[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:59:40.025703   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:42449
I20260709 12:59:40.027268   431 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:59:40.028301   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:40.056069   440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:40.056571   438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:40.058346   437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:41.379109   431 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
W20260709 12:59:41.379374   439 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
I20260709 12:59:41.382778   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:41.383000   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:41.383157   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601981383141 us; error 0 us; skew 500 ppm
I20260709 12:59:41.383937   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:41.391065   431 webserver.cc:533] Webserver started at http://127.0.107.254:46673/ using document root <none> and password file <none>
I20260709 12:59:41.391960   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:41.392158   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:41.392607   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:41.399268   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601979855482-431-0/minicluster-data/master-0-root/instance:
uuid: "83e1609cc5214144909294451d5530c8"
format_stamp: "Formatted at 2026-07-09 12:59:41 on dist-test-slave-g4pn"
I20260709 12:59:41.409336   431 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.006s	sys 0.005s
I20260709 12:59:41.415863   446 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:41.417207   431 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:59:41.417578   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601979855482-431-0/minicluster-data/master-0-root
uuid: "83e1609cc5214144909294451d5530c8"
format_stamp: "Formatted at 2026-07-09 12:59:41 on dist-test-slave-g4pn"
I20260709 12:59:41.417951   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601979855482-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601979855482-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601979855482-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:41.484762   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:41.486830   431 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:59:41.487428   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:41.668284   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:42449
I20260709 12:59:41.668486   497 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:42449 every 8 connection(s)
I20260709 12:59:41.679960   498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.712157   498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83e1609cc5214144909294451d5530c8: Bootstrap starting.
I20260709 12:59:41.722182   498 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 83e1609cc5214144909294451d5530c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:41.725399   498 log.cc:826] T 00000000000000000000000000000000 P 83e1609cc5214144909294451d5530c8: Log is configured to *not* fsync() on all Append() calls
I20260709 12:59:41.733187   498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83e1609cc5214144909294451d5530c8: No bootstrap required, opened a new log
I20260709 12:59:41.762787   498 raft_consensus.cc:359] T 00000000000000000000000000000000 P 83e1609cc5214144909294451d5530c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83e1609cc5214144909294451d5530c8" member_type: VOTER }
I20260709 12:59:41.763532   498 raft_consensus.cc:385] T 00000000000000000000000000000000 P 83e1609cc5214144909294451d5530c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:41.763942   498 raft_consensus.cc:740] T 00000000000000000000000000000000 P 83e1609cc5214144909294451d5530c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83e1609cc5214144909294451d5530c8, State: Initialized, Role: FOLLOWER
I20260709 12:59:41.764979   498 consensus_queue.cc:260] T 00000000000000000000000000000000 P 83e1609cc5214144909294451d5530c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83e1609cc5214144909294451d5530c8" member_type: VOTER }
I20260709 12:59:41.765638   498 raft_consensus.cc:399] T 00000000000000000000000000000000 P 83e1609cc5214144909294451d5530c8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:59:41.765951   498 raft_consensus.cc:493] T 00000000000000000000000000000000 P 83e1609cc5214144909294451d5530c8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:59:41.766330   498 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 83e1609cc5214144909294451d5530c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:41.772665   498 raft_consensus.cc:515] T 00000000000000000000000000000000 P 83e1609cc5214144909294451d5530c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83e1609cc5214144909294451d5530c8" member_type: VOTER }
I20260709 12:59:41.773556   498 leader_election.cc:304] T 00000000000000000000000000000000 P 83e1609cc5214144909294451d5530c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 83e1609cc5214144909294451d5530c8; no voters: 
I20260709 12:59:41.777366   498 leader_election.cc:290] T 00000000000000000000000000000000 P 83e1609cc5214144909294451d5530c8 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:59:41.777878   501 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 83e1609cc5214144909294451d5530c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:41.785811   501 raft_consensus.cc:697] T 00000000000000000000000000000000 P 83e1609cc5214144909294451d5530c8 [term 1 LEADER]: Becoming Leader. State: Replica: 83e1609cc5214144909294451d5530c8, State: Running, Role: LEADER
I20260709 12:59:41.788055   501 consensus_queue.cc:237] T 00000000000000000000000000000000 P 83e1609cc5214144909294451d5530c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83e1609cc5214144909294451d5530c8" member_type: VOTER }
I20260709 12:59:41.789812   498 sys_catalog.cc:565] T 00000000000000000000000000000000 P 83e1609cc5214144909294451d5530c8 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:59:41.814847   503 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83e1609cc5214144909294451d5530c8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "83e1609cc5214144909294451d5530c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83e1609cc5214144909294451d5530c8" member_type: VOTER } }
I20260709 12:59:41.816066   503 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83e1609cc5214144909294451d5530c8 [sys.catalog]: This master's current role is: LEADER
I20260709 12:59:41.816318   502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83e1609cc5214144909294451d5530c8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83e1609cc5214144909294451d5530c8. Latest consensus state: current_term: 1 leader_uuid: "83e1609cc5214144909294451d5530c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83e1609cc5214144909294451d5530c8" member_type: VOTER } }
I20260709 12:59:41.817371   502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83e1609cc5214144909294451d5530c8 [sys.catalog]: This master's current role is: LEADER
I20260709 12:59:41.823741   510 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:59:41.840803   510 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:59:41.863894   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:59:41.879335   510 catalog_manager.cc:1383] Generated new cluster ID: 2b61544fe3c64299a81f224d6ae7f070
I20260709 12:59:41.879704   510 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:59:41.905673   510 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:59:41.908044   510 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:59:41.937403   510 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 83e1609cc5214144909294451d5530c8: Generated new TSK 0
I20260709 12:59:41.938690   510 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:59:42.004726   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:42.019220   520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:42.022881   521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:42.034094   431 server_base.cc:1061] running on GCE node
W20260709 12:59:42.035562   523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:42.036710   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:42.036932   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:42.037178   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601982037149 us; error 0 us; skew 500 ppm
I20260709 12:59:42.037804   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:42.045853   431 webserver.cc:533] Webserver started at http://127.0.107.193:41345/ using document root <none> and password file <none>
I20260709 12:59:42.046487   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:42.046728   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:42.047039   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:42.048430   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601979855482-431-0/minicluster-data/ts-0-root/instance:
uuid: "800d84c2f42d4aabac1286f0b27d4ccb"
format_stamp: "Formatted at 2026-07-09 12:59:42 on dist-test-slave-g4pn"
I20260709 12:59:42.057943   431 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.004s	sys 0.003s
I20260709 12:59:42.066646   528 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:42.067760   431 fs_manager.cc:730] Time spent opening block manager: real 0.007s	user 0.002s	sys 0.006s
I20260709 12:59:42.068068   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601979855482-431-0/minicluster-data/ts-0-root
uuid: "800d84c2f42d4aabac1286f0b27d4ccb"
format_stamp: "Formatted at 2026-07-09 12:59:42 on dist-test-slave-g4pn"
I20260709 12:59:42.068356   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601979855482-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601979855482-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601979855482-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:42.109359   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:42.111505   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:42.117347   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:42.125442   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:42.125670   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:42.126031   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:42.126188   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:42.353547   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:43201
I20260709 12:59:42.355716   590 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:43201 every 8 connection(s)
I20260709 12:59:42.374745   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:42.390640   595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:42.403653   596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:42.417817   598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:42.422091   431 server_base.cc:1061] running on GCE node
I20260709 12:59:42.423399   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:42.423651   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:42.423975   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601982423954 us; error 0 us; skew 500 ppm
I20260709 12:59:42.424585   591 heartbeater.cc:344] Connected to a master server at 127.0.107.254:42449
I20260709 12:59:42.424821   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:42.425258   591 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:42.427280   591 heartbeater.cc:507] Master 127.0.107.254:42449 requested a full tablet report, sending...
I20260709 12:59:42.428795   431 webserver.cc:533] Webserver started at http://127.0.107.194:36181/ using document root <none> and password file <none>
I20260709 12:59:42.429699   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:42.429991   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:42.430236   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:42.431321   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601979855482-431-0/minicluster-data/ts-1-root/instance:
uuid: "4ab595233c1b47d2980dcad8b04a45e3"
format_stamp: "Formatted at 2026-07-09 12:59:42 on dist-test-slave-g4pn"
I20260709 12:59:42.431802   463 ts_manager.cc:194] Registered new tserver with Master: 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201)
I20260709 12:59:42.436049   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59182
I20260709 12:59:42.438971   431 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.003s
I20260709 12:59:42.443702   603 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:42.444677   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.001s
I20260709 12:59:42.445013   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601979855482-431-0/minicluster-data/ts-1-root
uuid: "4ab595233c1b47d2980dcad8b04a45e3"
format_stamp: "Formatted at 2026-07-09 12:59:42 on dist-test-slave-g4pn"
I20260709 12:59:42.445407   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601979855482-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601979855482-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601979855482-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:42.480314   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:42.482897   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:42.485932   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:42.490242   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:42.490540   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:42.490835   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:42.491042   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:42.762885   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:42299
I20260709 12:59:42.763371   665 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:42299 every 8 connection(s)
I20260709 12:59:42.783582   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:42.803176   669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:42.805851   666 heartbeater.cc:344] Connected to a master server at 127.0.107.254:42449
I20260709 12:59:42.806413   666 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:42.809197   666 heartbeater.cc:507] Master 127.0.107.254:42449 requested a full tablet report, sending...
I20260709 12:59:42.813496   463 ts_manager.cc:194] Registered new tserver with Master: 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299)
I20260709 12:59:42.816833   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59188
W20260709 12:59:42.819469   670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:42.824592   431 server_base.cc:1061] running on GCE node
W20260709 12:59:42.824929   672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:42.826678   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:42.826932   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:42.827134   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601982827117 us; error 0 us; skew 500 ppm
I20260709 12:59:42.827711   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:42.831275   431 webserver.cc:533] Webserver started at http://127.0.107.195:46525/ using document root <none> and password file <none>
I20260709 12:59:42.831800   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:42.832036   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:42.832324   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:42.833528   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601979855482-431-0/minicluster-data/ts-2-root/instance:
uuid: "c5c35c4177154a2aa180bef5b4eb32b7"
format_stamp: "Formatted at 2026-07-09 12:59:42 on dist-test-slave-g4pn"
I20260709 12:59:42.838860   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:59:42.842726   677 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:42.843730   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 12:59:42.844084   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601979855482-431-0/minicluster-data/ts-2-root
uuid: "c5c35c4177154a2aa180bef5b4eb32b7"
format_stamp: "Formatted at 2026-07-09 12:59:42 on dist-test-slave-g4pn"
I20260709 12:59:42.844391   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601979855482-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601979855482-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601979855482-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:42.863144   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:42.864580   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:42.867643   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:42.871603   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:42.871803   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:42.872128   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:42.872289   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:43.140699   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:42179
I20260709 12:59:43.142721   739 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:42179 every 8 connection(s)
I20260709 12:59:43.182859   740 heartbeater.cc:344] Connected to a master server at 127.0.107.254:42449
I20260709 12:59:43.183358   740 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:43.184581   740 heartbeater.cc:507] Master 127.0.107.254:42449 requested a full tablet report, sending...
I20260709 12:59:43.187624   463 ts_manager.cc:194] Registered new tserver with Master: c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179)
I20260709 12:59:43.188323   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.025996611s
I20260709 12:59:43.190243   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59202
I20260709 12:59:43.299180   463 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59218:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:59:43.307374   463 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:59:43.441119   591 heartbeater.cc:499] Master 127.0.107.254:42449 was elected leader, sending a full tablet report...
I20260709 12:59:43.537421   702 tablet_service.cc:1511] Processing CreateTablet for tablet 78aff2e266df4a51b635f6b10ce9600a (DEFAULT_TABLE table=test-workload [id=a166c132eba34fa1a30a8938b204ea92]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:59:43.534723   705 tablet_service.cc:1511] Processing CreateTablet for tablet 018df5b57c524579ab3bb24c61a13e54 (DEFAULT_TABLE table=test-workload [id=a166c132eba34fa1a30a8938b204ea92]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:59:43.527220   556 tablet_service.cc:1511] Processing CreateTablet for tablet 018df5b57c524579ab3bb24c61a13e54 (DEFAULT_TABLE table=test-workload [id=a166c132eba34fa1a30a8938b204ea92]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:59:43.556666   702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78aff2e266df4a51b635f6b10ce9600a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:43.559795   555 tablet_service.cc:1511] Processing CreateTablet for tablet 768734dfe27846478ec2b650e2289608 (DEFAULT_TABLE table=test-workload [id=a166c132eba34fa1a30a8938b204ea92]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:59:43.540458   554 tablet_service.cc:1511] Processing CreateTablet for tablet 8a146a08439145c189f2d8111591a7e4 (DEFAULT_TABLE table=test-workload [id=a166c132eba34fa1a30a8938b204ea92]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:59:43.553522   704 tablet_service.cc:1511] Processing CreateTablet for tablet 768734dfe27846478ec2b650e2289608 (DEFAULT_TABLE table=test-workload [id=a166c132eba34fa1a30a8938b204ea92]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:59:43.568305   556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 018df5b57c524579ab3bb24c61a13e54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:43.556102   553 tablet_service.cc:1511] Processing CreateTablet for tablet 78aff2e266df4a51b635f6b10ce9600a (DEFAULT_TABLE table=test-workload [id=a166c132eba34fa1a30a8938b204ea92]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:59:43.557492   701 tablet_service.cc:1511] Processing CreateTablet for tablet 67696df2323642db84a45062c01e2d29 (DEFAULT_TABLE table=test-workload [id=a166c132eba34fa1a30a8938b204ea92]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:59:43.568665   703 tablet_service.cc:1511] Processing CreateTablet for tablet 8a146a08439145c189f2d8111591a7e4 (DEFAULT_TABLE table=test-workload [id=a166c132eba34fa1a30a8938b204ea92]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:59:43.573534   555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 768734dfe27846478ec2b650e2289608. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:43.562546   699 tablet_service.cc:1511] Processing CreateTablet for tablet d11d9c8b7a0c408696e8ad7ef2b1ae15 (DEFAULT_TABLE table=test-workload [id=a166c132eba34fa1a30a8938b204ea92]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:59:43.575223   705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 018df5b57c524579ab3bb24c61a13e54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:43.569823   700 tablet_service.cc:1511] Processing CreateTablet for tablet 52db24cb6b184170af5d6cc1b6ef0b2a (DEFAULT_TABLE table=test-workload [id=a166c132eba34fa1a30a8938b204ea92]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:59:43.578226   698 tablet_service.cc:1511] Processing CreateTablet for tablet ff561f1c72b14a8881b49a495683999a (DEFAULT_TABLE table=test-workload [id=a166c132eba34fa1a30a8938b204ea92]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:59:43.583302   549 tablet_service.cc:1511] Processing CreateTablet for tablet ff561f1c72b14a8881b49a495683999a (DEFAULT_TABLE table=test-workload [id=a166c132eba34fa1a30a8938b204ea92]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:59:43.591470   554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a146a08439145c189f2d8111591a7e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:43.580266   552 tablet_service.cc:1511] Processing CreateTablet for tablet 67696df2323642db84a45062c01e2d29 (DEFAULT_TABLE table=test-workload [id=a166c132eba34fa1a30a8938b204ea92]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:59:43.576447   551 tablet_service.cc:1511] Processing CreateTablet for tablet 52db24cb6b184170af5d6cc1b6ef0b2a (DEFAULT_TABLE table=test-workload [id=a166c132eba34fa1a30a8938b204ea92]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:59:43.585597   550 tablet_service.cc:1511] Processing CreateTablet for tablet d11d9c8b7a0c408696e8ad7ef2b1ae15 (DEFAULT_TABLE table=test-workload [id=a166c132eba34fa1a30a8938b204ea92]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:59:43.601996   701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67696df2323642db84a45062c01e2d29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:43.601725   548 tablet_service.cc:1511] Processing CreateTablet for tablet feed72ce7e2549d7a27dc7595bac0d3d (DEFAULT_TABLE table=test-workload [id=a166c132eba34fa1a30a8938b204ea92]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:59:43.606523   553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78aff2e266df4a51b635f6b10ce9600a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:43.605675   630 tablet_service.cc:1511] Processing CreateTablet for tablet 768734dfe27846478ec2b650e2289608 (DEFAULT_TABLE table=test-workload [id=a166c132eba34fa1a30a8938b204ea92]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:59:43.618680   703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a146a08439145c189f2d8111591a7e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:43.621050   549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff561f1c72b14a8881b49a495683999a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:43.623103   630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 768734dfe27846478ec2b650e2289608. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:43.606564   631 tablet_service.cc:1511] Processing CreateTablet for tablet 018df5b57c524579ab3bb24c61a13e54 (DEFAULT_TABLE table=test-workload [id=a166c132eba34fa1a30a8938b204ea92]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:59:43.630410   550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d11d9c8b7a0c408696e8ad7ef2b1ae15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:43.628564   626 tablet_service.cc:1511] Processing CreateTablet for tablet 52db24cb6b184170af5d6cc1b6ef0b2a (DEFAULT_TABLE table=test-workload [id=a166c132eba34fa1a30a8938b204ea92]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:59:43.615108   628 tablet_service.cc:1511] Processing CreateTablet for tablet 78aff2e266df4a51b635f6b10ce9600a (DEFAULT_TABLE table=test-workload [id=a166c132eba34fa1a30a8938b204ea92]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:59:43.640880   697 tablet_service.cc:1511] Processing CreateTablet for tablet feed72ce7e2549d7a27dc7595bac0d3d (DEFAULT_TABLE table=test-workload [id=a166c132eba34fa1a30a8938b204ea92]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:59:43.635432   627 tablet_service.cc:1511] Processing CreateTablet for tablet 67696df2323642db84a45062c01e2d29 (DEFAULT_TABLE table=test-workload [id=a166c132eba34fa1a30a8938b204ea92]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:59:43.641011   625 tablet_service.cc:1511] Processing CreateTablet for tablet d11d9c8b7a0c408696e8ad7ef2b1ae15 (DEFAULT_TABLE table=test-workload [id=a166c132eba34fa1a30a8938b204ea92]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:59:43.637393   704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 768734dfe27846478ec2b650e2289608. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:43.628542   629 tablet_service.cc:1511] Processing CreateTablet for tablet 8a146a08439145c189f2d8111591a7e4 (DEFAULT_TABLE table=test-workload [id=a166c132eba34fa1a30a8938b204ea92]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:59:43.652462   631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 018df5b57c524579ab3bb24c61a13e54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:43.656775   628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78aff2e266df4a51b635f6b10ce9600a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:43.657070   551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52db24cb6b184170af5d6cc1b6ef0b2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:43.668879   629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a146a08439145c189f2d8111591a7e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:43.666070   624 tablet_service.cc:1511] Processing CreateTablet for tablet ff561f1c72b14a8881b49a495683999a (DEFAULT_TABLE table=test-workload [id=a166c132eba34fa1a30a8938b204ea92]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:59:43.709841   700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52db24cb6b184170af5d6cc1b6ef0b2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:43.714229   627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67696df2323642db84a45062c01e2d29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:43.714497   698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff561f1c72b14a8881b49a495683999a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:43.705861   623 tablet_service.cc:1511] Processing CreateTablet for tablet feed72ce7e2549d7a27dc7595bac0d3d (DEFAULT_TABLE table=test-workload [id=a166c132eba34fa1a30a8938b204ea92]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:59:43.719206   699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d11d9c8b7a0c408696e8ad7ef2b1ae15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:43.720854   548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feed72ce7e2549d7a27dc7595bac0d3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:43.726378   552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67696df2323642db84a45062c01e2d29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:43.726588   697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feed72ce7e2549d7a27dc7595bac0d3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:43.726604   625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d11d9c8b7a0c408696e8ad7ef2b1ae15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:43.772341   626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52db24cb6b184170af5d6cc1b6ef0b2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:43.784617   623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feed72ce7e2549d7a27dc7595bac0d3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:43.788961   624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff561f1c72b14a8881b49a495683999a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:43.824987   666 heartbeater.cc:499] Master 127.0.107.254:42449 was elected leader, sending a full tablet report...
W20260709 12:59:43.834185   511 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:43.883091   759 tablet_bootstrap.cc:492] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7: Bootstrap starting.
I20260709 12:59:44.113646   760 tablet_bootstrap.cc:492] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb: Bootstrap starting.
I20260709 12:59:44.171240   759 tablet_bootstrap.cc:654] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:44.186725   761 tablet_bootstrap.cc:492] T 78aff2e266df4a51b635f6b10ce9600a P 4ab595233c1b47d2980dcad8b04a45e3: Bootstrap starting.
I20260709 12:59:44.192196   760 tablet_bootstrap.cc:654] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:44.194928   740 heartbeater.cc:499] Master 127.0.107.254:42449 was elected leader, sending a full tablet report...
I20260709 12:59:44.209275   759 tablet_bootstrap.cc:492] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7: No bootstrap required, opened a new log
I20260709 12:59:44.209896   759 ts_tablet_manager.cc:1403] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7: Time spent bootstrapping tablet: real 0.332s	user 0.013s	sys 0.013s
I20260709 12:59:44.219445   759 raft_consensus.cc:359] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:44.220865   759 raft_consensus.cc:385] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:44.221402   759 raft_consensus.cc:740] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5c35c4177154a2aa180bef5b4eb32b7, State: Initialized, Role: FOLLOWER
I20260709 12:59:44.222728   759 consensus_queue.cc:260] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:44.225736   761 tablet_bootstrap.cc:654] T 78aff2e266df4a51b635f6b10ce9600a P 4ab595233c1b47d2980dcad8b04a45e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:44.227397   760 tablet_bootstrap.cc:492] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb: No bootstrap required, opened a new log
I20260709 12:59:44.228047   760 ts_tablet_manager.cc:1403] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb: Time spent bootstrapping tablet: real 0.125s	user 0.015s	sys 0.008s
I20260709 12:59:44.234571   760 raft_consensus.cc:359] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } } peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } }
I20260709 12:59:44.235536   760 raft_consensus.cc:385] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:44.236002   760 raft_consensus.cc:740] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 800d84c2f42d4aabac1286f0b27d4ccb, State: Initialized, Role: FOLLOWER
I20260709 12:59:44.240823   759 ts_tablet_manager.cc:1434] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7: Time spent starting tablet: real 0.031s	user 0.000s	sys 0.020s
I20260709 12:59:44.242046   759 tablet_bootstrap.cc:492] T ff561f1c72b14a8881b49a495683999a P c5c35c4177154a2aa180bef5b4eb32b7: Bootstrap starting.
I20260709 12:59:44.237103   760 consensus_queue.cc:260] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } } peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } }
I20260709 12:59:44.258831   761 tablet_bootstrap.cc:492] T 78aff2e266df4a51b635f6b10ce9600a P 4ab595233c1b47d2980dcad8b04a45e3: No bootstrap required, opened a new log
I20260709 12:59:44.259506   761 ts_tablet_manager.cc:1403] T 78aff2e266df4a51b635f6b10ce9600a P 4ab595233c1b47d2980dcad8b04a45e3: Time spent bootstrapping tablet: real 0.085s	user 0.013s	sys 0.018s
I20260709 12:59:44.265793   761 raft_consensus.cc:359] T 78aff2e266df4a51b635f6b10ce9600a P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:44.266422   759 tablet_bootstrap.cc:654] T ff561f1c72b14a8881b49a495683999a P c5c35c4177154a2aa180bef5b4eb32b7: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:44.266803   761 raft_consensus.cc:385] T 78aff2e266df4a51b635f6b10ce9600a P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:44.267299   761 raft_consensus.cc:740] T 78aff2e266df4a51b635f6b10ce9600a P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ab595233c1b47d2980dcad8b04a45e3, State: Initialized, Role: FOLLOWER
I20260709 12:59:44.270377   761 consensus_queue.cc:260] T 78aff2e266df4a51b635f6b10ce9600a P 4ab595233c1b47d2980dcad8b04a45e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:44.271600   760 ts_tablet_manager.cc:1434] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb: Time spent starting tablet: real 0.043s	user 0.011s	sys 0.022s
I20260709 12:59:44.273193   760 tablet_bootstrap.cc:492] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb: Bootstrap starting.
I20260709 12:59:44.282840   761 ts_tablet_manager.cc:1434] T 78aff2e266df4a51b635f6b10ce9600a P 4ab595233c1b47d2980dcad8b04a45e3: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.015s
I20260709 12:59:44.284487   761 tablet_bootstrap.cc:492] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3: Bootstrap starting.
W20260709 12:59:44.287161   667 tablet.cc:2406] T 78aff2e266df4a51b635f6b10ce9600a P 4ab595233c1b47d2980dcad8b04a45e3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:59:44.290071   760 tablet_bootstrap.cc:654] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:44.306670   761 tablet_bootstrap.cc:654] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:44.317646   760 tablet_bootstrap.cc:492] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb: No bootstrap required, opened a new log
I20260709 12:59:44.318266   760 ts_tablet_manager.cc:1403] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb: Time spent bootstrapping tablet: real 0.045s	user 0.006s	sys 0.024s
I20260709 12:59:44.321379   759 tablet_bootstrap.cc:492] T ff561f1c72b14a8881b49a495683999a P c5c35c4177154a2aa180bef5b4eb32b7: No bootstrap required, opened a new log
I20260709 12:59:44.321921   761 tablet_bootstrap.cc:492] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3: No bootstrap required, opened a new log
I20260709 12:59:44.322037   759 ts_tablet_manager.cc:1403] T ff561f1c72b14a8881b49a495683999a P c5c35c4177154a2aa180bef5b4eb32b7: Time spent bootstrapping tablet: real 0.080s	user 0.010s	sys 0.018s
I20260709 12:59:44.322850   761 ts_tablet_manager.cc:1403] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3: Time spent bootstrapping tablet: real 0.039s	user 0.007s	sys 0.023s
I20260709 12:59:44.323843   760 raft_consensus.cc:359] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:44.327486   760 raft_consensus.cc:385] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:44.329531   760 raft_consensus.cc:740] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 800d84c2f42d4aabac1286f0b27d4ccb, State: Initialized, Role: FOLLOWER
I20260709 12:59:44.334628   759 raft_consensus.cc:359] T ff561f1c72b14a8881b49a495683999a P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:44.333623   760 consensus_queue.cc:260] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:44.338063   759 raft_consensus.cc:385] T ff561f1c72b14a8881b49a495683999a P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:44.342162   761 raft_consensus.cc:359] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:44.345976   761 raft_consensus.cc:385] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:44.348985   761 raft_consensus.cc:740] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ab595233c1b47d2980dcad8b04a45e3, State: Initialized, Role: FOLLOWER
I20260709 12:59:44.349988   760 ts_tablet_manager.cc:1434] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb: Time spent starting tablet: real 0.031s	user 0.027s	sys 0.004s
I20260709 12:59:44.355252   760 tablet_bootstrap.cc:492] T ff561f1c72b14a8881b49a495683999a P 800d84c2f42d4aabac1286f0b27d4ccb: Bootstrap starting.
I20260709 12:59:44.354306   761 consensus_queue.cc:260] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:44.371959   761 ts_tablet_manager.cc:1434] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3: Time spent starting tablet: real 0.048s	user 0.034s	sys 0.007s
I20260709 12:59:44.376454   761 tablet_bootstrap.cc:492] T ff561f1c72b14a8881b49a495683999a P 4ab595233c1b47d2980dcad8b04a45e3: Bootstrap starting.
I20260709 12:59:44.339517   759 raft_consensus.cc:740] T ff561f1c72b14a8881b49a495683999a P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5c35c4177154a2aa180bef5b4eb32b7, State: Initialized, Role: FOLLOWER
I20260709 12:59:44.398319   760 tablet_bootstrap.cc:654] T ff561f1c72b14a8881b49a495683999a P 800d84c2f42d4aabac1286f0b27d4ccb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:44.407153   767 raft_consensus.cc:493] T 78aff2e266df4a51b635f6b10ce9600a P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.410374   767 raft_consensus.cc:515] T 78aff2e266df4a51b635f6b10ce9600a P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:44.396483   759 consensus_queue.cc:260] T ff561f1c72b14a8881b49a495683999a P c5c35c4177154a2aa180bef5b4eb32b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:44.436314   759 ts_tablet_manager.cc:1434] T ff561f1c72b14a8881b49a495683999a P c5c35c4177154a2aa180bef5b4eb32b7: Time spent starting tablet: real 0.113s	user 0.026s	sys 0.003s
I20260709 12:59:44.442049   761 tablet_bootstrap.cc:654] T ff561f1c72b14a8881b49a495683999a P 4ab595233c1b47d2980dcad8b04a45e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:44.441736   759 tablet_bootstrap.cc:492] T 018df5b57c524579ab3bb24c61a13e54 P c5c35c4177154a2aa180bef5b4eb32b7: Bootstrap starting.
I20260709 12:59:44.455150   767 leader_election.cc:290] T 78aff2e266df4a51b635f6b10ce9600a P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201), c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179)
I20260709 12:59:44.470582   764 raft_consensus.cc:493] T ff561f1c72b14a8881b49a495683999a P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.473812   764 raft_consensus.cc:515] T ff561f1c72b14a8881b49a495683999a P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:44.521858   767 raft_consensus.cc:493] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.526120   767 raft_consensus.cc:515] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:44.560316   766 raft_consensus.cc:493] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.573597   766 raft_consensus.cc:515] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:44.579093   764 leader_election.cc:290] T ff561f1c72b14a8881b49a495683999a P c5c35c4177154a2aa180bef5b4eb32b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201), 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299)
I20260709 12:59:44.615162   760 tablet_bootstrap.cc:492] T ff561f1c72b14a8881b49a495683999a P 800d84c2f42d4aabac1286f0b27d4ccb: No bootstrap required, opened a new log
I20260709 12:59:44.618522   760 ts_tablet_manager.cc:1403] T ff561f1c72b14a8881b49a495683999a P 800d84c2f42d4aabac1286f0b27d4ccb: Time spent bootstrapping tablet: real 0.264s	user 0.057s	sys 0.045s
I20260709 12:59:44.634142   767 leader_election.cc:290] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201), c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179)
I20260709 12:59:44.624195   764 raft_consensus.cc:493] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.642339   764 raft_consensus.cc:515] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:44.737236   766 leader_election.cc:290] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299), c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179)
I20260709 12:59:44.742846   764 leader_election.cc:290] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201), 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299)
I20260709 12:59:44.773453   760 raft_consensus.cc:359] T ff561f1c72b14a8881b49a495683999a P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:44.794309   760 raft_consensus.cc:385] T ff561f1c72b14a8881b49a495683999a P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:44.791926   759 tablet_bootstrap.cc:654] T 018df5b57c524579ab3bb24c61a13e54 P c5c35c4177154a2aa180bef5b4eb32b7: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:44.796458   760 raft_consensus.cc:740] T ff561f1c72b14a8881b49a495683999a P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 800d84c2f42d4aabac1286f0b27d4ccb, State: Initialized, Role: FOLLOWER
I20260709 12:59:44.828720   760 consensus_queue.cc:260] T ff561f1c72b14a8881b49a495683999a P 800d84c2f42d4aabac1286f0b27d4ccb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
W20260709 12:59:44.845712   511 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:44.901872   761 tablet_bootstrap.cc:492] T ff561f1c72b14a8881b49a495683999a P 4ab595233c1b47d2980dcad8b04a45e3: No bootstrap required, opened a new log
I20260709 12:59:44.902426   761 ts_tablet_manager.cc:1403] T ff561f1c72b14a8881b49a495683999a P 4ab595233c1b47d2980dcad8b04a45e3: Time spent bootstrapping tablet: real 0.527s	user 0.072s	sys 0.109s
I20260709 12:59:44.898202   766 raft_consensus.cc:493] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.905442   766 raft_consensus.cc:515] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } } peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } }
I20260709 12:59:44.908025   766 leader_election.cc:290] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179), 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299)
I20260709 12:59:44.929231   760 ts_tablet_manager.cc:1434] T ff561f1c72b14a8881b49a495683999a P 800d84c2f42d4aabac1286f0b27d4ccb: Time spent starting tablet: real 0.309s	user 0.024s	sys 0.018s
I20260709 12:59:44.932404   761 raft_consensus.cc:359] T ff561f1c72b14a8881b49a495683999a P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:44.933462   761 raft_consensus.cc:385] T ff561f1c72b14a8881b49a495683999a P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:44.933887   761 raft_consensus.cc:740] T ff561f1c72b14a8881b49a495683999a P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ab595233c1b47d2980dcad8b04a45e3, State: Initialized, Role: FOLLOWER
I20260709 12:59:44.934834   761 consensus_queue.cc:260] T ff561f1c72b14a8881b49a495683999a P 4ab595233c1b47d2980dcad8b04a45e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:44.939909   760 tablet_bootstrap.cc:492] T 78aff2e266df4a51b635f6b10ce9600a P 800d84c2f42d4aabac1286f0b27d4ccb: Bootstrap starting.
I20260709 12:59:44.940713   761 ts_tablet_manager.cc:1434] T ff561f1c72b14a8881b49a495683999a P 4ab595233c1b47d2980dcad8b04a45e3: Time spent starting tablet: real 0.038s	user 0.004s	sys 0.004s
I20260709 12:59:44.954197   761 tablet_bootstrap.cc:492] T 8a146a08439145c189f2d8111591a7e4 P 4ab595233c1b47d2980dcad8b04a45e3: Bootstrap starting.
I20260709 12:59:44.968777   759 tablet_bootstrap.cc:492] T 018df5b57c524579ab3bb24c61a13e54 P c5c35c4177154a2aa180bef5b4eb32b7: No bootstrap required, opened a new log
I20260709 12:59:44.969394   759 ts_tablet_manager.cc:1403] T 018df5b57c524579ab3bb24c61a13e54 P c5c35c4177154a2aa180bef5b4eb32b7: Time spent bootstrapping tablet: real 0.529s	user 0.053s	sys 0.066s
I20260709 12:59:45.012799   767 raft_consensus.cc:493] T ff561f1c72b14a8881b49a495683999a P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.010228   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff561f1c72b14a8881b49a495683999a" candidate_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" is_pre_election: true
I20260709 12:59:45.013540   767 raft_consensus.cc:515] T ff561f1c72b14a8881b49a495683999a P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.015481   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78aff2e266df4a51b635f6b10ce9600a" candidate_uuid: "4ab595233c1b47d2980dcad8b04a45e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" is_pre_election: true
I20260709 12:59:45.014642   566 raft_consensus.cc:2468] T ff561f1c72b14a8881b49a495683999a P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5c35c4177154a2aa180bef5b4eb32b7 in term 0.
I20260709 12:59:45.018185   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67696df2323642db84a45062c01e2d29" candidate_uuid: "4ab595233c1b47d2980dcad8b04a45e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" is_pre_election: true
I20260709 12:59:45.016222   759 raft_consensus.cc:359] T 018df5b57c524579ab3bb24c61a13e54 P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } } peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } }
I20260709 12:59:45.015533   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a146a08439145c189f2d8111591a7e4" candidate_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" is_pre_election: true
I20260709 12:59:45.020740   759 raft_consensus.cc:385] T 018df5b57c524579ab3bb24c61a13e54 P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:45.025135   759 raft_consensus.cc:740] T 018df5b57c524579ab3bb24c61a13e54 P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5c35c4177154a2aa180bef5b4eb32b7, State: Initialized, Role: FOLLOWER
W20260709 12:59:45.028154   681 leader_election.cc:343] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:45.027593   767 leader_election.cc:290] T ff561f1c72b14a8881b49a495683999a P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201), c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179)
I20260709 12:59:45.031913   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff561f1c72b14a8881b49a495683999a" candidate_uuid: "4ab595233c1b47d2980dcad8b04a45e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" is_pre_election: true
I20260709 12:59:45.025899   759 consensus_queue.cc:260] T 018df5b57c524579ab3bb24c61a13e54 P c5c35c4177154a2aa180bef5b4eb32b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } } peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } }
I20260709 12:59:45.035528   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768734dfe27846478ec2b650e2289608" candidate_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3" is_pre_election: true
I20260709 12:59:45.038870   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67696df2323642db84a45062c01e2d29" candidate_uuid: "4ab595233c1b47d2980dcad8b04a45e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" is_pre_election: true
I20260709 12:59:45.028775   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78aff2e266df4a51b635f6b10ce9600a" candidate_uuid: "4ab595233c1b47d2980dcad8b04a45e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" is_pre_election: true
I20260709 12:59:45.035918   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018df5b57c524579ab3bb24c61a13e54" candidate_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3" is_pre_election: true
I20260709 12:59:45.046208   760 tablet_bootstrap.cc:654] T 78aff2e266df4a51b635f6b10ce9600a P 800d84c2f42d4aabac1286f0b27d4ccb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:45.034562   681 leader_election.cc:304] T ff561f1c72b14a8881b49a495683999a P c5c35c4177154a2aa180bef5b4eb32b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 800d84c2f42d4aabac1286f0b27d4ccb, c5c35c4177154a2aa180bef5b4eb32b7; no voters: 
I20260709 12:59:45.047154   759 ts_tablet_manager.cc:1434] T 018df5b57c524579ab3bb24c61a13e54 P c5c35c4177154a2aa180bef5b4eb32b7: Time spent starting tablet: real 0.077s	user 0.011s	sys 0.000s
I20260709 12:59:45.035924   565 raft_consensus.cc:2468] T ff561f1c72b14a8881b49a495683999a P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ab595233c1b47d2980dcad8b04a45e3 in term 0.
W20260709 12:59:45.050123   532 leader_election.cc:343] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:45.050566   759 tablet_bootstrap.cc:492] T feed72ce7e2549d7a27dc7595bac0d3d P c5c35c4177154a2aa180bef5b4eb32b7: Bootstrap starting.
I20260709 12:59:45.050463   775 raft_consensus.cc:2804] T ff561f1c72b14a8881b49a495683999a P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:45.051230   775 raft_consensus.cc:493] T ff561f1c72b14a8881b49a495683999a P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:45.052083   775 raft_consensus.cc:3060] T ff561f1c72b14a8881b49a495683999a P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:45.053254   532 leader_election.cc:343] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:45.056218   607 leader_election.cc:343] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:45.065382   607 leader_election.cc:343] T 78aff2e266df4a51b635f6b10ce9600a P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:45.066531   607 leader_election.cc:343] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:45.068755   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff561f1c72b14a8881b49a495683999a" candidate_uuid: "4ab595233c1b47d2980dcad8b04a45e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" is_pre_election: true
I20260709 12:59:45.075387   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768734dfe27846478ec2b650e2289608" candidate_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" is_pre_election: true
I20260709 12:59:45.076506   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018df5b57c524579ab3bb24c61a13e54" candidate_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" is_pre_election: true
I20260709 12:59:45.077986   713 raft_consensus.cc:2468] T 018df5b57c524579ab3bb24c61a13e54 P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 800d84c2f42d4aabac1286f0b27d4ccb in term 0.
I20260709 12:59:45.067591   607 leader_election.cc:304] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ab595233c1b47d2980dcad8b04a45e3; no voters: 800d84c2f42d4aabac1286f0b27d4ccb, c5c35c4177154a2aa180bef5b4eb32b7
W20260709 12:59:45.079517   532 leader_election.cc:343] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:45.081775   761 tablet_bootstrap.cc:654] T 8a146a08439145c189f2d8111591a7e4 P 4ab595233c1b47d2980dcad8b04a45e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:45.081485   532 leader_election.cc:304] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 800d84c2f42d4aabac1286f0b27d4ccb; no voters: 4ab595233c1b47d2980dcad8b04a45e3, c5c35c4177154a2aa180bef5b4eb32b7
I20260709 12:59:45.083019   766 raft_consensus.cc:2749] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:45.085857   532 leader_election.cc:304] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 800d84c2f42d4aabac1286f0b27d4ccb, c5c35c4177154a2aa180bef5b4eb32b7; no voters: 4ab595233c1b47d2980dcad8b04a45e3
I20260709 12:59:45.087121   766 raft_consensus.cc:2804] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:45.087661   766 raft_consensus.cc:493] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:45.088119   766 raft_consensus.cc:3060] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:45.088200   607 leader_election.cc:343] T 78aff2e266df4a51b635f6b10ce9600a P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:45.089298   767 raft_consensus.cc:2749] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:45.088943   607 leader_election.cc:304] T 78aff2e266df4a51b635f6b10ce9600a P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ab595233c1b47d2980dcad8b04a45e3; no voters: 800d84c2f42d4aabac1286f0b27d4ccb, c5c35c4177154a2aa180bef5b4eb32b7
I20260709 12:59:45.093030   767 raft_consensus.cc:2749] T 78aff2e266df4a51b635f6b10ce9600a P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:45.097498   607 leader_election.cc:304] T ff561f1c72b14a8881b49a495683999a P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ab595233c1b47d2980dcad8b04a45e3, 800d84c2f42d4aabac1286f0b27d4ccb; no voters: 
I20260709 12:59:45.098747   767 raft_consensus.cc:2804] T ff561f1c72b14a8881b49a495683999a P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:45.094682   775 raft_consensus.cc:515] T ff561f1c72b14a8881b49a495683999a P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.099282   767 raft_consensus.cc:493] T ff561f1c72b14a8881b49a495683999a P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:45.100445   767 raft_consensus.cc:3060] T ff561f1c72b14a8881b49a495683999a P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:45.101356   714 raft_consensus.cc:2393] T ff561f1c72b14a8881b49a495683999a P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ab595233c1b47d2980dcad8b04a45e3 in current term 1: Already voted for candidate c5c35c4177154a2aa180bef5b4eb32b7 in this term.
I20260709 12:59:45.102953   759 tablet_bootstrap.cc:654] T feed72ce7e2549d7a27dc7595bac0d3d P c5c35c4177154a2aa180bef5b4eb32b7: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:45.112603   761 tablet_bootstrap.cc:492] T 8a146a08439145c189f2d8111591a7e4 P 4ab595233c1b47d2980dcad8b04a45e3: No bootstrap required, opened a new log
I20260709 12:59:45.113361   761 ts_tablet_manager.cc:1403] T 8a146a08439145c189f2d8111591a7e4 P 4ab595233c1b47d2980dcad8b04a45e3: Time spent bootstrapping tablet: real 0.164s	user 0.009s	sys 0.013s
I20260709 12:59:45.115729   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff561f1c72b14a8881b49a495683999a" candidate_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb"
I20260709 12:59:45.116677   564 raft_consensus.cc:3060] T ff561f1c72b14a8881b49a495683999a P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:45.119333   775 leader_election.cc:290] T ff561f1c72b14a8881b49a495683999a P c5c35c4177154a2aa180bef5b4eb32b7 [CANDIDATE]: Term 1 election: Requested vote from peers 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201), 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299)
I20260709 12:59:45.117244   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff561f1c72b14a8881b49a495683999a" candidate_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3" is_pre_election: true
I20260709 12:59:45.121338   761 raft_consensus.cc:359] T 8a146a08439145c189f2d8111591a7e4 P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.126278   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff561f1c72b14a8881b49a495683999a" candidate_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3"
I20260709 12:59:45.124678   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a146a08439145c189f2d8111591a7e4" candidate_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3" is_pre_election: true
I20260709 12:59:45.122542   761 raft_consensus.cc:385] T 8a146a08439145c189f2d8111591a7e4 P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:45.122394   766 raft_consensus.cc:515] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } } peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } }
I20260709 12:59:45.131316   761 raft_consensus.cc:740] T 8a146a08439145c189f2d8111591a7e4 P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ab595233c1b47d2980dcad8b04a45e3, State: Initialized, Role: FOLLOWER
I20260709 12:59:45.133994   761 consensus_queue.cc:260] T 8a146a08439145c189f2d8111591a7e4 P 4ab595233c1b47d2980dcad8b04a45e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.134842   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018df5b57c524579ab3bb24c61a13e54" candidate_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7"
I20260709 12:59:45.135356   641 raft_consensus.cc:2468] T 8a146a08439145c189f2d8111591a7e4 P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5c35c4177154a2aa180bef5b4eb32b7 in term 0.
I20260709 12:59:45.135632   714 raft_consensus.cc:3060] T 018df5b57c524579ab3bb24c61a13e54 P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:45.141589   681 leader_election.cc:304] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ab595233c1b47d2980dcad8b04a45e3, c5c35c4177154a2aa180bef5b4eb32b7; no voters: 800d84c2f42d4aabac1286f0b27d4ccb
I20260709 12:59:45.142086   766 leader_election.cc:290] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 1 election: Requested vote from peers c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179), 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299)
I20260709 12:59:45.142938   775 raft_consensus.cc:2804] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:45.143468   775 raft_consensus.cc:493] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:45.144088   775 raft_consensus.cc:3060] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:45.147161   767 raft_consensus.cc:515] T ff561f1c72b14a8881b49a495683999a P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.148825   640 raft_consensus.cc:2393] T ff561f1c72b14a8881b49a495683999a P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5c35c4177154a2aa180bef5b4eb32b7 in current term 1: Already voted for candidate 4ab595233c1b47d2980dcad8b04a45e3 in this term.
I20260709 12:59:45.149642   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018df5b57c524579ab3bb24c61a13e54" candidate_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3"
W20260709 12:59:45.151582   532 leader_election.cc:343] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:45.151553   564 raft_consensus.cc:2468] T ff561f1c72b14a8881b49a495683999a P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5c35c4177154a2aa180bef5b4eb32b7 in term 1.
I20260709 12:59:45.154027   681 leader_election.cc:304] T ff561f1c72b14a8881b49a495683999a P c5c35c4177154a2aa180bef5b4eb32b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 800d84c2f42d4aabac1286f0b27d4ccb, c5c35c4177154a2aa180bef5b4eb32b7; no voters: 4ab595233c1b47d2980dcad8b04a45e3
I20260709 12:59:45.155148   764 raft_consensus.cc:2804] T ff561f1c72b14a8881b49a495683999a P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:45.175757   714 raft_consensus.cc:2468] T 018df5b57c524579ab3bb24c61a13e54 P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 800d84c2f42d4aabac1286f0b27d4ccb in term 1.
I20260709 12:59:45.172645   775 raft_consensus.cc:515] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.177966   532 leader_election.cc:304] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 800d84c2f42d4aabac1286f0b27d4ccb, c5c35c4177154a2aa180bef5b4eb32b7; no voters: 4ab595233c1b47d2980dcad8b04a45e3
I20260709 12:59:45.179803   766 raft_consensus.cc:2804] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:45.180179   775 leader_election.cc:290] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7 [CANDIDATE]: Term 1 election: Requested vote from peers 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201), 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299)
I20260709 12:59:45.182566   767 leader_election.cc:290] T ff561f1c72b14a8881b49a495683999a P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 1 election: Requested vote from peers 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201), c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179)
I20260709 12:59:45.186066   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a146a08439145c189f2d8111591a7e4" candidate_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb"
I20260709 12:59:45.188406   761 ts_tablet_manager.cc:1434] T 8a146a08439145c189f2d8111591a7e4 P 4ab595233c1b47d2980dcad8b04a45e3: Time spent starting tablet: real 0.074s	user 0.001s	sys 0.014s
I20260709 12:59:45.190232   761 tablet_bootstrap.cc:492] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3: Bootstrap starting.
I20260709 12:59:45.190527   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a146a08439145c189f2d8111591a7e4" candidate_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3"
I20260709 12:59:45.191440   639 raft_consensus.cc:3060] T 8a146a08439145c189f2d8111591a7e4 P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:45.193599   681 leader_election.cc:343] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:45.196473   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff561f1c72b14a8881b49a495683999a" candidate_uuid: "4ab595233c1b47d2980dcad8b04a45e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb"
I20260709 12:59:45.198553   564 raft_consensus.cc:2393] T ff561f1c72b14a8881b49a495683999a P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4ab595233c1b47d2980dcad8b04a45e3 in current term 1: Already voted for candidate c5c35c4177154a2aa180bef5b4eb32b7 in this term.
I20260709 12:59:45.198901   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff561f1c72b14a8881b49a495683999a" candidate_uuid: "4ab595233c1b47d2980dcad8b04a45e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7"
I20260709 12:59:45.213681   759 tablet_bootstrap.cc:492] T feed72ce7e2549d7a27dc7595bac0d3d P c5c35c4177154a2aa180bef5b4eb32b7: No bootstrap required, opened a new log
I20260709 12:59:45.211138   764 raft_consensus.cc:697] T ff561f1c72b14a8881b49a495683999a P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 LEADER]: Becoming Leader. State: Replica: c5c35c4177154a2aa180bef5b4eb32b7, State: Running, Role: LEADER
I20260709 12:59:45.216862   764 consensus_queue.cc:237] T ff561f1c72b14a8881b49a495683999a P c5c35c4177154a2aa180bef5b4eb32b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.214421   759 ts_tablet_manager.cc:1403] T feed72ce7e2549d7a27dc7595bac0d3d P c5c35c4177154a2aa180bef5b4eb32b7: Time spent bootstrapping tablet: real 0.164s	user 0.030s	sys 0.034s
I20260709 12:59:45.219399   639 raft_consensus.cc:2468] T 8a146a08439145c189f2d8111591a7e4 P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5c35c4177154a2aa180bef5b4eb32b7 in term 1.
I20260709 12:59:45.225185   760 tablet_bootstrap.cc:492] T 78aff2e266df4a51b635f6b10ce9600a P 800d84c2f42d4aabac1286f0b27d4ccb: No bootstrap required, opened a new log
I20260709 12:59:45.224876   681 leader_election.cc:304] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ab595233c1b47d2980dcad8b04a45e3, c5c35c4177154a2aa180bef5b4eb32b7; no voters: 800d84c2f42d4aabac1286f0b27d4ccb
I20260709 12:59:45.225973   760 ts_tablet_manager.cc:1403] T 78aff2e266df4a51b635f6b10ce9600a P 800d84c2f42d4aabac1286f0b27d4ccb: Time spent bootstrapping tablet: real 0.286s	user 0.042s	sys 0.019s
I20260709 12:59:45.227911   791 raft_consensus.cc:2804] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:45.229055   791 raft_consensus.cc:697] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 LEADER]: Becoming Leader. State: Replica: c5c35c4177154a2aa180bef5b4eb32b7, State: Running, Role: LEADER
I20260709 12:59:45.230516   791 consensus_queue.cc:237] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.234612   766 raft_consensus.cc:697] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 LEADER]: Becoming Leader. State: Replica: 800d84c2f42d4aabac1286f0b27d4ccb, State: Running, Role: LEADER
I20260709 12:59:45.236935   766 consensus_queue.cc:237] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } } peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } }
I20260709 12:59:45.243999   761 tablet_bootstrap.cc:654] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:45.248173   759 raft_consensus.cc:359] T feed72ce7e2549d7a27dc7595bac0d3d P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.249320   759 raft_consensus.cc:385] T feed72ce7e2549d7a27dc7595bac0d3d P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:45.249747   759 raft_consensus.cc:740] T feed72ce7e2549d7a27dc7595bac0d3d P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5c35c4177154a2aa180bef5b4eb32b7, State: Initialized, Role: FOLLOWER
I20260709 12:59:45.250916   759 consensus_queue.cc:260] T feed72ce7e2549d7a27dc7595bac0d3d P c5c35c4177154a2aa180bef5b4eb32b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.251641   760 raft_consensus.cc:359] T 78aff2e266df4a51b635f6b10ce9600a P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.253003   760 raft_consensus.cc:385] T 78aff2e266df4a51b635f6b10ce9600a P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:45.253527   760 raft_consensus.cc:740] T 78aff2e266df4a51b635f6b10ce9600a P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 800d84c2f42d4aabac1286f0b27d4ccb, State: Initialized, Role: FOLLOWER
I20260709 12:59:45.254793   760 consensus_queue.cc:260] T 78aff2e266df4a51b635f6b10ce9600a P 800d84c2f42d4aabac1286f0b27d4ccb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.255867   759 ts_tablet_manager.cc:1434] T feed72ce7e2549d7a27dc7595bac0d3d P c5c35c4177154a2aa180bef5b4eb32b7: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.004s
I20260709 12:59:45.258441   759 tablet_bootstrap.cc:492] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7: Bootstrap starting.
I20260709 12:59:45.262689   760 ts_tablet_manager.cc:1434] T 78aff2e266df4a51b635f6b10ce9600a P 800d84c2f42d4aabac1286f0b27d4ccb: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.008s
I20260709 12:59:45.276734   760 tablet_bootstrap.cc:492] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 800d84c2f42d4aabac1286f0b27d4ccb: Bootstrap starting.
I20260709 12:59:45.285591   607 leader_election.cc:304] T ff561f1c72b14a8881b49a495683999a P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ab595233c1b47d2980dcad8b04a45e3; no voters: 800d84c2f42d4aabac1286f0b27d4ccb, c5c35c4177154a2aa180bef5b4eb32b7
I20260709 12:59:45.289755   790 raft_consensus.cc:2749] T ff561f1c72b14a8881b49a495683999a P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:59:45.299088   759 tablet_bootstrap.cc:654] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:45.294404   462 catalog_manager.cc:5697] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb reported cstate change: term changed from 0 to 1, leader changed from <none> to 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193). New cstate: current_term: 1 leader_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:45.300810   461 catalog_manager.cc:5697] T ff561f1c72b14a8881b49a495683999a P c5c35c4177154a2aa180bef5b4eb32b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:45.306442   761 tablet_bootstrap.cc:492] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3: No bootstrap required, opened a new log
I20260709 12:59:45.307163   761 ts_tablet_manager.cc:1403] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3: Time spent bootstrapping tablet: real 0.117s	user 0.022s	sys 0.009s
I20260709 12:59:45.317703   761 raft_consensus.cc:359] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.319610   761 raft_consensus.cc:385] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:45.322466   761 raft_consensus.cc:740] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ab595233c1b47d2980dcad8b04a45e3, State: Initialized, Role: FOLLOWER
I20260709 12:59:45.326429   759 tablet_bootstrap.cc:492] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7: No bootstrap required, opened a new log
I20260709 12:59:45.327366   760 tablet_bootstrap.cc:654] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 800d84c2f42d4aabac1286f0b27d4ccb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:45.328574   759 ts_tablet_manager.cc:1403] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7: Time spent bootstrapping tablet: real 0.071s	user 0.017s	sys 0.014s
I20260709 12:59:45.327191   761 consensus_queue.cc:260] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.338016   761 ts_tablet_manager.cc:1434] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.005s
I20260709 12:59:45.339416   761 tablet_bootstrap.cc:492] T 52db24cb6b184170af5d6cc1b6ef0b2a P 4ab595233c1b47d2980dcad8b04a45e3: Bootstrap starting.
I20260709 12:59:45.347452   759 raft_consensus.cc:359] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.348645   759 raft_consensus.cc:385] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:45.349052   759 raft_consensus.cc:740] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5c35c4177154a2aa180bef5b4eb32b7, State: Initialized, Role: FOLLOWER
I20260709 12:59:45.350153   759 consensus_queue.cc:260] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.361120   761 tablet_bootstrap.cc:654] T 52db24cb6b184170af5d6cc1b6ef0b2a P 4ab595233c1b47d2980dcad8b04a45e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:45.384428   759 ts_tablet_manager.cc:1434] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7: Time spent starting tablet: real 0.055s	user 0.005s	sys 0.007s
I20260709 12:59:45.386791   759 tablet_bootstrap.cc:492] T 78aff2e266df4a51b635f6b10ce9600a P c5c35c4177154a2aa180bef5b4eb32b7: Bootstrap starting.
I20260709 12:59:45.390506   761 tablet_bootstrap.cc:492] T 52db24cb6b184170af5d6cc1b6ef0b2a P 4ab595233c1b47d2980dcad8b04a45e3: No bootstrap required, opened a new log
I20260709 12:59:45.391062   761 ts_tablet_manager.cc:1403] T 52db24cb6b184170af5d6cc1b6ef0b2a P 4ab595233c1b47d2980dcad8b04a45e3: Time spent bootstrapping tablet: real 0.052s	user 0.017s	sys 0.007s
I20260709 12:59:45.403205   759 tablet_bootstrap.cc:654] T 78aff2e266df4a51b635f6b10ce9600a P c5c35c4177154a2aa180bef5b4eb32b7: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:45.408967   761 raft_consensus.cc:359] T 52db24cb6b184170af5d6cc1b6ef0b2a P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.412194   761 raft_consensus.cc:385] T 52db24cb6b184170af5d6cc1b6ef0b2a P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:45.412705   761 raft_consensus.cc:740] T 52db24cb6b184170af5d6cc1b6ef0b2a P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ab595233c1b47d2980dcad8b04a45e3, State: Initialized, Role: FOLLOWER
I20260709 12:59:45.414033   761 consensus_queue.cc:260] T 52db24cb6b184170af5d6cc1b6ef0b2a P 4ab595233c1b47d2980dcad8b04a45e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.415817   760 tablet_bootstrap.cc:492] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 800d84c2f42d4aabac1286f0b27d4ccb: No bootstrap required, opened a new log
I20260709 12:59:45.416631   760 ts_tablet_manager.cc:1403] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 800d84c2f42d4aabac1286f0b27d4ccb: Time spent bootstrapping tablet: real 0.144s	user 0.000s	sys 0.029s
I20260709 12:59:45.423697   760 raft_consensus.cc:359] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.425132   764 raft_consensus.cc:493] T feed72ce7e2549d7a27dc7595bac0d3d P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.425863   764 raft_consensus.cc:515] T feed72ce7e2549d7a27dc7595bac0d3d P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.427244   761 ts_tablet_manager.cc:1434] T 52db24cb6b184170af5d6cc1b6ef0b2a P 4ab595233c1b47d2980dcad8b04a45e3: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.005s
I20260709 12:59:45.429497   761 tablet_bootstrap.cc:492] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3: Bootstrap starting.
I20260709 12:59:45.430723   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feed72ce7e2549d7a27dc7595bac0d3d" candidate_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" is_pre_election: true
W20260709 12:59:45.432971   681 leader_election.cc:343] T feed72ce7e2549d7a27dc7595bac0d3d P c5c35c4177154a2aa180bef5b4eb32b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:45.434814   764 leader_election.cc:290] T feed72ce7e2549d7a27dc7595bac0d3d P c5c35c4177154a2aa180bef5b4eb32b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201), 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299)
I20260709 12:59:45.437335   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feed72ce7e2549d7a27dc7595bac0d3d" candidate_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3" is_pre_election: true
I20260709 12:59:45.438319   759 tablet_bootstrap.cc:492] T 78aff2e266df4a51b635f6b10ce9600a P c5c35c4177154a2aa180bef5b4eb32b7: No bootstrap required, opened a new log
I20260709 12:59:45.425132   760 raft_consensus.cc:385] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:45.440275   759 ts_tablet_manager.cc:1403] T 78aff2e266df4a51b635f6b10ce9600a P c5c35c4177154a2aa180bef5b4eb32b7: Time spent bootstrapping tablet: real 0.054s	user 0.004s	sys 0.024s
W20260709 12:59:45.440189   681 leader_election.cc:343] T feed72ce7e2549d7a27dc7595bac0d3d P c5c35c4177154a2aa180bef5b4eb32b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:45.442718   681 leader_election.cc:304] T feed72ce7e2549d7a27dc7595bac0d3d P c5c35c4177154a2aa180bef5b4eb32b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5c35c4177154a2aa180bef5b4eb32b7; no voters: 4ab595233c1b47d2980dcad8b04a45e3, 800d84c2f42d4aabac1286f0b27d4ccb
I20260709 12:59:45.441121   760 raft_consensus.cc:740] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 800d84c2f42d4aabac1286f0b27d4ccb, State: Initialized, Role: FOLLOWER
I20260709 12:59:45.444010   764 raft_consensus.cc:2749] T feed72ce7e2549d7a27dc7595bac0d3d P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:45.444303   760 consensus_queue.cc:260] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 800d84c2f42d4aabac1286f0b27d4ccb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.443564   461 catalog_manager.cc:5697] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:45.447068   760 ts_tablet_manager.cc:1434] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 800d84c2f42d4aabac1286f0b27d4ccb: Time spent starting tablet: real 0.030s	user 0.011s	sys 0.000s
I20260709 12:59:45.448210   760 tablet_bootstrap.cc:492] T 52db24cb6b184170af5d6cc1b6ef0b2a P 800d84c2f42d4aabac1286f0b27d4ccb: Bootstrap starting.
I20260709 12:59:45.453490   761 tablet_bootstrap.cc:654] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:45.460618   759 raft_consensus.cc:359] T 78aff2e266df4a51b635f6b10ce9600a P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.461925   759 raft_consensus.cc:385] T 78aff2e266df4a51b635f6b10ce9600a P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:45.462507   759 raft_consensus.cc:740] T 78aff2e266df4a51b635f6b10ce9600a P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5c35c4177154a2aa180bef5b4eb32b7, State: Initialized, Role: FOLLOWER
I20260709 12:59:45.464064   759 consensus_queue.cc:260] T 78aff2e266df4a51b635f6b10ce9600a P c5c35c4177154a2aa180bef5b4eb32b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.468456   759 ts_tablet_manager.cc:1434] T 78aff2e266df4a51b635f6b10ce9600a P c5c35c4177154a2aa180bef5b4eb32b7: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.000s
I20260709 12:59:45.470060   760 tablet_bootstrap.cc:654] T 52db24cb6b184170af5d6cc1b6ef0b2a P 800d84c2f42d4aabac1286f0b27d4ccb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:45.478256   791 raft_consensus.cc:493] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.479123   791 raft_consensus.cc:515] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.482959   759 tablet_bootstrap.cc:492] T 52db24cb6b184170af5d6cc1b6ef0b2a P c5c35c4177154a2aa180bef5b4eb32b7: Bootstrap starting.
I20260709 12:59:45.482920   791 leader_election.cc:290] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201), 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299)
I20260709 12:59:45.485989   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768734dfe27846478ec2b650e2289608" candidate_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" is_pre_election: true
I20260709 12:59:45.487404   564 raft_consensus.cc:2468] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5c35c4177154a2aa180bef5b4eb32b7 in term 0.
I20260709 12:59:45.489741   681 leader_election.cc:304] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 800d84c2f42d4aabac1286f0b27d4ccb, c5c35c4177154a2aa180bef5b4eb32b7; no voters: 
I20260709 12:59:45.491246   791 raft_consensus.cc:2804] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:45.491815   791 raft_consensus.cc:493] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:45.492412   791 raft_consensus.cc:3060] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:45.485978   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768734dfe27846478ec2b650e2289608" candidate_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3" is_pre_election: true
W20260709 12:59:45.497473   681 leader_election.cc:343] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:45.528338   760 tablet_bootstrap.cc:492] T 52db24cb6b184170af5d6cc1b6ef0b2a P 800d84c2f42d4aabac1286f0b27d4ccb: No bootstrap required, opened a new log
I20260709 12:59:45.532356   760 ts_tablet_manager.cc:1403] T 52db24cb6b184170af5d6cc1b6ef0b2a P 800d84c2f42d4aabac1286f0b27d4ccb: Time spent bootstrapping tablet: real 0.084s	user 0.014s	sys 0.022s
I20260709 12:59:45.539095   761 tablet_bootstrap.cc:492] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3: No bootstrap required, opened a new log
I20260709 12:59:45.548283   761 ts_tablet_manager.cc:1403] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3: Time spent bootstrapping tablet: real 0.120s	user 0.030s	sys 0.030s
I20260709 12:59:45.548339   791 raft_consensus.cc:515] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.550976   790 raft_consensus.cc:493] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.552220   790 raft_consensus.cc:515] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.561400   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768734dfe27846478ec2b650e2289608" candidate_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb"
I20260709 12:59:45.563922   564 raft_consensus.cc:3060] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:45.571451   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11d9c8b7a0c408696e8ad7ef2b1ae15" candidate_uuid: "4ab595233c1b47d2980dcad8b04a45e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" is_pre_election: true
I20260709 12:59:45.546262   759 tablet_bootstrap.cc:654] T 52db24cb6b184170af5d6cc1b6ef0b2a P c5c35c4177154a2aa180bef5b4eb32b7: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:45.575268   791 leader_election.cc:290] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7 [CANDIDATE]: Term 1 election: Requested vote from peers 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201), 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299)
I20260709 12:59:45.575507   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11d9c8b7a0c408696e8ad7ef2b1ae15" candidate_uuid: "4ab595233c1b47d2980dcad8b04a45e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" is_pre_election: true
I20260709 12:59:45.584815   766 raft_consensus.cc:493] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.576850   790 leader_election.cc:290] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201), c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179)
I20260709 12:59:45.586294   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768734dfe27846478ec2b650e2289608" candidate_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3"
W20260709 12:59:45.588102   607 leader_election.cc:343] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:45.590159   766 raft_consensus.cc:515] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.600193   565 raft_consensus.cc:2468] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ab595233c1b47d2980dcad8b04a45e3 in term 0.
I20260709 12:59:45.602495   760 raft_consensus.cc:359] T 52db24cb6b184170af5d6cc1b6ef0b2a P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.616508   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11d9c8b7a0c408696e8ad7ef2b1ae15" candidate_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3" is_pre_election: true
I20260709 12:59:45.624466   640 raft_consensus.cc:2468] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 800d84c2f42d4aabac1286f0b27d4ccb in term 0.
I20260709 12:59:45.628091   532 leader_election.cc:304] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ab595233c1b47d2980dcad8b04a45e3, 800d84c2f42d4aabac1286f0b27d4ccb; no voters: 
I20260709 12:59:45.627745   766 leader_election.cc:290] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299), c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179)
I20260709 12:59:45.618480   760 raft_consensus.cc:385] T 52db24cb6b184170af5d6cc1b6ef0b2a P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:59:45.619300   681 leader_election.cc:343] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:45.634896   792 raft_consensus.cc:2804] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:45.637573   792 raft_consensus.cc:493] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:45.633062   761 raft_consensus.cc:359] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.638355   792 raft_consensus.cc:3060] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:45.638875   761 raft_consensus.cc:385] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:45.636837   760 raft_consensus.cc:740] T 52db24cb6b184170af5d6cc1b6ef0b2a P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 800d84c2f42d4aabac1286f0b27d4ccb, State: Initialized, Role: FOLLOWER
I20260709 12:59:45.645582   761 raft_consensus.cc:740] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ab595233c1b47d2980dcad8b04a45e3, State: Initialized, Role: FOLLOWER
I20260709 12:59:45.647145   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11d9c8b7a0c408696e8ad7ef2b1ae15" candidate_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" is_pre_election: true
I20260709 12:59:45.649037   791 consensus_queue.cc:1048] T ff561f1c72b14a8881b49a495683999a P c5c35c4177154a2aa180bef5b4eb32b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:45.657646   761 consensus_queue.cc:260] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.675634   564 raft_consensus.cc:2468] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5c35c4177154a2aa180bef5b4eb32b7 in term 1.
I20260709 12:59:45.676549   759 tablet_bootstrap.cc:492] T 52db24cb6b184170af5d6cc1b6ef0b2a P c5c35c4177154a2aa180bef5b4eb32b7: No bootstrap required, opened a new log
I20260709 12:59:45.689213   759 ts_tablet_manager.cc:1403] T 52db24cb6b184170af5d6cc1b6ef0b2a P c5c35c4177154a2aa180bef5b4eb32b7: Time spent bootstrapping tablet: real 0.207s	user 0.036s	sys 0.026s
I20260709 12:59:45.688900   681 leader_election.cc:304] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 800d84c2f42d4aabac1286f0b27d4ccb, c5c35c4177154a2aa180bef5b4eb32b7; no voters: 4ab595233c1b47d2980dcad8b04a45e3
I20260709 12:59:45.696408   766 raft_consensus.cc:493] T 78aff2e266df4a51b635f6b10ce9600a P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.702837   791 raft_consensus.cc:2804] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:45.707373   766 raft_consensus.cc:515] T 78aff2e266df4a51b635f6b10ce9600a P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.713856   607 leader_election.cc:304] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ab595233c1b47d2980dcad8b04a45e3, 800d84c2f42d4aabac1286f0b27d4ccb; no voters: c5c35c4177154a2aa180bef5b4eb32b7
I20260709 12:59:45.710041   791 raft_consensus.cc:697] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 LEADER]: Becoming Leader. State: Replica: c5c35c4177154a2aa180bef5b4eb32b7, State: Running, Role: LEADER
I20260709 12:59:45.717887   790 raft_consensus.cc:2804] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:45.719172   790 raft_consensus.cc:493] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:45.719642   790 raft_consensus.cc:3060] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:45.728121   532 leader_election.cc:343] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:45.726169   760 consensus_queue.cc:260] T 52db24cb6b184170af5d6cc1b6ef0b2a P 800d84c2f42d4aabac1286f0b27d4ccb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.720037   791 consensus_queue.cc:237] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.712113   761 ts_tablet_manager.cc:1434] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3: Time spent starting tablet: real 0.163s	user 0.022s	sys 0.011s
I20260709 12:59:45.731765   766 leader_election.cc:290] T 78aff2e266df4a51b635f6b10ce9600a P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299), c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179)
I20260709 12:59:45.752120   759 raft_consensus.cc:359] T 52db24cb6b184170af5d6cc1b6ef0b2a P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.748888   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78aff2e266df4a51b635f6b10ce9600a" candidate_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3" is_pre_election: true
I20260709 12:59:45.771137   764 consensus_queue.cc:1048] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:59:45.773924   639 raft_consensus.cc:2468] T 78aff2e266df4a51b635f6b10ce9600a P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 800d84c2f42d4aabac1286f0b27d4ccb in term 0.
I20260709 12:59:45.771201   761 tablet_bootstrap.cc:492] T feed72ce7e2549d7a27dc7595bac0d3d P 4ab595233c1b47d2980dcad8b04a45e3: Bootstrap starting.
I20260709 12:59:45.754505   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78aff2e266df4a51b635f6b10ce9600a" candidate_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" is_pre_election: true
I20260709 12:59:45.786022   713 raft_consensus.cc:2468] T 78aff2e266df4a51b635f6b10ce9600a P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 800d84c2f42d4aabac1286f0b27d4ccb in term 0.
I20260709 12:59:45.783740   759 raft_consensus.cc:385] T 52db24cb6b184170af5d6cc1b6ef0b2a P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:45.786895   532 leader_election.cc:304] T 78aff2e266df4a51b635f6b10ce9600a P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ab595233c1b47d2980dcad8b04a45e3, 800d84c2f42d4aabac1286f0b27d4ccb; no voters: 
I20260709 12:59:45.792115   766 consensus_queue.cc:1048] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:59:45.809211   810 raft_consensus.cc:2804] T 78aff2e266df4a51b635f6b10ce9600a P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:45.811054   810 raft_consensus.cc:493] T 78aff2e266df4a51b635f6b10ce9600a P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:45.812762   810 raft_consensus.cc:3060] T 78aff2e266df4a51b635f6b10ce9600a P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:45.805181   759 raft_consensus.cc:740] T 52db24cb6b184170af5d6cc1b6ef0b2a P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5c35c4177154a2aa180bef5b4eb32b7, State: Initialized, Role: FOLLOWER
W20260709 12:59:45.841059   532 consensus_peers.cc:597] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb -> Peer 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299): Couldn't send request to peer 4ab595233c1b47d2980dcad8b04a45e3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:45.844323   759 consensus_queue.cc:260] T 52db24cb6b184170af5d6cc1b6ef0b2a P c5c35c4177154a2aa180bef5b4eb32b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.850253   761 tablet_bootstrap.cc:654] T feed72ce7e2549d7a27dc7595bac0d3d P 4ab595233c1b47d2980dcad8b04a45e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:45.852715   810 raft_consensus.cc:515] T 78aff2e266df4a51b635f6b10ce9600a P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.857065   810 leader_election.cc:290] T 78aff2e266df4a51b635f6b10ce9600a P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 1 election: Requested vote from peers 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299), c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179)
I20260709 12:59:45.858175   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78aff2e266df4a51b635f6b10ce9600a" candidate_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3"
I20260709 12:59:45.859961   639 raft_consensus.cc:3060] T 78aff2e266df4a51b635f6b10ce9600a P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:45.860688   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78aff2e266df4a51b635f6b10ce9600a" candidate_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7"
I20260709 12:59:45.857884   792 raft_consensus.cc:515] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.861536   713 raft_consensus.cc:3060] T 78aff2e266df4a51b635f6b10ce9600a P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:45.878302   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11d9c8b7a0c408696e8ad7ef2b1ae15" candidate_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3"
I20260709 12:59:45.881644   761 tablet_bootstrap.cc:492] T feed72ce7e2549d7a27dc7595bac0d3d P 4ab595233c1b47d2980dcad8b04a45e3: No bootstrap required, opened a new log
I20260709 12:59:45.882330   761 ts_tablet_manager.cc:1403] T feed72ce7e2549d7a27dc7595bac0d3d P 4ab595233c1b47d2980dcad8b04a45e3: Time spent bootstrapping tablet: real 0.112s	user 0.022s	sys 0.003s
I20260709 12:59:45.882990   792 leader_election.cc:290] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 1 election: Requested vote from peers 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299), c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179)
W20260709 12:59:45.896526   511 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:45.897970   759 ts_tablet_manager.cc:1434] T 52db24cb6b184170af5d6cc1b6ef0b2a P c5c35c4177154a2aa180bef5b4eb32b7: Time spent starting tablet: real 0.199s	user 0.020s	sys 0.017s
I20260709 12:59:45.899101   761 raft_consensus.cc:359] T feed72ce7e2549d7a27dc7595bac0d3d P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.899775   761 raft_consensus.cc:385] T feed72ce7e2549d7a27dc7595bac0d3d P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:45.900424   761 raft_consensus.cc:740] T feed72ce7e2549d7a27dc7595bac0d3d P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ab595233c1b47d2980dcad8b04a45e3, State: Initialized, Role: FOLLOWER
I20260709 12:59:45.907876   761 consensus_queue.cc:260] T feed72ce7e2549d7a27dc7595bac0d3d P 4ab595233c1b47d2980dcad8b04a45e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.909610   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11d9c8b7a0c408696e8ad7ef2b1ae15" candidate_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7"
I20260709 12:59:45.915004   760 ts_tablet_manager.cc:1434] T 52db24cb6b184170af5d6cc1b6ef0b2a P 800d84c2f42d4aabac1286f0b27d4ccb: Time spent starting tablet: real 0.380s	user 0.042s	sys 0.033s
W20260709 12:59:45.915766   532 leader_election.cc:343] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:45.917021   790 raft_consensus.cc:515] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.920022   759 tablet_bootstrap.cc:492] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7: Bootstrap starting.
I20260709 12:59:45.920601   790 leader_election.cc:290] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 1 election: Requested vote from peers 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201), c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179)
I20260709 12:59:45.922005   760 tablet_bootstrap.cc:492] T 67696df2323642db84a45062c01e2d29 P 800d84c2f42d4aabac1286f0b27d4ccb: Bootstrap starting.
I20260709 12:59:45.923346   640 raft_consensus.cc:2393] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 800d84c2f42d4aabac1286f0b27d4ccb in current term 1: Already voted for candidate 4ab595233c1b47d2980dcad8b04a45e3 in this term.
I20260709 12:59:45.928078   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11d9c8b7a0c408696e8ad7ef2b1ae15" candidate_uuid: "4ab595233c1b47d2980dcad8b04a45e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7"
I20260709 12:59:45.930338   792 raft_consensus.cc:493] T 52db24cb6b184170af5d6cc1b6ef0b2a P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:45.930691   607 leader_election.cc:343] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:45.931053   792 raft_consensus.cc:515] T 52db24cb6b184170af5d6cc1b6ef0b2a P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.929214   713 raft_consensus.cc:2468] T 78aff2e266df4a51b635f6b10ce9600a P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 800d84c2f42d4aabac1286f0b27d4ccb in term 1.
I20260709 12:59:45.950970   761 ts_tablet_manager.cc:1434] T feed72ce7e2549d7a27dc7595bac0d3d P 4ab595233c1b47d2980dcad8b04a45e3: Time spent starting tablet: real 0.068s	user 0.023s	sys 0.013s
W20260709 12:59:45.956137   681 consensus_peers.cc:597] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7 -> Peer 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201): Couldn't send request to peer 800d84c2f42d4aabac1286f0b27d4ccb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:45.950171   764 consensus_queue.cc:1048] T ff561f1c72b14a8881b49a495683999a P c5c35c4177154a2aa180bef5b4eb32b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:59:45.958132   792 leader_election.cc:290] T 52db24cb6b184170af5d6cc1b6ef0b2a P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299), c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179)
I20260709 12:59:45.953377   532 leader_election.cc:304] T 78aff2e266df4a51b635f6b10ce9600a P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 800d84c2f42d4aabac1286f0b27d4ccb, c5c35c4177154a2aa180bef5b4eb32b7; no voters: 
I20260709 12:59:45.954843   790 raft_consensus.cc:493] T 52db24cb6b184170af5d6cc1b6ef0b2a P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.966758   792 raft_consensus.cc:2804] T 78aff2e266df4a51b635f6b10ce9600a P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:45.967752   790 raft_consensus.cc:515] T 52db24cb6b184170af5d6cc1b6ef0b2a P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.969449   792 raft_consensus.cc:697] T 78aff2e266df4a51b635f6b10ce9600a P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 LEADER]: Becoming Leader. State: Replica: 800d84c2f42d4aabac1286f0b27d4ccb, State: Running, Role: LEADER
I20260709 12:59:45.972527   790 leader_election.cc:290] T 52db24cb6b184170af5d6cc1b6ef0b2a P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201), c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179)
I20260709 12:59:45.973289   532 leader_election.cc:304] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 800d84c2f42d4aabac1286f0b27d4ccb; no voters: 4ab595233c1b47d2980dcad8b04a45e3, c5c35c4177154a2aa180bef5b4eb32b7
I20260709 12:59:45.974313   461 catalog_manager.cc:5697] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:45.975359   761 tablet_bootstrap.cc:492] T 018df5b57c524579ab3bb24c61a13e54 P 4ab595233c1b47d2980dcad8b04a45e3: Bootstrap starting.
I20260709 12:59:45.977293   810 raft_consensus.cc:2749] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:59:45.973553   792 consensus_queue.cc:237] T 78aff2e266df4a51b635f6b10ce9600a P 800d84c2f42d4aabac1286f0b27d4ccb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:45.983301   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52db24cb6b184170af5d6cc1b6ef0b2a" candidate_uuid: "4ab595233c1b47d2980dcad8b04a45e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" is_pre_election: true
I20260709 12:59:45.984171   714 raft_consensus.cc:2468] T 52db24cb6b184170af5d6cc1b6ef0b2a P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ab595233c1b47d2980dcad8b04a45e3 in term 0.
I20260709 12:59:45.966187   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11d9c8b7a0c408696e8ad7ef2b1ae15" candidate_uuid: "4ab595233c1b47d2980dcad8b04a45e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb"
I20260709 12:59:45.994386   607 leader_election.cc:304] T 52db24cb6b184170af5d6cc1b6ef0b2a P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ab595233c1b47d2980dcad8b04a45e3, c5c35c4177154a2aa180bef5b4eb32b7; no voters: 
I20260709 12:59:46.016192   565 raft_consensus.cc:2393] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4ab595233c1b47d2980dcad8b04a45e3 in current term 1: Already voted for candidate 800d84c2f42d4aabac1286f0b27d4ccb in this term.
I20260709 12:59:45.999421   638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52db24cb6b184170af5d6cc1b6ef0b2a" candidate_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3" is_pre_election: true
I20260709 12:59:46.003733   790 raft_consensus.cc:2804] T 52db24cb6b184170af5d6cc1b6ef0b2a P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:46.020548   761 tablet_bootstrap.cc:654] T 018df5b57c524579ab3bb24c61a13e54 P 4ab595233c1b47d2980dcad8b04a45e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:46.017486   790 raft_consensus.cc:493] T 52db24cb6b184170af5d6cc1b6ef0b2a P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:46.014479   639 raft_consensus.cc:2468] T 78aff2e266df4a51b635f6b10ce9600a P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 800d84c2f42d4aabac1286f0b27d4ccb in term 1.
I20260709 12:59:46.021549   790 raft_consensus.cc:3060] T 52db24cb6b184170af5d6cc1b6ef0b2a P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:45.998385   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52db24cb6b184170af5d6cc1b6ef0b2a" candidate_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" is_pre_election: true
I20260709 12:59:46.022670   714 raft_consensus.cc:2468] T 52db24cb6b184170af5d6cc1b6ef0b2a P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 800d84c2f42d4aabac1286f0b27d4ccb in term 0.
I20260709 12:59:45.998445   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52db24cb6b184170af5d6cc1b6ef0b2a" candidate_uuid: "4ab595233c1b47d2980dcad8b04a45e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" is_pre_election: true
I20260709 12:59:46.024089   564 raft_consensus.cc:2468] T 52db24cb6b184170af5d6cc1b6ef0b2a P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ab595233c1b47d2980dcad8b04a45e3 in term 0.
I20260709 12:59:46.033603   759 tablet_bootstrap.cc:654] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:46.040640   607 leader_election.cc:304] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ab595233c1b47d2980dcad8b04a45e3; no voters: 800d84c2f42d4aabac1286f0b27d4ccb, c5c35c4177154a2aa180bef5b4eb32b7
I20260709 12:59:46.047641   822 raft_consensus.cc:2749] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:59:46.053623   532 leader_election.cc:304] T 52db24cb6b184170af5d6cc1b6ef0b2a P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 800d84c2f42d4aabac1286f0b27d4ccb, c5c35c4177154a2aa180bef5b4eb32b7; no voters: 
I20260709 12:59:46.062340   790 raft_consensus.cc:515] T 52db24cb6b184170af5d6cc1b6ef0b2a P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:46.063144   760 tablet_bootstrap.cc:654] T 67696df2323642db84a45062c01e2d29 P 800d84c2f42d4aabac1286f0b27d4ccb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:46.063843   638 raft_consensus.cc:2393] T 52db24cb6b184170af5d6cc1b6ef0b2a P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 800d84c2f42d4aabac1286f0b27d4ccb in current term 1: Already voted for candidate 4ab595233c1b47d2980dcad8b04a45e3 in this term.
I20260709 12:59:46.065886   790 leader_election.cc:290] T 52db24cb6b184170af5d6cc1b6ef0b2a P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 1 election: Requested vote from peers 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201), c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179)
I20260709 12:59:46.059458   792 raft_consensus.cc:2804] T 52db24cb6b184170af5d6cc1b6ef0b2a P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:46.069633   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52db24cb6b184170af5d6cc1b6ef0b2a" candidate_uuid: "4ab595233c1b47d2980dcad8b04a45e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7"
I20260709 12:59:46.070362   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52db24cb6b184170af5d6cc1b6ef0b2a" candidate_uuid: "4ab595233c1b47d2980dcad8b04a45e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb"
I20260709 12:59:46.071344   790 raft_consensus.cc:493] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.073550   714 raft_consensus.cc:3060] T 52db24cb6b184170af5d6cc1b6ef0b2a P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:46.069932   792 raft_consensus.cc:493] T 52db24cb6b184170af5d6cc1b6ef0b2a P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:46.075868   792 raft_consensus.cc:3060] T 52db24cb6b184170af5d6cc1b6ef0b2a P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:46.073884   790 raft_consensus.cc:515] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:46.079381   790 leader_election.cc:290] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201), c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179)
I20260709 12:59:46.082850   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768734dfe27846478ec2b650e2289608" candidate_uuid: "4ab595233c1b47d2980dcad8b04a45e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" is_pre_election: true
I20260709 12:59:46.084163   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768734dfe27846478ec2b650e2289608" candidate_uuid: "4ab595233c1b47d2980dcad8b04a45e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" is_pre_election: true
I20260709 12:59:46.085453   565 raft_consensus.cc:2393] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ab595233c1b47d2980dcad8b04a45e3 in current term 1: Already voted for candidate c5c35c4177154a2aa180bef5b4eb32b7 in this term.
I20260709 12:59:46.093652   607 leader_election.cc:304] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ab595233c1b47d2980dcad8b04a45e3; no voters: 800d84c2f42d4aabac1286f0b27d4ccb, c5c35c4177154a2aa180bef5b4eb32b7
I20260709 12:59:46.095463   790 raft_consensus.cc:3060] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:46.109419   761 tablet_bootstrap.cc:492] T 018df5b57c524579ab3bb24c61a13e54 P 4ab595233c1b47d2980dcad8b04a45e3: No bootstrap required, opened a new log
I20260709 12:59:46.109928   761 ts_tablet_manager.cc:1403] T 018df5b57c524579ab3bb24c61a13e54 P 4ab595233c1b47d2980dcad8b04a45e3: Time spent bootstrapping tablet: real 0.135s	user 0.020s	sys 0.009s
I20260709 12:59:46.109059   463 catalog_manager.cc:5697] T 78aff2e266df4a51b635f6b10ce9600a P 800d84c2f42d4aabac1286f0b27d4ccb reported cstate change: term changed from 0 to 1, leader changed from <none> to 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193). New cstate: current_term: 1 leader_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:46.114984   759 tablet_bootstrap.cc:492] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7: No bootstrap required, opened a new log
I20260709 12:59:46.115521   759 ts_tablet_manager.cc:1403] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7: Time spent bootstrapping tablet: real 0.196s	user 0.012s	sys 0.017s
I20260709 12:59:46.116202   714 raft_consensus.cc:2468] T 52db24cb6b184170af5d6cc1b6ef0b2a P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ab595233c1b47d2980dcad8b04a45e3 in term 1.
I20260709 12:59:46.119058   790 raft_consensus.cc:2749] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:46.119644   759 raft_consensus.cc:359] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:46.120527   759 raft_consensus.cc:385] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:46.120972   759 raft_consensus.cc:740] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5c35c4177154a2aa180bef5b4eb32b7, State: Initialized, Role: FOLLOWER
I20260709 12:59:46.120452   761 raft_consensus.cc:359] T 018df5b57c524579ab3bb24c61a13e54 P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } } peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } }
I20260709 12:59:46.121465   761 raft_consensus.cc:385] T 018df5b57c524579ab3bb24c61a13e54 P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:46.121841   761 raft_consensus.cc:740] T 018df5b57c524579ab3bb24c61a13e54 P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ab595233c1b47d2980dcad8b04a45e3, State: Initialized, Role: FOLLOWER
I20260709 12:59:46.122761   607 leader_election.cc:304] T 52db24cb6b184170af5d6cc1b6ef0b2a P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ab595233c1b47d2980dcad8b04a45e3, c5c35c4177154a2aa180bef5b4eb32b7; no voters: 
I20260709 12:59:46.122840   761 consensus_queue.cc:260] T 018df5b57c524579ab3bb24c61a13e54 P 4ab595233c1b47d2980dcad8b04a45e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } } peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } }
I20260709 12:59:46.124081   790 raft_consensus.cc:2804] T 52db24cb6b184170af5d6cc1b6ef0b2a P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:46.128314   792 raft_consensus.cc:515] T 52db24cb6b184170af5d6cc1b6ef0b2a P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:46.129128   759 consensus_queue.cc:260] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:46.131923   759 ts_tablet_manager.cc:1434] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.001s
I20260709 12:59:46.132865   564 raft_consensus.cc:2393] T 52db24cb6b184170af5d6cc1b6ef0b2a P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4ab595233c1b47d2980dcad8b04a45e3 in current term 1: Already voted for candidate 800d84c2f42d4aabac1286f0b27d4ccb in this term.
I20260709 12:59:46.133193   759 tablet_bootstrap.cc:492] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7: Bootstrap starting.
I20260709 12:59:46.131745   761 ts_tablet_manager.cc:1434] T 018df5b57c524579ab3bb24c61a13e54 P 4ab595233c1b47d2980dcad8b04a45e3: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 12:59:46.141726   638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52db24cb6b184170af5d6cc1b6ef0b2a" candidate_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3"
I20260709 12:59:46.143031   792 leader_election.cc:290] T 52db24cb6b184170af5d6cc1b6ef0b2a P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 1 election: Requested vote from peers 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299), c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179)
I20260709 12:59:46.145210   760 tablet_bootstrap.cc:492] T 67696df2323642db84a45062c01e2d29 P 800d84c2f42d4aabac1286f0b27d4ccb: No bootstrap required, opened a new log
I20260709 12:59:46.153754   760 ts_tablet_manager.cc:1403] T 67696df2323642db84a45062c01e2d29 P 800d84c2f42d4aabac1286f0b27d4ccb: Time spent bootstrapping tablet: real 0.232s	user 0.029s	sys 0.033s
I20260709 12:59:46.128054   790 raft_consensus.cc:697] T 52db24cb6b184170af5d6cc1b6ef0b2a P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 LEADER]: Becoming Leader. State: Replica: 4ab595233c1b47d2980dcad8b04a45e3, State: Running, Role: LEADER
I20260709 12:59:46.148064   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52db24cb6b184170af5d6cc1b6ef0b2a" candidate_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7"
I20260709 12:59:46.158412   714 raft_consensus.cc:2393] T 52db24cb6b184170af5d6cc1b6ef0b2a P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 800d84c2f42d4aabac1286f0b27d4ccb in current term 1: Already voted for candidate 4ab595233c1b47d2980dcad8b04a45e3 in this term.
I20260709 12:59:46.149127   641 raft_consensus.cc:3060] T 018df5b57c524579ab3bb24c61a13e54 P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:46.162611   822 raft_consensus.cc:493] T feed72ce7e2549d7a27dc7595bac0d3d P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.163142   822 raft_consensus.cc:515] T feed72ce7e2549d7a27dc7595bac0d3d P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:46.152979   759 tablet_bootstrap.cc:654] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:46.165707   822 leader_election.cc:290] T feed72ce7e2549d7a27dc7595bac0d3d P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201), c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179)
I20260709 12:59:46.166958   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feed72ce7e2549d7a27dc7595bac0d3d" candidate_uuid: "4ab595233c1b47d2980dcad8b04a45e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" is_pre_election: true
I20260709 12:59:46.167376   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feed72ce7e2549d7a27dc7595bac0d3d" candidate_uuid: "4ab595233c1b47d2980dcad8b04a45e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" is_pre_election: true
I20260709 12:59:46.168131   714 raft_consensus.cc:2468] T feed72ce7e2549d7a27dc7595bac0d3d P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ab595233c1b47d2980dcad8b04a45e3 in term 0.
W20260709 12:59:46.168401   607 leader_election.cc:343] T feed72ce7e2549d7a27dc7595bac0d3d P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:46.169356   607 leader_election.cc:304] T feed72ce7e2549d7a27dc7595bac0d3d P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ab595233c1b47d2980dcad8b04a45e3, c5c35c4177154a2aa180bef5b4eb32b7; no voters: 800d84c2f42d4aabac1286f0b27d4ccb
I20260709 12:59:46.170219   822 raft_consensus.cc:2804] T feed72ce7e2549d7a27dc7595bac0d3d P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:46.179153   822 raft_consensus.cc:493] T feed72ce7e2549d7a27dc7595bac0d3d P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:46.179870   822 raft_consensus.cc:3060] T feed72ce7e2549d7a27dc7595bac0d3d P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:46.178603   790 consensus_queue.cc:237] T 52db24cb6b184170af5d6cc1b6ef0b2a P 4ab595233c1b47d2980dcad8b04a45e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:46.184048   760 raft_consensus.cc:359] T 67696df2323642db84a45062c01e2d29 P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:46.191474   760 raft_consensus.cc:385] T 67696df2323642db84a45062c01e2d29 P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:46.193610   760 raft_consensus.cc:740] T 67696df2323642db84a45062c01e2d29 P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 800d84c2f42d4aabac1286f0b27d4ccb, State: Initialized, Role: FOLLOWER
I20260709 12:59:46.208572   791 consensus_queue.cc:1048] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:46.219148   760 consensus_queue.cc:260] T 67696df2323642db84a45062c01e2d29 P 800d84c2f42d4aabac1286f0b27d4ccb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:46.221897   532 leader_election.cc:304] T 52db24cb6b184170af5d6cc1b6ef0b2a P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 800d84c2f42d4aabac1286f0b27d4ccb; no voters: 4ab595233c1b47d2980dcad8b04a45e3, c5c35c4177154a2aa180bef5b4eb32b7
I20260709 12:59:46.222195   822 raft_consensus.cc:515] T feed72ce7e2549d7a27dc7595bac0d3d P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:46.231134   792 raft_consensus.cc:2749] T 52db24cb6b184170af5d6cc1b6ef0b2a P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:59:46.238392   463 catalog_manager.cc:5697] T 52db24cb6b184170af5d6cc1b6ef0b2a P 4ab595233c1b47d2980dcad8b04a45e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "4ab595233c1b47d2980dcad8b04a45e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:46.243517   791 consensus_queue.cc:1048] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:46.249732   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feed72ce7e2549d7a27dc7595bac0d3d" candidate_uuid: "4ab595233c1b47d2980dcad8b04a45e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb"
W20260709 12:59:46.251674   607 leader_election.cc:343] T feed72ce7e2549d7a27dc7595bac0d3d P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:46.261121   822 leader_election.cc:290] T feed72ce7e2549d7a27dc7595bac0d3d P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 1 election: Requested vote from peers 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201), c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179)
I20260709 12:59:46.263155   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feed72ce7e2549d7a27dc7595bac0d3d" candidate_uuid: "4ab595233c1b47d2980dcad8b04a45e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7"
I20260709 12:59:46.263934   714 raft_consensus.cc:3060] T feed72ce7e2549d7a27dc7595bac0d3d P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:46.265852   760 ts_tablet_manager.cc:1434] T 67696df2323642db84a45062c01e2d29 P 800d84c2f42d4aabac1286f0b27d4ccb: Time spent starting tablet: real 0.112s	user 0.008s	sys 0.005s
I20260709 12:59:46.268289   759 tablet_bootstrap.cc:492] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7: No bootstrap required, opened a new log
I20260709 12:59:46.269299   759 ts_tablet_manager.cc:1403] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7: Time spent bootstrapping tablet: real 0.136s	user 0.037s	sys 0.054s
I20260709 12:59:46.270082   760 tablet_bootstrap.cc:492] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb: Bootstrap starting.
I20260709 12:59:46.272142   714 raft_consensus.cc:2468] T feed72ce7e2549d7a27dc7595bac0d3d P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ab595233c1b47d2980dcad8b04a45e3 in term 1.
I20260709 12:59:46.273321   607 leader_election.cc:304] T feed72ce7e2549d7a27dc7595bac0d3d P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ab595233c1b47d2980dcad8b04a45e3, c5c35c4177154a2aa180bef5b4eb32b7; no voters: 800d84c2f42d4aabac1286f0b27d4ccb
I20260709 12:59:46.274516   759 raft_consensus.cc:359] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:46.275271   759 raft_consensus.cc:385] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:46.275648   759 raft_consensus.cc:740] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5c35c4177154a2aa180bef5b4eb32b7, State: Initialized, Role: FOLLOWER
I20260709 12:59:46.277001   822 raft_consensus.cc:2804] T feed72ce7e2549d7a27dc7595bac0d3d P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:46.277027   759 consensus_queue.cc:260] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:46.280130   759 ts_tablet_manager.cc:1434] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:59:46.283344   760 tablet_bootstrap.cc:654] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:46.288378   822 raft_consensus.cc:697] T feed72ce7e2549d7a27dc7595bac0d3d P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 LEADER]: Becoming Leader. State: Replica: 4ab595233c1b47d2980dcad8b04a45e3, State: Running, Role: LEADER
I20260709 12:59:46.290431   760 tablet_bootstrap.cc:492] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb: No bootstrap required, opened a new log
I20260709 12:59:46.291078   760 ts_tablet_manager.cc:1403] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.000s
I20260709 12:59:46.293394   822 consensus_queue.cc:237] T feed72ce7e2549d7a27dc7595bac0d3d P 4ab595233c1b47d2980dcad8b04a45e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:46.294281   760 raft_consensus.cc:359] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:46.303313   760 raft_consensus.cc:385] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:46.303807   760 raft_consensus.cc:740] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 800d84c2f42d4aabac1286f0b27d4ccb, State: Initialized, Role: FOLLOWER
I20260709 12:59:46.304841   760 consensus_queue.cc:260] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:46.308629   760 ts_tablet_manager.cc:1434] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:59:46.310053   760 tablet_bootstrap.cc:492] T feed72ce7e2549d7a27dc7595bac0d3d P 800d84c2f42d4aabac1286f0b27d4ccb: Bootstrap starting.
I20260709 12:59:46.333330   760 tablet_bootstrap.cc:654] T feed72ce7e2549d7a27dc7595bac0d3d P 800d84c2f42d4aabac1286f0b27d4ccb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:46.330451   463 catalog_manager.cc:5697] T feed72ce7e2549d7a27dc7595bac0d3d P 4ab595233c1b47d2980dcad8b04a45e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "4ab595233c1b47d2980dcad8b04a45e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:46.343921   815 raft_consensus.cc:493] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.344981   815 raft_consensus.cc:515] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:46.348135   815 leader_election.cc:290] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201), 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299)
I20260709 12:59:46.349781   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67696df2323642db84a45062c01e2d29" candidate_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3" is_pre_election: true
I20260709 12:59:46.350674   641 raft_consensus.cc:2468] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5c35c4177154a2aa180bef5b4eb32b7 in term 0.
I20260709 12:59:46.351825   792 raft_consensus.cc:493] T 67696df2323642db84a45062c01e2d29 P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.352464   792 raft_consensus.cc:515] T 67696df2323642db84a45062c01e2d29 P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:46.353555   760 tablet_bootstrap.cc:492] T feed72ce7e2549d7a27dc7595bac0d3d P 800d84c2f42d4aabac1286f0b27d4ccb: No bootstrap required, opened a new log
I20260709 12:59:46.353942   760 ts_tablet_manager.cc:1403] T feed72ce7e2549d7a27dc7595bac0d3d P 800d84c2f42d4aabac1286f0b27d4ccb: Time spent bootstrapping tablet: real 0.044s	user 0.003s	sys 0.019s
I20260709 12:59:46.356873   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67696df2323642db84a45062c01e2d29" candidate_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" is_pre_election: true
I20260709 12:59:46.357653   714 raft_consensus.cc:2468] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 800d84c2f42d4aabac1286f0b27d4ccb in term 0.
I20260709 12:59:46.357409   760 raft_consensus.cc:359] T feed72ce7e2549d7a27dc7595bac0d3d P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:46.358384   760 raft_consensus.cc:385] T feed72ce7e2549d7a27dc7595bac0d3d P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:46.358724   760 raft_consensus.cc:740] T feed72ce7e2549d7a27dc7595bac0d3d P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 800d84c2f42d4aabac1286f0b27d4ccb, State: Initialized, Role: FOLLOWER
I20260709 12:59:46.359483   532 leader_election.cc:304] T 67696df2323642db84a45062c01e2d29 P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 800d84c2f42d4aabac1286f0b27d4ccb, c5c35c4177154a2aa180bef5b4eb32b7; no voters: 
I20260709 12:59:46.359994   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67696df2323642db84a45062c01e2d29" candidate_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" is_pre_election: true
I20260709 12:59:46.359671   760 consensus_queue.cc:260] T feed72ce7e2549d7a27dc7595bac0d3d P 800d84c2f42d4aabac1286f0b27d4ccb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:46.361415   681 leader_election.cc:304] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ab595233c1b47d2980dcad8b04a45e3, c5c35c4177154a2aa180bef5b4eb32b7; no voters: 
I20260709 12:59:46.361595   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67696df2323642db84a45062c01e2d29" candidate_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3" is_pre_election: true
I20260709 12:59:46.362366   641 raft_consensus.cc:2468] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 800d84c2f42d4aabac1286f0b27d4ccb in term 0.
I20260709 12:59:46.362932   760 ts_tablet_manager.cc:1434] T feed72ce7e2549d7a27dc7595bac0d3d P 800d84c2f42d4aabac1286f0b27d4ccb: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:59:46.360745   564 raft_consensus.cc:2468] T 67696df2323642db84a45062c01e2d29 P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5c35c4177154a2aa180bef5b4eb32b7 in term 0.
I20260709 12:59:46.363976   815 raft_consensus.cc:2804] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:46.355490   792 leader_election.cc:290] T 67696df2323642db84a45062c01e2d29 P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299), c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179)
I20260709 12:59:46.364457   815 raft_consensus.cc:493] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:46.364956   815 raft_consensus.cc:3060] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:46.365237   766 raft_consensus.cc:2804] T 67696df2323642db84a45062c01e2d29 P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:46.367125   766 raft_consensus.cc:493] T 67696df2323642db84a45062c01e2d29 P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:46.367637   766 raft_consensus.cc:3060] T 67696df2323642db84a45062c01e2d29 P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:46.376607   815 raft_consensus.cc:515] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:46.376600   766 raft_consensus.cc:515] T 67696df2323642db84a45062c01e2d29 P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:46.379206   766 leader_election.cc:290] T 67696df2323642db84a45062c01e2d29 P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 1 election: Requested vote from peers 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299), c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179)
I20260709 12:59:46.379209   815 leader_election.cc:290] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [CANDIDATE]: Term 1 election: Requested vote from peers 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201), 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299)
I20260709 12:59:46.381664   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67696df2323642db84a45062c01e2d29" candidate_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb"
I20260709 12:59:46.382589   564 raft_consensus.cc:2393] T 67696df2323642db84a45062c01e2d29 P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c5c35c4177154a2aa180bef5b4eb32b7 in current term 1: Already voted for candidate 800d84c2f42d4aabac1286f0b27d4ccb in this term.
I20260709 12:59:46.383001   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67696df2323642db84a45062c01e2d29" candidate_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3"
I20260709 12:59:46.383913   641 raft_consensus.cc:3060] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:46.391211   638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67696df2323642db84a45062c01e2d29" candidate_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3"
I20260709 12:59:46.391978   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67696df2323642db84a45062c01e2d29" candidate_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7"
I20260709 12:59:46.393044   714 raft_consensus.cc:2393] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 800d84c2f42d4aabac1286f0b27d4ccb in current term 1: Already voted for candidate c5c35c4177154a2aa180bef5b4eb32b7 in this term.
I20260709 12:59:46.395272   641 raft_consensus.cc:2468] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5c35c4177154a2aa180bef5b4eb32b7 in term 1.
I20260709 12:59:46.395524   532 leader_election.cc:304] T 67696df2323642db84a45062c01e2d29 P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 800d84c2f42d4aabac1286f0b27d4ccb; no voters: 4ab595233c1b47d2980dcad8b04a45e3, c5c35c4177154a2aa180bef5b4eb32b7
I20260709 12:59:46.396662   792 raft_consensus.cc:2749] T 67696df2323642db84a45062c01e2d29 P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:59:46.397392   681 leader_election.cc:304] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ab595233c1b47d2980dcad8b04a45e3, c5c35c4177154a2aa180bef5b4eb32b7; no voters: 800d84c2f42d4aabac1286f0b27d4ccb
I20260709 12:59:46.398522   815 raft_consensus.cc:2804] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:46.399214   815 raft_consensus.cc:697] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 LEADER]: Becoming Leader. State: Replica: c5c35c4177154a2aa180bef5b4eb32b7, State: Running, Role: LEADER
I20260709 12:59:46.400465   815 consensus_queue.cc:237] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:46.412302   463 catalog_manager.cc:5697] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:46.470263   815 raft_consensus.cc:493] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.473388   815 raft_consensus.cc:515] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:46.482673   815 leader_election.cc:290] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201), 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299)
I20260709 12:59:46.484465   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11d9c8b7a0c408696e8ad7ef2b1ae15" candidate_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" is_pre_election: true
I20260709 12:59:46.484948   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11d9c8b7a0c408696e8ad7ef2b1ae15" candidate_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3" is_pre_election: true
I20260709 12:59:46.486136   564 raft_consensus.cc:2393] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5c35c4177154a2aa180bef5b4eb32b7 in current term 1: Already voted for candidate 800d84c2f42d4aabac1286f0b27d4ccb in this term.
I20260709 12:59:46.486759   641 raft_consensus.cc:2393] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5c35c4177154a2aa180bef5b4eb32b7 in current term 1: Already voted for candidate 4ab595233c1b47d2980dcad8b04a45e3 in this term.
I20260709 12:59:46.489943   681 leader_election.cc:304] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5c35c4177154a2aa180bef5b4eb32b7; no voters: 4ab595233c1b47d2980dcad8b04a45e3, 800d84c2f42d4aabac1286f0b27d4ccb
I20260709 12:59:46.492082   815 raft_consensus.cc:3060] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:46.497002   792 consensus_queue.cc:1048] T 78aff2e266df4a51b635f6b10ce9600a P 800d84c2f42d4aabac1286f0b27d4ccb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:59:46.538280   815 raft_consensus.cc:2749] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:46.600692   847 consensus_queue.cc:1048] T 78aff2e266df4a51b635f6b10ce9600a P 800d84c2f42d4aabac1286f0b27d4ccb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:59:46.638851   822 consensus_queue.cc:1048] T 52db24cb6b184170af5d6cc1b6ef0b2a P 4ab595233c1b47d2980dcad8b04a45e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:59:46.695887   565 raft_consensus.cc:3060] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:46.781184   790 consensus_queue.cc:1048] T 52db24cb6b184170af5d6cc1b6ef0b2a P 4ab595233c1b47d2980dcad8b04a45e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:46.807873   847 raft_consensus.cc:493] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5c35c4177154a2aa180bef5b4eb32b7)
I20260709 12:59:46.809326   766 raft_consensus.cc:493] T feed72ce7e2549d7a27dc7595bac0d3d P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.808466   847 raft_consensus.cc:515] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:46.809809   766 raft_consensus.cc:515] T feed72ce7e2549d7a27dc7595bac0d3d P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:46.812525   766 leader_election.cc:290] T feed72ce7e2549d7a27dc7595bac0d3d P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299), c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179)
I20260709 12:59:46.814190   847 leader_election.cc:290] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299), c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179)
I20260709 12:59:46.814038   638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feed72ce7e2549d7a27dc7595bac0d3d" candidate_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3" is_pre_election: true
I20260709 12:59:46.816524   638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a146a08439145c189f2d8111591a7e4" candidate_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3" is_pre_election: true
I20260709 12:59:46.817242   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a146a08439145c189f2d8111591a7e4" candidate_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" is_pre_election: true
I20260709 12:59:46.818636   532 leader_election.cc:304] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 800d84c2f42d4aabac1286f0b27d4ccb; no voters: 4ab595233c1b47d2980dcad8b04a45e3, c5c35c4177154a2aa180bef5b4eb32b7
I20260709 12:59:46.819253   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feed72ce7e2549d7a27dc7595bac0d3d" candidate_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" is_pre_election: true
I20260709 12:59:46.819422   847 raft_consensus.cc:2749] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:46.820080   713 raft_consensus.cc:2393] T feed72ce7e2549d7a27dc7595bac0d3d P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 800d84c2f42d4aabac1286f0b27d4ccb in current term 1: Already voted for candidate 4ab595233c1b47d2980dcad8b04a45e3 in this term.
I20260709 12:59:46.821033   532 leader_election.cc:304] T feed72ce7e2549d7a27dc7595bac0d3d P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 800d84c2f42d4aabac1286f0b27d4ccb; no voters: 4ab595233c1b47d2980dcad8b04a45e3, c5c35c4177154a2aa180bef5b4eb32b7
I20260709 12:59:46.825412   847 raft_consensus.cc:3060] T feed72ce7e2549d7a27dc7595bac0d3d P 800d84c2f42d4aabac1286f0b27d4ccb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:46.833984   847 raft_consensus.cc:2749] T feed72ce7e2549d7a27dc7595bac0d3d P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:46.835532   852 consensus_queue.cc:1048] T feed72ce7e2549d7a27dc7595bac0d3d P 4ab595233c1b47d2980dcad8b04a45e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:46.854743   852 consensus_queue.cc:1048] T feed72ce7e2549d7a27dc7595bac0d3d P 4ab595233c1b47d2980dcad8b04a45e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:59:46.913383   511 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:46.972585   815 consensus_queue.cc:1048] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:46.983788   819 consensus_queue.cc:1048] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:59:47.920063   511 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:47.939823   852 raft_consensus.cc:493] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.940344   852 raft_consensus.cc:515] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:47.942014   852 leader_election.cc:290] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201), c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179)
I20260709 12:59:47.943073   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11d9c8b7a0c408696e8ad7ef2b1ae15" candidate_uuid: "4ab595233c1b47d2980dcad8b04a45e3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" is_pre_election: true
I20260709 12:59:47.943404   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11d9c8b7a0c408696e8ad7ef2b1ae15" candidate_uuid: "4ab595233c1b47d2980dcad8b04a45e3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" is_pre_election: true
I20260709 12:59:47.943630   564 raft_consensus.cc:2468] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ab595233c1b47d2980dcad8b04a45e3 in term 1.
I20260709 12:59:47.944126   713 raft_consensus.cc:2468] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ab595233c1b47d2980dcad8b04a45e3 in term 1.
I20260709 12:59:47.944805   607 leader_election.cc:304] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ab595233c1b47d2980dcad8b04a45e3, 800d84c2f42d4aabac1286f0b27d4ccb; no voters: 
I20260709 12:59:47.945740   852 raft_consensus.cc:2804] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:47.946086   852 raft_consensus.cc:493] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:47.946363   852 raft_consensus.cc:3060] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:47.951398   852 raft_consensus.cc:515] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:47.953140   852 leader_election.cc:290] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 2 election: Requested vote from peers 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201), c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179)
I20260709 12:59:47.954039   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11d9c8b7a0c408696e8ad7ef2b1ae15" candidate_uuid: "4ab595233c1b47d2980dcad8b04a45e3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb"
I20260709 12:59:47.954342   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11d9c8b7a0c408696e8ad7ef2b1ae15" candidate_uuid: "4ab595233c1b47d2980dcad8b04a45e3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7"
I20260709 12:59:47.954639   564 raft_consensus.cc:3060] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:47.954933   713 raft_consensus.cc:3060] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:47.959954   713 raft_consensus.cc:2468] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ab595233c1b47d2980dcad8b04a45e3 in term 2.
I20260709 12:59:47.960292   564 raft_consensus.cc:2468] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ab595233c1b47d2980dcad8b04a45e3 in term 2.
I20260709 12:59:47.961184   607 leader_election.cc:304] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ab595233c1b47d2980dcad8b04a45e3, c5c35c4177154a2aa180bef5b4eb32b7; no voters: 
I20260709 12:59:47.962019   852 raft_consensus.cc:2804] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:47.963002   852 raft_consensus.cc:697] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 LEADER]: Becoming Leader. State: Replica: 4ab595233c1b47d2980dcad8b04a45e3, State: Running, Role: LEADER
I20260709 12:59:47.963773   852 consensus_queue.cc:237] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:47.976816   460 catalog_manager.cc:5697] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 reported cstate change: term changed from 0 to 2, leader changed from <none> to 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "4ab595233c1b47d2980dcad8b04a45e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:48.023221   713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "768734dfe27846478ec2b650e2289608"
dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7"
mode: GRACEFUL
new_leader_uuid: "800d84c2f42d4aabac1286f0b27d4ccb"
 from {username='slave'} at 127.0.0.1:34890
I20260709 12:59:48.023837   713 raft_consensus.cc:606] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 LEADER]: Received request to transfer leadership to TS 800d84c2f42d4aabac1286f0b27d4ccb
I20260709 12:59:48.029524   713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a146a08439145c189f2d8111591a7e4"
dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7"
mode: GRACEFUL
new_leader_uuid: "800d84c2f42d4aabac1286f0b27d4ccb"
 from {username='slave'} at 127.0.0.1:34890
I20260709 12:59:48.029989   713 raft_consensus.cc:606] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 LEADER]: Received request to transfer leadership to TS 800d84c2f42d4aabac1286f0b27d4ccb
I20260709 12:59:48.037598   713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67696df2323642db84a45062c01e2d29"
dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7"
mode: GRACEFUL
new_leader_uuid: "4ab595233c1b47d2980dcad8b04a45e3"
 from {username='slave'} at 127.0.0.1:34890
I20260709 12:59:48.038079   713 raft_consensus.cc:606] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 LEADER]: Received request to transfer leadership to TS 4ab595233c1b47d2980dcad8b04a45e3
I20260709 12:59:48.049266   713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff561f1c72b14a8881b49a495683999a"
dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7"
mode: GRACEFUL
new_leader_uuid: "4ab595233c1b47d2980dcad8b04a45e3"
 from {username='slave'} at 127.0.0.1:34890
I20260709 12:59:48.049790   713 raft_consensus.cc:606] T ff561f1c72b14a8881b49a495683999a P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 LEADER]: Received request to transfer leadership to TS 4ab595233c1b47d2980dcad8b04a45e3
I20260709 12:59:48.064553   638 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "feed72ce7e2549d7a27dc7595bac0d3d"
dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3"
mode: GRACEFUL
new_leader_uuid: "c5c35c4177154a2aa180bef5b4eb32b7"
 from {username='slave'} at 127.0.0.1:48118
I20260709 12:59:48.065062   638 raft_consensus.cc:606] T feed72ce7e2549d7a27dc7595bac0d3d P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 LEADER]: Received request to transfer leadership to TS c5c35c4177154a2aa180bef5b4eb32b7
I20260709 12:59:48.105181   815 raft_consensus.cc:993] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7: : Instructing follower 4ab595233c1b47d2980dcad8b04a45e3 to start an election
I20260709 12:59:48.105683   819 raft_consensus.cc:1081] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 LEADER]: Signalling peer 4ab595233c1b47d2980dcad8b04a45e3 to start an election
I20260709 12:59:48.107960   638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67696df2323642db84a45062c01e2d29"
dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3"
 from {username='slave'} at 127.0.0.1:48104
I20260709 12:59:48.108472   638 raft_consensus.cc:493] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:48.108758   638 raft_consensus.cc:3060] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:48.115027   638 raft_consensus.cc:515] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:48.117247   638 leader_election.cc:290] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 2 election: Requested vote from peers 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201), c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179)
I20260709 12:59:48.118083   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67696df2323642db84a45062c01e2d29" candidate_uuid: "4ab595233c1b47d2980dcad8b04a45e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb"
I20260709 12:59:48.118535   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67696df2323642db84a45062c01e2d29" candidate_uuid: "4ab595233c1b47d2980dcad8b04a45e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7"
I20260709 12:59:48.118641   564 raft_consensus.cc:3060] T 67696df2323642db84a45062c01e2d29 P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:48.119051   713 raft_consensus.cc:3055] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:48.119340   713 raft_consensus.cc:740] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5c35c4177154a2aa180bef5b4eb32b7, State: Running, Role: LEADER
I20260709 12:59:48.120059   713 consensus_queue.cc:260] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:48.121155   713 raft_consensus.cc:3060] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:48.123757   564 raft_consensus.cc:2468] T 67696df2323642db84a45062c01e2d29 P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ab595233c1b47d2980dcad8b04a45e3 in term 2.
I20260709 12:59:48.124857   607 leader_election.cc:304] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ab595233c1b47d2980dcad8b04a45e3, 800d84c2f42d4aabac1286f0b27d4ccb; no voters: 
I20260709 12:59:48.125736   852 raft_consensus.cc:2804] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:48.126222   852 raft_consensus.cc:697] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 LEADER]: Becoming Leader. State: Replica: 4ab595233c1b47d2980dcad8b04a45e3, State: Running, Role: LEADER
I20260709 12:59:48.126410   713 raft_consensus.cc:2468] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ab595233c1b47d2980dcad8b04a45e3 in term 2.
I20260709 12:59:48.127079   852 consensus_queue.cc:237] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:48.135509   460 catalog_manager.cc:5697] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3 reported cstate change: term changed from 1 to 2, leader changed from c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195) to 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "4ab595233c1b47d2980dcad8b04a45e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:48.183013   859 raft_consensus.cc:993] T feed72ce7e2549d7a27dc7595bac0d3d P 4ab595233c1b47d2980dcad8b04a45e3: : Instructing follower c5c35c4177154a2aa180bef5b4eb32b7 to start an election
I20260709 12:59:48.183449   852 raft_consensus.cc:1081] T feed72ce7e2549d7a27dc7595bac0d3d P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 LEADER]: Signalling peer c5c35c4177154a2aa180bef5b4eb32b7 to start an election
I20260709 12:59:48.184944   713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "feed72ce7e2549d7a27dc7595bac0d3d"
dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7"
 from {username='slave'} at 127.0.0.1:34858
I20260709 12:59:48.185405   713 raft_consensus.cc:493] T feed72ce7e2549d7a27dc7595bac0d3d P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:48.185662   713 raft_consensus.cc:3060] T feed72ce7e2549d7a27dc7595bac0d3d P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:48.190321   713 raft_consensus.cc:515] T feed72ce7e2549d7a27dc7595bac0d3d P c5c35c4177154a2aa180bef5b4eb32b7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:48.192085   713 leader_election.cc:290] T feed72ce7e2549d7a27dc7595bac0d3d P c5c35c4177154a2aa180bef5b4eb32b7 [CANDIDATE]: Term 2 election: Requested vote from peers 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201), 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299)
I20260709 12:59:48.192966   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feed72ce7e2549d7a27dc7595bac0d3d" candidate_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb"
I20260709 12:59:48.193284   638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feed72ce7e2549d7a27dc7595bac0d3d" candidate_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3"
I20260709 12:59:48.193557   564 raft_consensus.cc:3060] T feed72ce7e2549d7a27dc7595bac0d3d P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:48.193871   638 raft_consensus.cc:3055] T feed72ce7e2549d7a27dc7595bac0d3d P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:48.194218   638 raft_consensus.cc:740] T feed72ce7e2549d7a27dc7595bac0d3d P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4ab595233c1b47d2980dcad8b04a45e3, State: Running, Role: LEADER
I20260709 12:59:48.194975   638 consensus_queue.cc:260] T feed72ce7e2549d7a27dc7595bac0d3d P 4ab595233c1b47d2980dcad8b04a45e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:48.196087   638 raft_consensus.cc:3060] T feed72ce7e2549d7a27dc7595bac0d3d P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:48.199668   564 raft_consensus.cc:2468] T feed72ce7e2549d7a27dc7595bac0d3d P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5c35c4177154a2aa180bef5b4eb32b7 in term 2.
I20260709 12:59:48.200727   681 leader_election.cc:304] T feed72ce7e2549d7a27dc7595bac0d3d P c5c35c4177154a2aa180bef5b4eb32b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 800d84c2f42d4aabac1286f0b27d4ccb, c5c35c4177154a2aa180bef5b4eb32b7; no voters: 
I20260709 12:59:48.201613   819 raft_consensus.cc:2804] T feed72ce7e2549d7a27dc7595bac0d3d P c5c35c4177154a2aa180bef5b4eb32b7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:48.202037   638 raft_consensus.cc:2468] T feed72ce7e2549d7a27dc7595bac0d3d P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5c35c4177154a2aa180bef5b4eb32b7 in term 2.
I20260709 12:59:48.202126   819 raft_consensus.cc:697] T feed72ce7e2549d7a27dc7595bac0d3d P c5c35c4177154a2aa180bef5b4eb32b7 [term 2 LEADER]: Becoming Leader. State: Replica: c5c35c4177154a2aa180bef5b4eb32b7, State: Running, Role: LEADER
I20260709 12:59:48.204202   819 consensus_queue.cc:237] T feed72ce7e2549d7a27dc7595bac0d3d P c5c35c4177154a2aa180bef5b4eb32b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:48.216888   460 catalog_manager.cc:5697] T feed72ce7e2549d7a27dc7595bac0d3d P c5c35c4177154a2aa180bef5b4eb32b7 reported cstate change: term changed from 1 to 2, leader changed from 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194) to c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:48.325803   815 raft_consensus.cc:993] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7: : Instructing follower 800d84c2f42d4aabac1286f0b27d4ccb to start an election
I20260709 12:59:48.326256   819 raft_consensus.cc:1081] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 LEADER]: Signalling peer 800d84c2f42d4aabac1286f0b27d4ccb to start an election
I20260709 12:59:48.327749   564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "768734dfe27846478ec2b650e2289608"
dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb"
 from {username='slave'} at 127.0.0.1:55050
I20260709 12:59:48.328263   564 raft_consensus.cc:493] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:48.328552   564 raft_consensus.cc:3060] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:48.333894   564 raft_consensus.cc:515] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:48.335446   564 leader_election.cc:290] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 2 election: Requested vote from peers 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299), c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179)
I20260709 12:59:48.336304   638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768734dfe27846478ec2b650e2289608" candidate_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3"
I20260709 12:59:48.336653   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768734dfe27846478ec2b650e2289608" candidate_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7"
I20260709 12:59:48.336849   638 raft_consensus.cc:3060] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:48.337231   713 raft_consensus.cc:3055] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:48.337620   713 raft_consensus.cc:740] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5c35c4177154a2aa180bef5b4eb32b7, State: Running, Role: LEADER
I20260709 12:59:48.338449   713 consensus_queue.cc:260] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:48.339663   713 raft_consensus.cc:3060] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:48.342820   638 raft_consensus.cc:2468] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 800d84c2f42d4aabac1286f0b27d4ccb in term 2.
I20260709 12:59:48.344063   532 leader_election.cc:304] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ab595233c1b47d2980dcad8b04a45e3, 800d84c2f42d4aabac1286f0b27d4ccb; no voters: 
I20260709 12:59:48.344885   766 raft_consensus.cc:2804] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:48.345618   713 raft_consensus.cc:2468] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 800d84c2f42d4aabac1286f0b27d4ccb in term 2.
I20260709 12:59:48.346354   766 raft_consensus.cc:697] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 LEADER]: Becoming Leader. State: Replica: 800d84c2f42d4aabac1286f0b27d4ccb, State: Running, Role: LEADER
I20260709 12:59:48.347249   766 consensus_queue.cc:237] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:48.354743   460 catalog_manager.cc:5697] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb reported cstate change: term changed from 1 to 2, leader changed from c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195) to 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193). New cstate: current_term: 2 leader_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:48.420195   815 raft_consensus.cc:993] T ff561f1c72b14a8881b49a495683999a P c5c35c4177154a2aa180bef5b4eb32b7: : Instructing follower 4ab595233c1b47d2980dcad8b04a45e3 to start an election
I20260709 12:59:48.420657   815 raft_consensus.cc:1081] T ff561f1c72b14a8881b49a495683999a P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 LEADER]: Signalling peer 4ab595233c1b47d2980dcad8b04a45e3 to start an election
I20260709 12:59:48.422189   638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff561f1c72b14a8881b49a495683999a"
dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3"
 from {username='slave'} at 127.0.0.1:48104
I20260709 12:59:48.422696   638 raft_consensus.cc:493] T ff561f1c72b14a8881b49a495683999a P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:48.423045   638 raft_consensus.cc:3060] T ff561f1c72b14a8881b49a495683999a P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:48.428695   638 raft_consensus.cc:515] T ff561f1c72b14a8881b49a495683999a P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:48.430317   638 leader_election.cc:290] T ff561f1c72b14a8881b49a495683999a P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 2 election: Requested vote from peers 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201), c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179)
I20260709 12:59:48.431246   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff561f1c72b14a8881b49a495683999a" candidate_uuid: "4ab595233c1b47d2980dcad8b04a45e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb"
I20260709 12:59:48.431423   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff561f1c72b14a8881b49a495683999a" candidate_uuid: "4ab595233c1b47d2980dcad8b04a45e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7"
I20260709 12:59:48.431864   564 raft_consensus.cc:3060] T ff561f1c72b14a8881b49a495683999a P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:48.431977   713 raft_consensus.cc:3055] T ff561f1c72b14a8881b49a495683999a P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:48.432348   713 raft_consensus.cc:740] T ff561f1c72b14a8881b49a495683999a P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5c35c4177154a2aa180bef5b4eb32b7, State: Running, Role: LEADER
I20260709 12:59:48.433032   713 consensus_queue.cc:260] T ff561f1c72b14a8881b49a495683999a P c5c35c4177154a2aa180bef5b4eb32b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:48.434016   713 raft_consensus.cc:3060] T ff561f1c72b14a8881b49a495683999a P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:48.437247   564 raft_consensus.cc:2468] T ff561f1c72b14a8881b49a495683999a P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ab595233c1b47d2980dcad8b04a45e3 in term 2.
I20260709 12:59:48.438398   607 leader_election.cc:304] T ff561f1c72b14a8881b49a495683999a P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ab595233c1b47d2980dcad8b04a45e3, 800d84c2f42d4aabac1286f0b27d4ccb; no voters: 
I20260709 12:59:48.439194   852 raft_consensus.cc:2804] T ff561f1c72b14a8881b49a495683999a P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:48.439420   713 raft_consensus.cc:2468] T ff561f1c72b14a8881b49a495683999a P c5c35c4177154a2aa180bef5b4eb32b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ab595233c1b47d2980dcad8b04a45e3 in term 2.
I20260709 12:59:48.439730   852 raft_consensus.cc:697] T ff561f1c72b14a8881b49a495683999a P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 LEADER]: Becoming Leader. State: Replica: 4ab595233c1b47d2980dcad8b04a45e3, State: Running, Role: LEADER
I20260709 12:59:48.440585   852 consensus_queue.cc:237] T ff561f1c72b14a8881b49a495683999a P 4ab595233c1b47d2980dcad8b04a45e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:48.443360   713 raft_consensus.cc:1275] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7 [term 2 FOLLOWER]: Refusing update from remote peer 4ab595233c1b47d2980dcad8b04a45e3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:59:48.444748   852 consensus_queue.cc:1048] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:48.449417   460 catalog_manager.cc:5697] T ff561f1c72b14a8881b49a495683999a P 4ab595233c1b47d2980dcad8b04a45e3 reported cstate change: term changed from 1 to 2, leader changed from c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195) to 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "4ab595233c1b47d2980dcad8b04a45e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:48.457618   564 raft_consensus.cc:1275] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 FOLLOWER]: Refusing update from remote peer 4ab595233c1b47d2980dcad8b04a45e3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:59:48.459247   852 consensus_queue.cc:1048] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:48.533474   819 raft_consensus.cc:993] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7: : Instructing follower 800d84c2f42d4aabac1286f0b27d4ccb to start an election
I20260709 12:59:48.534025   815 raft_consensus.cc:1081] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 LEADER]: Signalling peer 800d84c2f42d4aabac1286f0b27d4ccb to start an election
I20260709 12:59:48.535802   564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a146a08439145c189f2d8111591a7e4"
dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb"
 from {username='slave'} at 127.0.0.1:55050
I20260709 12:59:48.536407   564 raft_consensus.cc:493] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:48.536765   564 raft_consensus.cc:3060] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:48.541431   564 raft_consensus.cc:515] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:48.543444   564 leader_election.cc:290] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 2 election: Requested vote from peers 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299), c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179)
I20260709 12:59:48.544133   638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a146a08439145c189f2d8111591a7e4" candidate_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3"
I20260709 12:59:48.544723   638 raft_consensus.cc:3060] T 8a146a08439145c189f2d8111591a7e4 P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:48.544577   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a146a08439145c189f2d8111591a7e4" candidate_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7"
I20260709 12:59:48.545327   713 raft_consensus.cc:3055] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:48.545601   713 raft_consensus.cc:740] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5c35c4177154a2aa180bef5b4eb32b7, State: Running, Role: LEADER
I20260709 12:59:48.546363   713 consensus_queue.cc:260] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:48.547333   713 raft_consensus.cc:3060] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:48.549649   638 raft_consensus.cc:2468] T 8a146a08439145c189f2d8111591a7e4 P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 800d84c2f42d4aabac1286f0b27d4ccb in term 2.
I20260709 12:59:48.550691   532 leader_election.cc:304] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ab595233c1b47d2980dcad8b04a45e3, 800d84c2f42d4aabac1286f0b27d4ccb; no voters: 
I20260709 12:59:48.551518   870 raft_consensus.cc:2804] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:48.552034   870 raft_consensus.cc:697] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 LEADER]: Becoming Leader. State: Replica: 800d84c2f42d4aabac1286f0b27d4ccb, State: Running, Role: LEADER
I20260709 12:59:48.552892   870 consensus_queue.cc:237] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:48.553651   713 raft_consensus.cc:2468] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 800d84c2f42d4aabac1286f0b27d4ccb in term 2.
I20260709 12:59:48.560838   463 catalog_manager.cc:5697] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb reported cstate change: term changed from 1 to 2, leader changed from c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195) to 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193). New cstate: current_term: 2 leader_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:48.586319   564 raft_consensus.cc:1275] T feed72ce7e2549d7a27dc7595bac0d3d P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 FOLLOWER]: Refusing update from remote peer c5c35c4177154a2aa180bef5b4eb32b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:48.587678   815 consensus_queue.cc:1048] T feed72ce7e2549d7a27dc7595bac0d3d P c5c35c4177154a2aa180bef5b4eb32b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:48.591221   565 raft_consensus.cc:1275] T 67696df2323642db84a45062c01e2d29 P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 FOLLOWER]: Refusing update from remote peer 4ab595233c1b47d2980dcad8b04a45e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:48.592927   852 consensus_queue.cc:1048] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:48.594864   638 raft_consensus.cc:1275] T feed72ce7e2549d7a27dc7595bac0d3d P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 FOLLOWER]: Refusing update from remote peer c5c35c4177154a2aa180bef5b4eb32b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:48.596347   819 consensus_queue.cc:1048] T feed72ce7e2549d7a27dc7595bac0d3d P c5c35c4177154a2aa180bef5b4eb32b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:48.605111   713 raft_consensus.cc:1275] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [term 2 FOLLOWER]: Refusing update from remote peer 4ab595233c1b47d2980dcad8b04a45e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:48.606398   852 consensus_queue.cc:1048] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:48.744164   638 raft_consensus.cc:1275] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 FOLLOWER]: Refusing update from remote peer 800d84c2f42d4aabac1286f0b27d4ccb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:48.745436   870 consensus_queue.cc:1048] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:48.756104   713 raft_consensus.cc:1275] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7 [term 2 FOLLOWER]: Refusing update from remote peer 800d84c2f42d4aabac1286f0b27d4ccb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:48.757653   766 consensus_queue.cc:1048] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:49.008632   713 raft_consensus.cc:1275] T ff561f1c72b14a8881b49a495683999a P c5c35c4177154a2aa180bef5b4eb32b7 [term 2 FOLLOWER]: Refusing update from remote peer 4ab595233c1b47d2980dcad8b04a45e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:49.010151   875 consensus_queue.cc:1048] T ff561f1c72b14a8881b49a495683999a P 4ab595233c1b47d2980dcad8b04a45e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:49.022157   565 raft_consensus.cc:1275] T ff561f1c72b14a8881b49a495683999a P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 FOLLOWER]: Refusing update from remote peer 4ab595233c1b47d2980dcad8b04a45e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:49.025934   852 consensus_queue.cc:1048] T ff561f1c72b14a8881b49a495683999a P 4ab595233c1b47d2980dcad8b04a45e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:49.099170   638 raft_consensus.cc:1275] T 8a146a08439145c189f2d8111591a7e4 P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 FOLLOWER]: Refusing update from remote peer 800d84c2f42d4aabac1286f0b27d4ccb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:49.100500   766 consensus_queue.cc:1048] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:49.110037   713 raft_consensus.cc:1275] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7 [term 2 FOLLOWER]: Refusing update from remote peer 800d84c2f42d4aabac1286f0b27d4ccb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:49.111562   887 consensus_queue.cc:1048] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:51.096808   431 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 12:59:51.097759   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:51.115319   565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78aff2e266df4a51b635f6b10ce9600a"
dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb"
mode: GRACEFUL
new_leader_uuid: "c5c35c4177154a2aa180bef5b4eb32b7"
 from {username='slave'} at 127.0.0.1:45184
I20260709 12:59:51.116008   565 raft_consensus.cc:606] T 78aff2e266df4a51b635f6b10ce9600a P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 LEADER]: Received request to transfer leadership to TS c5c35c4177154a2aa180bef5b4eb32b7
I20260709 12:59:51.127178   638 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d11d9c8b7a0c408696e8ad7ef2b1ae15"
dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3"
mode: GRACEFUL
new_leader_uuid: "c5c35c4177154a2aa180bef5b4eb32b7"
 from {username='slave'} at 127.0.0.1:47498
I20260709 12:59:51.127696   638 raft_consensus.cc:606] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 LEADER]: Received request to transfer leadership to TS c5c35c4177154a2aa180bef5b4eb32b7
I20260709 12:59:51.129065   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:59:51.129597   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:51.248564   887 raft_consensus.cc:993] T 78aff2e266df4a51b635f6b10ce9600a P 800d84c2f42d4aabac1286f0b27d4ccb: : Instructing follower c5c35c4177154a2aa180bef5b4eb32b7 to start an election
I20260709 12:59:51.249221   900 raft_consensus.cc:1081] T 78aff2e266df4a51b635f6b10ce9600a P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 LEADER]: Signalling peer c5c35c4177154a2aa180bef5b4eb32b7 to start an election
I20260709 12:59:51.250582   714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78aff2e266df4a51b635f6b10ce9600a"
dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7"
 from {username='slave'} at 127.0.0.1:34874
I20260709 12:59:51.251073   714 raft_consensus.cc:493] T 78aff2e266df4a51b635f6b10ce9600a P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:51.251420   714 raft_consensus.cc:3060] T 78aff2e266df4a51b635f6b10ce9600a P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:51.256690   714 raft_consensus.cc:515] T 78aff2e266df4a51b635f6b10ce9600a P c5c35c4177154a2aa180bef5b4eb32b7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:51.259830   638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78aff2e266df4a51b635f6b10ce9600a" candidate_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3"
I20260709 12:59:51.259572   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78aff2e266df4a51b635f6b10ce9600a" candidate_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb"
I20260709 12:59:51.260478   565 raft_consensus.cc:3055] T 78aff2e266df4a51b635f6b10ce9600a P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:51.260888   565 raft_consensus.cc:740] T 78aff2e266df4a51b635f6b10ce9600a P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 800d84c2f42d4aabac1286f0b27d4ccb, State: Running, Role: LEADER
I20260709 12:59:51.260390   638 raft_consensus.cc:3060] T 78aff2e266df4a51b635f6b10ce9600a P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:51.261720   565 consensus_queue.cc:260] T 78aff2e266df4a51b635f6b10ce9600a P 800d84c2f42d4aabac1286f0b27d4ccb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:51.262961   565 raft_consensus.cc:3060] T 78aff2e266df4a51b635f6b10ce9600a P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:51.258850   714 leader_election.cc:290] T 78aff2e266df4a51b635f6b10ce9600a P c5c35c4177154a2aa180bef5b4eb32b7 [CANDIDATE]: Term 2 election: Requested vote from peers 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201), 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299)
I20260709 12:59:51.267900   638 raft_consensus.cc:2468] T 78aff2e266df4a51b635f6b10ce9600a P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5c35c4177154a2aa180bef5b4eb32b7 in term 2.
I20260709 12:59:51.268512   565 raft_consensus.cc:2468] T 78aff2e266df4a51b635f6b10ce9600a P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5c35c4177154a2aa180bef5b4eb32b7 in term 2.
I20260709 12:59:51.269037   681 leader_election.cc:304] T 78aff2e266df4a51b635f6b10ce9600a P c5c35c4177154a2aa180bef5b4eb32b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ab595233c1b47d2980dcad8b04a45e3, c5c35c4177154a2aa180bef5b4eb32b7; no voters: 
I20260709 12:59:51.269905   896 raft_consensus.cc:2804] T 78aff2e266df4a51b635f6b10ce9600a P c5c35c4177154a2aa180bef5b4eb32b7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:51.271219   896 raft_consensus.cc:697] T 78aff2e266df4a51b635f6b10ce9600a P c5c35c4177154a2aa180bef5b4eb32b7 [term 2 LEADER]: Becoming Leader. State: Replica: c5c35c4177154a2aa180bef5b4eb32b7, State: Running, Role: LEADER
I20260709 12:59:51.272046   896 consensus_queue.cc:237] T 78aff2e266df4a51b635f6b10ce9600a P c5c35c4177154a2aa180bef5b4eb32b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:51.279412   463 catalog_manager.cc:5697] T 78aff2e266df4a51b635f6b10ce9600a P c5c35c4177154a2aa180bef5b4eb32b7 reported cstate change: term changed from 1 to 2, leader changed from 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193) to c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:51.611915   895 raft_consensus.cc:993] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3: : Instructing follower c5c35c4177154a2aa180bef5b4eb32b7 to start an election
I20260709 12:59:51.612589   907 raft_consensus.cc:1081] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 LEADER]: Signalling peer c5c35c4177154a2aa180bef5b4eb32b7 to start an election
I20260709 12:59:51.614504   714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d11d9c8b7a0c408696e8ad7ef2b1ae15"
dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7"
 from {username='slave'} at 127.0.0.1:34858
I20260709 12:59:51.615216   714 raft_consensus.cc:493] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:51.615556   714 raft_consensus.cc:3060] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:51.620740   714 raft_consensus.cc:515] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:51.622388   714 leader_election.cc:290] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7 [CANDIDATE]: Term 3 election: Requested vote from peers 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201), 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299)
I20260709 12:59:51.623335   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11d9c8b7a0c408696e8ad7ef2b1ae15" candidate_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb"
I20260709 12:59:51.623590   638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11d9c8b7a0c408696e8ad7ef2b1ae15" candidate_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3"
I20260709 12:59:51.623908   565 raft_consensus.cc:3060] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:51.624143   638 raft_consensus.cc:3055] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:51.624475   638 raft_consensus.cc:740] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4ab595233c1b47d2980dcad8b04a45e3, State: Running, Role: LEADER
I20260709 12:59:51.625134   638 consensus_queue.cc:260] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:51.626103   638 raft_consensus.cc:3060] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:51.629731   565 raft_consensus.cc:2468] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 800d84c2f42d4aabac1286f0b27d4ccb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5c35c4177154a2aa180bef5b4eb32b7 in term 3.
I20260709 12:59:51.630847   681 leader_election.cc:304] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 800d84c2f42d4aabac1286f0b27d4ccb, c5c35c4177154a2aa180bef5b4eb32b7; no voters: 
I20260709 12:59:51.631428   638 raft_consensus.cc:2468] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5c35c4177154a2aa180bef5b4eb32b7 in term 3.
I20260709 12:59:51.631552   896 raft_consensus.cc:2804] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:51.632074   896 raft_consensus.cc:697] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7 [term 3 LEADER]: Becoming Leader. State: Replica: c5c35c4177154a2aa180bef5b4eb32b7, State: Running, Role: LEADER
I20260709 12:59:51.633028   896 consensus_queue.cc:237] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:51.639415   463 catalog_manager.cc:5697] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7 reported cstate change: term changed from 2 to 3, leader changed from 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194) to c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:51.690793   565 raft_consensus.cc:1275] T 78aff2e266df4a51b635f6b10ce9600a P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 FOLLOWER]: Refusing update from remote peer c5c35c4177154a2aa180bef5b4eb32b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:51.692099   896 consensus_queue.cc:1048] T 78aff2e266df4a51b635f6b10ce9600a P c5c35c4177154a2aa180bef5b4eb32b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:51.701987   638 raft_consensus.cc:1275] T 78aff2e266df4a51b635f6b10ce9600a P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 FOLLOWER]: Refusing update from remote peer c5c35c4177154a2aa180bef5b4eb32b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:51.703594   901 consensus_queue.cc:1048] T 78aff2e266df4a51b635f6b10ce9600a P c5c35c4177154a2aa180bef5b4eb32b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:52.105841   565 raft_consensus.cc:1275] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 800d84c2f42d4aabac1286f0b27d4ccb [term 3 FOLLOWER]: Refusing update from remote peer c5c35c4177154a2aa180bef5b4eb32b7: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:52.107045   896 consensus_queue.cc:1048] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:52.118589   638 raft_consensus.cc:1275] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [term 3 FOLLOWER]: Refusing update from remote peer c5c35c4177154a2aa180bef5b4eb32b7: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:52.120081   911 consensus_queue.cc:1048] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:52.130386   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:52.151355   565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "018df5b57c524579ab3bb24c61a13e54"
dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb"
mode: GRACEFUL
new_leader_uuid: "4ab595233c1b47d2980dcad8b04a45e3"
 from {username='slave'} at 127.0.0.1:45200
I20260709 12:59:52.151911   565 raft_consensus.cc:606] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 LEADER]: Received request to transfer leadership to TS 4ab595233c1b47d2980dcad8b04a45e3
I20260709 12:59:52.156941   565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "768734dfe27846478ec2b650e2289608"
dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb"
mode: GRACEFUL
new_leader_uuid: "4ab595233c1b47d2980dcad8b04a45e3"
 from {username='slave'} at 127.0.0.1:45200
I20260709 12:59:52.157523   565 raft_consensus.cc:606] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 LEADER]: Received request to transfer leadership to TS 4ab595233c1b47d2980dcad8b04a45e3
I20260709 12:59:52.162329   565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a146a08439145c189f2d8111591a7e4"
dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb"
mode: GRACEFUL
new_leader_uuid: "4ab595233c1b47d2980dcad8b04a45e3"
 from {username='slave'} at 127.0.0.1:45200
I20260709 12:59:52.162807   565 raft_consensus.cc:606] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 LEADER]: Received request to transfer leadership to TS 4ab595233c1b47d2980dcad8b04a45e3
I20260709 12:59:52.167551   714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78aff2e266df4a51b635f6b10ce9600a"
dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7"
mode: GRACEFUL
new_leader_uuid: "4ab595233c1b47d2980dcad8b04a45e3"
 from {username='slave'} at 127.0.0.1:34890
I20260709 12:59:52.168144   714 raft_consensus.cc:606] T 78aff2e266df4a51b635f6b10ce9600a P c5c35c4177154a2aa180bef5b4eb32b7 [term 2 LEADER]: Received request to transfer leadership to TS 4ab595233c1b47d2980dcad8b04a45e3
I20260709 12:59:52.177542   714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d11d9c8b7a0c408696e8ad7ef2b1ae15"
dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7"
mode: GRACEFUL
new_leader_uuid: "4ab595233c1b47d2980dcad8b04a45e3"
 from {username='slave'} at 127.0.0.1:34890
I20260709 12:59:52.178038   714 raft_consensus.cc:606] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7 [term 3 LEADER]: Received request to transfer leadership to TS 4ab595233c1b47d2980dcad8b04a45e3
I20260709 12:59:52.312979   917 raft_consensus.cc:993] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb: : Instructing follower 4ab595233c1b47d2980dcad8b04a45e3 to start an election
I20260709 12:59:52.313520   900 raft_consensus.cc:1081] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 LEADER]: Signalling peer 4ab595233c1b47d2980dcad8b04a45e3 to start an election
I20260709 12:59:52.314976   638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "768734dfe27846478ec2b650e2289608"
dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3"
 from {username='slave'} at 127.0.0.1:48092
I20260709 12:59:52.315431   638 raft_consensus.cc:493] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:52.315729   638 raft_consensus.cc:3060] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:52.319905   638 raft_consensus.cc:515] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:52.321376   638 leader_election.cc:290] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 3 election: Requested vote from peers 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201), c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179)
I20260709 12:59:52.322310   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768734dfe27846478ec2b650e2289608" candidate_uuid: "4ab595233c1b47d2980dcad8b04a45e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb"
I20260709 12:59:52.322690   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768734dfe27846478ec2b650e2289608" candidate_uuid: "4ab595233c1b47d2980dcad8b04a45e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7"
I20260709 12:59:52.322897   565 raft_consensus.cc:3055] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:52.323186   714 raft_consensus.cc:3060] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:52.323294   565 raft_consensus.cc:740] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 800d84c2f42d4aabac1286f0b27d4ccb, State: Running, Role: LEADER
I20260709 12:59:52.324229   565 consensus_queue.cc:260] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:52.325342   565 raft_consensus.cc:3060] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:52.328123   714 raft_consensus.cc:2468] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ab595233c1b47d2980dcad8b04a45e3 in term 3.
I20260709 12:59:52.329349   607 leader_election.cc:304] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ab595233c1b47d2980dcad8b04a45e3, c5c35c4177154a2aa180bef5b4eb32b7; no voters: 
I20260709 12:59:52.330240   907 raft_consensus.cc:2804] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:52.331470   907 raft_consensus.cc:697] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3 [term 3 LEADER]: Becoming Leader. State: Replica: 4ab595233c1b47d2980dcad8b04a45e3, State: Running, Role: LEADER
I20260709 12:59:52.332105   565 raft_consensus.cc:2468] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ab595233c1b47d2980dcad8b04a45e3 in term 3.
I20260709 12:59:52.332482   907 consensus_queue.cc:237] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:52.339717   463 catalog_manager.cc:5697] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3 reported cstate change: term changed from 2 to 3, leader changed from 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193) to 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "4ab595233c1b47d2980dcad8b04a45e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:52.518033   917 raft_consensus.cc:993] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb: : Instructing follower 4ab595233c1b47d2980dcad8b04a45e3 to start an election
I20260709 12:59:52.518628   900 raft_consensus.cc:1081] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 LEADER]: Signalling peer 4ab595233c1b47d2980dcad8b04a45e3 to start an election
I20260709 12:59:52.520210   638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a146a08439145c189f2d8111591a7e4"
dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3"
 from {username='slave'} at 127.0.0.1:48092
I20260709 12:59:52.520684   638 raft_consensus.cc:493] T 8a146a08439145c189f2d8111591a7e4 P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:52.520972   638 raft_consensus.cc:3060] T 8a146a08439145c189f2d8111591a7e4 P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:52.524945   638 raft_consensus.cc:515] T 8a146a08439145c189f2d8111591a7e4 P 4ab595233c1b47d2980dcad8b04a45e3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:52.526505   638 leader_election.cc:290] T 8a146a08439145c189f2d8111591a7e4 P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 3 election: Requested vote from peers 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201), c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179)
I20260709 12:59:52.527343   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a146a08439145c189f2d8111591a7e4" candidate_uuid: "4ab595233c1b47d2980dcad8b04a45e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb"
I20260709 12:59:52.527647   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a146a08439145c189f2d8111591a7e4" candidate_uuid: "4ab595233c1b47d2980dcad8b04a45e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7"
I20260709 12:59:52.527863   565 raft_consensus.cc:3055] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:52.528245   714 raft_consensus.cc:3060] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:52.528179   565 raft_consensus.cc:740] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 800d84c2f42d4aabac1286f0b27d4ccb, State: Running, Role: LEADER
I20260709 12:59:52.529376   565 consensus_queue.cc:260] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:52.530440   565 raft_consensus.cc:3060] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:52.533459   714 raft_consensus.cc:2468] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ab595233c1b47d2980dcad8b04a45e3 in term 3.
I20260709 12:59:52.534500   607 leader_election.cc:304] T 8a146a08439145c189f2d8111591a7e4 P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ab595233c1b47d2980dcad8b04a45e3, c5c35c4177154a2aa180bef5b4eb32b7; no voters: 
I20260709 12:59:52.535213   907 raft_consensus.cc:2804] T 8a146a08439145c189f2d8111591a7e4 P 4ab595233c1b47d2980dcad8b04a45e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:52.535609   565 raft_consensus.cc:2468] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ab595233c1b47d2980dcad8b04a45e3 in term 3.
I20260709 12:59:52.535742   907 raft_consensus.cc:697] T 8a146a08439145c189f2d8111591a7e4 P 4ab595233c1b47d2980dcad8b04a45e3 [term 3 LEADER]: Becoming Leader. State: Replica: 4ab595233c1b47d2980dcad8b04a45e3, State: Running, Role: LEADER
I20260709 12:59:52.536644   907 consensus_queue.cc:237] T 8a146a08439145c189f2d8111591a7e4 P 4ab595233c1b47d2980dcad8b04a45e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:52.540352   911 raft_consensus.cc:993] T 78aff2e266df4a51b635f6b10ce9600a P c5c35c4177154a2aa180bef5b4eb32b7: : Instructing follower 4ab595233c1b47d2980dcad8b04a45e3 to start an election
I20260709 12:59:52.540849   911 raft_consensus.cc:1081] T 78aff2e266df4a51b635f6b10ce9600a P c5c35c4177154a2aa180bef5b4eb32b7 [term 2 LEADER]: Signalling peer 4ab595233c1b47d2980dcad8b04a45e3 to start an election
I20260709 12:59:52.541733   911 raft_consensus.cc:993] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7: : Instructing follower 4ab595233c1b47d2980dcad8b04a45e3 to start an election
I20260709 12:59:52.542376   896 raft_consensus.cc:1081] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7 [term 3 LEADER]: Signalling peer 4ab595233c1b47d2980dcad8b04a45e3 to start an election
I20260709 12:59:52.542599   641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78aff2e266df4a51b635f6b10ce9600a"
dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3"
 from {username='slave'} at 127.0.0.1:48104
I20260709 12:59:52.543162   641 raft_consensus.cc:493] T 78aff2e266df4a51b635f6b10ce9600a P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:52.543536   641 raft_consensus.cc:3060] T 78aff2e266df4a51b635f6b10ce9600a P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:52.543946   638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d11d9c8b7a0c408696e8ad7ef2b1ae15"
dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3"
 from {username='slave'} at 127.0.0.1:48104
I20260709 12:59:52.544379   638 raft_consensus.cc:493] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:52.544657   638 raft_consensus.cc:3060] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:52.551169   638 raft_consensus.cc:515] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:52.553501   641 raft_consensus.cc:515] T 78aff2e266df4a51b635f6b10ce9600a P 4ab595233c1b47d2980dcad8b04a45e3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:52.553894   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11d9c8b7a0c408696e8ad7ef2b1ae15" candidate_uuid: "4ab595233c1b47d2980dcad8b04a45e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb"
I20260709 12:59:52.554133   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11d9c8b7a0c408696e8ad7ef2b1ae15" candidate_uuid: "4ab595233c1b47d2980dcad8b04a45e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7"
I20260709 12:59:52.554454   565 raft_consensus.cc:3060] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 800d84c2f42d4aabac1286f0b27d4ccb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:52.555850   641 leader_election.cc:290] T 78aff2e266df4a51b635f6b10ce9600a P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 3 election: Requested vote from peers 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201), c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179)
I20260709 12:59:52.554780   714 raft_consensus.cc:3055] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:52.556921   714 raft_consensus.cc:740] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c5c35c4177154a2aa180bef5b4eb32b7, State: Running, Role: LEADER
I20260709 12:59:52.558089   638 leader_election.cc:290] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 4 election: Requested vote from peers 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201), c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179)
I20260709 12:59:52.557868   714 consensus_queue.cc:260] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:52.558377   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78aff2e266df4a51b635f6b10ce9600a" candidate_uuid: "4ab595233c1b47d2980dcad8b04a45e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb"
I20260709 12:59:52.558943   564 raft_consensus.cc:3060] T 78aff2e266df4a51b635f6b10ce9600a P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:52.559089   714 raft_consensus.cc:3060] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:52.559983   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78aff2e266df4a51b635f6b10ce9600a" candidate_uuid: "4ab595233c1b47d2980dcad8b04a45e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7"
I20260709 12:59:52.560539   713 raft_consensus.cc:3055] T 78aff2e266df4a51b635f6b10ce9600a P c5c35c4177154a2aa180bef5b4eb32b7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:52.560843   713 raft_consensus.cc:740] T 78aff2e266df4a51b635f6b10ce9600a P c5c35c4177154a2aa180bef5b4eb32b7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c5c35c4177154a2aa180bef5b4eb32b7, State: Running, Role: LEADER
I20260709 12:59:52.561816   713 consensus_queue.cc:260] T 78aff2e266df4a51b635f6b10ce9600a P c5c35c4177154a2aa180bef5b4eb32b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:52.562649   565 raft_consensus.cc:2468] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 800d84c2f42d4aabac1286f0b27d4ccb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ab595233c1b47d2980dcad8b04a45e3 in term 4.
I20260709 12:59:52.563233   713 raft_consensus.cc:3060] T 78aff2e266df4a51b635f6b10ce9600a P c5c35c4177154a2aa180bef5b4eb32b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:52.563831   607 leader_election.cc:304] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ab595233c1b47d2980dcad8b04a45e3, 800d84c2f42d4aabac1286f0b27d4ccb; no voters: 
I20260709 12:59:52.564762   907 raft_consensus.cc:2804] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:52.571049   714 raft_consensus.cc:2468] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ab595233c1b47d2980dcad8b04a45e3 in term 4.
I20260709 12:59:52.573189   907 raft_consensus.cc:697] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [term 4 LEADER]: Becoming Leader. State: Replica: 4ab595233c1b47d2980dcad8b04a45e3, State: Running, Role: LEADER
I20260709 12:59:52.573597   564 raft_consensus.cc:2468] T 78aff2e266df4a51b635f6b10ce9600a P 800d84c2f42d4aabac1286f0b27d4ccb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ab595233c1b47d2980dcad8b04a45e3 in term 3.
I20260709 12:59:52.557184   463 catalog_manager.cc:5697] T 8a146a08439145c189f2d8111591a7e4 P 4ab595233c1b47d2980dcad8b04a45e3 reported cstate change: term changed from 2 to 3, leader changed from 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193) to 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "4ab595233c1b47d2980dcad8b04a45e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:52.574257   907 consensus_queue.cc:237] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:52.574923   607 leader_election.cc:304] T 78aff2e266df4a51b635f6b10ce9600a P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ab595233c1b47d2980dcad8b04a45e3, 800d84c2f42d4aabac1286f0b27d4ccb; no voters: 
I20260709 12:59:52.576038   713 raft_consensus.cc:2468] T 78aff2e266df4a51b635f6b10ce9600a P c5c35c4177154a2aa180bef5b4eb32b7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ab595233c1b47d2980dcad8b04a45e3 in term 3.
I20260709 12:59:52.576277   921 raft_consensus.cc:2804] T 78aff2e266df4a51b635f6b10ce9600a P 4ab595233c1b47d2980dcad8b04a45e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:52.581676   921 raft_consensus.cc:697] T 78aff2e266df4a51b635f6b10ce9600a P 4ab595233c1b47d2980dcad8b04a45e3 [term 3 LEADER]: Becoming Leader. State: Replica: 4ab595233c1b47d2980dcad8b04a45e3, State: Running, Role: LEADER
I20260709 12:59:52.582767   921 consensus_queue.cc:237] T 78aff2e266df4a51b635f6b10ce9600a P 4ab595233c1b47d2980dcad8b04a45e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:52.591524   463 catalog_manager.cc:5697] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 reported cstate change: term changed from 3 to 4, leader changed from c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195) to 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "4ab595233c1b47d2980dcad8b04a45e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:52.592876   463 catalog_manager.cc:5697] T 78aff2e266df4a51b635f6b10ce9600a P 4ab595233c1b47d2980dcad8b04a45e3 reported cstate change: term changed from 2 to 3, leader changed from c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195) to 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "4ab595233c1b47d2980dcad8b04a45e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:52.697294   917 raft_consensus.cc:993] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb: : Instructing follower 4ab595233c1b47d2980dcad8b04a45e3 to start an election
I20260709 12:59:52.697758   900 raft_consensus.cc:1081] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 LEADER]: Signalling peer 4ab595233c1b47d2980dcad8b04a45e3 to start an election
I20260709 12:59:52.699302   638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "018df5b57c524579ab3bb24c61a13e54"
dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3"
 from {username='slave'} at 127.0.0.1:48092
I20260709 12:59:52.699788   638 raft_consensus.cc:493] T 018df5b57c524579ab3bb24c61a13e54 P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:52.700045   638 raft_consensus.cc:3060] T 018df5b57c524579ab3bb24c61a13e54 P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:52.704596   638 raft_consensus.cc:515] T 018df5b57c524579ab3bb24c61a13e54 P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } } peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } }
I20260709 12:59:52.706077   638 leader_election.cc:290] T 018df5b57c524579ab3bb24c61a13e54 P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 2 election: Requested vote from peers c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179), 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201)
I20260709 12:59:52.707063   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018df5b57c524579ab3bb24c61a13e54" candidate_uuid: "4ab595233c1b47d2980dcad8b04a45e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7"
I20260709 12:59:52.707245   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018df5b57c524579ab3bb24c61a13e54" candidate_uuid: "4ab595233c1b47d2980dcad8b04a45e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb"
I20260709 12:59:52.707670   713 raft_consensus.cc:3060] T 018df5b57c524579ab3bb24c61a13e54 P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:52.707768   564 raft_consensus.cc:3055] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:52.708115   564 raft_consensus.cc:740] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 800d84c2f42d4aabac1286f0b27d4ccb, State: Running, Role: LEADER
I20260709 12:59:52.708746   564 consensus_queue.cc:260] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } } peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } }
I20260709 12:59:52.709813   564 raft_consensus.cc:3060] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:52.712414   713 raft_consensus.cc:2468] T 018df5b57c524579ab3bb24c61a13e54 P c5c35c4177154a2aa180bef5b4eb32b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ab595233c1b47d2980dcad8b04a45e3 in term 2.
I20260709 12:59:52.713388   607 leader_election.cc:304] T 018df5b57c524579ab3bb24c61a13e54 P 4ab595233c1b47d2980dcad8b04a45e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ab595233c1b47d2980dcad8b04a45e3, c5c35c4177154a2aa180bef5b4eb32b7; no voters: 
I20260709 12:59:52.714067   921 raft_consensus.cc:2804] T 018df5b57c524579ab3bb24c61a13e54 P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:52.714504   921 raft_consensus.cc:697] T 018df5b57c524579ab3bb24c61a13e54 P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 LEADER]: Becoming Leader. State: Replica: 4ab595233c1b47d2980dcad8b04a45e3, State: Running, Role: LEADER
I20260709 12:59:52.714641   564 raft_consensus.cc:2468] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ab595233c1b47d2980dcad8b04a45e3 in term 2.
I20260709 12:59:52.715359   921 consensus_queue.cc:237] T 018df5b57c524579ab3bb24c61a13e54 P 4ab595233c1b47d2980dcad8b04a45e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } } peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } }
I20260709 12:59:52.723088   463 catalog_manager.cc:5697] T 018df5b57c524579ab3bb24c61a13e54 P 4ab595233c1b47d2980dcad8b04a45e3 reported cstate change: term changed from 1 to 2, leader changed from 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193) to 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "4ab595233c1b47d2980dcad8b04a45e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:52.867859   564 raft_consensus.cc:1275] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [term 3 FOLLOWER]: Refusing update from remote peer 4ab595233c1b47d2980dcad8b04a45e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:52.870179   921 consensus_queue.cc:1048] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:52.877260   713 raft_consensus.cc:1275] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7 [term 3 FOLLOWER]: Refusing update from remote peer 4ab595233c1b47d2980dcad8b04a45e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:52.879264   921 consensus_queue.cc:1048] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:52.985333   713 raft_consensus.cc:1275] T 78aff2e266df4a51b635f6b10ce9600a P c5c35c4177154a2aa180bef5b4eb32b7 [term 3 FOLLOWER]: Refusing update from remote peer 4ab595233c1b47d2980dcad8b04a45e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:52.986732   928 consensus_queue.cc:1048] T 78aff2e266df4a51b635f6b10ce9600a P 4ab595233c1b47d2980dcad8b04a45e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:52.995648   564 raft_consensus.cc:1275] T 78aff2e266df4a51b635f6b10ce9600a P 800d84c2f42d4aabac1286f0b27d4ccb [term 3 FOLLOWER]: Refusing update from remote peer 4ab595233c1b47d2980dcad8b04a45e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:52.997380   921 consensus_queue.cc:1048] T 78aff2e266df4a51b635f6b10ce9600a P 4ab595233c1b47d2980dcad8b04a45e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:53.000213   713 raft_consensus.cc:1275] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7 [term 3 FOLLOWER]: Refusing update from remote peer 4ab595233c1b47d2980dcad8b04a45e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:53.003613   928 consensus_queue.cc:1048] T 8a146a08439145c189f2d8111591a7e4 P 4ab595233c1b47d2980dcad8b04a45e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:53.019078   564 raft_consensus.cc:1275] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb [term 3 FOLLOWER]: Refusing update from remote peer 4ab595233c1b47d2980dcad8b04a45e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:53.020406   921 consensus_queue.cc:1048] T 8a146a08439145c189f2d8111591a7e4 P 4ab595233c1b47d2980dcad8b04a45e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:53.070639   713 raft_consensus.cc:1275] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7 [term 4 FOLLOWER]: Refusing update from remote peer 4ab595233c1b47d2980dcad8b04a45e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:53.071942   921 consensus_queue.cc:1048] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:53.079936   564 raft_consensus.cc:1275] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 800d84c2f42d4aabac1286f0b27d4ccb [term 4 FOLLOWER]: Refusing update from remote peer 4ab595233c1b47d2980dcad8b04a45e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:53.082046   928 consensus_queue.cc:1048] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:53.300670   564 raft_consensus.cc:1275] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 FOLLOWER]: Refusing update from remote peer 4ab595233c1b47d2980dcad8b04a45e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:53.301857   928 consensus_queue.cc:1048] T 018df5b57c524579ab3bb24c61a13e54 P 4ab595233c1b47d2980dcad8b04a45e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:53.309994   713 raft_consensus.cc:1275] T 018df5b57c524579ab3bb24c61a13e54 P c5c35c4177154a2aa180bef5b4eb32b7 [term 2 FOLLOWER]: Refusing update from remote peer 4ab595233c1b47d2980dcad8b04a45e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:53.311475   907 consensus_queue.cc:1048] T 018df5b57c524579ab3bb24c61a13e54 P 4ab595233c1b47d2980dcad8b04a45e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:55.184855   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:55.192217   638 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "018df5b57c524579ab3bb24c61a13e54"
dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3"
mode: GRACEFUL
new_leader_uuid: "800d84c2f42d4aabac1286f0b27d4ccb"
 from {username='slave'} at 127.0.0.1:47498
I20260709 12:59:55.192628   638 raft_consensus.cc:606] T 018df5b57c524579ab3bb24c61a13e54 P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 LEADER]: Received request to transfer leadership to TS 800d84c2f42d4aabac1286f0b27d4ccb
I20260709 12:59:55.194798   638 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52db24cb6b184170af5d6cc1b6ef0b2a"
dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3"
mode: GRACEFUL
new_leader_uuid: "c5c35c4177154a2aa180bef5b4eb32b7"
 from {username='slave'} at 127.0.0.1:47498
I20260709 12:59:55.195158   638 raft_consensus.cc:606] T 52db24cb6b184170af5d6cc1b6ef0b2a P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 LEADER]: Received request to transfer leadership to TS c5c35c4177154a2aa180bef5b4eb32b7
I20260709 12:59:55.197147   638 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67696df2323642db84a45062c01e2d29"
dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3"
mode: GRACEFUL
new_leader_uuid: "c5c35c4177154a2aa180bef5b4eb32b7"
 from {username='slave'} at 127.0.0.1:47498
I20260709 12:59:55.197552   638 raft_consensus.cc:606] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 LEADER]: Received request to transfer leadership to TS c5c35c4177154a2aa180bef5b4eb32b7
I20260709 12:59:55.199877   638 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "768734dfe27846478ec2b650e2289608"
dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3"
mode: GRACEFUL
new_leader_uuid: "800d84c2f42d4aabac1286f0b27d4ccb"
 from {username='slave'} at 127.0.0.1:47498
I20260709 12:59:55.200333   638 raft_consensus.cc:606] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3 [term 3 LEADER]: Received request to transfer leadership to TS 800d84c2f42d4aabac1286f0b27d4ccb
I20260709 12:59:55.202503   638 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a146a08439145c189f2d8111591a7e4"
dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3"
mode: GRACEFUL
new_leader_uuid: "800d84c2f42d4aabac1286f0b27d4ccb"
 from {username='slave'} at 127.0.0.1:47498
I20260709 12:59:55.202947   638 raft_consensus.cc:606] T 8a146a08439145c189f2d8111591a7e4 P 4ab595233c1b47d2980dcad8b04a45e3 [term 3 LEADER]: Received request to transfer leadership to TS 800d84c2f42d4aabac1286f0b27d4ccb
I20260709 12:59:55.204144   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:55.204653   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:55.208621   943 raft_consensus.cc:993] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3: : Instructing follower c5c35c4177154a2aa180bef5b4eb32b7 to start an election
I20260709 12:59:55.209091   907 raft_consensus.cc:1081] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 LEADER]: Signalling peer c5c35c4177154a2aa180bef5b4eb32b7 to start an election
I20260709 12:59:55.210359   713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67696df2323642db84a45062c01e2d29"
dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7"
 from {username='slave'} at 127.0.0.1:34858
I20260709 12:59:55.210752   713 raft_consensus.cc:493] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:55.210991   713 raft_consensus.cc:3060] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:55.215148   713 raft_consensus.cc:515] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:55.216696   713 leader_election.cc:290] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [CANDIDATE]: Term 3 election: Requested vote from peers 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201), 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299)
I20260709 12:59:55.217339   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67696df2323642db84a45062c01e2d29" candidate_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb"
I20260709 12:59:55.217628   638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67696df2323642db84a45062c01e2d29" candidate_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3"
I20260709 12:59:55.218564   565 raft_consensus.cc:3060] T 67696df2323642db84a45062c01e2d29 P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:55.218619   638 raft_consensus.cc:3055] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:55.219352   638 raft_consensus.cc:740] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4ab595233c1b47d2980dcad8b04a45e3, State: Running, Role: LEADER
I20260709 12:59:55.219981   638 consensus_queue.cc:260] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:55.221022   638 raft_consensus.cc:3060] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:55.223822   565 raft_consensus.cc:2468] T 67696df2323642db84a45062c01e2d29 P 800d84c2f42d4aabac1286f0b27d4ccb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5c35c4177154a2aa180bef5b4eb32b7 in term 3.
I20260709 12:59:55.224825   681 leader_election.cc:304] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 800d84c2f42d4aabac1286f0b27d4ccb, c5c35c4177154a2aa180bef5b4eb32b7; no voters: 
I20260709 12:59:55.224975   638 raft_consensus.cc:2468] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5c35c4177154a2aa180bef5b4eb32b7 in term 3.
I20260709 12:59:55.225786   942 raft_consensus.cc:2804] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:55.227006   942 raft_consensus.cc:697] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [term 3 LEADER]: Becoming Leader. State: Replica: c5c35c4177154a2aa180bef5b4eb32b7, State: Running, Role: LEADER
I20260709 12:59:55.227820   942 consensus_queue.cc:237] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:55.233958   460 catalog_manager.cc:5697] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 reported cstate change: term changed from 2 to 3, leader changed from 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194) to c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:55.273129   907 raft_consensus.cc:993] T 52db24cb6b184170af5d6cc1b6ef0b2a P 4ab595233c1b47d2980dcad8b04a45e3: : Instructing follower c5c35c4177154a2aa180bef5b4eb32b7 to start an election
I20260709 12:59:55.273682   907 raft_consensus.cc:1081] T 52db24cb6b184170af5d6cc1b6ef0b2a P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 LEADER]: Signalling peer c5c35c4177154a2aa180bef5b4eb32b7 to start an election
I20260709 12:59:55.275094   713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52db24cb6b184170af5d6cc1b6ef0b2a"
dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7"
 from {username='slave'} at 127.0.0.1:34858
I20260709 12:59:55.275734   713 raft_consensus.cc:493] T 52db24cb6b184170af5d6cc1b6ef0b2a P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:55.276094   713 raft_consensus.cc:3060] T 52db24cb6b184170af5d6cc1b6ef0b2a P c5c35c4177154a2aa180bef5b4eb32b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:55.281792   713 raft_consensus.cc:515] T 52db24cb6b184170af5d6cc1b6ef0b2a P c5c35c4177154a2aa180bef5b4eb32b7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:55.283329   713 leader_election.cc:290] T 52db24cb6b184170af5d6cc1b6ef0b2a P c5c35c4177154a2aa180bef5b4eb32b7 [CANDIDATE]: Term 2 election: Requested vote from peers 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201), 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299)
I20260709 12:59:55.284116   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52db24cb6b184170af5d6cc1b6ef0b2a" candidate_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb"
I20260709 12:59:55.284363   638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52db24cb6b184170af5d6cc1b6ef0b2a" candidate_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3"
I20260709 12:59:55.284619   565 raft_consensus.cc:3060] T 52db24cb6b184170af5d6cc1b6ef0b2a P 800d84c2f42d4aabac1286f0b27d4ccb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:55.284924   638 raft_consensus.cc:3055] T 52db24cb6b184170af5d6cc1b6ef0b2a P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:55.285272   638 raft_consensus.cc:740] T 52db24cb6b184170af5d6cc1b6ef0b2a P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4ab595233c1b47d2980dcad8b04a45e3, State: Running, Role: LEADER
I20260709 12:59:55.285986   638 consensus_queue.cc:260] T 52db24cb6b184170af5d6cc1b6ef0b2a P 4ab595233c1b47d2980dcad8b04a45e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:55.286859   638 raft_consensus.cc:3060] T 52db24cb6b184170af5d6cc1b6ef0b2a P 4ab595233c1b47d2980dcad8b04a45e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:55.288820   565 raft_consensus.cc:2468] T 52db24cb6b184170af5d6cc1b6ef0b2a P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5c35c4177154a2aa180bef5b4eb32b7 in term 2.
I20260709 12:59:55.289736   681 leader_election.cc:304] T 52db24cb6b184170af5d6cc1b6ef0b2a P c5c35c4177154a2aa180bef5b4eb32b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 800d84c2f42d4aabac1286f0b27d4ccb, c5c35c4177154a2aa180bef5b4eb32b7; no voters: 
I20260709 12:59:55.290717   942 raft_consensus.cc:2804] T 52db24cb6b184170af5d6cc1b6ef0b2a P c5c35c4177154a2aa180bef5b4eb32b7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:55.291183   942 raft_consensus.cc:697] T 52db24cb6b184170af5d6cc1b6ef0b2a P c5c35c4177154a2aa180bef5b4eb32b7 [term 2 LEADER]: Becoming Leader. State: Replica: c5c35c4177154a2aa180bef5b4eb32b7, State: Running, Role: LEADER
I20260709 12:59:55.291767   638 raft_consensus.cc:2468] T 52db24cb6b184170af5d6cc1b6ef0b2a P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5c35c4177154a2aa180bef5b4eb32b7 in term 2.
I20260709 12:59:55.292117   942 consensus_queue.cc:237] T 52db24cb6b184170af5d6cc1b6ef0b2a P c5c35c4177154a2aa180bef5b4eb32b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:55.300477   460 catalog_manager.cc:5697] T 52db24cb6b184170af5d6cc1b6ef0b2a P c5c35c4177154a2aa180bef5b4eb32b7 reported cstate change: term changed from 1 to 2, leader changed from 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194) to c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:55.347206   943 raft_consensus.cc:993] T 018df5b57c524579ab3bb24c61a13e54 P 4ab595233c1b47d2980dcad8b04a45e3: : Instructing follower 800d84c2f42d4aabac1286f0b27d4ccb to start an election
I20260709 12:59:55.347730   943 raft_consensus.cc:1081] T 018df5b57c524579ab3bb24c61a13e54 P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 LEADER]: Signalling peer 800d84c2f42d4aabac1286f0b27d4ccb to start an election
I20260709 12:59:55.349298   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "018df5b57c524579ab3bb24c61a13e54"
dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb"
 from {username='slave'} at 127.0.0.1:55040
I20260709 12:59:55.349781   565 raft_consensus.cc:493] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:55.350140   565 raft_consensus.cc:3060] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:55.351554   943 raft_consensus.cc:993] T 8a146a08439145c189f2d8111591a7e4 P 4ab595233c1b47d2980dcad8b04a45e3: : Instructing follower 800d84c2f42d4aabac1286f0b27d4ccb to start an election
I20260709 12:59:55.352018   907 raft_consensus.cc:1081] T 8a146a08439145c189f2d8111591a7e4 P 4ab595233c1b47d2980dcad8b04a45e3 [term 3 LEADER]: Signalling peer 800d84c2f42d4aabac1286f0b27d4ccb to start an election
I20260709 12:59:55.353557   564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a146a08439145c189f2d8111591a7e4"
dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb"
 from {username='slave'} at 127.0.0.1:55040
I20260709 12:59:55.354065   564 raft_consensus.cc:493] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:55.354415   564 raft_consensus.cc:3060] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:55.356086   565 raft_consensus.cc:515] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } } peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } }
I20260709 12:59:55.358661   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018df5b57c524579ab3bb24c61a13e54" candidate_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7"
I20260709 12:59:55.359077   638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018df5b57c524579ab3bb24c61a13e54" candidate_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3"
I20260709 12:59:55.359189   713 raft_consensus.cc:3060] T 018df5b57c524579ab3bb24c61a13e54 P c5c35c4177154a2aa180bef5b4eb32b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:55.359577   638 raft_consensus.cc:3055] T 018df5b57c524579ab3bb24c61a13e54 P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:55.359874   638 raft_consensus.cc:740] T 018df5b57c524579ab3bb24c61a13e54 P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4ab595233c1b47d2980dcad8b04a45e3, State: Running, Role: LEADER
I20260709 12:59:55.360086   565 leader_election.cc:290] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 3 election: Requested vote from peers c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179), 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299)
I20260709 12:59:55.360549   638 consensus_queue.cc:260] T 018df5b57c524579ab3bb24c61a13e54 P 4ab595233c1b47d2980dcad8b04a45e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } } peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } }
I20260709 12:59:55.360654   564 raft_consensus.cc:515] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:55.361651   638 raft_consensus.cc:3060] T 018df5b57c524579ab3bb24c61a13e54 P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:55.363384   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a146a08439145c189f2d8111591a7e4" candidate_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3"
I20260709 12:59:55.363919   641 raft_consensus.cc:3055] T 8a146a08439145c189f2d8111591a7e4 P 4ab595233c1b47d2980dcad8b04a45e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:55.364199   641 raft_consensus.cc:740] T 8a146a08439145c189f2d8111591a7e4 P 4ab595233c1b47d2980dcad8b04a45e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4ab595233c1b47d2980dcad8b04a45e3, State: Running, Role: LEADER
I20260709 12:59:55.364279   564 leader_election.cc:290] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 4 election: Requested vote from peers 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299), c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179)
I20260709 12:59:55.364388   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a146a08439145c189f2d8111591a7e4" candidate_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7"
I20260709 12:59:55.364930   714 raft_consensus.cc:3060] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:55.365410   713 raft_consensus.cc:2468] T 018df5b57c524579ab3bb24c61a13e54 P c5c35c4177154a2aa180bef5b4eb32b7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 800d84c2f42d4aabac1286f0b27d4ccb in term 3.
I20260709 12:59:55.364946   641 consensus_queue.cc:260] T 8a146a08439145c189f2d8111591a7e4 P 4ab595233c1b47d2980dcad8b04a45e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:55.366227   943 raft_consensus.cc:993] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3: : Instructing follower 800d84c2f42d4aabac1286f0b27d4ccb to start an election
I20260709 12:59:55.366552   641 raft_consensus.cc:3060] T 8a146a08439145c189f2d8111591a7e4 P 4ab595233c1b47d2980dcad8b04a45e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:55.366720   943 raft_consensus.cc:1081] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3 [term 3 LEADER]: Signalling peer 800d84c2f42d4aabac1286f0b27d4ccb to start an election
I20260709 12:59:55.366693   532 leader_election.cc:304] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 800d84c2f42d4aabac1286f0b27d4ccb, c5c35c4177154a2aa180bef5b4eb32b7; no voters: 
I20260709 12:59:55.369954   952 raft_consensus.cc:2804] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:55.371573   714 raft_consensus.cc:2468] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 800d84c2f42d4aabac1286f0b27d4ccb in term 4.
I20260709 12:59:55.372768   532 leader_election.cc:304] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 800d84c2f42d4aabac1286f0b27d4ccb, c5c35c4177154a2aa180bef5b4eb32b7; no voters: 
I20260709 12:59:55.373821   638 raft_consensus.cc:2468] T 018df5b57c524579ab3bb24c61a13e54 P 4ab595233c1b47d2980dcad8b04a45e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 800d84c2f42d4aabac1286f0b27d4ccb in term 3.
I20260709 12:59:55.376082   641 raft_consensus.cc:2468] T 8a146a08439145c189f2d8111591a7e4 P 4ab595233c1b47d2980dcad8b04a45e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 800d84c2f42d4aabac1286f0b27d4ccb in term 4.
I20260709 12:59:55.376704   952 raft_consensus.cc:697] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb [term 3 LEADER]: Becoming Leader. State: Replica: 800d84c2f42d4aabac1286f0b27d4ccb, State: Running, Role: LEADER
I20260709 12:59:55.376748   954 raft_consensus.cc:2804] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:55.376869   564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "768734dfe27846478ec2b650e2289608"
dest_uuid: "800d84c2f42d4aabac1286f0b27d4ccb"
 from {username='slave'} at 127.0.0.1:55040
I20260709 12:59:55.377839   564 raft_consensus.cc:493] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:55.378093   954 raft_consensus.cc:697] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb [term 4 LEADER]: Becoming Leader. State: Replica: 800d84c2f42d4aabac1286f0b27d4ccb, State: Running, Role: LEADER
I20260709 12:59:55.377923   952 consensus_queue.cc:237] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } } peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } }
I20260709 12:59:55.378334   564 raft_consensus.cc:3060] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:55.378983   954 consensus_queue.cc:237] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:55.384186   564 raft_consensus.cc:515] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:55.386374   564 leader_election.cc:290] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 4 election: Requested vote from peers 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194:42299), c5c35c4177154a2aa180bef5b4eb32b7 (127.0.107.195:42179)
I20260709 12:59:55.387147   460 catalog_manager.cc:5697] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb reported cstate change: term changed from 2 to 3, leader changed from 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194) to 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193). New cstate: current_term: 3 leader_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:55.387845   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768734dfe27846478ec2b650e2289608" candidate_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4ab595233c1b47d2980dcad8b04a45e3"
I20260709 12:59:55.388387   641 raft_consensus.cc:3055] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:55.388664   641 raft_consensus.cc:740] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4ab595233c1b47d2980dcad8b04a45e3, State: Running, Role: LEADER
I20260709 12:59:55.389559   641 consensus_queue.cc:260] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:55.390508   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768734dfe27846478ec2b650e2289608" candidate_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c5c35c4177154a2aa180bef5b4eb32b7"
I20260709 12:59:55.390894   641 raft_consensus.cc:3060] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:55.391070   714 raft_consensus.cc:3060] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:55.396267   714 raft_consensus.cc:2468] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 800d84c2f42d4aabac1286f0b27d4ccb in term 4.
I20260709 12:59:55.397162   532 leader_election.cc:304] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 800d84c2f42d4aabac1286f0b27d4ccb, c5c35c4177154a2aa180bef5b4eb32b7; no voters: 
I20260709 12:59:55.397912   954 raft_consensus.cc:2804] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:55.398409   954 raft_consensus.cc:697] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [term 4 LEADER]: Becoming Leader. State: Replica: 800d84c2f42d4aabac1286f0b27d4ccb, State: Running, Role: LEADER
I20260709 12:59:55.398651   641 raft_consensus.cc:2468] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 800d84c2f42d4aabac1286f0b27d4ccb in term 4.
I20260709 12:59:55.399326   954 consensus_queue.cc:237] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } }
I20260709 12:59:55.401182   460 catalog_manager.cc:5697] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb reported cstate change: term changed from 3 to 4, leader changed from 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194) to 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193). New cstate: current_term: 4 leader_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:55.412097   460 catalog_manager.cc:5697] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb reported cstate change: term changed from 3 to 4, leader changed from 4ab595233c1b47d2980dcad8b04a45e3 (127.0.107.194) to 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193). New cstate: current_term: 4 leader_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:55.617017   641 raft_consensus.cc:1275] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3 [term 3 FOLLOWER]: Refusing update from remote peer c5c35c4177154a2aa180bef5b4eb32b7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:55.618381   942 consensus_queue.cc:1048] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:55.629817   564 raft_consensus.cc:1275] T 67696df2323642db84a45062c01e2d29 P 800d84c2f42d4aabac1286f0b27d4ccb [term 3 FOLLOWER]: Refusing update from remote peer c5c35c4177154a2aa180bef5b4eb32b7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:55.631677   942 consensus_queue.cc:1048] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:55.738612   564 raft_consensus.cc:1275] T 52db24cb6b184170af5d6cc1b6ef0b2a P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 FOLLOWER]: Refusing update from remote peer c5c35c4177154a2aa180bef5b4eb32b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:55.739892   942 consensus_queue.cc:1048] T 52db24cb6b184170af5d6cc1b6ef0b2a P c5c35c4177154a2aa180bef5b4eb32b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "800d84c2f42d4aabac1286f0b27d4ccb" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:55.749361   641 raft_consensus.cc:1275] T 52db24cb6b184170af5d6cc1b6ef0b2a P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 FOLLOWER]: Refusing update from remote peer c5c35c4177154a2aa180bef5b4eb32b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:55.751614   964 consensus_queue.cc:1048] T 52db24cb6b184170af5d6cc1b6ef0b2a P c5c35c4177154a2aa180bef5b4eb32b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:55.774185   714 raft_consensus.cc:1275] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7 [term 4 FOLLOWER]: Refusing update from remote peer 800d84c2f42d4aabac1286f0b27d4ccb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:55.775372   954 consensus_queue.cc:1048] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:55.783844   641 raft_consensus.cc:1275] T 8a146a08439145c189f2d8111591a7e4 P 4ab595233c1b47d2980dcad8b04a45e3 [term 4 FOLLOWER]: Refusing update from remote peer 800d84c2f42d4aabac1286f0b27d4ccb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:55.785576   953 consensus_queue.cc:1048] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:55.804198   714 raft_consensus.cc:1275] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7 [term 4 FOLLOWER]: Refusing update from remote peer 800d84c2f42d4aabac1286f0b27d4ccb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:55.805440   953 consensus_queue.cc:1048] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:55.815038   641 raft_consensus.cc:1275] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3 [term 4 FOLLOWER]: Refusing update from remote peer 800d84c2f42d4aabac1286f0b27d4ccb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:55.818190   969 consensus_queue.cc:1048] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:55.838130   641 raft_consensus.cc:1275] T 018df5b57c524579ab3bb24c61a13e54 P 4ab595233c1b47d2980dcad8b04a45e3 [term 3 FOLLOWER]: Refusing update from remote peer 800d84c2f42d4aabac1286f0b27d4ccb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:55.839393   969 consensus_queue.cc:1048] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ab595233c1b47d2980dcad8b04a45e3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:55.847720   714 raft_consensus.cc:1275] T 018df5b57c524579ab3bb24c61a13e54 P c5c35c4177154a2aa180bef5b4eb32b7 [term 3 FOLLOWER]: Refusing update from remote peer 800d84c2f42d4aabac1286f0b27d4ccb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:55.849871   953 consensus_queue.cc:1048] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5c35c4177154a2aa180bef5b4eb32b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:56.205510   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:56.210808   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 12:59:56.242616   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:59:56.243291   431 tablet_replica.cc:333] T feed72ce7e2549d7a27dc7595bac0d3d P 800d84c2f42d4aabac1286f0b27d4ccb: stopping tablet replica
I20260709 12:59:56.244038   431 raft_consensus.cc:2243] T feed72ce7e2549d7a27dc7595bac0d3d P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:56.244572   431 raft_consensus.cc:2272] T feed72ce7e2549d7a27dc7595bac0d3d P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:56.246904   431 tablet_replica.cc:333] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb: stopping tablet replica
I20260709 12:59:56.247454   431 raft_consensus.cc:2243] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:59:56.248209   431 raft_consensus.cc:2272] T 8a146a08439145c189f2d8111591a7e4 P 800d84c2f42d4aabac1286f0b27d4ccb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:56.250798   431 tablet_replica.cc:333] T 67696df2323642db84a45062c01e2d29 P 800d84c2f42d4aabac1286f0b27d4ccb: stopping tablet replica
I20260709 12:59:56.251295   431 raft_consensus.cc:2243] T 67696df2323642db84a45062c01e2d29 P 800d84c2f42d4aabac1286f0b27d4ccb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:56.251729   431 raft_consensus.cc:2272] T 67696df2323642db84a45062c01e2d29 P 800d84c2f42d4aabac1286f0b27d4ccb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:56.253702   431 tablet_replica.cc:333] T ff561f1c72b14a8881b49a495683999a P 800d84c2f42d4aabac1286f0b27d4ccb: stopping tablet replica
I20260709 12:59:56.254211   431 raft_consensus.cc:2243] T ff561f1c72b14a8881b49a495683999a P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:56.254657   431 raft_consensus.cc:2272] T ff561f1c72b14a8881b49a495683999a P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:56.256664   431 tablet_replica.cc:333] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 800d84c2f42d4aabac1286f0b27d4ccb: stopping tablet replica
I20260709 12:59:56.257360   431 raft_consensus.cc:2243] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 800d84c2f42d4aabac1286f0b27d4ccb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:56.257840   431 raft_consensus.cc:2272] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 800d84c2f42d4aabac1286f0b27d4ccb [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:59:56.257865   607 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:56.259703   431 tablet_replica.cc:333] T 52db24cb6b184170af5d6cc1b6ef0b2a P 800d84c2f42d4aabac1286f0b27d4ccb: stopping tablet replica
I20260709 12:59:56.260233   431 raft_consensus.cc:2243] T 52db24cb6b184170af5d6cc1b6ef0b2a P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:56.260668   431 raft_consensus.cc:2272] T 52db24cb6b184170af5d6cc1b6ef0b2a P 800d84c2f42d4aabac1286f0b27d4ccb [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:59:56.260747   607 consensus_peers.cc:597] T 78aff2e266df4a51b635f6b10ce9600a P 4ab595233c1b47d2980dcad8b04a45e3 -> Peer 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201): Couldn't send request to peer 800d84c2f42d4aabac1286f0b27d4ccb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:56.262650   431 tablet_replica.cc:333] T 78aff2e266df4a51b635f6b10ce9600a P 800d84c2f42d4aabac1286f0b27d4ccb: stopping tablet replica
I20260709 12:59:56.263113   431 raft_consensus.cc:2243] T 78aff2e266df4a51b635f6b10ce9600a P 800d84c2f42d4aabac1286f0b27d4ccb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:56.263435   431 raft_consensus.cc:2272] T 78aff2e266df4a51b635f6b10ce9600a P 800d84c2f42d4aabac1286f0b27d4ccb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:56.264909   431 tablet_replica.cc:333] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb: stopping tablet replica
I20260709 12:59:56.265407   431 raft_consensus.cc:2243] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:59:56.266079   431 raft_consensus.cc:2272] T 768734dfe27846478ec2b650e2289608 P 800d84c2f42d4aabac1286f0b27d4ccb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:56.267895   431 tablet_replica.cc:333] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb: stopping tablet replica
I20260709 12:59:56.268319   431 raft_consensus.cc:2243] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:59:56.268972   431 raft_consensus.cc:2272] T 018df5b57c524579ab3bb24c61a13e54 P 800d84c2f42d4aabac1286f0b27d4ccb [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:59:56.281622   681 consensus_peers.cc:597] T feed72ce7e2549d7a27dc7595bac0d3d P c5c35c4177154a2aa180bef5b4eb32b7 -> Peer 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201): Couldn't send request to peer 800d84c2f42d4aabac1286f0b27d4ccb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:56.450742   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 12:59:56.451290   681 consensus_peers.cc:597] T 52db24cb6b184170af5d6cc1b6ef0b2a P c5c35c4177154a2aa180bef5b4eb32b7 -> Peer 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201): Couldn't send request to peer 800d84c2f42d4aabac1286f0b27d4ccb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43201: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:56.470741   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 12:59:56.501329   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:59:56.502075   431 tablet_replica.cc:333] T 018df5b57c524579ab3bb24c61a13e54 P 4ab595233c1b47d2980dcad8b04a45e3: stopping tablet replica
I20260709 12:59:56.502748   431 raft_consensus.cc:2243] T 018df5b57c524579ab3bb24c61a13e54 P 4ab595233c1b47d2980dcad8b04a45e3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:56.503141   431 raft_consensus.cc:2272] T 018df5b57c524579ab3bb24c61a13e54 P 4ab595233c1b47d2980dcad8b04a45e3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:56.505345   431 tablet_replica.cc:333] T feed72ce7e2549d7a27dc7595bac0d3d P 4ab595233c1b47d2980dcad8b04a45e3: stopping tablet replica
I20260709 12:59:56.505785   431 raft_consensus.cc:2243] T feed72ce7e2549d7a27dc7595bac0d3d P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:56.506137   431 raft_consensus.cc:2272] T feed72ce7e2549d7a27dc7595bac0d3d P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:56.508131   431 tablet_replica.cc:333] T ff561f1c72b14a8881b49a495683999a P 4ab595233c1b47d2980dcad8b04a45e3: stopping tablet replica
I20260709 12:59:56.508579   431 raft_consensus.cc:2243] T ff561f1c72b14a8881b49a495683999a P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:59:56.509261   431 raft_consensus.cc:2272] T ff561f1c72b14a8881b49a495683999a P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:56.510854   431 tablet_replica.cc:333] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3: stopping tablet replica
I20260709 12:59:56.511253   431 raft_consensus.cc:2243] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:59:56.511834   431 raft_consensus.cc:2272] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P 4ab595233c1b47d2980dcad8b04a45e3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:56.513432   431 tablet_replica.cc:333] T 8a146a08439145c189f2d8111591a7e4 P 4ab595233c1b47d2980dcad8b04a45e3: stopping tablet replica
I20260709 12:59:56.513830   431 raft_consensus.cc:2243] T 8a146a08439145c189f2d8111591a7e4 P 4ab595233c1b47d2980dcad8b04a45e3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:56.514214   431 raft_consensus.cc:2272] T 8a146a08439145c189f2d8111591a7e4 P 4ab595233c1b47d2980dcad8b04a45e3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:56.516600   431 tablet_replica.cc:333] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3: stopping tablet replica
I20260709 12:59:56.517064   431 raft_consensus.cc:2243] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:56.517539   431 raft_consensus.cc:2272] T 67696df2323642db84a45062c01e2d29 P 4ab595233c1b47d2980dcad8b04a45e3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:56.519531   431 tablet_replica.cc:333] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3: stopping tablet replica
I20260709 12:59:56.520292   431 raft_consensus.cc:2243] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:56.520679   431 raft_consensus.cc:2272] T 768734dfe27846478ec2b650e2289608 P 4ab595233c1b47d2980dcad8b04a45e3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:56.522681   431 tablet_replica.cc:333] T 52db24cb6b184170af5d6cc1b6ef0b2a P 4ab595233c1b47d2980dcad8b04a45e3: stopping tablet replica
I20260709 12:59:56.523149   431 raft_consensus.cc:2243] T 52db24cb6b184170af5d6cc1b6ef0b2a P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:56.523524   431 raft_consensus.cc:2272] T 52db24cb6b184170af5d6cc1b6ef0b2a P 4ab595233c1b47d2980dcad8b04a45e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:56.525449   431 tablet_replica.cc:333] T 78aff2e266df4a51b635f6b10ce9600a P 4ab595233c1b47d2980dcad8b04a45e3: stopping tablet replica
I20260709 12:59:56.525889   431 raft_consensus.cc:2243] T 78aff2e266df4a51b635f6b10ce9600a P 4ab595233c1b47d2980dcad8b04a45e3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:59:56.526544   431 raft_consensus.cc:2272] T 78aff2e266df4a51b635f6b10ce9600a P 4ab595233c1b47d2980dcad8b04a45e3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:56.555060   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 12:59:56.571869   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 12:59:56.599097   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:59:56.599901   431 tablet_replica.cc:333] T 52db24cb6b184170af5d6cc1b6ef0b2a P c5c35c4177154a2aa180bef5b4eb32b7: stopping tablet replica
I20260709 12:59:56.601037   431 raft_consensus.cc:2243] T 52db24cb6b184170af5d6cc1b6ef0b2a P c5c35c4177154a2aa180bef5b4eb32b7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:59:56.601984   431 raft_consensus.cc:2272] T 52db24cb6b184170af5d6cc1b6ef0b2a P c5c35c4177154a2aa180bef5b4eb32b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:56.603961   431 tablet_replica.cc:333] T 78aff2e266df4a51b635f6b10ce9600a P c5c35c4177154a2aa180bef5b4eb32b7: stopping tablet replica
I20260709 12:59:56.604434   431 raft_consensus.cc:2243] T 78aff2e266df4a51b635f6b10ce9600a P c5c35c4177154a2aa180bef5b4eb32b7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:56.604792   431 raft_consensus.cc:2272] T 78aff2e266df4a51b635f6b10ce9600a P c5c35c4177154a2aa180bef5b4eb32b7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:56.606603   431 tablet_replica.cc:333] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7: stopping tablet replica
I20260709 12:59:56.607273   431 raft_consensus.cc:2243] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:56.607702   431 raft_consensus.cc:2272] T 768734dfe27846478ec2b650e2289608 P c5c35c4177154a2aa180bef5b4eb32b7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:56.610316   431 tablet_replica.cc:333] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7: stopping tablet replica
I20260709 12:59:56.610908   431 raft_consensus.cc:2243] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:56.611308   431 raft_consensus.cc:2272] T d11d9c8b7a0c408696e8ad7ef2b1ae15 P c5c35c4177154a2aa180bef5b4eb32b7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:56.613061   431 tablet_replica.cc:333] T ff561f1c72b14a8881b49a495683999a P c5c35c4177154a2aa180bef5b4eb32b7: stopping tablet replica
I20260709 12:59:56.613657   431 raft_consensus.cc:2243] T ff561f1c72b14a8881b49a495683999a P c5c35c4177154a2aa180bef5b4eb32b7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:56.614075   431 raft_consensus.cc:2272] T ff561f1c72b14a8881b49a495683999a P c5c35c4177154a2aa180bef5b4eb32b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:56.616288   431 tablet_replica.cc:333] T feed72ce7e2549d7a27dc7595bac0d3d P c5c35c4177154a2aa180bef5b4eb32b7: stopping tablet replica
I20260709 12:59:56.616776   431 raft_consensus.cc:2243] T feed72ce7e2549d7a27dc7595bac0d3d P c5c35c4177154a2aa180bef5b4eb32b7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:59:56.617650   431 raft_consensus.cc:2272] T feed72ce7e2549d7a27dc7595bac0d3d P c5c35c4177154a2aa180bef5b4eb32b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:56.620240   431 tablet_replica.cc:333] T 018df5b57c524579ab3bb24c61a13e54 P c5c35c4177154a2aa180bef5b4eb32b7: stopping tablet replica
I20260709 12:59:56.620993   431 raft_consensus.cc:2243] T 018df5b57c524579ab3bb24c61a13e54 P c5c35c4177154a2aa180bef5b4eb32b7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:56.621623   431 raft_consensus.cc:2272] T 018df5b57c524579ab3bb24c61a13e54 P c5c35c4177154a2aa180bef5b4eb32b7 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:59:56.624511   681 consensus_peers.cc:597] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 -> Peer 800d84c2f42d4aabac1286f0b27d4ccb (127.0.107.193:43201): Couldn't send request to peer 800d84c2f42d4aabac1286f0b27d4ccb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43201: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:56.624591   431 tablet_replica.cc:333] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7: stopping tablet replica
I20260709 12:59:56.625334   431 raft_consensus.cc:2243] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:59:56.626096   431 raft_consensus.cc:2272] T 67696df2323642db84a45062c01e2d29 P c5c35c4177154a2aa180bef5b4eb32b7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:56.628032   431 tablet_replica.cc:333] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7: stopping tablet replica
I20260709 12:59:56.628571   431 raft_consensus.cc:2243] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:56.628980   431 raft_consensus.cc:2272] T 8a146a08439145c189f2d8111591a7e4 P c5c35c4177154a2aa180bef5b4eb32b7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:56.660269   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 12:59:56.678268   431 master.cc:562] Master@127.0.107.254:42449 shutting down...
I20260709 12:59:56.730186   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 83e1609cc5214144909294451d5530c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:59:56.730774   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 83e1609cc5214144909294451d5530c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:56.731163   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 83e1609cc5214144909294451d5530c8: stopping tablet replica
I20260709 12:59:56.751753   431 master.cc:584] Master@127.0.107.254:42449 shutdown complete.
4ab595233c1b47d2980dcad8b04a45e3  4
800d84c2f42d4aabac1286f0b27d4ccb  4
c5c35c4177154a2aa180bef5b4eb32b7  1
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (16769 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:59:56.793700   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:38877
I20260709 12:59:56.795406   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:56.801529   977 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:56.802321   976 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:56.803417   979 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:56.803781   431 server_base.cc:1061] running on GCE node
I20260709 12:59:56.804663   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:56.804844   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:56.805023   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601996805010 us; error 0 us; skew 500 ppm
I20260709 12:59:56.805562   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:56.808153   431 webserver.cc:533] Webserver started at http://127.0.107.254:35773/ using document root <none> and password file <none>
I20260709 12:59:56.808617   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:56.808779   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:56.809023   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:56.810211   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601979855482-431-0/minicluster-data/master-0-root/instance:
uuid: "d949ab00494940d3b92f4c8338f1ee4c"
format_stamp: "Formatted at 2026-07-09 12:59:56 on dist-test-slave-g4pn"
I20260709 12:59:56.814692   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:59:56.818864   984 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:56.819638   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:59:56.819944   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601979855482-431-0/minicluster-data/master-0-root
uuid: "d949ab00494940d3b92f4c8338f1ee4c"
format_stamp: "Formatted at 2026-07-09 12:59:56 on dist-test-slave-g4pn"
I20260709 12:59:56.820300   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601979855482-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601979855482-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601979855482-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:56.846213   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:56.847489   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:56.888667   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:38877
I20260709 12:59:56.888744  1035 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:38877 every 8 connection(s)
I20260709 12:59:56.894073  1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:56.903893  1036 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d949ab00494940d3b92f4c8338f1ee4c: Bootstrap starting.
I20260709 12:59:56.910264  1036 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d949ab00494940d3b92f4c8338f1ee4c: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:56.915874  1036 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d949ab00494940d3b92f4c8338f1ee4c: No bootstrap required, opened a new log
I20260709 12:59:56.918717  1036 raft_consensus.cc:359] T 00000000000000000000000000000000 P d949ab00494940d3b92f4c8338f1ee4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d949ab00494940d3b92f4c8338f1ee4c" member_type: VOTER }
I20260709 12:59:56.919183  1036 raft_consensus.cc:385] T 00000000000000000000000000000000 P d949ab00494940d3b92f4c8338f1ee4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:56.919373  1036 raft_consensus.cc:740] T 00000000000000000000000000000000 P d949ab00494940d3b92f4c8338f1ee4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d949ab00494940d3b92f4c8338f1ee4c, State: Initialized, Role: FOLLOWER
I20260709 12:59:56.919845  1036 consensus_queue.cc:260] T 00000000000000000000000000000000 P d949ab00494940d3b92f4c8338f1ee4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d949ab00494940d3b92f4c8338f1ee4c" member_type: VOTER }
I20260709 12:59:56.920243  1036 raft_consensus.cc:399] T 00000000000000000000000000000000 P d949ab00494940d3b92f4c8338f1ee4c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:59:56.920428  1036 raft_consensus.cc:493] T 00000000000000000000000000000000 P d949ab00494940d3b92f4c8338f1ee4c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:59:56.920642  1036 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d949ab00494940d3b92f4c8338f1ee4c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:56.992164  1036 raft_consensus.cc:515] T 00000000000000000000000000000000 P d949ab00494940d3b92f4c8338f1ee4c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d949ab00494940d3b92f4c8338f1ee4c" member_type: VOTER }
I20260709 12:59:56.992833  1036 leader_election.cc:304] T 00000000000000000000000000000000 P d949ab00494940d3b92f4c8338f1ee4c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d949ab00494940d3b92f4c8338f1ee4c; no voters: 
I20260709 12:59:56.996337  1036 leader_election.cc:290] T 00000000000000000000000000000000 P d949ab00494940d3b92f4c8338f1ee4c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:59:56.996665  1039 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d949ab00494940d3b92f4c8338f1ee4c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:56.998378  1039 raft_consensus.cc:697] T 00000000000000000000000000000000 P d949ab00494940d3b92f4c8338f1ee4c [term 1 LEADER]: Becoming Leader. State: Replica: d949ab00494940d3b92f4c8338f1ee4c, State: Running, Role: LEADER
I20260709 12:59:56.999007  1039 consensus_queue.cc:237] T 00000000000000000000000000000000 P d949ab00494940d3b92f4c8338f1ee4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d949ab00494940d3b92f4c8338f1ee4c" member_type: VOTER }
I20260709 12:59:56.999594  1036 sys_catalog.cc:565] T 00000000000000000000000000000000 P d949ab00494940d3b92f4c8338f1ee4c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:59:57.004236  1040 sys_catalog.cc:455] T 00000000000000000000000000000000 P d949ab00494940d3b92f4c8338f1ee4c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d949ab00494940d3b92f4c8338f1ee4c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d949ab00494940d3b92f4c8338f1ee4c" member_type: VOTER } }
I20260709 12:59:57.004279  1041 sys_catalog.cc:455] T 00000000000000000000000000000000 P d949ab00494940d3b92f4c8338f1ee4c [sys.catalog]: SysCatalogTable state changed. Reason: New leader d949ab00494940d3b92f4c8338f1ee4c. Latest consensus state: current_term: 1 leader_uuid: "d949ab00494940d3b92f4c8338f1ee4c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d949ab00494940d3b92f4c8338f1ee4c" member_type: VOTER } }
I20260709 12:59:57.005108  1040 sys_catalog.cc:458] T 00000000000000000000000000000000 P d949ab00494940d3b92f4c8338f1ee4c [sys.catalog]: This master's current role is: LEADER
I20260709 12:59:57.005180  1041 sys_catalog.cc:458] T 00000000000000000000000000000000 P d949ab00494940d3b92f4c8338f1ee4c [sys.catalog]: This master's current role is: LEADER
I20260709 12:59:57.010077  1046 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:59:57.017935  1046 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:59:57.019042   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:59:57.026886  1046 catalog_manager.cc:1383] Generated new cluster ID: f611d5280ca34586becca00407ba5b07
I20260709 12:59:57.027163  1046 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:59:57.039235  1046 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:59:57.040493  1046 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:59:57.052440  1046 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d949ab00494940d3b92f4c8338f1ee4c: Generated new TSK 0
I20260709 12:59:57.052997  1046 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:59:57.085310   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:57.091216  1057 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:57.092013  1058 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:57.093590  1060 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:57.094913   431 server_base.cc:1061] running on GCE node
I20260709 12:59:57.095948   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:57.096125   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:57.096331   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601997096299 us; error 0 us; skew 500 ppm
I20260709 12:59:57.096880   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:57.099370   431 webserver.cc:533] Webserver started at http://127.0.107.193:34313/ using document root <none> and password file <none>
I20260709 12:59:57.099849   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:57.100042   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:57.100317   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:57.101522   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601979855482-431-0/minicluster-data/ts-0-root/instance:
uuid: "28620b8df5964fb5bbbf51288ccbf9d7"
format_stamp: "Formatted at 2026-07-09 12:59:57 on dist-test-slave-g4pn"
I20260709 12:59:57.106359   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:59:57.109920  1065 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:57.110638   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 12:59:57.110946   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601979855482-431-0/minicluster-data/ts-0-root
uuid: "28620b8df5964fb5bbbf51288ccbf9d7"
format_stamp: "Formatted at 2026-07-09 12:59:57 on dist-test-slave-g4pn"
I20260709 12:59:57.111198   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601979855482-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601979855482-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601979855482-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:57.155400   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:57.156706   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:57.158257   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:57.160557   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:57.160739   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:57.161031   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:57.161209   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:59:57.202620   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:41491
I20260709 12:59:57.202725  1127 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:41491 every 8 connection(s)
I20260709 12:59:57.207147   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:57.214344  1132 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:57.216187  1133 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:57.221319  1128 heartbeater.cc:344] Connected to a master server at 127.0.107.254:38877
W20260709 12:59:57.221431  1135 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:57.221740   431 server_base.cc:1061] running on GCE node
I20260709 12:59:57.221987  1128 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:57.222826  1128 heartbeater.cc:507] Master 127.0.107.254:38877 requested a full tablet report, sending...
I20260709 12:59:57.222959   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:57.223253   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:57.223433   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601997223412 us; error 0 us; skew 500 ppm
I20260709 12:59:57.224172   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:57.225185  1001 ts_manager.cc:194] Registered new tserver with Master: 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193:41491)
I20260709 12:59:57.227015   431 webserver.cc:533] Webserver started at http://127.0.107.194:46515/ using document root <none> and password file <none>
I20260709 12:59:57.227640   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:57.227648  1001 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46328
I20260709 12:59:57.227982   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:57.228343   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:57.229689   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601979855482-431-0/minicluster-data/ts-1-root/instance:
uuid: "f98885ef63a44cd68a9a8e97a14e7cb4"
format_stamp: "Formatted at 2026-07-09 12:59:57 on dist-test-slave-g4pn"
I20260709 12:59:57.233940   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 12:59:57.237203  1140 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:57.237915   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.002s
I20260709 12:59:57.238229   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601979855482-431-0/minicluster-data/ts-1-root
uuid: "f98885ef63a44cd68a9a8e97a14e7cb4"
format_stamp: "Formatted at 2026-07-09 12:59:57 on dist-test-slave-g4pn"
I20260709 12:59:57.238488   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601979855482-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601979855482-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601979855482-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:57.247465   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:57.248615   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:57.250202   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:57.252514   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:57.252727   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:57.252964   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:57.253172   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:59:57.295248   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:38543
I20260709 12:59:57.295349  1202 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:38543 every 8 connection(s)
I20260709 12:59:57.299886   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:57.307035  1206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:57.308151  1207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:57.314589  1203 heartbeater.cc:344] Connected to a master server at 127.0.107.254:38877
I20260709 12:59:57.315008  1203 heartbeater.cc:461] Registering TS with master...
W20260709 12:59:57.315557  1209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:57.315944   431 server_base.cc:1061] running on GCE node
I20260709 12:59:57.315891  1203 heartbeater.cc:507] Master 127.0.107.254:38877 requested a full tablet report, sending...
I20260709 12:59:57.317142   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:57.317337   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:57.317559   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601997317541 us; error 0 us; skew 500 ppm
I20260709 12:59:57.318317   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:57.318708  1001 ts_manager.cc:194] Registered new tserver with Master: f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194:38543)
I20260709 12:59:57.320457  1001 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46334
I20260709 12:59:57.321061   431 webserver.cc:533] Webserver started at http://127.0.107.195:34193/ using document root <none> and password file <none>
I20260709 12:59:57.321688   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:57.321921   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:57.322309   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:57.323493   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601979855482-431-0/minicluster-data/ts-2-root/instance:
uuid: "76534c5775854ffb8239fb8bb2eead1b"
format_stamp: "Formatted at 2026-07-09 12:59:57 on dist-test-slave-g4pn"
I20260709 12:59:57.327795   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:59:57.330909  1214 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:57.331774   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:59:57.332072   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601979855482-431-0/minicluster-data/ts-2-root
uuid: "76534c5775854ffb8239fb8bb2eead1b"
format_stamp: "Formatted at 2026-07-09 12:59:57 on dist-test-slave-g4pn"
I20260709 12:59:57.332366   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601979855482-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601979855482-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601979855482-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:57.344779   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:57.346042   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:57.347509   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:57.349695   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:57.349890   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:57.350155   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:57.350325   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:57.390774   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:35987
I20260709 12:59:57.390877  1276 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:35987 every 8 connection(s)
I20260709 12:59:57.404130  1277 heartbeater.cc:344] Connected to a master server at 127.0.107.254:38877
I20260709 12:59:57.404505  1277 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:57.405367  1277 heartbeater.cc:507] Master 127.0.107.254:38877 requested a full tablet report, sending...
I20260709 12:59:57.407256  1001 ts_manager.cc:194] Registered new tserver with Master: 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195:35987)
I20260709 12:59:57.407352   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013534613s
I20260709 12:59:57.408597  1001 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46340
I20260709 12:59:57.432792  1001 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46342:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:59:57.435730  1001 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:59:57.520087  1093 tablet_service.cc:1511] Processing CreateTablet for tablet b6e533e49aba4111a0592ae2f0d6d5bb (DEFAULT_TABLE table=test-workload [id=bbd6b1edf883446b8e4f8a652b6b4ba8]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:59:57.521611  1093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6e533e49aba4111a0592ae2f0d6d5bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:57.522248  1240 tablet_service.cc:1511] Processing CreateTablet for tablet c3a86df4dce7431ebc3dd76609005812 (DEFAULT_TABLE table=test-workload [id=bbd6b1edf883446b8e4f8a652b6b4ba8]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:59:57.523590  1240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3a86df4dce7431ebc3dd76609005812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:57.526083  1241 tablet_service.cc:1511] Processing CreateTablet for tablet 53045d37f99e45ff83484a205d25c159 (DEFAULT_TABLE table=test-workload [id=bbd6b1edf883446b8e4f8a652b6b4ba8]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:59:57.526258  1092 tablet_service.cc:1511] Processing CreateTablet for tablet 53045d37f99e45ff83484a205d25c159 (DEFAULT_TABLE table=test-workload [id=bbd6b1edf883446b8e4f8a652b6b4ba8]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:59:57.527428  1241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53045d37f99e45ff83484a205d25c159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:57.528692  1091 tablet_service.cc:1511] Processing CreateTablet for tablet c3a86df4dce7431ebc3dd76609005812 (DEFAULT_TABLE table=test-workload [id=bbd6b1edf883446b8e4f8a652b6b4ba8]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:59:57.529847  1168 tablet_service.cc:1511] Processing CreateTablet for tablet b6e533e49aba4111a0592ae2f0d6d5bb (DEFAULT_TABLE table=test-workload [id=bbd6b1edf883446b8e4f8a652b6b4ba8]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:59:57.530184  1167 tablet_service.cc:1511] Processing CreateTablet for tablet 53045d37f99e45ff83484a205d25c159 (DEFAULT_TABLE table=test-workload [id=bbd6b1edf883446b8e4f8a652b6b4ba8]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:59:57.531138  1168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6e533e49aba4111a0592ae2f0d6d5bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:57.531049  1090 tablet_service.cc:1511] Processing CreateTablet for tablet 21562582b0a44dadbbadc702fd6b7b1b (DEFAULT_TABLE table=test-workload [id=bbd6b1edf883446b8e4f8a652b6b4ba8]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:59:57.520319  1242 tablet_service.cc:1511] Processing CreateTablet for tablet b6e533e49aba4111a0592ae2f0d6d5bb (DEFAULT_TABLE table=test-workload [id=bbd6b1edf883446b8e4f8a652b6b4ba8]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:59:57.532419  1166 tablet_service.cc:1511] Processing CreateTablet for tablet c3a86df4dce7431ebc3dd76609005812 (DEFAULT_TABLE table=test-workload [id=bbd6b1edf883446b8e4f8a652b6b4ba8]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:59:57.533505  1242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6e533e49aba4111a0592ae2f0d6d5bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:57.533730  1166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3a86df4dce7431ebc3dd76609005812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:57.538213  1161 tablet_service.cc:1511] Processing CreateTablet for tablet cf424ea418ec409fbe7d9bc3e959c695 (DEFAULT_TABLE table=test-workload [id=bbd6b1edf883446b8e4f8a652b6b4ba8]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:59:57.539556  1161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf424ea418ec409fbe7d9bc3e959c695. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:57.539942  1164 tablet_service.cc:1511] Processing CreateTablet for tablet 43365da3ffe345aa939dacc83fca01e2 (DEFAULT_TABLE table=test-workload [id=bbd6b1edf883446b8e4f8a652b6b4ba8]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:59:57.541292  1162 tablet_service.cc:1511] Processing CreateTablet for tablet 766aee4cd0ad4ca99e88106b9ee44bfd (DEFAULT_TABLE table=test-workload [id=bbd6b1edf883446b8e4f8a652b6b4ba8]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:59:57.542400  1163 tablet_service.cc:1511] Processing CreateTablet for tablet 34ca940a7b53463bb839e388285596f5 (DEFAULT_TABLE table=test-workload [id=bbd6b1edf883446b8e4f8a652b6b4ba8]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:59:57.543838  1160 tablet_service.cc:1511] Processing CreateTablet for tablet 8a8ac1e3e54345718250fe8751bf234e (DEFAULT_TABLE table=test-workload [id=bbd6b1edf883446b8e4f8a652b6b4ba8]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:59:57.538113  1165 tablet_service.cc:1511] Processing CreateTablet for tablet 21562582b0a44dadbbadc702fd6b7b1b (DEFAULT_TABLE table=test-workload [id=bbd6b1edf883446b8e4f8a652b6b4ba8]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:59:57.527467  1092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53045d37f99e45ff83484a205d25c159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:57.549866  1236 tablet_service.cc:1511] Processing CreateTablet for tablet 766aee4cd0ad4ca99e88106b9ee44bfd (DEFAULT_TABLE table=test-workload [id=bbd6b1edf883446b8e4f8a652b6b4ba8]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:59:57.550071  1235 tablet_service.cc:1511] Processing CreateTablet for tablet cf424ea418ec409fbe7d9bc3e959c695 (DEFAULT_TABLE table=test-workload [id=bbd6b1edf883446b8e4f8a652b6b4ba8]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:59:57.550180  1159 tablet_service.cc:1511] Processing CreateTablet for tablet 2b09c8c207814a50b328ea9a7de81a9d (DEFAULT_TABLE table=test-workload [id=bbd6b1edf883446b8e4f8a652b6b4ba8]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:59:57.551523  1236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 766aee4cd0ad4ca99e88106b9ee44bfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:57.552276  1235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf424ea418ec409fbe7d9bc3e959c695. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:57.552439  1234 tablet_service.cc:1511] Processing CreateTablet for tablet 8a8ac1e3e54345718250fe8751bf234e (DEFAULT_TABLE table=test-workload [id=bbd6b1edf883446b8e4f8a652b6b4ba8]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:59:57.554271  1233 tablet_service.cc:1511] Processing CreateTablet for tablet 2b09c8c207814a50b328ea9a7de81a9d (DEFAULT_TABLE table=test-workload [id=bbd6b1edf883446b8e4f8a652b6b4ba8]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:59:57.554711  1237 tablet_service.cc:1511] Processing CreateTablet for tablet 34ca940a7b53463bb839e388285596f5 (DEFAULT_TABLE table=test-workload [id=bbd6b1edf883446b8e4f8a652b6b4ba8]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:59:57.555521  1233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b09c8c207814a50b328ea9a7de81a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:57.556308  1237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34ca940a7b53463bb839e388285596f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:57.557435  1234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a8ac1e3e54345718250fe8751bf234e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:57.558151  1238 tablet_service.cc:1511] Processing CreateTablet for tablet 43365da3ffe345aa939dacc83fca01e2 (DEFAULT_TABLE table=test-workload [id=bbd6b1edf883446b8e4f8a652b6b4ba8]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:59:57.559439  1238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43365da3ffe345aa939dacc83fca01e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:57.562608  1239 tablet_service.cc:1511] Processing CreateTablet for tablet 21562582b0a44dadbbadc702fd6b7b1b (DEFAULT_TABLE table=test-workload [id=bbd6b1edf883446b8e4f8a652b6b4ba8]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:59:57.563997  1090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21562582b0a44dadbbadc702fd6b7b1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:57.564356  1239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21562582b0a44dadbbadc702fd6b7b1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:57.565662  1091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3a86df4dce7431ebc3dd76609005812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:57.566836  1089 tablet_service.cc:1511] Processing CreateTablet for tablet 43365da3ffe345aa939dacc83fca01e2 (DEFAULT_TABLE table=test-workload [id=bbd6b1edf883446b8e4f8a652b6b4ba8]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:59:57.568027  1164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43365da3ffe345aa939dacc83fca01e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:57.569489  1165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21562582b0a44dadbbadc702fd6b7b1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:57.569701  1088 tablet_service.cc:1511] Processing CreateTablet for tablet 34ca940a7b53463bb839e388285596f5 (DEFAULT_TABLE table=test-workload [id=bbd6b1edf883446b8e4f8a652b6b4ba8]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:59:57.571926  1087 tablet_service.cc:1511] Processing CreateTablet for tablet 766aee4cd0ad4ca99e88106b9ee44bfd (DEFAULT_TABLE table=test-workload [id=bbd6b1edf883446b8e4f8a652b6b4ba8]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:59:57.573523  1163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34ca940a7b53463bb839e388285596f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:57.574184  1086 tablet_service.cc:1511] Processing CreateTablet for tablet cf424ea418ec409fbe7d9bc3e959c695 (DEFAULT_TABLE table=test-workload [id=bbd6b1edf883446b8e4f8a652b6b4ba8]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:59:57.576452  1085 tablet_service.cc:1511] Processing CreateTablet for tablet 8a8ac1e3e54345718250fe8751bf234e (DEFAULT_TABLE table=test-workload [id=bbd6b1edf883446b8e4f8a652b6b4ba8]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:59:57.577580  1167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53045d37f99e45ff83484a205d25c159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:57.578734  1084 tablet_service.cc:1511] Processing CreateTablet for tablet 2b09c8c207814a50b328ea9a7de81a9d (DEFAULT_TABLE table=test-workload [id=bbd6b1edf883446b8e4f8a652b6b4ba8]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:59:57.579632  1159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b09c8c207814a50b328ea9a7de81a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:57.568125  1089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43365da3ffe345aa939dacc83fca01e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:57.583464  1087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 766aee4cd0ad4ca99e88106b9ee44bfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:57.585508  1162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 766aee4cd0ad4ca99e88106b9ee44bfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:57.586520  1084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b09c8c207814a50b328ea9a7de81a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:57.586803  1160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a8ac1e3e54345718250fe8751bf234e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:57.589394  1086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf424ea418ec409fbe7d9bc3e959c695. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:57.590703  1085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a8ac1e3e54345718250fe8751bf234e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:57.591953  1088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34ca940a7b53463bb839e388285596f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:57.708176  1292 tablet_bootstrap.cc:492] T b6e533e49aba4111a0592ae2f0d6d5bb P f98885ef63a44cd68a9a8e97a14e7cb4: Bootstrap starting.
I20260709 12:59:57.742022  1292 tablet_bootstrap.cc:654] T b6e533e49aba4111a0592ae2f0d6d5bb P f98885ef63a44cd68a9a8e97a14e7cb4: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:57.760661  1293 tablet_bootstrap.cc:492] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7: Bootstrap starting.
I20260709 12:59:57.790989  1294 tablet_bootstrap.cc:492] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b: Bootstrap starting.
I20260709 12:59:57.796895  1293 tablet_bootstrap.cc:654] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:57.802800  1292 tablet_bootstrap.cc:492] T b6e533e49aba4111a0592ae2f0d6d5bb P f98885ef63a44cd68a9a8e97a14e7cb4: No bootstrap required, opened a new log
I20260709 12:59:57.803325  1292 ts_tablet_manager.cc:1403] T b6e533e49aba4111a0592ae2f0d6d5bb P f98885ef63a44cd68a9a8e97a14e7cb4: Time spent bootstrapping tablet: real 0.095s	user 0.016s	sys 0.034s
I20260709 12:59:57.809468  1292 raft_consensus.cc:359] T b6e533e49aba4111a0592ae2f0d6d5bb P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } } peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } }
I20260709 12:59:57.810317  1292 raft_consensus.cc:385] T b6e533e49aba4111a0592ae2f0d6d5bb P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:57.810655  1292 raft_consensus.cc:740] T b6e533e49aba4111a0592ae2f0d6d5bb P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f98885ef63a44cd68a9a8e97a14e7cb4, State: Initialized, Role: FOLLOWER
I20260709 12:59:57.811811  1292 consensus_queue.cc:260] T b6e533e49aba4111a0592ae2f0d6d5bb P f98885ef63a44cd68a9a8e97a14e7cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } } peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } }
I20260709 12:59:57.823752  1294 tablet_bootstrap.cc:654] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:57.824254  1292 ts_tablet_manager.cc:1434] T b6e533e49aba4111a0592ae2f0d6d5bb P f98885ef63a44cd68a9a8e97a14e7cb4: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.012s
I20260709 12:59:57.825311  1203 heartbeater.cc:499] Master 127.0.107.254:38877 was elected leader, sending a full tablet report...
I20260709 12:59:57.829038  1292 tablet_bootstrap.cc:492] T 43365da3ffe345aa939dacc83fca01e2 P f98885ef63a44cd68a9a8e97a14e7cb4: Bootstrap starting.
I20260709 12:59:57.830260  1293 tablet_bootstrap.cc:492] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7: No bootstrap required, opened a new log
I20260709 12:59:57.830783  1293 ts_tablet_manager.cc:1403] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7: Time spent bootstrapping tablet: real 0.125s	user 0.033s	sys 0.008s
I20260709 12:59:57.834496  1294 tablet_bootstrap.cc:492] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b: No bootstrap required, opened a new log
I20260709 12:59:57.834151  1293 raft_consensus.cc:359] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:57.834864  1293 raft_consensus.cc:385] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:57.834995  1294 ts_tablet_manager.cc:1403] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b: Time spent bootstrapping tablet: real 0.044s	user 0.007s	sys 0.006s
I20260709 12:59:57.835278  1293 raft_consensus.cc:740] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28620b8df5964fb5bbbf51288ccbf9d7, State: Initialized, Role: FOLLOWER
I20260709 12:59:57.835822  1292 tablet_bootstrap.cc:654] T 43365da3ffe345aa939dacc83fca01e2 P f98885ef63a44cd68a9a8e97a14e7cb4: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:57.836155  1293 consensus_queue.cc:260] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:57.838204  1294 raft_consensus.cc:359] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:57.839133  1294 raft_consensus.cc:385] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:57.839522  1294 raft_consensus.cc:740] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76534c5775854ffb8239fb8bb2eead1b, State: Initialized, Role: FOLLOWER
I20260709 12:59:57.840724  1294 consensus_queue.cc:260] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:57.845512  1293 ts_tablet_manager.cc:1434] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7: Time spent starting tablet: real 0.014s	user 0.012s	sys 0.004s
I20260709 12:59:57.845525  1128 heartbeater.cc:499] Master 127.0.107.254:38877 was elected leader, sending a full tablet report...
I20260709 12:59:57.846658  1293 tablet_bootstrap.cc:492] T c3a86df4dce7431ebc3dd76609005812 P 28620b8df5964fb5bbbf51288ccbf9d7: Bootstrap starting.
I20260709 12:59:57.850996  1292 tablet_bootstrap.cc:492] T 43365da3ffe345aa939dacc83fca01e2 P f98885ef63a44cd68a9a8e97a14e7cb4: No bootstrap required, opened a new log
I20260709 12:59:57.851500  1292 ts_tablet_manager.cc:1403] T 43365da3ffe345aa939dacc83fca01e2 P f98885ef63a44cd68a9a8e97a14e7cb4: Time spent bootstrapping tablet: real 0.023s	user 0.004s	sys 0.012s
I20260709 12:59:57.853598  1293 tablet_bootstrap.cc:654] T c3a86df4dce7431ebc3dd76609005812 P 28620b8df5964fb5bbbf51288ccbf9d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:57.855680  1292 raft_consensus.cc:359] T 43365da3ffe345aa939dacc83fca01e2 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:57.856505  1292 raft_consensus.cc:385] T 43365da3ffe345aa939dacc83fca01e2 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:57.856781  1292 raft_consensus.cc:740] T 43365da3ffe345aa939dacc83fca01e2 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f98885ef63a44cd68a9a8e97a14e7cb4, State: Initialized, Role: FOLLOWER
I20260709 12:59:57.857717  1292 consensus_queue.cc:260] T 43365da3ffe345aa939dacc83fca01e2 P f98885ef63a44cd68a9a8e97a14e7cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:57.858927  1277 heartbeater.cc:499] Master 127.0.107.254:38877 was elected leader, sending a full tablet report...
I20260709 12:59:57.860051  1294 ts_tablet_manager.cc:1434] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.005s
I20260709 12:59:57.860116  1292 ts_tablet_manager.cc:1434] T 43365da3ffe345aa939dacc83fca01e2 P f98885ef63a44cd68a9a8e97a14e7cb4: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.007s
I20260709 12:59:57.861212  1294 tablet_bootstrap.cc:492] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b: Bootstrap starting.
I20260709 12:59:57.861522  1292 tablet_bootstrap.cc:492] T 8a8ac1e3e54345718250fe8751bf234e P f98885ef63a44cd68a9a8e97a14e7cb4: Bootstrap starting.
I20260709 12:59:57.862809  1293 tablet_bootstrap.cc:492] T c3a86df4dce7431ebc3dd76609005812 P 28620b8df5964fb5bbbf51288ccbf9d7: No bootstrap required, opened a new log
I20260709 12:59:57.863333  1293 ts_tablet_manager.cc:1403] T c3a86df4dce7431ebc3dd76609005812 P 28620b8df5964fb5bbbf51288ccbf9d7: Time spent bootstrapping tablet: real 0.017s	user 0.005s	sys 0.008s
I20260709 12:59:57.866321  1293 raft_consensus.cc:359] T c3a86df4dce7431ebc3dd76609005812 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:57.867151  1293 raft_consensus.cc:385] T c3a86df4dce7431ebc3dd76609005812 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:57.867481  1293 raft_consensus.cc:740] T c3a86df4dce7431ebc3dd76609005812 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28620b8df5964fb5bbbf51288ccbf9d7, State: Initialized, Role: FOLLOWER
I20260709 12:59:57.867936  1294 tablet_bootstrap.cc:654] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:57.868242  1293 consensus_queue.cc:260] T c3a86df4dce7431ebc3dd76609005812 P 28620b8df5964fb5bbbf51288ccbf9d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:57.869916  1292 tablet_bootstrap.cc:654] T 8a8ac1e3e54345718250fe8751bf234e P f98885ef63a44cd68a9a8e97a14e7cb4: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:57.870648  1293 ts_tablet_manager.cc:1434] T c3a86df4dce7431ebc3dd76609005812 P 28620b8df5964fb5bbbf51288ccbf9d7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:59:57.871908  1293 tablet_bootstrap.cc:492] T 43365da3ffe345aa939dacc83fca01e2 P 28620b8df5964fb5bbbf51288ccbf9d7: Bootstrap starting.
I20260709 12:59:57.878515  1294 tablet_bootstrap.cc:492] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b: No bootstrap required, opened a new log
I20260709 12:59:57.879089  1294 ts_tablet_manager.cc:1403] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.007s
I20260709 12:59:57.879390  1293 tablet_bootstrap.cc:654] T 43365da3ffe345aa939dacc83fca01e2 P 28620b8df5964fb5bbbf51288ccbf9d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:57.882445  1294 raft_consensus.cc:359] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:57.883630  1294 raft_consensus.cc:385] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:57.885471  1294 raft_consensus.cc:740] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76534c5775854ffb8239fb8bb2eead1b, State: Initialized, Role: FOLLOWER
I20260709 12:59:57.887604  1294 consensus_queue.cc:260] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:57.892107  1294 ts_tablet_manager.cc:1434] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:59:57.893448  1294 tablet_bootstrap.cc:492] T 34ca940a7b53463bb839e388285596f5 P 76534c5775854ffb8239fb8bb2eead1b: Bootstrap starting.
I20260709 12:59:57.889868  1292 tablet_bootstrap.cc:492] T 8a8ac1e3e54345718250fe8751bf234e P f98885ef63a44cd68a9a8e97a14e7cb4: No bootstrap required, opened a new log
I20260709 12:59:57.897496  1292 ts_tablet_manager.cc:1403] T 8a8ac1e3e54345718250fe8751bf234e P f98885ef63a44cd68a9a8e97a14e7cb4: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.010s
I20260709 12:59:57.901141  1292 raft_consensus.cc:359] T 8a8ac1e3e54345718250fe8751bf234e P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:57.903123  1292 raft_consensus.cc:385] T 8a8ac1e3e54345718250fe8751bf234e P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:57.903524  1292 raft_consensus.cc:740] T 8a8ac1e3e54345718250fe8751bf234e P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f98885ef63a44cd68a9a8e97a14e7cb4, State: Initialized, Role: FOLLOWER
I20260709 12:59:57.904513  1293 tablet_bootstrap.cc:492] T 43365da3ffe345aa939dacc83fca01e2 P 28620b8df5964fb5bbbf51288ccbf9d7: No bootstrap required, opened a new log
I20260709 12:59:57.904289  1292 consensus_queue.cc:260] T 8a8ac1e3e54345718250fe8751bf234e P f98885ef63a44cd68a9a8e97a14e7cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:57.904964  1293 ts_tablet_manager.cc:1403] T 43365da3ffe345aa939dacc83fca01e2 P 28620b8df5964fb5bbbf51288ccbf9d7: Time spent bootstrapping tablet: real 0.033s	user 0.023s	sys 0.008s
I20260709 12:59:57.906786  1292 ts_tablet_manager.cc:1434] T 8a8ac1e3e54345718250fe8751bf234e P f98885ef63a44cd68a9a8e97a14e7cb4: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 12:59:57.907742  1292 tablet_bootstrap.cc:492] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4: Bootstrap starting.
I20260709 12:59:57.907892  1293 raft_consensus.cc:359] T 43365da3ffe345aa939dacc83fca01e2 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:57.908614  1293 raft_consensus.cc:385] T 43365da3ffe345aa939dacc83fca01e2 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:57.908926  1293 raft_consensus.cc:740] T 43365da3ffe345aa939dacc83fca01e2 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28620b8df5964fb5bbbf51288ccbf9d7, State: Initialized, Role: FOLLOWER
I20260709 12:59:57.909664  1293 consensus_queue.cc:260] T 43365da3ffe345aa939dacc83fca01e2 P 28620b8df5964fb5bbbf51288ccbf9d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:57.912147  1293 ts_tablet_manager.cc:1434] T 43365da3ffe345aa939dacc83fca01e2 P 28620b8df5964fb5bbbf51288ccbf9d7: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:59:57.913225  1293 tablet_bootstrap.cc:492] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7: Bootstrap starting.
I20260709 12:59:57.914551  1294 tablet_bootstrap.cc:654] T 34ca940a7b53463bb839e388285596f5 P 76534c5775854ffb8239fb8bb2eead1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:57.914664  1292 tablet_bootstrap.cc:654] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:57.921183  1293 tablet_bootstrap.cc:654] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:57.929492  1292 tablet_bootstrap.cc:492] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4: No bootstrap required, opened a new log
I20260709 12:59:57.930241  1292 ts_tablet_manager.cc:1403] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.002s
I20260709 12:59:57.933532  1292 raft_consensus.cc:359] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:57.934396  1293 tablet_bootstrap.cc:492] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7: No bootstrap required, opened a new log
I20260709 12:59:57.934413  1292 raft_consensus.cc:385] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:57.935036  1294 tablet_bootstrap.cc:492] T 34ca940a7b53463bb839e388285596f5 P 76534c5775854ffb8239fb8bb2eead1b: No bootstrap required, opened a new log
I20260709 12:59:57.934935  1292 raft_consensus.cc:740] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f98885ef63a44cd68a9a8e97a14e7cb4, State: Initialized, Role: FOLLOWER
I20260709 12:59:57.935081  1293 ts_tablet_manager.cc:1403] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.008s
I20260709 12:59:57.935577  1294 ts_tablet_manager.cc:1403] T 34ca940a7b53463bb839e388285596f5 P 76534c5775854ffb8239fb8bb2eead1b: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.010s
I20260709 12:59:57.936163  1299 raft_consensus.cc:493] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.935904  1292 consensus_queue.cc:260] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:57.936673  1299 raft_consensus.cc:515] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:57.938452  1293 raft_consensus.cc:359] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:57.938609  1294 raft_consensus.cc:359] T 34ca940a7b53463bb839e388285596f5 P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:57.939314  1293 raft_consensus.cc:385] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:57.939517  1294 raft_consensus.cc:385] T 34ca940a7b53463bb839e388285596f5 P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:57.939898  1294 raft_consensus.cc:740] T 34ca940a7b53463bb839e388285596f5 P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76534c5775854ffb8239fb8bb2eead1b, State: Initialized, Role: FOLLOWER
I20260709 12:59:57.939703  1293 raft_consensus.cc:740] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28620b8df5964fb5bbbf51288ccbf9d7, State: Initialized, Role: FOLLOWER
I20260709 12:59:57.940636  1292 ts_tablet_manager.cc:1434] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 12:59:57.940712  1294 consensus_queue.cc:260] T 34ca940a7b53463bb839e388285596f5 P 76534c5775854ffb8239fb8bb2eead1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:57.940809  1293 consensus_queue.cc:260] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:57.941875  1292 tablet_bootstrap.cc:492] T 766aee4cd0ad4ca99e88106b9ee44bfd P f98885ef63a44cd68a9a8e97a14e7cb4: Bootstrap starting.
I20260709 12:59:57.943216  1294 ts_tablet_manager.cc:1434] T 34ca940a7b53463bb839e388285596f5 P 76534c5775854ffb8239fb8bb2eead1b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:59:57.944185  1294 tablet_bootstrap.cc:492] T c3a86df4dce7431ebc3dd76609005812 P 76534c5775854ffb8239fb8bb2eead1b: Bootstrap starting.
I20260709 12:59:57.950968  1294 tablet_bootstrap.cc:654] T c3a86df4dce7431ebc3dd76609005812 P 76534c5775854ffb8239fb8bb2eead1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:57.951103  1292 tablet_bootstrap.cc:654] T 766aee4cd0ad4ca99e88106b9ee44bfd P f98885ef63a44cd68a9a8e97a14e7cb4: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:57.951047  1293 ts_tablet_manager.cc:1434] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 12:59:57.952378  1293 tablet_bootstrap.cc:492] T 2b09c8c207814a50b328ea9a7de81a9d P 28620b8df5964fb5bbbf51288ccbf9d7: Bootstrap starting.
I20260709 12:59:57.958783  1301 raft_consensus.cc:493] T 34ca940a7b53463bb839e388285596f5 P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.959282  1301 raft_consensus.cc:515] T 34ca940a7b53463bb839e388285596f5 P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:57.962520  1293 tablet_bootstrap.cc:654] T 2b09c8c207814a50b328ea9a7de81a9d P 28620b8df5964fb5bbbf51288ccbf9d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:57.964332  1299 leader_election.cc:290] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194:38543), 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195:35987)
I20260709 12:59:57.975248  1301 leader_election.cc:290] T 34ca940a7b53463bb839e388285596f5 P 76534c5775854ffb8239fb8bb2eead1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193:41491), f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194:38543)
I20260709 12:59:57.995884  1292 tablet_bootstrap.cc:492] T 766aee4cd0ad4ca99e88106b9ee44bfd P f98885ef63a44cd68a9a8e97a14e7cb4: No bootstrap required, opened a new log
I20260709 12:59:57.996418  1292 ts_tablet_manager.cc:1403] T 766aee4cd0ad4ca99e88106b9ee44bfd P f98885ef63a44cd68a9a8e97a14e7cb4: Time spent bootstrapping tablet: real 0.055s	user 0.014s	sys 0.009s
I20260709 12:59:57.999346  1292 raft_consensus.cc:359] T 766aee4cd0ad4ca99e88106b9ee44bfd P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.000034  1292 raft_consensus.cc:385] T 766aee4cd0ad4ca99e88106b9ee44bfd P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:58.000347  1292 raft_consensus.cc:740] T 766aee4cd0ad4ca99e88106b9ee44bfd P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f98885ef63a44cd68a9a8e97a14e7cb4, State: Initialized, Role: FOLLOWER
I20260709 12:59:58.001161  1292 consensus_queue.cc:260] T 766aee4cd0ad4ca99e88106b9ee44bfd P f98885ef63a44cd68a9a8e97a14e7cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.010234  1292 ts_tablet_manager.cc:1434] T 766aee4cd0ad4ca99e88106b9ee44bfd P f98885ef63a44cd68a9a8e97a14e7cb4: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260709 12:59:58.010360  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ca940a7b53463bb839e388285596f5" candidate_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" is_pre_election: true
I20260709 12:59:58.011884  1292 tablet_bootstrap.cc:492] T c3a86df4dce7431ebc3dd76609005812 P f98885ef63a44cd68a9a8e97a14e7cb4: Bootstrap starting.
I20260709 12:59:58.014741  1293 tablet_bootstrap.cc:492] T 2b09c8c207814a50b328ea9a7de81a9d P 28620b8df5964fb5bbbf51288ccbf9d7: No bootstrap required, opened a new log
W20260709 12:59:58.014881  1067 leader_election.cc:343] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194:38543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:58.017288  1293 ts_tablet_manager.cc:1403] T 2b09c8c207814a50b328ea9a7de81a9d P 28620b8df5964fb5bbbf51288ccbf9d7: Time spent bootstrapping tablet: real 0.065s	user 0.020s	sys 0.010s
W20260709 12:59:58.018766  1049 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:58.020678  1252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ca940a7b53463bb839e388285596f5" candidate_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76534c5775854ffb8239fb8bb2eead1b" is_pre_election: true
I20260709 12:59:58.020756  1293 raft_consensus.cc:359] T 2b09c8c207814a50b328ea9a7de81a9d P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.021652  1293 raft_consensus.cc:385] T 2b09c8c207814a50b328ea9a7de81a9d P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:58.021556  1252 raft_consensus.cc:2468] T 34ca940a7b53463bb839e388285596f5 P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28620b8df5964fb5bbbf51288ccbf9d7 in term 0.
I20260709 12:59:58.022065  1293 raft_consensus.cc:740] T 2b09c8c207814a50b328ea9a7de81a9d P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28620b8df5964fb5bbbf51288ccbf9d7, State: Initialized, Role: FOLLOWER
I20260709 12:59:58.022915  1293 consensus_queue.cc:260] T 2b09c8c207814a50b328ea9a7de81a9d P 28620b8df5964fb5bbbf51288ccbf9d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.024474  1294 tablet_bootstrap.cc:492] T c3a86df4dce7431ebc3dd76609005812 P 76534c5775854ffb8239fb8bb2eead1b: No bootstrap required, opened a new log
I20260709 12:59:58.024978  1294 ts_tablet_manager.cc:1403] T c3a86df4dce7431ebc3dd76609005812 P 76534c5775854ffb8239fb8bb2eead1b: Time spent bootstrapping tablet: real 0.081s	user 0.009s	sys 0.003s
I20260709 12:59:58.025312  1293 ts_tablet_manager.cc:1434] T 2b09c8c207814a50b328ea9a7de81a9d P 28620b8df5964fb5bbbf51288ccbf9d7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:59:58.026315  1293 tablet_bootstrap.cc:492] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7: Bootstrap starting.
I20260709 12:59:58.027279  1068 leader_election.cc:304] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 28620b8df5964fb5bbbf51288ccbf9d7, 76534c5775854ffb8239fb8bb2eead1b; no voters: f98885ef63a44cd68a9a8e97a14e7cb4
I20260709 12:59:58.027922  1294 raft_consensus.cc:359] T c3a86df4dce7431ebc3dd76609005812 P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.028656  1294 raft_consensus.cc:385] T c3a86df4dce7431ebc3dd76609005812 P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:58.029052  1299 raft_consensus.cc:2804] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:58.029482  1294 raft_consensus.cc:740] T c3a86df4dce7431ebc3dd76609005812 P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76534c5775854ffb8239fb8bb2eead1b, State: Initialized, Role: FOLLOWER
I20260709 12:59:58.029804  1299 raft_consensus.cc:493] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:58.030225  1299 raft_consensus.cc:3060] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.030429  1294 consensus_queue.cc:260] T c3a86df4dce7431ebc3dd76609005812 P 76534c5775854ffb8239fb8bb2eead1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.033941  1293 tablet_bootstrap.cc:654] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:58.039373  1299 raft_consensus.cc:515] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.045389  1294 ts_tablet_manager.cc:1434] T c3a86df4dce7431ebc3dd76609005812 P 76534c5775854ffb8239fb8bb2eead1b: Time spent starting tablet: real 0.020s	user 0.001s	sys 0.006s
I20260709 12:59:58.046492  1103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ca940a7b53463bb839e388285596f5" candidate_uuid: "76534c5775854ffb8239fb8bb2eead1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" is_pre_election: true
I20260709 12:59:58.047422  1103 raft_consensus.cc:2393] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 76534c5775854ffb8239fb8bb2eead1b in current term 1: Already voted for candidate 28620b8df5964fb5bbbf51288ccbf9d7 in this term.
I20260709 12:59:58.046808  1292 tablet_bootstrap.cc:654] T c3a86df4dce7431ebc3dd76609005812 P f98885ef63a44cd68a9a8e97a14e7cb4: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:58.048542  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ca940a7b53463bb839e388285596f5" candidate_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4"
W20260709 12:59:58.050895  1067 leader_election.cc:343] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194:38543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:58.051967  1294 tablet_bootstrap.cc:492] T 766aee4cd0ad4ca99e88106b9ee44bfd P 76534c5775854ffb8239fb8bb2eead1b: Bootstrap starting.
I20260709 12:59:58.055446  1252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ca940a7b53463bb839e388285596f5" candidate_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76534c5775854ffb8239fb8bb2eead1b"
I20260709 12:59:58.056201  1310 raft_consensus.cc:493] T 43365da3ffe345aa939dacc83fca01e2 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.056265  1252 raft_consensus.cc:3060] T 34ca940a7b53463bb839e388285596f5 P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.056923  1310 raft_consensus.cc:515] T 43365da3ffe345aa939dacc83fca01e2 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.059331  1310 leader_election.cc:290] T 43365da3ffe345aa939dacc83fca01e2 P 28620b8df5964fb5bbbf51288ccbf9d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194:38543), 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195:35987)
I20260709 12:59:58.059764  1294 tablet_bootstrap.cc:654] T 766aee4cd0ad4ca99e88106b9ee44bfd P 76534c5775854ffb8239fb8bb2eead1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:58.061663  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43365da3ffe345aa939dacc83fca01e2" candidate_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" is_pre_election: true
I20260709 12:59:58.062427  1178 raft_consensus.cc:2468] T 43365da3ffe345aa939dacc83fca01e2 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28620b8df5964fb5bbbf51288ccbf9d7 in term 0.
I20260709 12:59:58.063227  1292 tablet_bootstrap.cc:492] T c3a86df4dce7431ebc3dd76609005812 P f98885ef63a44cd68a9a8e97a14e7cb4: No bootstrap required, opened a new log
I20260709 12:59:58.063632  1292 ts_tablet_manager.cc:1403] T c3a86df4dce7431ebc3dd76609005812 P f98885ef63a44cd68a9a8e97a14e7cb4: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.002s
I20260709 12:59:58.063854  1067 leader_election.cc:304] T 43365da3ffe345aa939dacc83fca01e2 P 28620b8df5964fb5bbbf51288ccbf9d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28620b8df5964fb5bbbf51288ccbf9d7, f98885ef63a44cd68a9a8e97a14e7cb4; no voters: 
I20260709 12:59:58.064345  1293 tablet_bootstrap.cc:492] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7: No bootstrap required, opened a new log
I20260709 12:59:58.064850  1293 ts_tablet_manager.cc:1403] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.025s
I20260709 12:59:58.064852  1310 raft_consensus.cc:2804] T 43365da3ffe345aa939dacc83fca01e2 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:58.065423  1310 raft_consensus.cc:493] T 43365da3ffe345aa939dacc83fca01e2 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:58.065848  1310 raft_consensus.cc:3060] T 43365da3ffe345aa939dacc83fca01e2 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.065678  1251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43365da3ffe345aa939dacc83fca01e2" candidate_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76534c5775854ffb8239fb8bb2eead1b" is_pre_election: true
I20260709 12:59:58.066409  1292 raft_consensus.cc:359] T c3a86df4dce7431ebc3dd76609005812 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.066987  1292 raft_consensus.cc:385] T c3a86df4dce7431ebc3dd76609005812 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:58.067267  1292 raft_consensus.cc:740] T c3a86df4dce7431ebc3dd76609005812 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f98885ef63a44cd68a9a8e97a14e7cb4, State: Initialized, Role: FOLLOWER
W20260709 12:59:58.067411  1068 leader_election.cc:343] T 43365da3ffe345aa939dacc83fca01e2 P 28620b8df5964fb5bbbf51288ccbf9d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195:35987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:58.067956  1292 consensus_queue.cc:260] T c3a86df4dce7431ebc3dd76609005812 P f98885ef63a44cd68a9a8e97a14e7cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.070024  1292 ts_tablet_manager.cc:1434] T c3a86df4dce7431ebc3dd76609005812 P f98885ef63a44cd68a9a8e97a14e7cb4: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:59:58.070993  1292 tablet_bootstrap.cc:492] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4: Bootstrap starting.
I20260709 12:59:58.073880  1310 raft_consensus.cc:515] T 43365da3ffe345aa939dacc83fca01e2 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.074436  1252 raft_consensus.cc:2468] T 34ca940a7b53463bb839e388285596f5 P 76534c5775854ffb8239fb8bb2eead1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28620b8df5964fb5bbbf51288ccbf9d7 in term 1.
I20260709 12:59:58.075848  1068 leader_election.cc:304] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 28620b8df5964fb5bbbf51288ccbf9d7, 76534c5775854ffb8239fb8bb2eead1b; no voters: f98885ef63a44cd68a9a8e97a14e7cb4
I20260709 12:59:58.076150  1310 leader_election.cc:290] T 43365da3ffe345aa939dacc83fca01e2 P 28620b8df5964fb5bbbf51288ccbf9d7 [CANDIDATE]: Term 1 election: Requested vote from peers f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194:38543), 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195:35987)
I20260709 12:59:58.076704  1310 raft_consensus.cc:2804] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:58.078122  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43365da3ffe345aa939dacc83fca01e2" candidate_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4"
I20260709 12:59:58.078732  1178 raft_consensus.cc:3060] T 43365da3ffe345aa939dacc83fca01e2 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.078981  1292 tablet_bootstrap.cc:654] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:58.080351  1293 raft_consensus.cc:359] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.081260  1310 raft_consensus.cc:697] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 LEADER]: Becoming Leader. State: Replica: 28620b8df5964fb5bbbf51288ccbf9d7, State: Running, Role: LEADER
I20260709 12:59:58.082187  1310 consensus_queue.cc:237] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.083235  1293 raft_consensus.cc:385] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:58.083604  1293 raft_consensus.cc:740] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28620b8df5964fb5bbbf51288ccbf9d7, State: Initialized, Role: FOLLOWER
I20260709 12:59:58.084372  1293 consensus_queue.cc:260] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.089848  1299 leader_election.cc:290] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [CANDIDATE]: Term 1 election: Requested vote from peers f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194:38543), 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195:35987)
I20260709 12:59:58.089977  1297 raft_consensus.cc:493] T b6e533e49aba4111a0592ae2f0d6d5bb P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.090718  1297 raft_consensus.cc:515] T b6e533e49aba4111a0592ae2f0d6d5bb P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } } peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } }
I20260709 12:59:58.096499  1297 leader_election.cc:290] T b6e533e49aba4111a0592ae2f0d6d5bb P f98885ef63a44cd68a9a8e97a14e7cb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195:35987), 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193:41491)
I20260709 12:59:58.097187  1178 raft_consensus.cc:2468] T 43365da3ffe345aa939dacc83fca01e2 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28620b8df5964fb5bbbf51288ccbf9d7 in term 1.
I20260709 12:59:58.098953  1067 leader_election.cc:304] T 43365da3ffe345aa939dacc83fca01e2 P 28620b8df5964fb5bbbf51288ccbf9d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28620b8df5964fb5bbbf51288ccbf9d7, f98885ef63a44cd68a9a8e97a14e7cb4; no voters: 
I20260709 12:59:58.100797  1293 ts_tablet_manager.cc:1434] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.005s
I20260709 12:59:58.102246  1322 raft_consensus.cc:2804] T 43365da3ffe345aa939dacc83fca01e2 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:58.102787  1322 raft_consensus.cc:697] T 43365da3ffe345aa939dacc83fca01e2 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 LEADER]: Becoming Leader. State: Replica: 28620b8df5964fb5bbbf51288ccbf9d7, State: Running, Role: LEADER
I20260709 12:59:58.103689  1322 consensus_queue.cc:237] T 43365da3ffe345aa939dacc83fca01e2 P 28620b8df5964fb5bbbf51288ccbf9d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.107254  1252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43365da3ffe345aa939dacc83fca01e2" candidate_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76534c5775854ffb8239fb8bb2eead1b"
I20260709 12:59:58.108909  1293 tablet_bootstrap.cc:492] T cf424ea418ec409fbe7d9bc3e959c695 P 28620b8df5964fb5bbbf51288ccbf9d7: Bootstrap starting.
W20260709 12:59:58.109009  1068 leader_election.cc:343] T 43365da3ffe345aa939dacc83fca01e2 P 28620b8df5964fb5bbbf51288ccbf9d7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195:35987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:58.114028  1177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ca940a7b53463bb839e388285596f5" candidate_uuid: "76534c5775854ffb8239fb8bb2eead1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" is_pre_election: true
I20260709 12:59:58.118703  1001 catalog_manager.cc:5697] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:58.119974  1294 tablet_bootstrap.cc:492] T 766aee4cd0ad4ca99e88106b9ee44bfd P 76534c5775854ffb8239fb8bb2eead1b: No bootstrap required, opened a new log
I20260709 12:59:58.120519  1294 ts_tablet_manager.cc:1403] T 766aee4cd0ad4ca99e88106b9ee44bfd P 76534c5775854ffb8239fb8bb2eead1b: Time spent bootstrapping tablet: real 0.069s	user 0.014s	sys 0.025s
W20260709 12:59:58.122177  1216 leader_election.cc:343] T 34ca940a7b53463bb839e388285596f5 P 76534c5775854ffb8239fb8bb2eead1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194:38543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:58.122687  1216 leader_election.cc:304] T 34ca940a7b53463bb839e388285596f5 P 76534c5775854ffb8239fb8bb2eead1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76534c5775854ffb8239fb8bb2eead1b; no voters: 28620b8df5964fb5bbbf51288ccbf9d7, f98885ef63a44cd68a9a8e97a14e7cb4
I20260709 12:59:58.123193  1293 tablet_bootstrap.cc:654] T cf424ea418ec409fbe7d9bc3e959c695 P 28620b8df5964fb5bbbf51288ccbf9d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:58.123477  1301 raft_consensus.cc:2749] T 34ca940a7b53463bb839e388285596f5 P 76534c5775854ffb8239fb8bb2eead1b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:58.123626  1294 raft_consensus.cc:359] T 766aee4cd0ad4ca99e88106b9ee44bfd P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.131000  1292 tablet_bootstrap.cc:492] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4: No bootstrap required, opened a new log
I20260709 12:59:58.131559  1292 ts_tablet_manager.cc:1403] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4: Time spent bootstrapping tablet: real 0.061s	user 0.018s	sys 0.005s
I20260709 12:59:58.135005  1292 raft_consensus.cc:359] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.136678  1293 tablet_bootstrap.cc:492] T cf424ea418ec409fbe7d9bc3e959c695 P 28620b8df5964fb5bbbf51288ccbf9d7: No bootstrap required, opened a new log
I20260709 12:59:58.137197  1293 ts_tablet_manager.cc:1403] T cf424ea418ec409fbe7d9bc3e959c695 P 28620b8df5964fb5bbbf51288ccbf9d7: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.004s
I20260709 12:59:58.138482  1103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e533e49aba4111a0592ae2f0d6d5bb" candidate_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" is_pre_election: true
I20260709 12:59:58.139186  1252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e533e49aba4111a0592ae2f0d6d5bb" candidate_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76534c5775854ffb8239fb8bb2eead1b" is_pre_election: true
I20260709 12:59:58.124809  1294 raft_consensus.cc:385] T 766aee4cd0ad4ca99e88106b9ee44bfd P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:59:58.140126  1143 leader_election.cc:343] T b6e533e49aba4111a0592ae2f0d6d5bb P f98885ef63a44cd68a9a8e97a14e7cb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193:41491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:58.140549  1294 raft_consensus.cc:740] T 766aee4cd0ad4ca99e88106b9ee44bfd P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76534c5775854ffb8239fb8bb2eead1b, State: Initialized, Role: FOLLOWER
I20260709 12:59:58.135758  1292 raft_consensus.cc:385] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:59:58.141317  1143 leader_election.cc:343] T b6e533e49aba4111a0592ae2f0d6d5bb P f98885ef63a44cd68a9a8e97a14e7cb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195:35987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:58.141407  1292 raft_consensus.cc:740] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f98885ef63a44cd68a9a8e97a14e7cb4, State: Initialized, Role: FOLLOWER
I20260709 12:59:58.141363  1293 raft_consensus.cc:359] T cf424ea418ec409fbe7d9bc3e959c695 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.142313  1293 raft_consensus.cc:385] T cf424ea418ec409fbe7d9bc3e959c695 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:58.141949  1143 leader_election.cc:304] T b6e533e49aba4111a0592ae2f0d6d5bb P f98885ef63a44cd68a9a8e97a14e7cb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f98885ef63a44cd68a9a8e97a14e7cb4; no voters: 28620b8df5964fb5bbbf51288ccbf9d7, 76534c5775854ffb8239fb8bb2eead1b
I20260709 12:59:58.142048  1294 consensus_queue.cc:260] T 766aee4cd0ad4ca99e88106b9ee44bfd P 76534c5775854ffb8239fb8bb2eead1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.142660  1292 consensus_queue.cc:260] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.143085  1297 raft_consensus.cc:2749] T b6e533e49aba4111a0592ae2f0d6d5bb P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:58.142678  1293 raft_consensus.cc:740] T cf424ea418ec409fbe7d9bc3e959c695 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28620b8df5964fb5bbbf51288ccbf9d7, State: Initialized, Role: FOLLOWER
I20260709 12:59:58.145550  1294 ts_tablet_manager.cc:1434] T 766aee4cd0ad4ca99e88106b9ee44bfd P 76534c5775854ffb8239fb8bb2eead1b: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.008s
I20260709 12:59:58.146284  1293 consensus_queue.cc:260] T cf424ea418ec409fbe7d9bc3e959c695 P 28620b8df5964fb5bbbf51288ccbf9d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.149156  1294 tablet_bootstrap.cc:492] T 2b09c8c207814a50b328ea9a7de81a9d P 76534c5775854ffb8239fb8bb2eead1b: Bootstrap starting.
I20260709 12:59:58.150326  1293 ts_tablet_manager.cc:1434] T cf424ea418ec409fbe7d9bc3e959c695 P 28620b8df5964fb5bbbf51288ccbf9d7: Time spent starting tablet: real 0.013s	user 0.001s	sys 0.006s
I20260709 12:59:58.151721  1293 tablet_bootstrap.cc:492] T b6e533e49aba4111a0592ae2f0d6d5bb P 28620b8df5964fb5bbbf51288ccbf9d7: Bootstrap starting.
I20260709 12:59:58.158088  1294 tablet_bootstrap.cc:654] T 2b09c8c207814a50b328ea9a7de81a9d P 76534c5775854ffb8239fb8bb2eead1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:58.161110  1297 raft_consensus.cc:493] T 8a8ac1e3e54345718250fe8751bf234e P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.161794  1297 raft_consensus.cc:515] T 8a8ac1e3e54345718250fe8751bf234e P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.165201  1301 raft_consensus.cc:493] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.165851  1301 raft_consensus.cc:515] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.169158  1293 tablet_bootstrap.cc:654] T b6e533e49aba4111a0592ae2f0d6d5bb P 28620b8df5964fb5bbbf51288ccbf9d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:58.171051  1103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53045d37f99e45ff83484a205d25c159" candidate_uuid: "76534c5775854ffb8239fb8bb2eead1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" is_pre_election: true
I20260709 12:59:58.171962  1103 raft_consensus.cc:2468] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76534c5775854ffb8239fb8bb2eead1b in term 0.
I20260709 12:59:58.174260  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53045d37f99e45ff83484a205d25c159" candidate_uuid: "76534c5775854ffb8239fb8bb2eead1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" is_pre_election: true
I20260709 12:59:58.177202  1301 leader_election.cc:290] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193:41491), f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194:38543)
I20260709 12:59:58.176380  1217 leader_election.cc:304] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28620b8df5964fb5bbbf51288ccbf9d7, 76534c5775854ffb8239fb8bb2eead1b; no voters: 
W20260709 12:59:58.179297  1216 leader_election.cc:343] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194:38543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:58.183835  1252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8ac1e3e54345718250fe8751bf234e" candidate_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76534c5775854ffb8239fb8bb2eead1b" is_pre_election: true
I20260709 12:59:58.184580  1293 tablet_bootstrap.cc:492] T b6e533e49aba4111a0592ae2f0d6d5bb P 28620b8df5964fb5bbbf51288ccbf9d7: No bootstrap required, opened a new log
I20260709 12:59:58.185197  1293 ts_tablet_manager.cc:1403] T b6e533e49aba4111a0592ae2f0d6d5bb P 28620b8df5964fb5bbbf51288ccbf9d7: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.000s
W20260709 12:59:58.185962  1143 leader_election.cc:343] T 8a8ac1e3e54345718250fe8751bf234e P f98885ef63a44cd68a9a8e97a14e7cb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195:35987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:58.187276  1103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8ac1e3e54345718250fe8751bf234e" candidate_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" is_pre_election: true
I20260709 12:59:58.188766  1293 raft_consensus.cc:359] T b6e533e49aba4111a0592ae2f0d6d5bb P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } } peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } }
I20260709 12:59:58.189164  1301 raft_consensus.cc:2804] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:58.189791  1301 raft_consensus.cc:493] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:58.190300  1301 raft_consensus.cc:3060] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.194906  1297 leader_election.cc:290] T 8a8ac1e3e54345718250fe8751bf234e P f98885ef63a44cd68a9a8e97a14e7cb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193:41491), 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195:35987)
I20260709 12:59:58.198382  1297 raft_consensus.cc:493] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.199061  1297 raft_consensus.cc:515] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
W20260709 12:59:58.201488  1143 leader_election.cc:343] T 8a8ac1e3e54345718250fe8751bf234e P f98885ef63a44cd68a9a8e97a14e7cb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193:41491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:58.202142  1143 leader_election.cc:304] T 8a8ac1e3e54345718250fe8751bf234e P f98885ef63a44cd68a9a8e97a14e7cb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f98885ef63a44cd68a9a8e97a14e7cb4; no voters: 28620b8df5964fb5bbbf51288ccbf9d7, 76534c5775854ffb8239fb8bb2eead1b
I20260709 12:59:58.203881  1301 raft_consensus.cc:515] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.207930  1103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53045d37f99e45ff83484a205d25c159" candidate_uuid: "76534c5775854ffb8239fb8bb2eead1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7"
I20260709 12:59:58.210250  1293 raft_consensus.cc:385] T b6e533e49aba4111a0592ae2f0d6d5bb P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:58.210678  1293 raft_consensus.cc:740] T b6e533e49aba4111a0592ae2f0d6d5bb P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28620b8df5964fb5bbbf51288ccbf9d7, State: Initialized, Role: FOLLOWER
I20260709 12:59:58.213452  1301 leader_election.cc:290] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [CANDIDATE]: Term 1 election: Requested vote from peers 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193:41491), f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194:38543)
I20260709 12:59:58.214246  1301 raft_consensus.cc:493] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.214781  1301 raft_consensus.cc:515] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.215130  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53045d37f99e45ff83484a205d25c159" candidate_uuid: "76534c5775854ffb8239fb8bb2eead1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4"
I20260709 12:59:58.213200  1103 raft_consensus.cc:3060] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.218513  1102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf424ea418ec409fbe7d9bc3e959c695" candidate_uuid: "76534c5775854ffb8239fb8bb2eead1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" is_pre_election: true
I20260709 12:59:58.219429  1102 raft_consensus.cc:2468] T cf424ea418ec409fbe7d9bc3e959c695 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76534c5775854ffb8239fb8bb2eead1b in term 0.
I20260709 12:59:58.211611  1293 consensus_queue.cc:260] T b6e533e49aba4111a0592ae2f0d6d5bb P 28620b8df5964fb5bbbf51288ccbf9d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } } peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } }
I20260709 12:59:58.220094  1310 raft_consensus.cc:493] T c3a86df4dce7431ebc3dd76609005812 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.220677  1217 leader_election.cc:304] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28620b8df5964fb5bbbf51288ccbf9d7, 76534c5775854ffb8239fb8bb2eead1b; no voters: 
W20260709 12:59:58.217443  1216 leader_election.cc:343] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194:38543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:58.220541  1310 raft_consensus.cc:515] T c3a86df4dce7431ebc3dd76609005812 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.223374  1310 leader_election.cc:290] T c3a86df4dce7431ebc3dd76609005812 P 28620b8df5964fb5bbbf51288ccbf9d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194:38543), 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195:35987)
I20260709 12:59:58.223919  1293 ts_tablet_manager.cc:1434] T b6e533e49aba4111a0592ae2f0d6d5bb P 28620b8df5964fb5bbbf51288ccbf9d7: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.001s
I20260709 12:59:58.224810  1293 tablet_bootstrap.cc:492] T 8a8ac1e3e54345718250fe8751bf234e P 28620b8df5964fb5bbbf51288ccbf9d7: Bootstrap starting.
I20260709 12:59:58.224982  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3a86df4dce7431ebc3dd76609005812" candidate_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" is_pre_election: true
I20260709 12:59:58.225775  1178 raft_consensus.cc:2468] T c3a86df4dce7431ebc3dd76609005812 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28620b8df5964fb5bbbf51288ccbf9d7 in term 0.
I20260709 12:59:58.227242  1067 leader_election.cc:304] T c3a86df4dce7431ebc3dd76609005812 P 28620b8df5964fb5bbbf51288ccbf9d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28620b8df5964fb5bbbf51288ccbf9d7, f98885ef63a44cd68a9a8e97a14e7cb4; no voters: 
I20260709 12:59:58.228318  1310 raft_consensus.cc:2804] T c3a86df4dce7431ebc3dd76609005812 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:58.228796  1310 raft_consensus.cc:493] T c3a86df4dce7431ebc3dd76609005812 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:58.229249  1310 raft_consensus.cc:3060] T c3a86df4dce7431ebc3dd76609005812 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.232326  1177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf424ea418ec409fbe7d9bc3e959c695" candidate_uuid: "76534c5775854ffb8239fb8bb2eead1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" is_pre_election: true
I20260709 12:59:58.233166  1177 raft_consensus.cc:2468] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76534c5775854ffb8239fb8bb2eead1b in term 0.
I20260709 12:59:58.233610  1252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3a86df4dce7431ebc3dd76609005812" candidate_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76534c5775854ffb8239fb8bb2eead1b" is_pre_election: true
I20260709 12:59:58.234390  1252 raft_consensus.cc:2468] T c3a86df4dce7431ebc3dd76609005812 P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28620b8df5964fb5bbbf51288ccbf9d7 in term 0.
I20260709 12:59:58.235711  1301 leader_election.cc:290] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193:41491), f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194:38543)
I20260709 12:59:58.236613  1301 raft_consensus.cc:2804] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:58.237039  1301 raft_consensus.cc:493] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:58.237496  1301 raft_consensus.cc:3060] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.241716  1102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf424ea418ec409fbe7d9bc3e959c695" candidate_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" is_pre_election: true
I20260709 12:59:58.242542  1102 raft_consensus.cc:2468] T cf424ea418ec409fbe7d9bc3e959c695 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f98885ef63a44cd68a9a8e97a14e7cb4 in term 0.
I20260709 12:59:58.244128  1143 leader_election.cc:304] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28620b8df5964fb5bbbf51288ccbf9d7, f98885ef63a44cd68a9a8e97a14e7cb4; no voters: 
I20260709 12:59:58.247074  1293 tablet_bootstrap.cc:654] T 8a8ac1e3e54345718250fe8751bf234e P 28620b8df5964fb5bbbf51288ccbf9d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:58.250989  1310 raft_consensus.cc:515] T c3a86df4dce7431ebc3dd76609005812 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.241807  1297 leader_election.cc:290] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193:41491), 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195:35987)
I20260709 12:59:58.253983  1297 raft_consensus.cc:2749] T 8a8ac1e3e54345718250fe8751bf234e P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:58.254274  1335 raft_consensus.cc:2804] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:58.254806  1335 raft_consensus.cc:493] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:58.255208  1335 raft_consensus.cc:3060] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.259003  1252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf424ea418ec409fbe7d9bc3e959c695" candidate_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76534c5775854ffb8239fb8bb2eead1b" is_pre_election: true
I20260709 12:59:58.259428  1301 raft_consensus.cc:515] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.260715  1252 raft_consensus.cc:2393] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f98885ef63a44cd68a9a8e97a14e7cb4 in current term 1: Already voted for candidate 76534c5775854ffb8239fb8bb2eead1b in this term.
I20260709 12:59:58.262306  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3a86df4dce7431ebc3dd76609005812" candidate_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4"
I20260709 12:59:58.263059  1178 raft_consensus.cc:3060] T c3a86df4dce7431ebc3dd76609005812 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.270133  1310 leader_election.cc:290] T c3a86df4dce7431ebc3dd76609005812 P 28620b8df5964fb5bbbf51288ccbf9d7 [CANDIDATE]: Term 1 election: Requested vote from peers f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194:38543), 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195:35987)
I20260709 12:59:58.274019  1252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3a86df4dce7431ebc3dd76609005812" candidate_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76534c5775854ffb8239fb8bb2eead1b"
I20260709 12:59:58.274022  1103 raft_consensus.cc:2468] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76534c5775854ffb8239fb8bb2eead1b in term 1.
I20260709 12:59:58.274892  1252 raft_consensus.cc:3060] T c3a86df4dce7431ebc3dd76609005812 P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.275949  1217 leader_election.cc:304] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 28620b8df5964fb5bbbf51288ccbf9d7, 76534c5775854ffb8239fb8bb2eead1b; no voters: f98885ef63a44cd68a9a8e97a14e7cb4
I20260709 12:59:58.276541  1335 raft_consensus.cc:515] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.277208  1334 raft_consensus.cc:2804] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:58.284582  1301 leader_election.cc:290] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b [CANDIDATE]: Term 1 election: Requested vote from peers 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193:41491), f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194:38543)
I20260709 12:59:58.285367  1103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf424ea418ec409fbe7d9bc3e959c695" candidate_uuid: "76534c5775854ffb8239fb8bb2eead1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7"
I20260709 12:59:58.286410  1252 raft_consensus.cc:2468] T c3a86df4dce7431ebc3dd76609005812 P 76534c5775854ffb8239fb8bb2eead1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28620b8df5964fb5bbbf51288ccbf9d7 in term 1.
I20260709 12:59:58.286576  1177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf424ea418ec409fbe7d9bc3e959c695" candidate_uuid: "76534c5775854ffb8239fb8bb2eead1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4"
I20260709 12:59:58.287492  1177 raft_consensus.cc:2393] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 76534c5775854ffb8239fb8bb2eead1b in current term 1: Already voted for candidate f98885ef63a44cd68a9a8e97a14e7cb4 in this term.
I20260709 12:59:58.287504  1103 raft_consensus.cc:3060] T cf424ea418ec409fbe7d9bc3e959c695 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.287819  1068 leader_election.cc:304] T c3a86df4dce7431ebc3dd76609005812 P 28620b8df5964fb5bbbf51288ccbf9d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28620b8df5964fb5bbbf51288ccbf9d7, 76534c5775854ffb8239fb8bb2eead1b; no voters: 
I20260709 12:59:58.292052  1310 raft_consensus.cc:2804] T c3a86df4dce7431ebc3dd76609005812 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:58.292531  1310 raft_consensus.cc:697] T c3a86df4dce7431ebc3dd76609005812 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 LEADER]: Becoming Leader. State: Replica: 28620b8df5964fb5bbbf51288ccbf9d7, State: Running, Role: LEADER
I20260709 12:59:58.293015  1292 ts_tablet_manager.cc:1434] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4: Time spent starting tablet: real 0.161s	user 0.030s	sys 0.036s
I20260709 12:59:58.293354  1310 consensus_queue.cc:237] T c3a86df4dce7431ebc3dd76609005812 P 28620b8df5964fb5bbbf51288ccbf9d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.294286  1292 tablet_bootstrap.cc:492] T 53045d37f99e45ff83484a205d25c159 P f98885ef63a44cd68a9a8e97a14e7cb4: Bootstrap starting.
I20260709 12:59:58.297745  1294 tablet_bootstrap.cc:492] T 2b09c8c207814a50b328ea9a7de81a9d P 76534c5775854ffb8239fb8bb2eead1b: No bootstrap required, opened a new log
I20260709 12:59:58.298291  1294 ts_tablet_manager.cc:1403] T 2b09c8c207814a50b328ea9a7de81a9d P 76534c5775854ffb8239fb8bb2eead1b: Time spent bootstrapping tablet: real 0.149s	user 0.052s	sys 0.068s
I20260709 12:59:58.286165  1178 raft_consensus.cc:2468] T c3a86df4dce7431ebc3dd76609005812 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28620b8df5964fb5bbbf51288ccbf9d7 in term 1.
I20260709 12:59:58.298525  1103 raft_consensus.cc:2468] T cf424ea418ec409fbe7d9bc3e959c695 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76534c5775854ffb8239fb8bb2eead1b in term 1.
I20260709 12:59:58.304229  1217 leader_election.cc:304] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 28620b8df5964fb5bbbf51288ccbf9d7, 76534c5775854ffb8239fb8bb2eead1b; no voters: f98885ef63a44cd68a9a8e97a14e7cb4
I20260709 12:59:58.305349  1301 raft_consensus.cc:2804] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:58.305745  1301 raft_consensus.cc:697] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b [term 1 LEADER]: Becoming Leader. State: Replica: 76534c5775854ffb8239fb8bb2eead1b, State: Running, Role: LEADER
I20260709 12:59:58.308424  1301 consensus_queue.cc:237] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.316020  1292 tablet_bootstrap.cc:654] T 53045d37f99e45ff83484a205d25c159 P f98885ef63a44cd68a9a8e97a14e7cb4: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:58.318720  1103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf424ea418ec409fbe7d9bc3e959c695" candidate_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7"
I20260709 12:59:58.319681  1103 raft_consensus.cc:2393] T cf424ea418ec409fbe7d9bc3e959c695 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f98885ef63a44cd68a9a8e97a14e7cb4 in current term 1: Already voted for candidate 76534c5775854ffb8239fb8bb2eead1b in this term.
I20260709 12:59:58.318367  1294 raft_consensus.cc:359] T 2b09c8c207814a50b328ea9a7de81a9d P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.320793  1252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf424ea418ec409fbe7d9bc3e959c695" candidate_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76534c5775854ffb8239fb8bb2eead1b"
I20260709 12:59:58.321233  1293 tablet_bootstrap.cc:492] T 8a8ac1e3e54345718250fe8751bf234e P 28620b8df5964fb5bbbf51288ccbf9d7: No bootstrap required, opened a new log
I20260709 12:59:58.320758  1294 raft_consensus.cc:385] T 2b09c8c207814a50b328ea9a7de81a9d P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:58.321995  1143 leader_election.cc:304] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f98885ef63a44cd68a9a8e97a14e7cb4; no voters: 28620b8df5964fb5bbbf51288ccbf9d7, 76534c5775854ffb8239fb8bb2eead1b
I20260709 12:59:58.321663  1293 ts_tablet_manager.cc:1403] T 8a8ac1e3e54345718250fe8751bf234e P 28620b8df5964fb5bbbf51288ccbf9d7: Time spent bootstrapping tablet: real 0.097s	user 0.010s	sys 0.018s
I20260709 12:59:58.322290  1294 raft_consensus.cc:740] T 2b09c8c207814a50b328ea9a7de81a9d P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76534c5775854ffb8239fb8bb2eead1b, State: Initialized, Role: FOLLOWER
I20260709 12:59:58.315701  1335 leader_election.cc:290] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4 [CANDIDATE]: Term 1 election: Requested vote from peers 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193:41491), 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195:35987)
I20260709 12:59:58.324172  1330 raft_consensus.cc:2749] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:59:58.326278  1334 raft_consensus.cc:697] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [term 1 LEADER]: Becoming Leader. State: Replica: 76534c5775854ffb8239fb8bb2eead1b, State: Running, Role: LEADER
I20260709 12:59:58.328217  1334 consensus_queue.cc:237] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.325764  1294 consensus_queue.cc:260] T 2b09c8c207814a50b328ea9a7de81a9d P 76534c5775854ffb8239fb8bb2eead1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.336514  1293 raft_consensus.cc:359] T 8a8ac1e3e54345718250fe8751bf234e P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.337450  1293 raft_consensus.cc:385] T 8a8ac1e3e54345718250fe8751bf234e P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:58.337808  1293 raft_consensus.cc:740] T 8a8ac1e3e54345718250fe8751bf234e P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28620b8df5964fb5bbbf51288ccbf9d7, State: Initialized, Role: FOLLOWER
I20260709 12:59:58.338671  1293 consensus_queue.cc:260] T 8a8ac1e3e54345718250fe8751bf234e P 28620b8df5964fb5bbbf51288ccbf9d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.332541  1335 raft_consensus.cc:493] T 766aee4cd0ad4ca99e88106b9ee44bfd P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.341779  1294 ts_tablet_manager.cc:1434] T 2b09c8c207814a50b328ea9a7de81a9d P 76534c5775854ffb8239fb8bb2eead1b: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.003s
I20260709 12:59:58.341506  1335 raft_consensus.cc:515] T 766aee4cd0ad4ca99e88106b9ee44bfd P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.343109  1294 tablet_bootstrap.cc:492] T 21562582b0a44dadbbadc702fd6b7b1b P 76534c5775854ffb8239fb8bb2eead1b: Bootstrap starting.
I20260709 12:59:58.344147  1335 leader_election.cc:290] T 766aee4cd0ad4ca99e88106b9ee44bfd P f98885ef63a44cd68a9a8e97a14e7cb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193:41491), 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195:35987)
I20260709 12:59:58.348134  1103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766aee4cd0ad4ca99e88106b9ee44bfd" candidate_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" is_pre_election: true
W20260709 12:59:58.349617  1143 leader_election.cc:343] T 766aee4cd0ad4ca99e88106b9ee44bfd P f98885ef63a44cd68a9a8e97a14e7cb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193:41491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:58.351097  1294 tablet_bootstrap.cc:654] T 21562582b0a44dadbbadc702fd6b7b1b P 76534c5775854ffb8239fb8bb2eead1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:58.354379  1293 ts_tablet_manager.cc:1434] T 8a8ac1e3e54345718250fe8751bf234e P 28620b8df5964fb5bbbf51288ccbf9d7: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 12:59:58.355962  1293 tablet_bootstrap.cc:492] T 766aee4cd0ad4ca99e88106b9ee44bfd P 28620b8df5964fb5bbbf51288ccbf9d7: Bootstrap starting.
I20260709 12:59:58.361527  1252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766aee4cd0ad4ca99e88106b9ee44bfd" candidate_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76534c5775854ffb8239fb8bb2eead1b" is_pre_election: true
I20260709 12:59:58.361851  1293 tablet_bootstrap.cc:654] T 766aee4cd0ad4ca99e88106b9ee44bfd P 28620b8df5964fb5bbbf51288ccbf9d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:58.362185  1252 raft_consensus.cc:2468] T 766aee4cd0ad4ca99e88106b9ee44bfd P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f98885ef63a44cd68a9a8e97a14e7cb4 in term 0.
I20260709 12:59:58.363704  1143 leader_election.cc:304] T 766aee4cd0ad4ca99e88106b9ee44bfd P f98885ef63a44cd68a9a8e97a14e7cb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 76534c5775854ffb8239fb8bb2eead1b, f98885ef63a44cd68a9a8e97a14e7cb4; no voters: 28620b8df5964fb5bbbf51288ccbf9d7
I20260709 12:59:58.364910  1335 raft_consensus.cc:2804] T 766aee4cd0ad4ca99e88106b9ee44bfd P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:58.365306  1335 raft_consensus.cc:493] T 766aee4cd0ad4ca99e88106b9ee44bfd P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:58.365645  1335 raft_consensus.cc:3060] T 766aee4cd0ad4ca99e88106b9ee44bfd P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.360010  1001 catalog_manager.cc:5697] T 43365da3ffe345aa939dacc83fca01e2 P 28620b8df5964fb5bbbf51288ccbf9d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:58.370214  1001 catalog_manager.cc:5697] T c3a86df4dce7431ebc3dd76609005812 P 28620b8df5964fb5bbbf51288ccbf9d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:58.370918  1335 raft_consensus.cc:515] T 766aee4cd0ad4ca99e88106b9ee44bfd P f98885ef63a44cd68a9a8e97a14e7cb4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.374439  1103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766aee4cd0ad4ca99e88106b9ee44bfd" candidate_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7"
I20260709 12:59:58.377722  1292 tablet_bootstrap.cc:492] T 53045d37f99e45ff83484a205d25c159 P f98885ef63a44cd68a9a8e97a14e7cb4: No bootstrap required, opened a new log
W20260709 12:59:58.377924  1143 leader_election.cc:343] T 766aee4cd0ad4ca99e88106b9ee44bfd P f98885ef63a44cd68a9a8e97a14e7cb4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193:41491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:58.378325  1292 ts_tablet_manager.cc:1403] T 53045d37f99e45ff83484a205d25c159 P f98885ef63a44cd68a9a8e97a14e7cb4: Time spent bootstrapping tablet: real 0.084s	user 0.023s	sys 0.032s
I20260709 12:59:58.380190  1252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766aee4cd0ad4ca99e88106b9ee44bfd" candidate_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76534c5775854ffb8239fb8bb2eead1b"
I20260709 12:59:58.380750  1252 raft_consensus.cc:3060] T 766aee4cd0ad4ca99e88106b9ee44bfd P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.381588  1292 raft_consensus.cc:359] T 53045d37f99e45ff83484a205d25c159 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.382362  1292 raft_consensus.cc:385] T 53045d37f99e45ff83484a205d25c159 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:58.382697  1292 raft_consensus.cc:740] T 53045d37f99e45ff83484a205d25c159 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f98885ef63a44cd68a9a8e97a14e7cb4, State: Initialized, Role: FOLLOWER
I20260709 12:59:58.383553  1292 consensus_queue.cc:260] T 53045d37f99e45ff83484a205d25c159 P f98885ef63a44cd68a9a8e97a14e7cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.385763  1292 ts_tablet_manager.cc:1434] T 53045d37f99e45ff83484a205d25c159 P f98885ef63a44cd68a9a8e97a14e7cb4: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:59:58.386932  1292 tablet_bootstrap.cc:492] T 2b09c8c207814a50b328ea9a7de81a9d P f98885ef63a44cd68a9a8e97a14e7cb4: Bootstrap starting.
I20260709 12:59:58.392216  1292 tablet_bootstrap.cc:654] T 2b09c8c207814a50b328ea9a7de81a9d P f98885ef63a44cd68a9a8e97a14e7cb4: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:58.393821  1252 raft_consensus.cc:2468] T 766aee4cd0ad4ca99e88106b9ee44bfd P 76534c5775854ffb8239fb8bb2eead1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f98885ef63a44cd68a9a8e97a14e7cb4 in term 1.
I20260709 12:59:58.394572  1293 tablet_bootstrap.cc:492] T 766aee4cd0ad4ca99e88106b9ee44bfd P 28620b8df5964fb5bbbf51288ccbf9d7: No bootstrap required, opened a new log
I20260709 12:59:58.386122  1335 leader_election.cc:290] T 766aee4cd0ad4ca99e88106b9ee44bfd P f98885ef63a44cd68a9a8e97a14e7cb4 [CANDIDATE]: Term 1 election: Requested vote from peers 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193:41491), 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195:35987)
I20260709 12:59:58.395076  1293 ts_tablet_manager.cc:1403] T 766aee4cd0ad4ca99e88106b9ee44bfd P 28620b8df5964fb5bbbf51288ccbf9d7: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.001s
I20260709 12:59:58.397235  1294 tablet_bootstrap.cc:492] T 21562582b0a44dadbbadc702fd6b7b1b P 76534c5775854ffb8239fb8bb2eead1b: No bootstrap required, opened a new log
I20260709 12:59:58.397689  1294 ts_tablet_manager.cc:1403] T 21562582b0a44dadbbadc702fd6b7b1b P 76534c5775854ffb8239fb8bb2eead1b: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.002s
I20260709 12:59:58.398608  1293 raft_consensus.cc:359] T 766aee4cd0ad4ca99e88106b9ee44bfd P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.399246  1293 raft_consensus.cc:385] T 766aee4cd0ad4ca99e88106b9ee44bfd P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:58.399490  1293 raft_consensus.cc:740] T 766aee4cd0ad4ca99e88106b9ee44bfd P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28620b8df5964fb5bbbf51288ccbf9d7, State: Initialized, Role: FOLLOWER
I20260709 12:59:58.400385  1293 consensus_queue.cc:260] T 766aee4cd0ad4ca99e88106b9ee44bfd P 28620b8df5964fb5bbbf51288ccbf9d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.400924  1294 raft_consensus.cc:359] T 21562582b0a44dadbbadc702fd6b7b1b P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.401739  1294 raft_consensus.cc:385] T 21562582b0a44dadbbadc702fd6b7b1b P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:58.402063  1294 raft_consensus.cc:740] T 21562582b0a44dadbbadc702fd6b7b1b P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76534c5775854ffb8239fb8bb2eead1b, State: Initialized, Role: FOLLOWER
I20260709 12:59:58.402829  1294 consensus_queue.cc:260] T 21562582b0a44dadbbadc702fd6b7b1b P 76534c5775854ffb8239fb8bb2eead1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.403579  1293 ts_tablet_manager.cc:1434] T 766aee4cd0ad4ca99e88106b9ee44bfd P 28620b8df5964fb5bbbf51288ccbf9d7: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:59:58.405428  1294 ts_tablet_manager.cc:1434] T 21562582b0a44dadbbadc702fd6b7b1b P 76534c5775854ffb8239fb8bb2eead1b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:59:58.406423  1294 tablet_bootstrap.cc:492] T 43365da3ffe345aa939dacc83fca01e2 P 76534c5775854ffb8239fb8bb2eead1b: Bootstrap starting.
I20260709 12:59:58.406668  1000 catalog_manager.cc:5697] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "76534c5775854ffb8239fb8bb2eead1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:58.409953  1143 leader_election.cc:304] T 766aee4cd0ad4ca99e88106b9ee44bfd P f98885ef63a44cd68a9a8e97a14e7cb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 76534c5775854ffb8239fb8bb2eead1b, f98885ef63a44cd68a9a8e97a14e7cb4; no voters: 28620b8df5964fb5bbbf51288ccbf9d7
I20260709 12:59:58.412217  1335 raft_consensus.cc:2804] T 766aee4cd0ad4ca99e88106b9ee44bfd P f98885ef63a44cd68a9a8e97a14e7cb4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:58.412781  1335 raft_consensus.cc:697] T 766aee4cd0ad4ca99e88106b9ee44bfd P f98885ef63a44cd68a9a8e97a14e7cb4 [term 1 LEADER]: Becoming Leader. State: Replica: f98885ef63a44cd68a9a8e97a14e7cb4, State: Running, Role: LEADER
I20260709 12:59:58.413604  1335 consensus_queue.cc:237] T 766aee4cd0ad4ca99e88106b9ee44bfd P f98885ef63a44cd68a9a8e97a14e7cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.415746  1292 tablet_bootstrap.cc:492] T 2b09c8c207814a50b328ea9a7de81a9d P f98885ef63a44cd68a9a8e97a14e7cb4: No bootstrap required, opened a new log
I20260709 12:59:58.416150  1292 ts_tablet_manager.cc:1403] T 2b09c8c207814a50b328ea9a7de81a9d P f98885ef63a44cd68a9a8e97a14e7cb4: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.017s
I20260709 12:59:58.418915  1292 raft_consensus.cc:359] T 2b09c8c207814a50b328ea9a7de81a9d P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.419440  1292 raft_consensus.cc:385] T 2b09c8c207814a50b328ea9a7de81a9d P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:58.419147  1294 tablet_bootstrap.cc:654] T 43365da3ffe345aa939dacc83fca01e2 P 76534c5775854ffb8239fb8bb2eead1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:58.419685  1292 raft_consensus.cc:740] T 2b09c8c207814a50b328ea9a7de81a9d P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f98885ef63a44cd68a9a8e97a14e7cb4, State: Initialized, Role: FOLLOWER
I20260709 12:59:58.420300  1292 consensus_queue.cc:260] T 2b09c8c207814a50b328ea9a7de81a9d P f98885ef63a44cd68a9a8e97a14e7cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.422228  1292 ts_tablet_manager.cc:1434] T 2b09c8c207814a50b328ea9a7de81a9d P f98885ef63a44cd68a9a8e97a14e7cb4: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:59:58.423090  1292 tablet_bootstrap.cc:492] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4: Bootstrap starting.
I20260709 12:59:58.429982  1292 tablet_bootstrap.cc:654] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:58.429177   999 catalog_manager.cc:5697] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "76534c5775854ffb8239fb8bb2eead1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:58.431488  1294 tablet_bootstrap.cc:492] T 43365da3ffe345aa939dacc83fca01e2 P 76534c5775854ffb8239fb8bb2eead1b: No bootstrap required, opened a new log
I20260709 12:59:58.432147  1294 ts_tablet_manager.cc:1403] T 43365da3ffe345aa939dacc83fca01e2 P 76534c5775854ffb8239fb8bb2eead1b: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.007s
I20260709 12:59:58.432394  1310 raft_consensus.cc:493] T 2b09c8c207814a50b328ea9a7de81a9d P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.433377  1335 raft_consensus.cc:493] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.432982  1310 raft_consensus.cc:515] T 2b09c8c207814a50b328ea9a7de81a9d P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.434245  1335 raft_consensus.cc:515] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.435952  1310 leader_election.cc:290] T 2b09c8c207814a50b328ea9a7de81a9d P 28620b8df5964fb5bbbf51288ccbf9d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194:38543), 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195:35987)
I20260709 12:59:58.436158  1335 leader_election.cc:290] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193:41491), 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195:35987)
I20260709 12:59:58.436561  1294 raft_consensus.cc:359] T 43365da3ffe345aa939dacc83fca01e2 P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.437598  1294 raft_consensus.cc:385] T 43365da3ffe345aa939dacc83fca01e2 P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:58.438007  1294 raft_consensus.cc:740] T 43365da3ffe345aa939dacc83fca01e2 P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76534c5775854ffb8239fb8bb2eead1b, State: Initialized, Role: FOLLOWER
I20260709 12:59:58.438071  1252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562582b0a44dadbbadc702fd6b7b1b" candidate_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76534c5775854ffb8239fb8bb2eead1b" is_pre_election: true
I20260709 12:59:58.438767  1252 raft_consensus.cc:2468] T 21562582b0a44dadbbadc702fd6b7b1b P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f98885ef63a44cd68a9a8e97a14e7cb4 in term 0.
I20260709 12:59:58.438886  1103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562582b0a44dadbbadc702fd6b7b1b" candidate_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" is_pre_election: true
I20260709 12:59:58.439532  1103 raft_consensus.cc:2468] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f98885ef63a44cd68a9a8e97a14e7cb4 in term 0.
I20260709 12:59:58.439049  1294 consensus_queue.cc:260] T 43365da3ffe345aa939dacc83fca01e2 P 76534c5775854ffb8239fb8bb2eead1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.440057  1143 leader_election.cc:304] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76534c5775854ffb8239fb8bb2eead1b, f98885ef63a44cd68a9a8e97a14e7cb4; no voters: 
I20260709 12:59:58.440517  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b09c8c207814a50b328ea9a7de81a9d" candidate_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" is_pre_election: true
I20260709 12:59:58.441174  1335 raft_consensus.cc:2804] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:58.441562  1335 raft_consensus.cc:493] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:58.441438  1251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b09c8c207814a50b328ea9a7de81a9d" candidate_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76534c5775854ffb8239fb8bb2eead1b" is_pre_election: true
I20260709 12:59:58.442507  1294 ts_tablet_manager.cc:1434] T 43365da3ffe345aa939dacc83fca01e2 P 76534c5775854ffb8239fb8bb2eead1b: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.003s
I20260709 12:59:58.442373  1178 raft_consensus.cc:2468] T 2b09c8c207814a50b328ea9a7de81a9d P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28620b8df5964fb5bbbf51288ccbf9d7 in term 0.
I20260709 12:59:58.443166  1251 raft_consensus.cc:2468] T 2b09c8c207814a50b328ea9a7de81a9d P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28620b8df5964fb5bbbf51288ccbf9d7 in term 0.
I20260709 12:59:58.443992  1294 tablet_bootstrap.cc:492] T b6e533e49aba4111a0592ae2f0d6d5bb P 76534c5775854ffb8239fb8bb2eead1b: Bootstrap starting.
I20260709 12:59:58.441931  1335 raft_consensus.cc:3060] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.444324  1067 leader_election.cc:304] T 2b09c8c207814a50b328ea9a7de81a9d P 28620b8df5964fb5bbbf51288ccbf9d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28620b8df5964fb5bbbf51288ccbf9d7, f98885ef63a44cd68a9a8e97a14e7cb4; no voters: 
I20260709 12:59:58.445688  1310 raft_consensus.cc:2804] T 2b09c8c207814a50b328ea9a7de81a9d P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:58.446043  1310 raft_consensus.cc:493] T 2b09c8c207814a50b328ea9a7de81a9d P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:58.446379  1310 raft_consensus.cc:3060] T 2b09c8c207814a50b328ea9a7de81a9d P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.452296  1294 tablet_bootstrap.cc:654] T b6e533e49aba4111a0592ae2f0d6d5bb P 76534c5775854ffb8239fb8bb2eead1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:58.456943  1334 raft_consensus.cc:493] T 43365da3ffe345aa939dacc83fca01e2 P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.457656  1334 raft_consensus.cc:515] T 43365da3ffe345aa939dacc83fca01e2 P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.459699  1292 tablet_bootstrap.cc:492] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4: No bootstrap required, opened a new log
I20260709 12:59:58.460186  1292 ts_tablet_manager.cc:1403] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4: Time spent bootstrapping tablet: real 0.037s	user 0.019s	sys 0.015s
I20260709 12:59:58.461619  1103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43365da3ffe345aa939dacc83fca01e2" candidate_uuid: "76534c5775854ffb8239fb8bb2eead1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" is_pre_election: true
I20260709 12:59:58.463214  1292 raft_consensus.cc:359] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.463902  1292 raft_consensus.cc:385] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:58.464186  1292 raft_consensus.cc:740] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f98885ef63a44cd68a9a8e97a14e7cb4, State: Initialized, Role: FOLLOWER
I20260709 12:59:58.465054  1292 consensus_queue.cc:260] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.465444  1334 leader_election.cc:290] T 43365da3ffe345aa939dacc83fca01e2 P 76534c5775854ffb8239fb8bb2eead1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193:41491), f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194:38543)
I20260709 12:59:58.465667  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43365da3ffe345aa939dacc83fca01e2" candidate_uuid: "76534c5775854ffb8239fb8bb2eead1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" is_pre_election: true
I20260709 12:59:58.466388  1178 raft_consensus.cc:2393] T 43365da3ffe345aa939dacc83fca01e2 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 76534c5775854ffb8239fb8bb2eead1b in current term 1: Already voted for candidate 28620b8df5964fb5bbbf51288ccbf9d7 in this term.
I20260709 12:59:58.467272  1292 ts_tablet_manager.cc:1434] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:59:58.467536  1216 leader_election.cc:304] T 43365da3ffe345aa939dacc83fca01e2 P 76534c5775854ffb8239fb8bb2eead1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76534c5775854ffb8239fb8bb2eead1b; no voters: 28620b8df5964fb5bbbf51288ccbf9d7, f98885ef63a44cd68a9a8e97a14e7cb4
I20260709 12:59:58.467705  1335 raft_consensus.cc:515] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.468680  1334 raft_consensus.cc:3060] T 43365da3ffe345aa939dacc83fca01e2 P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.470651  1103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562582b0a44dadbbadc702fd6b7b1b" candidate_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7"
I20260709 12:59:58.471328  1103 raft_consensus.cc:3060] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.473855  1310 raft_consensus.cc:515] T 2b09c8c207814a50b328ea9a7de81a9d P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.474222  1000 catalog_manager.cc:5697] T 766aee4cd0ad4ca99e88106b9ee44bfd P f98885ef63a44cd68a9a8e97a14e7cb4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:58.476624  1310 leader_election.cc:290] T 2b09c8c207814a50b328ea9a7de81a9d P 28620b8df5964fb5bbbf51288ccbf9d7 [CANDIDATE]: Term 1 election: Requested vote from peers f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194:38543), 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195:35987)
I20260709 12:59:58.476725  1334 raft_consensus.cc:2749] T 43365da3ffe345aa939dacc83fca01e2 P 76534c5775854ffb8239fb8bb2eead1b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:58.477533  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b09c8c207814a50b328ea9a7de81a9d" candidate_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4"
I20260709 12:59:58.477845  1251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b09c8c207814a50b328ea9a7de81a9d" candidate_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76534c5775854ffb8239fb8bb2eead1b"
I20260709 12:59:58.478238  1178 raft_consensus.cc:3060] T 2b09c8c207814a50b328ea9a7de81a9d P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.478559  1251 raft_consensus.cc:3060] T 2b09c8c207814a50b328ea9a7de81a9d P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.480343  1294 tablet_bootstrap.cc:492] T b6e533e49aba4111a0592ae2f0d6d5bb P 76534c5775854ffb8239fb8bb2eead1b: No bootstrap required, opened a new log
I20260709 12:59:58.480826  1294 ts_tablet_manager.cc:1403] T b6e533e49aba4111a0592ae2f0d6d5bb P 76534c5775854ffb8239fb8bb2eead1b: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.010s
I20260709 12:59:58.483629  1294 raft_consensus.cc:359] T b6e533e49aba4111a0592ae2f0d6d5bb P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } } peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } }
I20260709 12:59:58.484278  1294 raft_consensus.cc:385] T b6e533e49aba4111a0592ae2f0d6d5bb P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:58.484545  1294 raft_consensus.cc:740] T b6e533e49aba4111a0592ae2f0d6d5bb P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76534c5775854ffb8239fb8bb2eead1b, State: Initialized, Role: FOLLOWER
I20260709 12:59:58.485320  1294 consensus_queue.cc:260] T b6e533e49aba4111a0592ae2f0d6d5bb P 76534c5775854ffb8239fb8bb2eead1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } } peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } }
I20260709 12:59:58.487483  1294 ts_tablet_manager.cc:1434] T b6e533e49aba4111a0592ae2f0d6d5bb P 76534c5775854ffb8239fb8bb2eead1b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:59:58.488389  1294 tablet_bootstrap.cc:492] T 8a8ac1e3e54345718250fe8751bf234e P 76534c5775854ffb8239fb8bb2eead1b: Bootstrap starting.
I20260709 12:59:58.490083  1251 raft_consensus.cc:2468] T 2b09c8c207814a50b328ea9a7de81a9d P 76534c5775854ffb8239fb8bb2eead1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28620b8df5964fb5bbbf51288ccbf9d7 in term 1.
I20260709 12:59:58.492559  1068 leader_election.cc:304] T 2b09c8c207814a50b328ea9a7de81a9d P 28620b8df5964fb5bbbf51288ccbf9d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28620b8df5964fb5bbbf51288ccbf9d7, 76534c5775854ffb8239fb8bb2eead1b; no voters: 
I20260709 12:59:58.493440  1310 raft_consensus.cc:2804] T 2b09c8c207814a50b328ea9a7de81a9d P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:58.494182  1310 raft_consensus.cc:697] T 2b09c8c207814a50b328ea9a7de81a9d P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 LEADER]: Becoming Leader. State: Replica: 28620b8df5964fb5bbbf51288ccbf9d7, State: Running, Role: LEADER
I20260709 12:59:58.495153  1310 consensus_queue.cc:237] T 2b09c8c207814a50b328ea9a7de81a9d P 28620b8df5964fb5bbbf51288ccbf9d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.496027  1178 raft_consensus.cc:2468] T 2b09c8c207814a50b328ea9a7de81a9d P f98885ef63a44cd68a9a8e97a14e7cb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28620b8df5964fb5bbbf51288ccbf9d7 in term 1.
I20260709 12:59:58.496083  1251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562582b0a44dadbbadc702fd6b7b1b" candidate_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76534c5775854ffb8239fb8bb2eead1b"
I20260709 12:59:58.494249  1335 leader_election.cc:290] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4 [CANDIDATE]: Term 1 election: Requested vote from peers 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193:41491), 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195:35987)
I20260709 12:59:58.498140  1251 raft_consensus.cc:3060] T 21562582b0a44dadbbadc702fd6b7b1b P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.499845  1103 raft_consensus.cc:2468] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f98885ef63a44cd68a9a8e97a14e7cb4 in term 1.
I20260709 12:59:58.500497  1294 tablet_bootstrap.cc:654] T 8a8ac1e3e54345718250fe8751bf234e P 76534c5775854ffb8239fb8bb2eead1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:58.501143  1143 leader_election.cc:304] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28620b8df5964fb5bbbf51288ccbf9d7, f98885ef63a44cd68a9a8e97a14e7cb4; no voters: 
I20260709 12:59:58.502116  1335 raft_consensus.cc:2804] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:58.503561  1335 raft_consensus.cc:697] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4 [term 1 LEADER]: Becoming Leader. State: Replica: f98885ef63a44cd68a9a8e97a14e7cb4, State: Running, Role: LEADER
I20260709 12:59:58.504503  1335 consensus_queue.cc:237] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.508502  1330 raft_consensus.cc:493] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.509227  1330 raft_consensus.cc:515] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.509020   999 catalog_manager.cc:5697] T 2b09c8c207814a50b328ea9a7de81a9d P 28620b8df5964fb5bbbf51288ccbf9d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:58.515027  1252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ca940a7b53463bb839e388285596f5" candidate_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76534c5775854ffb8239fb8bb2eead1b" is_pre_election: true
I20260709 12:59:58.515820  1252 raft_consensus.cc:2393] T 34ca940a7b53463bb839e388285596f5 P 76534c5775854ffb8239fb8bb2eead1b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f98885ef63a44cd68a9a8e97a14e7cb4 in current term 1: Already voted for candidate 28620b8df5964fb5bbbf51288ccbf9d7 in this term.
I20260709 12:59:58.512678  1330 leader_election.cc:290] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193:41491), 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195:35987)
I20260709 12:59:58.518640  1103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ca940a7b53463bb839e388285596f5" candidate_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" is_pre_election: true
I20260709 12:59:58.520490  1143 leader_election.cc:304] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f98885ef63a44cd68a9a8e97a14e7cb4; no voters: 28620b8df5964fb5bbbf51288ccbf9d7, 76534c5775854ffb8239fb8bb2eead1b
I20260709 12:59:58.521881  1330 raft_consensus.cc:3060] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.512938  1251 raft_consensus.cc:2468] T 21562582b0a44dadbbadc702fd6b7b1b P 76534c5775854ffb8239fb8bb2eead1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f98885ef63a44cd68a9a8e97a14e7cb4 in term 1.
I20260709 12:59:58.525183  1294 tablet_bootstrap.cc:492] T 8a8ac1e3e54345718250fe8751bf234e P 76534c5775854ffb8239fb8bb2eead1b: No bootstrap required, opened a new log
I20260709 12:59:58.525640  1294 ts_tablet_manager.cc:1403] T 8a8ac1e3e54345718250fe8751bf234e P 76534c5775854ffb8239fb8bb2eead1b: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.014s
I20260709 12:59:58.526262  1000 catalog_manager.cc:5697] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:58.528043  1294 raft_consensus.cc:359] T 8a8ac1e3e54345718250fe8751bf234e P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.528693  1294 raft_consensus.cc:385] T 8a8ac1e3e54345718250fe8751bf234e P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:58.528962  1294 raft_consensus.cc:740] T 8a8ac1e3e54345718250fe8751bf234e P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76534c5775854ffb8239fb8bb2eead1b, State: Initialized, Role: FOLLOWER
I20260709 12:59:58.529235  1330 raft_consensus.cc:2749] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:58.529629  1294 consensus_queue.cc:260] T 8a8ac1e3e54345718250fe8751bf234e P 76534c5775854ffb8239fb8bb2eead1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.531533  1294 ts_tablet_manager.cc:1434] T 8a8ac1e3e54345718250fe8751bf234e P 76534c5775854ffb8239fb8bb2eead1b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:59:58.538887  1334 raft_consensus.cc:493] T 8a8ac1e3e54345718250fe8751bf234e P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.539387  1334 raft_consensus.cc:515] T 8a8ac1e3e54345718250fe8751bf234e P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.541601  1334 leader_election.cc:290] T 8a8ac1e3e54345718250fe8751bf234e P 76534c5775854ffb8239fb8bb2eead1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193:41491), f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194:38543)
I20260709 12:59:58.542338  1103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8ac1e3e54345718250fe8751bf234e" candidate_uuid: "76534c5775854ffb8239fb8bb2eead1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" is_pre_election: true
I20260709 12:59:58.542594  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8ac1e3e54345718250fe8751bf234e" candidate_uuid: "76534c5775854ffb8239fb8bb2eead1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" is_pre_election: true
I20260709 12:59:58.542964  1103 raft_consensus.cc:2468] T 8a8ac1e3e54345718250fe8751bf234e P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76534c5775854ffb8239fb8bb2eead1b in term 0.
I20260709 12:59:58.543236  1178 raft_consensus.cc:2468] T 8a8ac1e3e54345718250fe8751bf234e P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76534c5775854ffb8239fb8bb2eead1b in term 0.
I20260709 12:59:58.543934  1217 leader_election.cc:304] T 8a8ac1e3e54345718250fe8751bf234e P 76534c5775854ffb8239fb8bb2eead1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28620b8df5964fb5bbbf51288ccbf9d7, 76534c5775854ffb8239fb8bb2eead1b; no voters: 
I20260709 12:59:58.544737  1334 raft_consensus.cc:2804] T 8a8ac1e3e54345718250fe8751bf234e P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:58.545094  1334 raft_consensus.cc:493] T 8a8ac1e3e54345718250fe8751bf234e P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:58.545334  1334 raft_consensus.cc:3060] T 8a8ac1e3e54345718250fe8751bf234e P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.550014  1334 raft_consensus.cc:515] T 8a8ac1e3e54345718250fe8751bf234e P 76534c5775854ffb8239fb8bb2eead1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.551849  1334 leader_election.cc:290] T 8a8ac1e3e54345718250fe8751bf234e P 76534c5775854ffb8239fb8bb2eead1b [CANDIDATE]: Term 1 election: Requested vote from peers 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193:41491), f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194:38543)
I20260709 12:59:58.552489  1103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8ac1e3e54345718250fe8751bf234e" candidate_uuid: "76534c5775854ffb8239fb8bb2eead1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7"
I20260709 12:59:58.552837  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8ac1e3e54345718250fe8751bf234e" candidate_uuid: "76534c5775854ffb8239fb8bb2eead1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4"
I20260709 12:59:58.553145  1103 raft_consensus.cc:3060] T 8a8ac1e3e54345718250fe8751bf234e P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.553401  1178 raft_consensus.cc:3060] T 8a8ac1e3e54345718250fe8751bf234e P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.559804  1178 raft_consensus.cc:2468] T 8a8ac1e3e54345718250fe8751bf234e P f98885ef63a44cd68a9a8e97a14e7cb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76534c5775854ffb8239fb8bb2eead1b in term 1.
I20260709 12:59:58.559804  1103 raft_consensus.cc:2468] T 8a8ac1e3e54345718250fe8751bf234e P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76534c5775854ffb8239fb8bb2eead1b in term 1.
I20260709 12:59:58.561026  1217 leader_election.cc:304] T 8a8ac1e3e54345718250fe8751bf234e P 76534c5775854ffb8239fb8bb2eead1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28620b8df5964fb5bbbf51288ccbf9d7, 76534c5775854ffb8239fb8bb2eead1b; no voters: 
I20260709 12:59:58.562053  1334 raft_consensus.cc:2804] T 8a8ac1e3e54345718250fe8751bf234e P 76534c5775854ffb8239fb8bb2eead1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:58.562682  1334 raft_consensus.cc:697] T 8a8ac1e3e54345718250fe8751bf234e P 76534c5775854ffb8239fb8bb2eead1b [term 1 LEADER]: Becoming Leader. State: Replica: 76534c5775854ffb8239fb8bb2eead1b, State: Running, Role: LEADER
I20260709 12:59:58.563571  1334 consensus_queue.cc:237] T 8a8ac1e3e54345718250fe8751bf234e P 76534c5775854ffb8239fb8bb2eead1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.572196  1310 consensus_queue.cc:1048] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:58.571640   999 catalog_manager.cc:5697] T 8a8ac1e3e54345718250fe8751bf234e P 76534c5775854ffb8239fb8bb2eead1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "76534c5775854ffb8239fb8bb2eead1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:58.576289  1322 consensus_queue.cc:1048] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:58.641031  1321 raft_consensus.cc:493] T b6e533e49aba4111a0592ae2f0d6d5bb P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.641695  1321 raft_consensus.cc:515] T b6e533e49aba4111a0592ae2f0d6d5bb P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } } peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } }
I20260709 12:59:58.643513  1321 leader_election.cc:290] T b6e533e49aba4111a0592ae2f0d6d5bb P 28620b8df5964fb5bbbf51288ccbf9d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195:35987), f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194:38543)
I20260709 12:59:58.644425  1251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e533e49aba4111a0592ae2f0d6d5bb" candidate_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76534c5775854ffb8239fb8bb2eead1b" is_pre_election: true
I20260709 12:59:58.644701  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e533e49aba4111a0592ae2f0d6d5bb" candidate_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" is_pre_election: true
I20260709 12:59:58.644968  1251 raft_consensus.cc:2468] T b6e533e49aba4111a0592ae2f0d6d5bb P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28620b8df5964fb5bbbf51288ccbf9d7 in term 0.
I20260709 12:59:58.645368  1178 raft_consensus.cc:2468] T b6e533e49aba4111a0592ae2f0d6d5bb P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28620b8df5964fb5bbbf51288ccbf9d7 in term 0.
I20260709 12:59:58.646031  1068 leader_election.cc:304] T b6e533e49aba4111a0592ae2f0d6d5bb P 28620b8df5964fb5bbbf51288ccbf9d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28620b8df5964fb5bbbf51288ccbf9d7, 76534c5775854ffb8239fb8bb2eead1b; no voters: 
I20260709 12:59:58.646968  1321 raft_consensus.cc:2804] T b6e533e49aba4111a0592ae2f0d6d5bb P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:58.647305  1321 raft_consensus.cc:493] T b6e533e49aba4111a0592ae2f0d6d5bb P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:58.647722  1321 raft_consensus.cc:3060] T b6e533e49aba4111a0592ae2f0d6d5bb P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.654109  1321 raft_consensus.cc:515] T b6e533e49aba4111a0592ae2f0d6d5bb P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } } peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } }
I20260709 12:59:58.655997  1321 leader_election.cc:290] T b6e533e49aba4111a0592ae2f0d6d5bb P 28620b8df5964fb5bbbf51288ccbf9d7 [CANDIDATE]: Term 1 election: Requested vote from peers 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195:35987), f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194:38543)
I20260709 12:59:58.656870  1251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e533e49aba4111a0592ae2f0d6d5bb" candidate_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76534c5775854ffb8239fb8bb2eead1b"
I20260709 12:59:58.657166  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e533e49aba4111a0592ae2f0d6d5bb" candidate_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4"
I20260709 12:59:58.657439  1251 raft_consensus.cc:3060] T b6e533e49aba4111a0592ae2f0d6d5bb P 76534c5775854ffb8239fb8bb2eead1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.657770  1178 raft_consensus.cc:3060] T b6e533e49aba4111a0592ae2f0d6d5bb P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.663239  1251 raft_consensus.cc:2468] T b6e533e49aba4111a0592ae2f0d6d5bb P 76534c5775854ffb8239fb8bb2eead1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28620b8df5964fb5bbbf51288ccbf9d7 in term 1.
I20260709 12:59:58.663367  1178 raft_consensus.cc:2468] T b6e533e49aba4111a0592ae2f0d6d5bb P f98885ef63a44cd68a9a8e97a14e7cb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28620b8df5964fb5bbbf51288ccbf9d7 in term 1.
I20260709 12:59:58.664373  1068 leader_election.cc:304] T b6e533e49aba4111a0592ae2f0d6d5bb P 28620b8df5964fb5bbbf51288ccbf9d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28620b8df5964fb5bbbf51288ccbf9d7, 76534c5775854ffb8239fb8bb2eead1b; no voters: 
I20260709 12:59:58.665132  1321 raft_consensus.cc:2804] T b6e533e49aba4111a0592ae2f0d6d5bb P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:58.665650  1321 raft_consensus.cc:697] T b6e533e49aba4111a0592ae2f0d6d5bb P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 LEADER]: Becoming Leader. State: Replica: 28620b8df5964fb5bbbf51288ccbf9d7, State: Running, Role: LEADER
I20260709 12:59:58.666478  1321 consensus_queue.cc:237] T b6e533e49aba4111a0592ae2f0d6d5bb P 28620b8df5964fb5bbbf51288ccbf9d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } } peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } }
I20260709 12:59:58.674131   999 catalog_manager.cc:5697] T b6e533e49aba4111a0592ae2f0d6d5bb P 28620b8df5964fb5bbbf51288ccbf9d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:58.690294  1330 raft_consensus.cc:493] T 53045d37f99e45ff83484a205d25c159 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.690857  1330 raft_consensus.cc:515] T 53045d37f99e45ff83484a205d25c159 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.692620  1330 leader_election.cc:290] T 53045d37f99e45ff83484a205d25c159 P f98885ef63a44cd68a9a8e97a14e7cb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193:41491), 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195:35987)
I20260709 12:59:58.693562  1103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53045d37f99e45ff83484a205d25c159" candidate_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" is_pre_election: true
I20260709 12:59:58.693783  1251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53045d37f99e45ff83484a205d25c159" candidate_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76534c5775854ffb8239fb8bb2eead1b" is_pre_election: true
I20260709 12:59:58.694362  1103 raft_consensus.cc:2393] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f98885ef63a44cd68a9a8e97a14e7cb4 in current term 1: Already voted for candidate 76534c5775854ffb8239fb8bb2eead1b in this term.
I20260709 12:59:58.695266  1143 leader_election.cc:304] T 53045d37f99e45ff83484a205d25c159 P f98885ef63a44cd68a9a8e97a14e7cb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f98885ef63a44cd68a9a8e97a14e7cb4; no voters: 28620b8df5964fb5bbbf51288ccbf9d7, 76534c5775854ffb8239fb8bb2eead1b
I20260709 12:59:58.695925  1330 raft_consensus.cc:3060] T 53045d37f99e45ff83484a205d25c159 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.700970  1330 raft_consensus.cc:2749] T 53045d37f99e45ff83484a205d25c159 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:58.705394  1321 consensus_queue.cc:1048] T 43365da3ffe345aa939dacc83fca01e2 P 28620b8df5964fb5bbbf51288ccbf9d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:58.706475  1322 consensus_queue.cc:1048] T 43365da3ffe345aa939dacc83fca01e2 P 28620b8df5964fb5bbbf51288ccbf9d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:58.737177  1334 consensus_queue.cc:1048] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:58.748756  1334 consensus_queue.cc:1048] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:58.778656  1322 consensus_queue.cc:1048] T c3a86df4dce7431ebc3dd76609005812 P 28620b8df5964fb5bbbf51288ccbf9d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:58.778889  1334 consensus_queue.cc:1048] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:58.794061  1321 consensus_queue.cc:1048] T c3a86df4dce7431ebc3dd76609005812 P 28620b8df5964fb5bbbf51288ccbf9d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:58.799022  1301 consensus_queue.cc:1048] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:58.802978  1335 consensus_queue.cc:1048] T 766aee4cd0ad4ca99e88106b9ee44bfd P f98885ef63a44cd68a9a8e97a14e7cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:58.818060  1321 raft_consensus.cc:493] T 766aee4cd0ad4ca99e88106b9ee44bfd P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.818622  1321 raft_consensus.cc:515] T 766aee4cd0ad4ca99e88106b9ee44bfd P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:58.822273  1177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766aee4cd0ad4ca99e88106b9ee44bfd" candidate_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" is_pre_election: true
I20260709 12:59:58.822476  1103 raft_consensus.cc:3060] T 766aee4cd0ad4ca99e88106b9ee44bfd P 28620b8df5964fb5bbbf51288ccbf9d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.830466  1321 leader_election.cc:290] T 766aee4cd0ad4ca99e88106b9ee44bfd P 28620b8df5964fb5bbbf51288ccbf9d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194:38543), 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195:35987)
I20260709 12:59:58.830964  1252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766aee4cd0ad4ca99e88106b9ee44bfd" candidate_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76534c5775854ffb8239fb8bb2eead1b" is_pre_election: true
I20260709 12:59:58.832651  1068 leader_election.cc:304] T 766aee4cd0ad4ca99e88106b9ee44bfd P 28620b8df5964fb5bbbf51288ccbf9d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28620b8df5964fb5bbbf51288ccbf9d7; no voters: 76534c5775854ffb8239fb8bb2eead1b, f98885ef63a44cd68a9a8e97a14e7cb4
I20260709 12:59:58.833429  1321 raft_consensus.cc:2749] T 766aee4cd0ad4ca99e88106b9ee44bfd P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:58.834309  1330 consensus_queue.cc:1048] T 766aee4cd0ad4ca99e88106b9ee44bfd P f98885ef63a44cd68a9a8e97a14e7cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:58.899900  1321 consensus_queue.cc:1048] T 2b09c8c207814a50b328ea9a7de81a9d P 28620b8df5964fb5bbbf51288ccbf9d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:58.913812  1310 consensus_queue.cc:1048] T 2b09c8c207814a50b328ea9a7de81a9d P 28620b8df5964fb5bbbf51288ccbf9d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:58.930757  1330 consensus_queue.cc:1048] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:58.947256  1369 consensus_queue.cc:1048] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:58.961568  1251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53045d37f99e45ff83484a205d25c159"
dest_uuid: "76534c5775854ffb8239fb8bb2eead1b"
mode: GRACEFUL
new_leader_uuid: "28620b8df5964fb5bbbf51288ccbf9d7"
 from {username='slave'} at 127.0.0.1:59858
I20260709 12:59:58.962185  1251 raft_consensus.cc:606] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [term 1 LEADER]: Received request to transfer leadership to TS 28620b8df5964fb5bbbf51288ccbf9d7
I20260709 12:59:58.978212  1177 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21562582b0a44dadbbadc702fd6b7b1b"
dest_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4"
mode: GRACEFUL
new_leader_uuid: "28620b8df5964fb5bbbf51288ccbf9d7"
 from {username='slave'} at 127.0.0.1:38978
I20260709 12:59:58.978730  1177 raft_consensus.cc:606] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4 [term 1 LEADER]: Received request to transfer leadership to TS 28620b8df5964fb5bbbf51288ccbf9d7
I20260709 12:59:58.994266  1103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34ca940a7b53463bb839e388285596f5"
dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7"
mode: GRACEFUL
new_leader_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4"
 from {username='slave'} at 127.0.0.1:57956
I20260709 12:59:58.994726  1103 raft_consensus.cc:606] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 LEADER]: Received request to transfer leadership to TS f98885ef63a44cd68a9a8e97a14e7cb4
I20260709 12:59:59.002154  1251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf424ea418ec409fbe7d9bc3e959c695"
dest_uuid: "76534c5775854ffb8239fb8bb2eead1b"
mode: GRACEFUL
new_leader_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4"
 from {username='slave'} at 127.0.0.1:59858
I20260709 12:59:59.002611  1251 raft_consensus.cc:606] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b [term 1 LEADER]: Received request to transfer leadership to TS f98885ef63a44cd68a9a8e97a14e7cb4
I20260709 12:59:59.007567  1251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a8ac1e3e54345718250fe8751bf234e"
dest_uuid: "76534c5775854ffb8239fb8bb2eead1b"
mode: GRACEFUL
new_leader_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4"
 from {username='slave'} at 127.0.0.1:59858
I20260709 12:59:59.008141  1251 raft_consensus.cc:606] T 8a8ac1e3e54345718250fe8751bf234e P 76534c5775854ffb8239fb8bb2eead1b [term 1 LEADER]: Received request to transfer leadership to TS f98885ef63a44cd68a9a8e97a14e7cb4
I20260709 12:59:59.010461  1337 consensus_queue.cc:1048] T 8a8ac1e3e54345718250fe8751bf234e P 76534c5775854ffb8239fb8bb2eead1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:59.013520  1102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b09c8c207814a50b328ea9a7de81a9d"
dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7"
mode: GRACEFUL
new_leader_uuid: "76534c5775854ffb8239fb8bb2eead1b"
 from {username='slave'} at 127.0.0.1:57956
I20260709 12:59:59.014123  1102 raft_consensus.cc:606] T 2b09c8c207814a50b328ea9a7de81a9d P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 LEADER]: Received request to transfer leadership to TS 76534c5775854ffb8239fb8bb2eead1b
I20260709 12:59:59.022414  1337 consensus_queue.cc:1048] T 8a8ac1e3e54345718250fe8751bf234e P 76534c5775854ffb8239fb8bb2eead1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:59.030241  1337 raft_consensus.cc:993] T 8a8ac1e3e54345718250fe8751bf234e P 76534c5775854ffb8239fb8bb2eead1b: : Instructing follower f98885ef63a44cd68a9a8e97a14e7cb4 to start an election
I20260709 12:59:59.030699  1301 raft_consensus.cc:1081] T 8a8ac1e3e54345718250fe8751bf234e P 76534c5775854ffb8239fb8bb2eead1b [term 1 LEADER]: Signalling peer f98885ef63a44cd68a9a8e97a14e7cb4 to start an election
I20260709 12:59:59.032539  1178 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a8ac1e3e54345718250fe8751bf234e"
dest_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4"
 from {username='slave'} at 127.0.0.1:38962
I20260709 12:59:59.033138  1178 raft_consensus.cc:493] T 8a8ac1e3e54345718250fe8751bf234e P f98885ef63a44cd68a9a8e97a14e7cb4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:59.033499  1178 raft_consensus.cc:3060] T 8a8ac1e3e54345718250fe8751bf234e P f98885ef63a44cd68a9a8e97a14e7cb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:59.038724  1178 raft_consensus.cc:515] T 8a8ac1e3e54345718250fe8751bf234e P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:59.041621  1103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8ac1e3e54345718250fe8751bf234e" candidate_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7"
I20260709 12:59:59.042114  1103 raft_consensus.cc:3060] T 8a8ac1e3e54345718250fe8751bf234e P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:59.047802  1103 raft_consensus.cc:2468] T 8a8ac1e3e54345718250fe8751bf234e P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f98885ef63a44cd68a9a8e97a14e7cb4 in term 2.
I20260709 12:59:59.048652  1178 leader_election.cc:290] T 8a8ac1e3e54345718250fe8751bf234e P f98885ef63a44cd68a9a8e97a14e7cb4 [CANDIDATE]: Term 2 election: Requested vote from peers 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193:41491), 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195:35987)
I20260709 12:59:59.049256  1143 leader_election.cc:304] T 8a8ac1e3e54345718250fe8751bf234e P f98885ef63a44cd68a9a8e97a14e7cb4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28620b8df5964fb5bbbf51288ccbf9d7, f98885ef63a44cd68a9a8e97a14e7cb4; no voters: 
I20260709 12:59:59.049715  1251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8ac1e3e54345718250fe8751bf234e" candidate_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "76534c5775854ffb8239fb8bb2eead1b"
I20260709 12:59:59.050006  1369 raft_consensus.cc:2804] T 8a8ac1e3e54345718250fe8751bf234e P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:59.050303  1251 raft_consensus.cc:3055] T 8a8ac1e3e54345718250fe8751bf234e P 76534c5775854ffb8239fb8bb2eead1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:59.050467  1369 raft_consensus.cc:697] T 8a8ac1e3e54345718250fe8751bf234e P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 LEADER]: Becoming Leader. State: Replica: f98885ef63a44cd68a9a8e97a14e7cb4, State: Running, Role: LEADER
I20260709 12:59:59.050659  1251 raft_consensus.cc:740] T 8a8ac1e3e54345718250fe8751bf234e P 76534c5775854ffb8239fb8bb2eead1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 76534c5775854ffb8239fb8bb2eead1b, State: Running, Role: LEADER
I20260709 12:59:59.051309  1369 consensus_queue.cc:237] T 8a8ac1e3e54345718250fe8751bf234e P f98885ef63a44cd68a9a8e97a14e7cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:59.051402  1251 consensus_queue.cc:260] T 8a8ac1e3e54345718250fe8751bf234e P 76534c5775854ffb8239fb8bb2eead1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:59.052409  1251 raft_consensus.cc:3060] T 8a8ac1e3e54345718250fe8751bf234e P 76534c5775854ffb8239fb8bb2eead1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:59.057439  1251 raft_consensus.cc:2468] T 8a8ac1e3e54345718250fe8751bf234e P 76534c5775854ffb8239fb8bb2eead1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f98885ef63a44cd68a9a8e97a14e7cb4 in term 2.
I20260709 12:59:59.057550   999 catalog_manager.cc:5697] T 8a8ac1e3e54345718250fe8751bf234e P f98885ef63a44cd68a9a8e97a14e7cb4 reported cstate change: term changed from 1 to 2, leader changed from 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195) to f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:59.231725  1337 raft_consensus.cc:993] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b: : Instructing follower f98885ef63a44cd68a9a8e97a14e7cb4 to start an election
I20260709 12:59:59.232292  1301 raft_consensus.cc:1081] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b [term 1 LEADER]: Signalling peer f98885ef63a44cd68a9a8e97a14e7cb4 to start an election
I20260709 12:59:59.234242  1178 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf424ea418ec409fbe7d9bc3e959c695"
dest_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4"
 from {username='slave'} at 127.0.0.1:38962
I20260709 12:59:59.234771  1178 raft_consensus.cc:493] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:59.235211  1178 raft_consensus.cc:3060] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:59.238895  1310 consensus_queue.cc:1048] T b6e533e49aba4111a0592ae2f0d6d5bb P 28620b8df5964fb5bbbf51288ccbf9d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:59.244066  1178 raft_consensus.cc:515] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:59.247208  1178 leader_election.cc:290] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4 [CANDIDATE]: Term 2 election: Requested vote from peers 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193:41491), 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195:35987)
I20260709 12:59:59.249783  1103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf424ea418ec409fbe7d9bc3e959c695" candidate_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7"
I20260709 12:59:59.249958  1251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf424ea418ec409fbe7d9bc3e959c695" candidate_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "76534c5775854ffb8239fb8bb2eead1b"
I20260709 12:59:59.250680  1251 raft_consensus.cc:3055] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:59.250649  1103 raft_consensus.cc:3060] T cf424ea418ec409fbe7d9bc3e959c695 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:59.251286  1251 raft_consensus.cc:740] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 76534c5775854ffb8239fb8bb2eead1b, State: Running, Role: LEADER
I20260709 12:59:59.252460  1251 consensus_queue.cc:260] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:59.254134  1251 raft_consensus.cc:3060] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:59.262640  1321 consensus_queue.cc:1048] T b6e533e49aba4111a0592ae2f0d6d5bb P 28620b8df5964fb5bbbf51288ccbf9d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:59.272061  1103 raft_consensus.cc:2468] T cf424ea418ec409fbe7d9bc3e959c695 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f98885ef63a44cd68a9a8e97a14e7cb4 in term 2.
I20260709 12:59:59.275336  1143 leader_election.cc:304] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28620b8df5964fb5bbbf51288ccbf9d7, f98885ef63a44cd68a9a8e97a14e7cb4; no voters: 
I20260709 12:59:59.276558  1369 raft_consensus.cc:2804] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:59.276500  1251 raft_consensus.cc:2468] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f98885ef63a44cd68a9a8e97a14e7cb4 in term 2.
I20260709 12:59:59.277345  1369 raft_consensus.cc:697] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 LEADER]: Becoming Leader. State: Replica: f98885ef63a44cd68a9a8e97a14e7cb4, State: Running, Role: LEADER
I20260709 12:59:59.278640  1369 consensus_queue.cc:237] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:59.288552   999 catalog_manager.cc:5697] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4 reported cstate change: term changed from 1 to 2, leader changed from 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195) to f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:59.333989  1337 raft_consensus.cc:993] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b: : Instructing follower 28620b8df5964fb5bbbf51288ccbf9d7 to start an election
I20260709 12:59:59.334515  1301 raft_consensus.cc:1081] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [term 1 LEADER]: Signalling peer 28620b8df5964fb5bbbf51288ccbf9d7 to start an election
I20260709 12:59:59.336356  1103 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53045d37f99e45ff83484a205d25c159"
dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7"
 from {username='slave'} at 127.0.0.1:57936
I20260709 12:59:59.337173  1103 raft_consensus.cc:493] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:59.337754  1103 raft_consensus.cc:3060] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:59.340999  1322 raft_consensus.cc:993] T 2b09c8c207814a50b328ea9a7de81a9d P 28620b8df5964fb5bbbf51288ccbf9d7: : Instructing follower 76534c5775854ffb8239fb8bb2eead1b to start an election
I20260709 12:59:59.341586  1382 raft_consensus.cc:1081] T 2b09c8c207814a50b328ea9a7de81a9d P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 LEADER]: Signalling peer 76534c5775854ffb8239fb8bb2eead1b to start an election
I20260709 12:59:59.343547  1252 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b09c8c207814a50b328ea9a7de81a9d"
dest_uuid: "76534c5775854ffb8239fb8bb2eead1b"
 from {username='slave'} at 127.0.0.1:59840
I20260709 12:59:59.344322  1252 raft_consensus.cc:493] T 2b09c8c207814a50b328ea9a7de81a9d P 76534c5775854ffb8239fb8bb2eead1b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:59.344839  1252 raft_consensus.cc:3060] T 2b09c8c207814a50b328ea9a7de81a9d P 76534c5775854ffb8239fb8bb2eead1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:59.346145  1103 raft_consensus.cc:515] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:59.349421  1103 leader_election.cc:290] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [CANDIDATE]: Term 2 election: Requested vote from peers f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194:38543), 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195:35987)
I20260709 12:59:59.350035  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53045d37f99e45ff83484a205d25c159" candidate_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4"
I20260709 12:59:59.350965  1178 raft_consensus.cc:3060] T 53045d37f99e45ff83484a205d25c159 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:59.351225  1251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53045d37f99e45ff83484a205d25c159" candidate_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "76534c5775854ffb8239fb8bb2eead1b"
I20260709 12:59:59.352336  1251 raft_consensus.cc:3055] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:59.352669  1251 raft_consensus.cc:740] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 76534c5775854ffb8239fb8bb2eead1b, State: Running, Role: LEADER
I20260709 12:59:59.353703  1251 consensus_queue.cc:260] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:59.354835  1251 raft_consensus.cc:3060] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:59.354951  1252 raft_consensus.cc:515] T 2b09c8c207814a50b328ea9a7de81a9d P 76534c5775854ffb8239fb8bb2eead1b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:59.360670  1252 leader_election.cc:290] T 2b09c8c207814a50b328ea9a7de81a9d P 76534c5775854ffb8239fb8bb2eead1b [CANDIDATE]: Term 2 election: Requested vote from peers 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193:41491), f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194:38543)
I20260709 12:59:59.362068  1103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b09c8c207814a50b328ea9a7de81a9d" candidate_uuid: "76534c5775854ffb8239fb8bb2eead1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7"
I20260709 12:59:59.362258  1177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b09c8c207814a50b328ea9a7de81a9d" candidate_uuid: "76534c5775854ffb8239fb8bb2eead1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4"
I20260709 12:59:59.363123  1103 raft_consensus.cc:3055] T 2b09c8c207814a50b328ea9a7de81a9d P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:59.363169  1177 raft_consensus.cc:3060] T 2b09c8c207814a50b328ea9a7de81a9d P f98885ef63a44cd68a9a8e97a14e7cb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:59.363906  1103 raft_consensus.cc:740] T 2b09c8c207814a50b328ea9a7de81a9d P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 28620b8df5964fb5bbbf51288ccbf9d7, State: Running, Role: LEADER
I20260709 12:59:59.364661  1178 raft_consensus.cc:2468] T 53045d37f99e45ff83484a205d25c159 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28620b8df5964fb5bbbf51288ccbf9d7 in term 2.
I20260709 12:59:59.365016  1251 raft_consensus.cc:2468] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28620b8df5964fb5bbbf51288ccbf9d7 in term 2.
I20260709 12:59:59.366540  1067 leader_election.cc:304] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28620b8df5964fb5bbbf51288ccbf9d7, f98885ef63a44cd68a9a8e97a14e7cb4; no voters: 
I20260709 12:59:59.365427  1103 consensus_queue.cc:260] T 2b09c8c207814a50b328ea9a7de81a9d P 28620b8df5964fb5bbbf51288ccbf9d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:59.367774  1382 raft_consensus.cc:2804] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:59.368553  1382 raft_consensus.cc:697] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 LEADER]: Becoming Leader. State: Replica: 28620b8df5964fb5bbbf51288ccbf9d7, State: Running, Role: LEADER
I20260709 12:59:59.368887  1103 raft_consensus.cc:3060] T 2b09c8c207814a50b328ea9a7de81a9d P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:59.369854  1382 consensus_queue.cc:237] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:59.372691  1322 raft_consensus.cc:993] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7: : Instructing follower f98885ef63a44cd68a9a8e97a14e7cb4 to start an election
I20260709 12:59:59.373304  1310 raft_consensus.cc:1081] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 LEADER]: Signalling peer f98885ef63a44cd68a9a8e97a14e7cb4 to start an election
I20260709 12:59:59.375514  1177 raft_consensus.cc:2468] T 2b09c8c207814a50b328ea9a7de81a9d P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76534c5775854ffb8239fb8bb2eead1b in term 2.
I20260709 12:59:59.375846  1178 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34ca940a7b53463bb839e388285596f5"
dest_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4"
 from {username='slave'} at 127.0.0.1:38948
I20260709 12:59:59.376689  1178 raft_consensus.cc:493] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:59.377272  1178 raft_consensus.cc:3060] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:59.378343  1216 leader_election.cc:304] T 2b09c8c207814a50b328ea9a7de81a9d P 76534c5775854ffb8239fb8bb2eead1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76534c5775854ffb8239fb8bb2eead1b, f98885ef63a44cd68a9a8e97a14e7cb4; no voters: 
I20260709 12:59:59.379534  1301 raft_consensus.cc:2804] T 2b09c8c207814a50b328ea9a7de81a9d P 76534c5775854ffb8239fb8bb2eead1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:59.380213  1301 raft_consensus.cc:697] T 2b09c8c207814a50b328ea9a7de81a9d P 76534c5775854ffb8239fb8bb2eead1b [term 2 LEADER]: Becoming Leader. State: Replica: 76534c5775854ffb8239fb8bb2eead1b, State: Running, Role: LEADER
I20260709 12:59:59.381920  1103 raft_consensus.cc:2468] T 2b09c8c207814a50b328ea9a7de81a9d P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76534c5775854ffb8239fb8bb2eead1b in term 2.
I20260709 12:59:59.381512  1301 consensus_queue.cc:237] T 2b09c8c207814a50b328ea9a7de81a9d P 76534c5775854ffb8239fb8bb2eead1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:59.382984   999 catalog_manager.cc:5697] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 reported cstate change: term changed from 1 to 2, leader changed from 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195) to 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:59.387691  1178 raft_consensus.cc:515] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:59.390741  1178 leader_election.cc:290] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 [CANDIDATE]: Term 2 election: Requested vote from peers 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193:41491), 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195:35987)
I20260709 12:59:59.392280  1000 catalog_manager.cc:5697] T 2b09c8c207814a50b328ea9a7de81a9d P 76534c5775854ffb8239fb8bb2eead1b reported cstate change: term changed from 1 to 2, leader changed from 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193) to 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195). New cstate: current_term: 2 leader_uuid: "76534c5775854ffb8239fb8bb2eead1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:59.393375  1103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ca940a7b53463bb839e388285596f5" candidate_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7"
I20260709 12:59:59.393677  1251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ca940a7b53463bb839e388285596f5" candidate_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "76534c5775854ffb8239fb8bb2eead1b"
I20260709 12:59:59.394127  1103 raft_consensus.cc:3055] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:59.394467  1251 raft_consensus.cc:3060] T 34ca940a7b53463bb839e388285596f5 P 76534c5775854ffb8239fb8bb2eead1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:59.394686  1103 raft_consensus.cc:740] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 28620b8df5964fb5bbbf51288ccbf9d7, State: Running, Role: LEADER
I20260709 12:59:59.396214  1103 consensus_queue.cc:260] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:59.397982  1103 raft_consensus.cc:3060] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:59.403960  1251 raft_consensus.cc:2468] T 34ca940a7b53463bb839e388285596f5 P 76534c5775854ffb8239fb8bb2eead1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f98885ef63a44cd68a9a8e97a14e7cb4 in term 2.
I20260709 12:59:59.405661  1143 leader_election.cc:304] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76534c5775854ffb8239fb8bb2eead1b, f98885ef63a44cd68a9a8e97a14e7cb4; no voters: 
I20260709 12:59:59.406139  1103 raft_consensus.cc:2468] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f98885ef63a44cd68a9a8e97a14e7cb4 in term 2.
I20260709 12:59:59.406901  1369 raft_consensus.cc:2804] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:59.407722  1369 raft_consensus.cc:697] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 LEADER]: Becoming Leader. State: Replica: f98885ef63a44cd68a9a8e97a14e7cb4, State: Running, Role: LEADER
I20260709 12:59:59.408962  1369 consensus_queue.cc:237] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:59.420670  1000 catalog_manager.cc:5697] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 reported cstate change: term changed from 1 to 2, leader changed from 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193) to f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:59.451826  1335 raft_consensus.cc:993] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4: : Instructing follower 28620b8df5964fb5bbbf51288ccbf9d7 to start an election
I20260709 12:59:59.452332  1384 raft_consensus.cc:1081] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4 [term 1 LEADER]: Signalling peer 28620b8df5964fb5bbbf51288ccbf9d7 to start an election
I20260709 12:59:59.454259  1103 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21562582b0a44dadbbadc702fd6b7b1b"
dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7"
 from {username='slave'} at 127.0.0.1:57940
I20260709 12:59:59.454861  1103 raft_consensus.cc:493] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:59.455250  1103 raft_consensus.cc:3060] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:59.461404  1103 raft_consensus.cc:515] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:59.463366  1103 leader_election.cc:290] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7 [CANDIDATE]: Term 2 election: Requested vote from peers f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194:38543), 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195:35987)
I20260709 12:59:59.464424  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562582b0a44dadbbadc702fd6b7b1b" candidate_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4"
I20260709 12:59:59.465003  1251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562582b0a44dadbbadc702fd6b7b1b" candidate_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "76534c5775854ffb8239fb8bb2eead1b"
I20260709 12:59:59.465205  1178 raft_consensus.cc:3055] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:59.465693  1178 raft_consensus.cc:740] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f98885ef63a44cd68a9a8e97a14e7cb4, State: Running, Role: LEADER
I20260709 12:59:59.465773  1251 raft_consensus.cc:3060] T 21562582b0a44dadbbadc702fd6b7b1b P 76534c5775854ffb8239fb8bb2eead1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:59.466862  1178 consensus_queue.cc:260] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:59.468353  1178 raft_consensus.cc:3060] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:59.475689  1251 raft_consensus.cc:2468] T 21562582b0a44dadbbadc702fd6b7b1b P 76534c5775854ffb8239fb8bb2eead1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28620b8df5964fb5bbbf51288ccbf9d7 in term 2.
I20260709 12:59:59.476598  1178 raft_consensus.cc:2468] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28620b8df5964fb5bbbf51288ccbf9d7 in term 2.
I20260709 12:59:59.477353  1068 leader_election.cc:304] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28620b8df5964fb5bbbf51288ccbf9d7, 76534c5775854ffb8239fb8bb2eead1b; no voters: 
I20260709 12:59:59.478484  1382 raft_consensus.cc:2804] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:59.479022  1382 raft_consensus.cc:697] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 LEADER]: Becoming Leader. State: Replica: 28620b8df5964fb5bbbf51288ccbf9d7, State: Running, Role: LEADER
I20260709 12:59:59.479889  1382 consensus_queue.cc:237] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 12:59:59.487727  1000 catalog_manager.cc:5697] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7 reported cstate change: term changed from 1 to 2, leader changed from f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194) to 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:59.543754  1103 raft_consensus.cc:1275] T 8a8ac1e3e54345718250fe8751bf234e P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 FOLLOWER]: Refusing update from remote peer f98885ef63a44cd68a9a8e97a14e7cb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:59.545361  1384 consensus_queue.cc:1048] T 8a8ac1e3e54345718250fe8751bf234e P f98885ef63a44cd68a9a8e97a14e7cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:59.556454  1251 raft_consensus.cc:1275] T 8a8ac1e3e54345718250fe8751bf234e P 76534c5775854ffb8239fb8bb2eead1b [term 2 FOLLOWER]: Refusing update from remote peer f98885ef63a44cd68a9a8e97a14e7cb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:59.558722  1335 consensus_queue.cc:1048] T 8a8ac1e3e54345718250fe8751bf234e P f98885ef63a44cd68a9a8e97a14e7cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:59.747812  1103 raft_consensus.cc:1275] T cf424ea418ec409fbe7d9bc3e959c695 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 FOLLOWER]: Refusing update from remote peer f98885ef63a44cd68a9a8e97a14e7cb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:59.749178  1335 consensus_queue.cc:1048] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:59.756997  1251 raft_consensus.cc:1275] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b [term 2 FOLLOWER]: Refusing update from remote peer f98885ef63a44cd68a9a8e97a14e7cb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:59.758843  1384 consensus_queue.cc:1048] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:59.786379  1103 raft_consensus.cc:1275] T 2b09c8c207814a50b328ea9a7de81a9d P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 FOLLOWER]: Refusing update from remote peer 76534c5775854ffb8239fb8bb2eead1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:59.787645  1301 consensus_queue.cc:1048] T 2b09c8c207814a50b328ea9a7de81a9d P 76534c5775854ffb8239fb8bb2eead1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:59.796736  1178 raft_consensus.cc:1275] T 2b09c8c207814a50b328ea9a7de81a9d P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 FOLLOWER]: Refusing update from remote peer 76534c5775854ffb8239fb8bb2eead1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:59.798115  1334 consensus_queue.cc:1048] T 2b09c8c207814a50b328ea9a7de81a9d P 76534c5775854ffb8239fb8bb2eead1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:59.913026  1251 raft_consensus.cc:1275] T 21562582b0a44dadbbadc702fd6b7b1b P 76534c5775854ffb8239fb8bb2eead1b [term 2 FOLLOWER]: Refusing update from remote peer 28620b8df5964fb5bbbf51288ccbf9d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:59.914764  1382 consensus_queue.cc:1048] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:59.921943  1178 raft_consensus.cc:1275] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 FOLLOWER]: Refusing update from remote peer 28620b8df5964fb5bbbf51288ccbf9d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:59.923754  1382 consensus_queue.cc:1048] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:59.930078  1177 raft_consensus.cc:1275] T 53045d37f99e45ff83484a205d25c159 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 FOLLOWER]: Refusing update from remote peer 28620b8df5964fb5bbbf51288ccbf9d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:59.931703  1321 consensus_queue.cc:1048] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:59.941488  1251 raft_consensus.cc:1275] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [term 2 FOLLOWER]: Refusing update from remote peer 28620b8df5964fb5bbbf51288ccbf9d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:59.943221  1382 consensus_queue.cc:1048] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:59.953186  1103 raft_consensus.cc:1275] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 FOLLOWER]: Refusing update from remote peer f98885ef63a44cd68a9a8e97a14e7cb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:59.954427  1384 consensus_queue.cc:1048] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:59.963846  1252 raft_consensus.cc:1275] T 34ca940a7b53463bb839e388285596f5 P 76534c5775854ffb8239fb8bb2eead1b [term 2 FOLLOWER]: Refusing update from remote peer f98885ef63a44cd68a9a8e97a14e7cb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:59.965186  1330 consensus_queue.cc:1048] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:02.049219   431 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:00:02.050071   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:02.067996  1103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21562582b0a44dadbbadc702fd6b7b1b"
dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7"
mode: GRACEFUL
new_leader_uuid: "76534c5775854ffb8239fb8bb2eead1b"
 from {username='slave'} at 127.0.0.1:40292
I20260709 13:00:02.068714  1103 raft_consensus.cc:606] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 LEADER]: Received request to transfer leadership to TS 76534c5775854ffb8239fb8bb2eead1b
I20260709 13:00:02.071592  1103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53045d37f99e45ff83484a205d25c159"
dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7"
mode: GRACEFUL
new_leader_uuid: "76534c5775854ffb8239fb8bb2eead1b"
 from {username='slave'} at 127.0.0.1:40292
I20260709 13:00:02.072059  1103 raft_consensus.cc:606] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 LEADER]: Received request to transfer leadership to TS 76534c5775854ffb8239fb8bb2eead1b
I20260709 13:00:02.073175   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:00:02.073789   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:02.280961  1382 raft_consensus.cc:993] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7: : Instructing follower 76534c5775854ffb8239fb8bb2eead1b to start an election
I20260709 13:00:02.281396  1382 raft_consensus.cc:1081] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 LEADER]: Signalling peer 76534c5775854ffb8239fb8bb2eead1b to start an election
I20260709 13:00:02.283385  1252 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53045d37f99e45ff83484a205d25c159"
dest_uuid: "76534c5775854ffb8239fb8bb2eead1b"
 from {username='slave'} at 127.0.0.1:59840
I20260709 13:00:02.283968  1252 raft_consensus.cc:493] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:02.284304  1252 raft_consensus.cc:3060] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:02.292531  1252 raft_consensus.cc:515] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 13:00:02.299449  1252 leader_election.cc:290] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [CANDIDATE]: Term 3 election: Requested vote from peers 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193:41491), f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194:38543)
I20260709 13:00:02.300120  1103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53045d37f99e45ff83484a205d25c159" candidate_uuid: "76534c5775854ffb8239fb8bb2eead1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7"
I20260709 13:00:02.300812  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53045d37f99e45ff83484a205d25c159" candidate_uuid: "76534c5775854ffb8239fb8bb2eead1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4"
I20260709 13:00:02.301192  1103 raft_consensus.cc:3055] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:02.301816  1178 raft_consensus.cc:3060] T 53045d37f99e45ff83484a205d25c159 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:02.301819  1103 raft_consensus.cc:740] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 28620b8df5964fb5bbbf51288ccbf9d7, State: Running, Role: LEADER
I20260709 13:00:02.303385  1103 consensus_queue.cc:260] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 13:00:02.304813  1103 raft_consensus.cc:3060] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:02.313172  1178 raft_consensus.cc:2468] T 53045d37f99e45ff83484a205d25c159 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76534c5775854ffb8239fb8bb2eead1b in term 3.
I20260709 13:00:02.313578  1103 raft_consensus.cc:2468] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76534c5775854ffb8239fb8bb2eead1b in term 3.
I20260709 13:00:02.315479  1216 leader_election.cc:304] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76534c5775854ffb8239fb8bb2eead1b, f98885ef63a44cd68a9a8e97a14e7cb4; no voters: 
I20260709 13:00:02.316478  1334 raft_consensus.cc:2804] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:02.317914  1334 raft_consensus.cc:697] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [term 3 LEADER]: Becoming Leader. State: Replica: 76534c5775854ffb8239fb8bb2eead1b, State: Running, Role: LEADER
I20260709 13:00:02.320111  1334 consensus_queue.cc:237] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 13:00:02.330919  1000 catalog_manager.cc:5697] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b reported cstate change: term changed from 2 to 3, leader changed from 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193) to 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195). New cstate: current_term: 3 leader_uuid: "76534c5775854ffb8239fb8bb2eead1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:02.414974  1393 raft_consensus.cc:993] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7: : Instructing follower 76534c5775854ffb8239fb8bb2eead1b to start an election
I20260709 13:00:02.415503  1382 raft_consensus.cc:1081] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 LEADER]: Signalling peer 76534c5775854ffb8239fb8bb2eead1b to start an election
I20260709 13:00:02.417188  1251 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21562582b0a44dadbbadc702fd6b7b1b"
dest_uuid: "76534c5775854ffb8239fb8bb2eead1b"
 from {username='slave'} at 127.0.0.1:59840
I20260709 13:00:02.418035  1251 raft_consensus.cc:493] T 21562582b0a44dadbbadc702fd6b7b1b P 76534c5775854ffb8239fb8bb2eead1b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:02.418637  1251 raft_consensus.cc:3060] T 21562582b0a44dadbbadc702fd6b7b1b P 76534c5775854ffb8239fb8bb2eead1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:02.468932  1251 raft_consensus.cc:515] T 21562582b0a44dadbbadc702fd6b7b1b P 76534c5775854ffb8239fb8bb2eead1b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 13:00:02.471843  1251 leader_election.cc:290] T 21562582b0a44dadbbadc702fd6b7b1b P 76534c5775854ffb8239fb8bb2eead1b [CANDIDATE]: Term 3 election: Requested vote from peers 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193:41491), f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194:38543)
I20260709 13:00:02.472635  1103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562582b0a44dadbbadc702fd6b7b1b" candidate_uuid: "76534c5775854ffb8239fb8bb2eead1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7"
I20260709 13:00:02.472877  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562582b0a44dadbbadc702fd6b7b1b" candidate_uuid: "76534c5775854ffb8239fb8bb2eead1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4"
I20260709 13:00:02.473387  1178 raft_consensus.cc:3060] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:02.473387  1103 raft_consensus.cc:3055] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:02.473834  1103 raft_consensus.cc:740] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 28620b8df5964fb5bbbf51288ccbf9d7, State: Running, Role: LEADER
I20260709 13:00:02.474557  1103 consensus_queue.cc:260] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 13:00:02.475664  1103 raft_consensus.cc:3060] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:02.520773  1103 raft_consensus.cc:2468] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76534c5775854ffb8239fb8bb2eead1b in term 3.
I20260709 13:00:02.520773  1178 raft_consensus.cc:2468] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76534c5775854ffb8239fb8bb2eead1b in term 3.
I20260709 13:00:02.522675  1216 leader_election.cc:304] T 21562582b0a44dadbbadc702fd6b7b1b P 76534c5775854ffb8239fb8bb2eead1b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76534c5775854ffb8239fb8bb2eead1b, f98885ef63a44cd68a9a8e97a14e7cb4; no voters: 
I20260709 13:00:02.523936  1334 raft_consensus.cc:2804] T 21562582b0a44dadbbadc702fd6b7b1b P 76534c5775854ffb8239fb8bb2eead1b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:02.524665  1334 raft_consensus.cc:697] T 21562582b0a44dadbbadc702fd6b7b1b P 76534c5775854ffb8239fb8bb2eead1b [term 3 LEADER]: Becoming Leader. State: Replica: 76534c5775854ffb8239fb8bb2eead1b, State: Running, Role: LEADER
I20260709 13:00:02.525605  1334 consensus_queue.cc:237] T 21562582b0a44dadbbadc702fd6b7b1b P 76534c5775854ffb8239fb8bb2eead1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 13:00:02.539521   999 catalog_manager.cc:5697] T 21562582b0a44dadbbadc702fd6b7b1b P 76534c5775854ffb8239fb8bb2eead1b reported cstate change: term changed from 2 to 3, leader changed from 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193) to 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195). New cstate: current_term: 3 leader_uuid: "76534c5775854ffb8239fb8bb2eead1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:02.728838  1178 raft_consensus.cc:1275] T 53045d37f99e45ff83484a205d25c159 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 3 FOLLOWER]: Refusing update from remote peer 76534c5775854ffb8239fb8bb2eead1b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:02.730847  1334 consensus_queue.cc:1048] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:02.744130  1103 raft_consensus.cc:1275] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 3 FOLLOWER]: Refusing update from remote peer 76534c5775854ffb8239fb8bb2eead1b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:02.746023  1404 consensus_queue.cc:1048] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:02.939381  1103 raft_consensus.cc:1275] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7 [term 3 FOLLOWER]: Refusing update from remote peer 76534c5775854ffb8239fb8bb2eead1b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:02.940774  1404 consensus_queue.cc:1048] T 21562582b0a44dadbbadc702fd6b7b1b P 76534c5775854ffb8239fb8bb2eead1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:02.950276  1178 raft_consensus.cc:1275] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4 [term 3 FOLLOWER]: Refusing update from remote peer 76534c5775854ffb8239fb8bb2eead1b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:02.951923  1409 consensus_queue.cc:1048] T 21562582b0a44dadbbadc702fd6b7b1b P 76534c5775854ffb8239fb8bb2eead1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:03.074728   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:03.088153  1251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53045d37f99e45ff83484a205d25c159"
dest_uuid: "76534c5775854ffb8239fb8bb2eead1b"
mode: GRACEFUL
new_leader_uuid: "28620b8df5964fb5bbbf51288ccbf9d7"
 from {username='slave'} at 127.0.0.1:59858
I20260709 13:00:03.088732  1251 raft_consensus.cc:606] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [term 3 LEADER]: Received request to transfer leadership to TS 28620b8df5964fb5bbbf51288ccbf9d7
I20260709 13:00:03.097575  1251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21562582b0a44dadbbadc702fd6b7b1b"
dest_uuid: "76534c5775854ffb8239fb8bb2eead1b"
mode: GRACEFUL
new_leader_uuid: "28620b8df5964fb5bbbf51288ccbf9d7"
 from {username='slave'} at 127.0.0.1:59858
I20260709 13:00:03.098151  1251 raft_consensus.cc:606] T 21562582b0a44dadbbadc702fd6b7b1b P 76534c5775854ffb8239fb8bb2eead1b [term 3 LEADER]: Received request to transfer leadership to TS 28620b8df5964fb5bbbf51288ccbf9d7
I20260709 13:00:03.105279  1178 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34ca940a7b53463bb839e388285596f5"
dest_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4"
mode: GRACEFUL
new_leader_uuid: "28620b8df5964fb5bbbf51288ccbf9d7"
 from {username='slave'} at 127.0.0.1:38978
I20260709 13:00:03.105906  1178 raft_consensus.cc:606] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 LEADER]: Received request to transfer leadership to TS 28620b8df5964fb5bbbf51288ccbf9d7
I20260709 13:00:03.110718  1178 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "766aee4cd0ad4ca99e88106b9ee44bfd"
dest_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4"
mode: GRACEFUL
new_leader_uuid: "28620b8df5964fb5bbbf51288ccbf9d7"
 from {username='slave'} at 127.0.0.1:38978
I20260709 13:00:03.111171  1178 raft_consensus.cc:606] T 766aee4cd0ad4ca99e88106b9ee44bfd P f98885ef63a44cd68a9a8e97a14e7cb4 [term 1 LEADER]: Received request to transfer leadership to TS 28620b8df5964fb5bbbf51288ccbf9d7
I20260709 13:00:03.116288  1178 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf424ea418ec409fbe7d9bc3e959c695"
dest_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4"
mode: GRACEFUL
new_leader_uuid: "28620b8df5964fb5bbbf51288ccbf9d7"
 from {username='slave'} at 127.0.0.1:38978
I20260709 13:00:03.116920  1178 raft_consensus.cc:606] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 LEADER]: Received request to transfer leadership to TS 28620b8df5964fb5bbbf51288ccbf9d7
I20260709 13:00:03.144027  1396 raft_consensus.cc:993] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4: : Instructing follower 28620b8df5964fb5bbbf51288ccbf9d7 to start an election
I20260709 13:00:03.144464  1396 raft_consensus.cc:1081] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 LEADER]: Signalling peer 28620b8df5964fb5bbbf51288ccbf9d7 to start an election
I20260709 13:00:03.145968  1103 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf424ea418ec409fbe7d9bc3e959c695"
dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7"
 from {username='slave'} at 127.0.0.1:57940
I20260709 13:00:03.146379  1103 raft_consensus.cc:493] T cf424ea418ec409fbe7d9bc3e959c695 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:03.146661  1103 raft_consensus.cc:3060] T cf424ea418ec409fbe7d9bc3e959c695 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:03.217916  1411 raft_consensus.cc:993] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4: : Instructing follower 28620b8df5964fb5bbbf51288ccbf9d7 to start an election
I20260709 13:00:03.218367  1396 raft_consensus.cc:1081] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 LEADER]: Signalling peer 28620b8df5964fb5bbbf51288ccbf9d7 to start an election
I20260709 13:00:03.220166  1102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34ca940a7b53463bb839e388285596f5"
dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7"
 from {username='slave'} at 127.0.0.1:57940
I20260709 13:00:03.220702  1102 raft_consensus.cc:493] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:03.221014  1102 raft_consensus.cc:3060] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:03.246889  1103 raft_consensus.cc:515] T cf424ea418ec409fbe7d9bc3e959c695 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 13:00:03.250062  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf424ea418ec409fbe7d9bc3e959c695" candidate_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4"
I20260709 13:00:03.250415  1251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf424ea418ec409fbe7d9bc3e959c695" candidate_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "76534c5775854ffb8239fb8bb2eead1b"
I20260709 13:00:03.250751  1178 raft_consensus.cc:3055] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:03.250993  1251 raft_consensus.cc:3060] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:03.250092  1103 leader_election.cc:290] T cf424ea418ec409fbe7d9bc3e959c695 P 28620b8df5964fb5bbbf51288ccbf9d7 [CANDIDATE]: Term 3 election: Requested vote from peers f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194:38543), 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195:35987)
I20260709 13:00:03.251220  1178 raft_consensus.cc:740] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f98885ef63a44cd68a9a8e97a14e7cb4, State: Running, Role: LEADER
I20260709 13:00:03.253427  1178 consensus_queue.cc:260] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 13:00:03.254359  1178 raft_consensus.cc:3060] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:03.293874  1409 raft_consensus.cc:993] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b: : Instructing follower 28620b8df5964fb5bbbf51288ccbf9d7 to start an election
I20260709 13:00:03.294466  1404 raft_consensus.cc:1081] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [term 3 LEADER]: Signalling peer 28620b8df5964fb5bbbf51288ccbf9d7 to start an election
I20260709 13:00:03.296003  1103 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53045d37f99e45ff83484a205d25c159"
dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7"
 from {username='slave'} at 127.0.0.1:57936
I20260709 13:00:03.296490  1103 raft_consensus.cc:493] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:03.296983  1103 raft_consensus.cc:3060] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:03.349814  1178 raft_consensus.cc:2468] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28620b8df5964fb5bbbf51288ccbf9d7 in term 3.
I20260709 13:00:03.349859  1251 raft_consensus.cc:2468] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28620b8df5964fb5bbbf51288ccbf9d7 in term 3.
I20260709 13:00:03.349855  1102 raft_consensus.cc:515] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 13:00:03.351469  1067 leader_election.cc:304] T cf424ea418ec409fbe7d9bc3e959c695 P 28620b8df5964fb5bbbf51288ccbf9d7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28620b8df5964fb5bbbf51288ccbf9d7, f98885ef63a44cd68a9a8e97a14e7cb4; no voters: 
I20260709 13:00:03.352494  1393 raft_consensus.cc:2804] T cf424ea418ec409fbe7d9bc3e959c695 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:03.353654  1102 leader_election.cc:290] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [CANDIDATE]: Term 3 election: Requested vote from peers f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194:38543), 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195:35987)
I20260709 13:00:03.355082  1251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ca940a7b53463bb839e388285596f5" candidate_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "76534c5775854ffb8239fb8bb2eead1b"
I20260709 13:00:03.355082  1393 raft_consensus.cc:697] T cf424ea418ec409fbe7d9bc3e959c695 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 3 LEADER]: Becoming Leader. State: Replica: 28620b8df5964fb5bbbf51288ccbf9d7, State: Running, Role: LEADER
I20260709 13:00:03.355348  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ca940a7b53463bb839e388285596f5" candidate_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4"
I20260709 13:00:03.355685  1251 raft_consensus.cc:3060] T 34ca940a7b53463bb839e388285596f5 P 76534c5775854ffb8239fb8bb2eead1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:03.355844  1178 raft_consensus.cc:3055] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:03.356175  1178 raft_consensus.cc:740] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f98885ef63a44cd68a9a8e97a14e7cb4, State: Running, Role: LEADER
I20260709 13:00:03.356261  1393 consensus_queue.cc:237] T cf424ea418ec409fbe7d9bc3e959c695 P 28620b8df5964fb5bbbf51288ccbf9d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 13:00:03.357055  1178 consensus_queue.cc:260] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 13:00:03.358451  1178 raft_consensus.cc:3060] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:03.364889  1000 catalog_manager.cc:5697] T cf424ea418ec409fbe7d9bc3e959c695 P 28620b8df5964fb5bbbf51288ccbf9d7 reported cstate change: term changed from 2 to 3, leader changed from f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194) to 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:03.447242  1251 raft_consensus.cc:2468] T 34ca940a7b53463bb839e388285596f5 P 76534c5775854ffb8239fb8bb2eead1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28620b8df5964fb5bbbf51288ccbf9d7 in term 3.
I20260709 13:00:03.447238  1178 raft_consensus.cc:2468] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28620b8df5964fb5bbbf51288ccbf9d7 in term 3.
I20260709 13:00:03.447321  1103 raft_consensus.cc:515] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 13:00:03.449313  1067 leader_election.cc:304] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28620b8df5964fb5bbbf51288ccbf9d7, f98885ef63a44cd68a9a8e97a14e7cb4; no voters: 
I20260709 13:00:03.449736  1103 leader_election.cc:290] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [CANDIDATE]: Term 4 election: Requested vote from peers f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194:38543), 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195:35987)
I20260709 13:00:03.450641  1393 raft_consensus.cc:2804] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:03.451154  1393 raft_consensus.cc:697] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 3 LEADER]: Becoming Leader. State: Replica: 28620b8df5964fb5bbbf51288ccbf9d7, State: Running, Role: LEADER
I20260709 13:00:03.452365  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53045d37f99e45ff83484a205d25c159" candidate_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4"
I20260709 13:00:03.452224  1393 consensus_queue.cc:237] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 13:00:03.452950  1178 raft_consensus.cc:3060] T 53045d37f99e45ff83484a205d25c159 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:03.453289  1251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53045d37f99e45ff83484a205d25c159" candidate_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "76534c5775854ffb8239fb8bb2eead1b"
I20260709 13:00:03.453855  1251 raft_consensus.cc:3055] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:03.454181  1251 raft_consensus.cc:740] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 76534c5775854ffb8239fb8bb2eead1b, State: Running, Role: LEADER
I20260709 13:00:03.455233  1251 consensus_queue.cc:260] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 13:00:03.456451  1251 raft_consensus.cc:3060] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:03.461315  1000 catalog_manager.cc:5697] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 reported cstate change: term changed from 2 to 3, leader changed from f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194) to 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:03.516086  1409 raft_consensus.cc:993] T 21562582b0a44dadbbadc702fd6b7b1b P 76534c5775854ffb8239fb8bb2eead1b: : Instructing follower 28620b8df5964fb5bbbf51288ccbf9d7 to start an election
I20260709 13:00:03.516646  1409 raft_consensus.cc:1081] T 21562582b0a44dadbbadc702fd6b7b1b P 76534c5775854ffb8239fb8bb2eead1b [term 3 LEADER]: Signalling peer 28620b8df5964fb5bbbf51288ccbf9d7 to start an election
I20260709 13:00:03.518453  1103 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21562582b0a44dadbbadc702fd6b7b1b"
dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7"
 from {username='slave'} at 127.0.0.1:57936
I20260709 13:00:03.518903  1103 raft_consensus.cc:493] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:03.519151  1103 raft_consensus.cc:3060] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:03.543531  1178 raft_consensus.cc:2468] T 53045d37f99e45ff83484a205d25c159 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28620b8df5964fb5bbbf51288ccbf9d7 in term 4.
I20260709 13:00:03.543569  1251 raft_consensus.cc:2468] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28620b8df5964fb5bbbf51288ccbf9d7 in term 4.
I20260709 13:00:03.543573  1103 raft_consensus.cc:515] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 13:00:03.544981  1067 leader_election.cc:304] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28620b8df5964fb5bbbf51288ccbf9d7, f98885ef63a44cd68a9a8e97a14e7cb4; no voters: 
I20260709 13:00:03.545858  1103 leader_election.cc:290] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7 [CANDIDATE]: Term 4 election: Requested vote from peers f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194:38543), 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195:35987)
I20260709 13:00:03.546770  1393 raft_consensus.cc:2804] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:03.547300  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562582b0a44dadbbadc702fd6b7b1b" candidate_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4"
I20260709 13:00:03.547587  1251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562582b0a44dadbbadc702fd6b7b1b" candidate_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "76534c5775854ffb8239fb8bb2eead1b"
I20260709 13:00:03.548684  1178 raft_consensus.cc:3060] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:03.547300  1393 raft_consensus.cc:697] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 4 LEADER]: Becoming Leader. State: Replica: 28620b8df5964fb5bbbf51288ccbf9d7, State: Running, Role: LEADER
I20260709 13:00:03.548884  1251 raft_consensus.cc:3055] T 21562582b0a44dadbbadc702fd6b7b1b P 76534c5775854ffb8239fb8bb2eead1b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:03.549402  1251 raft_consensus.cc:740] T 21562582b0a44dadbbadc702fd6b7b1b P 76534c5775854ffb8239fb8bb2eead1b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 76534c5775854ffb8239fb8bb2eead1b, State: Running, Role: LEADER
I20260709 13:00:03.549773  1393 consensus_queue.cc:237] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 13:00:03.550209  1251 consensus_queue.cc:260] T 21562582b0a44dadbbadc702fd6b7b1b P 76534c5775854ffb8239fb8bb2eead1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 13:00:03.551301  1251 raft_consensus.cc:3060] T 21562582b0a44dadbbadc702fd6b7b1b P 76534c5775854ffb8239fb8bb2eead1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:03.557132  1000 catalog_manager.cc:5697] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 reported cstate change: term changed from 3 to 4, leader changed from 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195) to 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:03.631227  1411 raft_consensus.cc:993] T 766aee4cd0ad4ca99e88106b9ee44bfd P f98885ef63a44cd68a9a8e97a14e7cb4: : Instructing follower 28620b8df5964fb5bbbf51288ccbf9d7 to start an election
I20260709 13:00:03.631628  1396 raft_consensus.cc:1081] T 766aee4cd0ad4ca99e88106b9ee44bfd P f98885ef63a44cd68a9a8e97a14e7cb4 [term 1 LEADER]: Signalling peer 28620b8df5964fb5bbbf51288ccbf9d7 to start an election
I20260709 13:00:03.633051  1103 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "766aee4cd0ad4ca99e88106b9ee44bfd"
dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7"
 from {username='slave'} at 127.0.0.1:57940
I20260709 13:00:03.633531  1103 raft_consensus.cc:493] T 766aee4cd0ad4ca99e88106b9ee44bfd P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:03.633852  1103 raft_consensus.cc:3060] T 766aee4cd0ad4ca99e88106b9ee44bfd P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:03.647289  1178 raft_consensus.cc:2468] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28620b8df5964fb5bbbf51288ccbf9d7 in term 4.
I20260709 13:00:03.647290  1251 raft_consensus.cc:2468] T 21562582b0a44dadbbadc702fd6b7b1b P 76534c5775854ffb8239fb8bb2eead1b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28620b8df5964fb5bbbf51288ccbf9d7 in term 4.
I20260709 13:00:03.647336  1103 raft_consensus.cc:515] T 766aee4cd0ad4ca99e88106b9ee44bfd P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 13:00:03.648903  1068 leader_election.cc:304] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28620b8df5964fb5bbbf51288ccbf9d7, 76534c5775854ffb8239fb8bb2eead1b; no voters: 
I20260709 13:00:03.649680  1103 leader_election.cc:290] T 766aee4cd0ad4ca99e88106b9ee44bfd P 28620b8df5964fb5bbbf51288ccbf9d7 [CANDIDATE]: Term 2 election: Requested vote from peers f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194:38543), 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195:35987)
I20260709 13:00:03.650439  1393 raft_consensus.cc:2804] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:03.650722  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766aee4cd0ad4ca99e88106b9ee44bfd" candidate_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4"
I20260709 13:00:03.651331  1178 raft_consensus.cc:3055] T 766aee4cd0ad4ca99e88106b9ee44bfd P f98885ef63a44cd68a9a8e97a14e7cb4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:03.651615  1178 raft_consensus.cc:740] T 766aee4cd0ad4ca99e88106b9ee44bfd P f98885ef63a44cd68a9a8e97a14e7cb4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f98885ef63a44cd68a9a8e97a14e7cb4, State: Running, Role: LEADER
I20260709 13:00:03.651634  1393 raft_consensus.cc:697] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7 [term 4 LEADER]: Becoming Leader. State: Replica: 28620b8df5964fb5bbbf51288ccbf9d7, State: Running, Role: LEADER
I20260709 13:00:03.651923  1251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766aee4cd0ad4ca99e88106b9ee44bfd" candidate_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "76534c5775854ffb8239fb8bb2eead1b"
I20260709 13:00:03.652661  1251 raft_consensus.cc:3060] T 766aee4cd0ad4ca99e88106b9ee44bfd P 76534c5775854ffb8239fb8bb2eead1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:03.652484  1178 consensus_queue.cc:260] T 766aee4cd0ad4ca99e88106b9ee44bfd P f98885ef63a44cd68a9a8e97a14e7cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 13:00:03.652649  1393 consensus_queue.cc:237] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 13:00:03.653688  1178 raft_consensus.cc:3060] T 766aee4cd0ad4ca99e88106b9ee44bfd P f98885ef63a44cd68a9a8e97a14e7cb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:03.658811  1000 catalog_manager.cc:5697] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7 reported cstate change: term changed from 3 to 4, leader changed from 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195) to 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:03.749060  1251 raft_consensus.cc:2468] T 766aee4cd0ad4ca99e88106b9ee44bfd P 76534c5775854ffb8239fb8bb2eead1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28620b8df5964fb5bbbf51288ccbf9d7 in term 2.
I20260709 13:00:03.749116  1178 raft_consensus.cc:2468] T 766aee4cd0ad4ca99e88106b9ee44bfd P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28620b8df5964fb5bbbf51288ccbf9d7 in term 2.
I20260709 13:00:03.750497  1067 leader_election.cc:304] T 766aee4cd0ad4ca99e88106b9ee44bfd P 28620b8df5964fb5bbbf51288ccbf9d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28620b8df5964fb5bbbf51288ccbf9d7, f98885ef63a44cd68a9a8e97a14e7cb4; no voters: 
I20260709 13:00:03.751302  1393 raft_consensus.cc:2804] T 766aee4cd0ad4ca99e88106b9ee44bfd P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:03.751876  1393 raft_consensus.cc:697] T 766aee4cd0ad4ca99e88106b9ee44bfd P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 LEADER]: Becoming Leader. State: Replica: 28620b8df5964fb5bbbf51288ccbf9d7, State: Running, Role: LEADER
I20260709 13:00:03.752733  1393 consensus_queue.cc:237] T 766aee4cd0ad4ca99e88106b9ee44bfd P 28620b8df5964fb5bbbf51288ccbf9d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 13:00:03.759872  1000 catalog_manager.cc:5697] T 766aee4cd0ad4ca99e88106b9ee44bfd P 28620b8df5964fb5bbbf51288ccbf9d7 reported cstate change: term changed from 1 to 2, leader changed from f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194) to 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:03.911267  1178 raft_consensus.cc:1275] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 3 FOLLOWER]: Refusing update from remote peer 28620b8df5964fb5bbbf51288ccbf9d7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:03.912628  1393 consensus_queue.cc:1048] T cf424ea418ec409fbe7d9bc3e959c695 P 28620b8df5964fb5bbbf51288ccbf9d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:03.922161  1251 raft_consensus.cc:1275] T 34ca940a7b53463bb839e388285596f5 P 76534c5775854ffb8239fb8bb2eead1b [term 3 FOLLOWER]: Refusing update from remote peer 28620b8df5964fb5bbbf51288ccbf9d7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:03.924126  1393 consensus_queue.cc:1048] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:03.926060  1251 raft_consensus.cc:1275] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b [term 3 FOLLOWER]: Refusing update from remote peer 28620b8df5964fb5bbbf51288ccbf9d7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:03.931278  1412 consensus_queue.cc:1048] T cf424ea418ec409fbe7d9bc3e959c695 P 28620b8df5964fb5bbbf51288ccbf9d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:03.936904  1178 raft_consensus.cc:1275] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 3 FOLLOWER]: Refusing update from remote peer 28620b8df5964fb5bbbf51288ccbf9d7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:03.941994  1393 consensus_queue.cc:1048] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:04.040870  1251 raft_consensus.cc:1275] T 21562582b0a44dadbbadc702fd6b7b1b P 76534c5775854ffb8239fb8bb2eead1b [term 4 FOLLOWER]: Refusing update from remote peer 28620b8df5964fb5bbbf51288ccbf9d7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:04.042140  1393 consensus_queue.cc:1048] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:04.050792  1178 raft_consensus.cc:1275] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4 [term 4 FOLLOWER]: Refusing update from remote peer 28620b8df5964fb5bbbf51288ccbf9d7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:04.052770  1412 consensus_queue.cc:1048] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:04.166196  1178 raft_consensus.cc:1275] T 53045d37f99e45ff83484a205d25c159 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 4 FOLLOWER]: Refusing update from remote peer 28620b8df5964fb5bbbf51288ccbf9d7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:04.167382  1412 consensus_queue.cc:1048] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:04.175722  1251 raft_consensus.cc:1275] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [term 4 FOLLOWER]: Refusing update from remote peer 28620b8df5964fb5bbbf51288ccbf9d7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:04.177163  1393 consensus_queue.cc:1048] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:04.212317  1251 raft_consensus.cc:1275] T 766aee4cd0ad4ca99e88106b9ee44bfd P 76534c5775854ffb8239fb8bb2eead1b [term 2 FOLLOWER]: Refusing update from remote peer 28620b8df5964fb5bbbf51288ccbf9d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:04.213681  1393 consensus_queue.cc:1048] T 766aee4cd0ad4ca99e88106b9ee44bfd P 28620b8df5964fb5bbbf51288ccbf9d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:04.222700  1178 raft_consensus.cc:1275] T 766aee4cd0ad4ca99e88106b9ee44bfd P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 FOLLOWER]: Refusing update from remote peer 28620b8df5964fb5bbbf51288ccbf9d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:04.224066  1393 consensus_queue.cc:1048] T 766aee4cd0ad4ca99e88106b9ee44bfd P 28620b8df5964fb5bbbf51288ccbf9d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:06.123957   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:06.131567  1103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34ca940a7b53463bb839e388285596f5"
dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7"
mode: GRACEFUL
new_leader_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4"
 from {username='slave'} at 127.0.0.1:40292
I20260709 13:00:06.132164  1103 raft_consensus.cc:606] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 3 LEADER]: Received request to transfer leadership to TS f98885ef63a44cd68a9a8e97a14e7cb4
I20260709 13:00:06.134618  1103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53045d37f99e45ff83484a205d25c159"
dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7"
mode: GRACEFUL
new_leader_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4"
 from {username='slave'} at 127.0.0.1:40292
I20260709 13:00:06.134992  1103 raft_consensus.cc:606] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 4 LEADER]: Received request to transfer leadership to TS f98885ef63a44cd68a9a8e97a14e7cb4
I20260709 13:00:06.137122  1103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6e533e49aba4111a0592ae2f0d6d5bb"
dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7"
mode: GRACEFUL
new_leader_uuid: "76534c5775854ffb8239fb8bb2eead1b"
 from {username='slave'} at 127.0.0.1:40292
I20260709 13:00:06.137476  1103 raft_consensus.cc:606] T b6e533e49aba4111a0592ae2f0d6d5bb P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 LEADER]: Received request to transfer leadership to TS 76534c5775854ffb8239fb8bb2eead1b
I20260709 13:00:06.139580  1103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3a86df4dce7431ebc3dd76609005812"
dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7"
mode: GRACEFUL
new_leader_uuid: "76534c5775854ffb8239fb8bb2eead1b"
 from {username='slave'} at 127.0.0.1:40292
I20260709 13:00:06.140010  1103 raft_consensus.cc:606] T c3a86df4dce7431ebc3dd76609005812 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 LEADER]: Received request to transfer leadership to TS 76534c5775854ffb8239fb8bb2eead1b
I20260709 13:00:06.141069   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:00:06.141538   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:06.300693  1435 raft_consensus.cc:993] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7: : Instructing follower f98885ef63a44cd68a9a8e97a14e7cb4 to start an election
I20260709 13:00:06.301316  1436 raft_consensus.cc:1081] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 3 LEADER]: Signalling peer f98885ef63a44cd68a9a8e97a14e7cb4 to start an election
I20260709 13:00:06.302861  1178 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34ca940a7b53463bb839e388285596f5"
dest_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4"
 from {username='slave'} at 127.0.0.1:38948
I20260709 13:00:06.303344  1178 raft_consensus.cc:493] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:06.303619  1178 raft_consensus.cc:3060] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:06.308396  1178 raft_consensus.cc:515] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 13:00:06.309878  1178 leader_election.cc:290] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 [CANDIDATE]: Term 4 election: Requested vote from peers 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193:41491), 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195:35987)
I20260709 13:00:06.310757  1103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ca940a7b53463bb839e388285596f5" candidate_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7"
I20260709 13:00:06.311050  1251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ca940a7b53463bb839e388285596f5" candidate_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "76534c5775854ffb8239fb8bb2eead1b"
I20260709 13:00:06.311347  1103 raft_consensus.cc:3055] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:06.311561  1251 raft_consensus.cc:3060] T 34ca940a7b53463bb839e388285596f5 P 76534c5775854ffb8239fb8bb2eead1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:06.311764  1103 raft_consensus.cc:740] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 28620b8df5964fb5bbbf51288ccbf9d7, State: Running, Role: LEADER
I20260709 13:00:06.312561  1103 consensus_queue.cc:260] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 13:00:06.313452  1103 raft_consensus.cc:3060] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:06.315917  1251 raft_consensus.cc:2468] T 34ca940a7b53463bb839e388285596f5 P 76534c5775854ffb8239fb8bb2eead1b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f98885ef63a44cd68a9a8e97a14e7cb4 in term 4.
I20260709 13:00:06.317375  1143 leader_election.cc:304] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76534c5775854ffb8239fb8bb2eead1b, f98885ef63a44cd68a9a8e97a14e7cb4; no voters: 
I20260709 13:00:06.317922  1103 raft_consensus.cc:2468] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f98885ef63a44cd68a9a8e97a14e7cb4 in term 4.
I20260709 13:00:06.318194  1411 raft_consensus.cc:2804] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:06.320217  1411 raft_consensus.cc:697] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 4 LEADER]: Becoming Leader. State: Replica: f98885ef63a44cd68a9a8e97a14e7cb4, State: Running, Role: LEADER
I20260709 13:00:06.321732  1411 consensus_queue.cc:237] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 13:00:06.329864  1000 catalog_manager.cc:5697] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 reported cstate change: term changed from 3 to 4, leader changed from 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193) to f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:06.523515  1435 raft_consensus.cc:993] T c3a86df4dce7431ebc3dd76609005812 P 28620b8df5964fb5bbbf51288ccbf9d7: : Instructing follower 76534c5775854ffb8239fb8bb2eead1b to start an election
I20260709 13:00:06.524053  1436 raft_consensus.cc:1081] T c3a86df4dce7431ebc3dd76609005812 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 LEADER]: Signalling peer 76534c5775854ffb8239fb8bb2eead1b to start an election
I20260709 13:00:06.525542  1251 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3a86df4dce7431ebc3dd76609005812"
dest_uuid: "76534c5775854ffb8239fb8bb2eead1b"
 from {username='slave'} at 127.0.0.1:59840
I20260709 13:00:06.526017  1251 raft_consensus.cc:493] T c3a86df4dce7431ebc3dd76609005812 P 76534c5775854ffb8239fb8bb2eead1b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:06.526496  1251 raft_consensus.cc:3060] T c3a86df4dce7431ebc3dd76609005812 P 76534c5775854ffb8239fb8bb2eead1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:06.530691  1251 raft_consensus.cc:515] T c3a86df4dce7431ebc3dd76609005812 P 76534c5775854ffb8239fb8bb2eead1b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 13:00:06.532094  1251 leader_election.cc:290] T c3a86df4dce7431ebc3dd76609005812 P 76534c5775854ffb8239fb8bb2eead1b [CANDIDATE]: Term 2 election: Requested vote from peers 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193:41491), f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194:38543)
I20260709 13:00:06.533053  1102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3a86df4dce7431ebc3dd76609005812" candidate_uuid: "76534c5775854ffb8239fb8bb2eead1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7"
I20260709 13:00:06.533178  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3a86df4dce7431ebc3dd76609005812" candidate_uuid: "76534c5775854ffb8239fb8bb2eead1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4"
I20260709 13:00:06.533704  1102 raft_consensus.cc:3055] T c3a86df4dce7431ebc3dd76609005812 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:06.533743  1178 raft_consensus.cc:3060] T c3a86df4dce7431ebc3dd76609005812 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:06.534067  1102 raft_consensus.cc:740] T c3a86df4dce7431ebc3dd76609005812 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 28620b8df5964fb5bbbf51288ccbf9d7, State: Running, Role: LEADER
I20260709 13:00:06.534730  1102 consensus_queue.cc:260] T c3a86df4dce7431ebc3dd76609005812 P 28620b8df5964fb5bbbf51288ccbf9d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 13:00:06.535573  1102 raft_consensus.cc:3060] T c3a86df4dce7431ebc3dd76609005812 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:06.539618  1178 raft_consensus.cc:2468] T c3a86df4dce7431ebc3dd76609005812 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76534c5775854ffb8239fb8bb2eead1b in term 2.
I20260709 13:00:06.541198  1216 leader_election.cc:304] T c3a86df4dce7431ebc3dd76609005812 P 76534c5775854ffb8239fb8bb2eead1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76534c5775854ffb8239fb8bb2eead1b, f98885ef63a44cd68a9a8e97a14e7cb4; no voters: 
I20260709 13:00:06.542158  1409 raft_consensus.cc:2804] T c3a86df4dce7431ebc3dd76609005812 P 76534c5775854ffb8239fb8bb2eead1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:06.543156  1102 raft_consensus.cc:2468] T c3a86df4dce7431ebc3dd76609005812 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76534c5775854ffb8239fb8bb2eead1b in term 2.
I20260709 13:00:06.547026  1435 raft_consensus.cc:993] T b6e533e49aba4111a0592ae2f0d6d5bb P 28620b8df5964fb5bbbf51288ccbf9d7: : Instructing follower 76534c5775854ffb8239fb8bb2eead1b to start an election
I20260709 13:00:06.547744  1435 raft_consensus.cc:1081] T b6e533e49aba4111a0592ae2f0d6d5bb P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 LEADER]: Signalling peer 76534c5775854ffb8239fb8bb2eead1b to start an election
I20260709 13:00:06.547101  1409 raft_consensus.cc:697] T c3a86df4dce7431ebc3dd76609005812 P 76534c5775854ffb8239fb8bb2eead1b [term 2 LEADER]: Becoming Leader. State: Replica: 76534c5775854ffb8239fb8bb2eead1b, State: Running, Role: LEADER
I20260709 13:00:06.548543  1436 raft_consensus.cc:993] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7: : Instructing follower f98885ef63a44cd68a9a8e97a14e7cb4 to start an election
I20260709 13:00:06.549044  1435 raft_consensus.cc:1081] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 4 LEADER]: Signalling peer f98885ef63a44cd68a9a8e97a14e7cb4 to start an election
I20260709 13:00:06.549444  1409 consensus_queue.cc:237] T c3a86df4dce7431ebc3dd76609005812 P 76534c5775854ffb8239fb8bb2eead1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 13:00:06.550827  1178 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53045d37f99e45ff83484a205d25c159"
dest_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4"
 from {username='slave'} at 127.0.0.1:38948
I20260709 13:00:06.550827  1251 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6e533e49aba4111a0592ae2f0d6d5bb"
dest_uuid: "76534c5775854ffb8239fb8bb2eead1b"
 from {username='slave'} at 127.0.0.1:59840
I20260709 13:00:06.551378  1178 raft_consensus.cc:493] T 53045d37f99e45ff83484a205d25c159 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:06.551580  1251 raft_consensus.cc:493] T b6e533e49aba4111a0592ae2f0d6d5bb P 76534c5775854ffb8239fb8bb2eead1b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:06.551802  1178 raft_consensus.cc:3060] T 53045d37f99e45ff83484a205d25c159 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:06.552074  1251 raft_consensus.cc:3060] T b6e533e49aba4111a0592ae2f0d6d5bb P 76534c5775854ffb8239fb8bb2eead1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:06.559537  1251 raft_consensus.cc:515] T b6e533e49aba4111a0592ae2f0d6d5bb P 76534c5775854ffb8239fb8bb2eead1b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } } peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } }
I20260709 13:00:06.559788  1178 raft_consensus.cc:515] T 53045d37f99e45ff83484a205d25c159 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 13:00:06.561637  1178 leader_election.cc:290] T 53045d37f99e45ff83484a205d25c159 P f98885ef63a44cd68a9a8e97a14e7cb4 [CANDIDATE]: Term 5 election: Requested vote from peers 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193:41491), 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195:35987)
I20260709 13:00:06.562254  1102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e533e49aba4111a0592ae2f0d6d5bb" candidate_uuid: "76534c5775854ffb8239fb8bb2eead1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7"
I20260709 13:00:06.561729  1000 catalog_manager.cc:5697] T c3a86df4dce7431ebc3dd76609005812 P 76534c5775854ffb8239fb8bb2eead1b reported cstate change: term changed from 1 to 2, leader changed from 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193) to 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195). New cstate: current_term: 2 leader_uuid: "76534c5775854ffb8239fb8bb2eead1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:06.562813  1102 raft_consensus.cc:3055] T b6e533e49aba4111a0592ae2f0d6d5bb P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:06.563117  1102 raft_consensus.cc:740] T b6e533e49aba4111a0592ae2f0d6d5bb P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 28620b8df5964fb5bbbf51288ccbf9d7, State: Running, Role: LEADER
I20260709 13:00:06.563630  1252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53045d37f99e45ff83484a205d25c159" candidate_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "76534c5775854ffb8239fb8bb2eead1b"
I20260709 13:00:06.564235  1252 raft_consensus.cc:3060] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:06.563866  1102 consensus_queue.cc:260] T b6e533e49aba4111a0592ae2f0d6d5bb P 28620b8df5964fb5bbbf51288ccbf9d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } } peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } }
I20260709 13:00:06.564515  1251 leader_election.cc:290] T b6e533e49aba4111a0592ae2f0d6d5bb P 76534c5775854ffb8239fb8bb2eead1b [CANDIDATE]: Term 2 election: Requested vote from peers 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193:41491), f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194:38543)
I20260709 13:00:06.564977  1102 raft_consensus.cc:3060] T b6e533e49aba4111a0592ae2f0d6d5bb P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:06.566352  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e533e49aba4111a0592ae2f0d6d5bb" candidate_uuid: "76534c5775854ffb8239fb8bb2eead1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4"
I20260709 13:00:06.563630  1103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53045d37f99e45ff83484a205d25c159" candidate_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "28620b8df5964fb5bbbf51288ccbf9d7"
I20260709 13:00:06.568161  1103 raft_consensus.cc:3055] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:06.568470  1103 raft_consensus.cc:740] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 28620b8df5964fb5bbbf51288ccbf9d7, State: Running, Role: LEADER
I20260709 13:00:06.568717  1178 raft_consensus.cc:3060] T b6e533e49aba4111a0592ae2f0d6d5bb P f98885ef63a44cd68a9a8e97a14e7cb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:06.569670  1103 consensus_queue.cc:260] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 13:00:06.570993  1103 raft_consensus.cc:3060] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:06.572131  1102 raft_consensus.cc:2468] T b6e533e49aba4111a0592ae2f0d6d5bb P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76534c5775854ffb8239fb8bb2eead1b in term 2.
I20260709 13:00:06.573426  1217 leader_election.cc:304] T b6e533e49aba4111a0592ae2f0d6d5bb P 76534c5775854ffb8239fb8bb2eead1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28620b8df5964fb5bbbf51288ccbf9d7, 76534c5775854ffb8239fb8bb2eead1b; no voters: 
I20260709 13:00:06.574223  1409 raft_consensus.cc:2804] T b6e533e49aba4111a0592ae2f0d6d5bb P 76534c5775854ffb8239fb8bb2eead1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:06.574855  1409 raft_consensus.cc:697] T b6e533e49aba4111a0592ae2f0d6d5bb P 76534c5775854ffb8239fb8bb2eead1b [term 2 LEADER]: Becoming Leader. State: Replica: 76534c5775854ffb8239fb8bb2eead1b, State: Running, Role: LEADER
I20260709 13:00:06.575754  1409 consensus_queue.cc:237] T b6e533e49aba4111a0592ae2f0d6d5bb P 76534c5775854ffb8239fb8bb2eead1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } } peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } }
I20260709 13:00:06.576328  1252 raft_consensus.cc:2468] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f98885ef63a44cd68a9a8e97a14e7cb4 in term 5.
I20260709 13:00:06.576470  1178 raft_consensus.cc:2468] T b6e533e49aba4111a0592ae2f0d6d5bb P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76534c5775854ffb8239fb8bb2eead1b in term 2.
I20260709 13:00:06.577824  1103 raft_consensus.cc:2468] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f98885ef63a44cd68a9a8e97a14e7cb4 in term 5.
I20260709 13:00:06.578351  1143 leader_election.cc:304] T 53045d37f99e45ff83484a205d25c159 P f98885ef63a44cd68a9a8e97a14e7cb4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76534c5775854ffb8239fb8bb2eead1b, f98885ef63a44cd68a9a8e97a14e7cb4; no voters: 
I20260709 13:00:06.579212  1411 raft_consensus.cc:2804] T 53045d37f99e45ff83484a205d25c159 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:06.579644  1411 raft_consensus.cc:697] T 53045d37f99e45ff83484a205d25c159 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 5 LEADER]: Becoming Leader. State: Replica: f98885ef63a44cd68a9a8e97a14e7cb4, State: Running, Role: LEADER
I20260709 13:00:06.580606  1411 consensus_queue.cc:237] T 53045d37f99e45ff83484a205d25c159 P f98885ef63a44cd68a9a8e97a14e7cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } }
I20260709 13:00:06.584190  1000 catalog_manager.cc:5697] T b6e533e49aba4111a0592ae2f0d6d5bb P 76534c5775854ffb8239fb8bb2eead1b reported cstate change: term changed from 1 to 2, leader changed from 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193) to 76534c5775854ffb8239fb8bb2eead1b (127.0.107.195). New cstate: current_term: 2 leader_uuid: "76534c5775854ffb8239fb8bb2eead1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:06.588876   997 catalog_manager.cc:5697] T 53045d37f99e45ff83484a205d25c159 P f98885ef63a44cd68a9a8e97a14e7cb4 reported cstate change: term changed from 4 to 5, leader changed from 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193) to f98885ef63a44cd68a9a8e97a14e7cb4 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:06.725991  1252 raft_consensus.cc:1275] T 34ca940a7b53463bb839e388285596f5 P 76534c5775854ffb8239fb8bb2eead1b [term 4 FOLLOWER]: Refusing update from remote peer f98885ef63a44cd68a9a8e97a14e7cb4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:06.727165  1411 consensus_queue.cc:1048] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:06.737095  1103 raft_consensus.cc:1275] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 4 FOLLOWER]: Refusing update from remote peer f98885ef63a44cd68a9a8e97a14e7cb4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:06.738627  1451 consensus_queue.cc:1048] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:07.003588  1103 raft_consensus.cc:1275] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 5 FOLLOWER]: Refusing update from remote peer f98885ef63a44cd68a9a8e97a14e7cb4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:00:07.005250  1451 consensus_queue.cc:1048] T 53045d37f99e45ff83484a205d25c159 P f98885ef63a44cd68a9a8e97a14e7cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:07.016116  1252 raft_consensus.cc:1275] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [term 5 FOLLOWER]: Refusing update from remote peer f98885ef63a44cd68a9a8e97a14e7cb4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:00:07.017920  1451 consensus_queue.cc:1048] T 53045d37f99e45ff83484a205d25c159 P f98885ef63a44cd68a9a8e97a14e7cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76534c5775854ffb8239fb8bb2eead1b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:07.059361  1103 raft_consensus.cc:1275] T c3a86df4dce7431ebc3dd76609005812 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 FOLLOWER]: Refusing update from remote peer 76534c5775854ffb8239fb8bb2eead1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:07.060518  1409 consensus_queue.cc:1048] T c3a86df4dce7431ebc3dd76609005812 P 76534c5775854ffb8239fb8bb2eead1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:07.070274  1178 raft_consensus.cc:1275] T c3a86df4dce7431ebc3dd76609005812 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 FOLLOWER]: Refusing update from remote peer 76534c5775854ffb8239fb8bb2eead1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:07.071906  1458 consensus_queue.cc:1048] T c3a86df4dce7431ebc3dd76609005812 P 76534c5775854ffb8239fb8bb2eead1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:07.110792  1103 raft_consensus.cc:1275] T b6e533e49aba4111a0592ae2f0d6d5bb P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 FOLLOWER]: Refusing update from remote peer 76534c5775854ffb8239fb8bb2eead1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:07.112052  1458 consensus_queue.cc:1048] T b6e533e49aba4111a0592ae2f0d6d5bb P 76534c5775854ffb8239fb8bb2eead1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "28620b8df5964fb5bbbf51288ccbf9d7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:07.120579  1178 raft_consensus.cc:1275] T b6e533e49aba4111a0592ae2f0d6d5bb P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 FOLLOWER]: Refusing update from remote peer 76534c5775854ffb8239fb8bb2eead1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:07.122109  1445 consensus_queue.cc:1048] T b6e533e49aba4111a0592ae2f0d6d5bb P 76534c5775854ffb8239fb8bb2eead1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f98885ef63a44cd68a9a8e97a14e7cb4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:07.142316   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:07.148794   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:00:07.176417   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:07.177174   431 tablet_replica.cc:333] T 766aee4cd0ad4ca99e88106b9ee44bfd P 28620b8df5964fb5bbbf51288ccbf9d7: stopping tablet replica
I20260709 13:00:07.177804   431 raft_consensus.cc:2243] T 766aee4cd0ad4ca99e88106b9ee44bfd P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:07.178530   431 raft_consensus.cc:2272] T 766aee4cd0ad4ca99e88106b9ee44bfd P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:07.180320   431 tablet_replica.cc:333] T 8a8ac1e3e54345718250fe8751bf234e P 28620b8df5964fb5bbbf51288ccbf9d7: stopping tablet replica
I20260709 13:00:07.180838   431 raft_consensus.cc:2243] T 8a8ac1e3e54345718250fe8751bf234e P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:07.181335   431 raft_consensus.cc:2272] T 8a8ac1e3e54345718250fe8751bf234e P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:07.183161   431 tablet_replica.cc:333] T cf424ea418ec409fbe7d9bc3e959c695 P 28620b8df5964fb5bbbf51288ccbf9d7: stopping tablet replica
I20260709 13:00:07.183856   431 raft_consensus.cc:2243] T cf424ea418ec409fbe7d9bc3e959c695 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:00:07.184595   431 raft_consensus.cc:2272] T cf424ea418ec409fbe7d9bc3e959c695 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:07.186391   431 tablet_replica.cc:333] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7: stopping tablet replica
I20260709 13:00:07.187049   431 raft_consensus.cc:2243] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:07.187592   431 raft_consensus.cc:2272] T 53045d37f99e45ff83484a205d25c159 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:07.190201   431 tablet_replica.cc:333] T b6e533e49aba4111a0592ae2f0d6d5bb P 28620b8df5964fb5bbbf51288ccbf9d7: stopping tablet replica
W20260709 13:00:07.190263  1217 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
I20260709 13:00:07.190817   431 raft_consensus.cc:2243] T b6e533e49aba4111a0592ae2f0d6d5bb P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:07.191259   431 raft_consensus.cc:2272] T b6e533e49aba4111a0592ae2f0d6d5bb P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:07.194028   431 tablet_replica.cc:333] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7: stopping tablet replica
W20260709 13:00:07.194103  1217 consensus_peers.cc:597] T 2b09c8c207814a50b328ea9a7de81a9d P 76534c5775854ffb8239fb8bb2eead1b -> Peer 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193:41491): Couldn't send request to peer 28620b8df5964fb5bbbf51288ccbf9d7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:07.194726   431 raft_consensus.cc:2243] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:07.195091   431 raft_consensus.cc:2272] T 34ca940a7b53463bb839e388285596f5 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:07.197324   431 tablet_replica.cc:333] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7: stopping tablet replica
I20260709 13:00:07.197825   431 raft_consensus.cc:2243] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:00:07.198484   431 raft_consensus.cc:2272] T 21562582b0a44dadbbadc702fd6b7b1b P 28620b8df5964fb5bbbf51288ccbf9d7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:07.200109   431 tablet_replica.cc:333] T c3a86df4dce7431ebc3dd76609005812 P 28620b8df5964fb5bbbf51288ccbf9d7: stopping tablet replica
I20260709 13:00:07.200549   431 raft_consensus.cc:2243] T c3a86df4dce7431ebc3dd76609005812 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:07.201002   431 raft_consensus.cc:2272] T c3a86df4dce7431ebc3dd76609005812 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:07.203733   431 tablet_replica.cc:333] T 2b09c8c207814a50b328ea9a7de81a9d P 28620b8df5964fb5bbbf51288ccbf9d7: stopping tablet replica
I20260709 13:00:07.204566   431 raft_consensus.cc:2243] T 2b09c8c207814a50b328ea9a7de81a9d P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:07.205192   431 raft_consensus.cc:2272] T 2b09c8c207814a50b328ea9a7de81a9d P 28620b8df5964fb5bbbf51288ccbf9d7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:07.206421  1143 consensus_peers.cc:597] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 -> Peer 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193:41491): Couldn't send request to peer 28620b8df5964fb5bbbf51288ccbf9d7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:07.207666   431 tablet_replica.cc:333] T 43365da3ffe345aa939dacc83fca01e2 P 28620b8df5964fb5bbbf51288ccbf9d7: stopping tablet replica
I20260709 13:00:07.208350   431 raft_consensus.cc:2243] T 43365da3ffe345aa939dacc83fca01e2 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:07.209316   431 raft_consensus.cc:2272] T 43365da3ffe345aa939dacc83fca01e2 P 28620b8df5964fb5bbbf51288ccbf9d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:07.238824   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 13:00:07.259004   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:00:07.283987   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:07.284735   431 tablet_replica.cc:333] T 53045d37f99e45ff83484a205d25c159 P f98885ef63a44cd68a9a8e97a14e7cb4: stopping tablet replica
I20260709 13:00:07.285391   431 raft_consensus.cc:2243] T 53045d37f99e45ff83484a205d25c159 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:00:07.286598   431 raft_consensus.cc:2272] T 53045d37f99e45ff83484a205d25c159 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:07.288748   431 tablet_replica.cc:333] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4: stopping tablet replica
I20260709 13:00:07.289415   431 raft_consensus.cc:2243] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:07.289872   431 raft_consensus.cc:2272] T cf424ea418ec409fbe7d9bc3e959c695 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:07.292243   431 tablet_replica.cc:333] T 2b09c8c207814a50b328ea9a7de81a9d P f98885ef63a44cd68a9a8e97a14e7cb4: stopping tablet replica
W20260709 13:00:07.292312  1143 consensus_peers.cc:597] T 8a8ac1e3e54345718250fe8751bf234e P f98885ef63a44cd68a9a8e97a14e7cb4 -> Peer 28620b8df5964fb5bbbf51288ccbf9d7 (127.0.107.193:41491): Couldn't send request to peer 28620b8df5964fb5bbbf51288ccbf9d7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41491: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:07.292888   431 raft_consensus.cc:2243] T 2b09c8c207814a50b328ea9a7de81a9d P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:07.293378   431 raft_consensus.cc:2272] T 2b09c8c207814a50b328ea9a7de81a9d P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:07.294982   431 tablet_replica.cc:333] T c3a86df4dce7431ebc3dd76609005812 P f98885ef63a44cd68a9a8e97a14e7cb4: stopping tablet replica
I20260709 13:00:07.295517   431 raft_consensus.cc:2243] T c3a86df4dce7431ebc3dd76609005812 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:07.295915   431 raft_consensus.cc:2272] T c3a86df4dce7431ebc3dd76609005812 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:07.297972   431 tablet_replica.cc:333] T 8a8ac1e3e54345718250fe8751bf234e P f98885ef63a44cd68a9a8e97a14e7cb4: stopping tablet replica
I20260709 13:00:07.298491   431 raft_consensus.cc:2243] T 8a8ac1e3e54345718250fe8751bf234e P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:07.299217   431 raft_consensus.cc:2272] T 8a8ac1e3e54345718250fe8751bf234e P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:07.300933   431 tablet_replica.cc:333] T 766aee4cd0ad4ca99e88106b9ee44bfd P f98885ef63a44cd68a9a8e97a14e7cb4: stopping tablet replica
I20260709 13:00:07.301453   431 raft_consensus.cc:2243] T 766aee4cd0ad4ca99e88106b9ee44bfd P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:07.301839   431 raft_consensus.cc:2272] T 766aee4cd0ad4ca99e88106b9ee44bfd P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:07.303399   431 tablet_replica.cc:333] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4: stopping tablet replica
I20260709 13:00:07.303879   431 raft_consensus.cc:2243] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:00:07.304612   431 raft_consensus.cc:2272] T 34ca940a7b53463bb839e388285596f5 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:07.306458   431 tablet_replica.cc:333] T b6e533e49aba4111a0592ae2f0d6d5bb P f98885ef63a44cd68a9a8e97a14e7cb4: stopping tablet replica
I20260709 13:00:07.306941   431 raft_consensus.cc:2243] T b6e533e49aba4111a0592ae2f0d6d5bb P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:07.307343   431 raft_consensus.cc:2272] T b6e533e49aba4111a0592ae2f0d6d5bb P f98885ef63a44cd68a9a8e97a14e7cb4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:07.309514   431 tablet_replica.cc:333] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4: stopping tablet replica
I20260709 13:00:07.309991   431 raft_consensus.cc:2243] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:07.310439   431 raft_consensus.cc:2272] T 21562582b0a44dadbbadc702fd6b7b1b P f98885ef63a44cd68a9a8e97a14e7cb4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:07.312088   431 tablet_replica.cc:333] T 43365da3ffe345aa939dacc83fca01e2 P f98885ef63a44cd68a9a8e97a14e7cb4: stopping tablet replica
I20260709 13:00:07.312507   431 raft_consensus.cc:2243] T 43365da3ffe345aa939dacc83fca01e2 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:07.312865   431 raft_consensus.cc:2272] T 43365da3ffe345aa939dacc83fca01e2 P f98885ef63a44cd68a9a8e97a14e7cb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:07.334957   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:00:07.354669   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:00:07.381815   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:07.382572   431 tablet_replica.cc:333] T 43365da3ffe345aa939dacc83fca01e2 P 76534c5775854ffb8239fb8bb2eead1b: stopping tablet replica
I20260709 13:00:07.383188   431 raft_consensus.cc:2243] T 43365da3ffe345aa939dacc83fca01e2 P 76534c5775854ffb8239fb8bb2eead1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:07.383663   431 raft_consensus.cc:2272] T 43365da3ffe345aa939dacc83fca01e2 P 76534c5775854ffb8239fb8bb2eead1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:07.385576   431 tablet_replica.cc:333] T 8a8ac1e3e54345718250fe8751bf234e P 76534c5775854ffb8239fb8bb2eead1b: stopping tablet replica
I20260709 13:00:07.386121   431 raft_consensus.cc:2243] T 8a8ac1e3e54345718250fe8751bf234e P 76534c5775854ffb8239fb8bb2eead1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:07.386572   431 raft_consensus.cc:2272] T 8a8ac1e3e54345718250fe8751bf234e P 76534c5775854ffb8239fb8bb2eead1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:07.388218   431 tablet_replica.cc:333] T 766aee4cd0ad4ca99e88106b9ee44bfd P 76534c5775854ffb8239fb8bb2eead1b: stopping tablet replica
I20260709 13:00:07.388731   431 raft_consensus.cc:2243] T 766aee4cd0ad4ca99e88106b9ee44bfd P 76534c5775854ffb8239fb8bb2eead1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:07.389189   431 raft_consensus.cc:2272] T 766aee4cd0ad4ca99e88106b9ee44bfd P 76534c5775854ffb8239fb8bb2eead1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:07.390802   431 tablet_replica.cc:333] T b6e533e49aba4111a0592ae2f0d6d5bb P 76534c5775854ffb8239fb8bb2eead1b: stopping tablet replica
I20260709 13:00:07.391347   431 raft_consensus.cc:2243] T b6e533e49aba4111a0592ae2f0d6d5bb P 76534c5775854ffb8239fb8bb2eead1b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:07.392056   431 raft_consensus.cc:2272] T b6e533e49aba4111a0592ae2f0d6d5bb P 76534c5775854ffb8239fb8bb2eead1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:07.393970   431 tablet_replica.cc:333] T 21562582b0a44dadbbadc702fd6b7b1b P 76534c5775854ffb8239fb8bb2eead1b: stopping tablet replica
I20260709 13:00:07.394480   431 raft_consensus.cc:2243] T 21562582b0a44dadbbadc702fd6b7b1b P 76534c5775854ffb8239fb8bb2eead1b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:07.394862   431 raft_consensus.cc:2272] T 21562582b0a44dadbbadc702fd6b7b1b P 76534c5775854ffb8239fb8bb2eead1b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:07.396348   431 tablet_replica.cc:333] T 34ca940a7b53463bb839e388285596f5 P 76534c5775854ffb8239fb8bb2eead1b: stopping tablet replica
I20260709 13:00:07.396912   431 raft_consensus.cc:2243] T 34ca940a7b53463bb839e388285596f5 P 76534c5775854ffb8239fb8bb2eead1b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:07.397490   431 raft_consensus.cc:2272] T 34ca940a7b53463bb839e388285596f5 P 76534c5775854ffb8239fb8bb2eead1b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:07.399391   431 tablet_replica.cc:333] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b: stopping tablet replica
I20260709 13:00:07.399894   431 raft_consensus.cc:2243] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:07.400298   431 raft_consensus.cc:2272] T 53045d37f99e45ff83484a205d25c159 P 76534c5775854ffb8239fb8bb2eead1b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:07.402245   431 tablet_replica.cc:333] T 2b09c8c207814a50b328ea9a7de81a9d P 76534c5775854ffb8239fb8bb2eead1b: stopping tablet replica
I20260709 13:00:07.402879   431 raft_consensus.cc:2243] T 2b09c8c207814a50b328ea9a7de81a9d P 76534c5775854ffb8239fb8bb2eead1b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:07.403615   431 raft_consensus.cc:2272] T 2b09c8c207814a50b328ea9a7de81a9d P 76534c5775854ffb8239fb8bb2eead1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:07.405241   431 tablet_replica.cc:333] T c3a86df4dce7431ebc3dd76609005812 P 76534c5775854ffb8239fb8bb2eead1b: stopping tablet replica
I20260709 13:00:07.405705   431 raft_consensus.cc:2243] T c3a86df4dce7431ebc3dd76609005812 P 76534c5775854ffb8239fb8bb2eead1b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:07.406458   431 raft_consensus.cc:2272] T c3a86df4dce7431ebc3dd76609005812 P 76534c5775854ffb8239fb8bb2eead1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:07.408512   431 tablet_replica.cc:333] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b: stopping tablet replica
I20260709 13:00:07.408972   431 raft_consensus.cc:2243] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:07.409473   431 raft_consensus.cc:2272] T cf424ea418ec409fbe7d9bc3e959c695 P 76534c5775854ffb8239fb8bb2eead1b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:07.428910   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:00:07.447014   431 master.cc:562] Master@127.0.107.254:38877 shutting down...
I20260709 13:00:07.469257   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d949ab00494940d3b92f4c8338f1ee4c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:07.469831   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d949ab00494940d3b92f4c8338f1ee4c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:07.470160   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P d949ab00494940d3b92f4c8338f1ee4c: stopping tablet replica
I20260709 13:00:07.491223   431 master.cc:584] Master@127.0.107.254:38877 shutdown complete.
28620b8df5964fb5bbbf51288ccbf9d7  5
76534c5775854ffb8239fb8bb2eead1b  1
f98885ef63a44cd68a9a8e97a14e7cb4  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10740 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:00:07.533694   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:37303
I20260709 13:00:07.534875   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:07.540351  1465 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:07.540479  1466 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:07.542550  1468 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:07.543520   431 server_base.cc:1061] running on GCE node
I20260709 13:00:07.544395   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:07.544616   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:07.544807   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602007544790 us; error 0 us; skew 500 ppm
I20260709 13:00:07.545397   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:07.547902   431 webserver.cc:533] Webserver started at http://127.0.107.254:43355/ using document root <none> and password file <none>
I20260709 13:00:07.548417   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:07.548626   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:07.548934   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:07.550314   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/master-0-root/instance:
uuid: "5b36a7ca64a64fb998a5720e2ed486da"
format_stamp: "Formatted at 2026-07-09 13:00:07 on dist-test-slave-g4pn"
I20260709 13:00:07.555073   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:00:07.558555  1473 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:07.559340   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:00:07.559650   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/master-0-root
uuid: "5b36a7ca64a64fb998a5720e2ed486da"
format_stamp: "Formatted at 2026-07-09 13:00:07 on dist-test-slave-g4pn"
I20260709 13:00:07.559965   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:07.575305   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:07.576615   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:07.616434   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:37303
I20260709 13:00:07.616525  1524 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:37303 every 8 connection(s)
I20260709 13:00:07.620434  1525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.630308  1525 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da: Bootstrap starting.
I20260709 13:00:07.634907  1525 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:07.639235  1525 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da: No bootstrap required, opened a new log
I20260709 13:00:07.641515  1525 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b36a7ca64a64fb998a5720e2ed486da" member_type: VOTER }
I20260709 13:00:07.641906  1525 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:07.642084  1525 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b36a7ca64a64fb998a5720e2ed486da, State: Initialized, Role: FOLLOWER
I20260709 13:00:07.642570  1525 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b36a7ca64a64fb998a5720e2ed486da" member_type: VOTER }
I20260709 13:00:07.642971  1525 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:00:07.643163  1525 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:00:07.643375  1525 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:07.647686  1525 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b36a7ca64a64fb998a5720e2ed486da" member_type: VOTER }
I20260709 13:00:07.648298  1525 leader_election.cc:304] T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5b36a7ca64a64fb998a5720e2ed486da; no voters: 
I20260709 13:00:07.649499  1525 leader_election.cc:290] T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:00:07.649773  1528 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:07.651158  1528 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da [term 1 LEADER]: Becoming Leader. State: Replica: 5b36a7ca64a64fb998a5720e2ed486da, State: Running, Role: LEADER
I20260709 13:00:07.651849  1528 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b36a7ca64a64fb998a5720e2ed486da" member_type: VOTER }
I20260709 13:00:07.652545  1525 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:00:07.657275  1530 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5b36a7ca64a64fb998a5720e2ed486da. Latest consensus state: current_term: 1 leader_uuid: "5b36a7ca64a64fb998a5720e2ed486da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b36a7ca64a64fb998a5720e2ed486da" member_type: VOTER } }
I20260709 13:00:07.658025  1530 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da [sys.catalog]: This master's current role is: LEADER
I20260709 13:00:07.659575  1529 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5b36a7ca64a64fb998a5720e2ed486da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b36a7ca64a64fb998a5720e2ed486da" member_type: VOTER } }
I20260709 13:00:07.659916  1535 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:00:07.660171  1529 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da [sys.catalog]: This master's current role is: LEADER
I20260709 13:00:07.668481  1535 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:00:07.669556   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:00:07.678267  1535 catalog_manager.cc:1383] Generated new cluster ID: 6780fa3b4c694b8da07055f76d8f163c
I20260709 13:00:07.678613  1535 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:00:07.706898  1535 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:00:07.708194  1535 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:00:07.722568  1535 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da: Generated new TSK 0
I20260709 13:00:07.723184  1535 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:00:07.736060   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:07.742741  1546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:07.743398  1547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:07.745404  1549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:07.746532   431 server_base.cc:1061] running on GCE node
I20260709 13:00:07.747574   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:07.747815   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:07.747993   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602007747976 us; error 0 us; skew 500 ppm
I20260709 13:00:07.748548   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:07.751205   431 webserver.cc:533] Webserver started at http://127.0.107.193:39935/ using document root <none> and password file <none>
I20260709 13:00:07.751736   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:07.751929   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:07.752213   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:07.753408   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-0-root/instance:
uuid: "6d4de2ce0683442498244b9529127f91"
format_stamp: "Formatted at 2026-07-09 13:00:07 on dist-test-slave-g4pn"
I20260709 13:00:07.758392   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:00:07.761919  1554 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:07.762777   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:00:07.763087   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-0-root
uuid: "6d4de2ce0683442498244b9529127f91"
format_stamp: "Formatted at 2026-07-09 13:00:07 on dist-test-slave-g4pn"
I20260709 13:00:07.763356   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:07.793576   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:07.794826   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:07.796320   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:07.798652   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:07.798887   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:07.799124   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:07.799314   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:07.841992   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:33325
I20260709 13:00:07.842093  1616 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:33325 every 8 connection(s)
I20260709 13:00:07.847009   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:07.853780  1621 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:07.854861  1622 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:07.857702  1624 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:07.858520   431 server_base.cc:1061] running on GCE node
I20260709 13:00:07.859759   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:07.860025   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:07.860204   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602007860189 us; error 0 us; skew 500 ppm
I20260709 13:00:07.860752   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:07.864223   431 webserver.cc:533] Webserver started at http://127.0.107.194:42435/ using document root <none> and password file <none>
I20260709 13:00:07.864845   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:07.865123   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:07.865447   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:07.865685  1617 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37303
I20260709 13:00:07.866041  1617 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:07.866840   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-1-root/instance:
uuid: "5bb87fe07da2414e84ee578c3b176ede"
format_stamp: "Formatted at 2026-07-09 13:00:07 on dist-test-slave-g4pn"
I20260709 13:00:07.866899  1617 heartbeater.cc:507] Master 127.0.107.254:37303 requested a full tablet report, sending...
I20260709 13:00:07.869228  1490 ts_manager.cc:194] Registered new tserver with Master: 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:00:07.870976  1490 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55132
I20260709 13:00:07.872321   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:00:07.875598  1629 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:07.876377   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:00:07.876672   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-1-root
uuid: "5bb87fe07da2414e84ee578c3b176ede"
format_stamp: "Formatted at 2026-07-09 13:00:07 on dist-test-slave-g4pn"
I20260709 13:00:07.876969   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:07.898526   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:07.899768   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:07.901484   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:07.904013   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:07.904197   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:07.904532   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:07.904683   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:07.947549   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:41683
I20260709 13:00:07.947592  1691 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:41683 every 8 connection(s)
I20260709 13:00:07.952988   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:07.959440  1695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:07.961691  1696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:07.963007  1698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:07.963814   431 server_base.cc:1061] running on GCE node
I20260709 13:00:07.965310   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:07.965600   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:07.965975   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602007965953 us; error 0 us; skew 500 ppm
I20260709 13:00:07.966711  1692 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37303
I20260709 13:00:07.966864   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:07.967094  1692 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:07.967972  1692 heartbeater.cc:507] Master 127.0.107.254:37303 requested a full tablet report, sending...
I20260709 13:00:07.970108   431 webserver.cc:533] Webserver started at http://127.0.107.195:40121/ using document root <none> and password file <none>
I20260709 13:00:07.970355  1490 ts_manager.cc:194] Registered new tserver with Master: 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:07.970655   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:07.971087   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:07.971364   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:07.972078  1490 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55138
I20260709 13:00:07.972759   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-2-root/instance:
uuid: "5ced62816f8545cd9b63a27e9055e42d"
format_stamp: "Formatted at 2026-07-09 13:00:07 on dist-test-slave-g4pn"
I20260709 13:00:07.977434   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:00:07.981045  1703 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:07.981933   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.002s
I20260709 13:00:07.982221   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-2-root
uuid: "5ced62816f8545cd9b63a27e9055e42d"
format_stamp: "Formatted at 2026-07-09 13:00:07 on dist-test-slave-g4pn"
I20260709 13:00:07.982657   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:08.010429   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:08.011620   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:08.013234   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:08.015614   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:08.015856   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:08.016126   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:08.016314   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:08.059368   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:32843
I20260709 13:00:08.059458  1765 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:32843 every 8 connection(s)
I20260709 13:00:08.074388  1766 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37303
I20260709 13:00:08.074724  1766 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:08.075387  1766 heartbeater.cc:507] Master 127.0.107.254:37303 requested a full tablet report, sending...
I20260709 13:00:08.077450  1490 ts_manager.cc:194] Registered new tserver with Master: 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:08.077872   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014926672s
I20260709 13:00:08.078948  1490 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55154
I20260709 13:00:08.106330  1490 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55168:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:00:08.112692  1490 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:00:08.327378  1731 tablet_service.cc:1511] Processing CreateTablet for tablet ae1310c9ee464797a39b786c1d932941 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:00:08.331676  1731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae1310c9ee464797a39b786c1d932941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.332759  1729 tablet_service.cc:1511] Processing CreateTablet for tablet 17b4f0abad654424ae8d47e63dbf2067 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:00:08.331323  1723 tablet_service.cc:1511] Processing CreateTablet for tablet 06d03acc62b5400ebdca03680f553818 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:00:08.333747  1722 tablet_service.cc:1511] Processing CreateTablet for tablet 7cf5139331dd452b8c2a035da1db88dc (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:00:08.334343  1723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06d03acc62b5400ebdca03680f553818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.335137  1722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cf5139331dd452b8c2a035da1db88dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.334909  1728 tablet_service.cc:1511] Processing CreateTablet for tablet 0fbe5a86d7bd4880843e631ffca572ce (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:00:08.336242  1728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fbe5a86d7bd4880843e631ffca572ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.338301  1727 tablet_service.cc:1511] Processing CreateTablet for tablet 3f75a0ee5c184536abc81f5a366016fb (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:00:08.339849  1727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f75a0ee5c184536abc81f5a366016fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.342293  1726 tablet_service.cc:1511] Processing CreateTablet for tablet 1633c35f1cea4228894a2e7872612d9e (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:00:08.343883  1726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1633c35f1cea4228894a2e7872612d9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.346252  1725 tablet_service.cc:1511] Processing CreateTablet for tablet c47af644bb6145d7bf8d0aaa1d74000d (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:00:08.347529  1725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c47af644bb6145d7bf8d0aaa1d74000d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.350309  1724 tablet_service.cc:1511] Processing CreateTablet for tablet d1fb6d43d14545a9872b287d4096ff1a (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:00:08.350939  1729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17b4f0abad654424ae8d47e63dbf2067. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.351771  1724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1fb6d43d14545a9872b287d4096ff1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.327593  1730 tablet_service.cc:1511] Processing CreateTablet for tablet ed05ccb8c31f47b18b3bdea87b5b2e3a (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:00:08.356586  1730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed05ccb8c31f47b18b3bdea87b5b2e3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.364416  1582 tablet_service.cc:1511] Processing CreateTablet for tablet ae1310c9ee464797a39b786c1d932941 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:00:08.365903  1582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae1310c9ee464797a39b786c1d932941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.365487  1579 tablet_service.cc:1511] Processing CreateTablet for tablet 0fbe5a86d7bd4880843e631ffca572ce (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:00:08.371507  1574 tablet_service.cc:1511] Processing CreateTablet for tablet 06d03acc62b5400ebdca03680f553818 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:00:08.374032  1575 tablet_service.cc:1511] Processing CreateTablet for tablet d1fb6d43d14545a9872b287d4096ff1a (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:00:08.376979  1578 tablet_service.cc:1511] Processing CreateTablet for tablet 3f75a0ee5c184536abc81f5a366016fb (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:00:08.377039  1573 tablet_service.cc:1511] Processing CreateTablet for tablet 7cf5139331dd452b8c2a035da1db88dc (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:00:08.377828  1577 tablet_service.cc:1511] Processing CreateTablet for tablet 1633c35f1cea4228894a2e7872612d9e (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:00:08.378719  1580 tablet_service.cc:1511] Processing CreateTablet for tablet 17b4f0abad654424ae8d47e63dbf2067 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:00:08.384678  1579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fbe5a86d7bd4880843e631ffca572ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.379673  1581 tablet_service.cc:1511] Processing CreateTablet for tablet ed05ccb8c31f47b18b3bdea87b5b2e3a (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:00:08.386579  1580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17b4f0abad654424ae8d47e63dbf2067. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.380354  1576 tablet_service.cc:1511] Processing CreateTablet for tablet c47af644bb6145d7bf8d0aaa1d74000d (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:00:08.390795  1581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed05ccb8c31f47b18b3bdea87b5b2e3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.391461  1574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06d03acc62b5400ebdca03680f553818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.392139  1577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1633c35f1cea4228894a2e7872612d9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.397423  1575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1fb6d43d14545a9872b287d4096ff1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.398689  1576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c47af644bb6145d7bf8d0aaa1d74000d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.401902  1573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cf5139331dd452b8c2a035da1db88dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.405771  1578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f75a0ee5c184536abc81f5a366016fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.405349  1727 tablet_service.cc:1511] Processing CreateTablet for tablet 3f40f76410ee41d696f4427ca4903962 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:00:08.407063  1727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f40f76410ee41d696f4427ca4903962. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.418673  1781 tablet_bootstrap.cc:492] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:08.421121  1725 tablet_service.cc:1511] Processing CreateTablet for tablet 75a149db07824e3fb3c1f721b61d6c20 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:00:08.422459  1725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75a149db07824e3fb3c1f721b61d6c20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.428005  1657 tablet_service.cc:1511] Processing CreateTablet for tablet ae1310c9ee464797a39b786c1d932941 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:00:08.429939  1657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae1310c9ee464797a39b786c1d932941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.432509  1656 tablet_service.cc:1511] Processing CreateTablet for tablet ed05ccb8c31f47b18b3bdea87b5b2e3a (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:00:08.440892  1656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed05ccb8c31f47b18b3bdea87b5b2e3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.446758  1655 tablet_service.cc:1511] Processing CreateTablet for tablet 17b4f0abad654424ae8d47e63dbf2067 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:00:08.448442  1655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17b4f0abad654424ae8d47e63dbf2067. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.448315  1651 tablet_service.cc:1511] Processing CreateTablet for tablet c47af644bb6145d7bf8d0aaa1d74000d (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:00:08.449751  1651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c47af644bb6145d7bf8d0aaa1d74000d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.450315  1654 tablet_service.cc:1511] Processing CreateTablet for tablet 0fbe5a86d7bd4880843e631ffca572ce (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:00:08.452117  1654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fbe5a86d7bd4880843e631ffca572ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.454273  1652 tablet_service.cc:1511] Processing CreateTablet for tablet 1633c35f1cea4228894a2e7872612d9e (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:00:08.455719  1652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1633c35f1cea4228894a2e7872612d9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.458374  1653 tablet_service.cc:1511] Processing CreateTablet for tablet 3f75a0ee5c184536abc81f5a366016fb (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:00:08.459789  1653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f75a0ee5c184536abc81f5a366016fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.464591  1723 tablet_service.cc:1511] Processing CreateTablet for tablet ef1be054223a4d3f90725c570db24bf5 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:00:08.484526  1722 tablet_service.cc:1511] Processing CreateTablet for tablet bd728f93afb447e384035fae1af6b006 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:00:08.487038  1582 tablet_service.cc:1511] Processing CreateTablet for tablet 3f40f76410ee41d696f4427ca4903962 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:00:08.488469  1582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f40f76410ee41d696f4427ca4903962. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.496668  1781 tablet_bootstrap.cc:654] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:08.501747  1578 tablet_service.cc:1511] Processing CreateTablet for tablet 75a149db07824e3fb3c1f721b61d6c20 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:00:08.503328  1578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75a149db07824e3fb3c1f721b61d6c20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.505362  1582 tablet_service.cc:1511] Processing CreateTablet for tablet ef1be054223a4d3f90725c570db24bf5 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:00:08.507102  1582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef1be054223a4d3f90725c570db24bf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.525710  1783 tablet_bootstrap.cc:492] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:08.531889  1650 tablet_service.cc:1511] Processing CreateTablet for tablet d1fb6d43d14545a9872b287d4096ff1a (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:00:08.533963  1782 tablet_bootstrap.cc:492] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:08.546003  1573 tablet_service.cc:1511] Processing CreateTablet for tablet bd728f93afb447e384035fae1af6b006 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:00:08.549345  1650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1fb6d43d14545a9872b287d4096ff1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.543028  1723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef1be054223a4d3f90725c570db24bf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.550940  1722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd728f93afb447e384035fae1af6b006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.557542  1730 tablet_service.cc:1511] Processing CreateTablet for tablet 90426dc5094b4f3c855ea9d2a43bc452 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:00:08.559129  1730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90426dc5094b4f3c855ea9d2a43bc452. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.558881  1649 tablet_service.cc:1511] Processing CreateTablet for tablet 7cf5139331dd452b8c2a035da1db88dc (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:00:08.560230  1649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cf5139331dd452b8c2a035da1db88dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.564981  1573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd728f93afb447e384035fae1af6b006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.565097  1783 tablet_bootstrap.cc:654] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:08.566231  1648 tablet_service.cc:1511] Processing CreateTablet for tablet 3f40f76410ee41d696f4427ca4903962 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:00:08.567663  1648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f40f76410ee41d696f4427ca4903962. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.572320  1656 tablet_service.cc:1511] Processing CreateTablet for tablet 06d03acc62b5400ebdca03680f553818 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:00:08.549913  1726 tablet_service.cc:1511] Processing CreateTablet for tablet c5248b829f494452a558e65e2342b6f0 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:00:08.574952  1782 tablet_bootstrap.cc:654] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:08.586632  1656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06d03acc62b5400ebdca03680f553818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.588743  1726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5248b829f494452a558e65e2342b6f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.611126  1579 tablet_service.cc:1511] Processing CreateTablet for tablet 0500c740c1014c08b4ea992c888446ed (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:00:08.613442  1580 tablet_service.cc:1511] Processing CreateTablet for tablet 99151421d7f641c2b26a05af014a9dc1 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:00:08.614085  1574 tablet_service.cc:1511] Processing CreateTablet for tablet d8f6e5a8ef2b453189832346af645cd8 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:00:08.615051  1580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99151421d7f641c2b26a05af014a9dc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.616040  1582 tablet_service.cc:1511] Processing CreateTablet for tablet 03d9f5135e0d4c0091fe4ba5bed83ffd (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:00:08.617368  1582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03d9f5135e0d4c0091fe4ba5bed83ffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.587702  1576 tablet_service.cc:1511] Processing CreateTablet for tablet 90426dc5094b4f3c855ea9d2a43bc452 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:00:08.550076  1724 tablet_service.cc:1511] Processing CreateTablet for tablet 03d9f5135e0d4c0091fe4ba5bed83ffd (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:00:08.621654  1655 tablet_service.cc:1511] Processing CreateTablet for tablet ef1be054223a4d3f90725c570db24bf5 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:00:08.622422  1581 tablet_service.cc:1511] Processing CreateTablet for tablet c5248b829f494452a558e65e2342b6f0 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:00:08.626118  1652 tablet_service.cc:1511] Processing CreateTablet for tablet 75a149db07824e3fb3c1f721b61d6c20 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:00:08.627367  1724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03d9f5135e0d4c0091fe4ba5bed83ffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.627856  1657 tablet_service.cc:1511] Processing CreateTablet for tablet bd728f93afb447e384035fae1af6b006 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:00:08.619796  1576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90426dc5094b4f3c855ea9d2a43bc452. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.639230  1577 tablet_service.cc:1511] Processing CreateTablet for tablet 35fc0eeb87e24045a897daa0ad5c400b (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:00:08.640550  1577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35fc0eeb87e24045a897daa0ad5c400b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.640264  1731 tablet_service.cc:1511] Processing CreateTablet for tablet 99151421d7f641c2b26a05af014a9dc1 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:00:08.642526  1731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99151421d7f641c2b26a05af014a9dc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.642869  1574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8f6e5a8ef2b453189832346af645cd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.642549  1578 tablet_service.cc:1511] Processing CreateTablet for tablet 3ed1f59ae1624d7ca7a1694c18500e49 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:00:08.646114  1578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ed1f59ae1624d7ca7a1694c18500e49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.646605  1729 tablet_service.cc:1511] Processing CreateTablet for tablet 0500c740c1014c08b4ea992c888446ed (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:00:08.647193  1781 tablet_bootstrap.cc:492] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:08.647682  1781 ts_tablet_manager.cc:1403] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.229s	user 0.018s	sys 0.011s
I20260709 13:00:08.647846  1729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0500c740c1014c08b4ea992c888446ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.650594  1781 raft_consensus.cc:359] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:08.651301  1781 raft_consensus.cc:385] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:08.651572  1781 raft_consensus.cc:740] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:08.652311  1781 consensus_queue.cc:260] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:08.654023  1579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0500c740c1014c08b4ea992c888446ed. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:00:08.663945  1538 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:08.676350  1651 tablet_service.cc:1511] Processing CreateTablet for tablet c5248b829f494452a558e65e2342b6f0 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:00:08.679111  1655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef1be054223a4d3f90725c570db24bf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.682102  1657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd728f93afb447e384035fae1af6b006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.683215  1652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75a149db07824e3fb3c1f721b61d6c20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.683982  1651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5248b829f494452a558e65e2342b6f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.683692  1724 tablet_service.cc:1511] Processing CreateTablet for tablet d8f6e5a8ef2b453189832346af645cd8 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:00:08.685163  1724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8f6e5a8ef2b453189832346af645cd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.699801  1729 tablet_service.cc:1511] Processing CreateTablet for tablet 3ed1f59ae1624d7ca7a1694c18500e49 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:00:08.701177  1729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ed1f59ae1624d7ca7a1694c18500e49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.719342  1723 tablet_service.cc:1511] Processing CreateTablet for tablet 390554a5bb3c4780b61e0fc806cea161 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:00:08.720693  1723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 390554a5bb3c4780b61e0fc806cea161. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.721153  1783 tablet_bootstrap.cc:492] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:08.724583  1575 tablet_service.cc:1511] Processing CreateTablet for tablet 0d14bd0bd4204ece94fb1bfe29d407f8 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:00:08.722504  1783 ts_tablet_manager.cc:1403] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.197s	user 0.024s	sys 0.032s
I20260709 13:00:08.726356  1781 ts_tablet_manager.cc:1434] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.078s	user 0.011s	sys 0.005s
I20260709 13:00:08.727092  1766 heartbeater.cc:499] Master 127.0.107.254:37303 was elected leader, sending a full tablet report...
I20260709 13:00:08.727398  1781 tablet_bootstrap.cc:492] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:08.688591  1731 tablet_service.cc:1511] Processing CreateTablet for tablet 35fc0eeb87e24045a897daa0ad5c400b (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:00:08.734061  1731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35fc0eeb87e24045a897daa0ad5c400b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.735920  1649 tablet_service.cc:1511] Processing CreateTablet for tablet 0500c740c1014c08b4ea992c888446ed (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:00:08.744012  1651 tablet_service.cc:1511] Processing CreateTablet for tablet 99151421d7f641c2b26a05af014a9dc1 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:00:08.715099  1581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5248b829f494452a558e65e2342b6f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.745319  1727 tablet_service.cc:1511] Processing CreateTablet for tablet 0d14bd0bd4204ece94fb1bfe29d407f8 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:00:08.746313  1575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d14bd0bd4204ece94fb1bfe29d407f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.750408  1649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0500c740c1014c08b4ea992c888446ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.752246  1573 tablet_service.cc:1511] Processing CreateTablet for tablet 7e07e22e745346fa98096d8b909dc7f5 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:00:08.753026  1782 tablet_bootstrap.cc:492] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:08.753579  1782 ts_tablet_manager.cc:1403] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.220s	user 0.007s	sys 0.024s
I20260709 13:00:08.756964  1782 raft_consensus.cc:359] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:08.758423  1782 raft_consensus.cc:385] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:08.758740  1782 raft_consensus.cc:740] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:08.759790  1651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99151421d7f641c2b26a05af014a9dc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.762888  1782 consensus_queue.cc:260] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:08.766135  1728 tablet_service.cc:1511] Processing CreateTablet for tablet 7e07e22e745346fa98096d8b909dc7f5 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:00:08.767490  1728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e07e22e745346fa98096d8b909dc7f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.777521  1727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d14bd0bd4204ece94fb1bfe29d407f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.712893  1656 tablet_service.cc:1511] Processing CreateTablet for tablet 90426dc5094b4f3c855ea9d2a43bc452 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:00:08.779536  1656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90426dc5094b4f3c855ea9d2a43bc452. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.777704  1783 raft_consensus.cc:359] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:08.793009  1576 tablet_service.cc:1511] Processing CreateTablet for tablet 67b5a70a2de54935b60554301e6de808 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:00:08.781148  1783 raft_consensus.cc:385] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:08.794720  1783 raft_consensus.cc:740] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:08.795895  1783 consensus_queue.cc:260] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:08.798677  1653 tablet_service.cc:1511] Processing CreateTablet for tablet 35fc0eeb87e24045a897daa0ad5c400b (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:00:08.799440  1651 tablet_service.cc:1511] Processing CreateTablet for tablet 3ed1f59ae1624d7ca7a1694c18500e49 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:00:08.799991  1653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35fc0eeb87e24045a897daa0ad5c400b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.800750  1651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ed1f59ae1624d7ca7a1694c18500e49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.787675  1654 tablet_service.cc:1511] Processing CreateTablet for tablet 03d9f5135e0d4c0091fe4ba5bed83ffd (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:00:08.803402  1654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03d9f5135e0d4c0091fe4ba5bed83ffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.815443  1725 tablet_service.cc:1511] Processing CreateTablet for tablet 67b5a70a2de54935b60554301e6de808 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:00:08.816808  1725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67b5a70a2de54935b60554301e6de808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.820086  1573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e07e22e745346fa98096d8b909dc7f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.818857  1651 tablet_service.cc:1511] Processing CreateTablet for tablet 390554a5bb3c4780b61e0fc806cea161 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:00:08.840019  1726 tablet_service.cc:1511] Processing CreateTablet for tablet 40fb069a8f6e4d0c885835eee0132b00 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:00:08.840986  1648 tablet_service.cc:1511] Processing CreateTablet for tablet d8f6e5a8ef2b453189832346af645cd8 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:00:08.842054  1580 tablet_service.cc:1511] Processing CreateTablet for tablet 40fb069a8f6e4d0c885835eee0132b00 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:00:08.842476  1648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8f6e5a8ef2b453189832346af645cd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.843317  1580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40fb069a8f6e4d0c885835eee0132b00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.847272  1726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40fb069a8f6e4d0c885835eee0132b00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.834136  1781 tablet_bootstrap.cc:654] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:08.854614  1782 ts_tablet_manager.cc:1434] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.101s	user 0.030s	sys 0.029s
I20260709 13:00:08.854740  1617 heartbeater.cc:499] Master 127.0.107.254:37303 was elected leader, sending a full tablet report...
I20260709 13:00:08.860181  1723 tablet_service.cc:1511] Processing CreateTablet for tablet b37805060ac444b6b6e9e7da8164233c (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:00:08.852741  1582 tablet_service.cc:1511] Processing CreateTablet for tablet 390554a5bb3c4780b61e0fc806cea161 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:00:08.881173  1722 tablet_service.cc:1511] Processing CreateTablet for tablet 161aba2b69844461b9d8ed3cdf147919 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:00:08.882635  1782 tablet_bootstrap.cc:492] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:08.890751  1652 tablet_service.cc:1511] Processing CreateTablet for tablet 0d14bd0bd4204ece94fb1bfe29d407f8 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:00:08.897359  1651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 390554a5bb3c4780b61e0fc806cea161. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.898932  1581 tablet_service.cc:1511] Processing CreateTablet for tablet 161aba2b69844461b9d8ed3cdf147919 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:00:08.876204  1576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67b5a70a2de54935b60554301e6de808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.910332  1574 tablet_service.cc:1511] Processing CreateTablet for tablet b37805060ac444b6b6e9e7da8164233c (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:00:08.911697  1574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b37805060ac444b6b6e9e7da8164233c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.919970  1578 tablet_service.cc:1511] Processing CreateTablet for tablet 5b8e576fb1634970b28a86f720e85f9a (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:00:08.933943  1783 ts_tablet_manager.cc:1434] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.207s	user 0.028s	sys 0.026s
I20260709 13:00:08.933830  1649 tablet_service.cc:1511] Processing CreateTablet for tablet 7e07e22e745346fa98096d8b909dc7f5 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:00:08.934954  1692 heartbeater.cc:499] Master 127.0.107.254:37303 was elected leader, sending a full tablet report...
I20260709 13:00:08.935556  1652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d14bd0bd4204ece94fb1bfe29d407f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.941238  1723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b37805060ac444b6b6e9e7da8164233c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.946403  1650 tablet_service.cc:1511] Processing CreateTablet for tablet 67b5a70a2de54935b60554301e6de808 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:00:08.947937  1650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67b5a70a2de54935b60554301e6de808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.950635  1655 tablet_service.cc:1511] Processing CreateTablet for tablet 40fb069a8f6e4d0c885835eee0132b00 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:00:08.952122  1655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40fb069a8f6e4d0c885835eee0132b00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.963008  1657 tablet_service.cc:1511] Processing CreateTablet for tablet b37805060ac444b6b6e9e7da8164233c (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:00:08.969849  1722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 161aba2b69844461b9d8ed3cdf147919. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.973251  1582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 390554a5bb3c4780b61e0fc806cea161. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.973896  1581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 161aba2b69844461b9d8ed3cdf147919. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.976526  1783 tablet_bootstrap.cc:492] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:08.981215  1657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b37805060ac444b6b6e9e7da8164233c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.982582  1781 tablet_bootstrap.cc:492] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:08.983111  1781 ts_tablet_manager.cc:1403] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.256s	user 0.008s	sys 0.004s
I20260709 13:00:08.984573  1649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e07e22e745346fa98096d8b909dc7f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.989626  1789 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.990144  1789 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:08.993171  1580 tablet_service.cc:1511] Processing CreateTablet for tablet 8f63738689324ca9a4caa66b9aee2a78 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:00:08.994434  1580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f63738689324ca9a4caa66b9aee2a78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.997968  1578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b8e576fb1634970b28a86f720e85f9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:08.998991  1783 tablet_bootstrap.cc:654] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:09.002391  1723 tablet_service.cc:1511] Processing CreateTablet for tablet 5b8e576fb1634970b28a86f720e85f9a (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:00:09.003731  1723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b8e576fb1634970b28a86f720e85f9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.003768  1727 tablet_service.cc:1511] Processing CreateTablet for tablet 8f63738689324ca9a4caa66b9aee2a78 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:00:09.005312  1727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f63738689324ca9a4caa66b9aee2a78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.012686  1788 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.013262  1788 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:09.013643  1789 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:09.014590  1782 tablet_bootstrap.cc:654] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:09.019248  1788 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:09.029285  1656 tablet_service.cc:1511] Processing CreateTablet for tablet 161aba2b69844461b9d8ed3cdf147919 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:00:09.040084  1656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 161aba2b69844461b9d8ed3cdf147919. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.040997  1653 tablet_service.cc:1511] Processing CreateTablet for tablet 5b8e576fb1634970b28a86f720e85f9a (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:00:09.046667  1653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b8e576fb1634970b28a86f720e85f9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.050215  1654 tablet_service.cc:1511] Processing CreateTablet for tablet 8f63738689324ca9a4caa66b9aee2a78 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:00:09.051693  1654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f63738689324ca9a4caa66b9aee2a78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.055157  1781 raft_consensus.cc:359] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:09.056036  1781 raft_consensus.cc:385] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:09.056339  1781 raft_consensus.cc:740] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:09.073333  1579 tablet_service.cc:1511] Processing CreateTablet for tablet c03a2285eaff45a6a236c5eae38fb06f (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:00:09.074537  1787 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.074736  1579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c03a2285eaff45a6a236c5eae38fb06f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.075064  1787 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:09.084147  1787 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:09.057068  1781 consensus_queue.cc:260] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:09.164381  1781 ts_tablet_manager.cc:1434] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.181s	user 0.009s	sys 0.002s
I20260709 13:00:09.165761  1781 tablet_bootstrap.cc:492] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:09.175765  1722 tablet_service.cc:1511] Processing CreateTablet for tablet c03a2285eaff45a6a236c5eae38fb06f (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:00:09.177165  1722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c03a2285eaff45a6a236c5eae38fb06f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.206050  1729 tablet_service.cc:1511] Processing CreateTablet for tablet 81635b0a041d4e6da9f7499ecb70dcc2 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:00:09.207403  1729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81635b0a041d4e6da9f7499ecb70dcc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.208632  1579 tablet_service.cc:1511] Processing CreateTablet for tablet 3aff654153ad4acfa774f838f37c0604 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:00:09.210105  1579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3aff654153ad4acfa774f838f37c0604. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.219959  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:09.221233  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:09.222826  1633 leader_election.cc:343] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:09.223222  1781 tablet_bootstrap.cc:654] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:09.223358  1556 leader_election.cc:343] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:09.230589  1650 tablet_service.cc:1511] Processing CreateTablet for tablet 3aff654153ad4acfa774f838f37c0604 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:00:09.232065  1650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3aff654153ad4acfa774f838f37c0604. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.238008  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:09.239046  1783 tablet_bootstrap.cc:492] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:09.238807  1592 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 0.
I20260709 13:00:09.240257  1707 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:09.241187  1787 raft_consensus.cc:2804] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:09.241571  1787 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:09.241920  1787 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:09.246476  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:09.249001  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:09.248914  1787 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:09.250695  1741 raft_consensus.cc:2393] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 1: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
W20260709 13:00:09.250771  1633 leader_election.cc:343] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:09.254102  1651 tablet_service.cc:1511] Processing CreateTablet for tablet c03a2285eaff45a6a236c5eae38fb06f (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:00:09.254448  1633 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:09.255568  1651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c03a2285eaff45a6a236c5eae38fb06f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.256153  1790 raft_consensus.cc:2749] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:09.257926  1558 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:09.259162  1788 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:09.268292  1788 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:09.271772  1722 tablet_service.cc:1511] Processing CreateTablet for tablet 3aff654153ad4acfa774f838f37c0604 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:00:09.272136  1581 tablet_service.cc:1511] Processing CreateTablet for tablet 81635b0a041d4e6da9f7499ecb70dcc2 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:00:09.273156  1722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3aff654153ad4acfa774f838f37c0604. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.278735  1782 tablet_bootstrap.cc:492] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:09.279285  1782 ts_tablet_manager.cc:1403] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.397s	user 0.014s	sys 0.030s
I20260709 13:00:09.278736  1580 tablet_service.cc:1511] Processing CreateTablet for tablet 67258bf3ca484bd099fd3ec7923aee78 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:00:09.281745  1581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81635b0a041d4e6da9f7499ecb70dcc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.283347  1648 tablet_service.cc:1511] Processing CreateTablet for tablet 81635b0a041d4e6da9f7499ecb70dcc2 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:00:09.283551  1782 raft_consensus.cc:359] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } }
I20260709 13:00:09.284523  1782 raft_consensus.cc:385] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:09.284816  1782 raft_consensus.cc:740] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:09.286990  1580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67258bf3ca484bd099fd3ec7923aee78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.253856  1783 ts_tablet_manager.cc:1403] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.277s	user 0.023s	sys 0.021s
I20260709 13:00:09.305357  1782 consensus_queue.cc:260] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } }
I20260709 13:00:09.297432  1655 tablet_service.cc:1511] Processing CreateTablet for tablet 67258bf3ca484bd099fd3ec7923aee78 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:00:09.309158  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:09.310845  1705 leader_election.cc:343] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:09.313493  1648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81635b0a041d4e6da9f7499ecb70dcc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.314543  1655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67258bf3ca484bd099fd3ec7923aee78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.316079  1783 raft_consensus.cc:359] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } }
I20260709 13:00:09.316769  1783 raft_consensus.cc:385] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:09.317147  1783 raft_consensus.cc:740] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:09.317994  1783 consensus_queue.cc:260] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } }
I20260709 13:00:09.320297  1783 ts_tablet_manager.cc:1434] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.002s
I20260709 13:00:09.324223  1574 tablet_service.cc:1511] Processing CreateTablet for tablet 2782217725024e159b9536d03808a3ea (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:00:09.325829  1574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2782217725024e159b9536d03808a3ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.326116  1787 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:09.330842  1781 tablet_bootstrap.cc:492] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:09.331359  1781 ts_tablet_manager.cc:1403] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.166s	user 0.015s	sys 0.027s
I20260709 13:00:09.331729  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:09.332525  1729 tablet_service.cc:1511] Processing CreateTablet for tablet 67258bf3ca484bd099fd3ec7923aee78 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:00:09.334827  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:00:09.336133  1705 leader_election.cc:343] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:09.336480  1782 ts_tablet_manager.cc:1434] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
I20260709 13:00:09.337459  1729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67258bf3ca484bd099fd3ec7923aee78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.337510  1782 tablet_bootstrap.cc:492] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:09.339488  1592 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:09.340754  1707 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:09.342254  1651 tablet_service.cc:1511] Processing CreateTablet for tablet 2782217725024e159b9536d03808a3ea (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:00:09.343498  1651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2782217725024e159b9536d03808a3ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.345288  1783 tablet_bootstrap.cc:492] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:09.348407  1723 tablet_service.cc:1511] Processing CreateTablet for tablet 2782217725024e159b9536d03808a3ea (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:00:09.349687  1723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2782217725024e159b9536d03808a3ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.355300  1573 tablet_service.cc:1511] Processing CreateTablet for tablet c3d6305e583540c895021f5a180689f7 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:00:09.355681  1728 tablet_service.cc:1511] Processing CreateTablet for tablet d1883da16ec44d2a8304d3909471b4b1 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:00:09.356663  1573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3d6305e583540c895021f5a180689f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.356850  1728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1883da16ec44d2a8304d3909471b4b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.357831  1781 raft_consensus.cc:359] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:09.358575  1781 raft_consensus.cc:385] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:09.358845  1781 raft_consensus.cc:740] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:09.360597  1652 tablet_service.cc:1511] Processing CreateTablet for tablet 2c8e0ac7d1de40fdb93dc3a4e799e876 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:00:09.360859  1650 tablet_service.cc:1511] Processing CreateTablet for tablet c3d6305e583540c895021f5a180689f7 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:00:09.362041  1652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c8e0ac7d1de40fdb93dc3a4e799e876. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.364187  1731 tablet_service.cc:1511] Processing CreateTablet for tablet c3d6305e583540c895021f5a180689f7 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:00:09.365417  1650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3d6305e583540c895021f5a180689f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.365715  1731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3d6305e583540c895021f5a180689f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.365531  1656 tablet_service.cc:1511] Processing CreateTablet for tablet c9831da869404fb79a22d3887701ca69 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:00:09.366822  1656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9831da869404fb79a22d3887701ca69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.367810  1783 tablet_bootstrap.cc:654] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:09.370507  1726 tablet_service.cc:1511] Processing CreateTablet for tablet 2c8e0ac7d1de40fdb93dc3a4e799e876 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:00:09.371922  1726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c8e0ac7d1de40fdb93dc3a4e799e876. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.373940  1782 tablet_bootstrap.cc:654] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:09.379550  1576 tablet_service.cc:1511] Processing CreateTablet for tablet c9831da869404fb79a22d3887701ca69 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:00:09.380867  1576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9831da869404fb79a22d3887701ca69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.359594  1781 consensus_queue.cc:260] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:09.342283  1787 raft_consensus.cc:2804] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:09.384362  1575 tablet_service.cc:1511] Processing CreateTablet for tablet c26b89190fef4c8199109d4bbabf2395 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:00:09.387813  1575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c26b89190fef4c8199109d4bbabf2395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.387526  1657 tablet_service.cc:1511] Processing CreateTablet for tablet c26b89190fef4c8199109d4bbabf2395 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:00:09.388813  1657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c26b89190fef4c8199109d4bbabf2395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.388664  1727 tablet_service.cc:1511] Processing CreateTablet for tablet c9831da869404fb79a22d3887701ca69 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:00:09.393129  1727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9831da869404fb79a22d3887701ca69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.393699  1582 tablet_service.cc:1511] Processing CreateTablet for tablet 906dda27b6f84a53b2365339db2e3652 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:00:09.394937  1582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 906dda27b6f84a53b2365339db2e3652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.398116  1655 tablet_service.cc:1511] Processing CreateTablet for tablet d1883da16ec44d2a8304d3909471b4b1 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:00:09.399399  1655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1883da16ec44d2a8304d3909471b4b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.399436  1653 tablet_service.cc:1511] Processing CreateTablet for tablet 906dda27b6f84a53b2365339db2e3652 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:00:09.400884  1653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 906dda27b6f84a53b2365339db2e3652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.391362  1722 tablet_service.cc:1511] Processing CreateTablet for tablet c26b89190fef4c8199109d4bbabf2395 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:00:09.401826  1722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c26b89190fef4c8199109d4bbabf2395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.406008  1579 tablet_service.cc:1511] Processing CreateTablet for tablet 2c8e0ac7d1de40fdb93dc3a4e799e876 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:00:09.407595  1579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c8e0ac7d1de40fdb93dc3a4e799e876. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.410403  1578 tablet_service.cc:1511] Processing CreateTablet for tablet d1883da16ec44d2a8304d3909471b4b1 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:00:09.435652  1724 tablet_service.cc:1511] Processing CreateTablet for tablet 906dda27b6f84a53b2365339db2e3652 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:00:09.435987  1581 tablet_service.cc:1511] Processing CreateTablet for tablet 619fbae81e504a9b9671de42f0e75aea (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:00:09.437064  1724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 906dda27b6f84a53b2365339db2e3652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.441615  1581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 619fbae81e504a9b9671de42f0e75aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.449044  1654 tablet_service.cc:1511] Processing CreateTablet for tablet 619fbae81e504a9b9671de42f0e75aea (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:00:09.450744  1654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 619fbae81e504a9b9671de42f0e75aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.451979  1649 tablet_service.cc:1511] Processing CreateTablet for tablet 7b0a975df857466d9daf2f71f1c98623 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:00:09.450317  1577 tablet_service.cc:1511] Processing CreateTablet for tablet 7b0a975df857466d9daf2f71f1c98623 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:00:09.453835  1577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b0a975df857466d9daf2f71f1c98623. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.455159  1725 tablet_service.cc:1511] Processing CreateTablet for tablet 619fbae81e504a9b9671de42f0e75aea (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:00:09.456507  1725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 619fbae81e504a9b9671de42f0e75aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.458168  1730 tablet_service.cc:1511] Processing CreateTablet for tablet 7b0a975df857466d9daf2f71f1c98623 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:00:09.459463  1730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b0a975df857466d9daf2f71f1c98623. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.462697  1788 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.463184  1788 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } }
I20260709 13:00:09.466495  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:00:09.468331  1558 leader_election.cc:343] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:09.469347  1649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b0a975df857466d9daf2f71f1c98623. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.470615  1781 ts_tablet_manager.cc:1434] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.139s	user 0.009s	sys 0.008s
I20260709 13:00:09.471685  1781 tablet_bootstrap.cc:492] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:09.473508  1788 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:09.475068  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:09.475718  1667 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 0.
I20260709 13:00:09.476962  1556 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:09.478677  1788 raft_consensus.cc:2804] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:09.479075  1788 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:09.479393  1788 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:09.486654  1788 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } }
I20260709 13:00:09.489616  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:00:09.491251  1558 leader_election.cc:343] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:09.493806  1726 tablet_service.cc:1511] Processing CreateTablet for tablet 8c784821c4a84bc7ba32cb6e34fbb225 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:00:09.495508  1726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c784821c4a84bc7ba32cb6e34fbb225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.492950  1781 tablet_bootstrap.cc:654] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:09.504001  1578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1883da16ec44d2a8304d3909471b4b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.505324  1656 tablet_service.cc:1511] Processing CreateTablet for tablet 8c784821c4a84bc7ba32cb6e34fbb225 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:00:09.506587  1656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c784821c4a84bc7ba32cb6e34fbb225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.498760  1787 raft_consensus.cc:697] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:09.509886  1575 tablet_service.cc:1511] Processing CreateTablet for tablet 8c784821c4a84bc7ba32cb6e34fbb225 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:00:09.509940  1787 consensus_queue.cc:237] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:09.511170  1575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c784821c4a84bc7ba32cb6e34fbb225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.513474  1809 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.508546  1582 tablet_service.cc:1511] Processing CreateTablet for tablet 3b16912bb6d94c80b8ff8e641268e238 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:00:09.523376  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:09.524013  1667 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:09.513959  1809 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:09.530413  1809 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:09.531982  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:09.532495  1727 tablet_service.cc:1511] Processing CreateTablet for tablet 3b16912bb6d94c80b8ff8e641268e238 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:00:09.533181  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:09.533927  1727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b16912bb6d94c80b8ff8e641268e238. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:00:09.534818  1705 leader_election.cc:343] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:09.535900  1707 leader_election.cc:343] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:09.536295  1707 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:09.537374  1809 raft_consensus.cc:2749] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:09.541375  1577 tablet_service.cc:1511] Processing CreateTablet for tablet 6bb113e0e7c440b4911f4c09a86e2591 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:00:09.543184  1782 tablet_bootstrap.cc:492] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:09.543665  1782 ts_tablet_manager.cc:1403] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.206s	user 0.016s	sys 0.008s
I20260709 13:00:09.546586  1782 raft_consensus.cc:359] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:09.547284  1782 raft_consensus.cc:385] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:09.547559  1782 raft_consensus.cc:740] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:09.548298  1782 consensus_queue.cc:260] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:09.558476  1783 tablet_bootstrap.cc:492] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:09.558122  1731 tablet_service.cc:1511] Processing CreateTablet for tablet 6bb113e0e7c440b4911f4c09a86e2591 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:00:09.558987  1783 ts_tablet_manager.cc:1403] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.238s	user 0.018s	sys 0.004s
I20260709 13:00:09.559942  1731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bb113e0e7c440b4911f4c09a86e2591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.560523  1582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b16912bb6d94c80b8ff8e641268e238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.562342  1783 raft_consensus.cc:359] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:09.563066  1783 raft_consensus.cc:385] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:09.563364  1783 raft_consensus.cc:740] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:09.564132  1783 consensus_queue.cc:260] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:09.528195  1788 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:09.553068  1667 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:09.575529  1556 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:09.576690  1788 raft_consensus.cc:2804] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:09.577214  1788 raft_consensus.cc:697] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:09.578018  1788 consensus_queue.cc:237] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } }
I20260709 13:00:09.588074  1650 tablet_service.cc:1511] Processing CreateTablet for tablet 3b16912bb6d94c80b8ff8e641268e238 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:00:09.590356  1783 ts_tablet_manager.cc:1434] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:00:09.609488  1580 tablet_service.cc:1511] Processing CreateTablet for tablet 5935c74e00334979a51afdc704e3b06f (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:00:09.623966  1581 tablet_service.cc:1511] Processing CreateTablet for tablet f6f62b0e67804bcba2b2f2b49e0b7623 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:00:09.626806  1729 tablet_service.cc:1511] Processing CreateTablet for tablet 5935c74e00334979a51afdc704e3b06f (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:00:09.629191  1729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5935c74e00334979a51afdc704e3b06f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.638443  1809 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.639045  1809 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:09.642769  1809 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:09.644008  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:09.647965  1707 leader_election.cc:343] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:09.648733  1723 tablet_service.cc:1511] Processing CreateTablet for tablet 58f7cd3ac9254bdb9fb62ab42597f15b (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:00:09.650411  1723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58f7cd3ac9254bdb9fb62ab42597f15b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.653570  1781 tablet_bootstrap.cc:492] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:09.637149  1577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bb113e0e7c440b4911f4c09a86e2591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.654085  1781 ts_tablet_manager.cc:1403] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.183s	user 0.014s	sys 0.041s
I20260709 13:00:09.655678  1783 tablet_bootstrap.cc:492] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:09.677536  1580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5935c74e00334979a51afdc704e3b06f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.682013  1722 tablet_service.cc:1511] Processing CreateTablet for tablet f6f62b0e67804bcba2b2f2b49e0b7623 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:00:09.690164  1581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6f62b0e67804bcba2b2f2b49e0b7623. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:00:09.690507  1538 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:09.695641  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:09.697190  1650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b16912bb6d94c80b8ff8e641268e238. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:00:09.698094  1705 leader_election.cc:343] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:09.698935  1705 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:09.714684  1722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6f62b0e67804bcba2b2f2b49e0b7623. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.680910  1781 raft_consensus.cc:359] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:09.718379  1781 raft_consensus.cc:385] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:09.719003  1781 raft_consensus.cc:740] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:09.720362  1781 consensus_queue.cc:260] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:09.721683  1652 tablet_service.cc:1511] Processing CreateTablet for tablet f6f62b0e67804bcba2b2f2b49e0b7623 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:00:09.727423  1654 tablet_service.cc:1511] Processing CreateTablet for tablet 6bb113e0e7c440b4911f4c09a86e2591 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:00:09.735642  1728 tablet_service.cc:1511] Processing CreateTablet for tablet 4490828942174c3c9092820cf3a81fe3 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:00:09.737130  1728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4490828942174c3c9092820cf3a81fe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.736305  1488 catalog_manager.cc:5697] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:09.729265  1787 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:09.748025  1652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6f62b0e67804bcba2b2f2b49e0b7623. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.747776  1579 tablet_service.cc:1511] Processing CreateTablet for tablet 4490828942174c3c9092820cf3a81fe3 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:00:09.753400  1781 ts_tablet_manager.cc:1434] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.086s	user 0.004s	sys 0.007s
I20260709 13:00:09.767026  1783 tablet_bootstrap.cc:654] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:09.766484  1576 tablet_service.cc:1511] Processing CreateTablet for tablet 9eee8a552b4244ad8089de6467edd0d8 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:00:09.774124  1788 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.770159  1489 catalog_manager.cc:5697] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:09.774775  1788 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:09.779279  1653 tablet_service.cc:1511] Processing CreateTablet for tablet 5935c74e00334979a51afdc704e3b06f (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:00:09.780309  1725 tablet_service.cc:1511] Processing CreateTablet for tablet 9eee8a552b4244ad8089de6467edd0d8 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:00:09.782877  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:09.793538  1556 leader_election.cc:343] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:09.796059  1725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eee8a552b4244ad8089de6467edd0d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.797648  1651 tablet_service.cc:1511] Processing CreateTablet for tablet 4490828942174c3c9092820cf3a81fe3 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:00:09.795421  1578 tablet_service.cc:1511] Processing CreateTablet for tablet 7552d3c613c34834a3a9c7ce844572fd (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:00:09.797472  1654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bb113e0e7c440b4911f4c09a86e2591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.798468  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:09.799602  1741 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 0.
I20260709 13:00:09.801577  1558 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:09.803632  1812 raft_consensus.cc:2804] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:09.804401  1812 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:09.804013  1657 tablet_service.cc:1511] Processing CreateTablet for tablet 9eee8a552b4244ad8089de6467edd0d8 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:00:09.805672  1781 tablet_bootstrap.cc:492] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:09.805816  1782 ts_tablet_manager.cc:1434] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.262s	user 0.025s	sys 0.009s
I20260709 13:00:09.805022  1812 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:09.760910  1574 tablet_service.cc:1511] Processing CreateTablet for tablet 58f7cd3ac9254bdb9fb62ab42597f15b (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:00:09.792505  1788 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:09.821030  1653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5935c74e00334979a51afdc704e3b06f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.819535  1579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4490828942174c3c9092820cf3a81fe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.828075  1657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eee8a552b4244ad8089de6467edd0d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.846676  1578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7552d3c613c34834a3a9c7ce844572fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.829106  1782 tablet_bootstrap.cc:492] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:09.849800  1574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58f7cd3ac9254bdb9fb62ab42597f15b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.850755  1576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eee8a552b4244ad8089de6467edd0d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.856113  1790 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.856932  1790 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:09.866324  1783 tablet_bootstrap.cc:492] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:09.837410  1655 tablet_service.cc:1511] Processing CreateTablet for tablet 7552d3c613c34834a3a9c7ce844572fd (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:00:09.837901  1648 tablet_service.cc:1511] Processing CreateTablet for tablet 53c3c6ae566d4afda95ffc509772bca1 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:00:09.809290  1649 tablet_service.cc:1511] Processing CreateTablet for tablet 58f7cd3ac9254bdb9fb62ab42597f15b (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:00:09.895630  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:09.898036  1633 leader_election.cc:343] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:09.901669  1651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4490828942174c3c9092820cf3a81fe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.901540  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:00:09.903985  1633 leader_election.cc:343] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:09.904651  1633 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:09.905241  1649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58f7cd3ac9254bdb9fb62ab42597f15b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:00:09.905743  1477 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 81342.5us
W20260709 13:00:09.909878  1475 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 52139us
I20260709 13:00:09.910444  1731 tablet_service.cc:1511] Processing CreateTablet for tablet 7552d3c613c34834a3a9c7ce844572fd (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:00:09.912487  1731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7552d3c613c34834a3a9c7ce844572fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.913476  1655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7552d3c613c34834a3a9c7ce844572fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.917701  1648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53c3c6ae566d4afda95ffc509772bca1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.918936  1790 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:09.919787  1790 raft_consensus.cc:2749] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:09.920710  1783 ts_tablet_manager.cc:1403] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.265s	user 0.016s	sys 0.018s
I20260709 13:00:09.937398  1787 consensus_queue.cc:1048] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:09.942680  1781 tablet_bootstrap.cc:654] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:09.960340  1782 tablet_bootstrap.cc:654] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:09.967337  1575 tablet_service.cc:1511] Processing CreateTablet for tablet 53c3c6ae566d4afda95ffc509772bca1 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:00:09.968103  1582 tablet_service.cc:1511] Processing CreateTablet for tablet 075c70e81e41467491c4134e5e9fd03a (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:00:09.969756  1575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53c3c6ae566d4afda95ffc509772bca1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.969198  1729 tablet_service.cc:1511] Processing CreateTablet for tablet 075c70e81e41467491c4134e5e9fd03a (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:00:09.972697  1582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 075c70e81e41467491c4134e5e9fd03a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.973121  1729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 075c70e81e41467491c4134e5e9fd03a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.979669  1783 raft_consensus.cc:359] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:09.970997  1656 tablet_service.cc:1511] Processing CreateTablet for tablet 075c70e81e41467491c4134e5e9fd03a (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:00:09.988641  1656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 075c70e81e41467491c4134e5e9fd03a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.990015  1573 tablet_service.cc:1511] Processing CreateTablet for tablet f52de8c1489f4f9aabb361c6c02bb3de (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
W20260709 13:00:09.987116  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 81608.8us
W20260709 13:00:10.012970  1705 consensus_peers.cc:597] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:10.014890  1650 tablet_service.cc:1511] Processing CreateTablet for tablet f52de8c1489f4f9aabb361c6c02bb3de (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:00:10.022531  1725 tablet_service.cc:1511] Processing CreateTablet for tablet 53c3c6ae566d4afda95ffc509772bca1 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:00:10.024192  1573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f52de8c1489f4f9aabb361c6c02bb3de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.024739  1725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53c3c6ae566d4afda95ffc509772bca1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.033684  1787 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.037360  1723 tablet_service.cc:1511] Processing CreateTablet for tablet efd803bfc7504e98806ec4a5030c66b1 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:00:10.039654  1812 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.039904  1722 tablet_service.cc:1511] Processing CreateTablet for tablet f52de8c1489f4f9aabb361c6c02bb3de (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:00:09.986306  1783 raft_consensus.cc:385] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.017014  1650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f52de8c1489f4f9aabb361c6c02bb3de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.057507  1582 tablet_service.cc:1511] Processing CreateTablet for tablet efd803bfc7504e98806ec4a5030c66b1 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:00:10.059126  1582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efd803bfc7504e98806ec4a5030c66b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.064410  1651 tablet_service.cc:1511] Processing CreateTablet for tablet b51b235c777d4de2876dfd783998c83f (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:00:10.067972  1581 tablet_service.cc:1511] Processing CreateTablet for tablet b51b235c777d4de2876dfd783998c83f (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:00:10.068213  1730 tablet_service.cc:1511] Processing CreateTablet for tablet b51b235c777d4de2876dfd783998c83f (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:00:10.073422  1651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b51b235c777d4de2876dfd783998c83f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.073920  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:10.074482  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:10.075217  1741 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:10.075898  1556 leader_election.cc:343] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.054283  1783 raft_consensus.cc:740] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.085121  1577 tablet_service.cc:1511] Processing CreateTablet for tablet bd6e8a8a10c144f1bd64e638805e7a5a (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:00:10.086710  1652 tablet_service.cc:1511] Processing CreateTablet for tablet efd803bfc7504e98806ec4a5030c66b1 (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:00:10.088790  1652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efd803bfc7504e98806ec4a5030c66b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.100869  1577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd6e8a8a10c144f1bd64e638805e7a5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.102705  1651 tablet_service.cc:1511] Processing CreateTablet for tablet bd6e8a8a10c144f1bd64e638805e7a5a (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:00:10.056691  1787 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.107637  1581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b51b235c777d4de2876dfd783998c83f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.109105  1787 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:10.110088  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:10.110262  1558 consensus_peers.cc:597] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 -> Peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Couldn't send request to peer 5ced62816f8545cd9b63a27e9055e42d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:10.139997  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:10.146173  1707 leader_election.cc:343] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.151929  1781 tablet_bootstrap.cc:492] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:10.152693  1781 ts_tablet_manager.cc:1403] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.363s	user 0.010s	sys 0.037s
I20260709 13:00:10.126252  1783 consensus_queue.cc:260] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.078104  1812 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:10.153637  1651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd6e8a8a10c144f1bd64e638805e7a5a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:00:10.174374  1705 leader_election.cc:343] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.175143  1705 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:00:10.154227  1477 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 43597.5us
I20260709 13:00:10.183519  1812 consensus_queue.cc:1048] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:00:10.190584  1783 ts_tablet_manager.cc:1434] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.269s	user 0.011s	sys 0.001s
I20260709 13:00:10.194205  1783 tablet_bootstrap.cc:492] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:10.205165  1782 tablet_bootstrap.cc:492] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:10.205989  1782 ts_tablet_manager.cc:1403] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.377s	user 0.022s	sys 0.014s
I20260709 13:00:10.214594  1723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efd803bfc7504e98806ec4a5030c66b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.216223  1730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b51b235c777d4de2876dfd783998c83f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.217236  1722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f52de8c1489f4f9aabb361c6c02bb3de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.229583  1728 tablet_service.cc:1511] Processing CreateTablet for tablet bd6e8a8a10c144f1bd64e638805e7a5a (DEFAULT_TABLE table=test-workload [id=8a8e3153ff4e476f890a0820215f177a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:00:10.231606  1728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd6e8a8a10c144f1bd64e638805e7a5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.232424  1781 raft_consensus.cc:359] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.233526  1781 raft_consensus.cc:385] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.233984  1781 raft_consensus.cc:740] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.235054  1781 consensus_queue.cc:260] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:10.251015  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 76700us
I20260709 13:00:10.259789  1783 tablet_bootstrap.cc:654] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.261868  1787 raft_consensus.cc:2749] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:10.267079  1782 raft_consensus.cc:359] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.270112  1741 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:10.278491  1782 raft_consensus.cc:385] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.285221  1782 raft_consensus.cc:740] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.293331  1782 consensus_queue.cc:260] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.329353  1558 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:10.359632  1812 raft_consensus.cc:2804] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:10.360834  1812 raft_consensus.cc:697] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:10.356989  1781 ts_tablet_manager.cc:1434] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.204s	user 0.010s	sys 0.010s
I20260709 13:00:10.367957  1782 ts_tablet_manager.cc:1434] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.161s	user 0.010s	sys 0.003s
I20260709 13:00:10.363587  1812 consensus_queue.cc:237] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.378706  1788 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.379494  1788 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.381933  1781 tablet_bootstrap.cc:492] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:10.383215  1788 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:10.384049  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:10.385293  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:10.386009  1782 tablet_bootstrap.cc:492] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
W20260709 13:00:10.387127  1556 leader_election.cc:343] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:10.387740  1558 leader_election.cc:343] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.388250  1558 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:10.389605  1788 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:10.395340  1783 tablet_bootstrap.cc:492] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:10.396049  1783 ts_tablet_manager.cc:1403] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.202s	user 0.012s	sys 0.012s
I20260709 13:00:10.420799  1783 raft_consensus.cc:359] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.435753  1783 raft_consensus.cc:385] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.436129  1783 raft_consensus.cc:740] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.436998  1783 consensus_queue.cc:260] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.439209  1818 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.440114  1783 ts_tablet_manager.cc:1434] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.013s
I20260709 13:00:10.439729  1818 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.441473  1783 tablet_bootstrap.cc:492] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:10.442471  1818 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:10.443122  1782 tablet_bootstrap.cc:654] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.444224  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:10.444353  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:10.446360  1633 leader_election.cc:343] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:10.447090  1633 leader_election.cc:343] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.447517  1633 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:10.448474  1818 raft_consensus.cc:2749] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:10.449433  1783 tablet_bootstrap.cc:654] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.454169  1781 tablet_bootstrap.cc:654] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.455236  1782 tablet_bootstrap.cc:492] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:10.455873  1782 ts_tablet_manager.cc:1403] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.070s	user 0.015s	sys 0.001s
I20260709 13:00:10.459702  1782 raft_consensus.cc:359] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.460534  1782 raft_consensus.cc:385] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.460886  1782 raft_consensus.cc:740] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.461778  1782 consensus_queue.cc:260] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.464422  1782 ts_tablet_manager.cc:1434] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:00:10.466161  1782 tablet_bootstrap.cc:492] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:10.471138  1488 catalog_manager.cc:5697] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:10.474826  1782 tablet_bootstrap.cc:654] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.480291  1781 tablet_bootstrap.cc:492] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:10.481062  1781 ts_tablet_manager.cc:1403] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.100s	user 0.015s	sys 0.018s
I20260709 13:00:10.482592  1831 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.483141  1831 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.485891  1781 raft_consensus.cc:359] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.486814  1781 raft_consensus.cc:385] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.487321  1781 raft_consensus.cc:740] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.487524  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:10.488300  1781 consensus_queue.cc:260] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.496094  1781 ts_tablet_manager.cc:1434] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:00:10.497462  1781 tablet_bootstrap.cc:492] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
W20260709 13:00:10.497328  1707 leader_election.cc:343] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.503497  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:10.505633  1705 leader_election.cc:343] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.506235  1705 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:10.507601  1827 raft_consensus.cc:2749] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:10.508531  1831 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:10.511673  1783 tablet_bootstrap.cc:492] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:10.512308  1783 ts_tablet_manager.cc:1403] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.071s	user 0.007s	sys 0.017s
I20260709 13:00:10.514379  1781 tablet_bootstrap.cc:654] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.516206  1783 raft_consensus.cc:359] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.517366  1783 raft_consensus.cc:385] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.517750  1783 raft_consensus.cc:740] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.518648  1783 consensus_queue.cc:260] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.521219  1783 ts_tablet_manager.cc:1434] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.007s
I20260709 13:00:10.522300  1783 tablet_bootstrap.cc:492] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:10.524987  1781 tablet_bootstrap.cc:492] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:10.525553  1781 ts_tablet_manager.cc:1403] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.003s
I20260709 13:00:10.525801  1782 tablet_bootstrap.cc:492] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:10.526243  1782 ts_tablet_manager.cc:1403] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.060s	user 0.028s	sys 0.018s
I20260709 13:00:10.529093  1783 tablet_bootstrap.cc:654] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.528945  1781 raft_consensus.cc:359] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.529871  1781 raft_consensus.cc:385] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.529595  1782 raft_consensus.cc:359] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.530174  1781 raft_consensus.cc:740] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.530283  1782 raft_consensus.cc:385] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.530575  1782 raft_consensus.cc:740] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.531061  1781 consensus_queue.cc:260] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.531286  1782 consensus_queue.cc:260] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.533794  1782 ts_tablet_manager.cc:1434] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:00:10.534489  1783 tablet_bootstrap.cc:492] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:10.535020  1783 ts_tablet_manager.cc:1403] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:00:10.535456  1782 tablet_bootstrap.cc:492] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:10.537415  1781 ts_tablet_manager.cc:1434] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 13:00:10.538163  1783 raft_consensus.cc:359] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.538959  1783 raft_consensus.cc:385] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.539216  1783 raft_consensus.cc:740] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.539880  1783 consensus_queue.cc:260] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.538637  1781 tablet_bootstrap.cc:492] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:10.542822  1782 tablet_bootstrap.cc:654] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.547380  1781 tablet_bootstrap.cc:654] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.551925  1783 ts_tablet_manager.cc:1434] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:00:10.552131  1782 tablet_bootstrap.cc:492] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:10.552621  1782 ts_tablet_manager.cc:1403] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.003s
I20260709 13:00:10.553661  1783 tablet_bootstrap.cc:492] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:10.554319  1781 tablet_bootstrap.cc:492] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:10.554731  1781 ts_tablet_manager.cc:1403] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.016s	user 0.004s	sys 0.006s
I20260709 13:00:10.555686  1782 raft_consensus.cc:359] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.556380  1782 raft_consensus.cc:385] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.556641  1782 raft_consensus.cc:740] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.557284  1781 raft_consensus.cc:359] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.557377  1782 consensus_queue.cc:260] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.557991  1781 raft_consensus.cc:385] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.559697  1782 ts_tablet_manager.cc:1434] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:00:10.559860  1783 tablet_bootstrap.cc:654] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.561122  1781 raft_consensus.cc:740] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.561249  1782 tablet_bootstrap.cc:492] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:10.562024  1781 consensus_queue.cc:260] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.568176  1781 ts_tablet_manager.cc:1434] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:00:10.568956  1782 tablet_bootstrap.cc:654] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.569594  1781 tablet_bootstrap.cc:492] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:10.577615  1781 tablet_bootstrap.cc:654] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.591230  1781 tablet_bootstrap.cc:492] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:10.591857  1781 ts_tablet_manager.cc:1403] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.012s
I20260709 13:00:10.595486  1781 raft_consensus.cc:359] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } }
I20260709 13:00:10.596473  1781 raft_consensus.cc:385] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.596834  1781 raft_consensus.cc:740] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.598042  1781 consensus_queue.cc:260] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } }
I20260709 13:00:10.605822  1781 ts_tablet_manager.cc:1434] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.002s
I20260709 13:00:10.607154  1781 tablet_bootstrap.cc:492] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:10.616032  1781 tablet_bootstrap.cc:654] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.632162  1781 tablet_bootstrap.cc:492] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:10.632930  1781 ts_tablet_manager.cc:1403] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.010s
I20260709 13:00:10.637274  1783 tablet_bootstrap.cc:492] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:10.636930  1781 raft_consensus.cc:359] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.637749  1783 ts_tablet_manager.cc:1403] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.084s	user 0.039s	sys 0.044s
I20260709 13:00:10.637684  1781 raft_consensus.cc:385] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.638228  1781 raft_consensus.cc:740] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.638482  1782 tablet_bootstrap.cc:492] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:10.638902  1782 ts_tablet_manager.cc:1403] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.078s	user 0.038s	sys 0.027s
I20260709 13:00:10.639039  1781 consensus_queue.cc:260] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.640128  1783 raft_consensus.cc:359] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.640758  1783 raft_consensus.cc:385] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.640995  1783 raft_consensus.cc:740] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.641042  1781 ts_tablet_manager.cc:1434] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:00:10.641415  1782 raft_consensus.cc:359] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.642050  1782 raft_consensus.cc:385] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.641748  1783 consensus_queue.cc:260] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.642412  1781 tablet_bootstrap.cc:492] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:10.642315  1782 raft_consensus.cc:740] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.643081  1782 consensus_queue.cc:260] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.644980  1782 ts_tablet_manager.cc:1434] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:00:10.646718  1782 tablet_bootstrap.cc:492] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:10.648072  1783 ts_tablet_manager.cc:1434] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:00:10.648778  1781 tablet_bootstrap.cc:654] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.649271  1783 tablet_bootstrap.cc:492] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:10.655114  1782 tablet_bootstrap.cc:654] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.655894  1783 tablet_bootstrap.cc:654] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.662521  1781 tablet_bootstrap.cc:492] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:10.663160  1781 ts_tablet_manager.cc:1403] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260709 13:00:10.666013  1783 tablet_bootstrap.cc:492] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:10.666515  1783 ts_tablet_manager.cc:1403] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.003s
I20260709 13:00:10.667768  1781 raft_consensus.cc:359] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.668718  1781 raft_consensus.cc:385] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.669093  1781 raft_consensus.cc:740] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.669106  1783 raft_consensus.cc:359] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.669965  1783 raft_consensus.cc:385] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.670064  1831 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.670255  1783 raft_consensus.cc:740] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.670517  1831 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.670377  1781 consensus_queue.cc:260] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.672273  1783 consensus_queue.cc:260] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.672767  1781 ts_tablet_manager.cc:1434] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:00:10.673435  1782 tablet_bootstrap.cc:492] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:10.673771  1831 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:10.673873  1782 ts_tablet_manager.cc:1403] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.028s	user 0.023s	sys 0.002s
I20260709 13:00:10.674345  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:10.675117  1667 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 0.
I20260709 13:00:10.675523  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:10.676229  1592 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 0.
I20260709 13:00:10.676329  1705 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:10.677228  1831 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:10.676992  1782 raft_consensus.cc:359] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.677589  1831 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.677688  1782 raft_consensus.cc:385] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.677995  1831 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.678035  1782 raft_consensus.cc:740] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.678673  1781 tablet_bootstrap.cc:492] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:10.678964  1782 consensus_queue.cc:260] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.681234  1782 ts_tablet_manager.cc:1434] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:00:10.682431  1782 tablet_bootstrap.cc:492] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:10.675093  1783 ts_tablet_manager.cc:1434] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:00:10.685379  1783 tablet_bootstrap.cc:492] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:10.685848  1781 tablet_bootstrap.cc:654] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.688741  1782 tablet_bootstrap.cc:654] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.689724  1827 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.690196  1827 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.691280  1783 tablet_bootstrap.cc:654] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.692469  1827 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:10.697572  1831 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.699661  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:10.700624  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:10.701327  1591 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.701373  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:10.703317  1705 leader_election.cc:343] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:10.705606  1707 leader_election.cc:343] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.706032  1707 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:00:10.706284  1538 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:10.707428  1787 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:10.708117  1812 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.708194  1824 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.708626  1812 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.708876  1824 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.710820  1812 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:10.712569  1591 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:10.713330  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:10.714490  1831 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:10.713225  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:10.715063  1824 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:10.715613  1666 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 0.
I20260709 13:00:10.716986  1705 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:10.717985  1783 tablet_bootstrap.cc:492] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:10.717844  1824 raft_consensus.cc:2804] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:10.718588  1783 ts_tablet_manager.cc:1403] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.033s	user 0.007s	sys 0.004s
I20260709 13:00:10.718803  1707 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:10.715176  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:00:10.719461  1558 leader_election.cc:343] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.720551  1665 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.718106  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:10.721832  1831 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:10.728012  1831 raft_consensus.cc:697] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
W20260709 13:00:10.725884  1556 leader_election.cc:343] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.729300  1556 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:10.729888  1831 consensus_queue.cc:237] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.732879  1741 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.728622  1824 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.733605  1824 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.730726  1788 raft_consensus.cc:2749] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:10.726225  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:10.739023  1707 leader_election.cc:343] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.739835  1787 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.740343  1787 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.742614  1787 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:10.744323  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:10.745169  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:10.745903  1705 leader_election.cc:343] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:10.746380  1707 leader_election.cc:343] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.742728  1824 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.746809  1707 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:10.747869  1787 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:10.749333  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:10.750239  1782 tablet_bootstrap.cc:492] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:10.750741  1782 ts_tablet_manager.cc:1403] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.069s	user 0.012s	sys 0.002s
W20260709 13:00:10.750645  1707 leader_election.cc:343] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.751168  1665 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:10.753237  1781 tablet_bootstrap.cc:492] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:10.722692  1783 raft_consensus.cc:359] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.753809  1782 raft_consensus.cc:359] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.754292  1781 ts_tablet_manager.cc:1403] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.076s	user 0.023s	sys 0.033s
I20260709 13:00:10.754128  1783 raft_consensus.cc:385] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.755848  1783 raft_consensus.cc:740] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.755874  1782 raft_consensus.cc:385] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.756984  1782 raft_consensus.cc:740] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.757742  1782 consensus_queue.cc:260] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.759047  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:10.759650  1665 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.760812  1782 ts_tablet_manager.cc:1434] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:00:10.758800  1781 raft_consensus.cc:359] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.762094  1782 tablet_bootstrap.cc:492] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:10.762650  1781 raft_consensus.cc:385] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.762995  1781 raft_consensus.cc:740] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.764024  1781 consensus_queue.cc:260] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.762277  1824 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:10.769117  1783 consensus_queue.cc:260] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.772526  1783 ts_tablet_manager.cc:1434] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.000s
I20260709 13:00:10.765381  1488 catalog_manager.cc:5697] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:10.775719  1782 tablet_bootstrap.cc:654] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.775883  1781 ts_tablet_manager.cc:1434] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:00:10.777379  1781 tablet_bootstrap.cc:492] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:10.781818  1783 tablet_bootstrap.cc:492] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:10.782423  1818 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.783221  1818 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.780689  1788 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.785689  1788 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.788923  1818 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:10.789265  1781 tablet_bootstrap.cc:654] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.774012  1665 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:10.791240  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:10.793473  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:10.797668  1633 leader_election.cc:343] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.799088  1592 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 0.
I20260709 13:00:10.791291  1705 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:10.801126  1633 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:10.802809  1818 raft_consensus.cc:2804] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:10.803287  1818 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.803772  1818 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.805346  1783 tablet_bootstrap.cc:654] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.806864  1812 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.807744  1812 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.801152  1824 raft_consensus.cc:2804] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:10.809346  1788 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:10.809908  1824 raft_consensus.cc:697] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:10.812117  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:10.813061  1740 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 0.
I20260709 13:00:10.814471  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:10.815207  1667 raft_consensus.cc:2393] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 1: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:10.816323  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:10.817307  1665 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 0.
I20260709 13:00:10.818439  1812 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:10.811549  1824 consensus_queue.cc:237] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.817561  1558 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:10.825971  1831 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.826756  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:10.826853  1831 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.831631  1831 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:10.832670  1788 raft_consensus.cc:2804] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:10.833262  1788 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.833827  1788 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.833839  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:10.834139  1558 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:10.835103  1665 raft_consensus.cc:2468] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 0.
I20260709 13:00:10.832854  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:10.836897  1705 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:10.838092  1835 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.819849  1812 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.839946  1812 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:10.842460  1707 leader_election.cc:343] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.845218  1831 raft_consensus.cc:2804] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:10.845753  1831 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.846309  1831 raft_consensus.cc:3060] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.848079  1812 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:10.849185  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:10.850452  1665 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 0.
I20260709 13:00:10.866274  1781 tablet_bootstrap.cc:492] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:10.866295  1782 tablet_bootstrap.cc:492] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:10.867010  1781 ts_tablet_manager.cc:1403] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.090s	user 0.014s	sys 0.012s
I20260709 13:00:10.867137  1782 ts_tablet_manager.cc:1403] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.105s	user 0.030s	sys 0.030s
I20260709 13:00:10.866074  1556 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:10.868371  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:10.870024  1827 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:10.870504  1740 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 0.
I20260709 13:00:10.870533  1827 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } }
I20260709 13:00:10.870669  1812 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:10.872604  1812 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.872990  1812 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.876118  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:10.877573  1831 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.878639  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:10.879359  1781 raft_consensus.cc:359] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.880012  1781 raft_consensus.cc:385] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.880327  1781 raft_consensus.cc:740] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.880436  1707 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:10.881068  1781 consensus_queue.cc:260] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.881466  1787 raft_consensus.cc:2749] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:10.861884  1818 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.885915  1831 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:10.886650  1835 raft_consensus.cc:2749] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:10.879990  1812 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.888526  1812 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:10.889228  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:10.889786  1665 raft_consensus.cc:3060] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.890358  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:10.890882  1667 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.880194  1827 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:00:10.888049  1488 catalog_manager.cc:5697] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:10.896574  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:10.896683  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:10.900453  1741 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:10.901491  1707 leader_election.cc:343] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.897161  1783 tablet_bootstrap.cc:492] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:10.902734  1783 ts_tablet_manager.cc:1403] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.121s	user 0.022s	sys 0.008s
I20260709 13:00:10.899906  1667 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:10.907440  1788 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.912938  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:10.914696  1666 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.912989  1665 raft_consensus.cc:2468] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:10.913072  1818 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:10.913870  1556 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:10.921133  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:10.936034  1781 ts_tablet_manager.cc:1434] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.069s	user 0.005s	sys 0.008s
I20260709 13:00:10.936491  1592 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.939625  1812 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:10.938696  1705 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:10.940953  1781 tablet_bootstrap.cc:492] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:10.942333  1782 raft_consensus.cc:359] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.939183  1783 raft_consensus.cc:359] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.943298  1782 raft_consensus.cc:385] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.943328  1783 raft_consensus.cc:385] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.943727  1782 raft_consensus.cc:740] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.943893  1783 raft_consensus.cc:740] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.939213  1739 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.944131  1831 raft_consensus.cc:2804] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:10.921568  1827 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.946087  1831 raft_consensus.cc:697] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:10.946725  1827 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.947679  1741 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:10.947774  1831 consensus_queue.cc:237] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.942288  1812 raft_consensus.cc:697] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:10.937199  1788 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:10.954628  1787 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.955428  1787 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.958587  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:10.959736  1787 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:10.941313  1818 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:10.961445  1707 leader_election.cc:343] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.960621  1812 consensus_queue.cc:237] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.962752  1782 consensus_queue.cc:260] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.937476  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:10.961964  1818 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.969817  1783 consensus_queue.cc:260] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:10.970418  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:10.972466  1633 leader_election.cc:343] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.980886  1783 ts_tablet_manager.cc:1434] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.078s	user 0.007s	sys 0.001s
I20260709 13:00:10.982220  1782 ts_tablet_manager.cc:1434] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.115s	user 0.009s	sys 0.001s
I20260709 13:00:10.977183  1591 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 0.
I20260709 13:00:10.987185  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:10.989846  1783 tablet_bootstrap.cc:492] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:10.989742  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:10.994889  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:00:10.996176  1705 leader_election.cc:343] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.991014  1707 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:10.983489  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:10.993256  1782 tablet_bootstrap.cc:492] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:10.985683  1827 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:10.996827  1705 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:00:11.000218  1633 leader_election.cc:343] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:11.001478  1831 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:10.992985  1667 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.002458  1831 raft_consensus.cc:2804] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:11.004911  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:11.013345  1831 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.013664  1591 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 0.
I20260709 13:00:11.014062  1831 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.007829  1812 consensus_queue.cc:1048] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:11.017966  1633 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:11.018175  1592 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 1.
I20260709 13:00:11.020689  1837 raft_consensus.cc:2804] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:11.021302  1837 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.993852  1818 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:11.021477  1633 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:11.022894  1837 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.023981  1818 raft_consensus.cc:2804] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:00:11.024471  1556 consensus_peers.cc:597] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:11.006814  1665 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 0.
I20260709 13:00:11.025539  1818 raft_consensus.cc:697] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 1 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:11.047955  1486 catalog_manager.cc:5697] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:11.059010  1667 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:11.060766  1556 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:11.063275  1864 raft_consensus.cc:2804] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:11.064002  1864 raft_consensus.cc:697] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:11.065397  1864 consensus_queue.cc:237] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.075768  1782 tablet_bootstrap.cc:654] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.076480  1837 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.085985  1781 tablet_bootstrap.cc:654] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.084462  1739 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:11.090437  1837 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:11.090201  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:11.091378  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:11.087092  1818 consensus_queue.cc:237] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.100762  1592 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:11.105095  1633 leader_election.cc:343] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:11.096567  1831 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.137955  1827 consensus_queue.cc:1048] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:11.194671  1837 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.195397  1837 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.220332  1592 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 1.
I20260709 13:00:11.230219  1781 tablet_bootstrap.cc:492] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:11.230816  1781 ts_tablet_manager.cc:1403] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.290s	user 0.015s	sys 0.025s
I20260709 13:00:11.234089  1783 tablet_bootstrap.cc:654] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.235845  1633 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:11.238389  1867 raft_consensus.cc:2804] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:11.239182  1867 raft_consensus.cc:697] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 1 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:11.242280  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:11.243048  1590 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.256202  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:11.256855  1667 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.256624  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:11.258844  1633 leader_election.cc:343] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:11.244735  1831 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:11.240638  1867 consensus_queue.cc:237] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.267990  1781 raft_consensus.cc:359] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.269042  1781 raft_consensus.cc:385] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.272683  1781 raft_consensus.cc:740] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.274986  1827 consensus_queue.cc:1048] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:11.277532  1781 consensus_queue.cc:260] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.283522  1831 consensus_queue.cc:1048] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:11.294955  1781 ts_tablet_manager.cc:1434] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.064s	user 0.009s	sys 0.004s
I20260709 13:00:11.302699  1781 tablet_bootstrap.cc:492] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:11.303869  1782 tablet_bootstrap.cc:492] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:11.304497  1782 ts_tablet_manager.cc:1403] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.316s	user 0.018s	sys 0.018s
I20260709 13:00:11.306270  1590 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:11.308482  1782 raft_consensus.cc:359] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.310016  1707 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:11.310698  1782 raft_consensus.cc:385] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.311074  1782 raft_consensus.cc:740] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.312135  1824 raft_consensus.cc:2804] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:11.312394  1782 consensus_queue.cc:260] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.312834  1824 raft_consensus.cc:697] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:11.313524  1667 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:11.314729  1782 ts_tablet_manager.cc:1434] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.002s
I20260709 13:00:11.316702  1782 tablet_bootstrap.cc:492] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:11.314133  1824 consensus_queue.cc:237] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.323768  1831 consensus_queue.cc:1048] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:11.325384  1783 tablet_bootstrap.cc:492] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:11.326004  1783 ts_tablet_manager.cc:1403] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.337s	user 0.025s	sys 0.020s
I20260709 13:00:11.327840  1781 tablet_bootstrap.cc:654] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.332145  1831 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.333750  1831 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.338394  1783 raft_consensus.cc:359] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.339360  1783 raft_consensus.cc:385] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.339689  1783 raft_consensus.cc:740] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.342147  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:11.351178  1783 consensus_queue.cc:260] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.356119  1783 ts_tablet_manager.cc:1434] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.030s	user 0.010s	sys 0.002s
W20260709 13:00:11.355991  1707 leader_election.cc:343] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:11.359274  1783 tablet_bootstrap.cc:492] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:11.359515  1837 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:11.363130  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:11.365955  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:11.366935  1740 raft_consensus.cc:2468] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 0.
I20260709 13:00:11.369784  1633 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:11.357575  1831 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:11.372890  1867 raft_consensus.cc:2804] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:11.375633  1812 consensus_queue.cc:1048] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:11.375037  1486 catalog_manager.cc:5697] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
W20260709 13:00:11.377285  1705 leader_election.cc:343] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:11.382448  1705 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:11.385270  1831 raft_consensus.cc:2749] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:11.399003  1782 tablet_bootstrap.cc:654] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.402889  1783 tablet_bootstrap.cc:654] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.380376  1867 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.412220  1867 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.414631  1812 consensus_queue.cc:1048] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:11.414453  1488 catalog_manager.cc:5697] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:11.432448  1666 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.447589  1490 catalog_manager.cc:5697] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 1 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:11.460055  1781 tablet_bootstrap.cc:492] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:11.460683  1781 ts_tablet_manager.cc:1403] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.158s	user 0.015s	sys 0.030s
I20260709 13:00:11.466325  1781 raft_consensus.cc:359] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.467159  1781 raft_consensus.cc:385] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:00:11.467281  1707 consensus_peers.cc:597] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:11.468576  1782 tablet_bootstrap.cc:492] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:11.469167  1782 ts_tablet_manager.cc:1403] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.153s	user 0.020s	sys 0.015s
I20260709 13:00:11.471277  1867 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.455345  1490 catalog_manager.cc:5697] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 1 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:11.476882  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:11.479588  1782 raft_consensus.cc:359] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.480543  1782 raft_consensus.cc:385] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.467543  1781 raft_consensus.cc:740] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
W20260709 13:00:11.480614  1633 leader_election.cc:343] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:11.481029  1782 raft_consensus.cc:740] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.482439  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:11.483104  1741 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.487918  1867 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:11.482026  1782 consensus_queue.cc:260] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.488354  1864 consensus_queue.cc:1048] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:11.490087  1782 ts_tablet_manager.cc:1434] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.001s
I20260709 13:00:11.490831  1783 tablet_bootstrap.cc:492] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:11.491179  1782 tablet_bootstrap.cc:492] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:11.491266  1783 ts_tablet_manager.cc:1403] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.132s	user 0.010s	sys 0.021s
I20260709 13:00:11.494760  1741 raft_consensus.cc:2468] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 1.
I20260709 13:00:11.495335  1783 raft_consensus.cc:359] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.496601  1783 raft_consensus.cc:385] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.496941  1788 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.497164  1783 raft_consensus.cc:740] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.497617  1788 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.498353  1783 consensus_queue.cc:260] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.481761  1781 consensus_queue.cc:260] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.499991  1633 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:11.501204  1788 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:11.503104  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:11.503633  1781 ts_tablet_manager.cc:1434] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.043s	user 0.010s	sys 0.000s
I20260709 13:00:11.504877  1781 tablet_bootstrap.cc:492] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
W20260709 13:00:11.505221  1556 leader_election.cc:343] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:11.506002  1486 catalog_manager.cc:5697] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:11.507756  1782 tablet_bootstrap.cc:654] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.510643  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:11.511471  1740 raft_consensus.cc:2468] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 0.
I20260709 13:00:11.512146  1867 raft_consensus.cc:2804] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:11.513226  1867 raft_consensus.cc:697] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 1 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:11.514983  1783 ts_tablet_manager.cc:1434] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.003s
I20260709 13:00:11.514569  1867 consensus_queue.cc:237] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.515339  1558 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:11.522472  1835 raft_consensus.cc:2804] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:11.523052  1835 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.523555  1835 raft_consensus.cc:3060] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.525461  1824 consensus_queue.cc:1048] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:11.529526  1864 consensus_queue.cc:1048] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:11.516152  1783 tablet_bootstrap.cc:492] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:11.563800  1781 tablet_bootstrap.cc:654] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.566160  1782 tablet_bootstrap.cc:492] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:11.566732  1782 ts_tablet_manager.cc:1403] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.076s	user 0.022s	sys 0.034s
I20260709 13:00:11.570981  1782 raft_consensus.cc:359] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.571807  1782 raft_consensus.cc:385] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.572120  1782 raft_consensus.cc:740] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.573005  1782 consensus_queue.cc:260] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.576313  1782 ts_tablet_manager.cc:1434] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:00:11.577834  1782 tablet_bootstrap.cc:492] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:11.598351  1835 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.606002  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:11.606973  1740 raft_consensus.cc:3060] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.612618  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:11.613426  1818 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.614063  1818 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.616371  1818 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:11.616890  1787 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.617479  1787 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:11.618253  1556 leader_election.cc:343] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:11.619424  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:11.620823  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:11.622309  1633 leader_election.cc:343] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:11.623479  1633 leader_election.cc:343] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:11.623654  1741 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.624157  1633 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:11.624825  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:11.625198  1837 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:11.625939  1590 raft_consensus.cc:2393] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 1: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:11.628760  1787 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:11.602296  1812 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.629890  1812 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.641283  1812 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:11.642657  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:11.644071  1739 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 0.
I20260709 13:00:11.645043  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:11.645673  1558 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:11.646340  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:11.646775  1812 raft_consensus.cc:2804] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:11.647284  1812 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.648344  1705 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:11.609050  1835 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:11.647722  1556 leader_election.cc:343] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:11.659673  1783 tablet_bootstrap.cc:654] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.647790  1812 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.660610  1787 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:11.671541  1837 consensus_queue.cc:1048] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:00:11.668325  1486 catalog_manager.cc:5697] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 1 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:11.677364  1781 tablet_bootstrap.cc:492] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:11.677964  1781 ts_tablet_manager.cc:1403] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.173s	user 0.008s	sys 0.022s
I20260709 13:00:11.683521  1782 tablet_bootstrap.cc:654] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.679813  1740 raft_consensus.cc:2468] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:11.687927  1558 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:11.690618  1894 raft_consensus.cc:2804] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:11.691057  1812 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.691329  1894 raft_consensus.cc:697] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:11.694577  1894 consensus_queue.cc:237] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.695662  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:11.695866  1812 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:11.699574  1837 consensus_queue.cc:1048] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:11.701476  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:11.707527  1740 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.701308  1781 raft_consensus.cc:359] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:11.702456  1556 leader_election.cc:343] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:11.711489  1781 raft_consensus.cc:385] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.713179  1781 raft_consensus.cc:740] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
W20260709 13:00:11.720348  1633 consensus_peers.cc:597] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede -> Peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Couldn't send request to peer 5ced62816f8545cd9b63a27e9055e42d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:11.730726  1781 consensus_queue.cc:260] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.732558  1781 ts_tablet_manager.cc:1434] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.002s
I20260709 13:00:11.741953  1740 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:11.744064  1558 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:11.745625  1812 raft_consensus.cc:2804] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:11.746531  1812 raft_consensus.cc:697] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:00:11.748147  1538 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:11.748018  1812 consensus_queue.cc:237] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.751550  1781 tablet_bootstrap.cc:492] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:11.753857  1783 tablet_bootstrap.cc:492] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:11.754304  1783 ts_tablet_manager.cc:1403] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.238s	user 0.021s	sys 0.032s
I20260709 13:00:11.773872  1783 raft_consensus.cc:359] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.774389  1783 raft_consensus.cc:385] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.774639  1783 raft_consensus.cc:740] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.782197  1783 consensus_queue.cc:260] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.782429  1488 catalog_manager.cc:5697] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:11.796685  1867 consensus_queue.cc:1048] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:11.787001  1783 ts_tablet_manager.cc:1434] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.002s
I20260709 13:00:11.804127  1781 tablet_bootstrap.cc:654] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.805568  1783 tablet_bootstrap.cc:492] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:11.816794  1782 tablet_bootstrap.cc:492] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:11.824503  1782 ts_tablet_manager.cc:1403] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.247s	user 0.015s	sys 0.031s
I20260709 13:00:11.828612  1782 raft_consensus.cc:359] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.829813  1782 raft_consensus.cc:385] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.830169  1782 raft_consensus.cc:740] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.830974  1782 consensus_queue.cc:260] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.832564  1490 catalog_manager.cc:5697] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:11.834120  1781 tablet_bootstrap.cc:492] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:11.834472  1782 ts_tablet_manager.cc:1434] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:00:11.834589  1781 ts_tablet_manager.cc:1403] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.083s	user 0.008s	sys 0.015s
I20260709 13:00:11.835759  1782 tablet_bootstrap.cc:492] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:11.839504  1781 raft_consensus.cc:359] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.840546  1781 raft_consensus.cc:385] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.840966  1781 raft_consensus.cc:740] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.842115  1781 consensus_queue.cc:260] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.845463  1781 ts_tablet_manager.cc:1434] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:00:11.847086  1783 tablet_bootstrap.cc:654] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.847146  1781 tablet_bootstrap.cc:492] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:11.859670  1788 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.860440  1788 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.862402  1782 tablet_bootstrap.cc:654] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.866245  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:11.867080  1741 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 0.
I20260709 13:00:11.869113  1787 consensus_queue.cc:1048] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:11.868749  1558 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:11.871096  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:11.871294  1835 raft_consensus.cc:2804] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:11.871886  1835 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:11.872289  1556 leader_election.cc:343] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:11.872313  1835 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.877178  1788 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:11.881454  1835 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.884479  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:00:11.885803  1556 leader_election.cc:343] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:11.889184  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:11.889973  1741 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.896078  1835 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:11.900243  1783 tablet_bootstrap.cc:492] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:11.900844  1783 ts_tablet_manager.cc:1403] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.097s	user 0.012s	sys 0.031s
I20260709 13:00:11.903692  1781 tablet_bootstrap.cc:654] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.905603  1741 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:11.909857  1558 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:11.911191  1835 raft_consensus.cc:2804] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:11.911880  1835 raft_consensus.cc:697] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:11.913580  1835 consensus_queue.cc:237] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.922830  1782 tablet_bootstrap.cc:492] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:11.923290  1782 ts_tablet_manager.cc:1403] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.088s	user 0.011s	sys 0.009s
I20260709 13:00:11.926256  1824 consensus_queue.cc:1048] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:11.928267  1782 raft_consensus.cc:359] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.929534  1782 raft_consensus.cc:385] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.930017  1782 raft_consensus.cc:740] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.932178  1782 consensus_queue.cc:260] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.936734  1782 ts_tablet_manager.cc:1434] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.013s	user 0.001s	sys 0.007s
I20260709 13:00:11.938401  1782 tablet_bootstrap.cc:492] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:11.943259  1783 raft_consensus.cc:359] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.944089  1783 raft_consensus.cc:385] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.944698  1783 raft_consensus.cc:740] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.971477  1783 consensus_queue.cc:260] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:11.980774  1783 ts_tablet_manager.cc:1434] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.080s	user 0.007s	sys 0.003s
I20260709 13:00:11.986845  1783 tablet_bootstrap.cc:492] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:11.982633  1824 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.998189  1824 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.009299  1781 tablet_bootstrap.cc:492] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:12.009943  1781 ts_tablet_manager.cc:1403] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.163s	user 0.013s	sys 0.050s
I20260709 13:00:12.011766  1824 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:12.013159  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:12.013458  1781 raft_consensus.cc:359] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.015588  1781 raft_consensus.cc:385] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.015841  1781 raft_consensus.cc:740] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.018432  1781 consensus_queue.cc:260] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.020848  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:12.021375  1781 ts_tablet_manager.cc:1434] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 13:00:12.026674  1782 tablet_bootstrap.cc:654] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.030558  1707 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:12.037029  1831 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:12.035638  1490 catalog_manager.cc:5697] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:12.050505  1782 tablet_bootstrap.cc:492] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:12.051091  1782 ts_tablet_manager.cc:1403] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.113s	user 0.009s	sys 0.020s
I20260709 13:00:12.052465  1781 tablet_bootstrap.cc:492] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:12.055265  1782 raft_consensus.cc:359] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.056237  1831 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.056483  1782 raft_consensus.cc:385] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.057031  1782 raft_consensus.cc:740] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.056953  1831 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.059149  1783 tablet_bootstrap.cc:654] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.063127  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:12.057885  1782 consensus_queue.cc:260] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.073902  1782 ts_tablet_manager.cc:1434] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.001s
I20260709 13:00:12.068534  1831 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:12.074712  1818 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:12.076391  1707 leader_election.cc:343] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:12.071578  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:12.076889  1818 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:12.079104  1705 leader_election.cc:343] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:12.079743  1705 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:12.080019  1591 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.081156  1824 raft_consensus.cc:2749] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:12.081763  1831 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.082643  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:12.084501  1782 tablet_bootstrap.cc:492] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:12.085541  1783 tablet_bootstrap.cc:492] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:12.085986  1783 ts_tablet_manager.cc:1403] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.099s	user 0.011s	sys 0.015s
I20260709 13:00:12.086066  1818 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:12.082633  1831 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.091838  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:12.093053  1741 raft_consensus.cc:2393] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 1: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:12.096897  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:12.097172  1783 raft_consensus.cc:359] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.097890  1783 raft_consensus.cc:385] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.097738  1590 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 0.
I20260709 13:00:12.098225  1783 raft_consensus.cc:740] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.099126  1783 consensus_queue.cc:260] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.101426  1707 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:12.102839  1824 raft_consensus.cc:2804] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:12.103161  1831 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:12.103369  1824 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:12.103598  1781 tablet_bootstrap.cc:654] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.103878  1824 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.107672  1783 ts_tablet_manager.cc:1434] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 13:00:12.109095  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:12.109966  1837 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.110646  1837 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.115295  1633 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:12.119805  1818 raft_consensus.cc:3060] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.113821  1837 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:12.126459  1812 consensus_queue.cc:1048] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:12.129169  1782 tablet_bootstrap.cc:654] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:12.131634  1705 leader_election.cc:343] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:12.144428  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:12.151808  1783 tablet_bootstrap.cc:492] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:12.151858  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:12.152336  1739 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.153090  1740 raft_consensus.cc:2393] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 1: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:12.153208  1837 consensus_queue.cc:1048] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:12.159305  1837 consensus_queue.cc:1048] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:12.161314  1824 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.168535  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:12.170130  1591 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.172730  1818 raft_consensus.cc:2749] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:12.164918  1824 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:12.183032  1633 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:12.186667  1818 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.187542  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:00:12.196530  1705 leader_election.cc:343] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:12.201056  1812 consensus_queue.cc:1048] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:12.205603  1818 raft_consensus.cc:2749] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:12.209764  1783 tablet_bootstrap.cc:654] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.213845  1781 tablet_bootstrap.cc:492] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:12.215472  1781 ts_tablet_manager.cc:1403] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.169s	user 0.013s	sys 0.040s
I20260709 13:00:12.228433  1591 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:12.244302  1707 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:12.246650  1824 raft_consensus.cc:2804] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:12.247416  1824 raft_consensus.cc:697] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:12.241223  1818 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.248840  1824 consensus_queue.cc:237] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.250198  1818 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.257299  1781 raft_consensus.cc:359] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.258165  1781 raft_consensus.cc:385] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.258473  1781 raft_consensus.cc:740] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.260471  1781 consensus_queue.cc:260] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.264115  1781 ts_tablet_manager.cc:1434] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.048s	user 0.009s	sys 0.001s
I20260709 13:00:12.264966  1818 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:12.266901  1812 consensus_queue.cc:1048] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:12.265476  1781 tablet_bootstrap.cc:492] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:12.287861  1812 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.289611  1812 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.295698  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:12.297530  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:12.301316  1782 tablet_bootstrap.cc:492] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:12.301988  1782 ts_tablet_manager.cc:1403] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.218s	user 0.020s	sys 0.030s
I20260709 13:00:12.303054  1812 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:12.305523  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:12.308151  1740 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 0.
W20260709 13:00:12.308347  1556 leader_election.cc:343] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:12.309603  1782 raft_consensus.cc:359] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.310422  1782 raft_consensus.cc:385] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.310320  1558 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:12.310818  1782 raft_consensus.cc:740] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.311620  1894 raft_consensus.cc:2804] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:12.311560  1782 consensus_queue.cc:260] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.312201  1894 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:12.312738  1894 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.315846  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:00:12.316124  1633 leader_election.cc:343] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:12.316639  1739 raft_consensus.cc:2468] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 0.
I20260709 13:00:12.322184  1864 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.324306  1864 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.320704  1633 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:12.363234  1782 ts_tablet_manager.cc:1434] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.061s	user 0.010s	sys 0.000s
I20260709 13:00:12.365046  1783 tablet_bootstrap.cc:492] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:12.365653  1783 ts_tablet_manager.cc:1403] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.214s	user 0.024s	sys 0.009s
I20260709 13:00:12.373816  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:12.367522  1837 raft_consensus.cc:2804] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:00:12.375041  1556 leader_election.cc:343] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:12.375566  1837 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:12.375944  1837 raft_consensus.cc:3060] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.385020  1782 tablet_bootstrap.cc:492] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:12.363812  1812 consensus_queue.cc:1048] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:00:12.388744  1837 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.394138  1894 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.396991  1837 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:12.398089  1490 catalog_manager.cc:5697] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
W20260709 13:00:12.371073  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 50530.9us
I20260709 13:00:12.403096  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:12.406141  1894 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:12.409428  1556 leader_election.cc:343] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:12.410161  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:12.412083  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:12.412943  1741 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.416090  1781 tablet_bootstrap.cc:654] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.405417  1864 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:12.417955  1558 leader_election.cc:343] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:12.418645  1558 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:12.423382  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:12.425777  1783 raft_consensus.cc:359] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.426515  1783 raft_consensus.cc:385] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.426739  1783 raft_consensus.cc:740] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.427487  1864 raft_consensus.cc:2749] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:00:12.444638  1633 leader_election.cc:343] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:12.441262  1741 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
W20260709 13:00:12.451256  1556 consensus_peers.cc:597] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:12.456784  1558 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:12.459390  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:12.460357  1740 raft_consensus.cc:3060] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.460527  1812 raft_consensus.cc:2804] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:12.461544  1812 raft_consensus.cc:697] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:12.441183  1783 consensus_queue.cc:260] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.464828  1788 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.465552  1788 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.472723  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:12.472972  1788 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:12.474970  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:00:12.475127  1556 leader_election.cc:343] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:12.463485  1812 consensus_queue.cc:237] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.482366  1783 ts_tablet_manager.cc:1434] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.116s	user 0.008s	sys 0.001s
W20260709 13:00:12.482698  1558 leader_election.cc:343] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:12.484565  1558 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:12.485744  1783 tablet_bootstrap.cc:492] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:12.486011  1835 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:12.488938  1864 consensus_queue.cc:1048] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:12.494143  1782 tablet_bootstrap.cc:654] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.507576  1781 tablet_bootstrap.cc:492] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:12.508455  1781 ts_tablet_manager.cc:1403] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.243s	user 0.017s	sys 0.016s
I20260709 13:00:12.517484  1781 raft_consensus.cc:359] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.518301  1781 raft_consensus.cc:385] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.518618  1781 raft_consensus.cc:740] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.519404  1781 consensus_queue.cc:260] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.523449  1781 ts_tablet_manager.cc:1434] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:00:12.524757  1781 tablet_bootstrap.cc:492] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:12.527979  1740 raft_consensus.cc:2468] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 1.
I20260709 13:00:12.529960  1633 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:12.531183  1867 raft_consensus.cc:2804] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:12.531908  1867 raft_consensus.cc:697] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 1 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:12.533703  1867 consensus_queue.cc:237] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.534911  1782 tablet_bootstrap.cc:492] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:12.538093  1782 ts_tablet_manager.cc:1403] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.153s	user 0.008s	sys 0.013s
I20260709 13:00:12.539315  1783 tablet_bootstrap.cc:654] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.540488  1781 tablet_bootstrap.cc:654] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.553699  1782 raft_consensus.cc:359] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.554417  1782 raft_consensus.cc:385] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.554656  1782 raft_consensus.cc:740] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.555233  1782 consensus_queue.cc:260] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.557763  1782 ts_tablet_manager.cc:1434] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.005s
I20260709 13:00:12.561995  1782 tablet_bootstrap.cc:492] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:12.562094  1490 catalog_manager.cc:5697] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:12.564145  1486 catalog_manager.cc:5697] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 1 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:12.575390  1782 tablet_bootstrap.cc:654] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.590204  1783 tablet_bootstrap.cc:492] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:12.594812  1783 ts_tablet_manager.cc:1403] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.111s	user 0.021s	sys 0.005s
I20260709 13:00:12.600291  1782 tablet_bootstrap.cc:492] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:12.600852  1782 ts_tablet_manager.cc:1403] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.011s
I20260709 13:00:12.603869  1781 tablet_bootstrap.cc:492] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:12.604772  1781 ts_tablet_manager.cc:1403] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.080s	user 0.016s	sys 0.032s
I20260709 13:00:12.599820  1783 raft_consensus.cc:359] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.603798  1782 raft_consensus.cc:359] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.605278  1783 raft_consensus.cc:385] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.605357  1782 raft_consensus.cc:385] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.605619  1783 raft_consensus.cc:740] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.605751  1782 raft_consensus.cc:740] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.606367  1783 consensus_queue.cc:260] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.606659  1782 consensus_queue.cc:260] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.609642  1781 raft_consensus.cc:359] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.610378  1783 ts_tablet_manager.cc:1434] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:00:12.610338  1781 raft_consensus.cc:385] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.610792  1781 raft_consensus.cc:740] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.612027  1781 consensus_queue.cc:260] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.613548  1782 ts_tablet_manager.cc:1434] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 13:00:12.614547  1781 ts_tablet_manager.cc:1434] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:00:12.614606  1782 tablet_bootstrap.cc:492] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:12.616079  1781 tablet_bootstrap.cc:492] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:12.623337  1783 tablet_bootstrap.cc:492] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:12.625279  1782 tablet_bootstrap.cc:654] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.627698  1781 tablet_bootstrap.cc:654] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.647150  1783 tablet_bootstrap.cc:654] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.671216  1781 tablet_bootstrap.cc:492] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:12.671820  1781 ts_tablet_manager.cc:1403] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.056s	user 0.029s	sys 0.022s
I20260709 13:00:12.671213  1667 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.672056  1782 tablet_bootstrap.cc:492] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:12.674098  1782 ts_tablet_manager.cc:1403] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.060s	user 0.019s	sys 0.013s
I20260709 13:00:12.676021  1910 consensus_queue.cc:1048] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:12.677350  1783 tablet_bootstrap.cc:492] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:12.677878  1783 ts_tablet_manager.cc:1403] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.067s	user 0.013s	sys 0.012s
I20260709 13:00:12.680518  1781 raft_consensus.cc:359] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.681360  1781 raft_consensus.cc:385] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.681668  1781 raft_consensus.cc:740] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.682546  1781 consensus_queue.cc:260] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.686269  1781 ts_tablet_manager.cc:1434] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:00:12.687275  1781 tablet_bootstrap.cc:492] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:12.688897  1782 raft_consensus.cc:359] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.689666  1782 raft_consensus.cc:385] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.689921  1782 raft_consensus.cc:740] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.690512  1782 consensus_queue.cc:260] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.691084  1910 consensus_queue.cc:1048] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:12.696331  1783 raft_consensus.cc:359] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.697021  1783 raft_consensus.cc:385] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.697346  1783 raft_consensus.cc:740] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.698194  1783 consensus_queue.cc:260] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.698649  1835 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.699249  1835 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.701274  1783 ts_tablet_manager.cc:1434] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.023s	user 0.011s	sys 0.000s
I20260709 13:00:12.701745  1781 tablet_bootstrap.cc:654] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.703990  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:12.705351  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:12.706012  1910 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.706648  1910 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.709172  1783 tablet_bootstrap.cc:492] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:12.710291  1910 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:12.710513  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:12.712101  1558 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:12.714716  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:12.713335  1835 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:12.717820  1705 leader_election.cc:343] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:12.720463  1782 ts_tablet_manager.cc:1434] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.001s
I20260709 13:00:12.720397  1927 raft_consensus.cc:2749] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:00:12.722030  1707 leader_election.cc:343] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:12.725718  1707 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:12.727113  1910 raft_consensus.cc:2749] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:12.727583  1867 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.728225  1867 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.733289  1782 tablet_bootstrap.cc:492] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:12.738992  1783 tablet_bootstrap.cc:654] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.751880  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:12.756603  1781 tablet_bootstrap.cc:492] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:12.757117  1781 ts_tablet_manager.cc:1403] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.070s	user 0.011s	sys 0.027s
I20260709 13:00:12.761812  1867 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:12.766404  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:12.771174  1741 raft_consensus.cc:2393] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 1: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:12.772318  1781 raft_consensus.cc:359] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.772970  1633 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:12.772977  1781 raft_consensus.cc:385] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.775353  1781 raft_consensus.cc:740] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.776516  1781 consensus_queue.cc:260] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.779783  1781 ts_tablet_manager.cc:1434] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260709 13:00:12.780830  1781 tablet_bootstrap.cc:492] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:12.781486  1867 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.790894  1781 tablet_bootstrap.cc:654] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.803722  1831 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.804430  1831 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.805162  1781 tablet_bootstrap.cc:492] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:12.805652  1781 ts_tablet_manager.cc:1403] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.007s
I20260709 13:00:12.809710  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:12.810376  1592 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 0.
I20260709 13:00:12.810832  1781 raft_consensus.cc:359] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.811474  1781 raft_consensus.cc:385] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.811738  1781 raft_consensus.cc:740] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.812496  1781 consensus_queue.cc:260] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.813110  1707 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:12.813867  1910 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:12.814222  1910 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:12.814559  1910 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.816084  1831 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:12.817366  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:12.817986  1667 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 0.
I20260709 13:00:12.823103  1910 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:12.824757  1538 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:12.828239  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:12.828986  1592 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.828763  1781 ts_tablet_manager.cc:1434] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.002s
I20260709 13:00:12.831328  1781 tablet_bootstrap.cc:492] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:12.832772  1782 tablet_bootstrap.cc:654] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.833530  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:12.834314  1667 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.837033  1910 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:12.843317  1590 raft_consensus.cc:3060] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.843807  1781 tablet_bootstrap.cc:654] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.853247  1867 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:12.869347  1783 tablet_bootstrap.cc:492] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:12.869809  1783 ts_tablet_manager.cc:1403] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.161s	user 0.025s	sys 0.079s
I20260709 13:00:12.869273  1592 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:12.868896  1667 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:12.871852  1707 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:12.872804  1910 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:12.873525  1910 raft_consensus.cc:697] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:12.875017  1910 consensus_queue.cc:237] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.875737  1783 raft_consensus.cc:359] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.876773  1783 raft_consensus.cc:385] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.878058  1781 tablet_bootstrap.cc:492] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:12.880399  1781 ts_tablet_manager.cc:1403] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.049s	user 0.007s	sys 0.017s
I20260709 13:00:12.881181  1783 raft_consensus.cc:740] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.882050  1783 consensus_queue.cc:260] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.883889  1781 raft_consensus.cc:359] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.884528  1781 raft_consensus.cc:385] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.884969  1781 raft_consensus.cc:740] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.885151  1783 ts_tablet_manager.cc:1434] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.003s
I20260709 13:00:12.885764  1781 consensus_queue.cc:260] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.887993  1781 ts_tablet_manager.cc:1434] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:00:12.888765  1781 tablet_bootstrap.cc:492] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:12.889628  1488 catalog_manager.cc:5697] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:12.892539  1782 tablet_bootstrap.cc:492] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:12.892959  1782 ts_tablet_manager.cc:1403] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.160s	user 0.008s	sys 0.014s
I20260709 13:00:12.897181  1783 tablet_bootstrap.cc:492] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:12.912211  1781 tablet_bootstrap.cc:654] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.918759  1782 raft_consensus.cc:359] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.919703  1782 raft_consensus.cc:385] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.919988  1782 raft_consensus.cc:740] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.925531  1782 consensus_queue.cc:260] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.935956  1783 tablet_bootstrap.cc:654] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.937359  1782 ts_tablet_manager.cc:1434] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.002s
I20260709 13:00:12.938903  1782 tablet_bootstrap.cc:492] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:12.950901  1782 tablet_bootstrap.cc:654] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.954970  1781 tablet_bootstrap.cc:492] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:12.955685  1781 ts_tablet_manager.cc:1403] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.067s	user 0.016s	sys 0.015s
I20260709 13:00:12.959508  1783 tablet_bootstrap.cc:492] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:12.960155  1783 ts_tablet_manager.cc:1403] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.068s	user 0.013s	sys 0.017s
I20260709 13:00:12.959833  1781 raft_consensus.cc:359] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.960587  1781 raft_consensus.cc:385] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.960994  1781 raft_consensus.cc:740] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.961252  1910 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.962064  1910 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.962167  1781 consensus_queue.cc:260] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.964818  1781 ts_tablet_manager.cc:1434] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:00:12.964645  1783 raft_consensus.cc:359] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.965480  1783 raft_consensus.cc:385] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.965867  1781 tablet_bootstrap.cc:492] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:12.965809  1783 raft_consensus.cc:740] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.966676  1783 consensus_queue.cc:260] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.970954  1824 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.971760  1824 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:12.974298  1781 tablet_bootstrap.cc:654] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.977144  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:12.978066  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:12.978991  1707 leader_election.cc:343] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:12.978915  1590 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 0.
I20260709 13:00:12.981441  1707 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:12.983938  1831 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:12.984566  1831 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:12.985189  1831 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.987380  1783 ts_tablet_manager.cc:1434] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.027s	user 0.000s	sys 0.007s
I20260709 13:00:12.998346  1783 tablet_bootstrap.cc:492] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:13.008625  1782 tablet_bootstrap.cc:492] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:13.010591  1782 ts_tablet_manager.cc:1403] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.072s	user 0.046s	sys 0.019s
I20260709 13:00:13.015618  1781 tablet_bootstrap.cc:492] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:13.016278  1781 ts_tablet_manager.cc:1403] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.051s	user 0.019s	sys 0.025s
I20260709 13:00:13.016777  1910 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:13.023262  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:13.027194  1705 leader_election.cc:343] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.010854  1927 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.017969  1824 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:13.033313  1835 consensus_queue.cc:1048] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:00:13.044665  1894 consensus_queue.cc:1048] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:13.046305  1590 raft_consensus.cc:3060] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.029047  1927 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.046572  1781 raft_consensus.cc:359] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.048059  1781 raft_consensus.cc:385] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.048441  1781 raft_consensus.cc:740] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.049260  1781 consensus_queue.cc:260] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.049804  1927 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:13.051043  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:13.054116  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:13.054955  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:13.055096  1740 raft_consensus.cc:2468] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 0.
I20260709 13:00:13.055963  1667 raft_consensus.cc:2468] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 0.
I20260709 13:00:13.057469  1556 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:00:13.059230  1705 leader_election.cc:343] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.059974  1705 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:13.061172  1864 raft_consensus.cc:2804] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:13.061762  1864 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.062287  1864 raft_consensus.cc:3060] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.070225  1824 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:13.073191  1665 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.085433  1951 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.090342  1951 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.092537  1781 ts_tablet_manager.cc:1434] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.076s	user 0.020s	sys 0.028s
I20260709 13:00:13.093973  1781 tablet_bootstrap.cc:492] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:13.095505  1782 raft_consensus.cc:359] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.095806  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:13.101969  1783 tablet_bootstrap.cc:654] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.096223  1782 raft_consensus.cc:385] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.109880  1782 raft_consensus.cc:740] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.109670  1927 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.118634  1927 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.137544  1951 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:13.104866  1831 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.139442  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:13.141535  1705 leader_election.cc:343] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.155761  1782 consensus_queue.cc:260] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.157287  1831 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:13.156510  1864 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.162155  1837 consensus_queue.cc:1048] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:13.163581  1864 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:13.165529  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:13.166363  1666 raft_consensus.cc:3060] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.166675  1831 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.167459  1831 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.177731  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:13.184919  1782 ts_tablet_manager.cc:1434] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.174s	user 0.011s	sys 0.005s
I20260709 13:00:13.187919  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:13.188813  1667 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 0.
I20260709 13:00:13.189308  1831 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:00:13.190717  1705 leader_election.cc:343] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.192351  1556 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:13.218782  1781 tablet_bootstrap.cc:654] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.219950  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:13.224840  1782 tablet_bootstrap.cc:492] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
W20260709 13:00:13.222652  1705 leader_election.cc:343] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.222565  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:00:13.217567  1707 leader_election.cc:343] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.225713  1927 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:13.229506  1738 raft_consensus.cc:3060] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.235668  1707 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:00:13.250537  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 53142.8us
I20260709 13:00:13.251309  1831 raft_consensus.cc:2749] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:13.236657  1835 raft_consensus.cc:2804] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:13.258342  1835 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.258903  1835 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.260442  1666 raft_consensus.cc:2468] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
W20260709 13:00:13.235812  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 43597us
I20260709 13:00:13.267491  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:13.272737  1837 consensus_queue.cc:1048] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:13.273546  1590 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.273883  1783 tablet_bootstrap.cc:492] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:13.274705  1783 ts_tablet_manager.cc:1403] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.277s	user 0.016s	sys 0.025s
I20260709 13:00:13.295526  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:13.296218  1592 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 0.
I20260709 13:00:13.298177  1783 raft_consensus.cc:359] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.298731  1783 raft_consensus.cc:385] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.298971  1783 raft_consensus.cc:740] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.299547  1783 consensus_queue.cc:260] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.313853  1783 ts_tablet_manager.cc:1434] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 13:00:13.315968  1556 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:13.319471  1738 raft_consensus.cc:2468] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:13.326465  1955 raft_consensus.cc:2804] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:13.327140  1955 raft_consensus.cc:697] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:13.327078  1835 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.328274  1955 consensus_queue.cc:237] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.329571  1782 tablet_bootstrap.cc:654] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.339041  1781 tablet_bootstrap.cc:492] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:13.343626  1781 ts_tablet_manager.cc:1403] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.250s	user 0.026s	sys 0.013s
I20260709 13:00:13.339537  1783 tablet_bootstrap.cc:492] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:13.350689  1867 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:13.351418  1867 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.352517  1781 raft_consensus.cc:359] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.353459  1781 raft_consensus.cc:385] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.353721  1781 raft_consensus.cc:740] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.355195  1781 consensus_queue.cc:260] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.362601  1707 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:13.367388  1867 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:13.377065  1831 raft_consensus.cc:2804] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:13.377223  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:13.377565  1831 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.378046  1738 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 0.
I20260709 13:00:13.378121  1831 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.330005  1835 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:13.394915  1781 ts_tablet_manager.cc:1434] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.002s
I20260709 13:00:13.399612  1781 tablet_bootstrap.cc:492] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:13.439733  1782 tablet_bootstrap.cc:492] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:13.440387  1782 ts_tablet_manager.cc:1403] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.217s	user 0.023s	sys 0.001s
I20260709 13:00:13.454926  1590 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:13.467149  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:13.460352  1951 consensus_queue.cc:1048] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:00:13.471406  1782 raft_consensus.cc:359] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.473163  1782 raft_consensus.cc:385] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.473472  1782 raft_consensus.cc:740] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.474128  1782 consensus_queue.cc:260] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.470042  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:13.471130  1665 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.480000  1781 tablet_bootstrap.cc:654] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.479710  1831 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.483954  1782 ts_tablet_manager.cc:1434] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 13:00:13.488210  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:13.486754  1738 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.498147  1782 tablet_bootstrap.cc:492] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:13.503996  1488 catalog_manager.cc:5697] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:13.504515  1783 tablet_bootstrap.cc:654] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.509454  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:13.517901  1831 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:13.525609  1951 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.526250  1951 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.528671  1665 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:13.540912  1556 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:13.543552  1955 raft_consensus.cc:2804] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:13.544286  1955 raft_consensus.cc:697] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:13.538527  1951 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:13.543241  1633 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:13.545421  1955 consensus_queue.cc:237] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.548702  1965 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:13.552155  1738 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:13.536933  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:13.523566  1707 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:13.574111  1970 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:13.579434  1781 tablet_bootstrap.cc:492] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:13.579906  1781 ts_tablet_manager.cc:1403] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.181s	user 0.013s	sys 0.017s
I20260709 13:00:13.581543  1970 raft_consensus.cc:697] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:13.586712  1970 consensus_queue.cc:237] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.595945  1910 consensus_queue.cc:1048] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:13.601047  1782 tablet_bootstrap.cc:654] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:13.589363  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 74404.4us
I20260709 13:00:13.604135  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:13.618008  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:13.618714  1705 leader_election.cc:343] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.618626  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:13.619728  1591 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.624316  1783 tablet_bootstrap.cc:492] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:13.624958  1783 ts_tablet_manager.cc:1403] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.286s	user 0.019s	sys 0.022s
W20260709 13:00:13.620473  1707 leader_election.cc:343] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.616151  1781 raft_consensus.cc:359] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.626266  1781 raft_consensus.cc:385] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.626647  1781 raft_consensus.cc:740] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.627393  1781 consensus_queue.cc:260] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:13.631278  1705 leader_election.cc:343] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.632036  1705 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:13.633319  1951 raft_consensus.cc:2749] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:13.641021  1781 ts_tablet_manager.cc:1434] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.061s	user 0.013s	sys 0.005s
I20260709 13:00:13.642493  1781 tablet_bootstrap.cc:492] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:13.654683  1781 tablet_bootstrap.cc:654] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.664450  1783 raft_consensus.cc:359] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.665760  1783 raft_consensus.cc:385] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.666148  1783 raft_consensus.cc:740] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.666077  1591 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:13.667323  1783 consensus_queue.cc:260] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.668756  1707 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:13.670711  1783 ts_tablet_manager.cc:1434] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.001s
I20260709 13:00:13.670786  1951 raft_consensus.cc:2804] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:13.671624  1951 raft_consensus.cc:697] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:13.672195  1783 tablet_bootstrap.cc:492] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:13.672857  1951 consensus_queue.cc:237] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.681885  1965 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.683549  1965 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.691454  1965 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:13.700033  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:13.705057  1633 leader_election.cc:343] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.705163  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:13.706271  1738 raft_consensus.cc:2468] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 0.
W20260709 13:00:13.710536  1978 log.cc:927] Time spent T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:00:13.710919  1633 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:13.711189  1783 tablet_bootstrap.cc:654] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.714725  1964 raft_consensus.cc:2804] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:13.715319  1964 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.715839  1964 raft_consensus.cc:3060] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.727732  1782 tablet_bootstrap.cc:492] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:13.728335  1782 ts_tablet_manager.cc:1403] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.232s	user 0.018s	sys 0.016s
I20260709 13:00:13.729857  1489 catalog_manager.cc:5697] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:13.731900  1782 raft_consensus.cc:359] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.732558  1782 raft_consensus.cc:385] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.732806  1782 raft_consensus.cc:740] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.733486  1782 consensus_queue.cc:260] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.735580  1782 ts_tablet_manager.cc:1434] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:00:13.738909  1965 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.739570  1965 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.745462  1782 tablet_bootstrap.cc:492] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:13.746539  1965 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:13.741191  1964 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.754896  1964 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:13.751484  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:13.750806  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:13.757861  1739 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 0.
I20260709 13:00:13.757923  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:13.758144  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:13.758776  1590 raft_consensus.cc:3060] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.761842  1633 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:13.763403  1781 tablet_bootstrap.cc:492] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:13.763944  1781 ts_tablet_manager.cc:1403] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.122s	user 0.017s	sys 0.016s
I20260709 13:00:13.759081  1589 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 0.
I20260709 13:00:13.759074  1738 raft_consensus.cc:3060] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.766525  1964 raft_consensus.cc:2804] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:13.767589  1490 catalog_manager.cc:5697] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:13.768638  1783 tablet_bootstrap.cc:492] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:13.769173  1781 raft_consensus.cc:359] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.766992  1964 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.784025  1783 ts_tablet_manager.cc:1403] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.112s	user 0.019s	sys 0.021s
I20260709 13:00:13.773932  1782 tablet_bootstrap.cc:654] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.784737  1781 raft_consensus.cc:385] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.784134  1964 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.785053  1781 raft_consensus.cc:740] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.773495  1955 consensus_queue.cc:1048] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:00:13.790091  1783 raft_consensus.cc:359] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.790738  1783 raft_consensus.cc:385] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.791000  1783 raft_consensus.cc:740] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.783627  1590 raft_consensus.cc:2468] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 1.
I20260709 13:00:13.791625  1783 consensus_queue.cc:260] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.792636  1633 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:13.793396  1867 raft_consensus.cc:2804] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:13.793833  1867 raft_consensus.cc:697] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 1 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:13.794027  1783 ts_tablet_manager.cc:1434] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:00:13.795027  1783 tablet_bootstrap.cc:492] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:13.794651  1867 consensus_queue.cc:237] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.795037  1489 catalog_manager.cc:5697] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:13.801297  1783 tablet_bootstrap.cc:654] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.801787  1781 consensus_queue.cc:260] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.803145  1964 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.807806  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:13.808848  1590 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.812523  1781 ts_tablet_manager.cc:1434] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.048s	user 0.002s	sys 0.006s
I20260709 13:00:13.814548  1781 tablet_bootstrap.cc:492] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:13.825949  1783 tablet_bootstrap.cc:492] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:13.826658  1783 ts_tablet_manager.cc:1403] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.012s
I20260709 13:00:13.828811  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:13.829896  1741 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.802080  1738 raft_consensus.cc:2468] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 1.
I20260709 13:00:13.841859  1783 raft_consensus.cc:359] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.855013  1783 raft_consensus.cc:385] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.855501  1783 raft_consensus.cc:740] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.857254  1783 consensus_queue.cc:260] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.858343  1782 tablet_bootstrap.cc:492] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:13.859236  1782 ts_tablet_manager.cc:1403] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.114s	user 0.011s	sys 0.007s
I20260709 13:00:13.859683  1783 ts_tablet_manager.cc:1434] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.033s	user 0.010s	sys 0.000s
I20260709 13:00:13.859520  1741 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 1.
I20260709 13:00:13.839030  1964 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:13.861500  1783 tablet_bootstrap.cc:492] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:13.863926  1590 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 1.
I20260709 13:00:13.867074  1782 raft_consensus.cc:359] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.867645  1782 raft_consensus.cc:385] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.867831  1782 raft_consensus.cc:740] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.872417  1781 tablet_bootstrap.cc:654] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.874548  1633 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:13.876096  1964 raft_consensus.cc:2804] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:13.876880  1964 raft_consensus.cc:697] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 1 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:13.878615  1964 consensus_queue.cc:237] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.888149  1782 consensus_queue.cc:260] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.890465  1956 consensus_queue.cc:1048] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:13.911861  1486 catalog_manager.cc:5697] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 1 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:13.933527  1782 ts_tablet_manager.cc:1434] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.074s	user 0.009s	sys 0.003s
I20260709 13:00:13.936337  1782 tablet_bootstrap.cc:492] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:13.939461  1781 tablet_bootstrap.cc:492] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:13.941282  1781 ts_tablet_manager.cc:1403] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.128s	user 0.012s	sys 0.024s
I20260709 13:00:13.943109  1783 tablet_bootstrap.cc:654] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.947088  1781 raft_consensus.cc:359] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.948716  1781 raft_consensus.cc:385] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.949051  1781 raft_consensus.cc:740] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.949820  1781 consensus_queue.cc:260] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.951990  1781 ts_tablet_manager.cc:1434] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:00:13.956620  1781 tablet_bootstrap.cc:492] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:13.975647  1782 tablet_bootstrap.cc:654] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.979171  1964 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.980161  1964 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:13.989382  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:13.984817  1964 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:13.993897  1633 leader_election.cc:343] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.999686  1781 tablet_bootstrap.cc:654] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.000434  1954 consensus_queue.cc:1048] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 13:00:14.006870  1538 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:14.008716  1954 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.009479  1954 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.011060  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:14.011396  1955 consensus_queue.cc:1048] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:14.015319  1741 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 0.
I20260709 13:00:14.026201  1633 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:14.055073  1867 raft_consensus.cc:2804] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:14.055783  1867 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:14.056149  1867 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.057271  1954 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:14.060786  1831 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.061533  1831 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.066223  1831 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:14.070755  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:14.073035  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:14.075136  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:14.077677  1707 leader_election.cc:343] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.079070  1782 tablet_bootstrap.cc:492] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:14.079568  1782 ts_tablet_manager.cc:1403] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.143s	user 0.012s	sys 0.011s
I20260709 13:00:14.080036  1783 tablet_bootstrap.cc:492] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:14.080499  1783 ts_tablet_manager.cc:1403] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.219s	user 0.013s	sys 0.013s
I20260709 13:00:14.083670  1782 raft_consensus.cc:359] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.083818  1783 raft_consensus.cc:359] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.084982  1782 raft_consensus.cc:385] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.085500  1783 raft_consensus.cc:385] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.085559  1782 raft_consensus.cc:740] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.085840  1783 raft_consensus.cc:740] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.086571  1782 consensus_queue.cc:260] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.086884  1783 consensus_queue.cc:260] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.090368  1663 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.090723  1783 ts_tablet_manager.cc:1434] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 13:00:14.092777  1812 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.094095  1783 tablet_bootstrap.cc:492] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:14.091409  1490 catalog_manager.cc:5697] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 1 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:14.098743  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:14.099663  1705 leader_election.cc:343] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:14.100891  1707 leader_election.cc:343] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.093554  1812 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.101835  1707 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:14.102583  1782 ts_tablet_manager.cc:1434] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.003s
I20260709 13:00:14.103328  1954 raft_consensus.cc:2749] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:00:14.104156  1705 leader_election.cc:343] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.104841  1705 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:14.105980  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:14.106523  1954 raft_consensus.cc:2749] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:14.107985  1782 tablet_bootstrap.cc:492] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:14.109581  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:14.110612  1739 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 0.
I20260709 13:00:14.114115  1558 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:14.115438  1955 raft_consensus.cc:2804] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:14.115924  1955 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:14.116410  1955 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.127092  1781 tablet_bootstrap.cc:492] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:14.127801  1781 ts_tablet_manager.cc:1403] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.171s	user 0.031s	sys 0.027s
I20260709 13:00:14.108175  1812 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:14.134692  1965 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.135517  1965 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.139001  1965 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:14.139068  1867 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.142211  1667 raft_consensus.cc:2393] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 1: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:14.144531  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:14.145748  1590 raft_consensus.cc:2393] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 1: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:14.148537  1781 raft_consensus.cc:359] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.149330  1867 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:14.149530  1781 raft_consensus.cc:385] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.150002  1781 raft_consensus.cc:740] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.150825  1781 consensus_queue.cc:260] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.153985  1781 ts_tablet_manager.cc:1434] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.026s	user 0.010s	sys 0.000s
I20260709 13:00:14.155397  1781 tablet_bootstrap.cc:492] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:14.160622  1955 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.163295  1831 consensus_queue.cc:1048] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:14.173596  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:14.174355  1738 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.180434  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:14.181529  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:14.182113  1590 raft_consensus.cc:2393] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 1: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:14.190112  1867 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.190953  1867 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.193229  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:14.194386  1663 raft_consensus.cc:2393] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 1: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:14.194228  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:14.214515  1783 tablet_bootstrap.cc:654] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.195935  1812 consensus_queue.cc:1048] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:00:14.219000  1782 tablet_bootstrap.cc:654] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.216053  1781 tablet_bootstrap.cc:654] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.211593  1738 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:14.207675  1665 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.215286  1954 consensus_queue.cc:1048] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:14.211997  1867 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:14.210126  1633 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:14.181013  1955 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:14.232689  1965 raft_consensus.cc:2749] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:00:14.233420  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:14.236541  1633 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:14.237164  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:14.239415  1867 raft_consensus.cc:2749] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:14.241195  1970 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.241570  1954 consensus_queue.cc:1048] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:14.241863  1970 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.248143  1970 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:14.248147  1558 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:14.249742  1867 consensus_queue.cc:1048] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:14.250521  1812 raft_consensus.cc:2804] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:14.252120  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:14.260566  1812 raft_consensus.cc:697] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:14.261837  1812 consensus_queue.cc:237] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.263172  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:14.271026  1956 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.274180  1956 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:14.272979  1707 leader_election.cc:343] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.284842  1783 tablet_bootstrap.cc:492] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:14.284629  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:14.291761  1783 ts_tablet_manager.cc:1403] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.200s	user 0.011s	sys 0.011s
I20260709 13:00:14.290341  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:14.288693  1956 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:14.298985  1738 raft_consensus.cc:2468] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 0.
W20260709 13:00:14.300170  1556 leader_election.cc:343] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.300737  1783 raft_consensus.cc:359] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.300951  1558 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:14.301741  1783 raft_consensus.cc:385] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.302142  1783 raft_consensus.cc:740] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.302322  1955 raft_consensus.cc:2804] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:14.302944  1955 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:14.303457  1955 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.303190  1783 consensus_queue.cc:260] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.307818  1783 ts_tablet_manager.cc:1434] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:00:14.309554  1783 tablet_bootstrap.cc:492] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:14.260524  1633 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:00:14.316241  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 55837.1us
W20260709 13:00:14.321671  1705 leader_election.cc:343] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.322120  1965 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:14.322321  1705 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:14.323802  1970 raft_consensus.cc:2749] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:14.328775  1782 tablet_bootstrap.cc:492] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:14.329494  1782 ts_tablet_manager.cc:1403] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.223s	user 0.014s	sys 0.016s
I20260709 13:00:14.329783  1781 tablet_bootstrap.cc:492] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:14.330250  1781 ts_tablet_manager.cc:1403] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.175s	user 0.013s	sys 0.029s
I20260709 13:00:14.331496  1486 catalog_manager.cc:5697] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:14.337255  1782 raft_consensus.cc:359] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.338058  1782 raft_consensus.cc:385] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.338377  1782 raft_consensus.cc:740] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.339097  1782 consensus_queue.cc:260] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.343186  1782 ts_tablet_manager.cc:1434] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:00:14.349589  1783 tablet_bootstrap.cc:654] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.341897  1955 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.371671  1782 tablet_bootstrap.cc:492] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:14.371050  1781 raft_consensus.cc:359] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.378474  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:14.373101  1781 raft_consensus.cc:385] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.380354  1781 raft_consensus.cc:740] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
W20260709 13:00:14.382592  1556 leader_election.cc:343] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.380784  1955 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:14.387941  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:14.389613  1739 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.392885  1781 consensus_queue.cc:260] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.403165  1781 ts_tablet_manager.cc:1434] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.073s	user 0.008s	sys 0.000s
I20260709 13:00:14.404407  1781 tablet_bootstrap.cc:492] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:14.413722  1783 tablet_bootstrap.cc:492] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:14.414702  1739 raft_consensus.cc:2468] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:14.415655  1783 ts_tablet_manager.cc:1403] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.106s	user 0.007s	sys 0.012s
I20260709 13:00:14.417960  1558 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:14.418677  1867 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.419243  1867 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.419934  1956 raft_consensus.cc:2804] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:14.420843  1956 raft_consensus.cc:697] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:14.422122  1867 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:14.424357  1965 consensus_queue.cc:1048] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:14.422508  1956 consensus_queue.cc:237] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.424995  1782 tablet_bootstrap.cc:654] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.432854  1965 consensus_queue.cc:1048] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:14.437629  1781 tablet_bootstrap.cc:654] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.441018  1782 tablet_bootstrap.cc:492] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:14.441596  1782 ts_tablet_manager.cc:1403] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.070s	user 0.013s	sys 0.004s
I20260709 13:00:14.448199  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:14.448858  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:14.449703  1739 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 0.
I20260709 13:00:14.449506  1782 raft_consensus.cc:359] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.450539  1782 raft_consensus.cc:385] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.450785  1782 raft_consensus.cc:740] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.451362  1782 consensus_queue.cc:260] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.451792  1783 raft_consensus.cc:359] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.452461  1783 raft_consensus.cc:385] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.452702  1783 raft_consensus.cc:740] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.453351  1782 ts_tablet_manager.cc:1434] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:00:14.454393  1782 tablet_bootstrap.cc:492] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
W20260709 13:00:14.457199  1633 leader_election.cc:343] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.458240  1970 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.453390  1783 consensus_queue.cc:260] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.458808  1970 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.458268  1633 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:14.460697  1965 raft_consensus.cc:2804] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:14.461100  1965 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:14.461464  1965 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.461946  1782 tablet_bootstrap.cc:654] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.460807  1970 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:14.464504  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:14.468714  1707 leader_election.cc:343] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.478950  1781 tablet_bootstrap.cc:492] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:14.479535  1781 ts_tablet_manager.cc:1403] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.075s	user 0.010s	sys 0.006s
I20260709 13:00:14.485257  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:14.488968  1489 catalog_manager.cc:5697] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:14.490060  1767 tablet.cc:2406] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:00:14.494971  1781 raft_consensus.cc:359] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.495805  1781 raft_consensus.cc:385] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.496177  1781 raft_consensus.cc:740] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.497198  1781 consensus_queue.cc:260] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.499169  1781 ts_tablet_manager.cc:1434] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.004s
I20260709 13:00:14.502651  1781 tablet_bootstrap.cc:492] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:14.509500  1783 ts_tablet_manager.cc:1434] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.093s	user 0.006s	sys 0.002s
W20260709 13:00:14.514899  1705 leader_election.cc:343] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.515525  1705 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:14.518050  1831 raft_consensus.cc:2749] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:14.487162  1965 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.525345  1783 tablet_bootstrap.cc:492] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:14.536932  1782 tablet_bootstrap.cc:492] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:14.537575  1782 ts_tablet_manager.cc:1403] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.083s	user 0.021s	sys 0.019s
I20260709 13:00:14.540040  1782 raft_consensus.cc:359] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.540697  1782 raft_consensus.cc:385] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.541003  1782 raft_consensus.cc:740] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.541714  1782 consensus_queue.cc:260] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.543974  1782 ts_tablet_manager.cc:1434] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:00:14.546664  1965 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:14.560060  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:14.568111  1782 tablet_bootstrap.cc:492] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:14.577349  1781 tablet_bootstrap.cc:654] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.579411  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:14.580555  1738 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:14.584913  1633 leader_election.cc:343] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.588917  1964 consensus_queue.cc:1048] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:00:14.599566  1831 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.600099  1831 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.600518  1955 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.601025  1955 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.602174  1831 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:14.603751  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:14.604568  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:14.604699  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:14.605370  1707 leader_election.cc:343] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:14.605984  1556 leader_election.cc:343] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:14.606209  1705 leader_election.cc:343] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.603035  1955 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:14.606104  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:14.606686  1705 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:14.606436  1782 tablet_bootstrap.cc:654] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.607249  1739 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 0.
I20260709 13:00:14.608117  1831 raft_consensus.cc:2749] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:14.609028  1558 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:14.610128  1956 raft_consensus.cc:2804] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:14.610545  1956 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:14.610773  1956 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.602447  1738 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 1.
I20260709 13:00:14.618114  1633 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:14.618888  1965 raft_consensus.cc:2804] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:14.620007  1965 raft_consensus.cc:697] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 1 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:14.607895  1783 tablet_bootstrap.cc:654] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.625192  1956 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.625283  1831 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.625243  1781 tablet_bootstrap.cc:492] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:14.626708  1781 ts_tablet_manager.cc:1403] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.124s	user 0.008s	sys 0.010s
I20260709 13:00:14.627375  1956 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:14.626379  1831 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.629135  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:14.630980  1781 raft_consensus.cc:359] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.631680  1831 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:14.625898  1782 tablet_bootstrap.cc:492] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:14.632333  1782 ts_tablet_manager.cc:1403] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.065s	user 0.010s	sys 0.006s
I20260709 13:00:14.632247  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:14.633976  1783 tablet_bootstrap.cc:492] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
W20260709 13:00:14.631059  1556 leader_election.cc:343] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.634430  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:14.638558  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:14.638972  1741 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:14.639962  1707 leader_election.cc:343] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.635468  1965 consensus_queue.cc:237] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.638947  1666 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 0.
I20260709 13:00:14.644464  1705 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:14.646700  1954 raft_consensus.cc:2804] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:14.647140  1954 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:14.647317  1741 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:14.647565  1954 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.648725  1558 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:14.649955  1955 raft_consensus.cc:2804] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:14.650595  1781 raft_consensus.cc:385] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.651021  1781 raft_consensus.cc:740] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.651196  1955 raft_consensus.cc:697] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:14.652051  1781 consensus_queue.cc:260] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.652271  1955 consensus_queue.cc:237] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.656311  1781 ts_tablet_manager.cc:1434] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.003s
I20260709 13:00:14.657393  1781 tablet_bootstrap.cc:492] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:14.664215  1490 catalog_manager.cc:5697] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 1 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:14.667903  1781 tablet_bootstrap.cc:654] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.671504  1782 raft_consensus.cc:359] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.672536  1782 raft_consensus.cc:385] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.672947  1782 raft_consensus.cc:740] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.672340  1783 ts_tablet_manager.cc:1403] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.148s	user 0.010s	sys 0.004s
I20260709 13:00:14.674074  1782 consensus_queue.cc:260] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.680760  1782 ts_tablet_manager.cc:1434] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.047s	user 0.004s	sys 0.004s
I20260709 13:00:14.680970  1783 raft_consensus.cc:359] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.682426  1783 raft_consensus.cc:385] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.684405  1782 tablet_bootstrap.cc:492] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:14.686990  1783 raft_consensus.cc:740] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.683162  1954 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.691792  1783 consensus_queue.cc:260] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.694475  1783 ts_tablet_manager.cc:1434] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:00:14.694820  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:14.695906  1783 tablet_bootstrap.cc:492] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:14.695655  1666 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.707490  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:14.708573  1591 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.708648  1927 consensus_queue.cc:1048] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:14.709363  1954 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:14.711879  1666 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:14.712999  1781 tablet_bootstrap.cc:492] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:14.714385  1781 ts_tablet_manager.cc:1403] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.057s	user 0.003s	sys 0.022s
I20260709 13:00:14.715610  1705 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:14.717357  1954 raft_consensus.cc:2804] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:14.719082  1781 raft_consensus.cc:359] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.720024  1781 raft_consensus.cc:385] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.718194  1954 raft_consensus.cc:697] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:14.720407  1781 raft_consensus.cc:740] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.722007  1781 consensus_queue.cc:260] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.721413  1954 consensus_queue.cc:237] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.730759  1927 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.731173  1783 tablet_bootstrap.cc:654] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.730831  1781 ts_tablet_manager.cc:1434] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.001s
I20260709 13:00:14.732999  1927 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.736270  1781 tablet_bootstrap.cc:492] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:14.737046  1927 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:14.739001  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:14.739758  1738 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 0.
I20260709 13:00:14.740825  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:14.741309  1558 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:00:14.742846  1556 leader_election.cc:343] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.742882  1591 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:14.743564  1490 catalog_manager.cc:5697] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:14.744114  1927 raft_consensus.cc:2804] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:14.753332  1927 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:14.753947  1927 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.754607  1782 tablet_bootstrap.cc:654] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.787215  1970 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.787943  1970 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.796044  1970 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:14.797592  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:14.797676  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:14.799561  1707 leader_election.cc:343] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:14.802414  1705 leader_election.cc:343] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.805876  1956 consensus_queue.cc:1048] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:14.806097  1705 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:14.808517  1970 raft_consensus.cc:2749] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:14.817755  1956 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.818708  1956 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.824901  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:14.831719  1956 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:14.838434  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:14.839412  1739 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 0.
I20260709 13:00:14.848053  1558 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:14.848467  1956 consensus_queue.cc:1048] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:14.849411  1955 raft_consensus.cc:2804] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:14.850726  1955 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:14.851261  1955 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:14.857554  1556 leader_election.cc:343] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:14.862609  1556 consensus_peers.cc:597] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:14.878331  1783 tablet_bootstrap.cc:492] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:14.879076  1783 ts_tablet_manager.cc:1403] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.183s	user 0.023s	sys 0.066s
I20260709 13:00:14.886999  1783 raft_consensus.cc:359] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.888518  1783 raft_consensus.cc:385] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.892099  1783 raft_consensus.cc:740] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.893462  1783 consensus_queue.cc:260] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.897328  1783 ts_tablet_manager.cc:1434] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 13:00:14.936259  1783 tablet_bootstrap.cc:492] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:14.942181  1927 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.943822  1955 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.950944  1781 tablet_bootstrap.cc:654] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:14.934391  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 52564.1us
I20260709 13:00:14.960191  1782 tablet_bootstrap.cc:492] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:14.960807  1782 ts_tablet_manager.cc:1403] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.277s	user 0.034s	sys 0.071s
I20260709 13:00:14.971575  1955 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:14.971089  1927 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:14.976691  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:14.964237  1965 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.978924  1965 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.988090  1954 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.988889  1954 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.989286  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:14.973431  1782 raft_consensus.cc:359] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.993841  1782 raft_consensus.cc:385] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.994143  1782 raft_consensus.cc:740] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.994679  1782 consensus_queue.cc:260] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:14.998061  1739 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:15.001576  1556 leader_election.cc:343] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:15.002456  1489 catalog_manager.cc:5697] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:15.198745  1782 ts_tablet_manager.cc:1434] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.236s	user 0.023s	sys 0.036s
I20260709 13:00:15.217060  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:15.219831  1782 tablet_bootstrap.cc:492] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:15.200987  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:15.220440  1741 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.047195  1964 consensus_queue.cc:1048] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.175s
I20260709 13:00:15.226454  1954 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:15.210249  1965 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:15.233379  1707 leader_election.cc:343] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:15.013489  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:15.245154  1666 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.252079  1955 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.252797  1955 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:15.253226  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:15.260015  1739 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:15.260114  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:15.261497  1705 leader_election.cc:343] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:15.262126  1705 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:15.264453  1831 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:15.271345  1955 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:15.283131  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:15.284745  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:15.286206  1739 raft_consensus.cc:2393] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 1: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:15.287994  1783 tablet_bootstrap.cc:654] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.283239  1590 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.291081  1661 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.299643  1741 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:15.300395  1782 tablet_bootstrap.cc:654] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.313582  1781 tablet_bootstrap.cc:492] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:15.314129  1781 ts_tablet_manager.cc:1403] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.578s	user 0.028s	sys 0.030s
I20260709 13:00:15.317622  1781 raft_consensus.cc:359] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:15.318301  1781 raft_consensus.cc:385] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.318559  1781 raft_consensus.cc:740] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.319156  1781 consensus_queue.cc:260] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:15.321367  1781 ts_tablet_manager.cc:1434] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:00:15.323665  1781 tablet_bootstrap.cc:492] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:15.325419  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:15.330710  2027 consensus_queue.cc:1048] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:15.349839  1558 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:15.350951  2027 raft_consensus.cc:2804] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:15.352146  2027 raft_consensus.cc:697] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:15.354696  1781 tablet_bootstrap.cc:654] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.356596  2027 consensus_queue.cc:237] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:15.358968  2028 consensus_queue.cc:1048] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:00:15.361517  1666 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:15.369612  1633 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:15.386981  1556 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:15.388556  1956 raft_consensus.cc:2804] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:15.389312  1956 raft_consensus.cc:697] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:15.390771  1956 consensus_queue.cc:237] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:15.404547  1782 tablet_bootstrap.cc:492] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:15.405167  1782 ts_tablet_manager.cc:1403] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.186s	user 0.023s	sys 0.005s
I20260709 13:00:15.407883  1970 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.408054  1966 consensus_queue.cc:1048] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:15.410614  1783 tablet_bootstrap.cc:492] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:15.411058  1783 ts_tablet_manager.cc:1403] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.477s	user 0.004s	sys 0.021s
I20260709 13:00:15.408644  1970 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:15.414765  1965 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:15.416678  1970 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:15.417297  1782 raft_consensus.cc:359] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:15.419639  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:15.421222  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:15.422571  1705 leader_election.cc:343] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:15.423705  1707 leader_election.cc:343] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:15.424360  1707 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:15.418606  1782 raft_consensus.cc:385] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.426568  1970 raft_consensus.cc:2749] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:15.426563  1782 raft_consensus.cc:740] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.431499  1782 consensus_queue.cc:260] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:15.441321  1558 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:15.448721  1782 ts_tablet_manager.cc:1434] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.012s
I20260709 13:00:15.442926  1958 consensus_queue.cc:1048] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:00:15.453804  1958 raft_consensus.cc:2749] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:15.458668  1782 tablet_bootstrap.cc:492] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:15.473718  1783 raft_consensus.cc:359] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:15.474462  1783 raft_consensus.cc:385] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.474781  1783 raft_consensus.cc:740] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.475346  1783 consensus_queue.cc:260] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:15.495450  1783 ts_tablet_manager.cc:1434] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.084s	user 0.006s	sys 0.002s
I20260709 13:00:15.499599  1781 tablet_bootstrap.cc:492] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:15.500233  1781 ts_tablet_manager.cc:1403] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.177s	user 0.023s	sys 0.025s
I20260709 13:00:15.505026  1783 tablet_bootstrap.cc:492] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:15.515565  1954 consensus_queue.cc:1048] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:00:15.533071  1781 raft_consensus.cc:359] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:15.533812  1781 raft_consensus.cc:385] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.534060  1781 raft_consensus.cc:740] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.534579  1781 consensus_queue.cc:260] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:15.539800  1781 ts_tablet_manager.cc:1434] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
W20260709 13:00:15.541230  1538 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:00:15.516424  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 66705.1us
W20260709 13:00:15.565747  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 124529us
I20260709 13:00:15.571594  1781 tablet_bootstrap.cc:492] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:15.582758  1782 tablet_bootstrap.cc:654] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.598766  1783 tablet_bootstrap.cc:654] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.606587  1831 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.607132  1831 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:15.610704  2034 log.cc:927] Time spent T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.138s	user 0.006s	sys 0.005s
I20260709 13:00:15.618417  1831 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:15.625393  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:15.633857  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:15.641214  1707 leader_election.cc:343] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:15.655975  1705 leader_election.cc:343] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:15.669697  1781 tablet_bootstrap.cc:654] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.658370  1705 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:15.673630  1970 raft_consensus.cc:2749] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:15.676785  1490 catalog_manager.cc:5697] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:15.679204  1490 catalog_manager.cc:5697] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:15.692399  1956 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.693401  1956 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:15.698076  1956 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:15.701836  1782 tablet_bootstrap.cc:492] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:15.702493  1782 ts_tablet_manager.cc:1403] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.244s	user 0.018s	sys 0.009s
I20260709 13:00:15.703279  1783 tablet_bootstrap.cc:492] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:15.704237  1783 ts_tablet_manager.cc:1403] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.199s	user 0.008s	sys 0.012s
I20260709 13:00:15.715878  1782 raft_consensus.cc:359] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:15.725661  1781 tablet_bootstrap.cc:492] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:15.729574  1783 raft_consensus.cc:359] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:15.732159  1783 raft_consensus.cc:385] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.732635  1783 raft_consensus.cc:740] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.733529  1783 consensus_queue.cc:260] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:15.741472  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:15.727129  1781 ts_tablet_manager.cc:1403] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.159s	user 0.009s	sys 0.020s
I20260709 13:00:15.745680  1666 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 0.
I20260709 13:00:15.747462  1783 ts_tablet_manager.cc:1434] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.011s
I20260709 13:00:15.749590  1783 tablet_bootstrap.cc:492] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:15.751725  1781 raft_consensus.cc:359] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:15.752535  1781 raft_consensus.cc:385] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.753022  1781 raft_consensus.cc:740] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.754284  1781 consensus_queue.cc:260] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:15.720252  1782 raft_consensus.cc:385] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.757869  1782 raft_consensus.cc:740] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.759126  1781 ts_tablet_manager.cc:1434] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.004s
I20260709 13:00:15.760380  1782 consensus_queue.cc:260] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:15.763814  1781 tablet_bootstrap.cc:492] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:15.765674  1782 ts_tablet_manager.cc:1434] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.062s	user 0.011s	sys 0.001s
I20260709 13:00:15.767470  1782 tablet_bootstrap.cc:492] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:15.768505  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:15.769322  1741 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 0.
I20260709 13:00:15.774839  1556 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:15.776603  1927 raft_consensus.cc:2804] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:15.777520  1927 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.778016  1927 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.779150  1783 tablet_bootstrap.cc:654] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.794507  1666 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.806452  1782 tablet_bootstrap.cc:654] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.823004  1927 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:15.826061  1781 tablet_bootstrap.cc:654] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.833240  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:15.834340  1667 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.834878  1927 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:15.846982  2042 consensus_queue.cc:1048] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:00:15.861963  1782 tablet_bootstrap.cc:492] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:15.862588  1782 ts_tablet_manager.cc:1403] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.095s	user 0.029s	sys 0.019s
I20260709 13:00:15.865264  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:15.865618  1667 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:15.866178  1741 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.869951  1782 raft_consensus.cc:359] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:15.870816  1782 raft_consensus.cc:385] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.871146  1782 raft_consensus.cc:740] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.871214  1556 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:15.872110  1782 consensus_queue.cc:260] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:15.873693  2027 raft_consensus.cc:2804] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:15.879799  2027 raft_consensus.cc:697] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:15.881211  1782 ts_tablet_manager.cc:1434] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.000s
I20260709 13:00:15.881119  2027 consensus_queue.cc:237] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:15.882521  1782 tablet_bootstrap.cc:492] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:15.896152  1782 tablet_bootstrap.cc:654] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.901646  1781 tablet_bootstrap.cc:492] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:15.902216  1781 ts_tablet_manager.cc:1403] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.139s	user 0.024s	sys 0.022s
I20260709 13:00:15.916270  1781 raft_consensus.cc:359] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:15.909873  2039 consensus_queue.cc:1048] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:00:15.920274  1783 tablet_bootstrap.cc:492] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:15.926728  1783 ts_tablet_manager.cc:1403] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.177s	user 0.024s	sys 0.018s
I20260709 13:00:15.937888  1783 raft_consensus.cc:359] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:15.938910  1783 raft_consensus.cc:385] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.920681  1781 raft_consensus.cc:385] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.939476  1781 raft_consensus.cc:740] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.922267  1741 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:15.941159  1783 raft_consensus.cc:740] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.940325  1781 consensus_queue.cc:260] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:15.946538  1781 ts_tablet_manager.cc:1434] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.003s
I20260709 13:00:15.950851  1781 tablet_bootstrap.cc:492] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:15.947190  1783 consensus_queue.cc:260] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:15.957764  1783 ts_tablet_manager.cc:1434] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.005s
I20260709 13:00:15.963250  1955 consensus_queue.cc:1048] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:15.965160  1783 tablet_bootstrap.cc:492] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:15.988054  2027 consensus_queue.cc:1048] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:16.004794  1782 tablet_bootstrap.cc:492] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:16.007910  1781 tablet_bootstrap.cc:654] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:16.008901  1782 ts_tablet_manager.cc:1403] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.127s	user 0.014s	sys 0.012s
I20260709 13:00:16.017232  1783 tablet_bootstrap.cc:654] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:16.025593  1490 catalog_manager.cc:5697] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:16.029757  1782 raft_consensus.cc:359] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.032934  1782 raft_consensus.cc:385] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:16.034277  1782 raft_consensus.cc:740] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:16.035039  1782 consensus_queue.cc:260] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.037252  1782 ts_tablet_manager.cc:1434] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 13:00:16.038307  1782 tablet_bootstrap.cc:492] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:16.039533  1954 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.040174  1954 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.045121  1954 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:16.047987  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:16.048828  1589 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 0.
I20260709 13:00:16.050323  1782 tablet_bootstrap.cc:654] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:16.051278  1707 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:16.053416  1970 raft_consensus.cc:2804] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:16.053894  1970 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.054322  1970 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:16.055244  1964 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.055783  1964 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.057313  1955 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.058116  1955 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.058619  1964 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:16.059631  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:16.061180  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:16.062764  1705 leader_election.cc:343] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:16.064088  2039 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:16.066656  1633 leader_election.cc:343] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:16.068444  1955 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:16.065805  2039 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.071419  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:16.073606  1556 leader_election.cc:343] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:16.075012  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:16.078687  1831 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.079279  1831 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:16.080415  1558 leader_election.cc:343] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:16.080585  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:16.081216  1558 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:16.081254  1741 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 0.
I20260709 13:00:16.085932  1970 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.089389  1831 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:16.089401  2039 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:16.103739  1970 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:16.108258  1782 tablet_bootstrap.cc:492] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:16.108851  1782 ts_tablet_manager.cc:1403] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.071s	user 0.018s	sys 0.012s
I20260709 13:00:16.112145  1781 tablet_bootstrap.cc:492] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:16.092670  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:16.113035  1781 ts_tablet_manager.cc:1403] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.163s	user 0.019s	sys 0.007s
I20260709 13:00:16.113272  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:16.113579  1782 raft_consensus.cc:359] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.114652  1782 raft_consensus.cc:385] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:16.114930  1782 raft_consensus.cc:740] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:16.083554  2027 raft_consensus.cc:2749] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:16.115145  1633 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:16.115549  1782 consensus_queue.cc:260] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.116058  1867 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:16.116480  1867 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.116926  1867 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:16.118260  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:16.119977  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:16.120666  1591 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:16.121642  1707 leader_election.cc:343] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:16.126048  1782 ts_tablet_manager.cc:1434] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 13:00:16.128023  1783 tablet_bootstrap.cc:492] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:16.128516  1783 ts_tablet_manager.cc:1403] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.164s	user 0.028s	sys 0.014s
I20260709 13:00:16.107915  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:16.129602  1705 leader_election.cc:343] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:16.130751  1705 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:00:16.131959  1556 leader_election.cc:343] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:16.137343  1970 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:16.132532  1781 raft_consensus.cc:359] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.138453  1781 raft_consensus.cc:385] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:16.138819  1781 raft_consensus.cc:740] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:16.139058  1591 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:16.141938  1781 consensus_queue.cc:260] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:16.139979  1705 leader_election.cc:343] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:16.138484  1783 raft_consensus.cc:359] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.143253  1707 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:16.143209  1783 raft_consensus.cc:385] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:16.143898  1783 raft_consensus.cc:740] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:16.144176  1831 raft_consensus.cc:2804] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:16.140683  1867 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.144826  1831 raft_consensus.cc:697] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:16.140641  1782 tablet_bootstrap.cc:492] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:16.146464  1831 consensus_queue.cc:237] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.149536  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:00:16.151129  1633 leader_election.cc:343] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:16.145118  1783 consensus_queue.cc:260] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.155808  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:16.156613  1741 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 0.
I20260709 13:00:16.159296  2027 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.160694  1781 ts_tablet_manager.cc:1434] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.002s
I20260709 13:00:16.160142  2027 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.214107  1867 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:16.215535  1783 ts_tablet_manager.cc:1434] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.087s	user 0.017s	sys 0.013s
I20260709 13:00:16.216755  1783 tablet_bootstrap.cc:492] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:16.221892  2027 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:16.223767  1782 tablet_bootstrap.cc:654] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:16.229413  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:16.231104  1558 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:16.231410  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:16.167153  1781 tablet_bootstrap.cc:492] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:16.235126  1783 tablet_bootstrap.cc:654] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:16.237668  1490 catalog_manager.cc:5697] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:16.238442  1867 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.239130  1867 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.239732  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:16.240371  1741 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:16.244819  1867 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:16.248008  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:16.239140  1782 tablet_bootstrap.cc:492] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:16.249723  1782 ts_tablet_manager.cc:1403] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.109s	user 0.022s	sys 0.005s
I20260709 13:00:16.250950  1741 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 1.
I20260709 13:00:16.252841  1633 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:16.254453  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:16.254976  1955 raft_consensus.cc:2804] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:16.255473  1955 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.255954  1955 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:16.256124  1867 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:16.258551  1867 raft_consensus.cc:697] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 1 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
W20260709 13:00:16.262120  1556 leader_election.cc:343] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:16.269577  1558 leader_election.cc:343] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:16.269968  1558 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:16.260215  1867 consensus_queue.cc:237] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.284948  2027 raft_consensus.cc:2749] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:16.284993  1783 tablet_bootstrap.cc:492] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:16.286101  1783 ts_tablet_manager.cc:1403] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.070s	user 0.010s	sys 0.014s
I20260709 13:00:16.286226  1781 tablet_bootstrap.cc:654] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:16.288775  1783 raft_consensus.cc:359] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.289471  1783 raft_consensus.cc:385] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:16.289738  1783 raft_consensus.cc:740] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:16.285537  1955 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.290385  1783 consensus_queue.cc:260] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.291899  1783 ts_tablet_manager.cc:1434] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:00:16.291932  1955 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:16.294013  1782 raft_consensus.cc:359] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.294710  1782 raft_consensus.cc:385] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:16.294967  1782 raft_consensus.cc:740] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:16.295689  1782 consensus_queue.cc:260] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.296512  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:16.297261  1741 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:16.299755  1782 ts_tablet_manager.cc:1434] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.050s	user 0.004s	sys 0.004s
I20260709 13:00:16.299612  2069 consensus_queue.cc:1048] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:16.302568  1782 tablet_bootstrap.cc:492] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:16.307528  1781 tablet_bootstrap.cc:492] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:16.308178  1781 ts_tablet_manager.cc:1403] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.141s	user 0.010s	sys 0.009s
W20260709 13:00:16.312577  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 49705.9us
I20260709 13:00:16.312682  1781 raft_consensus.cc:359] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.313766  1781 raft_consensus.cc:385] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:16.314144  1781 raft_consensus.cc:740] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:16.314332  1633 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:16.315071  1867 raft_consensus.cc:2749] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:16.314965  1781 consensus_queue.cc:260] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.318310  1781 ts_tablet_manager.cc:1434] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.005s
I20260709 13:00:16.321549  1781 tablet_bootstrap.cc:492] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:16.323300  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:16.324849  1831 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.325384  1831 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.329331  1781 tablet_bootstrap.cc:654] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:16.329578  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:16.330575  1782 tablet_bootstrap.cc:654] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:16.330883  1831 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:00:16.331974  1707 leader_election.cc:343] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:16.335259  1556 leader_election.cc:343] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:16.337841  2067 consensus_queue.cc:1048] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:16.292924  1783 tablet_bootstrap.cc:492] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:16.355319  1741 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:16.356730  1558 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:16.358647  1955 raft_consensus.cc:2804] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:16.359294  1955 raft_consensus.cc:697] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:16.360359  1955 consensus_queue.cc:237] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.372231  1781 tablet_bootstrap.cc:492] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:16.372856  1781 ts_tablet_manager.cc:1403] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.052s	user 0.008s	sys 0.015s
I20260709 13:00:16.376233  1781 raft_consensus.cc:359] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.378576  1489 catalog_manager.cc:5697] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 1 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:16.377015  1781 raft_consensus.cc:385] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:16.381659  1781 raft_consensus.cc:740] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:16.382700  1781 consensus_queue.cc:260] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.385907  1781 ts_tablet_manager.cc:1434] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:00:16.387190  1781 tablet_bootstrap.cc:492] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
W20260709 13:00:16.388511  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 72885.6us
I20260709 13:00:16.389940  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:16.394902  1783 tablet_bootstrap.cc:654] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:16.401371  1781 tablet_bootstrap.cc:654] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:16.412237  1666 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:16.413200  1781 tablet_bootstrap.cc:492] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
W20260709 13:00:16.416549  1705 leader_election.cc:343] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:16.420365  1781 ts_tablet_manager.cc:1403] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.006s
I20260709 13:00:16.420171  1705 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:16.422369  1831 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:16.419210  1486 catalog_manager.cc:5697] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:16.433956  1782 tablet_bootstrap.cc:492] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:16.433561  1781 raft_consensus.cc:359] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.434839  1781 raft_consensus.cc:385] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:16.435146  1781 raft_consensus.cc:740] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:16.435536  1782 ts_tablet_manager.cc:1403] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.133s	user 0.016s	sys 0.009s
I20260709 13:00:16.435855  1781 consensus_queue.cc:260] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.438072  1781 ts_tablet_manager.cc:1434] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.004s
I20260709 13:00:16.439052  1781 tablet_bootstrap.cc:492] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:16.448202  1781 tablet_bootstrap.cc:654] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:16.448654  1783 tablet_bootstrap.cc:492] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:16.449275  1783 ts_tablet_manager.cc:1403] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.157s	user 0.013s	sys 0.020s
I20260709 13:00:16.452180  1783 raft_consensus.cc:359] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.452777  1783 raft_consensus.cc:385] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:16.453052  1783 raft_consensus.cc:740] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:16.454154  1783 consensus_queue.cc:260] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.455204  1782 raft_consensus.cc:359] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.455976  1782 raft_consensus.cc:385] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:16.456288  1782 raft_consensus.cc:740] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:16.457221  1783 ts_tablet_manager.cc:1434] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:00:16.456938  1782 consensus_queue.cc:260] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.460181  1782 ts_tablet_manager.cc:1434] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 13:00:16.461351  1782 tablet_bootstrap.cc:492] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:16.462370  1783 tablet_bootstrap.cc:492] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:16.478953  1783 tablet_bootstrap.cc:654] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:16.494694  1781 tablet_bootstrap.cc:492] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:16.495352  1782 tablet_bootstrap.cc:654] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:16.495386  1781 ts_tablet_manager.cc:1403] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.057s	user 0.018s	sys 0.014s
I20260709 13:00:16.498710  1781 raft_consensus.cc:359] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.499558  1781 raft_consensus.cc:385] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:16.499903  1781 raft_consensus.cc:740] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:16.500553  1781 consensus_queue.cc:260] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.501199  1782 tablet_bootstrap.cc:492] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:16.501559  1783 tablet_bootstrap.cc:492] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:16.501714  1782 ts_tablet_manager.cc:1403] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.000s
I20260709 13:00:16.502175  1783 ts_tablet_manager.cc:1403] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.001s
I20260709 13:00:16.502738  1781 ts_tablet_manager.cc:1434] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:00:16.504315  1781 tablet_bootstrap.cc:492] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:16.504940  1782 raft_consensus.cc:359] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.505264  1783 raft_consensus.cc:359] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.505788  1782 raft_consensus.cc:385] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:16.506017  1783 raft_consensus.cc:385] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:16.506143  1782 raft_consensus.cc:740] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:16.506531  1783 raft_consensus.cc:740] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:16.507589  1782 consensus_queue.cc:260] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.509009  1783 consensus_queue.cc:260] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.511409  1783 ts_tablet_manager.cc:1434] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:00:16.511921  1781 tablet_bootstrap.cc:654] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:16.512535  1783 tablet_bootstrap.cc:492] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:16.528136  1781 tablet_bootstrap.cc:492] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:16.528756  1781 ts_tablet_manager.cc:1403] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.008s
I20260709 13:00:16.534844  1781 raft_consensus.cc:359] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.535673  1781 raft_consensus.cc:385] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:16.535909  1782 ts_tablet_manager.cc:1434] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:00:16.536087  1781 raft_consensus.cc:740] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:16.537129  1782 tablet_bootstrap.cc:492] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:16.543069  1781 consensus_queue.cc:260] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.546159  1781 ts_tablet_manager.cc:1434] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.004s
W20260709 13:00:16.547335  1705 consensus_peers.cc:597] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:16.550866  1782 tablet_bootstrap.cc:654] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:16.539928  1783 tablet_bootstrap.cc:654] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:16.555320  1781 tablet_bootstrap.cc:492] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:16.561025  1970 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.561857  1970 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.567073  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:16.573851  1591 raft_consensus.cc:2468] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 0.
I20260709 13:00:16.575860  1707 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:16.576974  1831 raft_consensus.cc:2804] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:16.577350  1831 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.577746  1831 raft_consensus.cc:3060] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:16.582837  1783 tablet_bootstrap.cc:492] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:16.589622  1783 ts_tablet_manager.cc:1403] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.077s	user 0.008s	sys 0.027s
I20260709 13:00:16.651485  1955 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.661548  1831 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.651618  1970 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:16.670418  1831 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:16.671620  1831 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.672493  1831 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.677440  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:16.677752  2072 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.665068  1955 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.678470  2072 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.674507  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:16.672039  2087 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.685129  2087 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.687161  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:16.692598  2069 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:16.694020  1556 leader_election.cc:343] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:16.693251  2069 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.698906  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:16.680914  1955 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:16.701385  1633 leader_election.cc:343] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:16.704274  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:16.703239  1831 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:16.711539  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:16.711716  1740 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 0.
I20260709 13:00:16.712275  1661 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 0.
I20260709 13:00:16.704582  1782 tablet_bootstrap.cc:492] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:16.709210  1783 raft_consensus.cc:359] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.710398  2087 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:16.714001  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:16.710772  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:16.709633  2072 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:16.714488  1783 raft_consensus.cc:385] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:16.714969  1736 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 0.
W20260709 13:00:16.703729  1705 leader_election.cc:343] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:16.715533  1782 ts_tablet_manager.cc:1403] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.179s	user 0.042s	sys 0.030s
W20260709 13:00:16.716310  1705 leader_election.cc:343] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:16.716483  1591 raft_consensus.cc:3060] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:16.704401  2069 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:16.718560  1782 raft_consensus.cc:359] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.719313  1782 raft_consensus.cc:385] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:16.719334  1556 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:16.719789  1782 raft_consensus.cc:740] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:16.720255  2069 raft_consensus.cc:2804] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:16.715425  1783 raft_consensus.cc:740] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:16.720925  2069 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.721797  1783 consensus_queue.cc:260] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.708495  1781 tablet_bootstrap.cc:654] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:16.722890  2069 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:16.724035  1591 raft_consensus.cc:2468] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:16.724242  2072 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.724685  2072 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.725373  1558 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:16.726962  2072 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:16.727182  1955 raft_consensus.cc:2804] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:16.741714  1867 consensus_queue.cc:1048] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:16.742476  1781 tablet_bootstrap.cc:492] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:16.742322  1955 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.743046  1781 ts_tablet_manager.cc:1403] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.188s	user 0.014s	sys 0.003s
I20260709 13:00:16.720479  1782 consensus_queue.cc:260] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.728060  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:16.743979  1741 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 0.
I20260709 13:00:16.747512  1781 raft_consensus.cc:359] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.750248  2068 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.750558  1781 raft_consensus.cc:385] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:16.730751  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:16.731379  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:16.735612  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:16.735819  1538 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:16.735769  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:16.739753  1707 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:16.751371  1781 raft_consensus.cc:740] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:16.753924  1667 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 0.
I20260709 13:00:16.754818  1781 consensus_queue.cc:260] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.755995  2089 raft_consensus.cc:2804] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:16.756131  1954 consensus_queue.cc:1048] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:00:16.756610  1633 leader_election.cc:343] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:16.740868  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:16.749979  1782 ts_tablet_manager.cc:1434] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:00:16.728894  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:16.727463  1783 ts_tablet_manager.cc:1434] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.138s	user 0.007s	sys 0.003s
I20260709 13:00:16.757663  1740 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 0.
I20260709 13:00:16.758092  1781 ts_tablet_manager.cc:1434] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:00:16.759938  1782 tablet_bootstrap.cc:492] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:16.742935  1955 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:16.756547  2089 raft_consensus.cc:697] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:16.771128  2089 consensus_queue.cc:237] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.773227  1781 tablet_bootstrap.cc:492] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:16.750922  2068 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:16.753595  1705 leader_election.cc:343] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:16.776988  1633 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:16.777742  1782 tablet_bootstrap.cc:654] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:16.779211  1831 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.777770  1783 tablet_bootstrap.cc:492] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:16.779688  1831 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.781514  1633 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:16.782260  1867 raft_consensus.cc:2804] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:16.782928  1867 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.783151  1964 raft_consensus.cc:2804] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:16.783327  2068 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:16.783557  1867 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:16.783876  1964 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:16.785771  1707 leader_election.cc:343] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:16.784622  1964 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:16.788666  1831 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:16.800276  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:16.801411  1741 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 0.
I20260709 13:00:16.803172  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:16.803858  1558 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:00:16.805311  1556 leader_election.cc:343] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:16.786289  1705 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:16.806725  2027 raft_consensus.cc:2804] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:16.814805  1831 raft_consensus.cc:2749] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:00:16.826838  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 67644.2us
I20260709 13:00:16.835835  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:16.840603  1707 leader_election.cc:343] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:16.842711  1783 tablet_bootstrap.cc:654] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:16.816789  2027 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:16.816151  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 62647us
I20260709 13:00:16.854049  2027 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:16.899091  1831 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.899636  1831 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:16.899940  1867 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:16.896458  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 47453.8us
I20260709 13:00:16.895200  1705 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:16.918331  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:16.919064  1591 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 0.
I20260709 13:00:16.916569  1831 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:16.925150  1867 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:16.929589  1831 raft_consensus.cc:2804] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:16.930135  1831 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.930549  1831 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:17.001008  1707 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:17.003180  1831 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:17.003795  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 72069.7us
I20260709 13:00:17.009701  1781 tablet_bootstrap.cc:654] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:17.012238  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:17.012959  1741 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:17.015362  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:17.000415  2068 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.022348  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:17.007442  2090 raft_consensus.cc:2804] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:17.023552  2068 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:17.034341  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:17.035167  1661 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 0.
I20260709 13:00:17.039402  2069 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:17.041286  1589 raft_consensus.cc:2393] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 1: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:17.026764  2090 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.042867  2090 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:17.043164  1955 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:17.040225  2027 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:17.046595  1741 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 1.
I20260709 13:00:17.052786  1782 tablet_bootstrap.cc:492] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:17.053483  1782 ts_tablet_manager.cc:1403] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.294s	user 0.026s	sys 0.018s
I20260709 13:00:17.045944  2068 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:17.061896  1705 leader_election.cc:343] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:17.051551  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:17.093860  1831 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:17.091988  1782 raft_consensus.cc:359] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:17.095227  1782 raft_consensus.cc:385] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:17.095634  1782 raft_consensus.cc:740] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:17.096498  1782 consensus_queue.cc:260] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:17.070326  1705 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:17.073529  1964 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:17.106796  1783 tablet_bootstrap.cc:492] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:17.108695  1783 ts_tablet_manager.cc:1403] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.331s	user 0.035s	sys 0.035s
I20260709 13:00:17.108752  1782 ts_tablet_manager.cc:1434] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.002s
I20260709 13:00:17.109833  1782 tablet_bootstrap.cc:492] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:17.114257  2088 raft_consensus.cc:2749] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:17.129141  1783 raft_consensus.cc:359] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:17.132504  1783 raft_consensus.cc:385] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:17.132923  1783 raft_consensus.cc:740] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:17.134595  1783 consensus_queue.cc:260] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:17.139451  1783 ts_tablet_manager.cc:1434] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
W20260709 13:00:17.126084  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 64220us
I20260709 13:00:17.169798  1591 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:17.147346  2069 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:17.154004  1955 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:17.181434  1831 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.181993  1831 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:17.184038  1831 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:17.185591  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:17.186192  1667 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:17.188505  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:17.177706  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:17.177315  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:17.193050  1782 tablet_bootstrap.cc:654] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:17.198139  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:17.200511  1667 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
W20260709 13:00:17.201368  1707 leader_election.cc:343] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:17.202931  1705 leader_election.cc:343] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:17.205484  1705 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:17.206588  1705 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:17.209301  1954 raft_consensus.cc:2749] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:17.210003  1954 raft_consensus.cc:2804] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:17.210459  1954 raft_consensus.cc:697] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:17.211313  1954 consensus_queue.cc:237] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:17.213361  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:17.214275  1735 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:17.209326  1964 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:17.218940  1633 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:17.229434  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:17.229441  1783 tablet_bootstrap.cc:492] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
W20260709 13:00:17.232203  1633 leader_election.cc:343] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:17.232372  2112 consensus_queue.cc:1048] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:00:17.226863  2104 raft_consensus.cc:2804] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:00:17.234380  1633 leader_election.cc:343] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:17.225343  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:17.234009  1964 consensus_queue.cc:1048] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:00:17.234266  1736 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:17.236011  2104 raft_consensus.cc:697] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 1 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:17.251067  1782 tablet_bootstrap.cc:492] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:17.228271  2090 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:17.251607  1782 ts_tablet_manager.cc:1403] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.142s	user 0.010s	sys 0.002s
I20260709 13:00:17.244395  2104 consensus_queue.cc:237] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:17.281147  1783 tablet_bootstrap.cc:654] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:17.283205  1556 consensus_peers.cc:597] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:17.288048  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:17.288537  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:17.288887  1667 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:17.289186  1585 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:17.299798  1585 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:17.301026  1707 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:17.301355  1667 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:17.303246  2089 raft_consensus.cc:2804] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:17.303752  2089 raft_consensus.cc:697] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:17.304575  2089 consensus_queue.cc:237] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:17.304783  1782 raft_consensus.cc:359] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:17.305449  1782 raft_consensus.cc:385] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:17.305716  1782 raft_consensus.cc:740] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:17.306351  1782 consensus_queue.cc:260] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:17.284343  2090 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:17.328125  1782 ts_tablet_manager.cc:1434] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.000s
I20260709 13:00:17.331251  1782 tablet_bootstrap.cc:492] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:17.332353  1783 tablet_bootstrap.cc:492] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:17.332975  1783 ts_tablet_manager.cc:1403] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.104s	user 0.017s	sys 0.006s
I20260709 13:00:17.336061  2116 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.336735  1486 catalog_manager.cc:5697] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:17.337040  2116 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:17.350708  1781 tablet_bootstrap.cc:492] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:17.351253  1781 ts_tablet_manager.cc:1403] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.592s	user 0.032s	sys 0.018s
I20260709 13:00:17.361024  1783 raft_consensus.cc:359] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:17.361742  1783 raft_consensus.cc:385] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:17.361984  1783 raft_consensus.cc:740] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:17.362934  1783 consensus_queue.cc:260] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:17.371762  1783 ts_tablet_manager.cc:1434] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:00:17.380934  2027 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:17.380826  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:17.385285  1783 tablet_bootstrap.cc:492] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:17.400377  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:17.400795  1781 raft_consensus.cc:359] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:17.401525  1781 raft_consensus.cc:385] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:17.401846  1781 raft_consensus.cc:740] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:17.410122  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:17.410600  2116 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:17.415663  1831 consensus_queue.cc:1048] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:17.426326  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:17.427260  1734 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:17.429257  1782 tablet_bootstrap.cc:654] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:17.417349  1737 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 0.
I20260709 13:00:17.437490  2116 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.438486  2116 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:17.440325  1662 raft_consensus.cc:3060] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:17.443487  1735 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:17.449355  1736 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 1.
I20260709 13:00:17.459986  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:17.470242  2125 log.cc:927] Time spent T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.140s	user 0.008s	sys 0.000s
I20260709 13:00:17.470670  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:17.477818  1666 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:17.480438  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:17.482175  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:17.482764  1667 raft_consensus.cc:2393] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 1: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:17.485519  1660 raft_consensus.cc:2393] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 1: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:17.488409  1558 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:17.488919  1633 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:17.489917  1558 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:17.469661  2116 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:17.491936  1781 consensus_queue.cc:260] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:17.474200  1734 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:17.495548  1558 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:17.495710  2027 raft_consensus.cc:2804] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:17.496824  2106 raft_consensus.cc:2804] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:17.497352  1955 raft_consensus.cc:2804] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:17.497678  2106 raft_consensus.cc:697] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 1 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:17.498193  1955 raft_consensus.cc:697] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:17.499480  1955 consensus_queue.cc:237] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:17.503625  2110 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:17.504705  2110 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.510439  1781 ts_tablet_manager.cc:1434] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.159s	user 0.013s	sys 0.000s
I20260709 13:00:17.512539  2110 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:17.516577  1556 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:17.518592  1781 tablet_bootstrap.cc:492] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:17.509341  2027 raft_consensus.cc:697] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:17.518734  2099 raft_consensus.cc:2749] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:17.527002  1783 tablet_bootstrap.cc:654] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:17.527238  1556 leader_election.cc:343] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:17.539269  2128 log.cc:927] Time spent T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.073s	user 0.000s	sys 0.003s
I20260709 13:00:17.521551  2027 consensus_queue.cc:237] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:17.498909  2106 consensus_queue.cc:237] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:17.556697  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:17.558082  1736 raft_consensus.cc:2393] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 1: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:17.558532  1666 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:17.565202  2118 consensus_queue.cc:1048] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:00:17.569440  1488 catalog_manager.cc:5697] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 1 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:17.577922  1782 tablet_bootstrap.cc:492] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:17.578936  1782 ts_tablet_manager.cc:1403] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.248s	user 0.025s	sys 0.029s
I20260709 13:00:17.600046  1782 raft_consensus.cc:359] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:17.600860  1782 raft_consensus.cc:385] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:17.601199  1782 raft_consensus.cc:740] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
W20260709 13:00:17.607338  1556 leader_election.cc:343] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:17.608204  1782 consensus_queue.cc:260] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:17.600282  2110 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:17.620551  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:17.621634  2110 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:17.622689  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:17.628700  1736 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:17.639777  1556 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:17.640143  1782 ts_tablet_manager.cc:1434] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.001s
I20260709 13:00:17.640735  1556 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:17.643494  2099 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:17.642822  1955 raft_consensus.cc:2749] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:00:17.650548  1781 tablet_bootstrap.cc:654] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:17.652709  1782 tablet_bootstrap.cc:492] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
W20260709 13:00:17.656239  1556 leader_election.cc:343] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:17.678757  1783 tablet_bootstrap.cc:492] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:17.679347  1783 ts_tablet_manager.cc:1403] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.296s	user 0.006s	sys 0.021s
I20260709 13:00:17.685230  1783 raft_consensus.cc:359] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:17.686280  1783 raft_consensus.cc:385] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:17.686717  1783 raft_consensus.cc:740] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:17.687651  1783 consensus_queue.cc:260] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:17.697175  1781 tablet_bootstrap.cc:492] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:17.697758  1781 ts_tablet_manager.cc:1403] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.180s	user 0.011s	sys 0.016s
I20260709 13:00:17.702158  1783 ts_tablet_manager.cc:1434] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.022s	user 0.011s	sys 0.000s
I20260709 13:00:17.706516  1736 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:17.708585  1558 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:17.709693  1781 raft_consensus.cc:359] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:17.710394  2097 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:17.710726  1781 raft_consensus.cc:385] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:17.711153  1781 raft_consensus.cc:740] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:17.711160  2097 raft_consensus.cc:697] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:17.712131  1781 consensus_queue.cc:260] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:17.715080  1783 tablet_bootstrap.cc:492] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:17.712823  2097 consensus_queue.cc:237] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:17.719614  1781 ts_tablet_manager.cc:1434] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.000s
I20260709 13:00:17.730149  1781 tablet_bootstrap.cc:492] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:17.727347  2117 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.743813  1831 consensus_queue.cc:1048] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:17.737752  2117 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:17.755977  2099 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:17.787786  2117 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:17.788424  1587 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:17.788791  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:17.799816  1736 raft_consensus.cc:2393] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 1: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:17.804564  1782 tablet_bootstrap.cc:654] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:17.803968  2089 consensus_queue.cc:1048] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:00:17.812201  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:17.827169  1486 catalog_manager.cc:5697] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:17.828986  1556 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:00:17.833607  1538 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:17.833982  1486 catalog_manager.cc:5697] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:17.847276  1781 tablet_bootstrap.cc:654] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:17.854305  2105 raft_consensus.cc:2749] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:17.855281  2091 consensus_queue.cc:1048] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:00:17.866376  2091 consensus_queue.cc:1048] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:17.873624  1783 tablet_bootstrap.cc:654] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:17.878437  1488 catalog_manager.cc:5697] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 1 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:17.884685  1954 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.887401  1954 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:17.893124  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:17.895047  1707 leader_election.cc:343] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:17.903038  1489 catalog_manager.cc:5697] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:17.905922  1489 catalog_manager.cc:5697] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:17.908138  1489 catalog_manager.cc:5697] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:17.927259  1954 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:17.927934  2104 consensus_queue.cc:1048] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:00:18.013329  2096 consensus_queue.cc:1048] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:18.025681  1782 tablet_bootstrap.cc:492] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:18.025354  2117 consensus_queue.cc:1048] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:18.026145  1782 ts_tablet_manager.cc:1403] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.374s	user 0.021s	sys 0.002s
I20260709 13:00:18.029682  1782 raft_consensus.cc:359] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.031432  1782 raft_consensus.cc:385] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.032133  1782 raft_consensus.cc:740] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.033838  1782 consensus_queue.cc:260] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.036877  1782 ts_tablet_manager.cc:1434] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:00:18.040071  1782 tablet_bootstrap.cc:492] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:18.041987  1781 tablet_bootstrap.cc:492] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:18.042465  1781 ts_tablet_manager.cc:1403] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.313s	user 0.013s	sys 0.013s
I20260709 13:00:18.046047  1781 raft_consensus.cc:359] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.046844  1781 raft_consensus.cc:385] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.047148  1781 raft_consensus.cc:740] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
W20260709 13:00:18.049130  2146 log.cc:927] Time spent T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.123s	user 0.008s	sys 0.003s
I20260709 13:00:18.053194  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:18.061571  1781 consensus_queue.cc:260] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.064900  2117 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.065557  2117 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.067888  2117 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:18.064939  1781 ts_tablet_manager.cc:1434] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.001s
I20260709 13:00:18.080003  1781 tablet_bootstrap.cc:492] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:18.080689  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:18.095759  1964 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.096432  1964 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.098879  1964 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:18.101655  1556 leader_election.cc:343] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:18.107443  1705 leader_election.cc:343] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:18.109309  1705 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:18.109441  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:18.111682  1783 tablet_bootstrap.cc:492] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:18.112524  1783 ts_tablet_manager.cc:1403] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.398s	user 0.019s	sys 0.028s
I20260709 13:00:18.115406  2091 raft_consensus.cc:2749] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:18.116016  1783 raft_consensus.cc:359] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.116803  1783 raft_consensus.cc:385] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.116922  1782 tablet_bootstrap.cc:654] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.118911  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:18.118904  1781 tablet_bootstrap.cc:654] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.119575  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:18.119729  1964 consensus_queue.cc:1048] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:18.136381  1740 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 0.
I20260709 13:00:18.125826  2099 consensus_queue.cc:1048] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:18.149108  1662 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.150944  1633 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:18.158257  1783 raft_consensus.cc:740] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.159014  1783 consensus_queue.cc:260] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.162758  1964 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:18.163002  1558 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:18.169986  1783 ts_tablet_manager.cc:1434] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
I20260709 13:00:18.170871  1783 tablet_bootstrap.cc:492] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:18.171797  2104 consensus_queue.cc:1048] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:18.173482  2110 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:18.174029  2110 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.174465  2110 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.179883  2069 consensus_queue.cc:1048] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:18.184705  2091 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.185402  2091 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.187737  2091 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:18.194816  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:18.196072  2116 consensus_queue.cc:1048] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:00:18.212853  1705 leader_election.cc:343] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:18.217283  1783 tablet_bootstrap.cc:654] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.208254  2110 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.224079  1782 tablet_bootstrap.cc:492] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:18.227312  1781 tablet_bootstrap.cc:492] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:18.227985  1781 ts_tablet_manager.cc:1403] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.148s	user 0.013s	sys 0.013s
I20260709 13:00:18.237036  1782 ts_tablet_manager.cc:1403] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.199s	user 0.016s	sys 0.007s
I20260709 13:00:18.241472  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:18.249703  1707 leader_election.cc:343] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:18.250288  1707 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:18.259629  1781 raft_consensus.cc:359] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.261322  1781 raft_consensus.cc:385] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.261775  1781 raft_consensus.cc:740] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.263049  1781 consensus_queue.cc:260] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.261737  1782 raft_consensus.cc:359] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.274945  1782 raft_consensus.cc:385] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.275285  1782 raft_consensus.cc:740] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
W20260709 13:00:18.277009  2155 log.cc:927] Time spent T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:00:18.288863  2118 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.289362  2118 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.254892  1954 raft_consensus.cc:2749] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:18.293238  1781 ts_tablet_manager.cc:1434] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.065s	user 0.009s	sys 0.000s
I20260709 13:00:18.298789  1781 tablet_bootstrap.cc:492] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:18.300518  1782 consensus_queue.cc:260] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.306555  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:18.308040  1705 leader_election.cc:343] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:18.308269  1666 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.300248  2118 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:18.318017  1783 tablet_bootstrap.cc:492] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:18.322096  2110 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:18.317118  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:18.333267  1783 ts_tablet_manager.cc:1403] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.163s	user 0.037s	sys 0.037s
I20260709 13:00:18.352449  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:00:18.353585  1707 leader_election.cc:343] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:18.354102  1707 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:18.353626  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:18.354851  1736 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.356176  2089 raft_consensus.cc:2749] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:18.357363  1782 ts_tablet_manager.cc:1434] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.120s	user 0.012s	sys 0.000s
I20260709 13:00:18.364444  1782 tablet_bootstrap.cc:492] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
W20260709 13:00:18.366101  1556 leader_election.cc:343] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:18.366806  1556 consensus_peers.cc:597] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:18.362151  1783 raft_consensus.cc:359] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.369362  1783 raft_consensus.cc:385] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.369738  1783 raft_consensus.cc:740] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.370604  1783 consensus_queue.cc:260] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.372735  1783 ts_tablet_manager.cc:1434] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.000s
I20260709 13:00:18.378536  1781 tablet_bootstrap.cc:654] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.378683  1783 tablet_bootstrap.cc:492] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:18.389775  2069 consensus_queue.cc:1048] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:18.394086  2099 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.398198  2099 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.391023  1736 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:18.402319  2099 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:18.403769  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:18.409224  1558 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
W20260709 13:00:18.411306  1556 leader_election.cc:343] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:18.416285  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:18.423617  2116 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:18.425014  2116 raft_consensus.cc:697] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:18.425536  2104 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.430751  2104 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.426283  2116 consensus_queue.cc:237] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.424283  1736 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 0.
I20260709 13:00:18.442925  1666 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.443225  2104 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:18.444464  1781 tablet_bootstrap.cc:492] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:18.444407  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:18.445058  1781 ts_tablet_manager.cc:1403] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.149s	user 0.017s	sys 0.011s
I20260709 13:00:18.445806  1783 tablet_bootstrap.cc:654] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.450058  1781 raft_consensus.cc:359] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.434849  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:18.453277  1781 raft_consensus.cc:385] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.458489  1781 raft_consensus.cc:740] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.464380  1558 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:18.464779  1782 tablet_bootstrap.cc:654] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.466054  2069 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:18.466559  2069 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.467453  2069 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.468312  1781 consensus_queue.cc:260] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.477757  1781 ts_tablet_manager.cc:1434] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.032s	user 0.004s	sys 0.005s
I20260709 13:00:18.477936  1633 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:18.478775  1781 tablet_bootstrap.cc:492] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:18.488409  2069 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.489657  2089 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.490365  2089 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.492702  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:00:18.494441  1556 leader_election.cc:343] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:18.494933  2069 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:18.496024  2089 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:18.497313  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:18.499774  1705 leader_election.cc:343] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:18.503723  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:18.504204  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:18.504633  1736 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:18.514909  1707 leader_election.cc:343] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:18.515450  1707 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:18.516196  2089 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:18.533527  2104 raft_consensus.cc:2749] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:18.539152  1736 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:18.541066  1558 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:18.547428  2069 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:18.548134  2069 raft_consensus.cc:697] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:18.572013  1783 tablet_bootstrap.cc:492] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:18.572608  1783 ts_tablet_manager.cc:1403] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.194s	user 0.026s	sys 0.010s
I20260709 13:00:18.575611  2069 consensus_queue.cc:237] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.576632  1486 catalog_manager.cc:5697] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:18.582785  1781 tablet_bootstrap.cc:654] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.584220  2089 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.584901  2089 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.587590  2089 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:18.589566  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:18.592111  1707 leader_election.cc:343] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:18.597821  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:18.599622  1705 leader_election.cc:343] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:18.600149  1705 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:18.601941  2118 raft_consensus.cc:2749] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:18.600168  1783 raft_consensus.cc:359] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.609258  1783 raft_consensus.cc:385] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.609679  1783 raft_consensus.cc:740] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.618060  1783 consensus_queue.cc:260] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.629500  1782 tablet_bootstrap.cc:492] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:18.630286  1782 ts_tablet_manager.cc:1403] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.266s	user 0.020s	sys 0.014s
I20260709 13:00:18.634430  1783 ts_tablet_manager.cc:1434] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.062s	user 0.004s	sys 0.005s
I20260709 13:00:18.639533  1782 raft_consensus.cc:359] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.640308  1782 raft_consensus.cc:385] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.640619  1782 raft_consensus.cc:740] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.641993  1783 tablet_bootstrap.cc:492] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:18.641799  1782 consensus_queue.cc:260] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.643083  2161 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.643499  2161 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.649327  2161 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:18.654820  1782 ts_tablet_manager.cc:1434] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:00:18.653195  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:18.658217  1738 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 0.
I20260709 13:00:18.663296  1783 tablet_bootstrap.cc:654] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.668480  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:18.670061  1558 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:00:18.670652  1556 leader_election.cc:343] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:18.671191  2117 raft_consensus.cc:2804] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:18.671571  2117 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.671887  2117 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.675959  1782 tablet_bootstrap.cc:492] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:18.685353  2117 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.691406  1781 tablet_bootstrap.cc:492] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:18.692044  1781 ts_tablet_manager.cc:1403] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.213s	user 0.020s	sys 0.018s
I20260709 13:00:18.694396  1783 tablet_bootstrap.cc:492] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:18.694882  1783 ts_tablet_manager.cc:1403] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.053s	user 0.007s	sys 0.007s
I20260709 13:00:18.695734  1781 raft_consensus.cc:359] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.696735  1781 raft_consensus.cc:385] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.697070  1781 raft_consensus.cc:740] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.697918  1781 consensus_queue.cc:260] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.700431  1781 ts_tablet_manager.cc:1434] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:00:18.706568  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:18.708264  1781 tablet_bootstrap.cc:492] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
W20260709 13:00:18.708993  1556 leader_election.cc:343] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:18.709228  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:18.710041  1736 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.698455  1783 raft_consensus.cc:359] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.717459  1783 raft_consensus.cc:385] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.717875  1783 raft_consensus.cc:740] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.703867  2117 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:18.720235  1783 consensus_queue.cc:260] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.721114  1736 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:18.722465  1558 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:18.724155  1782 tablet_bootstrap.cc:654] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.725673  2117 raft_consensus.cc:2804] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:18.726533  2117 raft_consensus.cc:697] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:18.728612  1489 catalog_manager.cc:5697] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:18.730182  2117 consensus_queue.cc:237] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.747020  1781 tablet_bootstrap.cc:654] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.748103  1665 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.751819  1783 ts_tablet_manager.cc:1434] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.007s
I20260709 13:00:18.767572  1783 tablet_bootstrap.cc:492] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:18.775363  1782 tablet_bootstrap.cc:492] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:18.775846  1782 ts_tablet_manager.cc:1403] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.100s	user 0.012s	sys 0.010s
I20260709 13:00:18.776868  1781 tablet_bootstrap.cc:492] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:18.777305  1781 ts_tablet_manager.cc:1403] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.069s	user 0.007s	sys 0.009s
I20260709 13:00:18.780390  1783 tablet_bootstrap.cc:654] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.781622  1782 raft_consensus.cc:359] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.782258  1782 raft_consensus.cc:385] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.782485  1782 raft_consensus.cc:740] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.783143  1782 consensus_queue.cc:260] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.785635  1782 ts_tablet_manager.cc:1434] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:00:18.786020  1783 tablet_bootstrap.cc:492] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:18.786494  1783 ts_tablet_manager.cc:1403] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.001s
I20260709 13:00:18.786545  1782 tablet_bootstrap.cc:492] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:18.792101  1782 tablet_bootstrap.cc:654] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.793051  1783 raft_consensus.cc:359] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.793780  1783 raft_consensus.cc:385] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.794047  1783 raft_consensus.cc:740] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.794713  1783 consensus_queue.cc:260] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.796854  1783 ts_tablet_manager.cc:1434] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:00:18.798300  1783 tablet_bootstrap.cc:492] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:18.803784  1783 tablet_bootstrap.cc:654] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.808614  1486 catalog_manager.cc:5697] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:18.823097  1964 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.823675  1964 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.827014  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:18.829550  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:18.828760  1781 raft_consensus.cc:359] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.830611  1736 raft_consensus.cc:2393] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 1: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:18.830713  1781 raft_consensus.cc:385] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.831390  1781 raft_consensus.cc:740] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.832096  1781 consensus_queue.cc:260] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.836930  1781 ts_tablet_manager.cc:1434] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.059s	user 0.005s	sys 0.002s
I20260709 13:00:18.838109  1633 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:18.839135  2106 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.849483  1781 tablet_bootstrap.cc:492] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:18.827162  1964 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:18.862289  1783 tablet_bootstrap.cc:492] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:18.863173  1781 tablet_bootstrap.cc:654] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.863157  1783 ts_tablet_manager.cc:1403] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.065s	user 0.016s	sys 0.034s
I20260709 13:00:18.865020  2089 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.865893  2089 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.870783  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:18.873807  1707 leader_election.cc:343] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:18.877331  2089 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:18.876971  1783 raft_consensus.cc:359] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.863193  2106 raft_consensus.cc:2749] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:18.878333  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:18.882735  1705 leader_election.cc:343] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:18.883139  1705 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:18.884184  2089 raft_consensus.cc:2749] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:18.881273  1783 raft_consensus.cc:385] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.885030  1783 raft_consensus.cc:740] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.885181  1781 tablet_bootstrap.cc:492] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:18.885650  1781 ts_tablet_manager.cc:1403] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.048s	user 0.017s	sys 0.001s
I20260709 13:00:18.885951  1783 consensus_queue.cc:260] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.887519  1783 ts_tablet_manager.cc:1434] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 13:00:18.890446  1783 tablet_bootstrap.cc:492] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:18.897655  2117 consensus_queue.cc:1048] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:18.898622  1781 raft_consensus.cc:359] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.902508  1781 raft_consensus.cc:385] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.902853  1781 raft_consensus.cc:740] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.903541  1781 consensus_queue.cc:260] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.905346  1781 ts_tablet_manager.cc:1434] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:00:18.907125  1662 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.899232  1783 tablet_bootstrap.cc:654] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.922214  1831 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.922822  1831 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.924768  1831 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:18.926504  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:18.928210  1705 leader_election.cc:343] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:18.942451  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:18.948987  1781 tablet_bootstrap.cc:492] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
W20260709 13:00:18.957748  1707 leader_election.cc:343] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:18.958374  1707 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:18.958673  1781 tablet_bootstrap.cc:654] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.959520  1831 raft_consensus.cc:2749] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:18.960357  2069 consensus_queue.cc:1048] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:18.969544  2161 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.970161  2161 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.973016  2161 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:18.976588  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:18.977423  1666 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 0.
I20260709 13:00:18.979039  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:18.980042  1735 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 0.
I20260709 13:00:18.982966  1558 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:18.984551  2117 raft_consensus.cc:2804] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:18.985095  2117 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.985617  2117 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.989475  1783 tablet_bootstrap.cc:492] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:18.990082  1783 ts_tablet_manager.cc:1403] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.102s	user 0.010s	sys 0.015s
I20260709 13:00:18.995500  2117 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.995530  1783 raft_consensus.cc:359] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:18.997695  1783 raft_consensus.cc:385] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.997995  1783 raft_consensus.cc:740] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.999975  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:19.000524  1666 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:19.000469  1783 consensus_queue.cc:260] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:19.007390  1666 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:19.008560  1556 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:19.009250  1783 ts_tablet_manager.cc:1434] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.005s
I20260709 13:00:19.009505  2069 raft_consensus.cc:2804] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:19.010414  1783 tablet_bootstrap.cc:492] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:19.011641  2117 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:19.014110  2069 raft_consensus.cc:697] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:19.015491  2069 consensus_queue.cc:237] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:19.018147  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:19.019193  1735 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:19.038720  1735 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:19.047511  1781 tablet_bootstrap.cc:492] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:19.048221  1781 ts_tablet_manager.cc:1403] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.100s	user 0.012s	sys 0.020s
I20260709 13:00:19.051807  1783 tablet_bootstrap.cc:654] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:19.070118  1781 raft_consensus.cc:359] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:19.070789  1781 raft_consensus.cc:385] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:19.071055  1781 raft_consensus.cc:740] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:19.071676  1781 consensus_queue.cc:260] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:19.090070  1781 ts_tablet_manager.cc:1434] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 13:00:19.098356  1781 tablet_bootstrap.cc:492] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:19.068261  2162 consensus_queue.cc:1048] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 13:00:19.110903  1782 tablet_bootstrap.cc:492] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:19.111485  1782 ts_tablet_manager.cc:1403] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.325s	user 0.083s	sys 0.101s
I20260709 13:00:19.115758  1782 raft_consensus.cc:359] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:19.117010  1782 raft_consensus.cc:385] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:19.117376  1782 raft_consensus.cc:740] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:19.118098  1782 consensus_queue.cc:260] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:19.124501  1782 ts_tablet_manager.cc:1434] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:00:19.126374  1782 tablet_bootstrap.cc:492] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:19.128070  1783 tablet_bootstrap.cc:492] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:19.129489  1783 ts_tablet_manager.cc:1403] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.119s	user 0.012s	sys 0.006s
I20260709 13:00:19.129529  1781 tablet_bootstrap.cc:654] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:19.131242  1490 catalog_manager.cc:5697] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:19.134644  1783 raft_consensus.cc:359] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:19.135576  1783 raft_consensus.cc:385] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:19.135901  1783 raft_consensus.cc:740] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:19.136672  1783 consensus_queue.cc:260] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:19.139427  1783 ts_tablet_manager.cc:1434] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:00:19.140583  1783 tablet_bootstrap.cc:492] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:19.160292  1782 tablet_bootstrap.cc:654] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:19.165702  1783 tablet_bootstrap.cc:654] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:19.172204  2161 consensus_queue.cc:1048] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:19.208205  2192 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.208767  2192 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:19.210672  2192 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:19.215698  1782 tablet_bootstrap.cc:492] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:19.216264  1782 ts_tablet_manager.cc:1403] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.090s	user 0.014s	sys 0.024s
I20260709 13:00:19.218868  1782 raft_consensus.cc:359] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:19.219594  1782 raft_consensus.cc:385] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:19.219930  1782 raft_consensus.cc:740] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:19.220595  1782 consensus_queue.cc:260] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:19.222064  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:19.223655  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:19.224278  1738 raft_consensus.cc:2468] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 0.
W20260709 13:00:19.226285  1538 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:19.229511  1782 ts_tablet_manager.cc:1434] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:00:19.230518  1782 tablet_bootstrap.cc:492] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:19.238584  1782 tablet_bootstrap.cc:654] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:19.250929  1783 tablet_bootstrap.cc:492] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:19.251600  1783 ts_tablet_manager.cc:1403] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.111s	user 0.020s	sys 0.013s
W20260709 13:00:19.297221  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 80147us
I20260709 13:00:19.303683  1783 raft_consensus.cc:359] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:19.304719  1783 raft_consensus.cc:385] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:19.307297  1783 raft_consensus.cc:740] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:19.308440  1783 consensus_queue.cc:260] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:19.318053  2161 consensus_queue.cc:1048] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:19.323299  2161 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:19.316089  1633 leader_election.cc:343] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:19.323949  2161 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:19.329376  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:19.329550  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:19.330245  1736 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 0.
I20260709 13:00:19.333873  1558 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:19.335609  2162 raft_consensus.cc:2804] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:19.336089  2162 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:19.336524  2162 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:19.340356  1556 leader_election.cc:343] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:19.346699  2161 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:19.352437  1783 ts_tablet_manager.cc:1434] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.100s	user 0.006s	sys 0.004s
I20260709 13:00:19.360882  1662 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:19.362917  1831 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.363533  1831 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:19.370694  1633 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:19.374111  1831 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:19.380518  1783 tablet_bootstrap.cc:492] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:19.368469  2089 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.379037  2104 raft_consensus.cc:2804] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:19.378194  2162 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:19.384199  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:19.388895  2069 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.384519  2089 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:19.393764  2069 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:19.396515  1707 leader_election.cc:343] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:19.398955  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:19.400169  1705 leader_election.cc:343] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:19.401278  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:19.401932  1592 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 0.
I20260709 13:00:19.386070  2104 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:19.402941  2104 raft_consensus.cc:3060] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:19.406641  1707 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:19.407533  1781 tablet_bootstrap.cc:492] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:19.407982  1781 ts_tablet_manager.cc:1403] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.310s	user 0.065s	sys 0.143s
I20260709 13:00:19.409219  1831 raft_consensus.cc:2804] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:19.409771  1831 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:19.410302  1831 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:19.411340  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:19.405942  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:19.413707  1556 leader_election.cc:343] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:19.417850  1782 tablet_bootstrap.cc:492] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:19.418290  1782 ts_tablet_manager.cc:1403] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.188s	user 0.037s	sys 0.064s
W20260709 13:00:19.417654  1705 leader_election.cc:343] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:19.419147  1705 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:19.398183  2089 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:19.421677  1781 raft_consensus.cc:359] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:19.422281  1781 raft_consensus.cc:385] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:19.422499  1781 raft_consensus.cc:740] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:19.423095  1781 consensus_queue.cc:260] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:19.425560  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:19.429956  2104 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:19.433697  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:19.436347  2104 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:19.439491  2069 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:19.440977  1633 leader_election.cc:343] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:19.427960  1954 raft_consensus.cc:2749] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:19.441536  1781 ts_tablet_manager.cc:1434] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.001s
I20260709 13:00:19.450111  1781 tablet_bootstrap.cc:492] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:19.451889  1782 raft_consensus.cc:359] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:19.452831  1782 raft_consensus.cc:385] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:19.453223  1782 raft_consensus.cc:740] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:19.454382  2162 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:19.458992  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:19.460398  1783 tablet_bootstrap.cc:654] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:19.454013  1782 consensus_queue.cc:260] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:19.474001  1556 leader_election.cc:343] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:19.477145  2105 consensus_queue.cc:1048] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:19.494925  1782 ts_tablet_manager.cc:1434] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.076s	user 0.009s	sys 0.001s
I20260709 13:00:19.498375  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:19.501240  1735 raft_consensus.cc:3060] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:19.506789  2161 consensus_queue.cc:1048] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:19.509918  1831 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:19.512629  1782 tablet_bootstrap.cc:492] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:19.513736  1738 raft_consensus.cc:2393] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 1: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:19.516780  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:19.521157  1781 tablet_bootstrap.cc:654] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:19.521848  1733 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:19.533536  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:19.534703  1592 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:19.537508  1735 raft_consensus.cc:2468] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 1.
I20260709 13:00:19.540184  1831 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:19.539038  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:19.548089  1558 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:19.548688  1633 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:19.550774  2104 raft_consensus.cc:2804] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:19.555084  2104 raft_consensus.cc:697] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 1 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:19.556383  2104 consensus_queue.cc:237] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:19.564579  2162 consensus_queue.cc:1048] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:00:19.572551  1705 leader_election.cc:343] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:19.576251  1783 tablet_bootstrap.cc:492] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:19.576851  1783 ts_tablet_manager.cc:1403] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.209s	user 0.018s	sys 0.012s
I20260709 13:00:19.588819  2105 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.598865  1782 tablet_bootstrap.cc:654] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:19.605060  1592 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:19.605760  2161 raft_consensus.cc:2749] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:19.612293  1733 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:19.623047  1558 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:19.627300  1707 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:19.628376  1831 raft_consensus.cc:2804] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:19.628836  1831 raft_consensus.cc:697] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:19.629695  1831 consensus_queue.cc:237] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:19.631582  1964 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.636488  1964 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:19.630141  2161 raft_consensus.cc:2804] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:19.638725  2161 raft_consensus.cc:697] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:19.639533  1964 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:19.639889  2161 consensus_queue.cc:237] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:19.643090  1783 raft_consensus.cc:359] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:19.643796  1783 raft_consensus.cc:385] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:19.644079  1783 raft_consensus.cc:740] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:19.597633  2105 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:19.649681  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:19.652125  2105 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:19.653673  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:19.654789  1783 consensus_queue.cc:260] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:19.657316  1633 leader_election.cc:343] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:19.657568  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:19.658524  1735 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 0.
I20260709 13:00:19.659876  1558 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:00:19.667897  1633 leader_election.cc:343] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:19.668504  1633 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:19.660719  2116 raft_consensus.cc:2804] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:19.670475  1783 ts_tablet_manager.cc:1434] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.093s	user 0.003s	sys 0.005s
I20260709 13:00:19.666635  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:19.671679  2192 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:19.675781  1783 tablet_bootstrap.cc:492] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:19.678756  2106 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.671285  2116 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:19.681772  2106 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:19.694696  1556 leader_election.cc:343] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:19.685451  2116 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:19.715021  1781 tablet_bootstrap.cc:492] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:19.715736  1781 ts_tablet_manager.cc:1403] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.266s	user 0.010s	sys 0.012s
I20260709 13:00:19.722790  2106 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:19.731065  1489 catalog_manager.cc:5697] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 1 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:19.720863  1781 raft_consensus.cc:359] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:19.749862  1781 raft_consensus.cc:385] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:19.750267  1781 raft_consensus.cc:740] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:19.751176  1781 consensus_queue.cc:260] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:19.753258  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 54070.7us
I20260709 13:00:19.757436  1486 catalog_manager.cc:5697] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:19.765430  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:19.766178  1781 ts_tablet_manager.cc:1434] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.050s	user 0.012s	sys 0.000s
W20260709 13:00:19.767171  1633 leader_election.cc:343] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:19.756012  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:19.770788  1783 tablet_bootstrap.cc:654] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:19.767182  1781 tablet_bootstrap.cc:492] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d: Bootstrap starting.
I20260709 13:00:19.771910  1735 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 0.
I20260709 13:00:19.781857  1633 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:19.782739  2106 raft_consensus.cc:2804] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:19.783303  2106 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:19.783836  2106 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:19.818954  2116 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:19.822751  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:19.828604  2116 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:19.834575  1782 tablet_bootstrap.cc:492] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:19.837420  1831 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.841143  1782 ts_tablet_manager.cc:1403] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.329s	user 0.008s	sys 0.026s
I20260709 13:00:19.841049  1831 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:19.841449  1556 leader_election.cc:343] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:19.845737  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:19.847193  1705 leader_election.cc:343] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:19.847036  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:19.848238  1736 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:19.850153  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:19.851320  1831 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:00:19.853688  1707 leader_election.cc:343] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:19.854619  1707 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:19.856707  1831 raft_consensus.cc:2749] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:19.863628  1736 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:19.865792  1558 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:19.868287  2220 raft_consensus.cc:2804] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:19.869599  2220 raft_consensus.cc:697] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:19.870129  1782 raft_consensus.cc:359] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:19.847088  1781 tablet_bootstrap.cc:654] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:19.871227  1782 raft_consensus.cc:385] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:19.872573  1782 raft_consensus.cc:740] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:19.871281  2220 consensus_queue.cc:237] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:19.873633  1782 consensus_queue.cc:260] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:19.856911  2106 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:19.890743  2106 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:19.894946  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:19.895768  1736 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:19.900008  1782 ts_tablet_manager.cc:1434] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.000s
I20260709 13:00:19.908438  2204 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.917567  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:19.917423  2204 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:19.918484  1589 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:19.919706  1783 tablet_bootstrap.cc:492] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:19.920256  1783 ts_tablet_manager.cc:1403] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.247s	user 0.021s	sys 0.028s
I20260709 13:00:19.930472  1782 tablet_bootstrap.cc:492] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:19.950177  2204 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:19.953368  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:19.953048  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:19.954742  1705 leader_election.cc:343] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:19.956015  1707 leader_election.cc:343] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:19.956459  1707 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:19.961872  2204 raft_consensus.cc:2749] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:19.971388  2104 consensus_queue.cc:1048] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:19.977144  1781 tablet_bootstrap.cc:492] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d: No bootstrap required, opened a new log
I20260709 13:00:19.977749  1781 ts_tablet_manager.cc:1403] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d: Time spent bootstrapping tablet: real 0.211s	user 0.026s	sys 0.020s
I20260709 13:00:19.985059  1783 raft_consensus.cc:359] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:19.985929  1783 raft_consensus.cc:385] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:19.986264  1783 raft_consensus.cc:740] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:19.969494  1736 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 1.
I20260709 13:00:19.989873  1782 tablet_bootstrap.cc:654] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:19.990787  1783 consensus_queue.cc:260] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:19.991940  1633 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:19.992916  2192 raft_consensus.cc:2804] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:19.993784  2192 raft_consensus.cc:697] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 1 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:19.998047  1781 raft_consensus.cc:359] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:19.998730  1781 raft_consensus.cc:385] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:19.998971  1781 raft_consensus.cc:740] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Initialized, Role: FOLLOWER
I20260709 13:00:19.996235  2192 consensus_queue.cc:237] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:20.000226  1783 ts_tablet_manager.cc:1434] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.080s	user 0.007s	sys 0.001s
I20260709 13:00:20.004323  1490 catalog_manager.cc:5697] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:20.017907  1781 consensus_queue.cc:260] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:20.025554  1783 tablet_bootstrap.cc:492] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:20.034760  1781 ts_tablet_manager.cc:1434] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.001s
I20260709 13:00:20.039223  1589 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 1.
I20260709 13:00:20.049187  2106 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.049528  1783 tablet_bootstrap.cc:654] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:20.049893  2106 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:20.052558  2106 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:20.065198  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:20.065933  1736 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 0.
I20260709 13:00:20.064136  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:20.070304  1782 tablet_bootstrap.cc:492] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:20.071956  1782 ts_tablet_manager.cc:1403] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.149s	user 0.024s	sys 0.023s
I20260709 13:00:20.067262  1486 catalog_manager.cc:5697] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:20.089920  1782 raft_consensus.cc:359] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:20.090607  1782 raft_consensus.cc:385] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:20.090865  1782 raft_consensus.cc:740] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:20.091706  1782 consensus_queue.cc:260] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:20.093106  1556 consensus_peers.cc:597] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:20.093556  1633 consensus_peers.cc:597] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:20.094132  1633 leader_election.cc:343] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:20.094705  1633 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:20.095317  1782 ts_tablet_manager.cc:1434] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.006s
I20260709 13:00:20.096272  1782 tablet_bootstrap.cc:492] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:20.103976  2230 raft_consensus.cc:2804] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:20.107352  2230 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:20.107501  1782 tablet_bootstrap.cc:654] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:20.107728  2230 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:20.136327  2204 consensus_queue.cc:1048] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:20.136349  2230 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:20.152321  2230 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:20.152793  1782 tablet_bootstrap.cc:492] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:20.153745  2089 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.154302  2089 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:20.157686  1783 tablet_bootstrap.cc:492] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:20.158366  1783 ts_tablet_manager.cc:1403] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.141s	user 0.016s	sys 0.037s
I20260709 13:00:20.155818  1486 catalog_manager.cc:5697] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 1 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:20.153439  1782 ts_tablet_manager.cc:1403] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.057s	user 0.010s	sys 0.024s
I20260709 13:00:20.163949  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:20.164510  1782 raft_consensus.cc:359] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:20.165755  1782 raft_consensus.cc:385] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:00:20.165911  1707 leader_election.cc:343] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:20.285187  1782 raft_consensus.cc:740] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:20.179072  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:20.286103  1782 consensus_queue.cc:260] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:20.287679  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:20.288277  1736 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:20.288532  1782 ts_tablet_manager.cc:1434] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.128s	user 0.043s	sys 0.082s
I20260709 13:00:20.289470  1782 tablet_bootstrap.cc:492] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:20.277954  1783 raft_consensus.cc:359] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:20.290385  1783 raft_consensus.cc:385] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:20.290693  1783 raft_consensus.cc:740] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:20.291441  1783 consensus_queue.cc:260] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:20.293658  1783 ts_tablet_manager.cc:1434] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.135s	user 0.028s	sys 0.016s
W20260709 13:00:20.295964  1705 consensus_peers.cc:597] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:20.297866  1783 tablet_bootstrap.cc:492] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:20.191839  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:20.301541  1666 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 0.
I20260709 13:00:20.175496  2089 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:20.300839  1736 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 1.
I20260709 13:00:20.305145  1783 tablet_bootstrap.cc:654] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:20.296476  1782 tablet_bootstrap.cc:654] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:20.319046  1705 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
W20260709 13:00:20.315496  1538 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:20.320951  2089 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:20.321367  2089 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:20.321698  2089 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:20.324095  1783 tablet_bootstrap.cc:492] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:20.324524  1783 ts_tablet_manager.cc:1403] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.027s	user 0.004s	sys 0.007s
I20260709 13:00:20.327303  1782 tablet_bootstrap.cc:492] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:20.327011  1783 raft_consensus.cc:359] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:20.327759  1783 raft_consensus.cc:385] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:20.327870  1782 ts_tablet_manager.cc:1403] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.039s	user 0.006s	sys 0.006s
I20260709 13:00:20.328058  1783 raft_consensus.cc:740] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
W20260709 13:00:20.285529  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 119651us
I20260709 13:00:20.328776  1783 consensus_queue.cc:260] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:20.331307  1782 raft_consensus.cc:359] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:20.332206  1782 raft_consensus.cc:385] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:20.332382  1783 ts_tablet_manager.cc:1434] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
I20260709 13:00:20.332551  1782 raft_consensus.cc:740] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:20.333199  2215 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.333360  1782 consensus_queue.cc:260] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:20.333667  2215 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:20.335695  2215 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:20.335703  1782 ts_tablet_manager.cc:1434] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:00:20.337165  1782 tablet_bootstrap.cc:492] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
W20260709 13:00:20.338864  1556 consensus_peers.cc:597] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:20.343665  1831 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.344151  1831 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:20.346129  1831 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:00:20.346602  1633 leader_election.cc:343] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:20.350291  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:20.350425  1633 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:20.351037  1666 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 0.
I20260709 13:00:20.352269  2089 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:20.353761  2230 raft_consensus.cc:2804] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:20.354455  2230 raft_consensus.cc:697] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 1 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:20.355557  2230 consensus_queue.cc:237] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:20.357043  1782 tablet_bootstrap.cc:654] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:20.364405  1705 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:20.370460  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:20.370920  1783 tablet_bootstrap.cc:492] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:20.384861  2089 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:20.384670  1831 raft_consensus.cc:2804] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:20.391894  1831 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:20.392330  1831 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:20.393229  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:20.397051  1486 catalog_manager.cc:5697] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 1 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:20.400345  1783 tablet_bootstrap.cc:654] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:20.401141  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:20.402009  1667 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:20.410066  1667 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:20.414999  1831 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:20.417016  1831 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:20.418713  1705 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:20.419402  2239 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:20.419922  2239 raft_consensus.cc:697] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:20.420817  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:20.421866  1667 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:20.425196  2239 consensus_queue.cc:237] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:20.432228  1667 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:20.433736  1705 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:20.434473  2089 raft_consensus.cc:2804] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:20.435288  2089 raft_consensus.cc:697] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:20.436628  2089 consensus_queue.cc:237] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:20.439505  2116 consensus_queue.cc:1048] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:20.451107  1558 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:20.453265  2218 raft_consensus.cc:2749] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:20.455871  1782 tablet_bootstrap.cc:492] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:20.456423  1782 ts_tablet_manager.cc:1403] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.119s	user 0.051s	sys 0.039s
I20260709 13:00:20.458315  2230 consensus_queue.cc:1048] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:20.464141  1783 tablet_bootstrap.cc:492] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:20.464740  1783 ts_tablet_manager.cc:1403] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.094s	user 0.012s	sys 0.005s
W20260709 13:00:20.505156  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 52358us
I20260709 13:00:20.515666  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:20.512861  1486 catalog_manager.cc:5697] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:20.525940  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:20.529029  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:20.559108  1783 raft_consensus.cc:359] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:20.560437  1783 raft_consensus.cc:385] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:20.560982  1783 raft_consensus.cc:740] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:20.554839  1782 raft_consensus.cc:359] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:20.562721  1782 raft_consensus.cc:385] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:20.563076  1782 raft_consensus.cc:740] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:20.564121  1782 consensus_queue.cc:260] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:20.592295  1783 consensus_queue.cc:260] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:20.599658  1782 ts_tablet_manager.cc:1434] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.143s	user 0.006s	sys 0.007s
I20260709 13:00:20.602963  1782 tablet_bootstrap.cc:492] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:20.605501  1964 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.606474  1964 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:20.612425  1964 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:20.621212  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 62071.1us
I20260709 13:00:20.614684  1783 ts_tablet_manager.cc:1434] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.150s	user 0.012s	sys 0.000s
I20260709 13:00:20.626935  1783 tablet_bootstrap.cc:492] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:20.633328  2220 consensus_queue.cc:1048] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:20.640100  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:20.665697  2097 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.666628  2097 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:20.669415  2097 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:20.670154  1707 leader_election.cc:343] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:20.671687  1707 leader_election.cc:343] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:20.673017  1707 leader_election.cc:343] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:20.687101  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:20.688089  1735 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 0.
I20260709 13:00:20.691700  1660 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:20.696561  1489 catalog_manager.cc:5697] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:20.728034  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:20.728680  2204 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.729364  2204 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:20.733754  2204 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:20.734925  1583 raft_consensus.cc:3060] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:20.736910  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:20.738637  1705 leader_election.cc:343] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:20.730794  1558 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:20.740420  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:20.741379  2249 raft_consensus.cc:2804] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:20.741806  2249 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:20.742197  2249 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:20.748860  1783 tablet_bootstrap.cc:654] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:20.753317  1782 tablet_bootstrap.cc:654] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:20.757378  2192 consensus_queue.cc:1048] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:20.760761  1633 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:20.774145  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:20.775905  2249 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:20.778556  2249 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:20.791734  1707 leader_election.cc:343] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:20.792588  1707 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:20.793507  2239 raft_consensus.cc:2749] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:20.799384  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:20.800295  1740 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:20.805505  1782 tablet_bootstrap.cc:492] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:20.806008  1782 ts_tablet_manager.cc:1403] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.204s	user 0.013s	sys 0.004s
I20260709 13:00:20.808482  1782 raft_consensus.cc:359] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:20.809331  2230 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.810047  2230 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:20.789495  1556 leader_election.cc:343] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:20.808974  1782 raft_consensus.cc:385] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:20.813684  1782 raft_consensus.cc:740] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:20.815351  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:20.816776  2230 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:20.817339  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:20.818024  2229 raft_consensus.cc:2749] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:20.818106  1733 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 0.
I20260709 13:00:20.816505  1782 consensus_queue.cc:260] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:20.819635  1633 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:20.821540  1782 ts_tablet_manager.cc:1434] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:00:20.822443  1783 tablet_bootstrap.cc:492] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:20.822650  1782 tablet_bootstrap.cc:492] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:20.823025  1783 ts_tablet_manager.cc:1403] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.197s	user 0.017s	sys 0.007s
I20260709 13:00:20.825316  2229 raft_consensus.cc:2804] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:20.825712  2229 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:20.826092  2229 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:20.828298  1783 raft_consensus.cc:359] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:20.829764  1783 raft_consensus.cc:385] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:20.830111  1783 raft_consensus.cc:740] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:20.839640  2245 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.839916  1783 consensus_queue.cc:260] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:20.840277  2245 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:20.842514  1707 consensus_peers.cc:597] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:20.843698  2245 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:20.846259  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:20.847033  1733 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 0.
I20260709 13:00:20.847844  1783 ts_tablet_manager.cc:1434] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:00:20.851930  1782 tablet_bootstrap.cc:654] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:20.853459  1558 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:20.854497  2245 raft_consensus.cc:2804] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:20.854861  2245 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:20.855196  2245 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:20.863910  1583 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:20.864614  1964 consensus_queue.cc:1048] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:20.865859  1740 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:20.866783  2245 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:20.873626  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:20.867808  1558 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:20.870014  1584 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:20.874622  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:20.878728  2249 raft_consensus.cc:2804] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:20.879053  2245 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:20.879446  2249 raft_consensus.cc:697] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:20.880784  2249 consensus_queue.cc:237] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:20.884862  1556 leader_election.cc:343] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:20.887063  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:20.887676  1733 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:20.887876  1588 raft_consensus.cc:2393] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 1: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:20.890170  2229 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:20.891589  1663 raft_consensus.cc:2393] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 1: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:20.950277  2246 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.952603  2246 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:20.954226  1783 tablet_bootstrap.cc:492] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
W20260709 13:00:21.055714  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 94926.4us
I20260709 13:00:21.121562  2246 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:21.196455  1733 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
W20260709 13:00:21.203763  2256 log.cc:927] Time spent T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:00:21.275489  1964 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.277540  1964 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:21.306607  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:21.269203  2229 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:21.313408  2259 consensus_queue.cc:1048] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.075s
W20260709 13:00:21.315936  2260 log.cc:927] Time spent T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.050s	user 0.003s	sys 0.000s
I20260709 13:00:21.317378  2215 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.326815  1666 raft_consensus.cc:2393] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 1: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:21.408331  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:21.422526  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 50638.7us
I20260709 13:00:21.435570  1964 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:21.410528  1665 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
W20260709 13:00:21.401525  2256 log.cc:927] Time spent T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.081s	user 0.000s	sys 0.004s
I20260709 13:00:21.319830  2215 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:21.569142  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:21.590552  1592 raft_consensus.cc:2393] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 1: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:21.588620  1782 tablet_bootstrap.cc:492] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:21.603282  1782 ts_tablet_manager.cc:1403] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.781s	user 0.051s	sys 0.079s
W20260709 13:00:21.617183  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 53283.3us
I20260709 13:00:21.621060  1558 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:21.589954  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:00:21.584131  2253 log.cc:927] Time spent T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.073s	user 0.001s	sys 0.001s
I20260709 13:00:21.646451  2097 raft_consensus.cc:2804] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:21.697669  1783 tablet_bootstrap.cc:654] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:21.691732  2265 log.cc:927] Time spent T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.073s	user 0.003s	sys 0.000s
I20260709 13:00:21.707774  2273 consensus_queue.cc:1048] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:00:21.707973  1782 raft_consensus.cc:359] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:21.691967  2097 raft_consensus.cc:697] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:21.718441  1782 raft_consensus.cc:385] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:21.722144  1782 raft_consensus.cc:740] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:21.737882  2097 consensus_queue.cc:237] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:21.745414  1782 consensus_queue.cc:260] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:21.758970  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 70274.6us
I20260709 13:00:21.795809  2278 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.797503  2278 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:21.781369  1783 tablet_bootstrap.cc:492] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:21.845902  1783 ts_tablet_manager.cc:1403] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.951s	user 0.032s	sys 0.025s
I20260709 13:00:21.770426  1782 ts_tablet_manager.cc:1434] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.165s	user 0.019s	sys 0.001s
I20260709 13:00:21.850390  1782 tablet_bootstrap.cc:492] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91: Bootstrap starting.
I20260709 13:00:21.767414  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:21.865358  1783 raft_consensus.cc:359] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:21.868362  1738 raft_consensus.cc:2393] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 1: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:21.872334  2273 consensus_queue.cc:1048] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:00:21.869109  1783 raft_consensus.cc:385] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:21.875463  1783 raft_consensus.cc:740] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:21.873241  2215 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:21.925348  2278 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:21.941988  1783 consensus_queue.cc:260] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:21.971832  1783 ts_tablet_manager.cc:1434] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.125s	user 0.017s	sys 0.005s
I20260709 13:00:21.979311  1664 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:21.986838  1783 tablet_bootstrap.cc:492] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:22.001518  2270 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:22.002652  2270 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:22.003135  1964 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:21.954628  2278 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:22.049307  1964 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:22.058841  1782 tablet_bootstrap.cc:654] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:22.064025  1964 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:22.042850  2249 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:22.086314  2270 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:22.084605  2249 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:22.060272  2278 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:22.128124  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:22.145153  1666 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:22.168973  2261 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:22.174240  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:00:22.181653  1538 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:22.174752  2249 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:22.185650  1739 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 0.
I20260709 13:00:22.193686  2270 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:22.194723  2278 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:22.195236  2270 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:22.191402  1783 tablet_bootstrap.cc:654] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:22.205554  1486 catalog_manager.cc:5697] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:22.203994  2281 log.cc:927] Time spent T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.079s	user 0.002s	sys 0.001s
I20260709 13:00:22.211858  2192 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:22.170858  2261 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:22.263310  2192 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:22.291652  2239 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:22.296931  1964 consensus_queue.cc:1048] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:22.298938  2239 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:22.316133  2192 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:22.260388  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:22.362250  2219 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:22.318060  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:22.325636  2239 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:00:22.394383  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 70525.7us
W20260709 13:00:22.439288  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 143755us
I20260709 13:00:22.351027  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:22.462354  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:22.401790  2192 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:22.466009  2192 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:22.494509  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:22.495554  1739 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:22.471542  2239 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:22.454818  2219 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:22.508239  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:22.497571  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:22.512418  1556 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:22.492058  2257 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
W20260709 13:00:22.522497  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 75964.7us
I20260709 13:00:22.529495  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:22.534406  2270 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:22.552575  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 53129.4us
I20260709 13:00:22.556993  1633 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:22.558301  1782 tablet_bootstrap.cc:492] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91: No bootstrap required, opened a new log
I20260709 13:00:22.560571  1782 ts_tablet_manager.cc:1403] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91: Time spent bootstrapping tablet: real 0.711s	user 0.041s	sys 0.024s
I20260709 13:00:22.548859  2220 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:22.546196  2263 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:22.520793  2239 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:22.615468  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 60841us
W20260709 13:00:22.746722  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 159172us
I20260709 13:00:22.754858  1783 tablet_bootstrap.cc:492] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:22.756058  1783 ts_tablet_manager.cc:1403] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.770s	user 0.025s	sys 0.020s
I20260709 13:00:22.589704  2270 raft_consensus.cc:2749] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:00:22.730217  2204 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:22.596942  2261 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:22.595672  2262 consensus_queue.cc:1048] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.179s
I20260709 13:00:22.789229  1782 raft_consensus.cc:359] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:22.792273  1782 raft_consensus.cc:385] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:22.792755  1782 raft_consensus.cc:740] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Initialized, Role: FOLLOWER
I20260709 13:00:22.746081  2266 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:22.774382  2220 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:22.571748  2257 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:22.780798  2291 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:22.795145  1782 consensus_queue.cc:260] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:22.651278  1831 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:22.806427  2291 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:22.824517  1831 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:22.821547  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 224550us
I20260709 13:00:22.788538  2192 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:22.650797  2104 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:22.650091  2218 raft_consensus.cc:2804] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:22.795305  2266 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:22.853757  2218 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:22.854584  2218 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:22.856300  2266 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:22.850564  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 96993.9us
I20260709 13:00:22.857511  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:22.831606  2263 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:22.888437  1782 ts_tablet_manager.cc:1434] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91: Time spent starting tablet: real 0.322s	user 0.032s	sys 0.009s
I20260709 13:00:22.813522  2204 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:22.891454  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 70778.6us
I20260709 13:00:22.849287  2219 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:22.899587  1831 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:22.905023  2257 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:22.895381  2292 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:22.895076  2230 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:22.894102  2236 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:22.864362  2104 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:22.897163  2249 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:22.937958  2257 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:22.944670  2219 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:22.938174  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:22.899296  2270 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:23.223992  2229 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:23.112283  2239 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:23.229894  2261 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.229735  2229 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:22.953641  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:23.231213  2261 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:22.957098  1558 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:23.231493  2309 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:23.040572  2264 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:22.961355  2292 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.232597  2263 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:22.954594  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:00:23.092906  2293 log.cc:927] Time spent T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:00:23.026924  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:23.233444  1964 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:23.055187  2220 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:22.945644  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 97151.2us
W20260709 13:00:23.218854  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 162787us
W20260709 13:00:23.241149  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 284208us
I20260709 13:00:23.248700  1558 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:23.242619  1783 raft_consensus.cc:359] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.017915  2273 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
W20260709 13:00:23.120673  2302 log.cc:927] Time spent T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
W20260709 13:00:23.064658  2289 log.cc:927] Time spent T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 13:00:23.249739  1783 raft_consensus.cc:385] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:23.271914  1783 raft_consensus.cc:740] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:23.244963  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:23.272781  1783 consensus_queue.cc:260] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.242278  2257 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.251916  1964 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.054278  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:23.242264  2270 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.103029  2291 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:23.234910  2219 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.271014  2229 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:23.274863  2295 raft_consensus.cc:2804] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:23.298758  1964 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:23.276484  1556 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:23.269385  2300 raft_consensus.cc:2804] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:23.233909  2236 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:22.985756  2288 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:23.242024  2230 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:23.300011  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 47675.5us
I20260709 13:00:23.235352  2249 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.240674  2239 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:23.298597  1666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 401) took 1169 ms. Trace:
I20260709 13:00:23.309741  2300 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:23.310135  2295 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
W20260709 13:00:23.312032  1556 leader_election.cc:343] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:23.327798  1556 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:23.235348  2306 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:23.288864  2292 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:23.321794  1783 ts_tablet_manager.cc:1434] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.565s	user 0.014s	sys 0.026s
I20260709 13:00:23.321789  1664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 300) took 1354 ms. Trace:
I20260709 13:00:23.322510  2288 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.313706  2204 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:00:23.328663  1783 ts_tablet_manager.cc:1467] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede: Tablet startup took 571ms
I20260709 13:00:23.345389  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:23.326869  2300 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:23.318141  2104 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:23.329612  2295 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:23.253759  2309 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.333211  2097 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:23.289227  2273 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:23.356081  2218 consensus_meta.cc:287] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.501s	user 0.015s	sys 0.000s
I20260709 13:00:23.331012  2239 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.361366  1661 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:23.365588  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 45069.3us
I20260709 13:00:23.251370  2264 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.393888  2313 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:23.363050  2287 raft_consensus.cc:2749] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:23.323874  1666 rpcz_store.cc:276] 0709 13:00:22.125003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:22.142816 (+ 17813us) service_pool.cc:224] Handling call
0709 13:00:22.144524 (+  1708us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:22.478536 (+334012us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:22.478581 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:22.479889 (+  1308us) log.cc:844] Serialized 26 byte log entry
0709 13:00:22.622447 (+142558us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:22.895635 (+273188us) log.cc:844] Serialized 14 byte log entry
0709 13:00:23.223677 (+328042us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:23.236128 (+ 12451us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:23.294298 (+ 58170us) raft_consensus.cc:1685] finished
0709 13:00:23.294316 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:23.294437 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5559,"prepare.queue_time_us":601522,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":30,"raft.queue_time_us":59472,"raft.run_cpu_time_us":492,"raft.run_wall_time_us":12469,"thread_start_us":473488,"threads_started":3,"wal-append.queue_time_us":353803}
I20260709 13:00:23.348067  2306 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.386354  2218 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.397121  2313 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.418983  2257 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:23.413352  2270 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:23.454577  1633 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:23.365026  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:23.425246  2307 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:23.473582  2236 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:23.474516  2236 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:23.475188  2236 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.477252  2301 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:23.454165  2261 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:23.453444  2104 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:23.463766  2257 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:23.469280  2192 raft_consensus.cc:2749] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:23.468667  2298 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:23.490664  2104 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.502415  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:23.508854  2239 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:23.478116  2301 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.490233  2257 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } }
I20260709 13:00:23.329600  1664 rpcz_store.cc:276] 0709 13:00:21.967839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.972535 (+  4696us) service_pool.cc:224] Handling call
0709 13:00:21.978388 (+  5853us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:22.300291 (+321903us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:22.300554 (+   263us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:22.302335 (+  1781us) log.cc:844] Serialized 26 byte log entry
0709 13:00:22.535367 (+233032us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b18002e3660. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7de84e07 00007f1b86cdfab9 00007f1b7dea169b 00007f1b7de9f93f 00007f1b7dea1c02 00007f1b80b2920b 00007f1b80b2ed23 00007f1b80b2f0d1 00007f1b80f4aa0f
0709 13:00:22.827937 (+292570us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:23.218678 (+390741us) log.cc:844] Serialized 14 byte log entry
0709 13:00:23.242114 (+ 23436us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:23.247321 (+  5207us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:23.316995 (+ 69674us) raft_consensus.cc:1685] finished
0709 13:00:23.321560 (+  4565us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:23.321717 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":390507,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":61526,"raft.run_cpu_time_us":511,"raft.run_wall_time_us":6922,"spinlock_wait_cycles":32206208,"thread_start_us":625466,"threads_started":2,"wal-append.queue_time_us":588460}
W20260709 13:00:23.529644  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 232995us
I20260709 13:00:23.510462  2270 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:23.489403  2319 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:23.521469  2219 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:23.541620  2104 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:23.524768  2249 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:23.491995  2307 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.545197  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:23.512651  2298 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.531178  2239 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:23.533885  2313 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:23.552517  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:23.549270  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:23.542858  2270 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.555279  2273 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:23.550983  2218 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:23.530293  2300 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.563431  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:23.533417  2311 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:23.549258  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:23.555773  2239 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.560766  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:23.564622  1738 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 1.
I20260709 13:00:23.562423  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:23.549274  2314 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:23.567644  2236 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:23.576629  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:23.550340  2319 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.565871  2313 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:23.583549  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:23.579628  2299 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:23.580817  2264 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:23.577162  1659 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:23.584374  2236 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:23.583212  2218 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:23.602627  1592 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:23.589165  2287 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:23.589851  2294 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:23.572065  2311 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.612775  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:23.612939  2300 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:23.614519  2104 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:23.615590  2316 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:23.589358  2249 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:23.584347  2313 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.607963  2264 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:23.618556  2257 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:00:23.618006  2263 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:23.608978  2218 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.587497  2299 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.631318  2264 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.634740  2218 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:23.635066  2299 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:23.624408  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:23.639135  1964 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:23.619380  2236 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.639892  1964 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.627944  2270 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:23.625907  2301 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:23.586947  2314 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.639140  2317 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:23.626490  2249 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.629240  2104 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.640853  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:23.593595  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:23.651222  2307 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:23.652619  1964 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:23.654124  1964 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:23.636622  2263 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.621253  2287 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.652292  2239 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:23.630836  2294 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.655082  1964 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.646757  2270 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:23.645879  2308 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.666198  2312 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:23.666501  2319 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:23.341506  1783 ts_tablet_manager.cc:1469] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede: Trace:
0709 13:00:09.804309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.835502 (+ 31193us) service_pool.cc:224] Handling call
0709 13:00:09.873653 (+ 38151us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:00:09.873816 (+   163us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:00:10.095260 (+221444us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:10.380529 (+285269us) tablet_replica.cc:206] Creating consensus instance
0709 13:00:10.399750 (+ 19221us) inbound_call.cc:177] Queueing success response
0709 13:00:21.986189 (+11586439us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:00:22.757023 (+770834us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:00:22.831445 (+ 74422us) tablet_replica.cc:261] Starting instrumentation
0709 13:00:22.894178 (+ 62733us) tablet_replica.cc:280] Starting consensus
Metrics: {"mutex_wait_us":71789,"raft.queue_time_us":50963,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":5466,"tablet-open.queue_time_us":11593334}
I20260709 13:00:23.651743  2301 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:23.670130  2311 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:23.677749  2301 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.678494  2236 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:23.678962  2270 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.679661  2290 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:23.671847  2104 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:23.672273  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:23.672430  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:23.670140  2263 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:23.676419  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:23.638245  2316 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.683928  2313 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:23.683749  1587 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:23.680184  2290 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } }
I20260709 13:00:23.696899  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:23.698195  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:23.699388  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:23.699941  1663 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:23.700769  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:23.667520  1732 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 1.
I20260709 13:00:23.687361  1583 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:23.688479  2301 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:23.690814  2270 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:23.665131  2317 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.714248  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:23.696564  2264 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:23.714252  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:23.713169  2313 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:23.713393  2298 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:23.696062  2312 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.689512  2308 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.756814  1658 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:23.741626  2249 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:23.744663  2314 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:23.746620  2290 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:00:23.742146  2264 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:23.721757  2287 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:23.762602  2317 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:23.762796  2313 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.775048  2270 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:23.773917  1663 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:23.777985  1661 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:23.780640  2104 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:23.775405  2316 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:23.807974  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:23.817657  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:23.818394  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:23.819821  1783 tablet_bootstrap.cc:492] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede: Bootstrap starting.
I20260709 13:00:23.819911  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:23.821455  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:23.822247  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:23.828559  2294 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:23.829592  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:23.800762  2104 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.829638  2290 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:23.807924  2316 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:23.830554  2290 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.830849  2316 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.832010  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:23.832180  2288 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:23.832559  2290 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:23.832926  2104 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:23.790777  2270 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.834173  2291 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:23.834674  2291 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.835542  2270 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:23.788072  2264 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.842469  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:23.880684  1667 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:23.862769  1705 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:23.860734  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:23.891681  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:23.836810  2291 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:23.812444  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:23.895449  1831 raft_consensus.cc:2804] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:23.900997  1831 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:23.901520  1831 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:23.903637  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:23.860185  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:23.868366  2314 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:23.914057  2314 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.916679  2314 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:23.908164  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:23.920210  1739 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 1.
I20260709 13:00:23.909195  2290 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:23.923705  2290 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.900336  2317 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:23.925786  1633 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:23.912358  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:23.926344  2290 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:23.926677  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:23.927678  1658 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:23.928650  2290 raft_consensus.cc:2804] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:23.929382  2290 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:23.930013  2290 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:23.930100  1663 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:23.932472  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:23.933506  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:23.933905  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:23.837052  2270 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:23.918219  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:23.917799  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:23.875495  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:23.925594  2317 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.912230  1783 tablet_bootstrap.cc:654] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:23.917732  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:23.907284  1705 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
W20260709 13:00:23.910625  2295 consensus_meta.cc:287] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.554s	user 0.007s	sys 0.006s
I20260709 13:00:23.935624  1633 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:23.948774  1705 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:23.952035  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:23.894282  2313 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:23.906131  2316 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:23.958413  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:23.959589  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:23.963887  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:23.934983  1660 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:23.968266  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:23.950376  2321 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:23.960880  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:23.988093  2309 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:23.953907  2295 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.967404  2298 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:23.984938  2321 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:23.985473  2239 raft_consensus.cc:2804] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:23.967469  2291 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:23.994899  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:23.970654  2296 raft_consensus.cc:2804] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:23.988130  2317 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:23.954561  2270 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:24.012931  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:24.014060  1592 raft_consensus.cc:1240] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:24.015676  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:23.989825  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:24.016312  1592 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:24.016920  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:24.017233  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:24.018623  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:23.996048  2239 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:23.999501  2291 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:24.027626  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:24.045622  1739 raft_consensus.cc:2468] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 1.
I20260709 13:00:24.028647  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:24.047299  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:24.030630  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 68288.7us
I20260709 13:00:24.009899  2306 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:24.004334  2296 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:24.050523  1707 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:24.049809  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:24.054579  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:24.056644  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:24.064587  1739 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 1.
I20260709 13:00:24.054991  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:24.003927  2298 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:24.057535  1831 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:24.058652  2264 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:24.067029  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:24.067466  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:24.060792  2270 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:24.029042  2239 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:24.205390  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 256660us
I20260709 13:00:24.061748  2296 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:24.227437  1831 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:24.227500  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:24.072690  1707 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:24.221272  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:24.050294  2291 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:24.068177  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:24.238708  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:24.239130  1705 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:24.227674  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:24.226240  1662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 311) took 1179 ms. Trace:
I20260709 13:00:24.220558  2306 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:24.065953  2321 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:24.226994  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:24.266814  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:24.287187  1831 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:24.070147  2298 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:24.065891  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:24.281255  1705 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:24.098920  2272 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:24.189507  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:24.070469  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:24.288265  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 215658us
I20260709 13:00:24.288374  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:24.299311  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:24.289597  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:24.300994  1707 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:24.301266  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:24.124859  2295 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:24.068344  2331 raft_consensus.cc:2804] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:24.290366  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:24.289963  2230 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:24.294857  1831 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:24.295012  1705 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:24.245430  1662 rpcz_store.cc:276] 0709 13:00:23.046740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.053170 (+  6430us) service_pool.cc:224] Handling call
0709 13:00:23.053606 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:23.239988 (+186382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:23.242044 (+  2056us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:23.245047 (+  3003us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:23.247486 (+  2439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.225863 (+978377us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b540040e7d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:00:24.225932 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:24.226073 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":415990528}
I20260709 13:00:24.304207  1831 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:24.304786  1831 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:24.128914  2290 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:24.293323  2332 raft_consensus.cc:2804] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:24.306944  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:24.307950  1737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43686 (request call id 222) took 1071 ms. Trace:
I20260709 13:00:24.308555  2312 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:24.308826  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:24.312036  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:24.313545  1705 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:24.314237  2089 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:24.314683  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:24.317210  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:24.324236  1737 rpcz_store.cc:276] 0709 13:00:23.236211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.240255 (+  4044us) service_pool.cc:224] Handling call
0709 13:00:23.266674 (+ 26419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:23.326399 (+ 59725us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:23.326437 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:23.326492 (+    55us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:23.326528 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.307710 (+981182us) spinlock_profiling.cc:243] Waited 59.5 ms on lock 0x7b5400277754. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:00:24.307754 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:24.307864 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136837504}
I20260709 13:00:24.339332  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:24.275933  2306 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:24.332855  2089 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:24.341605  2089 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:24.342089  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:24.343161  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:24.343340  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:24.344393  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:24.344547  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:24.336362  2236 raft_consensus.cc:2804] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:24.345410  2236 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:24.345561  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:24.345845  2236 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:24.321578  2298 raft_consensus.cc:2804] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:24.346685  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:24.342231  1964 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:24.347994  1705 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:24.303577  2331 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:24.349932  2331 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:24.355579  2299 raft_consensus.cc:2804] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:24.323781  2332 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:24.346837  2298 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:24.357220  1707 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:24.356019  2299 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:24.345866  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:24.358685  1633 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.511s (SENT) [suppressed 2 similar messages]
I20260709 13:00:24.364521  2299 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:24.376175  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:24.356171  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:24.380020  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:24.380882  1584 raft_consensus.cc:2393] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 2: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:24.359934  2332 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:24.381642  2263 raft_consensus.cc:2749] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:24.381706  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:24.380108  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:24.297251  2272 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:24.387318  1831 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:24.360090  2298 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:24.391825  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:24.385376  2292 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.005s	user 0.008s	sys 0.003s
I20260709 13:00:24.394538  1707 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:24.395810  1831 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:24.395961  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:24.391081  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:24.383783  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:24.400620  1831 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:24.401304  2272 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:24.404309  1707 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:24.405632  1707 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:24.406720  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:00:24.397680  2292 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.032s	user 0.008s	sys 0.003s
I20260709 13:00:24.399219  2239 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } }
I20260709 13:00:24.412137  2239 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:00:24.414477  1592 raft_consensus.cc:1240] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:24.437839  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:24.412832  2308 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:24.451390  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:24.405767  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:24.451792  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 93151.6us
I20260709 13:00:24.452020  1740 raft_consensus.cc:2468] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 1.
I20260709 13:00:24.532636  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:24.451969  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:24.450872  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:24.433816  2317 raft_consensus.cc:2749] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:24.445498  2321 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:24.556411  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:24.544036  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:24.544781  2306 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:24.544947  2291 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:24.547578  2341 consensus_queue.cc:1059] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:00:24.565508  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:24.565392  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:24.408016  2296 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:24.569213  1667 raft_consensus.cc:2468] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:24.555485  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:24.583117  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:24.587661  1783 tablet_bootstrap.cc:492] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede: No bootstrap required, opened a new log
I20260709 13:00:24.588372  1783 ts_tablet_manager.cc:1403] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede: Time spent bootstrapping tablet: real 0.781s	user 0.041s	sys 0.036s
I20260709 13:00:24.591027  1665 raft_consensus.cc:1240] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 1. Current term is 2. Ops: []
W20260709 13:00:24.592635  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 185520us
I20260709 13:00:24.593397  1707 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:24.594417  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:24.597203  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:24.600376  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:24.603272  1707 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:24.608451  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:24.571110  2089 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:24.611533  1831 raft_consensus.cc:2749] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:24.598781  2290 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:24.605372  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:24.613624  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:24.634114  2089 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:24.612507  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:24.609933  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:24.635398  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:24.636168  1739 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:24.630286  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:24.619349  1707 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:24.607487  2341 raft_consensus.cc:2804] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:24.542755  2331 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:24.651993  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:00:24.660772  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 84678.2us
I20260709 13:00:24.647850  2239 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:24.649745  2341 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:24.693982  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:00:24.699718  1538 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:24.701345  1783 raft_consensus.cc:359] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:24.702132  1783 raft_consensus.cc:385] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:24.702420  1783 raft_consensus.cc:740] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Initialized, Role: FOLLOWER
I20260709 13:00:24.703384  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:24.703879  2249 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:24.704238  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:24.704668  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:24.704478  2249 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:24.705873  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:24.702360  1486 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55132 (request call id 115) took 2880 ms. Trace:
I20260709 13:00:24.664414  1732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43686 (request call id 225) took 1190 ms. Trace:
I20260709 13:00:24.711077  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:24.711630  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:24.708240  2299 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:24.708673  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:24.703228  1783 consensus_queue.cc:260] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:24.712809  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:24.767786  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:24.753237  1738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 432) took 1365 ms. Trace:
I20260709 13:00:24.758821  2292 raft_consensus.cc:3055] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:24.729319  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:24.780350  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:24.756052  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:24.753566  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:24.746964  2291 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:24.744377  2335 log.cc:927] Time spent T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.166s	user 0.001s	sys 0.001s
I20260709 13:00:24.734367  1665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 415) took 1389 ms. Trace:
I20260709 13:00:24.726660  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:24.783957  1665 rpcz_store.cc:276] 0709 13:00:23.344579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.356147 (+ 11568us) service_pool.cc:224] Handling call
0709 13:00:24.388114 (+1031967us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b5800155a98. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7de6ab71 00007f1b7de6aa22 00007f1b86d83c09 00007f1b85eddee0 00007f1b85fa70ab 00007f1b85fa7131 00007f1b85f68fc0 00007f1b85f53929 00007f1b85f533d2 00007f1b7f4cabd4
0709 13:00:24.388312 (+   198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:24.591473 (+203161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.734140 (+142667us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b540030b454. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:00:24.734303 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":470236288}
I20260709 13:00:24.782437  1741 raft_consensus.cc:1240] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:24.751731  2331 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:24.757205  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:24.779536  2292 raft_consensus.cc:740] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:24.788416  2292 consensus_queue.cc:260] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:24.751386  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:24.789930  2292 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:24.793532  2299 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:24.778379  1738 rpcz_store.cc:276] 0709 13:00:23.391583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.604019 (+1212436us) service_pool.cc:224] Handling call
0709 13:00:24.752347 (+148328us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b58000e4398. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7de6ab71 00007f1b7de6aa22 00007f1b86d83c09 00007f1b85eddee0 00007f1b85fa70ab 00007f1b85fa7131 00007f1b85f68fc0 00007f1b85f53929 00007f1b85f533d2 00007f1b7f4cabd4
0709 13:00:24.752612 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:24.752842 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:24.752874 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:24.752919 (+    45us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:24.752959 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.753025 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:24.753180 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3528960}
I20260709 13:00:24.743119  1633 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:24.712824  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:24.739830  2332 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:24.711076  2249 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:24.714641  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:24.797688  1666 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:24.797986  2236 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:24.673843  2341 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:24.709851  1486 rpcz_store.cc:276] 0709 13:00:21.822004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.822346 (+   342us) service_pool.cc:224] Handling call
0709 13:00:24.702259 (+2879913us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:22.708844 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:22.791669 (+ 82825us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:22.791885 (+   216us) write_op.cc:435] Acquired schema lock
0709 13:00:22.791960 (+    75us) tablet.cc:662] Decoding operations
0709 13:00:22.797256 (+  5296us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:22.806205 (+  8949us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:22.806544 (+   339us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:00:22.807646 (+  1102us) tablet.cc:701] Row locks acquired
0709 13:00:22.807721 (+    75us) write_op.cc:260] PREPARE: finished
0709 13:00:22.808224 (+   503us) write_op.cc:270] Start()
0709 13:00:22.808693 (+   469us) write_op.cc:276] Timestamp: P: 1783602022807996 usec, L: 0
0709 13:00:22.808728 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:00:22.865869 (+ 57141us) log.cc:844] Serialized 540 byte log entry
0709 13:00:23.428822 (+562953us) op_driver.cc:464] REPLICATION: finished
0709 13:00:23.567245 (+138423us) write_op.cc:301] APPLY: starting
0709 13:00:23.569334 (+  2089us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:23.570475 (+  1141us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:23.580572 (+ 10097us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:23.585319 (+  4747us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:23.587441 (+  2122us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:00:23.587529 (+    88us) write_op.cc:312] APPLY: finished
0709 13:00:23.602091 (+ 14562us) log.cc:844] Serialized 22 byte log entry
0709 13:00:23.619718 (+ 17627us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:23.623241 (+  3523us) write_op.cc:454] Released schema lock
0709 13:00:23.624315 (+  1074us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:23.641145 (+ 16830us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:23.643264 (+  2119us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1734,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":104281,"apply.run_cpu_time_us":3635,"apply.run_wall_time_us":70351,"num_ops":1,"prepare.queue_time_us":322315,"prepare.run_cpu_time_us":26860,"prepare.run_wall_time_us":560288,"raft.queue_time_us":119237,"raft.run_cpu_time_us":18931,"raft.run_wall_time_us":173561,"replication_time_us":595958,"thread_start_us":617101,"threads_started":4,"wal-append.queue_time_us":338476,"wal-append.run_cpu_time_us":24155,"wal-append.run_wall_time_us":1422989}]]}
I20260709 13:00:24.804697  1739 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:24.710223  1732 rpcz_store.cc:276] 0709 13:00:23.474108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.829621 (+355513us) service_pool.cc:224] Handling call
0709 13:00:24.598848 (+769227us) spinlock_profiling.cc:243] Waited 7.95 ms on lock 0x7b58000e4398. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7de6ab71 00007f1b7de6aa22 00007f1b86d83c09 00007f1b85eddee0 00007f1b85fa70ab 00007f1b85fa7131 00007f1b85f68fc0 00007f1b85f53929 00007f1b85f533d2 00007f1b7f4cabd4
0709 13:00:24.607759 (+  8911us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:24.634215 (+ 26456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:24.637535 (+  3320us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:24.646195 (+  8660us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:24.651391 (+  5196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.655170 (+  3779us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:24.661850 (+  6680us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18285440}
I20260709 13:00:24.745249  2296 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:24.718750  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:24.795094  2291 raft_consensus.cc:2749] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:24.801752  2308 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.820253  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:24.736861  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:24.822306  1732 raft_consensus.cc:1240] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:24.664134  1659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 329) took 1078 ms. Trace:
I20260709 13:00:24.722028  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:24.806198  1740 raft_consensus.cc:1240] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:24.806504  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:00:24.795775  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 52792.6us
I20260709 13:00:24.776023  2298 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:24.819979  2308 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:24.829986  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:24.871263  1556 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:24.838954  1734 raft_consensus.cc:1240] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:24.848821  2249 consensus_queue.cc:1059] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:00:24.885305  2347 raft_consensus.cc:2749] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:24.873301  2272 consensus_queue.cc:1059] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:00:24.832067  1741 raft_consensus.cc:1240] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:24.860934  1732 raft_consensus.cc:1240] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:24.822911  1659 rpcz_store.cc:276] 0709 13:00:23.585471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.623616 (+ 38145us) service_pool.cc:224] Handling call
0709 13:00:24.599090 (+975474us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b5800155a98. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7de6ab71 00007f1b7de6aa22 00007f1b86d83c09 00007f1b85eddee0 00007f1b85fa70ab 00007f1b85fa7131 00007f1b85f550a0 00007f1b85f54984 00007f1b7f4cf6d4 00007f1b7f4cf662
0709 13:00:24.661998 (+ 62908us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3922176}
I20260709 13:00:24.833837  1633 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:24.800529  2236 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:24.888028  1558 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:00:24.889503  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 55774.2us
I20260709 13:00:24.824412  2332 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:24.892851  1633 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:24.676981  1705 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:24.915830  1783 ts_tablet_manager.cc:1434] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede: Time spent starting tablet: real 0.327s	user 0.009s	sys 0.002s
I20260709 13:00:24.916095  2348 raft_consensus.cc:3055] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:24.916533  2348 raft_consensus.cc:740] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:24.919488  2348 consensus_queue.cc:260] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:24.890069  2270 raft_consensus.cc:2749] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:24.896021  1556 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:24.921345  2295 raft_consensus.cc:3055] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:24.921770  1556 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:24.921799  2295 raft_consensus.cc:740] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:24.923233  2319 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:24.923363  1556 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:24.923318  2295 consensus_queue.cc:260] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:24.924372  1633 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:24.924484  2249 consensus_queue.cc:1048] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:24.892086  2278 raft_consensus.cc:2804] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:24.666141  2219 consensus_queue.cc:1048] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.225s
I20260709 13:00:24.903898  1739 raft_consensus.cc:1240] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:24.907773  1735 raft_consensus.cc:1240] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:24.908764  2298 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:24.919872  2308 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:24.924726  2295 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:24.935019  1558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.896036  2313 raft_consensus.cc:2749] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:24.936899  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:24.835894  2341 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:24.927407  2346 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:24.928442  2347 raft_consensus.cc:2749] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:24.932276  2345 consensus_queue.cc:1048] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:24.943293  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:24.943495  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:24.943729  2348 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:24.933380  2278 raft_consensus.cc:697] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:24.943331  2341 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:24.945004  2278 consensus_queue.cc:237] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:24.946523  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:24.944730  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:24.929944  2270 raft_consensus.cc:2749] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:24.949452  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 272574us
I20260709 13:00:24.950760  1705 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:24.951975  2299 raft_consensus.cc:2804] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:24.952354  2299 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:24.952749  2299 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:24.955317  2239 raft_consensus.cc:2804] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:24.955770  2239 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:24.956208  2239 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:24.957391  2270 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.957970  2270 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:24.960425  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:24.961966  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:24.965389  2270 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:24.968982  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:24.968786  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:24.969667  1666 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:24.970562  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:24.970696  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:24.971185  1665 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:24.978811  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:24.980942  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:24.980791  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:24.982383  1667 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:24.982489  1586 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:24.985903  2345 consensus_queue.cc:1059] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:24.987072  2345 raft_consensus.cc:3055] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:24.987454  2345 raft_consensus.cc:740] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:24.988042  2347 consensus_queue.cc:1059] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:24.989284  2346 raft_consensus.cc:3055] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:24.989660  2346 raft_consensus.cc:740] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:24.989508  2345 consensus_queue.cc:260] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:24.991014  2345 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:24.990702  2346 consensus_queue.cc:260] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:24.992794  2346 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:24.996270  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:24.999831  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:25.001679  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:00:25.002429  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 79132.3us
I20260709 13:00:25.002645  2347 consensus_queue.cc:1059] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:00:25.003247  1556 leader_election.cc:343] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:25.003446  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:25.003722  2347 consensus_queue.cc:1059] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:25.004050  1666 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.004750  2353 raft_consensus.cc:3055] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:25.004606  1556 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:25.005132  2353 raft_consensus.cc:740] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:25.006012  2353 consensus_queue.cc:260] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:25.001818  1667 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:25.007180  2353 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.006510  1556 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:25.008142  2319 raft_consensus.cc:3055] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:25.008520  2319 raft_consensus.cc:740] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:25.009231  2295 raft_consensus.cc:2749] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.009438  2319 consensus_queue.cc:260] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:25.010161  2295 raft_consensus.cc:2749] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.010190  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:25.011550  1556 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:25.012749  1556 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:25.013195  2287 raft_consensus.cc:2749] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.013451  2295 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.015422  1666 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:25.013476  2319 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.016741  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:25.016991  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:25.017256  1556 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:25.022378  2239 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:25.025549  2348 consensus_queue.cc:1059] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:00:25.023345  2299 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:25.027180  2239 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:25.029192  1707 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:25.034650  2239 raft_consensus.cc:2804] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:25.035156  2239 raft_consensus.cc:697] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:25.035705  1705 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.036062  2239 consensus_queue.cc:237] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:25.036598  2349 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.029368  2295 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.025686  2347 consensus_queue.cc:1059] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:00:25.038493  2347 raft_consensus.cc:3055] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:25.039757  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:25.040630  1733 raft_consensus.cc:2393] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 1: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:25.024493  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:25.029287  1556 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:25.042426  1705 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.042533  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:25.042652  2278 raft_consensus.cc:2749] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.043581  1705 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.033051  2348 raft_consensus.cc:3055] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:25.044409  2348 raft_consensus.cc:740] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:25.038858  2347 raft_consensus.cc:740] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:25.045238  2261 raft_consensus.cc:2749] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.046070  2261 raft_consensus.cc:2804] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:25.046564  2261 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:25.046970  2261 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.046070  2347 consensus_queue.cc:260] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } }
I20260709 13:00:25.045246  2348 consensus_queue.cc:260] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:25.049259  2347 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.049439  2348 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.047185  1705 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.052801  1705 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.057986  1633 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.058897  2270 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:25.058212  1486 catalog_manager.cc:5697] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:00:25.059121  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:25.059384  2270 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:25.056782  2292 raft_consensus.cc:2749] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.054147  2349 raft_consensus.cc:2804] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:25.061652  2270 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:25.062017  2349 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:25.062434  2349 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.046130  1556 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:25.063705  1705 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.065923  2299 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:25.068140  2270 raft_consensus.cc:2749] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.070011  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:25.069419  2346 raft_consensus.cc:2749] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.069464  1556 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:25.078790  1705 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.080128  1633 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.086947  1633 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.089298  1633 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.091173  2229 raft_consensus.cc:2749] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:25.092518  2354 log.cc:927] Time spent T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:00:25.093433  2291 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:25.094170  1633 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.094229  2291 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:25.087951  2270 raft_consensus.cc:2749] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.094844  2291 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.084101  2346 raft_consensus.cc:2749] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.096719  1705 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.083820  2332 raft_consensus.cc:2749] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.085559  2298 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.100526  1633 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.104853  1633 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.099248  2270 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.108192  1556 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:25.101629  2292 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.105149  2229 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.110064  1556 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:25.142549  2353 raft_consensus.cc:2749] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.143565  2353 consensus_queue.cc:1059] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:25.144925  1556 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:25.128790  1633 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.147303  1633 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.148048  2270 raft_consensus.cc:2749] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.148041  2345 raft_consensus.cc:2804] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:25.148742  2345 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:25.149199  2345 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.154755  2349 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:25.149883  2229 raft_consensus.cc:2804] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:25.156167  2229 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:25.109536  2347 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.157253  2229 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.158543  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:25.118702  2291 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:25.108142  1705 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.160796  2298 raft_consensus.cc:2749] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.161278  2291 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:25.161808  2349 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:25.161540  2345 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:25.113873  2308 raft_consensus.cc:2804] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:25.162966  1584 raft_consensus.cc:1240] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:25.164243  2345 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:25.166802  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:00:25.169402  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 62595.9us
I20260709 13:00:25.170199  1705 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.124444  2261 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:25.172837  2261 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:25.162855  2308 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:25.168794  1633 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.174288  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:25.175362  1586 raft_consensus.cc:2410] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 13:00:25.176209  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:25.177567  1667 raft_consensus.cc:1240] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:25.179034  1660 raft_consensus.cc:1240] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:00:25.179627  2298 consensus_queue.cc:1059] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:25.180449  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:25.180637  2341 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.178761  2229 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:25.181823  2341 raft_consensus.cc:3055] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:25.181897  2270 raft_consensus.cc:2749] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.182207  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:25.182948  1705 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.175266  1633 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.182222  2341 raft_consensus.cc:740] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:25.183746  2229 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:25.184083  2270 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.184607  2292 raft_consensus.cc:2804] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:25.184371  2341 consensus_queue.cc:260] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:25.186383  2341 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.185277  2292 raft_consensus.cc:697] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:25.187559  2292 consensus_queue.cc:237] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } }
I20260709 13:00:25.189939  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:25.174335  2308 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.196776  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:25.184409  1633 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.201795  2270 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.202559  1633 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.203730  2270 raft_consensus.cc:2749] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.200625  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:25.159757  2348 raft_consensus.cc:3055] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:25.205425  2348 raft_consensus.cc:740] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:25.206615  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:25.207791  2348 consensus_queue.cc:260] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:25.214498  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:25.218397  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:25.219439  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:25.219858  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:25.204437  1633 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.226250  1633 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.230031  1667 raft_consensus.cc:1240] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:25.230198  2229 raft_consensus.cc:2749] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.230387  1556 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:25.226886  2270 raft_consensus.cc:2749] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.231580  1633 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.233016  1633 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.236174  2308 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:25.236891  2229 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.237690  2229 raft_consensus.cc:2749] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.238888  2308 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:25.239714  2345 raft_consensus.cc:2749] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.240172  1633 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.241885  2270 raft_consensus.cc:2749] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.242349  1633 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.243633  1633 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.244233  2270 raft_consensus.cc:2749] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.245328  2270 raft_consensus.cc:2749] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.248369  1633 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.208890  2348 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.249392  2291 raft_consensus.cc:2749] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.249848  1556 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:25.251806  1633 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.253697  2347 raft_consensus.cc:2749] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.253697  2270 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.255169  1633 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.257047  2270 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.258641  1658 raft_consensus.cc:1240] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:25.262207  2347 consensus_queue.cc:1059] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:25.263222  2345 raft_consensus.cc:3055] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:25.263621  2345 raft_consensus.cc:740] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:25.264583  2345 consensus_queue.cc:260] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:25.266579  1633 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.268169  2345 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.268461  1735 raft_consensus.cc:1240] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:25.270434  2270 raft_consensus.cc:2749] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.271595  2308 raft_consensus.cc:2749] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.271692  2353 consensus_queue.cc:1059] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:25.273037  2278 raft_consensus.cc:3055] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:25.273434  2278 raft_consensus.cc:740] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:25.274472  2278 consensus_queue.cc:260] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:25.276161  2278 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.286872  1667 raft_consensus.cc:1240] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:25.290123  2319 consensus_queue.cc:1059] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:25.291286  2319 raft_consensus.cc:3055] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:25.291679  2319 raft_consensus.cc:740] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:25.292836  2319 consensus_queue.cc:260] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:25.297416  2319 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.304148  1667 raft_consensus.cc:1240] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:25.306996  2347 consensus_queue.cc:1059] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:25.313752  2347 raft_consensus.cc:3055] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:25.314179  2347 raft_consensus.cc:740] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:25.315104  2347 consensus_queue.cc:260] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:25.316756  2347 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.272920  1633 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.325045  2270 raft_consensus.cc:2804] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:25.325635  2270 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:25.326176  2270 raft_consensus.cc:3060] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.331470  2347 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:25.332113  2347 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:25.335191  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:25.337512  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 64671.3us
I20260709 13:00:25.339277  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:25.339422  1633 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.340557  2291 raft_consensus.cc:2749] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.348230  1558 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:25.350015  1658 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:25.350143  1633 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.350894  2291 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.352767  1705 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.353152  2319 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.354662  2292 raft_consensus.cc:2749] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.355721  1705 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.356838  1705 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.356940  2345 consensus_queue.cc:1048] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:25.357558  2349 raft_consensus.cc:2749] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.358009  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:25.358180  2349 raft_consensus.cc:2804] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:25.358688  2349 raft_consensus.cc:697] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:25.359483  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:25.359637  2349 consensus_queue.cc:237] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:25.362643  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:25.364754  1733 raft_consensus.cc:1240] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:25.365432  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:25.365715  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:25.366273  1741 raft_consensus.cc:1240] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:25.371371  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:25.371841  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:25.375376  2345 consensus_queue.cc:1059] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:25.376515  2348 raft_consensus.cc:3055] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:25.376842  2348 raft_consensus.cc:740] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:25.377151  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:25.377887  2348 consensus_queue.cc:260] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:25.378832  2347 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:25.379240  2348 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.383730  2345 consensus_queue.cc:1048] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:25.386722  1589 raft_consensus.cc:2468] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:00:25.393431  1633 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.355708  2270 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:25.420099  2308 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.421470  2270 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:25.376843  1584 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:00:25.394393  2291 consensus_queue.cc:1059] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:25.423025  2291 raft_consensus.cc:3055] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:25.423396  2291 raft_consensus.cc:740] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:25.423434  1633 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.424348  2270 raft_consensus.cc:2749] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.425625  1633 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.426553  2229 raft_consensus.cc:2749] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.426704  1633 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.427562  2229 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.424451  2291 consensus_queue.cc:260] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:25.429183  2291 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.429651  1633 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.430748  2308 raft_consensus.cc:2749] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.431888  1633 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.432637  2308 raft_consensus.cc:2749] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.433836  1633 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.434827  2308 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.418081  1489 catalog_manager.cc:5697] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:25.436120  1633 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.436805  2308 raft_consensus.cc:2749] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.437978  1633 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.438632  2308 raft_consensus.cc:2749] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.442171  1667 raft_consensus.cc:1240] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:25.443708  2345 consensus_queue.cc:1059] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:25.443835  1633 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.444609  2308 raft_consensus.cc:2749] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.444808  2347 raft_consensus.cc:3055] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:25.445266  2347 raft_consensus.cc:740] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:25.445874  1633 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.446574  2308 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.447611  1633 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.453299  2308 raft_consensus.cc:2749] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.446120  2347 consensus_queue.cc:260] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:25.456625  2347 raft_consensus.cc:3060] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.460050  1633 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.463160  1486 catalog_manager.cc:5697] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 1 to 2, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 2 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:25.471256  1486 catalog_manager.cc:5697] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 1 to 2, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 2 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:25.472931  1486 catalog_manager.cc:5697] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 1 to 2, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 2 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:25.476274  2308 raft_consensus.cc:2749] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:25.488587  1633 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:25.489449  2270 raft_consensus.cc:2804] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:25.489576  1633 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:25.490020  2270 raft_consensus.cc:697] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:25.490803  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:25.490924  2270 consensus_queue.cc:237] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:25.491955  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:25.493398  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:25.493407  2229 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:25.494683  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:25.495088  2229 raft_consensus.cc:697] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:25.496048  2229 consensus_queue.cc:237] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:25.509680  1741 raft_consensus.cc:1240] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:25.512921  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:25.513244  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:25.514791  1705 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.515502  2349 raft_consensus.cc:2749] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.515975  1705 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.516673  2349 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.512759  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:25.517323  1705 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.517499  1589 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:00:25.518110  2292 raft_consensus.cc:2749] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.518729  1705 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.519443  2349 raft_consensus.cc:2749] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.521534  1590 raft_consensus.cc:2468] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:00:25.525117  1489 catalog_manager.cc:5697] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 1 to 2, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 2 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:25.524691  1633 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.527495  1741 raft_consensus.cc:1240] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:25.527545  2270 raft_consensus.cc:2749] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.534263  2345 consensus_queue.cc:1059] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:25.535363  2295 raft_consensus.cc:3055] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:25.535763  2295 raft_consensus.cc:740] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:25.536630  2295 consensus_queue.cc:260] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:25.537820  2295 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.535226  1633 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.547175  1486 catalog_manager.cc:5697] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 1 to 2, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 2 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:25.548439  2229 raft_consensus.cc:2749] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.550097  2270 consensus_queue.cc:1059] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:25.550777  2291 raft_consensus.cc:3055] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:25.551132  2291 raft_consensus.cc:740] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:25.552917  2308 consensus_queue.cc:1059] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:25.553872  2313 raft_consensus.cc:3055] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:25.554220  2313 raft_consensus.cc:740] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:25.551910  2291 consensus_queue.cc:260] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:25.555094  2313 consensus_queue.cc:260] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:25.555601  1633 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:25.555759  2291 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.556325  2229 raft_consensus.cc:2804] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:25.556337  2313 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.556885  2229 raft_consensus.cc:697] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:25.557808  2229 consensus_queue.cc:237] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:25.567811  1741 raft_consensus.cc:1240] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:25.569346  2313 consensus_queue.cc:1059] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:25.570447  2291 raft_consensus.cc:3055] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:25.570748  2291 raft_consensus.cc:740] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:25.571456  2291 consensus_queue.cc:260] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:25.572576  2291 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.574890  1486 catalog_manager.cc:5697] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 1 to 2, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 2 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:25.583702  1659 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.588851  1659 raft_consensus.cc:1275] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:25.590240  2261 consensus_queue.cc:1048] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:25.599758  1590 raft_consensus.cc:1275] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:25.604453  2349 consensus_queue.cc:1048] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:25.612075  1659 raft_consensus.cc:1240] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:25.613921  2272 consensus_queue.cc:1059] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:25.614892  2345 raft_consensus.cc:3055] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:25.615279  2345 raft_consensus.cc:740] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:25.616125  2345 consensus_queue.cc:260] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:25.618278  2345 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.684260  1659 raft_consensus.cc:1275] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:25.685756  2261 consensus_queue.cc:1048] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:25.698541  1589 raft_consensus.cc:1275] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:25.699891  2349 consensus_queue.cc:1048] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:25.757040  1665 raft_consensus.cc:1275] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:25.758740  2261 consensus_queue.cc:1048] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:25.774317  1589 raft_consensus.cc:1275] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:25.776104  2292 consensus_queue.cc:1048] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:25.863081  2292 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:25.863638  2292 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:25.865725  2292 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:25.866187  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:25.866843  1590 raft_consensus.cc:2393] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 2: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:25.866676  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:25.867352  1659 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:25.868592  1705 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.869355  2261 raft_consensus.cc:2804] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:25.869715  2261 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:25.869964  2261 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.875226  2261 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:25.877295  2261 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:25.878062  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:25.878480  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:25.879354  1589 raft_consensus.cc:2393] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 2: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:25.892091  1659 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:25.895712  1705 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:25.896823  2292 raft_consensus.cc:2804] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:25.899227  2292 raft_consensus.cc:697] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:25.903501  2292 consensus_queue.cc:237] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:25.923853  1489 catalog_manager.cc:5697] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 1 to 2, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 2 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:25.932950  1589 raft_consensus.cc:1275] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:25.935045  2313 consensus_queue.cc:1048] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:25.947956  1741 raft_consensus.cc:1275] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:25.949952  2229 consensus_queue.cc:1048] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:25.992269  1741 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.994025  1589 raft_consensus.cc:1275] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:25.995515  2313 consensus_queue.cc:1048] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:25.999773  1741 raft_consensus.cc:1275] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:26.003777  2313 consensus_queue.cc:1048] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:26.047863  1590 raft_consensus.cc:1275] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:26.049155  2229 consensus_queue.cc:1048] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:26.057832  1741 raft_consensus.cc:3060] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:26.069478  1741 raft_consensus.cc:1275] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:26.070663  2313 consensus_queue.cc:1048] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:26.077982  2261 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.078418  2261 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.080077  2261 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:26.081074  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:26.081272  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:26.081786  1589 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:26.081786  1665 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:26.083042  1705 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:26.084138  2261 raft_consensus.cc:2804] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:26.084484  2261 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.084800  2261 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.090443  2261 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.092057  2261 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:26.092761  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:26.093052  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:26.093385  1589 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.093603  1665 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.100042  1665 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:26.100042  1589 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:26.101222  1705 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:26.101910  2261 raft_consensus.cc:2804] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:26.102468  2261 raft_consensus.cc:697] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:26.103303  2261 consensus_queue.cc:237] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.113952  1486 catalog_manager.cc:5697] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:26.152417  2345 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.152923  2345 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.154842  2345 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:26.155687  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:26.155989  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:26.156642  1741 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:26.157750  1558 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:26.158396  2345 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:26.158771  2345 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.159089  2345 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.164705  2345 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.166781  2345 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:26.167412  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:26.167979  1665 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.168363  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:26.168980  1741 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.176242  1665 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:26.177342  1741 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:26.177419  1556 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:26.178398  2345 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:26.178887  2345 raft_consensus.cc:697] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:26.179689  2345 consensus_queue.cc:237] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.189555  1486 catalog_manager.cc:5697] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:26.384248  2349 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:26.384954  2349 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.387142  2349 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:26.387912  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:26.388100  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:26.388628  1589 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:26.388841  1659 raft_consensus.cc:2393] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 2: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:26.389849  1707 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:26.390580  2349 raft_consensus.cc:2804] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:26.390954  2349 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:26.391312  2349 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:26.398100  2349 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.399772  2349 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:26.400416  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:26.400657  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:26.401363  1659 raft_consensus.cc:2393] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 2: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:26.405467  1589 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:26.406517  1707 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:26.407084  2349 raft_consensus.cc:2804] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:26.407572  2349 raft_consensus.cc:697] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:26.408267  2349 consensus_queue.cc:237] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.418469  1486 catalog_manager.cc:5697] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 1 to 2, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 2 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:26.446102  1659 raft_consensus.cc:1275] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:26.446373  1589 raft_consensus.cc:1275] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:26.450577  2349 consensus_queue.cc:1048] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:26.455080  2313 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:26.455927  2313 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.460750  2313 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:26.460500  2349 consensus_queue.cc:1048] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:26.463534  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:26.463987  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:26.465873  1741 raft_consensus.cc:2393] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 2: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:26.467644  1589 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:00:26.482434  1633 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:26.483737  2291 raft_consensus.cc:2804] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:26.484324  2291 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:26.484728  2291 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:26.500550  1590 raft_consensus.cc:1275] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:26.507944  2292 consensus_queue.cc:1048] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:26.505249  2291 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.524039  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:26.524744  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:26.525566  1741 raft_consensus.cc:2393] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 2: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:26.526767  2291 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:26.530884  1590 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:00:26.531741  2391 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:26.532043  1633 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:26.532310  2391 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.532805  2291 raft_consensus.cc:2804] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:26.534593  2291 raft_consensus.cc:697] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:26.535446  2291 consensus_queue.cc:237] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.536279  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:26.541399  1590 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:26.537647  2391 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:26.540745  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:26.542505  1665 raft_consensus.cc:2393] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 2: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:26.547549  1707 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:26.549912  2391 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:26.550351  2391 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:26.550768  2391 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:26.553750  1489 catalog_manager.cc:5697] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 1 to 2, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 2 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:26.558208  2391 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.560338  2391 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:26.561431  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:26.562186  1659 raft_consensus.cc:2393] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 2: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:26.563622  1665 raft_consensus.cc:1275] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:26.570197  2292 consensus_queue.cc:1048] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:26.571013  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:26.580811  1589 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:26.582345  1707 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:26.583139  2391 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:26.584547  2391 raft_consensus.cc:697] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:26.585454  2391 consensus_queue.cc:237] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.601311  1741 raft_consensus.cc:1275] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:26.603006  2345 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.603545  2345 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.604234  1486 catalog_manager.cc:5697] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 1 to 2, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 2 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:26.605270  2272 consensus_queue.cc:1048] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:26.606062  2345 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:26.607661  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:26.608389  1659 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:26.610761  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:26.610986  1556 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:26.611404  1741 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:26.612584  2390 raft_consensus.cc:2804] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:26.612946  2390 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.613294  2390 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.621698  2390 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.623692  2390 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:26.624622  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:26.625357  1665 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.632174  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:26.632863  1735 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.634892  1665 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:26.636332  1659 raft_consensus.cc:1275] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:26.638612  1556 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:26.639572  2272 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.639999  2390 raft_consensus.cc:2804] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:26.640540  2390 raft_consensus.cc:697] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:26.640101  2272 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.641237  2345 consensus_queue.cc:1048] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:26.643246  2390 consensus_queue.cc:237] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.643265  2272 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:26.648916  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:26.649580  1739 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:26.651117  1735 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:26.654663  1558 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:26.655778  2272 raft_consensus.cc:2804] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:26.656174  2272 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.656520  2272 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.658681  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:26.666208  2272 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.670909  2272 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:26.671862  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:26.672546  1735 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.675012  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:26.675591  1665 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.675931  2270 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:26.676433  2270 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.676512  1488 catalog_manager.cc:5697] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:26.678498  2270 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:26.681427  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:26.682197  1739 raft_consensus.cc:2393] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 2: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:26.683692  1665 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:26.684587  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:26.685283  1590 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:00:26.687522  1633 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:26.688395  2291 raft_consensus.cc:2804] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:26.688802  2291 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:26.689178  2291 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:26.690182  1735 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:26.691354  2390 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.690236  1556 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:26.691959  2390 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.694571  2390 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:26.696012  2390 raft_consensus.cc:2804] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:26.696635  2390 raft_consensus.cc:697] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:26.697471  2390 consensus_queue.cc:237] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.695932  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:26.698364  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:26.698649  1735 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:26.698513  2291 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.699148  1665 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:26.699754  1558 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:26.700500  2345 raft_consensus.cc:2804] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:26.698357  2272 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.700906  2345 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.701503  2345 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.702162  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:26.703308  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:26.704048  1739 raft_consensus.cc:2393] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 2: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:26.710232  1589 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:00:26.702163  2291 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:26.701306  2272 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.712724  1633 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:26.712374  2345 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.710685  1486 catalog_manager.cc:5697] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:26.714695  2272 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:26.715828  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:26.716451  1739 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.717162  2291 raft_consensus.cc:2804] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:26.717612  2345 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:26.715773  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:26.718364  1735 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:26.718847  2291 raft_consensus.cc:697] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:26.719789  2291 consensus_queue.cc:237] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.720538  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:26.721244  1667 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.721698  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:26.722298  1665 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:26.725859  1739 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:26.727967  1667 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:26.720044  1558 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:26.729462  2272 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:26.729854  2272 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.730183  2272 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.731199  1558 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:26.732292  2390 raft_consensus.cc:2804] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:26.732802  2390 raft_consensus.cc:697] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:26.733855  2390 consensus_queue.cc:237] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.740543  2272 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.744194  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:26.744745  1665 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.748179  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:26.748819  1735 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.749596  1486 catalog_manager.cc:5697] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:26.751379  1665 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:26.752578  1556 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:26.753373  2390 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:26.753854  2390 raft_consensus.cc:697] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:26.754741  2390 consensus_queue.cc:237] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.755554  2272 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:26.756731  1735 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:26.759328  1488 catalog_manager.cc:5697] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 1 to 2, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 2 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:26.770777  1486 catalog_manager.cc:5697] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:26.792689  2390 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.793296  2390 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.796517  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:26.798187  2390 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:26.800145  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:26.801194  1665 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:26.802347  1556 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:26.804141  2272 raft_consensus.cc:2804] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:26.804527  2272 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.804844  2272 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.810983  2272 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.813561  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:26.814209  1665 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.815619  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:26.812882  2272 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:26.824011  1665 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:26.825263  1556 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:26.826289  2272 raft_consensus.cc:2804] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:26.827423  2272 raft_consensus.cc:697] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:26.828279  2272 consensus_queue.cc:237] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.847669  1486 catalog_manager.cc:5697] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:26.859031  2272 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:26.859793  2272 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.863101  2272 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:26.863662  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:26.864408  1665 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:26.865442  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:26.866304  1735 raft_consensus.cc:2393] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 2: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:26.865471  1556 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:26.867470  2390 raft_consensus.cc:2804] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:26.867448  2272 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:26.867959  2390 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:26.868389  2390 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:26.868333  2272 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.871709  2272 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:26.872093  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:26.872653  1665 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:26.872900  2272 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:26.873471  2272 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.874218  1556 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:26.875074  2399 raft_consensus.cc:2804] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:26.875447  2399 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:26.875828  2399 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:26.876184  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:26.876875  1739 raft_consensus.cc:2393] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 2: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:26.878043  2272 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:26.880237  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:26.880375  1667 raft_consensus.cc:1275] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:26.880800  1665 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:26.880440  2390 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.881387  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:26.882161  1741 raft_consensus.cc:2393] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 2: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:26.882092  1556 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:26.883170  2272 raft_consensus.cc:2804] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:26.883245  2390 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:26.883744  2272 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:26.883852  2391 consensus_queue.cc:1048] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:26.884377  2272 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:26.886415  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:26.887805  2399 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.890118  2399 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:26.890858  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:26.891815  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:26.892550  1739 raft_consensus.cc:2393] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 2: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:26.897372  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:26.897836  1659 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:26.898054  1741 raft_consensus.cc:2393] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 2: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:26.898911  1556 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:26.901661   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260709 13:00:26.903183  1589 raft_consensus.cc:1275] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:26.905273  2261 consensus_queue.cc:1048] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:26.915436  1667 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:26.901806  2399 raft_consensus.cc:2804] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:26.924535  1556 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:26.929234  2399 raft_consensus.cc:697] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 2 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:26.930361  2399 consensus_queue.cc:237] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.934101  2345 raft_consensus.cc:2804] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:26.934625  2345 raft_consensus.cc:697] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 2 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:26.935343  2345 consensus_queue.cc:237] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.948515  1486 catalog_manager.cc:5697] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 1 to 2, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:26.950847  1486 catalog_manager.cc:5697] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 1 to 2, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:26.952215  2272 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.959213  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:26.959807  2272 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:26.960078  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:26.960861  1741 raft_consensus.cc:2393] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 2: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:26.961934  2261 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.962354  2261 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.966799  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:26.967399  1589 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
W20260709 13:00:26.969554  2412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:26.970016  2261 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:26.970844  1659 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:26.969059  1707 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:26.971710  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:26.972061  1556 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:26.972379  1667 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
W20260709 13:00:26.972229  2411 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:26.972724  2349 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.973246  2272 raft_consensus.cc:2804] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:26.973424  2292 raft_consensus.cc:2804] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:26.973817  2292 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.974248  2292 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.973253  2349 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.973768  2272 raft_consensus.cc:697] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 2 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:26.978883  2272 consensus_queue.cc:237] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:26.979389  2414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:26.979698   431 server_base.cc:1061] running on GCE node
I20260709 13:00:26.980952  2349 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:26.981145  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:26.981786  1590 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:26.982159   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:00:26.981155  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:26.982465   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:26.982975   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602026982954 us; error 0 us; skew 500 ppm
I20260709 13:00:26.983026  1667 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:26.983776   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:26.984274  1707 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:26.985407  2349 raft_consensus.cc:2804] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:26.985728  2349 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.985950  2349 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.988376  2292 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.991863  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:26.993163  2292 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:26.995370  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:26.994172  2349 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:26.995966  1659 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.999776  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:27.000439  1590 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:27.004106  1486 catalog_manager.cc:5697] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 1 to 2, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:27.007732  1590 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:27.008754  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:27.009369  1667 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:00:27.005614  1659 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:27.010712  1705 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:27.012704  2292 raft_consensus.cc:2804] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:27.009184  1707 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:27.013458  2261 raft_consensus.cc:2804] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:26.999805  2349 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:27.013960  2261 raft_consensus.cc:697] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:27.014784  2261 consensus_queue.cc:237] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:27.017637  1667 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:27.019282  2292 raft_consensus.cc:697] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:27.020313   431 webserver.cc:533] Webserver started at http://127.0.107.196:42581/ using document root <none> and password file <none>
I20260709 13:00:27.021157   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:27.021530   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:27.022083   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:27.020711  2292 consensus_queue.cc:237] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:27.024981   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-3-root/instance:
uuid: "7e839e91a1314c2f9a99b25b17c916a6"
format_stamp: "Formatted at 2026-07-09 13:00:27 on dist-test-slave-g4pn"
I20260709 13:00:27.033806   431 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:00:27.033921  1486 catalog_manager.cc:5697] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 2 to 3, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 3 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:27.035526  1486 catalog_manager.cc:5697] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:27.038486  2422 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:27.040794   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:00:27.041209   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-3-root
uuid: "7e839e91a1314c2f9a99b25b17c916a6"
format_stamp: "Formatted at 2026-07-09 13:00:27 on dist-test-slave-g4pn"
I20260709 13:00:27.041558   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:27.059302  1659 raft_consensus.cc:1275] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:27.061285  2272 consensus_queue.cc:1048] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:27.063133  1741 raft_consensus.cc:1275] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:27.064706  2229 consensus_queue.cc:1048] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:27.067900   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:27.070822   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:27.072006  2292 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.072564  2292 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:27.076436  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:27.076809  2292 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:27.077127  1590 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:27.078349  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:27.079056  1667 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:27.078372  1707 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:27.082216  2292 raft_consensus.cc:2804] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:27.082585  2292 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.082953  2292 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:27.095299  1590 raft_consensus.cc:1275] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:27.096792  2292 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:27.097010  2430 consensus_queue.cc:1048] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:27.109122  2261 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:27.109822  2261 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:27.112149  2261 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:27.117053  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:27.117858  1667 raft_consensus.cc:2368] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 2. Current term is 3.
I20260709 13:00:27.121882  1705 leader_election.cc:400] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Vote denied by peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683) with higher term. Message: Invalid argument: T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 2. Current term is 3.
I20260709 13:00:27.121943  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:27.122288  1705 leader_election.cc:403] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:27.123420  1739 raft_consensus.cc:1275] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:27.128464  2391 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:00:27.135860  1589 raft_consensus.cc:1275] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:27.140676  1667 raft_consensus.cc:1275] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:27.145001  2345 consensus_queue.cc:1048] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:27.142814  2430 consensus_queue.cc:1048] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:00:27.128816  2272 consensus_queue.cc:1048] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:00:27.170578  2391 raft_consensus.cc:2749] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683) with higher term. Message: Invalid argument: T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 2. Current term is 3.
I20260709 13:00:27.172995  1589 raft_consensus.cc:1275] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:27.173498  1665 raft_consensus.cc:1275] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:27.172999   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:27.184981  2391 consensus_queue.cc:1048] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:27.184257  1665 raft_consensus.cc:1275] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:27.191782  2390 consensus_queue.cc:1048] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:00:27.193393  2261 consensus_queue.cc:1048] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:27.203593  2292 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:27.205397  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:27.206162  1665 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:00:27.217444  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:27.218115  1589 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:27.221276  1665 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:27.225044  1705 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:27.244349  1589 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:27.241509  2349 raft_consensus.cc:2804] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:27.241207  2261 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.249022  2261 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:27.251428  2261 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:27.251868  1665 raft_consensus.cc:1275] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:27.252358  1732 raft_consensus.cc:1275] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:27.253228  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:27.253813  2349 raft_consensus.cc:697] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:27.255043  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:27.254923  2349 consensus_queue.cc:237] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:27.257179  2345 consensus_queue.cc:1048] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:27.259171  1707 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:27.260627  2392 raft_consensus.cc:2749] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:27.274376  2345 consensus_queue.cc:1048] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:27.276739  1739 raft_consensus.cc:1275] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:27.298713  1735 raft_consensus.cc:1275] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:27.306190  2345 consensus_queue.cc:1048] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:27.309610  2270 consensus_queue.cc:1048] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:00:27.340783   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:27.341355   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.000s	sys 0.000s
I20260709 13:00:27.340608  1737 raft_consensus.cc:1275] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:27.349138   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:27.369287   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.020s	user 0.000s	sys 0.000s
I20260709 13:00:27.380939  1733 raft_consensus.cc:1275] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:27.369110  2390 consensus_queue.cc:1048] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:00:27.384111  1732 raft_consensus.cc:1240] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:27.398342  1733 raft_consensus.cc:1275] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:27.398123  1665 raft_consensus.cc:1275] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:27.410769  2345 consensus_queue.cc:1048] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:27.415910  1736 raft_consensus.cc:1275] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:27.408917  2399 consensus_queue.cc:1048] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
W20260709 13:00:27.446265  2439 log.cc:927] Time spent T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:00:27.429471  1658 raft_consensus.cc:1275] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:27.428392  2442 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.465849  2442 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:27.495071  2292 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.526393  2442 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:27.520035  2292 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:27.541782  2292 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:00:27.579133  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 169453us
I20260709 13:00:27.598796  2345 consensus_queue.cc:1048] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:27.694725  1659 raft_consensus.cc:1240] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:27.706977  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:27.740927  1584 raft_consensus.cc:3055] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:27.750298  1584 raft_consensus.cc:740] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:27.763100  2390 consensus_queue.cc:1048] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
W20260709 13:00:28.042943  1633 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.009s	sys 0.029s
W20260709 13:00:28.043392  1633 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.010s	sys 0.029s
W20260709 13:00:28.047966  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 742088us
W20260709 13:00:28.055411  2446 log.cc:927] Time spent T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.511s	user 0.005s	sys 0.007s
W20260709 13:00:28.076138  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 338130us
I20260709 13:00:28.077777  2390 consensus_queue.cc:1048] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:28.089314  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:28.113642  1589 raft_consensus.cc:1275] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:27.755367  1584 consensus_queue.cc:260] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:28.117265  1584 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:28.136468  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 407041us
W20260709 13:00:28.121418  2272 consensus_queue.cc:1175] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5ced62816f8545cd9b63a27e9055e42d" responder_term: 3 status { last_received { term: 3 index: 2 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:00:28.156276  2399 consensus_queue.cc:1175] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5bb87fe07da2414e84ee578c3b176ede" responder_term: 3 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:00:28.158144  1660 raft_consensus.cc:1275] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:28.162032  1584 raft_consensus.cc:1275] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:00:28.162370  1590 raft_consensus.cc:1275] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:28.162535  1584 pending_rounds.cc:85] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91: Aborting all ops after (but not including) 1
I20260709 13:00:28.162885  1584 pending_rounds.cc:107] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:00:28.163272  1584 raft_consensus.cc:2889] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:28.173424  2463 consensus_queue.cc:1048] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:28.177829  1659 raft_consensus.cc:1275] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:28.181407  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:28.181704  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:28.182178  1659 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:28.182418  1664 raft_consensus.cc:1275] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:28.210302  2455 consensus_queue.cc:1048] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:28.228746  1659 raft_consensus.cc:1275] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:00:28.488879  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 264733us
I20260709 13:00:28.525660  2464 consensus_queue.cc:1048] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:00:28.538801  1705 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:28.548664  1705 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
W20260709 13:00:28.553315  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 46168.8us
I20260709 13:00:28.587585  2463 consensus_queue.cc:1048] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:00:28.592197  2463 raft_consensus.cc:2804] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:28.592689  2463 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:28.593182  2463 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:28.587973  2272 consensus_queue.cc:1048] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:00:28.585942  2462 consensus_queue.cc:1048] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
W20260709 13:00:28.799167  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 236760us
W20260709 13:00:28.808025  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 186272us
I20260709 13:00:28.764104  2463 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:28.815640  2463 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:28.817339  2462 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:28.817914  2462 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:28.820168  2462 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:00:28.823112  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 238162us
W20260709 13:00:28.824043  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 272175us
I20260709 13:00:28.834976  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:28.837770  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:28.880703  2435 consensus_queue.cc:1048] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:00:28.898214  1737 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.003s	sys 0.010s
W20260709 13:00:28.898975  1737 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.004s	sys 0.011s
I20260709 13:00:28.902460  2349 raft_consensus.cc:2749] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:29.043381  2504 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.044101  2504 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:29.047171  2504 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:29.051286  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 224016us
W20260709 13:00:29.113263  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 70456.9us
W20260709 13:00:29.121114  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 68987.2us
W20260709 13:00:29.123345  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 275793us
W20260709 13:00:29.195827  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 144826us
I20260709 13:00:29.207111  2463 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:29.208950  2463 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:29.206326  2470 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:29.213670  2513 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.214270  2513 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:29.213763  2470 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:29.226828  2504 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:29.248046  2470 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:29.230093  2513 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:29.246162  2504 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:29.252840  2513 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:29.253960  2513 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:29.256146  2463 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:29.258898  2504 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:29.268945  1739 raft_consensus.cc:1240] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:29.288223  2513 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:29.294183  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 86140.8us
I20260709 13:00:29.306881  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:29.307365  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:29.310439  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:29.325204  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:29.328740  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:29.350739  1705 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:00:29.361246  1688 debug-util.cc:398] Leaking SignalData structure 0x7b0800161e40 after lost signal to thread 434
I20260709 13:00:29.383028  1705 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:00:29.381382  2503 log.cc:927] Time spent T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.366s	user 0.003s	sys 0.003s
I20260709 13:00:29.399060  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:29.385457  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:29.385931  2349 raft_consensus.cc:2749] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:29.387284  2399 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:29.397313  2454 raft_consensus.cc:2749] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:29.406119  1688 debug-util.cc:398] Leaking SignalData structure 0x7b08002019a0 after lost signal to thread 1524
I20260709 13:00:29.405040  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:29.485814  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:29.569866  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:29.460278  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:29.585623  1583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 549) took 1025 ms. Trace:
I20260709 13:00:29.586464  1583 rpcz_store.cc:276] 0709 13:00:28.560577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.578686 (+ 18109us) service_pool.cc:224] Handling call
0709 13:00:28.604130 (+ 25444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:28.604597 (+   467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:28.604668 (+    71us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:28.605320 (+   652us) log.cc:844] Serialized 26 byte log entry
0709 13:00:28.815106 (+209786us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:28.815159 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.815268 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:29.367663 (+552395us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b4400022b4c. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7ddc8c85 00007f1b7ddc96a2 00007f1b80b3b1db 00007f1b80b36aaf 00007f1b80b2a86e 00007f1b80b29bb6 00007f1b80b297d8 00007f1b80b33221 00007f1b80b331d9 00007f1b80b33169
0709 13:00:29.483306 (+115643us) raft_consensus.cc:1685] finished
0709 13:00:29.486829 (+  3523us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:29.585494 (+ 98665us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":206,"raft.queue_time_us":29518,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":2449,"spinlock_wait_cycles":32458112,"thread_start_us":209352,"threads_started":1,"wal-append.queue_time_us":344434}
W20260709 13:00:29.632916  1688 debug-util.cc:398] Leaking SignalData structure 0x7b08002610e0 after lost signal to thread 1616
I20260709 13:00:29.633502  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:29.634483  1688 debug-util.cc:398] Leaking SignalData structure 0x7b08002ed2a0 after lost signal to thread 1691
I20260709 13:00:29.634765  1740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 626) took 1006 ms. Trace:
I20260709 13:00:29.662989  2522 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:29.663733  2522 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:29.665652  2507 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:29.666653  2507 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:29.668604  2507 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:29.669353  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:29.674659  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:29.678755  2522 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:29.635177  1740 rpcz_store.cc:276] 0709 13:00:28.628407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.628592 (+   185us) service_pool.cc:224] Handling call
0709 13:00:29.633850 (+1005258us) spinlock_profiling.cc:243] Waited 959 us on lock 0x7b58000e4398. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7de6ab71 00007f1b7de6aa22 00007f1b86d83c09 00007f1b85eddee0 00007f1b85fa70ab 00007f1b85fa7131 00007f1b85f68fc0 00007f1b85f53929 00007f1b85f533d2 00007f1b7f4cabd4
0709 13:00:29.634171 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:29.634387 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:29.634418 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:29.634468 (+    50us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:29.634503 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.634568 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:29.634704 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2206464}
I20260709 13:00:29.696077  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:00:29.724989  1688 debug-util.cc:398] Leaking SignalData structure 0x7b080016c4e0 after lost signal to thread 1765
W20260709 13:00:29.725450  1688 debug-util.cc:398] Leaking SignalData structure 0x7b08001ad840 after lost signal to thread 1766
I20260709 13:00:29.734951  2516 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:29.735613  2516 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:29.739612  2516 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:29.485324  2399 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:29.773584  1736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 615) took 1269 ms. Trace:
I20260709 13:00:29.783761  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:29.787127  2399 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:29.760300  2516 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:29.774192  1736 rpcz_store.cc:276] 0709 13:00:28.504323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.591114 (+1086791us) service_pool.cc:224] Handling call
0709 13:00:29.591568 (+   454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:29.731539 (+139971us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:29.731591 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:29.731658 (+    67us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:29.731705 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.773258 (+ 41553us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b54001586d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:00:29.773323 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:29.773499 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":321142016}
W20260709 13:00:29.805135  1662 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.049s	sys 0.143s
W20260709 13:00:29.807343  1662 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.050s	sys 0.143s
I20260709 13:00:29.802274  2516 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:29.790441  2430 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:29.802035  2522 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:29.809788  1488 catalog_manager.cc:5697] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 1 to 3, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 3 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:29.840240  1489 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55132 (request call id 151) took 1299 ms. Trace:
I20260709 13:00:29.840902  1489 rpcz_store.cc:276] 0709 13:00:28.538701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.538830 (+   129us) service_pool.cc:224] Handling call
0709 13:00:29.838499 (+1299669us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":383614,"reported_tablets":2}
I20260709 13:00:29.816569  2430 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:29.876129  2398 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:29.876715  2398 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:29.878808  2398 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:29.879359  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 418799us
I20260709 13:00:29.818430  2522 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:29.853227  1661 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.039s	sys 0.024s
I20260709 13:00:29.883213  2453 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:29.884938  2398 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
W20260709 13:00:29.902093  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 484622us
W20260709 13:00:29.918993  1705 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.002s	sys 0.015s
W20260709 13:00:29.919921  1705 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.002s	sys 0.015s
W20260709 13:00:29.900936  1661 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.039s	sys 0.024s
W20260709 13:00:29.925347  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 517800us
I20260709 13:00:29.901340  2430 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:29.897300  2399 consensus_queue.cc:1059] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:00:29.944641  2466 raft_consensus.cc:3055] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:29.945145  2466 raft_consensus.cc:740] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:29.947532  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:29.920511  2398 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:29.957034  2345 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:29.957832  2345 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:29.970625  2345 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:29.973186  2398 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:29.979357  2466 consensus_queue.cc:260] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:29.980719  2466 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:29.981386  2459 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:29.981909  2459 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:29.960112  2516 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:29.984198  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:29.985813  2459 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:29.988418  2522 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:29.973301  2399 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:29.994397  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:29.996942  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:29.997623  1589 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 1.
I20260709 13:00:30.002568  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:30.007445  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:30.016212  1633 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:30.021737  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:29.923661  2453 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:30.032021  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:30.040560  1633 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:30.044579  2291 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:30.006048  2522 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:30.005344  2399 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:30.046551  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:30.098044  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:30.157539  1556 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:30.153877  2392 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:30.009517  2490 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:30.162024  2490 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:30.160005  2392 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:30.164969  2459 raft_consensus.cc:2749] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:30.168663  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:30.107796  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 67319.1us
I20260709 13:00:30.034646  2430 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:30.050714  2520 raft_consensus.cc:2749] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:30.035873  2518 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:30.075826  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:30.166419  2392 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:30.148268  2453 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:30.109019  2391 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:30.051560  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:30.179266  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:30.186316  1633 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:30.201402  2453 raft_consensus.cc:2749] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:30.182900  2430 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:30.191094  2518 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:30.202215  1633 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:30.195029  2391 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:30.161664  2522 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:30.223929  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:30.229758  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:30.230000  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:30.231772  2399 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:30.246733  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:30.214991  2490 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:30.214754  2519 raft_consensus.cc:2749] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:30.260076  2522 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:30.266095  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:30.270188  1486 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55138 (request call id 150) took 1740 ms. Trace:
I20260709 13:00:30.270779  1486 rpcz_store.cc:276] 0709 13:00:28.530193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.530445 (+   252us) service_pool.cc:224] Handling call
0709 13:00:30.270098 (+1739653us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54298,"reported_tablets":8}
I20260709 13:00:30.277714  1707 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:00:30.283128  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 64401.1us
I20260709 13:00:30.292991  2391 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:00:30.293835  2541 log.cc:927] Time spent T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:00:30.294766  2430 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:30.297665  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:30.301481  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:30.298080  1556 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:30.303480  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:30.303735  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:30.308761  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:30.306455  2455 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:30.323333  2518 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:30.332989  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:30.347433  1707 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:30.356698  2391 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:30.359885  2459 raft_consensus.cc:2749] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:30.368626  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 70635.9us
I20260709 13:00:30.369644  1556 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:30.370750  2459 raft_consensus.cc:2749] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:30.373715  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:30.384505  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:30.386009  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:30.388692  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:30.394395  1633 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:30.395375  2518 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:30.395920  2518 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:30.396461  2518 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:30.419567  1633 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:30.420719  2516 raft_consensus.cc:2749] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:30.422365  1633 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:30.423192  2516 raft_consensus.cc:2749] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:30.424528  1633 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:30.432879  2518 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:30.435215  1660 raft_consensus.cc:1240] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:30.442169  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:30.453469  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:30.478665  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:30.481462  2516 raft_consensus.cc:2749] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:00:30.480696  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 56235.8us
I20260709 13:00:30.436802  2518 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:30.483666  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:30.492888  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:30.501878  1488 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55154 (request call id 149) took 2273 ms. Trace:
I20260709 13:00:30.503880  2510 consensus_queue.cc:1059] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:30.505304  2510 raft_consensus.cc:3055] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:30.505681  2510 raft_consensus.cc:740] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:30.506302  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:30.506435  2510 consensus_queue.cc:260] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:30.507508  2510 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:30.509989  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:30.510424  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:30.518566  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:30.523914  1633 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:30.525218  1707 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:30.545068  1556 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:30.547478  1633 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:30.546782  2518 raft_consensus.cc:2749] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:30.547327  2349 raft_consensus.cc:2749] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:30.549506  2520 raft_consensus.cc:2749] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:30.550478  1633 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:30.552444  1633 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:30.552281  2399 raft_consensus.cc:2749] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:30.554263  2520 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:30.552134  2516 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:30.556556  1633 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:30.557364  2516 raft_consensus.cc:2749] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:30.513720  1488 rpcz_store.cc:276] 0709 13:00:28.228294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.229507 (+  1213us) service_pool.cc:224] Handling call
0709 13:00:30.501805 (+2272298us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:30.133598 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:30.135439 (+  1841us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:30.135490 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:00:30.135519 (+    29us) tablet.cc:662] Decoding operations
0709 13:00:30.136041 (+   522us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:30.136115 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:30.136164 (+    49us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:00:30.140280 (+  4116us) tablet.cc:701] Row locks acquired
0709 13:00:30.140347 (+    67us) write_op.cc:260] PREPARE: finished
0709 13:00:30.142139 (+  1792us) write_op.cc:270] Start()
0709 13:00:30.155441 (+ 13302us) write_op.cc:276] Timestamp: P: 1783602030141497 usec, L: 0
0709 13:00:30.160303 (+  4862us) op_driver.cc:348] REPLICATION: starting
0709 13:00:30.163819 (+  3516us) log.cc:844] Serialized 540 byte log entry
0709 13:00:30.344553 (+180734us) spinlock_profiling.cc:243] Waited 2.53 ms on lock 0x7b180008e3c0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7dea23f3 00007f1b7dea47c1 00007f1b7dea4779 00007f1b7dea4709 00007f1b7dea46d1 00007f1b7dea39cd 000000000038f354 000000000038f199 00007f1b7de8583a
0709 13:00:30.426357 (+ 81804us) op_driver.cc:464] REPLICATION: finished
0709 13:00:30.463252 (+ 36895us) write_op.cc:301] APPLY: starting
0709 13:00:30.463363 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:30.463515 (+   152us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:30.463555 (+    40us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:30.463899 (+   344us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:30.464155 (+   256us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:00:30.484872 (+ 20717us) write_op.cc:312] APPLY: finished
0709 13:00:30.485170 (+   298us) log.cc:844] Serialized 22 byte log entry
0709 13:00:30.490966 (+  5796us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:30.494497 (+  3531us) write_op.cc:454] Released schema lock
0709 13:00:30.494565 (+    68us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":36532,"apply.run_cpu_time_us":2333,"apply.run_wall_time_us":53052,"num_ops":1,"prepare.queue_time_us":272811,"prepare.run_cpu_time_us":21717,"prepare.run_wall_time_us":142383,"raft.queue_time_us":71131,"raft.run_cpu_time_us":1284,"raft.run_wall_time_us":42560,"replication_time_us":259560,"spinlock_wait_cycles":5809920,"thread_start_us":298530,"threads_started":4,"wal-append.queue_time_us":112364}]]}
I20260709 13:00:30.552755  1556 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:30.562120  1556 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:30.564955  2459 raft_consensus.cc:2749] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:30.561560  2490 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:30.665304  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 58902.7us
I20260709 13:00:30.669238  1633 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:30.670537  2518 raft_consensus.cc:2749] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:30.680671  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 99435.6us
I20260709 13:00:30.682166  1556 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:30.683246  2466 raft_consensus.cc:2749] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:30.684840  1556 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:30.692981  1737 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:00:30.708165  2466 raft_consensus.cc:2749] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:30.781159  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 47330.7us
I20260709 13:00:30.788357  1633 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:30.806123  2430 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:30.829768  2430 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:30.817981  2518 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:30.854593  2518 raft_consensus.cc:697] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:30.860845  2430 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:30.856390  2518 consensus_queue.cc:237] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:30.926126  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:30.927373  1583 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 3.
W20260709 13:00:30.949225  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 85224.4us
I20260709 13:00:30.948159  1633 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:30.955631  2566 raft_consensus.cc:2804] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:30.956238  2566 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:30.956620  2566 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:30.947563  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 89274.9us
I20260709 13:00:30.956699  2455 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:30.970939  2455 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:31.042696  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:31.044024  1732 raft_consensus.cc:2393] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 3: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:31.048691  2455 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:31.074903  1486 catalog_manager.cc:5697] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 1 to 2, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 2 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:31.102391  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 46332.9us
I20260709 13:00:31.104884  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:31.107482  2349 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.109254  2349 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:31.122400  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:31.108103  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:31.117686  2349 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:31.146189  1707 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:31.148442  2349 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:31.161504  2566 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:31.162734  1660 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:31.163933  2566 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:31.170953  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:31.173477  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:31.174424  1732 raft_consensus.cc:2393] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 3: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:31.172358  1705 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:31.179340  2455 raft_consensus.cc:2804] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:31.179755  2455 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.180087  2455 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:31.198419  1586 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 3.
I20260709 13:00:31.200867  2455 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:31.204702  1633 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:31.206386  2569 raft_consensus.cc:2804] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:31.208935  2569 raft_consensus.cc:697] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 3 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:31.210027  2569 consensus_queue.cc:237] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:31.211293  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:31.211979  1590 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:31.217604  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:31.218250  1588 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:31.225703  2455 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:31.233000  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:31.236534  1588 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:00:31.242251  1707 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:31.243736  2455 raft_consensus.cc:2804] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:31.245222  2455 raft_consensus.cc:697] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:31.246326  2455 consensus_queue.cc:237] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:31.270826  1486 catalog_manager.cc:5697] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 2 to 4, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 4 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:31.396461   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.196:39157
I20260709 13:00:31.396564  2594 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.196:39157 every 8 connection(s)
I20260709 13:00:31.431298   431 auto_leader_rebalancer-test.cc:384] add a tserver: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:00:31.462863  2595 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37303
I20260709 13:00:31.463398  2595 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:31.464457  2595 heartbeater.cc:507] Master 127.0.107.254:37303 requested a full tablet report, sending...
I20260709 13:00:31.464514  1586 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:31.466876  1486 ts_manager.cc:194] Registered new tserver with Master: 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:00:31.468801  1486 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51168
I20260709 13:00:31.472152  1586 raft_consensus.cc:1275] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:31.474084  2430 consensus_queue.cc:1048] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:31.494239  1734 raft_consensus.cc:1275] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:31.503850  2569 consensus_queue.cc:1048] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:31.609457  1588 raft_consensus.cc:1240] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:31.610703  2569 consensus_queue.cc:1059] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:31.611479  2520 raft_consensus.cc:3055] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:31.611931  2520 raft_consensus.cc:740] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:31.612789  2520 consensus_queue.cc:260] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:31.614009  2520 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:31.696401  1586 raft_consensus.cc:1275] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:31.697943  2509 consensus_queue.cc:1048] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:31.711087  1660 raft_consensus.cc:1275] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:00:31.711493  1660 pending_rounds.cc:85] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 2
I20260709 13:00:31.711723  1660 pending_rounds.cc:107] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:00:31.712018  1660 raft_consensus.cc:2889] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:31.713500  2455 consensus_queue.cc:1048] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:32.472380  2595 heartbeater.cc:499] Master 127.0.107.254:37303 was elected leader, sending a full tablet report...
I20260709 13:00:32.495908  1660 consensus_queue.cc:237] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:00:32.510730  1734 raft_consensus.cc:1275] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:32.513824  2569 consensus_queue.cc:1048] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:32.536926  1586 raft_consensus.cc:1275] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:32.538578  2430 consensus_queue.cc:1048] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:32.558732  2430 raft_consensus.cc:2955] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:00:32.567186  1734 raft_consensus.cc:2955] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:00:32.579296  1588 raft_consensus.cc:2955] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:00:32.588301  1661 consensus_queue.cc:237] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
W20260709 13:00:32.590999  1630 consensus_peers.cc:597] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede -> Peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157): Couldn't send request to peer 7e839e91a1314c2f9a99b25b17c916a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 75a149db07824e3fb3c1f721b61d6c20. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:32.608417  1486 catalog_manager.cc:5697] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: config changed from index -1 to 3, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
W20260709 13:00:32.643579  1630 consensus_peers.cc:597] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede -> Peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157): Couldn't send request to peer 7e839e91a1314c2f9a99b25b17c916a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4490828942174c3c9092820cf3a81fe3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:32.651461  1734 raft_consensus.cc:1275] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:32.652081  1586 raft_consensus.cc:1275] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:32.664597  2569 consensus_queue.cc:1048] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:32.670198  2430 consensus_queue.cc:1048] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:32.691026  2430 raft_consensus.cc:2955] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:00:32.693128  1588 raft_consensus.cc:2955] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:00:32.706787  1734 raft_consensus.cc:2955] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:00:32.723488  1489 catalog_manager.cc:5697] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 reported cstate change: config changed from index -1 to 2, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:00:32.766785  1586 consensus_queue.cc:237] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:00:32.775867  1734 raft_consensus.cc:1275] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:32.778716  2568 consensus_queue.cc:1048] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:32.783022  1663 raft_consensus.cc:1275] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:32.788659  2565 consensus_queue.cc:1048] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:00:32.796365  1555 consensus_peers.cc:597] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 -> Peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157): Couldn't send request to peer 7e839e91a1314c2f9a99b25b17c916a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3f75a0ee5c184536abc81f5a366016fb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:32.796792  2568 raft_consensus.cc:2955] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:00:32.803198  1735 raft_consensus.cc:2955] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:00:32.819780  1586 consensus_queue.cc:237] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:00:32.828738  1663 raft_consensus.cc:2955] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:00:32.855741  1662 raft_consensus.cc:1275] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:32.859978  2565 consensus_queue.cc:1048] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:32.856797  1734 raft_consensus.cc:1275] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:32.875543  1488 catalog_manager.cc:5697] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: config changed from index -1 to 3, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New cstate: current_term: 3 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:00:32.878610  2627 consensus_queue.cc:1048] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:00:32.928754  1555 consensus_peers.cc:597] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 -> Peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157): Couldn't send request to peer 7e839e91a1314c2f9a99b25b17c916a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 161aba2b69844461b9d8ed3cdf147919. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:32.947947  2568 raft_consensus.cc:2955] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:00:32.960168  1735 raft_consensus.cc:2955] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:00:32.968161  1663 raft_consensus.cc:2955] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:00:32.989028  1489 catalog_manager.cc:5697] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: config changed from index -1 to 2, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:00:32.994570  2632 ts_tablet_manager.cc:933] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6: Initiating tablet copy from peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:33.000061  2632 tablet_copy_client.cc:323] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:41683
I20260709 13:00:33.062357  1677 tablet_copy_service.cc:140] P 5bb87fe07da2414e84ee578c3b176ede: Received BeginTabletCopySession request for tablet 75a149db07824e3fb3c1f721b61d6c20 from peer 7e839e91a1314c2f9a99b25b17c916a6 ({username='slave'} at 127.0.0.1:58814)
I20260709 13:00:33.063037  1677 tablet_copy_service.cc:161] P 5bb87fe07da2414e84ee578c3b176ede: Beginning new tablet copy session on tablet 75a149db07824e3fb3c1f721b61d6c20 from peer 7e839e91a1314c2f9a99b25b17c916a6 at {username='slave'} at 127.0.0.1:58814: session id = 7e839e91a1314c2f9a99b25b17c916a6-75a149db07824e3fb3c1f721b61d6c20
I20260709 13:00:33.075117  1677 tablet_copy_source_session.cc:215] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:33.082118  2632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75a149db07824e3fb3c1f721b61d6c20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:33.110348  2632 tablet_copy_client.cc:806] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:33.111163  2632 tablet_copy_client.cc:670] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:33.116876  2632 tablet_copy_client.cc:538] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:33.131819  2632 tablet_bootstrap.cc:492] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap starting.
I20260709 13:00:33.189164  2632 tablet_bootstrap.cc:492] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:33.190442  2632 tablet_bootstrap.cc:492] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap complete.
I20260709 13:00:33.191247  2632 ts_tablet_manager.cc:1403] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent bootstrapping tablet: real 0.060s	user 0.025s	sys 0.015s
I20260709 13:00:33.199796  2632 raft_consensus.cc:359] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:00:33.200865  2632 raft_consensus.cc:740] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Initialized, Role: LEARNER
I20260709 13:00:33.201802  2632 consensus_queue.cc:260] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:00:33.214782  2632 ts_tablet_manager.cc:1434] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.004s
I20260709 13:00:33.219022  1677 tablet_copy_service.cc:342] P 5bb87fe07da2414e84ee578c3b176ede: Request end of tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-75a149db07824e3fb3c1f721b61d6c20 received from {username='slave'} at 127.0.0.1:58814
I20260709 13:00:33.219514  1677 tablet_copy_service.cc:434] P 5bb87fe07da2414e84ee578c3b176ede: ending tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-75a149db07824e3fb3c1f721b61d6c20 on tablet 75a149db07824e3fb3c1f721b61d6c20 with peer 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:00:33.225487  2632 ts_tablet_manager.cc:933] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6: Initiating tablet copy from peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:33.242048  2632 tablet_copy_client.cc:323] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:41683
I20260709 13:00:33.244758  1677 tablet_copy_service.cc:140] P 5bb87fe07da2414e84ee578c3b176ede: Received BeginTabletCopySession request for tablet 4490828942174c3c9092820cf3a81fe3 from peer 7e839e91a1314c2f9a99b25b17c916a6 ({username='slave'} at 127.0.0.1:58814)
I20260709 13:00:33.245364  1677 tablet_copy_service.cc:161] P 5bb87fe07da2414e84ee578c3b176ede: Beginning new tablet copy session on tablet 4490828942174c3c9092820cf3a81fe3 from peer 7e839e91a1314c2f9a99b25b17c916a6 at {username='slave'} at 127.0.0.1:58814: session id = 7e839e91a1314c2f9a99b25b17c916a6-4490828942174c3c9092820cf3a81fe3
I20260709 13:00:33.256984  1677 tablet_copy_source_session.cc:215] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:33.259959  2637 ts_tablet_manager.cc:933] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6: Initiating tablet copy from peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:00:33.260696  2632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4490828942174c3c9092820cf3a81fe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:33.296196  2632 tablet_copy_client.cc:806] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:33.296949  2632 tablet_copy_client.cc:670] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:33.318548  2632 tablet_copy_client.cc:538] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:33.362290  2632 tablet_bootstrap.cc:492] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap starting.
I20260709 13:00:33.374001  2554 raft_consensus.cc:1217] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:00:33.385159  2637 tablet_copy_client.cc:323] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:33325
I20260709 13:00:33.423229  2632 tablet_bootstrap.cc:492] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:33.424817  2632 tablet_bootstrap.cc:492] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap complete.
I20260709 13:00:33.425674  2632 ts_tablet_manager.cc:1403] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent bootstrapping tablet: real 0.064s	user 0.023s	sys 0.006s
I20260709 13:00:33.429464  2632 raft_consensus.cc:359] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:00:33.436689  2632 raft_consensus.cc:740] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Initialized, Role: LEARNER
I20260709 13:00:33.437537  2632 consensus_queue.cc:260] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:00:33.441883  2632 ts_tablet_manager.cc:1434] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.002s
I20260709 13:00:33.444082  1677 tablet_copy_service.cc:342] P 5bb87fe07da2414e84ee578c3b176ede: Request end of tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-4490828942174c3c9092820cf3a81fe3 received from {username='slave'} at 127.0.0.1:58814
I20260709 13:00:33.444519  1677 tablet_copy_service.cc:434] P 5bb87fe07da2414e84ee578c3b176ede: ending tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-4490828942174c3c9092820cf3a81fe3 on tablet 4490828942174c3c9092820cf3a81fe3 with peer 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:00:33.455369  2632 ts_tablet_manager.cc:933] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6: Initiating tablet copy from peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:00:33.468457  2632 tablet_copy_client.cc:323] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:33325
I20260709 13:00:33.480235  1602 tablet_copy_service.cc:140] P 6d4de2ce0683442498244b9529127f91: Received BeginTabletCopySession request for tablet 161aba2b69844461b9d8ed3cdf147919 from peer 7e839e91a1314c2f9a99b25b17c916a6 ({username='slave'} at 127.0.0.1:46836)
I20260709 13:00:33.480818  1602 tablet_copy_service.cc:161] P 6d4de2ce0683442498244b9529127f91: Beginning new tablet copy session on tablet 161aba2b69844461b9d8ed3cdf147919 from peer 7e839e91a1314c2f9a99b25b17c916a6 at {username='slave'} at 127.0.0.1:46836: session id = 7e839e91a1314c2f9a99b25b17c916a6-161aba2b69844461b9d8ed3cdf147919
I20260709 13:00:33.485891  1601 tablet_copy_service.cc:140] P 6d4de2ce0683442498244b9529127f91: Received BeginTabletCopySession request for tablet 3f75a0ee5c184536abc81f5a366016fb from peer 7e839e91a1314c2f9a99b25b17c916a6 ({username='slave'} at 127.0.0.1:46836)
I20260709 13:00:33.486503  1601 tablet_copy_service.cc:161] P 6d4de2ce0683442498244b9529127f91: Beginning new tablet copy session on tablet 3f75a0ee5c184536abc81f5a366016fb from peer 7e839e91a1314c2f9a99b25b17c916a6 at {username='slave'} at 127.0.0.1:46836: session id = 7e839e91a1314c2f9a99b25b17c916a6-3f75a0ee5c184536abc81f5a366016fb
I20260709 13:00:33.500233  1601 tablet_copy_source_session.cc:215] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:33.521230  2632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f75a0ee5c184536abc81f5a366016fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:33.534070  1602 tablet_copy_source_session.cc:215] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:33.536893  2637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 161aba2b69844461b9d8ed3cdf147919. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:33.577667  2637 tablet_copy_client.cc:806] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:33.583470  2554 raft_consensus.cc:1217] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:33.585988  2637 tablet_copy_client.cc:670] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:33.591504  2637 tablet_copy_client.cc:538] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:33.598927  2632 tablet_copy_client.cc:806] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:33.599699  2632 tablet_copy_client.cc:670] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:33.609164  2632 tablet_copy_client.cc:538] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:33.659981  2637 tablet_bootstrap.cc:492] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap starting.
I20260709 13:00:33.758194  2632 tablet_bootstrap.cc:492] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap starting.
W20260709 13:00:34.600746  1630 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.003s	sys 0.004s
W20260709 13:00:34.601503  1630 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.004s	sys 0.004s
I20260709 13:00:34.685496  2647 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:34.686398  2647 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:34.690179  2647 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:34.723886  2646 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:34.724704  2646 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:34.727495  2646 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:34.751252  2646 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:34.752168  2646 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:34.754808  2646 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:34.790252  2647 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:34.791222  2647 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:34.793969  2647 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:34.807802  2646 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:34.808712  2646 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:34.811599  2646 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:34.822494  2647 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:35.104041  2647 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } }
I20260709 13:00:35.107050  2647 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:35.107872  2647 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:34.940928  2644 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:35.108794  2644 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.111480  2644 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.112166  2644 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:35.112810  2644 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:34.881735  1557 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.921s	user 0.010s	sys 0.022s
W20260709 13:00:35.113885  1557 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.154s	user 0.010s	sys 0.023s
I20260709 13:00:35.125777  2646 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:35.126719  2646 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.129417  2646 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.149926  2648 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:35.205581  2648 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.207858  2648 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.181661  2644 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.189096  2649 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:35.195781  2651 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:35.198876  2652 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:35.203387  2650 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:35.203641  2656 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:35.215302  2651 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.215426  2652 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.215592  2656 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.203943  2654 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:35.217725  2651 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.217841  2652 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.218441  2652 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:35.218144  2654 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.218915  2652 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.220328  2654 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.220919  2652 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.217880  2656 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.212036  2646 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:35.210093  2657 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:35.212543  2648 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:35.222342  2650 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.160841  2647 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.211308  2658 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:35.223666  2658 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.204178  2653 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:35.213104  2649 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.224728  2647 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.224740  2650 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.219405  2644 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:35.226313  2658 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.226126  2644 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.226445  2649 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.220842  2654 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:35.227193  2654 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.228336  2644 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.222345  2646 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.230294  2654 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.221848  2652 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:35.222487  2657 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.210355  2655 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:35.230877  2646 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.231405  2646 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:35.231223  2655 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.231904  2646 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.232374  2657 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.222970  2648 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.232985  2652 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.233394  2655 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.234817  2648 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.235021  2652 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.235647  2653 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.258365  2653 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.212471  2659 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:35.239084  2662 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:35.261931  2662 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.260912  2659 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.250653  2661 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:35.265910  2661 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.266574  2659 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.251343  2651 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:35.266897  2631 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:35.276773  2651 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.277375  2631 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.278666  2650 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:35.279340  2650 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.278754  2657 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:35.280176  2568 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:35.280071  2654 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:35.280326  2657 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.280862  2654 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.282430  2626 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:35.282514  2657 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.282573  2655 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:35.280853  2568 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.283372  2655 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:00:35.284003  2649 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:35.285406  2568 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.285521  2649 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.285934  2568 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:35.286160  2647 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:35.286439  2568 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.286708  2647 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.287449  2649 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.288000  2649 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:35.288440  2568 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.289376  2646 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.283231  2657 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:35.315536  2657 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.317304  2644 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:35.318147  2644 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.319247  2657 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.280059  2631 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.281376  2650 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.235312  2648 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:35.290212  2655 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.283190  2626 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.394227  2648 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.397933  2669 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:35.398785  2669 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.283214  2654 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.288626  2649 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.294656  1583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 488) took 1551 ms. Trace:
I20260709 13:00:35.401467  1583 rpcz_store.cc:276] 0709 13:00:33.742887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.293131 (+1550244us) service_pool.cc:224] Handling call
0709 13:00:35.293603 (+   472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:35.293862 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:35.293924 (+    62us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:35.294006 (+    82us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:35.294063 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.294242 (+   179us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:35.294534 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:35.403285  2649 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.296453  2647 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.302915  2455 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:35.392572  2626 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.404464  2455 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.300596  2509 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:35.305518  2658 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:35.282438  2651 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.314334  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:35.271070  2661 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.264473  2662 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:35.403649  2644 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.325434  2653 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:35.425885  2631 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:35.332103  2659 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:35.438606  2455 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:35.439369  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:35.441098  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:35.441308  1583 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 1.
I20260709 13:00:35.441713  1588 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 1.
I20260709 13:00:35.443686  2669 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.437577  2651 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:35.427228  2509 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.507699  2455 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:35.450963  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:35.530328  2455 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.447574  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:35.428313  2658 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.531270  1586 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 3.
I20260709 13:00:35.539880  2455 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:35.543385  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:35.543828  2670 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:35.551085  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:35.552032  1586 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 1.
I20260709 13:00:35.447907  2648 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.443023  2659 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.561326  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:35.447938  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:35.566586  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:35.444353  2644 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:35.562069  1662 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:35.449038  2631 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.446085  2653 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.540939  2651 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.562911  2661 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:35.616662  2661 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.617055  2648 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:35.566334  2669 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:35.570587  2646 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:35.571777  1583 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:00:35.614259  2668 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:35.615633  2509 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:35.617390  2673 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:35.623796  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:35.618439  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:35.842664  2659 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:35.719888  1521 debug-util.cc:398] Leaking SignalData structure 0x7b0800040cc0 after lost signal to thread 434
I20260709 13:00:35.843452  2631 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.624029  2664 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:35.702015  2671 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:35.621634  2644 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.786372  2663 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:35.845256  2669 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.703003  2676 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:35.703461  2662 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:35.624428  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:35.633364  2666 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:35.785622  2455 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:35.622423  2672 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:35.552490  2670 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.861279  1659 raft_consensus.cc:2468] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:35.871408  2349 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:35.876210  2674 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:35.866019  1662 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:35.703871  2675 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:35.625826  2658 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.622983  2665 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:35.617944  2648 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.880435  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:35.871920  2646 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.899541  2349 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.901695  2646 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.901981  2349 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:35.903019  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:35.903679  1663 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:35.886297  2455 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.866021  2668 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.905531  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:35.916869  1663 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:35.909394  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:35.891649  1521 debug-util.cc:398] Leaking SignalData structure 0x7b080003c7a0 after lost signal to thread 1524
I20260709 13:00:35.872313  2673 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } }
I20260709 13:00:35.891042  2651 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.918064  1662 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:35.920714  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:35.894610  2631 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:35.889773  2664 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:00:35.925658  2455 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:35.925567  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:35.895242  2661 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.927357  1661 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:35.882097  2671 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.930531  1665 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:35.934868  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:35.884195  2663 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.936925  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:35.938907  1660 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:35.937474  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:35.889276  2676 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.891321  2662 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.935967  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:35.897667  2675 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.891219  2666 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.943953  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:35.904439  2665 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.944996  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:35.945353  2648 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.938578  2651 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:35.989887  2651 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.990993  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:35.991825  1583 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:35.946041  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:35.993340  1665 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:35.993718  2665 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:35.994251  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:35.994801  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:35.995591  1591 raft_consensus.cc:2468] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:35.947335  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:35.996773  2662 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:35.967882  2673 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:00:35.949661  2664 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:35.998265  1658 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:00:35.994812  1665 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:35.999754  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.000130  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:36.000384  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:35.950141  2668 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.929688  2674 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.997366  1659 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:36.002386  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.002957  1659 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:36.003762  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:35.951933  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.004271  1659 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:36.006116  2651 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.988302  1662 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:36.007686  2666 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.952112  2671 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:35.953145  2653 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.953430  2670 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.955842  2644 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.958160  2669 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:35.896860  2672 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.919870  2677 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:36.001128  1665 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
W20260709 13:00:36.011988  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 54987.2us
I20260709 13:00:36.014647  2672 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:36.016893  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:36.020496  2677 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.023260  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:36.026494  2646 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:36.027176  2646 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.939940  2631 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:35.966284  2509 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:35.941994  2680 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:36.032351  2569 raft_consensus.cc:1064] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede: attempting to promote NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 to VOTER
I20260709 13:00:36.045367  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.054005  2455 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:36.054605  2455 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.054605  2509 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:36.057348  1521 debug-util.cc:398] Leaking SignalData structure 0x7b0800263aa0 after lost signal to thread 1616
W20260709 13:00:36.058764  1521 debug-util.cc:398] Leaking SignalData structure 0x7b08000da820 after lost signal to thread 1691
W20260709 13:00:36.061873  1555 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.912s	user 0.066s	sys 0.078s
W20260709 13:00:36.062338  1555 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.038s	user 0.066s	sys 0.078s
I20260709 13:00:36.069885  2646 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:36.003963  2674 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:36.035792  2637 tablet_bootstrap.cc:492] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:36.037560  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.087468  1665 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:36.038407  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.039156  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.000705  1658 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:36.041512  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.043372  2675 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:36.044723  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.099994  1661 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:35.991063  2663 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:36.047015  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.103365  1663 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:36.024649  2677 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:36.105144  2455 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:36.088251  2680 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.088470  1659 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
W20260709 13:00:36.090935  1521 debug-util.cc:398] Leaking SignalData structure 0x7b0800240420 after lost signal to thread 1765
I20260709 13:00:36.088811  2664 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:36.092355  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.087839  2658 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:36.093039  2631 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:36.071604  2659 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:36.115655  2659 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.116360  2680 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:36.117807  2676 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:36.103170  2672 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:36.118971  2659 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:36.118860  2672 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.101936  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.097695  2569 consensus_queue.cc:237] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:36.120283  1661 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:36.121213  2664 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.124073  2664 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:36.124779  2658 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.088415  2662 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:36.127394  2662 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.128525  2658 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:36.110013  1665 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:36.129300  2661 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:36.130025  2661 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.112882  2663 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:36.133802  2663 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.136579  2663 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:36.138111  2509 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:00:36.140096  1521 debug-util.cc:398] Leaking SignalData structure 0x7b08001ecf00 after lost signal to thread 2594
I20260709 13:00:36.132547  2661 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:36.147622  2677 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:36.148280  2677 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.149468  2662 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:36.152603  2672 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:36.159662  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.161629  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.162276  1665 raft_consensus.cc:2468] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:36.163007  2677 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:36.169744  2679 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:36.169934  2662 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:36.171188  2679 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.170475  2675 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:36.171351  2662 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.172777  2637 tablet_bootstrap.cc:492] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap complete.
I20260709 13:00:36.172452  2675 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.173964  2663 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:36.174642  2663 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.175356  2662 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:36.175981  2675 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:36.174948  2679 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:36.178404  2676 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:36.173687  2637 ts_tablet_manager.cc:1403] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent bootstrapping tablet: real 2.514s	user 0.059s	sys 0.046s
I20260709 13:00:36.179288  2677 raft_consensus.cc:1064] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede: attempting to promote NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 to VOTER
I20260709 13:00:36.179107  2676 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:00:36.181170  2671 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:36.181272  2665 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:36.181864  2671 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.182525  2676 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:36.183096  2509 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:36.184067  2671 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:36.183864  2509 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.184583  2671 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:36.184675  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:36.185221  2680 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:36.187009  1588 raft_consensus.cc:2468] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:36.187024  2680 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.185388  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:36.188095  2509 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:36.182035  2665 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.186234  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:36.185642  2672 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:36.190151  2680 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:36.190565  2672 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.191072  2665 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:36.186266  2671 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:00:36.183048  2677 consensus_queue.cc:237] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:36.196079  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:36.205520  1586 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:36.206094  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:36.176849  2663 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:36.196676  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:36.201680  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:36.202126  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:36.202987  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:36.203620  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:36.208946  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.183175  2676 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:36.211802  2676 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:00:36.212009  2637 raft_consensus.cc:359] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:00:36.213212  2675 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:36.213330  2637 raft_consensus.cc:740] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Initialized, Role: LEARNER
I20260709 13:00:36.214111  2675 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.214529  2637 consensus_queue.cc:260] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:00:36.219832  2676 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:36.227779  2632 tablet_bootstrap.cc:492] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:36.229512  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:36.230979  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.238713  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:36.240898  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:36.242309  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.256306  2632 tablet_bootstrap.cc:492] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap complete.
I20260709 13:00:36.257237  2632 ts_tablet_manager.cc:1403] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6: Time spent bootstrapping tablet: real 2.499s	user 0.032s	sys 0.025s
I20260709 13:00:36.257346  2553 raft_consensus.cc:1275] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 2 LEARNER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:36.259733  2679 consensus_queue.cc:1048] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:36.263478  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:36.264190  1588 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:36.260866  2632 raft_consensus.cc:359] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:00:36.267167  2632 raft_consensus.cc:740] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Initialized, Role: LEARNER
I20260709 13:00:36.268435  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.268111  2632 consensus_queue.cc:260] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:00:36.269527  1739 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:36.272125  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.273231  1556 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:00:36.274102  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 69102.5us
I20260709 13:00:36.274243  2670 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:36.274842  2670 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:36.275381  2670 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:36.275740  1556 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:36.277885  2671 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:36.279105  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:36.279428  2659 raft_consensus.cc:2804] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:36.279805  1591 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:36.279953  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:36.281100  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:36.267203  2672 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:36.281793  1592 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:36.282455  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:36.283049  1589 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:36.284034  2637 ts_tablet_manager.cc:1434] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent starting tablet: real 0.105s	user 0.024s	sys 0.031s
W20260709 13:00:36.285182  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.285240  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.273294  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.288245  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:36.283898  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.288852  1588 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:36.280148  2659 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:36.297202  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.298666  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:36.299010  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.299332  1590 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:36.300269  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.303903  1707 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:36.305392  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.306764  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.309499  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.310137  1738 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:36.310204  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.312942  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.313623  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.314170  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.314441  1740 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:36.316596  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.317193  1738 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:36.317601  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.317987  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.318580  1738 raft_consensus.cc:2468] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:36.320490  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.306306  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.325628  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.325896  1732 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:36.306509  2659 raft_consensus.cc:3060] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:36.333530  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.335409  2675 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:36.336838  1707 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:36.372715  2632 ts_tablet_manager.cc:1434] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6: Time spent starting tablet: real 0.115s	user 0.019s	sys 0.035s
I20260709 13:00:36.371837  2675 raft_consensus.cc:2804] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:36.374110  2675 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:36.374701  2675 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:36.380290  1707 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:36.382728  2670 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.387928  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.388490  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.388689  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.389520  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.390018  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.391296  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.391863  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.392892  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.393290  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.393543  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.394177  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.395392  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.399545  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.399708  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:36.400758  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.400933  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.341298  1602 tablet_copy_service.cc:342] P 6d4de2ce0683442498244b9529127f91: Request end of tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-161aba2b69844461b9d8ed3cdf147919 received from {username='slave'} at 127.0.0.1:46836
I20260709 13:00:36.403599  1602 tablet_copy_service.cc:434] P 6d4de2ce0683442498244b9529127f91: ending tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-161aba2b69844461b9d8ed3cdf147919 on tablet 161aba2b69844461b9d8ed3cdf147919 with peer 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:00:36.404565  1601 tablet_copy_service.cc:342] P 6d4de2ce0683442498244b9529127f91: Request end of tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-3f75a0ee5c184536abc81f5a366016fb received from {username='slave'} at 127.0.0.1:46836
I20260709 13:00:36.405182  1601 tablet_copy_service.cc:434] P 6d4de2ce0683442498244b9529127f91: ending tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-3f75a0ee5c184536abc81f5a366016fb on tablet 3f75a0ee5c184536abc81f5a366016fb with peer 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:00:36.405432  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.341902  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.408480  2670 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:36.422210  2676 raft_consensus.cc:2804] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:36.422791  2676 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:36.423269  2676 raft_consensus.cc:3060] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:36.424221  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.424832  1707 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:36.425760  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.441107  2672 raft_consensus.cc:2804] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:36.441706  2672 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:36.442232  2672 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:36.342684  2665 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:00:36.447149  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 171464us
I20260709 13:00:36.448398  1556 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:36.449335  2670 raft_consensus.cc:2804] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:36.450795  2670 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:36.450829  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.449558  1556 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:36.451685  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.459723  2552 raft_consensus.cc:1275] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 1 LEARNER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:36.446601  2554 raft_consensus.cc:1217] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:36.463542  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.461040  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.462893  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.463305  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.467137  1556 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:36.478948  2659 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.447664  2665 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:36.484998  2659 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:36.485379  2665 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:36.488111  2687 raft_consensus.cc:2804] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:36.488827  2687 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:36.455214  2670 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:36.490119  1556 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:36.492125  1707 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:36.492297  1556 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:36.497522  2644 raft_consensus.cc:2804] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:36.497826  2680 raft_consensus.cc:2804] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:36.489449  2687 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:36.498121  2644 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:36.518039  2644 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:36.519763  1707 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:36.520606  2349 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:36.520938  2349 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:36.521364  2349 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:36.522800  1707 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:36.523731  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.499877  1556 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:36.530251  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.535355  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.538448  1707 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:36.498345  2658 raft_consensus.cc:2804] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:36.539659  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.524260  2680 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
W20260709 13:00:36.544157  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.545315  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.545677  2680 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:36.495914  2659 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:36.577116  1707 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:36.580385  2509 raft_consensus.cc:2804] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:36.539486  2671 raft_consensus.cc:2804] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:36.581009  2509 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:36.603919  2509 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:36.560770  2658 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:36.606818  2658 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:36.577029  2659 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:36.614838  2659 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:36.629132  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 52110.9us
I20260709 13:00:36.629913  1707 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:36.631371  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.595059  2565 raft_consensus.cc:2804] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:36.636250  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:36.630719  2676 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:00:36.638329  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.639581  2675 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.640265  2676 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:36.642192  2672 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.643843  2644 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.644186  2672 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:36.485379  2679 consensus_queue.cc:1048] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.148s
I20260709 13:00:36.601931  2671 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:36.645289  2671 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:36.645435  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:36.646962  1741 raft_consensus.cc:2393] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 2: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:36.647280  2675 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:36.649679  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:36.598766  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.644548  2659 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.675946  2349 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.681430  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:36.687668  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 187861us
I20260709 13:00:36.632942  2565 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:36.688880  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:36.689316  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:36.690672  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:36.691762  2349 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:36.697127  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.700536  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.688367  1556 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:36.702999  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.699316  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.704607  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.688884  2565 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:36.637316  2681 raft_consensus.cc:2804] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:36.710907  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.711951  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.712158  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.712445  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.713039  1741 raft_consensus.cc:2468] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:36.713421  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.710572  2681 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:36.713809  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.714586  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:36.714777  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.715274  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.714109  2681 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:36.715572  1739 raft_consensus.cc:2393] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 3: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:36.715999  1734 raft_consensus.cc:2393] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 3: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:36.716501  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:00:36.716682  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.720108  1738 raft_consensus.cc:1240] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:36.722193  1732 raft_consensus.cc:1240] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:36.722656  1738 raft_consensus.cc:1240] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:36.725026  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.726641  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.727388  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.727805  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.649791  2658 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.731616  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.732810  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.732952  2658 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:36.733438  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.735409  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.652186  2663 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:36.695016  2659 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:36.698506  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:36.744284  2693 raft_consensus.cc:2804] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:36.744755  2693 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:36.725095  2681 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.745103  2693 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:36.740427  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.742020  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:36.738351  2663 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:36.757979  2663 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:36.758244  2689 log.cc:927] Time spent T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:00:36.757597  1737 raft_consensus.cc:2393] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 2: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:36.728783  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:36.763572  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:36.770692  1592 raft_consensus.cc:1240] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:36.774752  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:00:36.779560  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 91253.1us
I20260709 13:00:36.780292  1556 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:36.780705  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:36.781136  1556 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:36.784286  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.784273  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:36.785506  1556 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:36.786494  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.769515  1587 raft_consensus.cc:2468] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:36.774438  2644 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:36.791275  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.791967  1556 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:36.793802  1738 raft_consensus.cc:1240] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:36.794962  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:36.795639  1591 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:36.797652  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.788245  2659 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:00:36.805867  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.786579  2691 raft_consensus.cc:2804] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:36.804768  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:36.807664  1588 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:36.808528  2681 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:36.809159  2553 raft_consensus.cc:1217] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 13:00:36.813475  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:36.814229  1587 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:36.793165  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:36.817570  1583 raft_consensus.cc:3060] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:36.820307  2509 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.820358  2663 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.789786  2690 raft_consensus.cc:2804] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:36.823451  2690 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:36.823868  2690 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:36.828280  1588 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:36.805585  2659 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:36.830054  2695 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:36.830384  2659 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:36.830673  2695 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.835669  2695 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:36.830054  1732 raft_consensus.cc:1240] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:36.824836  2644 raft_consensus.cc:2804] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:36.837999  2644 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:36.838434  2644 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:36.841140  2659 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.824698  2691 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:36.845398  1591 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:36.846853  2670 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.849051  1587 raft_consensus.cc:2468] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:36.850000  2659 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:36.834091  2696 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:36.860693  1590 raft_consensus.cc:1240] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:36.854808  2697 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:36.881733  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:36.882606  1584 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:36.881733  2697 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:00:36.889425  2697 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:36.893476  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:36.893638  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:36.902209  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.902881  2680 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.910166  2665 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.861536  2696 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.911336  2671 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.924849  1733 raft_consensus.cc:2393] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 2: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:36.927028  1734 raft_consensus.cc:1240] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 1. Current term is 2. Ops: []
W20260709 13:00:36.854697  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 53096us
I20260709 13:00:36.855522  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.857674  1583 raft_consensus.cc:2468] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:36.929478  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:36.860078  1736 raft_consensus.cc:1240] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:36.930581  1556 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:36.931586  2697 raft_consensus.cc:2804] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:36.860647  2670 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:36.932076  2697 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:36.852880  2691 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:36.932767  2697 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:36.869602  1590 raft_consensus.cc:1240] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:36.871878  2693 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.874259  1592 raft_consensus.cc:1240] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:36.879907  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:36.930507  1583 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:36.936416  1586 raft_consensus.cc:1240] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:36.851933  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.917459  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:36.918865  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:36.935770  1590 raft_consensus.cc:1240] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:36.936033  1585 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:36.853920  2663 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:36.945897  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.919454  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.913326  2680 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:36.931990  1556 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:36.938323  2693 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:36.935438  2509 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:36.917538  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:36.917794  2687 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.957923  1556 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:36.957988  2659 raft_consensus.cc:2804] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:36.958369  1591 raft_consensus.cc:1240] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:36.960489  2687 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:36.958915  2695 raft_consensus.cc:2804] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:36.961851  2695 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:36.963035  2695 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:36.962419  2659 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:36.926108  2565 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:36.959313  1556 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:36.967994  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.969278  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.921185  2696 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:36.913064  2665 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:36.974151  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.975775  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.965301  2659 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:36.979018  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.979210  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.969165  2670 raft_consensus.cc:2804] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:36.986903  1587 raft_consensus.cc:1240] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:36.981791  2670 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:36.983788  2664 consensus_queue.cc:1059] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:00:36.995738  2663 raft_consensus.cc:3055] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:36.996099  2663 raft_consensus.cc:740] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:36.995987  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:00:36.997107  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.000560  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.997176  1556 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:37.001803  1558 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:37.001911  2658 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:37.002058  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.999902  1707 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:37.002444  2658 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:37.005582  2658 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.005698  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:36.999454  1583 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:37.007136  2693 raft_consensus.cc:2804] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:37.007632  2693 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:37.008121  2693 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:36.996814  2670 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:37.008693  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:37.002460  1556 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:37.013227  2680 raft_consensus.cc:2804] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:37.013824  2680 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:37.014072  1556 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:37.014339  2680 raft_consensus.cc:3060] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.015105  1556 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:37.020855  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:37.027031  2690 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:37.030045  1589 raft_consensus.cc:1240] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:37.029781  2663 consensus_queue.cc:260] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:37.030606  2697 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:37.031648  2663 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.035039  2695 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } }
I20260709 13:00:37.036159  2671 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:37.037880  2697 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:37.038857  2697 raft_consensus.cc:2804] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:37.039381  2697 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:37.039918  2697 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.041985  1707 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:37.043052  1707 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:37.043988  1707 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:37.044132  2695 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:37.044975  2509 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:37.044979  2681 raft_consensus.cc:2804] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:37.045488  2674 raft_consensus.cc:2804] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:37.045883  2509 raft_consensus.cc:697] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:37.046346  2674 raft_consensus.cc:697] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:37.045917  2681 raft_consensus.cc:697] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
W20260709 13:00:37.048152  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.048031  2681 consensus_queue.cc:237] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:37.048328  2674 consensus_queue.cc:237] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:37.049566  2695 raft_consensus.cc:2804] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:37.050143  2695 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:37.050458  2565 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:37.050711  2695 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:37.051510  2565 raft_consensus.cc:2804] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:37.052201  2565 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:37.029827  1584 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:37.054064  2644 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:37.055770  1588 raft_consensus.cc:1240] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:37.057261  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:37.059158  2569 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:37.059387  2644 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:37.059980  2569 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:00:37.060979  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:37.063495  2569 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:37.047459  2509 consensus_queue.cc:237] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:37.065632  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:37.068295  1732 raft_consensus.cc:1240] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:37.072304  1585 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:37.063546  2690 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:37.052754  2565 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.091233  1739 raft_consensus.cc:1275] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:37.097934  2697 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:37.098667  1733 raft_consensus.cc:1240] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:37.113540  1705 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:37.116007  2679 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:37.116140  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:37.116824  2679 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:00:37.117479  2665 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:37.120050  2679 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:37.111654  2569 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:37.122109  2569 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:37.125226  1705 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:37.126435  2691 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:37.100507  2671 consensus_queue.cc:1059] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:00:37.130421  1705 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:37.131335  2665 raft_consensus.cc:2749] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:37.101027  2697 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:37.133836  2680 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:37.136531  2693 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:37.144002  2676 raft_consensus.cc:2749] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:37.146308  2680 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:37.146420  1705 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:37.137663  2695 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:37.148036  2693 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:37.148346  1705 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:37.150066  2695 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:37.151104  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 146760us
I20260709 13:00:37.153797  2664 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:37.154209  1732 raft_consensus.cc:1240] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:37.155437  2664 raft_consensus.cc:2749] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:37.162739  1705 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:00:37.136768  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 121727us
I20260709 13:00:37.129796  2569 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:37.138168  2691 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:37.142800  2671 raft_consensus.cc:3055] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:37.107685  2658 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:37.163694  1556 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:37.164093  1705 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:37.169230  2670 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:37.184124  2671 raft_consensus.cc:740] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:37.188092  2670 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:37.187793  2671 consensus_queue.cc:260] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:37.175782  1633 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:37.173736  2680 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:37.189587  2672 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:37.185793  2659 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:37.193157  1558 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:37.194180  2698 raft_consensus.cc:2764] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:00:37.196107  1558 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:37.196816  1556 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:37.186391  2658 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:37.189360  2671 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.192636  2659 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:37.201345  2690 raft_consensus.cc:2804] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:37.201928  2690 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:37.200121  1705 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:37.202423  2690 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:37.202937  2672 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:37.204738  1705 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:37.205399  2695 raft_consensus.cc:2764] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:00:37.206764  2693 raft_consensus.cc:2804] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:37.206950  1556 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:37.207268  2693 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:37.207784  2693 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:37.208767  2672 raft_consensus.cc:2749] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:37.209295  2697 raft_consensus.cc:2804] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:37.208657  1556 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:37.209812  2697 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:37.210323  2697 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:37.211155  1558 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:37.213819  2698 raft_consensus.cc:2804] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:37.214308  2698 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:37.214789  2698 raft_consensus.cc:3060] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.218693  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:37.222182  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:37.223217  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:37.224980  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:37.213279  1705 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:37.228006  1705 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:37.224795  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:37.229067  1705 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:37.236539  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:37.238032  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:37.238328  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:37.238545  2664 raft_consensus.cc:2749] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:37.238567  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:37.239560  2664 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:37.239667  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:37.240106  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:37.240443  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:37.241441  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:37.241732  2699 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:37.242070  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:37.242703  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:37.243259  2687 raft_consensus.cc:1064] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91: attempting to promote NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 to VOTER
I20260709 13:00:37.243862  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:37.242198  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:00:37.245406  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.246387  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:37.246611  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:37.242215  2699 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:37.248389  2699 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.237908  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:37.241521  1558 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:37.241499  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:37.240916  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:37.245043  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:37.243719  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:37.184027  2565 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:37.257360  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 81649.6us
I20260709 13:00:37.258445  1558 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
W20260709 13:00:37.259003  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.260761  2681 raft_consensus.cc:2749] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:37.260994  2679 raft_consensus.cc:2804] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:37.261590  2679 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:37.262089  2679 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.258193  1633 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:37.238369  2695 raft_consensus.cc:1064] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91: attempting to promote NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 to VOTER
I20260709 13:00:37.267577  1705 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:37.266186  1633 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:37.269124  1705 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:37.275272  2664 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:37.264102  2659 raft_consensus.cc:2764] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:00:37.268591  2700 raft_consensus.cc:2804] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:37.270876  2569 raft_consensus.cc:2804] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:00:37.319773  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 50752us
I20260709 13:00:37.271721  2681 raft_consensus.cc:2749] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:37.325873  1705 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:37.348130  1705 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:37.349179  2676 raft_consensus.cc:2749] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:37.349291  1705 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:37.351055  2663 raft_consensus.cc:2749] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:37.350548  1705 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:00:37.352407  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 91917.3us
I20260709 13:00:37.353775  1705 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:37.323992  2700 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:37.329754  2569 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:37.360404  1705 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:00:37.361647  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 95526.7us
I20260709 13:00:37.362692  1705 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:37.360394  2680 raft_consensus.cc:2749] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:37.363489  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.361433  2676 raft_consensus.cc:2749] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:37.364874  2569 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.365181  2509 raft_consensus.cc:2749] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:37.366132  2509 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:37.366765  1558 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:37.370055  1705 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:37.371658  2676 raft_consensus.cc:2749] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:37.371217  2687 consensus_queue.cc:237] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:37.337872  2674 raft_consensus.cc:2749] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:37.363130  1633 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:37.373965  1705 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:37.376899  2676 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:37.376816  2565 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:37.384330  1633 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:37.362632  2700 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:37.394830  2565 raft_consensus.cc:2749] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:37.401950  1488 catalog_manager.cc:5697] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 2 to 3, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 3 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:37.403936  1488 catalog_manager.cc:5697] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 2 to 3, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 3 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:37.405711  1488 catalog_manager.cc:5697] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 2 to 3, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 3 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:37.408252  2690 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:37.413390  2699 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:37.386772  2709 raft_consensus.cc:2804] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:37.441250  2693 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:37.440008  2709 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:37.455389  2709 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:37.459774  1588 raft_consensus.cc:1240] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:37.465603  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:37.467026  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:37.467656  1586 raft_consensus.cc:1240] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:37.467238  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:37.468943  1584 raft_consensus.cc:1240] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:37.469236  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:37.470290  1589 raft_consensus.cc:1240] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:37.475893  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:37.477031  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:37.478554  1586 raft_consensus.cc:1240] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:37.478248  2697 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:37.477398  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:37.479827  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:37.477907  1590 raft_consensus.cc:1240] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:37.481510  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:37.481678  2697 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:37.483347  2699 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:37.483942  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:37.424304  2695 consensus_queue.cc:237] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:37.486691  1592 raft_consensus.cc:1240] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:37.488080  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:37.489913  1589 raft_consensus.cc:1240] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:37.490602  2710 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:37.490742  1584 raft_consensus.cc:1240] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:37.491220  2710 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:37.491842  2710 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.492388  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:37.493525  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:37.496392  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:37.469013  1587 raft_consensus.cc:2393] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 3: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:37.498315  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:37.498885  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:37.505781  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:37.506275  2690 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:37.506278  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:37.508468  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:37.510582  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:37.510701  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:37.511916  1588 raft_consensus.cc:2393] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 2: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:37.513953  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:37.514047  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:37.515861  1584 raft_consensus.cc:1240] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:37.516145  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:37.519618  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:37.521417  1589 raft_consensus.cc:1275] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:37.524734  2569 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:37.528317  2569 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:37.535054  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:37.540944  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:37.542429  2693 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:37.545565  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:37.550375  2698 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:37.562719  2679 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:37.570561  2569 raft_consensus.cc:2804] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:37.571455  2569 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:37.589322  2569 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:37.624846  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 258133us
I20260709 13:00:37.627997  1558 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:37.637636  1558 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:37.643680  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:37.644534  1558 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:37.647598  1558 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:37.648249  2697 raft_consensus.cc:2749] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:37.650466  2677 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:37.594921  2700 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:37.643596  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:37.644130  2699 raft_consensus.cc:2749] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:37.657825  2679 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:37.658481  2698 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:37.641700  2711 raft_consensus.cc:2804] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:37.668709  2710 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:37.681979  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:37.682300  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 298046us
I20260709 13:00:37.683508  1558 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:37.694674  1633 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:37.683898  2644 raft_consensus.cc:2749] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:37.649380  2709 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:37.687680  2711 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:37.703290  1558 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:37.704460  1558 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:37.705039  2712 raft_consensus.cc:2749] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:37.705274  2716 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:37.704550  2553 raft_consensus.cc:1275] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 3 LEARNER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:00:37.707751  1558 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:37.708779  2670 raft_consensus.cc:2749] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:37.709484  2670 consensus_queue.cc:1048] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:37.710753  1558 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:37.713944  2553 raft_consensus.cc:1275] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 1 LEARNER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:37.715873  2670 consensus_queue.cc:1048] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:37.698258  2679 raft_consensus.cc:2749] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:37.719066  1633 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:37.720386  2679 raft_consensus.cc:2749] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:37.723671  2710 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:37.724525  1558 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:37.699412  2697 raft_consensus.cc:2749] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:37.726284  1665 raft_consensus.cc:1275] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:37.687484  2677 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:37.727243  1659 raft_consensus.cc:1275] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:00:37.727654  1633 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:37.728526  2712 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.728662  2677 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:37.729812  2693 raft_consensus.cc:2749] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:37.731395  2700 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:37.731894  2697 consensus_queue.cc:1048] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:37.693677  2713 consensus_queue.cc:1059] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:00:37.718171  2711 raft_consensus.cc:3060] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.732764  2710 raft_consensus.cc:2749] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:37.734413  1558 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:37.703033  2709 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:37.736374  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:00:37.738125  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.739027  2677 consensus_queue.cc:1059] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:00:37.742026  2693 raft_consensus.cc:2749] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:37.742522  1558 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:37.745428  2670 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:37.743580  2677 raft_consensus.cc:3055] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:37.746793  1558 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:37.737262  2708 consensus_queue.cc:1048] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:00:37.751541  2715 raft_consensus.cc:3055] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:37.751973  2715 raft_consensus.cc:740] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:37.757556  2679 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:37.758103  2679 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:37.760133  2679 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:37.763625  2711 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:37.768464  1707 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:37.770445  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:37.776373  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:37.777015  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:37.779600  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:37.782721  1589 raft_consensus.cc:1240] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:37.782652  2569 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:37.782742  1736 raft_consensus.cc:2393] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 2: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:37.785816  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:37.785449  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:37.787124  2569 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:37.748597  2677 raft_consensus.cc:740] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:37.788187  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:37.789073  1587 raft_consensus.cc:2393] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 2: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:37.788198  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:37.791057  1589 raft_consensus.cc:2393] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 2: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:37.793382  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:37.785434  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:37.796221  1589 raft_consensus.cc:1240] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:37.796548  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:37.797817  2710 consensus_queue.cc:1059] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:37.798993  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:37.799084  1587 raft_consensus.cc:1240] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:37.797986  2717 consensus_queue.cc:1059] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:00:37.802807  1590 raft_consensus.cc:1240] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:37.803365  1586 raft_consensus.cc:1240] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:37.805645  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:37.803588  1591 raft_consensus.cc:1240] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:37.807766  1591 raft_consensus.cc:1240] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:37.808907  1591 raft_consensus.cc:1275] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:37.809585  1586 raft_consensus.cc:1275] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:37.766938  2708 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:37.803880  1589 raft_consensus.cc:1240] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:37.810603  1590 raft_consensus.cc:1275] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:37.804257  1592 raft_consensus.cc:1240] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:37.802838  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:37.812256  2569 consensus_queue.cc:1048] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:37.812500  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:37.820741  1558 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:37.823915  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:37.818226  1741 raft_consensus.cc:2393] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 2: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:37.825744  1558 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:37.830073  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:37.831895  1558 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:37.754043  2704 consensus_queue.cc:1059] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.112s
I20260709 13:00:37.832866  2677 consensus_queue.cc:260] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:37.833544  2644 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:37.834161  2677 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:37.834903  1558 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:37.836095  1558 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:37.836985  1558 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:37.837721  2700 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:37.811589  2674 raft_consensus.cc:2804] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:37.841571  2674 raft_consensus.cc:697] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:37.843945  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:37.846091  1558 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:37.856360  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:37.859177  1558 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:37.862957  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:37.809926  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:37.863862  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:37.806492  2713 consensus_queue.cc:1059] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:00:37.804401  2679 consensus_queue.cc:1059] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:00:37.870270  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:00:37.864691  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 64040.4us
I20260709 13:00:37.831419  2690 raft_consensus.cc:2749] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:37.836032  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:37.835355  2695 raft_consensus.cc:2749] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:37.858338  1583 raft_consensus.cc:1240] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:37.873216  1741 raft_consensus.cc:1275] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:00:37.873766  1736 raft_consensus.cc:1275] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:37.844841  2644 raft_consensus.cc:2749] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:37.881240  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:37.842550  2674 consensus_queue.cc:237] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:00:37.881994  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:37.866695  2699 raft_consensus.cc:2749] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:37.869747  2700 raft_consensus.cc:2749] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:37.836340  2671 consensus_queue.cc:1059] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:00:37.869673  1585 raft_consensus.cc:1240] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:37.885533  2569 raft_consensus.cc:3055] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:37.898685  2569 raft_consensus.cc:740] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:37.850492  2720 consensus_queue.cc:1059] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:00:37.900945  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:37.887884  1558 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:00:37.878710  2724 log.cc:927] Time spent T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:00:37.906844  1584 raft_consensus.cc:1240] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:37.862843  2672 consensus_queue.cc:1059] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:00:37.909373  1558 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:37.891580  2687 raft_consensus.cc:2749] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:37.916777  2717 raft_consensus.cc:3055] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:37.920728  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:37.943094  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:37.943593  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:37.921175  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:37.945199  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:37.945963  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:37.947199  1659 raft_consensus.cc:1240] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:37.921623  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:37.922825  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:37.905362  2711 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:37.925766  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:37.954478  1591 raft_consensus.cc:2393] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 2: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:37.955312  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:37.926707  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:37.925806  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:37.928314  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:37.928846  1592 raft_consensus.cc:1240] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:37.929668  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:37.930254  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:37.926728  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:37.932495  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:37.875922  2694 consensus_queue.cc:1059] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:00:37.975056  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:37.877954  2509 consensus_queue.cc:1059] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:00:37.915802  2713 consensus_queue.cc:1059] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:00:37.934002  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:37.991365  2509 raft_consensus.cc:3055] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:37.991523  2713 raft_consensus.cc:3055] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:37.991912  2509 raft_consensus.cc:740] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:37.992046  2713 raft_consensus.cc:740] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:37.934646  2725 raft_consensus.cc:3055] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:37.993405  2725 raft_consensus.cc:740] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:37.995253  1633 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:37.994858  2725 consensus_queue.cc:260] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:37.996212  2725 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.935846  2663 raft_consensus.cc:3055] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:37.911041  1740 raft_consensus.cc:1240] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:37.936932  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:37.937321  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:38.004487  1586 raft_consensus.cc:2393] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 2: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:37.899478  2569 consensus_queue.cc:260] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:37.823227  2715 consensus_queue.cc:260] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:37.938375  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:37.874114  2676 consensus_queue.cc:1059] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:00:38.009470  1590 raft_consensus.cc:2393] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 2: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:38.010797  2699 raft_consensus.cc:2955] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:00:37.940374  1558 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:00:37.940754  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 72028.8us
I20260709 13:00:37.941120  2710 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:37.941594  2708 raft_consensus.cc:2749] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:37.950495  1666 raft_consensus.cc:1240] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:38.018694  1666 raft_consensus.cc:1275] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:37.951270  1663 raft_consensus.cc:1240] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:37.936924  2695 raft_consensus.cc:2749] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:37.923175  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:37.952474  1659 raft_consensus.cc:1240] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:38.021414  1732 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 1.
I20260709 13:00:38.022836  2569 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.953676  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:37.974511  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:37.956918  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:37.932504  2709 raft_consensus.cc:3055] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:38.025372  2709 raft_consensus.cc:740] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:38.026314  2709 consensus_queue.cc:260] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:38.027380  2709 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.956549  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:38.028766  2715 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:37.977710  1589 raft_consensus.cc:2393] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 4: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:37.979640  2704 raft_consensus.cc:3055] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:37.940258  2717 raft_consensus.cc:740] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:38.031193  2704 raft_consensus.cc:740] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:37.980679  2671 raft_consensus.cc:3055] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:38.032462  2671 raft_consensus.cc:740] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:38.032311  2717 consensus_queue.cc:260] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:37.987921  2712 raft_consensus.cc:2749] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:37.988943  2694 raft_consensus.cc:3055] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:38.033486  2671 consensus_queue.cc:260] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:38.033913  2717 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:38.034062  2694 raft_consensus.cc:740] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
W20260709 13:00:37.950452  2721 log.cc:927] Time spent T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da: Append to log took a long time: real 0.184s	user 0.000s	sys 0.002s
I20260709 13:00:38.003664  2663 raft_consensus.cc:740] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:37.997936  1633 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:37.936056  2679 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:38.007169  2728 raft_consensus.cc:2749] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:38.008457  2677 raft_consensus.cc:3055] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:38.040963  2677 raft_consensus.cc:740] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:38.013447  2713 consensus_queue.cc:260] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:38.041638  2676 raft_consensus.cc:3055] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:38.042008  2676 raft_consensus.cc:740] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:38.042447  2713 raft_consensus.cc:3060] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.992885  2509 consensus_queue.cc:260] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:38.022934  1659 raft_consensus.cc:1240] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:37.974558  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:38.015635  1707 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:38.034698  2671 raft_consensus.cc:3060] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:38.005172  2720 consensus_queue.cc:1059] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:00:38.039422  1633 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:38.049474  1633 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:38.052086  2509 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:38.032300  2704 consensus_queue.cc:260] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:38.054216  2704 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:38.039522  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 99260.3us
I20260709 13:00:38.039105  2663 consensus_queue.cc:260] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:38.047322  2726 consensus_queue.cc:1175] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7e839e91a1314c2f9a99b25b17c916a6" responder_term: 1 status { last_received { term: 1 index: 3 } last_committed_idx: 2 last_received_current_leader { term: 1 index: 3 } }
I20260709 13:00:38.059031  1558 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:38.016652  2710 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:38.065114  1558 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:38.070540  2509 consensus_queue.cc:1059] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:38.070765  1707 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:38.066036  2569 consensus_queue.cc:1059] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:38.040278  2708 raft_consensus.cc:2749] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:38.076011  2509 raft_consensus.cc:3055] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:38.075946  1558 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:38.076472  2509 raft_consensus.cc:740] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:38.079926  1633 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:38.080905  2509 consensus_queue.cc:260] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:38.082722  1558 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:38.083698  1707 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:38.083384  2509 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:38.072168  2720 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:38.071951  2728 raft_consensus.cc:2749] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:38.070330  2687 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:38.100441  1558 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:38.045524  2679 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:38.042843  2676 consensus_queue.cc:260] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:38.079082  2695 raft_consensus.cc:2749] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:38.107259  2509 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:38.081226  2672 raft_consensus.cc:2804] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:38.074100  2680 consensus_queue.cc:1059] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:00:38.125537  2509 raft_consensus.cc:697] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:38.086401  2697 raft_consensus.cc:2749] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:38.128336  2509 consensus_queue.cc:237] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:38.107384  2663 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:38.133929  1558 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:38.123754  2670 raft_consensus.cc:2749] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:38.103674  2691 raft_consensus.cc:2749] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:00:38.147008  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.130476  2728 raft_consensus.cc:3055] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:38.085753  2694 consensus_queue.cc:260] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:38.173827  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.140300  2720 raft_consensus.cc:2749] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:38.173650  2729 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:38.145216  2676 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:38.183784  2731 log.cc:927] Time spent T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:00:38.086879  2674 consensus_queue.cc:1059] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:00:38.157819  2644 raft_consensus.cc:2749] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:38.158588  2728 raft_consensus.cc:740] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
W20260709 13:00:38.225876  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.172235  2710 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:38.160943  1558 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:38.174674  2679 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:38.198824  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.162573  1667 raft_consensus.cc:2955] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:00:38.205691  1660 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:38.219437  2694 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:38.179071  2727 raft_consensus.cc:2804] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:38.179695  2677 consensus_queue.cc:260] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:38.231721  2565 raft_consensus.cc:2749] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:38.241537  1663 raft_consensus.cc:1275] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:00:38.245428  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.258481  2677 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:38.231230  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 70403.1us
I20260709 13:00:38.257542  2727 raft_consensus.cc:697] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:38.298372  1558 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:38.306867  1558 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:38.308885  1558 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:00:38.329108  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.315315  2695 raft_consensus.cc:2749] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:38.315587  2712 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:38.309449  2644 consensus_queue.cc:1048] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:00:38.316717  2711 consensus_queue.cc:1048] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:00:38.361403  1489 catalog_manager.cc:5697] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: config changed from index 3 to 4, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:00:38.293408  2728 consensus_queue.cc:260] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:38.353334  2693 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:00:38.369971  1705 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.518s (SENT) [suppressed 3 similar messages]
I20260709 13:00:38.373842  2672 raft_consensus.cc:697] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:38.380517  2728 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:38.408231  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 325862us
W20260709 13:00:38.409781  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.404222  2672 consensus_queue.cc:237] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:38.379832  2727 consensus_queue.cc:237] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:38.437937  1658 raft_consensus.cc:1275] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:00:38.441884  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 133092us
W20260709 13:00:38.453354  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.461738  1558 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:00:38.457398  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 377646us
I20260709 13:00:38.473766  2741 consensus_queue.cc:1059] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:00:38.475641  1558 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:38.476815  2697 raft_consensus.cc:2749] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:38.478686  2739 consensus_queue.cc:1059] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:00:38.482776  2712 raft_consensus.cc:2749] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:38.487893  1633 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:38.489163  1633 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:38.490288  2663 raft_consensus.cc:3055] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:38.482859  2553 raft_consensus.cc:2955] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:00:38.496654  2663 raft_consensus.cc:740] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:38.501956  2737 consensus_queue.cc:1059] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:00:38.506670  1633 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:00:38.507638  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.495782  2715 raft_consensus.cc:2749] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:38.497781  2709 raft_consensus.cc:2749] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:38.494150  2674 consensus_queue.cc:1059] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:00:38.497609  2663 consensus_queue.cc:260] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:38.535085  1633 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:38.528054  2509 consensus_queue.cc:1059] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:38.508632  2717 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:38.550237  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.588397  1633 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:00:38.591053  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.531720  2741 consensus_queue.cc:1048] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:00:38.559742  2680 raft_consensus.cc:3055] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:38.595947  1633 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:38.559521  2677 raft_consensus.cc:2749] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:38.559259  2694 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.599211  1633 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:38.601043  1633 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:38.589596  2663 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:38.611284  2742 consensus_queue.cc:1059] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.081s
I20260709 13:00:38.597034  2676 raft_consensus.cc:3055] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:00:38.605504  2721 log.cc:927] Time spent T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da: Append to log took a long time: real 0.050s	user 0.003s	sys 0.008s
I20260709 13:00:38.596244  2717 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:38.599303  2674 raft_consensus.cc:3055] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:38.608739  2709 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:38.629750  2670 raft_consensus.cc:2955] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:00:38.631951  2671 raft_consensus.cc:3055] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:38.632565  2671 raft_consensus.cc:740] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:38.637059  1488 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55154 (request call id 163) took 1272 ms. Trace:
I20260709 13:00:38.613101  2676 raft_consensus.cc:740] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:38.638360  2676 consensus_queue.cc:260] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:38.598305  2680 raft_consensus.cc:740] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
W20260709 13:00:38.640110  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 270163us
I20260709 13:00:38.652944  2676 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:38.646001  1667 raft_consensus.cc:2955] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
W20260709 13:00:38.656497  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:38.660379  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 59437.5us
W20260709 13:00:38.657251  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 183999us
I20260709 13:00:38.672221  1633 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:00:38.681190  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.640204  2674 raft_consensus.cc:740] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:38.685262  1633 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:38.683377  2726 raft_consensus.cc:2749] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:38.608227  2694 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:38.687332  1633 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:38.666787  2709 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:38.692989  1633 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:38.696445  1633 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:00:38.706707  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.693145  2717 raft_consensus.cc:2749] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:38.710361  2750 consensus_queue.cc:1048] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:00:38.682569  2742 consensus_queue.cc:1059] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:00:38.700654  2677 raft_consensus.cc:2749] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:38.702988  2715 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:38.707840  1633 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:38.711115  1664 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:38.637537  1488 rpcz_store.cc:276] 0709 13:00:37.364600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.369213 (+  4613us) service_pool.cc:224] Handling call
0709 13:00:37.391702 (+ 22489us) spinlock_profiling.cc:243] Waited 3.8 ms on lock 0x7b5400119254. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef9090 00007f1b80f97f3a 00007f1b86d4e1cc 00007f1b86e4c37e 00007f1b8530d2a4 00007f1b8530d232 00007f1b8530d161 00007f1b8530d0dc 00007f1b8530c392 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:00:38.636932 (+1245230us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:37.704163 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:37.704700 (+   537us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:37.704737 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:00:37.704754 (+    17us) tablet.cc:662] Decoding operations
0709 13:00:37.705309 (+   555us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:37.705398 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:37.705438 (+    40us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:00:37.705798 (+   360us) tablet.cc:701] Row locks acquired
0709 13:00:37.705820 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:00:37.705944 (+   124us) write_op.cc:270] Start()
0709 13:00:37.706050 (+   106us) write_op.cc:276] Timestamp: P: 1783602037705908 usec, L: 0
0709 13:00:37.706071 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:00:37.707531 (+  1460us) log.cc:844] Serialized 1316 byte log entry
0709 13:00:37.789715 (+ 82184us) spinlock_profiling.cc:243] Waited 889 us on lock 0x7b5400119254. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8ae28 00007f1b849c5581 00007f1b849c4d58 00007f1b849c99f1 00007f1b849c99a9 00007f1b849c9939 00007f1b849c9901 00007f1b849c8b2d 000000000038f354 000000000038f199
0709 13:00:38.127927 (+338212us) op_driver.cc:464] REPLICATION: finished
0709 13:00:38.420028 (+292101us) write_op.cc:301] APPLY: starting
0709 13:00:38.421848 (+  1820us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:38.429546 (+  7698us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:38.439434 (+  9888us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:38.490630 (+ 51196us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:38.502524 (+ 11894us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:00:38.503768 (+  1244us) write_op.cc:312] APPLY: finished
0709 13:00:38.531316 (+ 27548us) log.cc:844] Serialized 34 byte log entry
0709 13:00:38.546783 (+ 15467us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:38.555739 (+  8956us) write_op.cc:454] Released schema lock
0709 13:00:38.560197 (+  4458us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:38.613424 (+ 53227us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:38.616707 (+  3283us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"spinlock_wait_cycles":8736512,"child_traces":[["op",{"apply.queue_time_us":288157,"apply.run_cpu_time_us":3394,"apply.run_wall_time_us":175516,"num_ops":3,"prepare.queue_time_us":290375,"prepare.run_cpu_time_us":20348,"prepare.run_wall_time_us":85716,"raft.queue_time_us":88568,"raft.run_cpu_time_us":43126,"raft.run_wall_time_us":193648,"replication_time_us":421714,"spinlock_wait_cycles":2044800,"thread_start_us":537255,"threads_started":4,"wal-append.queue_time_us":58727}]]}
I20260709 13:00:38.725687  1633 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:38.711149  2726 raft_consensus.cc:2749] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:38.710518  2751 consensus_queue.cc:1048] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:38.736528  2735 raft_consensus.cc:3055] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:38.737136  2735 raft_consensus.cc:740] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:38.738080  2735 consensus_queue.cc:260] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:38.739331  2735 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:38.742221  2740 raft_consensus.cc:2749] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:38.742660  2552 raft_consensus.cc:2955] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:00:38.711282  2671 consensus_queue.cc:260] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:38.743777  2694 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:38.750433  1633 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:38.752511  2509 raft_consensus.cc:3055] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:38.752909  2509 raft_consensus.cc:740] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:38.712126  2727 consensus_queue.cc:1059] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:00:38.727783  2717 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:38.754989  1633 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:00:38.732304  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 48386.2us
I20260709 13:00:38.722157  2737 consensus_queue.cc:1059] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:00:38.764104  1633 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:38.753356  2671 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:38.768419  2509 consensus_queue.cc:260] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:38.755489  2742 raft_consensus.cc:3055] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:38.758414  2726 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:38.754285  2677 raft_consensus.cc:2749] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:38.777904  2509 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:38.783001  2737 raft_consensus.cc:3055] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:38.783545  2737 raft_consensus.cc:740] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:38.784459  2737 consensus_queue.cc:260] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:38.785796  2737 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:38.764647  2715 raft_consensus.cc:2749] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:38.722388  2674 consensus_queue.cc:260] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:38.752154  2752 consensus_queue.cc:1059] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:00:38.718581  2680 consensus_queue.cc:260] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:38.811988  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:38.812582  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:38.812930  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:38.813465  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.815809  1585 raft_consensus.cc:1275] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:38.816164  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:38.816745  1588 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:38.817247  1590 raft_consensus.cc:1240] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:38.820590  1589 raft_consensus.cc:1240] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:38.774427  2742 raft_consensus.cc:740] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:38.790525  2717 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:38.827127  2680 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:38.818898  2674 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:38.818125  1584 raft_consensus.cc:1275] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:38.827374  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:38.845386  2727 raft_consensus.cc:3055] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:38.845813  2727 raft_consensus.cc:740] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
W20260709 13:00:38.847049  2756 log.cc:927] Time spent T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:00:38.846614  2727 consensus_queue.cc:260] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:38.847887  2727 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:38.849773  2749 raft_consensus.cc:3055] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:38.819517  2751 consensus_queue.cc:1059] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
W20260709 13:00:38.844890  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.852581  1707 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:00:38.857286  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.850337  2749 raft_consensus.cc:740] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
W20260709 13:00:38.859061  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 95063.4us
I20260709 13:00:38.861327  1633 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:38.823312  2758 consensus_queue.cc:1059] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:00:38.862339  2717 raft_consensus.cc:2749] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:38.871176  1705 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:38.854194  2663 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:38.873381  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.875331  1589 raft_consensus.cc:1240] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:38.877871  2761 consensus_queue.cc:1059] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:00:38.881855  1734 raft_consensus.cc:1240] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:38.882154  2761 raft_consensus.cc:3055] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:38.882576  2761 raft_consensus.cc:740] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:38.885784  1734 raft_consensus.cc:1240] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 1. Current term is 2. Ops: []
W20260709 13:00:38.886365  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.896251  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:38.872927  1732 raft_consensus.cc:2393] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 2: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:38.903831  1589 raft_consensus.cc:2393] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 2: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:38.910601  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:38.915884  1735 raft_consensus.cc:2468] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:00:38.911855  1633 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:00:38.919132  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 66621.5us
W20260709 13:00:38.920291  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 49199.6us
I20260709 13:00:38.921234  1734 raft_consensus.cc:1240] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:38.924571  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:38.905174  2758 raft_consensus.cc:3055] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:38.868124  2728 consensus_queue.cc:1048] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
W20260709 13:00:38.941833  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.892333  2663 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:38.948186  2663 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:38.950085  1633 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:38.951247  2740 raft_consensus.cc:2749] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:38.951571  1633 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:38.952092  2740 raft_consensus.cc:2749] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:38.953155  1633 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:38.954103  2715 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:38.954253  1633 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:38.955265  2715 raft_consensus.cc:2749] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:38.955583  1633 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:38.956454  2717 raft_consensus.cc:2749] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:38.957828  1633 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:38.952764  2740 raft_consensus.cc:2749] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:38.958642  2717 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:38.959909  1633 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:38.960136  1558 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:38.960608  2717 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:38.962496  1633 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:38.900738  2704 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.922756  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:38.933552  2749 consensus_queue.cc:260] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:38.862599  2760 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:38.864600  2752 consensus_queue.cc:1048] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:00:38.926357  2737 raft_consensus.cc:2749] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:38.926759  2750 raft_consensus.cc:2804] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:38.930056  1705 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:00:38.980348  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 50416.1us
I20260709 13:00:38.970871  2663 consensus_queue.cc:1059] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:00:38.984540  1584 raft_consensus.cc:2393] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 2: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:38.935701  2758 raft_consensus.cc:740] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:38.985827  2760 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:38.965866  1633 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:38.960963  2761 consensus_queue.cc:260] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:38.870956  2742 consensus_queue.cc:260] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:38.974221  2711 raft_consensus.cc:2749] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:00:38.977828  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.998062  2765 raft_consensus.cc:2804] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:38.972055  2677 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:39.001914  2509 consensus_queue.cc:1059] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:39.004359  1589 raft_consensus.cc:1240] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:39.005600  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:39.008210  1588 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:38.986825  2739 raft_consensus.cc:2749] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:38.987030  2750 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.014389  2509 raft_consensus.cc:3055] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:39.015321  2509 raft_consensus.cc:740] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:39.010097  1633 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:39.021751  2509 consensus_queue.cc:260] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:39.022274  1707 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:39.023061  2509 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:38.977764  2704 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:39.031225  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:39.032644  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:39.034054  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:39.035104  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:39.029733  1664 raft_consensus.cc:1275] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 13:00:39.033205  1660 raft_consensus.cc:2376] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2. Re-sending same reply.
I20260709 13:00:39.011133  2749 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:38.990496  2671 consensus_queue.cc:1048] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:00:39.025180  2765 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:39.046072  2765 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:39.018178  2750 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:39.020864  2740 raft_consensus.cc:2804] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:39.037925  2751 raft_consensus.cc:2804] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:39.036643  1664 pending_rounds.cc:85] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 2
I20260709 13:00:39.044997  2761 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:39.031185  2663 consensus_queue.cc:1059] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:00:39.071691  1664 pending_rounds.cc:107] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:00:39.057544  2740 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:39.055226  1740 raft_consensus.cc:2955] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:00:39.062762  2751 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.090503  2737 consensus_queue.cc:1059] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:00:39.093222  1664 raft_consensus.cc:2917] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:00:39.059815  2715 raft_consensus.cc:2955] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:00:39.092129  2663 raft_consensus.cc:3055] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:39.124312  1664 raft_consensus.cc:2889] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:39.090323  2672 raft_consensus.cc:3055] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:39.098783  2740 raft_consensus.cc:3060] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:39.098099  1584 raft_consensus.cc:1275] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:39.102169  2751 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:39.062244  2758 consensus_queue.cc:260] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:39.124835  2663 raft_consensus.cc:740] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:39.147905  2760 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:39.149253  1737 raft_consensus.cc:2955] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:00:39.144842  2672 raft_consensus.cc:740] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:39.152073  2704 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:39.168236  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 86986.1us
I20260709 13:00:39.169909  2671 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.168532  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:39.178615  2671 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:39.183362  2671 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:39.190768  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:39.169679  1667 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:39.200171  1663 raft_consensus.cc:1275] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:39.168885  2759 raft_consensus.cc:3055] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:39.195356  2704 consensus_queue.cc:1059] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:00:39.221869  2704 raft_consensus.cc:3055] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:39.222422  2704 raft_consensus.cc:740] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:39.168968  2663 consensus_queue.cc:260] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:39.172115  2676 consensus_queue.cc:1048] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:00:39.219035  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:39.240054  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:39.231961  2758 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:39.248083  2735 consensus_meta.cc:287] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.508s	user 0.012s	sys 0.000s
I20260709 13:00:39.249198  1584 raft_consensus.cc:1240] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:39.185932  2672 consensus_queue.cc:260] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:39.259660  1666 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:39.232434  2759 raft_consensus.cc:740] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:39.256855  1633 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:00:39.260385  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 55951.5us
I20260709 13:00:39.260510  1585 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:00:39.264019  2717 raft_consensus.cc:2749] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:39.271782  2712 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.272687  2704 consensus_queue.cc:260] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:39.300457  2704 raft_consensus.cc:3060] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:39.273600  2746 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:39.270884  2671 consensus_queue.cc:1048] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:00:39.319105  2760 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:39.319659  2760 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:39.321941  2677 raft_consensus.cc:2749] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:39.322625  2760 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:39.332087  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:39.339567  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 76096.2us
I20260709 13:00:39.349493  2739 consensus_queue.cc:1048] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:39.303994  2712 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:39.368078  1705 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:39.307121  2759 consensus_queue.cc:260] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:39.316463  2746 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:39.367666  2677 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:39.378465  2680 consensus_meta.cc:287] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.538s	user 0.010s	sys 0.003s
I20260709 13:00:39.374146  2552 raft_consensus.cc:3060] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:39.389475  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:39.392189  1663 raft_consensus.cc:2376] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2. Re-sending same reply.
I20260709 13:00:39.382573  1707 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:00:39.394661  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.354013  2760 consensus_queue.cc:1048] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:00:39.352732  2765 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:39.402319  1663 raft_consensus.cc:1275] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:39.395787  1667 raft_consensus.cc:1275] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:39.403119  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:39.404991  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:39.407966  1705 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:39.410490  1736 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
W20260709 13:00:39.402379  2709 consensus_meta.cc:287] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.700s	user 0.010s	sys 0.003s
I20260709 13:00:39.424064  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:39.399487  2727 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:39.420337  2778 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.417258  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:39.391844  2677 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:39.386746  2776 consensus_queue.cc:1048] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
W20260709 13:00:39.448386  2674 consensus_meta.cc:287] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.607s	user 0.004s	sys 0.009s
I20260709 13:00:39.448707  2752 raft_consensus.cc:3055] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:39.449070  2752 raft_consensus.cc:740] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:39.429970  2709 raft_consensus.cc:2749] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:39.431561  2759 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:39.453948  1664 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:39.457795  2783 raft_consensus.cc:2804] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:39.452214  2780 raft_consensus.cc:2804] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:39.457299  2727 raft_consensus.cc:697] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:39.481873  1664 raft_consensus.cc:1240] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:39.482586  2553 raft_consensus.cc:2955] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:00:39.504078  2697 consensus_queue.cc:1059] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:00:39.498641  2716 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.518008  2690 raft_consensus.cc:3055] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:39.518455  2690 raft_consensus.cc:740] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:39.500769  2709 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:39.505606  2695 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.450040  2752 consensus_queue.cc:260] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } }
I20260709 13:00:39.444407  2777 consensus_queue.cc:1048] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:00:39.479869  2780 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.451535  2778 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:39.542201  2784 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:39.508427  2670 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.475281  2728 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.518415  2716 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:39.548166  2728 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:00:39.552356  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:39.553135  1738 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:39.553208  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:39.554020  1658 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:39.522933  2677 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:39.527915  2758 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.557329  1558 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:00:39.564780  2768 log.cc:927] Time spent T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.209s	user 0.000s	sys 0.002s
I20260709 13:00:39.564361  2670 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:39.565514  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:39.572861  2753 raft_consensus.cc:2804] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:39.573511  2753 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.574030  2753 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:39.540978  2780 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:39.580895  2742 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:39.580255  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:39.540043  2695 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:39.575021  2670 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:39.616302  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 58479.3us
I20260709 13:00:39.539086  2709 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:39.558145  2716 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:39.610023  2750 consensus_meta.cc:287] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.539s	user 0.004s	sys 0.007s
I20260709 13:00:39.568681  2677 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:39.645299  1732 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:00:39.654827  2744 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.645519  2671 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:39.656039  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:39.542992  2784 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:39.664925  2700 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.665402  2757 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.667407  1558 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:00:39.648036  2726 consensus_meta.cc:287] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.856s	user 0.012s	sys 0.003s
I20260709 13:00:39.566395  2727 consensus_queue.cc:237] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:39.570638  2758 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:39.556097  2728 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:39.657481  2750 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:39.696247  2750 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:39.688293  2691 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.698454  2691 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:39.679190  1664 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:39.701550  2778 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:39.705770  2740 consensus_meta.cc:287] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.538s	user 0.010s	sys 0.003s
I20260709 13:00:39.706221  2765 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:00:39.649837  2712 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:39.669770  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:39.711232  1738 raft_consensus.cc:2468] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:39.576491  2690 consensus_queue.cc:260] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:00:39.676061  2788 log.cc:927] Time spent T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:00:39.717885  2690 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:39.682248  2761 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.663367  2751 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:39.685782  2726 raft_consensus.cc:2749] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:39.670626  2677 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:39.673236  2671 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:39.727998  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 322330us
I20260709 13:00:39.706384  2740 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:39.683967  2700 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:39.737417  1705 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:00:39.731199  2749 consensus_meta.cc:287] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.681s	user 0.015s	sys 0.000s
I20260709 13:00:39.743101  1665 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:39.682701  2744 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:39.744203  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:39.746451  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:39.746584  2744 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:39.730512  2670 raft_consensus.cc:2804] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:39.766363  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:39.773558  1633 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:39.740857  2691 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:39.747668  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:00:39.741039  2776 consensus_queue.cc:1048] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:00:39.729787  2697 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.741964  2741 consensus_queue.cc:1048] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:00:39.776979  2695 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:39.777915  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:39.781551  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:39.782701  2671 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:39.725756  2761 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:39.723538  2757 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:39.801015  2726 raft_consensus.cc:2804] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:39.765008  2670 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.814638  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:39.772912  2749 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:39.819676  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:39.847325  1741 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:00:39.832819  2663 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:39.835793  2700 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:39.841799  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:39.822011  2709 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:39.844852  1489 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55138 (request call id 171) took 1519 ms. Trace:
I20260709 13:00:39.812606  2697 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:39.882123  2758 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:39.883098  2697 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:39.845954  2726 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:39.883985  2726 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:39.868316  1486 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55132 (request call id 170) took 1322 ms. Trace:
I20260709 13:00:39.874794  1633 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:00:39.890913  1633 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:39.860670  2677 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:39.888464  1486 rpcz_store.cc:276] 0709 13:00:38.545590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.545743 (+   153us) service_pool.cc:224] Handling call
0709 13:00:39.868219 (+1322476us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 13:00:39.848866  2670 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:39.878247  1489 rpcz_store.cc:276] 0709 13:00:38.325491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.350056 (+ 24565us) service_pool.cc:224] Handling call
0709 13:00:39.844776 (+1494720us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:38.693802 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:38.776893 (+ 83091us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:38.791426 (+ 14533us) write_op.cc:435] Acquired schema lock
0709 13:00:38.794759 (+  3333us) tablet.cc:662] Decoding operations
0709 13:00:38.829604 (+ 34845us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:38.829669 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:38.829793 (+   124us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:00:38.830017 (+   224us) tablet.cc:701] Row locks acquired
0709 13:00:38.830033 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:00:38.830238 (+   205us) write_op.cc:270] Start()
0709 13:00:38.830386 (+   148us) write_op.cc:276] Timestamp: P: 1783602038830180 usec, L: 0
0709 13:00:38.830410 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:00:38.836232 (+  5822us) log.cc:844] Serialized 598 byte log entry
0709 13:00:39.338465 (+502233us) op_driver.cc:464] REPLICATION: finished
0709 13:00:39.529793 (+191328us) write_op.cc:301] APPLY: starting
0709 13:00:39.536741 (+  6948us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:39.547272 (+ 10531us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:39.613917 (+ 66645us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:39.637608 (+ 23691us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:39.637964 (+   356us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:00:39.638058 (+    94us) write_op.cc:312] APPLY: finished
0709 13:00:39.638428 (+   370us) log.cc:844] Serialized 22 byte log entry
0709 13:00:39.638716 (+   288us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:39.638848 (+   132us) write_op.cc:454] Released schema lock
0709 13:00:39.638913 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:39.639448 (+   535us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:39.639499 (+    51us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":145751,"apply.run_cpu_time_us":3077,"apply.run_wall_time_us":115979,"num_ops":1,"prepare.queue_time_us":295344,"prepare.run_cpu_time_us":4221,"prepare.run_wall_time_us":154014,"replication_time_us":479793,"thread_start_us":219377,"threads_started":2}]]}
I20260709 13:00:39.847908  2552 raft_consensus.cc:1275] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 2 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 13:00:39.877408  2784 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:39.894784  2709 raft_consensus.cc:2749] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:39.916520  2552 pending_rounds.cc:85] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6: Aborting all ops after (but not including) 2
I20260709 13:00:39.922047  2552 pending_rounds.cc:107] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:00:39.918432  2751 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:39.918987  1488 catalog_manager.cc:5697] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 1 to 2, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 2 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:39.900224  2752 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:39.927687  1488 catalog_manager.cc:5697] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 1 to 2, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 2 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:39.922606  2552 raft_consensus.cc:2917] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:00:39.931048  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:39.940057  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:39.955665  1488 catalog_manager.cc:5697] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 2 to 3, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 3 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:39.960565  2746 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:39.914235  2717 raft_consensus.cc:2804] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:40.016798  2717 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:40.017693  2717 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:39.967288  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:39.971768  2552 raft_consensus.cc:2889] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 2 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:39.899523  2753 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:39.953791  2761 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:39.999473  2672 raft_consensus.cc:3060] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:40.021739  1488 catalog_manager.cc:5697] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 1 to 2, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 2 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:40.022871  1660 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:40.053279  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:00:40.055184  1707 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.099s	sys 0.196s
I20260709 13:00:40.058152  1666 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:00:40.058364  1707 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.100s	sys 0.196s
W20260709 13:00:40.058947  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 653910us
I20260709 13:00:40.064875  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:40.075004  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:40.075871  1658 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:00:40.051939  2677 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.053910  1737 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:00:40.087745  2509 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.088387  2509 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.090939  1705 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:40.091439  1666 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
W20260709 13:00:40.091751  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.097697  2787 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.064114  2740 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:40.103982  2509 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:00:40.101867  2759 consensus_meta.cc:287] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.641s	user 0.008s	sys 0.009s
I20260709 13:00:40.063609  2765 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:40.106706  1707 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:40.112905  2509 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:40.072713  2757 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:40.106244  2663 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.104856  2776 raft_consensus.cc:2804] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:40.101341  2780 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.133890  2759 consensus_queue.cc:1048] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:40.131691  2663 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.117766  1490 catalog_manager.cc:5697] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: config changed from index 2 to 3, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:00:40.085636  2677 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.139998  2759 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.113415  2765 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:40.133402  2553 consensus_meta.cc:287] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent flushing consensus metadata: real 0.616s	user 0.012s	sys 0.005s
I20260709 13:00:40.126428  2776 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.146981  1741 raft_consensus.cc:2368] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5.
I20260709 13:00:40.116518  2787 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.167739  2787 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:40.182130  1633 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:40.182514  1705 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:40.151060  2753 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:40.163702  2783 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.034s	sys 0.061s
I20260709 13:00:40.154039  2776 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:40.186308  2704 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:40.187083  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:40.194569  2762 raft_consensus.cc:670] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:00:40.194311  2704 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.188597  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:40.199404  1658 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:40.202641  2677 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:40.202693  2670 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.190831  2765 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:40.184423  2742 consensus_meta.cc:287] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.569s	user 0.017s	sys 0.000s
I20260709 13:00:40.193377  2757 raft_consensus.cc:2804] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:40.195483  1666 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:00:40.186105  2726 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.198365  2704 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:40.209203  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.151404  2759 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.187342  2785 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:40.217504  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:40.218497  1705 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:40.219926  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:00:40.187923  2783 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.035s	sys 0.063s
I20260709 13:00:40.195946  2663 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:00:40.233979  1659 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.002s	sys 0.054s
W20260709 13:00:40.238309  1659 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.002s	sys 0.054s
I20260709 13:00:40.240083  1738 raft_consensus.cc:2468] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
W20260709 13:00:40.265682  1556 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.004s	sys 0.014s
W20260709 13:00:40.329389  1556 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.004s	sys 0.014s
I20260709 13:00:40.331305  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:40.232625  1557 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.809s	user 0.022s	sys 0.049s
W20260709 13:00:40.334043  1557 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.910s	user 0.022s	sys 0.049s
I20260709 13:00:40.336088  1633 leader_election.cc:400] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5.
I20260709 13:00:40.336643  1633 leader_election.cc:403] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:40.337217  1666 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
W20260709 13:00:40.287051  2694 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.000s	sys 0.012s
I20260709 13:00:40.236063  1739 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
W20260709 13:00:40.379433  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 161625us
I20260709 13:00:40.383590  1741 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 3.
I20260709 13:00:40.454823  1705 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
W20260709 13:00:40.293184  2727 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.003s	sys 0.008s
W20260709 13:00:40.389780  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.460384  2644 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:40.461041  2644 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.235383  2757 raft_consensus.cc:697] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:40.462328  2757 consensus_queue.cc:237] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.464099  2644 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:40.235074  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:40.319279  2742 raft_consensus.cc:2804] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:40.465459  2742 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.465538  1658 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:40.466048  2742 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:40.467308  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:40.468194  1658 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:00:40.237915  2783 raft_consensus.cc:697] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:40.390799  2752 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:40.469509  2752 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:40.469861  2783 consensus_queue.cc:237] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.394695  2750 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:40.473403  2750 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.376916  2787 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.376576  2672 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.475576  2672 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.477982  2672 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:40.319023  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:40.393337  2663 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.375829  2785 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:40.478770  2663 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.393499  2670 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:40.378978  2762 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:40.383756  2674 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:40.378078  2780 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:40.388087  2677 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:00:40.400974  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:40.383060  2704 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:00:40.407853  1558 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.014s	sys 0.014s
I20260709 13:00:40.409963  2687 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.412700  2793 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
W20260709 13:00:40.441210  1555 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.004s	sys 0.014s
I20260709 13:00:40.461380  2700 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.391533  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:40.475528  2787 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.392346  2786 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:00:40.481019  1663 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.018s	sys 0.026s
I20260709 13:00:40.479501  2785 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:40.473385  2727 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.004s	sys 0.010s
W20260709 13:00:40.509830  1663 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.018s	sys 0.026s
W20260709 13:00:40.481664  2715 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.064s	user 0.081s	sys 0.102s
I20260709 13:00:40.487751  1633 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
W20260709 13:00:40.497198  1558 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.016s	sys 0.015s
I20260709 13:00:40.488047  2765 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
W20260709 13:00:40.505025  1555 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.004s	sys 0.014s
W20260709 13:00:40.451691  2694 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.048s	user 0.000s	sys 0.019s
I20260709 13:00:40.508296  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:40.504487  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:40.502746  1664 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.023s	sys 0.044s
I20260709 13:00:40.520548  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:00:40.532505  1558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.533700  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:40.522876  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:40.524552  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:00:40.514559  2715 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.097s	user 0.083s	sys 0.104s
I20260709 13:00:40.528918  1633 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:40.530014  1660 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:40.478391  2752 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:00:40.530562  1666 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:40.501569  2761 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:40.504455  2759 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:40.544483  1705 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:40.547626  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:40.488823  2674 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.514521  2726 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:40.536315  1664 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.024s	sys 0.044s
I20260709 13:00:40.551146  1666 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:40.560896  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:40.555689  1660 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:40.506487  2687 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.541345  2709 raft_consensus.cc:2804] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:00:40.559120  2680 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.004s	sys 0.017s
I20260709 13:00:40.511062  2704 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.504074  2762 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:40.513273  2700 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } }
I20260709 13:00:40.549973  2740 raft_consensus.cc:2804] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:40.542760  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:00:40.584961  2778 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:40.584826  2717 consensus_meta.cc:287] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.566s	user 0.006s	sys 0.005s
I20260709 13:00:40.550676  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:40.586377  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:40.586283  2717 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.587250  1663 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:40.513866  2786 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.533915  2765 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.578277  2789 raft_consensus.cc:2804] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:40.578744  2663 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:40.579427  2787 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:40.558130  2553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 19) took 1067 ms. Trace:
I20260709 13:00:40.580226  2674 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:40.528033  2793 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:00:40.609841  1658 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:00:40.610993  2793 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:40.611539  2793 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.611696  2717 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:40.612032  2793 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.581650  2670 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.582472  2742 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.613391  2670 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.613950  1734 raft_consensus.cc:2393] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 3: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:40.614073  2746 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.567402  2752 raft_consensus.cc:2804] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:40.614763  2752 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.615238  2752 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:40.616047  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:40.573269  2726 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.576640  2740 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.568665  2750 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:40.625161  2726 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.628198  2726 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:40.570446  2680 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.004s	sys 0.017s
I20260709 13:00:40.628818  2740 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:40.587401  1659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 830) took 1184 ms. Trace:
I20260709 13:00:40.593802  2759 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:40.629855  2759 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.629560  1659 rpcz_store.cc:276] 0709 13:00:39.403236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.403358 (+   122us) service_pool.cc:224] Handling call
0709 13:00:39.421695 (+ 18337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:39.543556 (+121861us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:39.543603 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:39.568298 (+ 24695us) log.cc:844] Serialized 26 byte log entry
0709 13:00:40.238919 (+670621us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:40.238959 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:40.416498 (+177539us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54002fbf54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:00:40.416566 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:40.587057 (+170491us) raft_consensus.cc:1685] finished
0709 13:00:40.587078 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:40.587309 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2454,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":8352,"spinlock_wait_cycles":279331584,"thread_start_us":648769,"threads_started":1,"wal-append.queue_time_us":897207}
I20260709 13:00:40.566255  2795 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.563298  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:40.600646  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:40.634057  1740 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:40.616170  2670 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:40.586555  1733 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:40.557317  2761 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.575973  2709 raft_consensus.cc:697] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:40.577180  2694 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.658023  2694 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.578800  2791 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.621502  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:40.661613  1734 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:40.661569  2791 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.616418  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:40.632931  2750 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.665221  1732 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:40.603996  2780 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:40.603766  2727 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.585841  2778 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.635643  1660 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:00:40.608757  2789 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.632408  2795 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:40.649904  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:40.656111  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.664052  2740 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.617434  2554 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:40.688405  1734 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:40.666347  2780 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.614782  2746 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.708652  1740 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
W20260709 13:00:40.640972  2739 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.020s	sys 0.040s
I20260709 13:00:40.665302  2750 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.672281  2789 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:40.688483  2727 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.670368  2791 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:40.692170  2680 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:40.809430  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:40.827025  1488 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.043s	sys 0.071s
I20260709 13:00:40.669960  2694 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:00:40.840313  1488 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.043s	sys 0.071s
I20260709 13:00:40.840804  1661 raft_consensus.cc:2393] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 in current term 2: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:40.737345  2796 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.723598  2795 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:40.723088  2700 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:40.719051  2762 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:40.724040  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:40.718421  2740 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:40.738440  2687 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:40.745767  2704 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:40.810097  2784 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.812541  2790 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.718421  2746 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:40.713605  2739 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.020s	sys 0.041s
I20260709 13:00:40.904834  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:40.906086  1586 raft_consensus.cc:2410] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:00:40.744827  2765 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:40.838809  2726 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:40.838943  2674 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:40.839469  2791 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:40.884200  2785 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.843734  2787 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:40.729529  2786 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:40.845445  2735 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:40.923884  2717 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:40.743181  2778 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:40.909351  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:40.948364  1589 raft_consensus.cc:2410] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 3 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:00:40.910655  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:40.949437  1588 raft_consensus.cc:2410] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:00:40.917814  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:40.906963  2784 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.893118  2793 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:40.902650  2565 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.897392  2704 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:40.904032  2687 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.914006  2694 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.914822  2700 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.729038  2709 consensus_queue.cc:237] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.911973  2740 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:40.879046  2796 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.607239  2553 rpcz_store.cc:276] 0709 13:00:39.481316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.481577 (+   261us) service_pool.cc:224] Handling call
0709 13:00:39.482112 (+   535us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:39.482405 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:40.163327 (+680922us) log.cc:844] Serialized 14 byte log entry
0709 13:00:40.511163 (+347836us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:40.513166 (+  2003us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:40.516857 (+  3691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:40.533041 (+ 16184us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:40.544056 (+ 11015us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":371000,"thread_start_us":313046,"threads_started":1,"wal-append.queue_time_us":679922}
I20260709 13:00:40.722078  2761 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:40.925397  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:40.927467  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:40.985553  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:40.947649  2735 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.949857  2717 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.986272  1659 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:40.995923  2745 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.997433  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:40.937899  1556 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:40.950238  1590 raft_consensus.cc:2393] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 4: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:40.845755  2680 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:40.903327  2790 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.938671  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:40.996536  2745 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.925035  2752 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.955480  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:40.939376  2674 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.936523  2726 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.977402  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:40.941115  2791 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.980717  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:40.982833  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:40.979405  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:40.946321  2787 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.993670  2761 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:41.003059  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:41.035741  1590 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:40.982477  2727 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:40.979893  2700 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.969952  2565 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:41.005403  2746 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.951786  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:41.006520  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:40.985596  2715 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:40.972204  2704 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:41.008028  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:40.975169  2687 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:41.009323  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:41.055796  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:40.991683  2765 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:41.012327  2509 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.976995  2694 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:40.991811  2750 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:41.028189  1661 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:41.017746  2778 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:41.021844  2810 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:41.029541  1663 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
W20260709 13:00:40.996788  2776 consensus_meta.cc:287] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.785s	user 0.010s	sys 0.003s
I20260709 13:00:40.983327  2740 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:41.002285  2813 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.047569  1734 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:00:41.001502  2697 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:41.004355  2783 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:41.056354  1738 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:00:41.017457  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:41.075098  2783 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:41.075641  1733 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:41.077392  2783 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:41.077999  1735 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 3.
I20260709 13:00:41.078105  2687 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:41.079646  2790 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:41.080200  2790 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:41.081529  2796 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:41.082283  2824 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:41.082378  2565 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:41.067978  2715 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:41.061879  2509 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:41.046478  2670 raft_consensus.cc:2804] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:41.070781  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:41.072494  2816 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
W20260709 13:00:41.074540  2811 log.cc:927] Time spent T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:00:41.074625  2785 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:41.073475  2813 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:41.052381  2761 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:41.088248  2717 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:41.088629  2817 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:41.088796  2825 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:41.088912  2759 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:41.089273  2745 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:41.090031  2740 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:41.097020  2817 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:41.097178  2825 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:41.098532  2674 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:41.099284  2817 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:41.099359  2825 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:41.084858  2697 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:00:41.099768  2791 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:41.100032  2752 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:41.100505  2726 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:41.090672  2680 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:00:41.058784  2746 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:41.091535  2704 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:41.087930  2787 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:41.092098  2816 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:41.066540  2765 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:41.080659  2790 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:41.070467  2778 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:41.082852  2824 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:41.071851  2776 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:41.106106  2813 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:41.108040  2784 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:41.071921  2810 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:41.019685  1583 raft_consensus.cc:2393] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 2: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
W20260709 13:00:41.010422  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 72629.1us
I20260709 13:00:41.007911  1585 raft_consensus.cc:2393] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 2: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:41.062441  1591 raft_consensus.cc:2393] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 2: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:41.056520  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:41.055373  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:41.004022  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:41.065402  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:41.028232  1660 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:41.051728  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:41.028667  1667 raft_consensus.cc:2393] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 2: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:41.060492  1705 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:41.074990  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:41.105707  2700 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:41.432363  2726 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.446964  2790 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:41.447500  2776 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:41.433395  2704 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:41.448948  2704 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:41.450126  2778 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:41.129928  2780 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:41.451859  2704 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:41.444473  2765 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:41.448053  2715 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:41.116796  2789 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:41.455284  1739 raft_consensus.cc:2393] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 6: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:41.192148  1586 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:41.441677  2742 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:41.443032  2746 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:41.445340  2761 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:41.454591  2810 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:41.458312  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:41.440855  2735 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:41.406592  2697 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:41.436384  2663 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:41.439275  1633 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
W20260709 13:00:41.412508  2677 consensus_meta.cc:287] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.909s	user 0.012s	sys 0.006s
I20260709 13:00:41.460528  2663 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:41.461882  1633 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:41.456354  2789 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:41.463608  2715 raft_consensus.cc:2804] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:41.464126  2715 raft_consensus.cc:697] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:41.464254  2816 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:41.464721  2663 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:00:41.459774  2726 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:41.412499  1737 consensus_meta.cc:287] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.007s
I20260709 13:00:41.203238  1589 raft_consensus.cc:2393] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 2: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:41.465510  2715 consensus_queue.cc:237] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:41.465893  1658 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:41.466426  1737 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:00:41.466996  1633 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:41.320839  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:41.396588  2644 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.431270  2709 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:41.405966  2680 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.469985  2709 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:41.461203  2677 raft_consensus.cc:2749] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5.
I20260709 13:00:41.191279  1584 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:00:41.101178  2694 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:41.468720  1732 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:00:41.471637  1633 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:41.279937  1664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 834) took 1507 ms. Trace:
I20260709 13:00:41.203339  1588 raft_consensus.cc:2393] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 3: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:41.470026  2680 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } }
I20260709 13:00:41.085310  2670 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:41.394228  2509 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:41.287897  1665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 838) took 1238 ms. Trace:
I20260709 13:00:41.484716  2680 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:00:41.480630  1664 rpcz_store.cc:276] 0709 13:00:39.772495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.776545 (+  4050us) service_pool.cc:224] Handling call
0709 13:00:39.777048 (+   503us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:39.804785 (+ 27737us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:39.804854 (+    69us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:39.808573 (+  3719us) log.cc:844] Serialized 26 byte log entry
0709 13:00:40.570832 (+762259us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:41.053206 (+482374us) log.cc:844] Serialized 14 byte log entry
0709 13:00:41.278934 (+225728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.279178 (+   244us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:41.279302 (+   124us) raft_consensus.cc:1685] finished
0709 13:00:41.279327 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:41.279627 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":222648,"prepare.queue_time_us":427817,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":391926,"raft.run_cpu_time_us":489,"raft.run_wall_time_us":7634,"thread_start_us":1145482,"threads_started":2,"wal-append.queue_time_us":1073258}
I20260709 13:00:41.485846  2824 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:41.397452  2674 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:41.502604  2674 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:41.503036  1633 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:41.505287  2795 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.506002  2795 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:41.506760  2816 raft_consensus.cc:2804] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:41.507380  2816 raft_consensus.cc:697] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:41.327360  1590 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:41.471251  2644 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:41.085605  1734 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 1.
I20260709 13:00:41.497529  2761 raft_consensus.cc:2804] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:41.498374  2828 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:41.302099  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.474112  1556 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:41.501602  2825 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:41.504886  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:41.458914  1661 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:41.433359  2552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49238 (request call id 1) took 1269 ms. Trace:
I20260709 13:00:41.501601  1738 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:00:41.510370  1592 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:00:41.510533  2793 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.432374  2832 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:41.499715  1665 rpcz_store.cc:276] 0709 13:00:40.049717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.050003 (+   286us) service_pool.cc:224] Handling call
0709 13:00:40.058285 (+  8282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:40.070532 (+ 12247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:40.070577 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:40.077280 (+  6703us) log.cc:844] Serialized 26 byte log entry
0709 13:00:40.126577 (+ 49297us) spinlock_profiling.cc:243] Waited 8.12 ms on lock 0x7b48001bc258. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b85eb8aa1 00007f1b85eafb37 00007f1b85eaf9ca 00007f1b85fa726f 00007f1b85fa6f37 00007f1b85fbb55c 00007f1b85fbb508 00007f1b85fbb488 00007f1b85fbb443 00007f1b85fba6ec 00007f1b84ee4a96
0709 13:00:40.535741 (+409164us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:40.535794 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:40.535857 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:40.881896 (+346039us) raft_consensus.cc:1685] finished
0709 13:00:40.881917 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:41.287444 (+405527us) spinlock_profiling.cc:243] Waited 7.85 ms on lock 0x7b54002b25d0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8e8ad 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:00:41.287706 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11825,"raft.queue_time_us":12578,"raft.run_cpu_time_us":3586,"raft.run_wall_time_us":59928,"spinlock_wait_cycles":36723968,"thread_start_us":420026,"threads_started":1,"wal-append.queue_time_us":777269}
I20260709 13:00:41.326504  1733 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 3.
W20260709 13:00:41.591364  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 530785us
W20260709 13:00:41.170173  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 157965us
I20260709 13:00:41.597308  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:41.567189  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 86013.6us
I20260709 13:00:41.592209  2509 raft_consensus.cc:2804] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:41.647176  2644 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:41.500871  1587 raft_consensus.cc:2955] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:00:41.640439  2704 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:41.658391  2709 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:41.659222  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:41.661157  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:41.661499  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:41.663003  2726 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:41.567546  2833 log.cc:927] Time spent T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:00:41.511291  1659 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:41.664927  2509 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:41.590776  2670 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:41.595234  2795 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:41.667430  1662 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:41.670099  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:41.507722  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:41.663049  1705 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
W20260709 13:00:41.675055  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 201243us
I20260709 13:00:41.641160  2674 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:41.583992  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:41.677640  2509 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:41.511092  2765 raft_consensus.cc:2804] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:41.676137  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:41.640027  2825 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:41.678292  1588 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5.
I20260709 13:00:41.683262  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:41.687387  1592 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:41.690379  1591 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:00:41.690961  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:41.691650  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:41.691818  1592 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:41.683535  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:41.692384  1591 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:41.689011  1586 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:41.687438  1589 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:41.686447  2644 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:41.584172  2816 consensus_queue.cc:237] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:41.684307  2765 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:41.698254  1590 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:41.673741  2828 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:41.684899  2825 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:41.696682  2817 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:41.702768  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:41.699074  1558 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:41.700766  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:41.678900  2704 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } }
I20260709 13:00:41.708424  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:41.707237  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:41.710016  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:41.698772  2644 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:41.705444  1585 raft_consensus.cc:2393] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 2: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:41.710246  2817 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:41.713436  2644 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:41.716866  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:41.714200  1589 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:00:41.708226  2765 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:41.713886  1588 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:41.686821  2793 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:41.728788  1558 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:41.713953  1584 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:41.728329  2674 raft_consensus.cc:2804] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:41.737439  2674 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:41.737980  2674 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:41.716388  2704 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:00:41.741808  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:41.742235  1666 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5.
I20260709 13:00:41.742527  1589 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:41.743937  1666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 849) took 1289 ms. Trace:
I20260709 13:00:41.715924  2817 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:41.745803  1666 rpcz_store.cc:276] 0709 13:00:40.454237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.560545 (+106308us) service_pool.cc:224] Handling call
0709 13:00:41.743665 (+1183120us) spinlock_profiling.cc:243] Waited 951 ms on lock 0x7b54000a87d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:00:41.743847 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2187334912}
I20260709 13:00:41.751711  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:00:41.732345  1556 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:41.747934  1588 raft_consensus.cc:1275] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:41.754671  1590 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:00:41.756376  1590 raft_consensus.cc:1240] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:41.637414  2552 rpcz_store.cc:276] 0709 13:00:40.179368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.189867 (+ 10499us) service_pool.cc:224] Handling call
0709 13:00:40.190374 (+   507us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:40.562601 (+372227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:40.564426 (+  1825us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:40.609833 (+ 45407us) log.cc:844] Serialized 26 byte log entry
0709 13:00:41.063027 (+453194us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:41.384725 (+321698us) log.cc:844] Serialized 14 byte log entry
0709 13:00:41.432628 (+ 47903us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.432752 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:41.432851 (+    99us) raft_consensus.cc:1685] finished
0709 13:00:41.432864 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:41.433065 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30156,"prepare.queue_time_us":419743,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":66,"raft.queue_time_us":66722,"raft.run_cpu_time_us":378,"raft.run_wall_time_us":379,"thread_start_us":1133986,"threads_started":4,"wal-append.queue_time_us":471263}
I20260709 13:00:41.762953  2761 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:41.763553  2761 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:41.694489  2832 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:41.725431  2795 raft_consensus.cc:2804] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:41.771113  1591 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5.
I20260709 13:00:41.788002  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:41.776458  1586 raft_consensus.cc:1240] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:41.782326  1592 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
W20260709 13:00:41.828895  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 134121us
I20260709 13:00:41.829396  2700 raft_consensus.cc:2804] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:41.834575  1589 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:41.796192  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:41.771610  2795 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:41.852617  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:41.854252  1589 raft_consensus.cc:2393] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 in current term 2: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:41.796141  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:00:41.775121  1583 raft_consensus.cc:2393] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 3: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:41.833098  2697 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:41.785068  2828 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:00:41.858843  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:41.796598  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:00:41.880973  1556 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:41.799891  2789 raft_consensus.cc:1064] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d: attempting to promote NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 to VOTER
I20260709 13:00:41.843554  2746 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.856773  2795 raft_consensus.cc:3060] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:41.860524  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:41.893011  2791 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:41.893621  2813 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:41.894883  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 166214us
I20260709 13:00:41.886435  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:41.871495  2554 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:41.903883  2426 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:41.905310  2813 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:41.894428  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:41.909600  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:41.911883  1705 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:41.904721  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:00:41.957228  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.918058  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:41.908695  1558 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:00:41.962517  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 53983.6us
I20260709 13:00:41.963282  2813 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:41.964035  2509 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:41.965723  2700 raft_consensus.cc:697] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:41.967685  2509 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:41.972223  2700 consensus_queue.cc:237] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:41.858711  2816 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:41.900741  2715 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:41.916440  2644 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:41.977420  1705 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:41.917337  2735 raft_consensus.cc:2804] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:41.967074  2813 raft_consensus.cc:2764] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:00:41.988703  1738 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
W20260709 13:00:42.001103  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 83101.1us
I20260709 13:00:42.004684  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:41.987550  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:41.908695  2746 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:42.001546  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:41.954064  2552 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 1.
I20260709 13:00:42.014436  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:41.991565  2735 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.018473  1666 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:42.027082  2509 raft_consensus.cc:2804] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:42.027539  2509 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.027930  2509 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:42.028649  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.032951  2735 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:42.041438  2670 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:42.046074  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.048936  1589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 913) took 1048 ms. Trace:
I20260709 13:00:42.045359  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.054665  1705 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:42.051388  1659 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:42.051388  1662 raft_consensus.cc:2468] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:41.953583  2791 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:42.024186  2697 raft_consensus.cc:2749] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:42.049414  1589 rpcz_store.cc:276] 0709 13:00:41.000246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.885342 (+885096us) service_pool.cc:224] Handling call
0709 13:00:42.004353 (+119011us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.034304 (+ 29951us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.034345 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:42.048591 (+ 14246us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:42.048644 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.048733 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.048873 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:42.064679  1740 raft_consensus.cc:2468] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:00:42.081724  1591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 905) took 1075 ms. Trace:
W20260709 13:00:42.086552  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 77001.7us
I20260709 13:00:42.092396  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.048537  2793 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:42.082261  1591 rpcz_store.cc:276] 0709 13:00:40.997756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.787188 (+789432us) service_pool.cc:224] Handling call
0709 13:00:41.788087 (+   899us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.788416 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:41.899575 (+111159us) log.cc:844] Serialized 14 byte log entry
0709 13:00:42.071945 (+172370us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:42.072271 (+   326us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:42.072473 (+   202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.072614 (+   141us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.072804 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":213916,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":2875,"thread_start_us":166928,"threads_started":2}
I20260709 13:00:42.023623  2816 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:42.107005  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.107846  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.108655  1490 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51168 (request call id 16) took 2032 ms. Trace:
I20260709 13:00:42.093309  1558 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:42.092760  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.085750  1661 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:42.122694  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.000200  2715 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:42.108793  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:00:42.125800  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:42.126353  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.133338  2704 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:42.136854  1738 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 1.
I20260709 13:00:42.105475  2694 raft_consensus.cc:2804] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:42.144788  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.109319  2824 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:42.150888  1734 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 1.
W20260709 13:00:42.144923  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 64793.7us
I20260709 13:00:42.156991  2509 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:42.126878  2828 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:42.127104  2832 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:42.166961  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 147509us
I20260709 13:00:42.173938  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.080811  2789 consensus_queue.cc:237] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:42.107846  2761 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:42.147071  2694 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:42.127820  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 224222us
I20260709 13:00:42.180608  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.194082  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:42.178802  2704 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:42.198784  1666 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:42.199359  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.200246  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.200968  1659 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:42.201313  1661 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:42.201694  2426 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:42.202852  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.203553  1741 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 1.
I20260709 13:00:42.204638  2780 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:42.205236  2780 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:42.206382  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.206682  2761 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:42.207033  1734 raft_consensus.cc:2468] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:00:42.208006  2715 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:42.208637  1584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 897) took 1213 ms. Trace:
I20260709 13:00:42.208915  2824 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:42.209712  1738 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:00:42.209223  1486 catalog_manager.cc:5697] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: config changed from index 3 to 4, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:42.200382  1488 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55154 (request call id 164) took 3361 ms. Trace:
I20260709 13:00:42.170217  2726 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.195626  1732 raft_consensus.cc:2368] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5.
I20260709 13:00:42.204452  2825 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:42.193500  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.194324  2694 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:42.211467  1662 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 3.
I20260709 13:00:42.195235  2832 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:42.195214  2697 raft_consensus.cc:2804] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:42.194276  2817 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:42.232630  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.239604  1738 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 3.
I20260709 13:00:42.241355  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.241576  1592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 907) took 1242 ms. Trace:
I20260709 13:00:42.243337  1592 rpcz_store.cc:276] 0709 13:00:40.998337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.808123 (+809786us) service_pool.cc:224] Handling call
0709 13:00:41.832551 (+ 24428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.899994 (+ 67443us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:42.069714 (+169720us) log.cc:844] Serialized 14 byte log entry
0709 13:00:42.240145 (+170431us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:42.240280 (+   135us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:42.240368 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.240550 (+   182us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.240804 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":159974,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"thread_start_us":156749,"threads_started":2}
I20260709 13:00:42.194080  2828 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:42.223266  2663 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:42.117357  1490 rpcz_store.cc:276] 0709 13:00:40.076336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.076517 (+   181us) service_pool.cc:224] Handling call
0709 13:00:42.108386 (+2031869us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:41.448322 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:41.449476 (+  1154us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:41.449552 (+    76us) write_op.cc:435] Acquired schema lock
0709 13:00:41.449605 (+    53us) tablet.cc:662] Decoding operations
0709 13:00:41.450282 (+   677us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:41.450387 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:41.450461 (+    74us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:00:41.450907 (+   446us) tablet.cc:701] Row locks acquired
0709 13:00:41.450975 (+    68us) write_op.cc:260] PREPARE: finished
0709 13:00:41.451247 (+   272us) write_op.cc:270] Start()
0709 13:00:41.451476 (+   229us) write_op.cc:276] Timestamp: P: 1783602041451169 usec, L: 0
0709 13:00:41.451525 (+    49us) op_driver.cc:348] REPLICATION: starting
0709 13:00:41.453021 (+  1496us) log.cc:844] Serialized 598 byte log entry
0709 13:00:41.857324 (+404303us) op_driver.cc:464] REPLICATION: finished
0709 13:00:42.019008 (+161684us) write_op.cc:301] APPLY: starting
0709 13:00:42.027752 (+  8744us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:42.048012 (+ 20260us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:42.058500 (+ 10488us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:42.093652 (+ 35152us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:42.105683 (+ 12031us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:00:42.105761 (+    78us) write_op.cc:312] APPLY: finished
0709 13:00:42.106010 (+   249us) log.cc:844] Serialized 22 byte log entry
0709 13:00:42.106216 (+   206us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:42.106303 (+    87us) write_op.cc:454] Released schema lock
0709 13:00:42.106349 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:42.106703 (+   354us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:42.106739 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":143858,"apply.run_cpu_time_us":2258,"apply.run_wall_time_us":91085,"num_ops":1,"prepare.queue_time_us":1051650,"prepare.run_cpu_time_us":5213,"prepare.run_wall_time_us":17065,"replication_time_us":384990,"thread_start_us":91005,"threads_started":1}]]}
I20260709 13:00:42.253223  1660 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:42.258488  1661 raft_consensus.cc:2468] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:42.260461  1665 raft_consensus.cc:2393] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 4: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:42.226043  2704 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:42.232002  2644 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:42.270578  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.272295  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:42.212191  1488 rpcz_store.cc:276] 0709 13:00:38.785241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.785391 (+   150us) service_pool.cc:224] Handling call
0709 13:00:39.246291 (+460900us) spinlock_profiling.cc:243] Waited 6.22 ms on lock 0x7b540020fe90. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7de6ab71 00007f1b7de6b0b2 00007f1b86de4a89 00007f1b86d7cda6 00007f1b86d4e088 00007f1b86e4c37e 00007f1b8530d2a4 00007f1b8530d232 00007f1b8530d161 00007f1b8530d0dc
0709 13:00:42.126643 (+2880352us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:41.006274 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:41.020085 (+ 13811us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:41.020157 (+    72us) write_op.cc:435] Acquired schema lock
0709 13:00:41.020179 (+    22us) tablet.cc:662] Decoding operations
0709 13:00:41.020846 (+   667us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:41.020938 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:41.020972 (+    34us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:00:41.072155 (+ 51183us) tablet.cc:701] Row locks acquired
0709 13:00:41.074270 (+  2115us) write_op.cc:260] PREPARE: finished
0709 13:00:41.093023 (+ 18753us) write_op.cc:270] Start()
0709 13:00:41.101523 (+  8500us) write_op.cc:276] Timestamp: P: 1783602041092965 usec, L: 0
0709 13:00:41.102077 (+   554us) op_driver.cc:348] REPLICATION: starting
0709 13:00:41.105742 (+  3665us) log.cc:844] Serialized 1763 byte log entry
0709 13:00:41.703989 (+598247us) op_driver.cc:464] REPLICATION: finished
0709 13:00:41.860665 (+156676us) write_op.cc:301] APPLY: starting
0709 13:00:41.860800 (+   135us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:41.861014 (+   214us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:41.861234 (+   220us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:41.909094 (+ 47860us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:41.909397 (+   303us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:00:41.909470 (+    73us) write_op.cc:312] APPLY: finished
0709 13:00:41.909870 (+   400us) log.cc:844] Serialized 40 byte log entry
0709 13:00:41.910881 (+  1011us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:41.911128 (+   247us) write_op.cc:454] Released schema lock
0709 13:00:41.911215 (+    87us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:41.953418 (+ 42203us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:41.953452 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":4,"spinlock_wait_cycles":14301952,"child_traces":[["op",{"apply.queue_time_us":156341,"apply.run_cpu_time_us":3868,"apply.run_wall_time_us":56792,"num_ops":4,"prepare.queue_time_us":907477,"prepare.run_cpu_time_us":31991,"prepare.run_wall_time_us":453880,"raft.queue_time_us":444631,"raft.run_cpu_time_us":56867,"raft.run_wall_time_us":282125,"replication_time_us":601680,"thread_start_us":1316292,"threads_started":4,"wal-append.queue_time_us":377249}]]}
I20260709 13:00:42.257792  2746 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:42.257175  2697 raft_consensus.cc:697] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:42.282757  1666 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
W20260709 13:00:42.284866  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 439257us
I20260709 13:00:42.292515  1659 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
W20260709 13:00:42.268959  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 45493us
I20260709 13:00:42.250985  2726 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:42.260094  2817 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:42.298521  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:42.311951  1661 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:00:42.315018  2509 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:42.294204  2663 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:42.301725  2824 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:00:42.323621  1666 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:42.325350  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:00:42.321144  2677 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.326134  2554 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 3.
I20260709 13:00:42.326252  2677 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:42.326385  2697 consensus_queue.cc:237] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:42.324142  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:42.320071  2509 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:00:42.331647  2853 log.cc:927] Time spent T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:00:42.331779  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.311249  1587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 556) took 1408 ms. Trace:
I20260709 13:00:42.315688  2816 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:42.339429  2791 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:42.306193  2735 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:42.386039  2509 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:42.350484  1659 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 6
W20260709 13:00:42.382684  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 49984.2us
I20260709 13:00:42.209053  1584 rpcz_store.cc:276] 0709 13:00:40.995043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.735749 (+740706us) service_pool.cc:224] Handling call
0709 13:00:41.736334 (+   585us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.736770 (+   436us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:41.868268 (+131498us) log.cc:844] Serialized 14 byte log entry
0709 13:00:42.160712 (+292444us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:42.172043 (+ 11331us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:42.174022 (+  1979us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.181684 (+  7662us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.208562 (+ 26878us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28809,"prepare.queue_time_us":151284,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":35697,"raft.queue_time_us":50504,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":122,"thread_start_us":353997,"threads_started":2,"wal-append.queue_time_us":296622}
I20260709 13:00:42.395090  1661 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:42.396137  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:42.354053  2674 consensus_meta.cc:287] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.615s	user 0.006s	sys 0.007s
I20260709 13:00:42.396799  1667 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:42.396513  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:42.393633  2825 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:42.362824  2855 raft_consensus.cc:2749] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:42.397550  2674 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:42.398893  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 90955.3us
I20260709 13:00:42.399654  2426 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:00:42.400817  2855 raft_consensus.cc:2804] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:42.363260  2863 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:42.401697  2855 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:42.402222  2855 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:42.401890  2863 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:42.406594  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:42.384846  2765 consensus_meta.cc:287] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.553s	user 0.009s	sys 0.000s
I20260709 13:00:42.410846  1659 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
W20260709 13:00:42.377092  2849 log.cc:927] Time spent T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.169s	user 0.000s	sys 0.004s
I20260709 13:00:42.416021  1666 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5.
I20260709 13:00:42.355429  2817 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:42.379733  2670 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:42.350312  2780 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:42.366302  2828 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:42.341262  2726 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:42.340070  2663 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:42.387024  2677 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:42.429603  2509 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:42.457966  1660 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:42.433306  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.470932  1734 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:42.433545  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.431428  1556 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:42.465109  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:42.467031  1664 raft_consensus.cc:1275] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:42.468591  1658 raft_consensus.cc:1275] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:42.473790  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.473927  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.477438  1741 raft_consensus.cc:2393] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 3: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:42.477289  1660 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:42.480718  2509 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:42.499226  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.500277  1664 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:42.501806  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.454437  2674 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:42.516381  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.523975  1739 raft_consensus.cc:2393] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 3: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:42.525714  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.474570  2780 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.526530  2509 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:42.526531  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.531210  1660 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:42.418576  2765 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:42.533248  1663 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:42.534376  2509 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:42.546792  1734 raft_consensus.cc:2393] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 5: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:42.473578  1732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:43674
I20260709 13:00:42.551663  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.553005  1660 raft_consensus.cc:2393] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 2: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:42.553442  2509 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:42.553723  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:42.554873  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 129505us
I20260709 13:00:42.551177  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.548144  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.558758  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.561322  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.561349  2509 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:42.560077  1705 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:42.559458  1735 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:42.561910  1739 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:42.560534  1736 raft_consensus.cc:2468] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:42.564000  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.566627  1734 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:42.567510  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:42.570544  2509 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:42.558403  1732 raft_consensus.cc:606] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Received request to transfer leadership
I20260709 13:00:42.572041  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.551733  1664 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:42.571024  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.574038  1667 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:42.391973  1587 rpcz_store.cc:276] 0709 13:00:40.897533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.902580 (+  5047us) service_pool.cc:224] Handling call
0709 13:00:40.947330 (+ 44750us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:40.980272 (+ 32942us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:40.982754 (+  2482us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:41.446806 (+464052us) log.cc:844] Serialized 564 byte log entry
0709 13:00:41.500498 (+ 53692us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:41.893539 (+393041us) log.cc:844] Serialized 14 byte log entry
0709 13:00:42.266576 (+373037us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.283843 (+ 17267us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:42.289939 (+  6096us) raft_consensus.cc:1685] finished
0709 13:00:42.289961 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.305724 (+ 15763us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":71059,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":707,"thread_start_us":416624,"threads_started":2,"wal-append.queue_time_us":53683}
I20260709 13:00:42.577135  2848 raft_consensus.cc:2804] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:42.577373  2858 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.577634  2848 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.578071  2848 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:42.578037  2858 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:42.561528  2863 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:42.580940  2509 raft_consensus.cc:2804] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:42.582233  2861 log.cc:927] Time spent T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:00:42.583722  1585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 896) took 1589 ms. Trace:
I20260709 13:00:42.580300  2858 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:42.576802  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.594915  1740 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:00:42.588636  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.552801  2780 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:42.589905  2509 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.595923  2509 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:42.596580  1663 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:42.568257  1733 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:42.561136  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.599388  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.599772  1741 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:00:42.601128  1660 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:00:42.575350  2860 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:42.606673  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.603580  2863 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:42.605000  1658 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:42.609545  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.611945  1733 raft_consensus.cc:1275] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:42.612618  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.613328  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.601012  2735 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:42.623646  1740 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 3.
I20260709 13:00:42.620684  1590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 909) took 1621 ms. Trace:
I20260709 13:00:42.629149  2552 raft_consensus.cc:1275] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 2 LEARNER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:42.629315  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.630100  1739 raft_consensus.cc:2393] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 4: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:42.635414  1661 raft_consensus.cc:1240] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:42.637293  1705 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:42.638303  2765 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:42.638510  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.629019  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.638355  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.640273  1732 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 1.
I20260709 13:00:42.625128  1590 rpcz_store.cc:276] 0709 13:00:40.999072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.811975 (+812903us) service_pool.cc:224] Handling call
0709 13:00:41.859711 (+ 47736us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.135103 (+275392us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:42.172712 (+ 37609us) log.cc:844] Serialized 14 byte log entry
0709 13:00:42.395593 (+222881us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:42.395643 (+    50us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:42.395683 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.620391 (+224708us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b54002b7ad4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:00:42.620449 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.620597 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85503,"prepare.queue_time_us":34349,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":85614,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":12059,"spinlock_wait_cycles":585220992,"thread_start_us":80560,"threads_started":1,"wal-append.queue_time_us":232437}
I20260709 13:00:42.641209  2863 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:42.641319  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:42.643321  2863 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:42.644989  2780 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:42.645097  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.645761  1664 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
W20260709 13:00:42.646731  2795 consensus_meta.cc:287] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.687s	user 0.010s	sys 0.000s
I20260709 13:00:42.647127  2795 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:42.626083  2860 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:42.649464  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.647367  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.656450  1661 raft_consensus.cc:2393] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 3: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:42.657445  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.656381  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.658380  1667 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:42.658955  1705 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:42.657508  1738 raft_consensus.cc:1275] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:42.646767  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.660020  2509 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:42.661752  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.663175  1667 raft_consensus.cc:2468] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:42.666424  1735 raft_consensus.cc:2393] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 4: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:42.668362  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.668926  1739 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 3.
I20260709 13:00:42.669562  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.669866  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.670403  2860 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:42.670408  1741 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 3.
I20260709 13:00:42.671346  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.671998  1733 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
W20260709 13:00:42.672217  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.674743  1660 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5.
I20260709 13:00:42.675287  2694 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:42.676602  1737 raft_consensus.cc:2368] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 3. Current term is 4.
I20260709 13:00:42.677636  1664 raft_consensus.cc:2393] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 5: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:42.678609  2832 raft_consensus.cc:2749] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:42.684388  2509 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:42.655615  2795 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:42.594332  1585 rpcz_store.cc:276] 0709 13:00:40.994719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.789789 (+795070us) service_pool.cc:224] Handling call
0709 13:00:41.897902 (+108113us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:42.018718 (+120816us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.029233 (+ 10515us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:42.044507 (+ 15274us) log.cc:844] Serialized 26 byte log entry
0709 13:00:42.582826 (+538319us) spinlock_profiling.cc:243] Waited 3.92 ms on lock 0x7b18003825a0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b80b374bc 00007f1b7de8548b 00007f1b86cdfab9 00007f1b7dea169b 00007f1b7de9f93f 00007f1b7dea1c02 00007f1b80b2920b 00007f1b80b2ed23 00007f1b80b2f0d1
0709 13:00:42.583093 (+   267us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:42.583186 (+    93us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.583310 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:42.583367 (+    57us) raft_consensus.cc:1685] finished
0709 13:00:42.583377 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.583630 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":133596,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":30973,"spinlock_wait_cycles":9009536,"thread_start_us":124792,"threads_started":1,"wal-append.queue_time_us":298648}
I20260709 13:00:42.667771  2867 raft_consensus.cc:2804] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:42.688369  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:42.688987  2735 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:42.688988  2867 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.689958  2867 raft_consensus.cc:3060] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:42.690723  1705 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:42.689545  2735 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.693672  2735 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:42.698868  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.699493  1663 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:42.655769  2742 consensus_queue.cc:1048] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:00:42.701485  1705 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:00:42.702394  1705 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:42.703066  2863 raft_consensus.cc:2804] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:42.703227  2674 raft_consensus.cc:2749] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:42.703478  2863 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:42.703953  2863 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:42.704020  2674 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:42.704499  2674 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.704823  2674 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:42.696031  1658 raft_consensus.cc:2393] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 3: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:42.706854  1705 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:42.676652  2855 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:00:42.715421  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.716280  1733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:43674
I20260709 13:00:42.717746  2509 raft_consensus.cc:2804] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:42.717917  1705 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:42.719108  2509 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:42.719878  2509 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:42.714443  1707 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:42.728453  1733 raft_consensus.cc:606] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Received request to transfer leadership
W20260709 13:00:42.715497  1633 connection.cc:256] RPC call timeout handler was delayed by -1.0282513160000235s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18830000000000002s for a response
I20260709 13:00:42.713912  2694 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:42.730891  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.692385  2848 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:42.735086  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.736754  1705 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:42.739010  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.739084  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.739112  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:42.739655  1739 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:42.739852  1590 raft_consensus.cc:2468] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:42.740953  1741 raft_consensus.cc:2393] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 3: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:42.742167  1740 raft_consensus.cc:2393] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 5: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:42.742528  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:42.743045  1738 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:42.746786  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.743743  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:42.748435  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.751238  2862 raft_consensus.cc:2804] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:42.751655  2862 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.752002  2862 raft_consensus.cc:3060] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:42.752743  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:42.753232  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.753424  1587 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:42.753957  1739 raft_consensus.cc:2368] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3.
I20260709 13:00:42.754240  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.754376  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.754768  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.754853  1740 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 3.
I20260709 13:00:42.755012  1735 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 3.
I20260709 13:00:42.755546  1739 raft_consensus.cc:2393] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 3: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:42.755749  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:42.756708  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.757298  1732 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:42.754386  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:42.727162  2860 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:42.759269  2860 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:42.760995  1738 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:00:42.761895  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:42.761754  1705 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:42.764084  1736 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:42.767117  2509 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:42.768208  2789 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.768478  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:42.768970  2509 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:42.768751  2789 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:42.769164  1590 raft_consensus.cc:2468] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:42.770879  2789 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:42.762148  2865 raft_consensus.cc:2804] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:42.763906  2780 raft_consensus.cc:2804] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:00:42.774796  2875 log.cc:927] Time spent T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:00:42.778031  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.814558  1663 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:42.778882  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.779384  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.815728  1665 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:42.779647  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.780332  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.816819  1660 raft_consensus.cc:2468] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:42.781018  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.779680  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:42.818130  1589 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:42.813297  2780 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:42.818624  2780 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:42.818836  1667 raft_consensus.cc:2393] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 4: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:42.819991  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:42.820663  1667 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:42.817706  1661 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:42.781749  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.781891  2863 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:42.782733  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:42.828783  2862 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:42.830120  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:42.830991  2863 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:42.831354  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:42.783073  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:42.831506  2862 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:42.831617  2789 consensus_queue.cc:1048] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:42.832137  1590 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:42.812316  2865 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.832988  2865 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:42.833060  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:42.833889  1590 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:42.834729  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:42.835484  1590 raft_consensus.cc:2393] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 6: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:42.836220  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:42.784164  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:42.839076  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:42.785152  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:42.785452  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:42.841058  1591 raft_consensus.cc:2393] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 6: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:42.841053  1587 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:42.842075  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:42.843209  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:42.843943  1591 raft_consensus.cc:2393] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 3: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:42.844679  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:42.785768  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:42.784880  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:42.786073  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:42.849535  1586 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:42.786173  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:42.791785  1736 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:00:42.792618  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.793143  2860 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:42.793383  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.858320  1666 raft_consensus.cc:2393] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 4: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:42.793730  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.794353  2674 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:42.797945  2855 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:42.804464  2848 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:42.806957  1556 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:59106 dropped due to backpressure: service queue is full with 50 items
I20260709 13:00:42.862375  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:42.864636  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:42.865007  1707 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:00:42.811656  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 49968.9us
I20260709 13:00:42.818634  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.824271  1589 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:00:42.825340  2742 raft_consensus.cc:2804] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:42.866029  1705 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:42.825501  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:42.866726  1661 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:42.826272  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.826629  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.827391  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.827281  2735 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:42.809789  1558 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:59112 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 960)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 946)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 948)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 947)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 572)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 584)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 588)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 961)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 959)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 962)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 963)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 590)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 593)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 956)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 943)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 578)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 583)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 964)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 580)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 945)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 573)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 949)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 581)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 950)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 944)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 969)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 586)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 958)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 951)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 585)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 575)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46836 (request call id 9)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 589)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 587)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 957)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 591)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 579)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 952)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 954)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 965)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 953)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 968)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 582)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 955)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 592)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 574)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 967)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 577)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 576)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 942)
I20260709 13:00:42.828311  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:42.849575  1592 raft_consensus.cc:2468] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:42.850874  1591 raft_consensus.cc:2393] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 3: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:42.836953  1590 raft_consensus.cc:2393] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 2: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:42.792317  2867 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:42.840270  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:42.859069  1659 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:42.865705  1588 raft_consensus.cc:2393] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 3: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:42.857402  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:42.876525  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:42.868531  1665 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:42.877660  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:42.868818  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:42.875564  1705 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:42.878387  1589 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:42.878611  2509 raft_consensus.cc:2804] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:42.878733  1705 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:42.879020  2509 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.879381  2509 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:42.864741  1556 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:59106 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 578)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 583)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 964)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 580)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 945)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 573)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 949)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 581)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 950)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 944)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 969)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 586)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 958)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 951)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 585)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 575)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46836 (request call id 9)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 589)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 587)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 957)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 591)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 579)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 952)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 954)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 965)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 953)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 968)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 582)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 955)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 592)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 574)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 967)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 577)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 576)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 942)
I20260709 13:00:42.879683  1705 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:42.880460  2694 raft_consensus.cc:2804] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:42.859858  1584 raft_consensus.cc:2376] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3. Re-sending same reply.
I20260709 13:00:42.881436  1705 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:42.881609  2863 raft_consensus.cc:2804] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:42.881856  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:42.882308  1705 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:42.883136  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:42.883458  2663 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:42.883692  2735 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:42.883908  2663 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:42.884305  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:42.884786  1658 raft_consensus.cc:2393] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 5: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:42.873631  2789 raft_consensus.cc:2804] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:42.885524  1583 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:42.885722  2789 raft_consensus.cc:697] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:42.886495  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:42.887230  1583 raft_consensus.cc:2393] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 2: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:42.887588  2780 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:42.888113  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:42.888720  1583 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 3.
I20260709 13:00:42.889816  2674 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:42.890516  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:42.891745  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:42.886741  2789 consensus_queue.cc:237] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:42.894302  1734 raft_consensus.cc:2393] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 3: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:42.892822  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:42.889748  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:42.896561  1588 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:42.884449  2735 raft_consensus.cc:2804] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:42.902525  1589 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
W20260709 13:00:42.903146  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 156394us
I20260709 13:00:42.890547  1660 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:00:42.913311  1661 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 4.
I20260709 13:00:42.898470  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.910720  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:42.884346  2663 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:42.921365  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:42.921525  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:42.922153  1592 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:42.872548  1664 raft_consensus.cc:2468] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:42.925351  1667 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:00:42.926671  1736 raft_consensus.cc:1275] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:42.921165  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:42.929015  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:42.916915  1584 raft_consensus.cc:2393] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 2: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:42.926390  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:42.931604  1591 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:42.894325  2867 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:42.918150  2862 raft_consensus.cc:2804] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:42.876145  2742 raft_consensus.cc:697] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:42.929833  1589 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:42.989455  1660 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:00:42.917135  2735 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:42.979161  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:43.002713  1590 raft_consensus.cc:2376] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3. Re-sending same reply.
W20260709 13:00:42.991299  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 109080us
I20260709 13:00:43.008162  1705 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:42.958797  2863 raft_consensus.cc:697] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 5 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:43.009893  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:43.010792  1586 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:00:43.016178  1592 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:00:42.998417  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:42.990407  2862 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:43.019359  2509 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } }
W20260709 13:00:43.021301  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 131101us
I20260709 13:00:43.029479  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:43.022900  1633 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:43.006110  1587 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5.
I20260709 13:00:43.024380  1589 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:43.025007  1591 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5.
I20260709 13:00:43.004467  2735 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:43.004292  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:43.034569  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:43.035434  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:43.037981  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:43.039793  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:43.042014  2509 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:00:43.042784  1589 raft_consensus.cc:2368] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5.
I20260709 13:00:43.043866  1633 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:43.044450  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:43.044219  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:43.045202  1737 raft_consensus.cc:3060] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:43.045524  1591 raft_consensus.cc:2393] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 3: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:43.046387  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:43.046873  1591 raft_consensus.cc:2376] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3. Re-sending same reply.
I20260709 13:00:43.047621  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:43.048105  1591 raft_consensus.cc:2376] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5. Re-sending same reply.
I20260709 13:00:43.044795  1633 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
W20260709 13:00:43.049477  2878 log.cc:927] Time spent T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 13:00:43.049700  1633 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
W20260709 13:00:43.050319  2877 log.cc:927] Time spent T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:00:43.050732  2858 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:43.050899  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:43.051146  2858 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.051510  2858 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:43.052102  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:43.053150  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:43.053328  2677 raft_consensus.cc:2804] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:43.053881  2677 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:43.054116  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:43.054374  2677 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:43.055212  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:43.051457  1590 raft_consensus.cc:2376] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5. Re-sending same reply.
I20260709 13:00:43.048852  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:43.044648  2765 raft_consensus.cc:2804] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:43.056661  1591 raft_consensus.cc:2393] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 3: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:43.033563  2862 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:43.061650  2509 raft_consensus.cc:993] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d: : Instructing follower 7e839e91a1314c2f9a99b25b17c916a6 to start an election
I20260709 13:00:43.063781  2509 raft_consensus.cc:1081] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Signalling peer 7e839e91a1314c2f9a99b25b17c916a6 to start an election
I20260709 13:00:43.064787  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:43.065627  1591 raft_consensus.cc:2393] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 2: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:43.037046  1583 raft_consensus.cc:2376] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4. Re-sending same reply.
I20260709 13:00:43.074661  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:43.075341  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:43.075742  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:43.031092  2867 consensus_queue.cc:1048] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:00:43.081898  1592 raft_consensus.cc:2468] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:00:43.081898  1586 raft_consensus.cc:2468] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:43.090704  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:43.056604  2780 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:43.060364  2765 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:43.073840  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:43.103209  1591 raft_consensus.cc:2376] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5. Re-sending same reply.
I20260709 13:00:43.104272  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:43.105052  1591 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:00:43.106485  1591 raft_consensus.cc:1240] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:43.055780  2885 raft_consensus.cc:2804] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:43.109655  2885 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:43.110105  2885 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:43.092638  2509 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:43.113410  2509 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:43.115468  2509 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:43.117096  2554 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3"
dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
 from {username='slave'} at 127.0.0.1:49238
I20260709 13:00:43.096644  1586 raft_consensus.cc:2368] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3.
I20260709 13:00:43.097235  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:43.098112  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:43.098745  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:43.100203  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:43.123039  1592 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:00:43.109063  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:43.060797  2694 raft_consensus.cc:697] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:43.122536  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:43.124898  1586 raft_consensus.cc:2368] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 3. Current term is 4.
I20260709 13:00:43.089767  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:43.124298  1589 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:43.125376  1707 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:43.127904  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:43.128515  1591 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:00:43.130738  1590 raft_consensus.cc:1275] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:43.105448  2765 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:43.133177  1583 raft_consensus.cc:1275] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:43.135339  1592 raft_consensus.cc:1275] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 13:00:43.138871  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 181032us
I20260709 13:00:43.139811  1558 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:43.152910  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:43.163856  2883 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:43.167801  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:43.174330  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:43.175096  1590 raft_consensus.cc:2368] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3.
I20260709 13:00:43.130843  1733 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:43.182615  1590 raft_consensus.cc:1275] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:43.089205  2742 consensus_queue.cc:237] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:43.134519  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:43.153434  2552 raft_consensus.cc:1240] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:43.173959  2848 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:43.186018  2848 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.101951  2863 consensus_queue.cc:237] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:43.186384  2848 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:43.192337  2677 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:43.194525  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 68656.1us
I20260709 13:00:43.201634  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:43.165632  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:43.207983  1589 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 3.
I20260709 13:00:43.216766  1558 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:43.192893  2694 consensus_queue.cc:237] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:43.235497  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:43.202867  2885 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:43.236490  1591 raft_consensus.cc:2393] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 3: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:43.239131  2663 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:43.239786  2860 raft_consensus.cc:2804] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:43.240272  2860 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.240626  2860 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:43.246824  1588 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:00:43.200366  2845 consensus_queue.cc:1059] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
W20260709 13:00:43.248620  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 199008us
I20260709 13:00:43.255424  2845 raft_consensus.cc:3055] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:43.255854  2845 raft_consensus.cc:740] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:43.256819  2845 consensus_queue.cc:260] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:43.258688  2845 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:43.259996  2663 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:43.263731  1633 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:43.270534  1737 raft_consensus.cc:2468] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
W20260709 13:00:43.271258  2831 log.cc:927] Time spent T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da: Append to log took a long time: real 0.163s	user 0.001s	sys 0.002s
I20260709 13:00:43.273000  2677 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:43.281446  2885 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:43.303882  1633 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:43.291986  2735 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:43.311833  2735 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:43.292048  2883 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:43.316525  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:43.316287  2862 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:43.288100  1707 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:43.299403  1660 consensus_queue.cc:237] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:43.294137  1486 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55138 (request call id 172) took 1623 ms. Trace:
W20260709 13:00:43.352766  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 64745us
I20260709 13:00:43.290833  1733 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 4.
I20260709 13:00:43.308730  2848 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:43.362730  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 58939.6us
I20260709 13:00:43.344830  2888 raft_consensus.cc:2804] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:43.365914  1707 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:43.367242  1633 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:43.336704  1486 rpcz_store.cc:276] 0709 13:00:41.671117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.671388 (+   271us) service_pool.cc:224] Handling call
0709 13:00:43.294045 (+1622657us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:42.572342 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:42.585628 (+ 13286us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:42.585672 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:00:42.585690 (+    18us) tablet.cc:662] Decoding operations
0709 13:00:42.586008 (+   318us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:42.586057 (+    49us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:42.586087 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:00:42.586256 (+   169us) tablet.cc:701] Row locks acquired
0709 13:00:42.586272 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:00:42.586395 (+   123us) write_op.cc:270] Start()
0709 13:00:42.586497 (+   102us) write_op.cc:276] Timestamp: P: 1783602042586359 usec, L: 0
0709 13:00:42.586522 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:00:42.587163 (+   641us) log.cc:844] Serialized 598 byte log entry
0709 13:00:42.825689 (+238526us) op_driver.cc:464] REPLICATION: finished
0709 13:00:42.957997 (+132308us) write_op.cc:301] APPLY: starting
0709 13:00:42.990215 (+ 32218us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:43.004342 (+ 14127us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:43.038047 (+ 33705us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:43.060368 (+ 22321us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:43.088737 (+ 28369us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:00:43.094808 (+  6071us) write_op.cc:312] APPLY: finished
0709 13:00:43.097836 (+  3028us) log.cc:844] Serialized 22 byte log entry
0709 13:00:43.098009 (+   173us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:43.098089 (+    80us) write_op.cc:454] Released schema lock
0709 13:00:43.098138 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:43.098486 (+   348us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:43.098532 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3807,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":102928,"apply.run_cpu_time_us":8469,"apply.run_wall_time_us":140505,"num_ops":1,"prepare.queue_time_us":222946,"prepare.run_cpu_time_us":2480,"prepare.run_wall_time_us":26120,"replication_time_us":187327,"thread_start_us":220793,"threads_started":2}]]}
I20260709 13:00:43.363164  2677 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:43.317667  2865 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:43.363583  2883 raft_consensus.cc:2749] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:43.370685  1633 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:43.378170  2896 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.378888  2896 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:43.370002  2694 raft_consensus.cc:2804] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:43.388993  1665 raft_consensus.cc:1275] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:43.371941  2426 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:43.396992  1666 raft_consensus.cc:1240] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:43.399901  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:43.400260  2862 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:43.400432  2858 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:43.401398  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:43.402065  2896 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:43.402433  2858 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:43.402647  2896 raft_consensus.cc:2804] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:43.403016  2896 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:43.403141  2858 raft_consensus.cc:2804] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:43.403410  2896 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:43.403522  2858 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:43.403954  2858 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:43.405963  2848 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:43.406605  1662 raft_consensus.cc:1275] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:43.407562  2694 raft_consensus.cc:697] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:43.408551  2694 consensus_queue.cc:237] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:43.409549  2865 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:43.381503  2891 raft_consensus.cc:2804] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:43.410737  2891 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.411167  2891 raft_consensus.cc:3060] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:43.413319  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:43.393533  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:43.429809  1658 raft_consensus.cc:2393] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 6: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
W20260709 13:00:43.434309  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 63742.4us
I20260709 13:00:43.439430  1633 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:43.440821  2677 raft_consensus.cc:697] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:43.444612  1633 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
W20260709 13:00:43.457894  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 89079.5us
I20260709 13:00:43.460103  2888 raft_consensus.cc:697] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 3 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:43.449165  2677 consensus_queue.cc:237] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:43.473249  2765 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:43.475870  2765 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:43.476634  1477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 419256us
I20260709 13:00:43.464898  2897 raft_consensus.cc:2804] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:43.479297  2897 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:43.479858  2897 raft_consensus.cc:3060] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:43.482263  2860 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:43.484679  2860 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:43.485360  1739 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:43674
I20260709 13:00:43.470762  2902 raft_consensus.cc:2804] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:43.493501  1739 raft_consensus.cc:606] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Received request to transfer leadership
I20260709 13:00:43.469759  2900 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:43.494246  2900 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:43.495074  2900 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:43.495962  2552 raft_consensus.cc:1275] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 2 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:43.505997  2901 consensus_queue.cc:1048] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:43.515887  2891 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:43.497555  2888 consensus_queue.cc:237] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:43.518630  2891 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:43.520753  2858 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:43.543027  2902 raft_consensus.cc:697] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:00:43.547000  2902 consensus_queue.cc:237] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:43.552485  2896 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:43.567312  2858 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:43.571604  2897 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:43.757200  2896 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:44.281414  2897 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:44.991482  2900 consensus_meta.cc:287] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 1.496s	user 0.011s	sys 0.000s
I20260709 13:00:44.992182  2900 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:45.078836  1613 debug-util.cc:398] Leaking SignalData structure 0x7b080012ab40 after lost signal to thread 434
I20260709 13:00:45.124336  2900 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:45.412607  2426 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.000s	sys 0.012s
W20260709 13:00:45.413111  2426 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.000s	sys 0.013s
W20260709 13:00:45.606961  1558 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.361s	user 0.014s	sys 0.016s
W20260709 13:00:45.614607  1558 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.369s	user 0.015s	sys 0.016s
W20260709 13:00:45.616568  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 2.40353e+06us
I20260709 13:00:45.622215  1558 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:45.647939  1661 raft_consensus.cc:1275] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:00:45.655654  1633 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.205s	user 0.026s	sys 0.021s
W20260709 13:00:45.656548  1633 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.206s	user 0.027s	sys 0.022s
W20260709 13:00:45.656950  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 2.21222e+06us
I20260709 13:00:45.658087  1633 leader_election.cc:400] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5.
I20260709 13:00:45.658597  1633 leader_election.cc:403] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:45.673187  2911 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.674294  1633 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:45.678143  2911 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:45.678670  2912 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.680763  2912 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:45.682938  2912 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:45.683471  2912 raft_consensus.cc:2749] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5.
I20260709 13:00:45.684026  2911 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:45.684087  2912 raft_consensus.cc:2804] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:45.680080  1633 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:45.686340  1633 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:45.689064  2911 raft_consensus.cc:2804] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:45.689495  2911 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.689860  2911 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:45.691332  2912 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:45.691766  2912 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:45.692443  2765 raft_consensus.cc:2804] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:45.692904  2765 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:45.693295  2765 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:45.695506  1633 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:00:45.709254  2914 raft_consensus.cc:2804] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:45.711103  2914 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.711469  2914 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:45.713598  2789 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.714279  2915 consensus_queue.cc:1048] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:45.714241  2789 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:45.715669  2915 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.716110  2915 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:45.717056  2789 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:00:45.722916  1633 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:45.724499  2912 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:45.716532  2911 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:45.718457  2915 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:45.730639  2910 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:45.731307  2910 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:45.734109  2898 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.734190  2912 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:45.737319  2912 raft_consensus.cc:2804] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:45.737339  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:45.737850  2912 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:45.738246  2912 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:45.738133  1661 raft_consensus.cc:2468] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 2.
I20260709 13:00:45.727792  2915 consensus_queue.cc:1048] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:00:45.734771  2898 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:45.743166  1707 connection.cc:256] RPC call timeout handler was delayed by -2.1858740000000125s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17520000000000002s for a response
W20260709 13:00:45.743711  1707 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.807s (SENT) [suppressed 31 similar messages]
I20260709 13:00:45.760183  1633 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:00:45.762324  2915 raft_consensus.cc:2764] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:00:45.740132  2910 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:45.767620  1633 leader_election.cc:400] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3.
I20260709 13:00:45.768404  1633 leader_election.cc:403] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:45.757957  2911 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:45.759842  2916 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.768898  2914 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:45.770992  2898 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:45.768659  2765 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } }
I20260709 13:00:45.773177  2917 raft_consensus.cc:2749] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3.
I20260709 13:00:45.773216  1633 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:45.774430  2917 raft_consensus.cc:2804] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:45.774833  2917 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.775184  2917 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:45.775628  2765 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:00:45.781632  1633 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:45.782938  2914 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:00:45.783531  2765 raft_consensus.cc:2804] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:45.784266  2765 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:45.784838  2765 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:45.785422  2916 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:45.786834  2917 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:45.782955  1633 leader_election.cc:400] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 3. Current term is 4.
I20260709 13:00:45.787823  2916 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:45.788543  1633 leader_election.cc:403] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:45.791033  2917 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:45.793699  2916 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:00:45.854400  2916 raft_consensus.cc:2749] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 3. Current term is 4.
I20260709 13:00:45.865556  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:45.866504  1736 raft_consensus.cc:2393] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 2: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:45.866459  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:00:45.866899  2552 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.338s	user 0.017s	sys 0.031s
W20260709 13:00:45.867244  2552 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.338s	user 0.017s	sys 0.031s
I20260709 13:00:45.867427  1738 raft_consensus.cc:2393] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 3: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:45.867802  2902 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:45.868017  2552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 27) took 2359 ms. Trace:
I20260709 13:00:45.868360  2902 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:45.868929  2912 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:45.869755  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:45.870527  1738 raft_consensus.cc:2393] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 2: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:45.871287  2912 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:45.868387  2552 rpcz_store.cc:276] 0709 13:00:43.508601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.508786 (+   185us) service_pool.cc:224] Handling call
0709 13:00:43.509451 (+   665us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:43.509845 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:43.509886 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:43.528566 (+ 18680us) log.cc:844] Serialized 501 byte log entry
0709 13:00:45.867593 (+2339027us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:45.867635 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.867750 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:45.867803 (+    53us) raft_consensus.cc:1685] finished
0709 13:00:45.867818 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.867943 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":2338546,"threads_started":1,"wal-append.queue_time_us":2040858}
I20260709 13:00:45.870581  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:45.874457  1739 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 5.
I20260709 13:00:45.877756  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:45.876966  2914 raft_consensus.cc:2955] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 6d4de2ce0683442498244b9529127f91 (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:00:45.878533  1737 raft_consensus.cc:2368] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3.
I20260709 13:00:45.879185  2552 raft_consensus.cc:2955] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 6d4de2ce0683442498244b9529127f91 (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:00:45.889164  2910 consensus_queue.cc:1048] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:45.891108  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:45.892030  1737 raft_consensus.cc:2393] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 2: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:45.896695  2902 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:45.896577  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:00:45.903827  2553 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:45.906978  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:45.912600  1739 raft_consensus.cc:2368] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3.
I20260709 13:00:45.916759  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:45.917606  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:45.917814  1739 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 4.
I20260709 13:00:45.922019  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:45.922792  1739 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 4.
W20260709 13:00:45.925292  1613 debug-util.cc:398] Leaking SignalData structure 0x7b0800146740 after lost signal to thread 1524
I20260709 13:00:45.930511  2553 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 3.
I20260709 13:00:45.931949  1490 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51168 (request call id 17) took 3182 ms. Trace:
I20260709 13:00:45.926478  1488 catalog_manager.cc:5697] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 1 to 2, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 2 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:00:45.932343  1490 rpcz_store.cc:276] 0709 13:00:42.749704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.749877 (+   173us) service_pool.cc:224] Handling call
0709 13:00:45.931880 (+3182003us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":205718,"reported_tablets":2}
I20260709 13:00:45.934670  1488 catalog_manager.cc:5697] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 1 to 3, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:45.939141  1739 raft_consensus.cc:1240] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:00:45.904078  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:45.946550  1737 raft_consensus.cc:2368] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3.
I20260709 13:00:45.947630  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:45.937018  1488 catalog_manager.cc:5697] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 3 to 5, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:45.903934  2765 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:45.952337  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:45.952682  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:45.953953  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:45.954593  1733 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:45.957702  1741 raft_consensus.cc:2393] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 3: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:45.952523  2765 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:45.957106  1737 raft_consensus.cc:1275] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:45.962209  2789 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.962752  2789 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:45.963351  2735 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.964092  2735 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:45.964771  2789 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:45.967254  2735 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:45.971521  2554 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:45.973142  2554 raft_consensus.cc:3060] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:45.973184  1556 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.757s	user 0.023s	sys 0.013s
W20260709 13:00:45.974563  1556 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.759s	user 0.023s	sys 0.013s
I20260709 13:00:45.977052  1733 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 4.
I20260709 13:00:45.980055  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:45.981032  1741 raft_consensus.cc:2393] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 3: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:45.984642  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:00:45.987990  1633 connection.cc:256] RPC call timeout handler was delayed by -3.2426962270000104s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17400000000000002s for a response
I20260709 13:00:45.988286  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:45.989423  1738 raft_consensus.cc:2368] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 3. Current term is 4.
I20260709 13:00:45.990653  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:45.991518  1736 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:00:45.992322  1733 raft_consensus.cc:2393] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 3: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:45.992580  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:45.983484  2863 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:45.994316  2863 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:45.993440  1738 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:45.997859  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:45.998872  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:45.999037  1739 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 3.
W20260709 13:00:45.998277  1633 connection.cc:256] RPC call timeout handler was delayed by -3.1688962270000047s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18220000000000003s for a response
I20260709 13:00:46.007296  1736 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 3.
I20260709 13:00:46.009492  2913 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.010250  2913 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:46.014256  2913 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:46.009536  2914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:39130 (request call id 59) took 2719 ms. Trace:
I20260709 13:00:46.017959  2914 rpcz_store.cc:276] 0709 13:00:43.289633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.289927 (+   294us) service_pool.cc:224] Handling call
0709 13:00:43.363380 (+ 73453us) log.cc:844] Serialized 501 byte log entry
0709 13:00:45.733189 (+2369809us) spinlock_profiling.cc:243] Waited 968 us on lock 0x7b18001c9fe0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80fcbd01 00007f1b80f08691 00007f1b80ee8eaa 00007f1b80eefd53 00007f1b80eefcd9 00007f1b80eefc69 00007f1b80eefc31 00007f1b80eeedfd 000000000038f354 000000000038f199
0709 13:00:46.009251 (+276062us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":50143,"raft.run_cpu_time_us":24529,"raft.run_wall_time_us":2304511,"spinlock_wait_cycles":2226944,"thread_start_us":61983,"threads_started":1,"wal-append.queue_time_us":83302,"wal-append.run_cpu_time_us":2555,"wal-append.run_wall_time_us":1282936}
I20260709 13:00:46.020423  1475 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 75a149db07824e3fb3c1f721b61d6c20 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:46.003515  2765 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:46.021638  2765 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:46.023922  2765 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:46.032680  1738 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 4.
I20260709 13:00:46.025328  2554 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:00:46.034317  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 412266us
I20260709 13:00:46.035079  1558 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:46.036091  1558 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:46.039258  1558 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:00:46.041879  1705 connection.cc:256] RPC call timeout handler was delayed by -2.4138677970000231s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20910000000000004s for a response
I20260709 13:00:46.036564  2848 raft_consensus.cc:2804] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:46.037565  2791 raft_consensus.cc:2804] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:00:46.047214  1705 connection.cc:256] RPC call timeout handler was delayed by -2.2901460240000233s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17520000000000002s for a response
I20260709 13:00:46.036580  2860 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.047833  2848 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.049312  2848 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:46.049748  1613 debug-util.cc:398] Leaking SignalData structure 0x7b080035d740 after lost signal to thread 1616
W20260709 13:00:46.050148  1613 debug-util.cc:398] Leaking SignalData structure 0x7b080035d600 after lost signal to thread 1617
I20260709 13:00:46.048841  2860 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:46.053017  1707 connection.cc:256] RPC call timeout handler was delayed by -1.7100816079999959s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1882s for a response
I20260709 13:00:46.053180  2860 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:46.053563  1707 connection.cc:256] RPC call timeout handler was delayed by -1.636409034000053s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1819s for a response
W20260709 13:00:46.053907  1707 connection.cc:256] RPC call timeout handler was delayed by -1.5896090340000342s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18710000000000002s for a response
W20260709 13:00:46.054237  1707 connection.cc:256] RPC call timeout handler was delayed by -1.5450542539999788s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
W20260709 13:00:46.054551  1707 connection.cc:256] RPC call timeout handler was delayed by -1.540109034000011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1926s for a response
W20260709 13:00:46.054863  1707 connection.cc:256] RPC call timeout handler was delayed by -1.4739542539999775s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1768s for a response
W20260709 13:00:46.055184  1707 connection.cc:256] RPC call timeout handler was delayed by -1.4712542539999731s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1771s for a response
W20260709 13:00:46.056299  1705 connection.cc:256] RPC call timeout handler was delayed by -2.0532756640000116s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1819s for a response
W20260709 13:00:46.056717  1705 connection.cc:256] RPC call timeout handler was delayed by -2.0386304740000014s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1771s for a response
W20260709 13:00:46.057016  1705 connection.cc:256] RPC call timeout handler was delayed by -2.03224306300001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1882s for a response
W20260709 13:00:46.058687  1705 connection.cc:256] RPC call timeout handler was delayed by -1.7652756640000007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21389999999999998s for a response
W20260709 13:00:46.059044  1705 connection.cc:256] RPC call timeout handler was delayed by -1.6662000430000035s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2162s for a response
I20260709 13:00:46.040925  2845 raft_consensus.cc:2804] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:00:46.060961  1705 connection.cc:256] RPC call timeout handler was delayed by -1.5991536539999629s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1537s for a response
W20260709 13:00:46.062037  1705 connection.cc:256] RPC call timeout handler was delayed by -1.5613536539999586s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1579s for a response
W20260709 13:00:46.062464  1705 connection.cc:256] RPC call timeout handler was delayed by -1.5595536539999557s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15810000000000002s for a response
W20260709 13:00:46.062922  1705 connection.cc:256] RPC call timeout handler was delayed by -1.5514536539999995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15900000000000003s for a response
W20260709 13:00:46.063333  1705 connection.cc:256] RPC call timeout handler was delayed by -1.5379536539999776s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1605s for a response
W20260709 13:00:46.063781  1705 connection.cc:256] RPC call timeout handler was delayed by -1.5163536539999996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16290000000000002s for a response
W20260709 13:00:46.064190  1705 connection.cc:256] RPC call timeout handler was delayed by -1.5022598539999876s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15810000000000002s for a response
W20260709 13:00:46.064652  1705 connection.cc:256] RPC call timeout handler was delayed by -1.4623536539999691s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
W20260709 13:00:46.065268  1707 connection.cc:256] RPC call timeout handler was delayed by -1.3893542540000112s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18620000000000003s for a response
I20260709 13:00:46.065348  2509 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:00:46.065793  1707 connection.cc:256] RPC call timeout handler was delayed by -1.3844090340000434s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20990000000000003s for a response
W20260709 13:00:46.066169  1707 connection.cc:256] RPC call timeout handler was delayed by -1.3781090340000333s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2106s for a response
I20260709 13:00:46.065987  2509 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:46.066498  1707 connection.cc:256] RPC call timeout handler was delayed by -1.349754254000004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1906s for a response
W20260709 13:00:46.066830  1707 connection.cc:256] RPC call timeout handler was delayed by -1.3484090340000421s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21389999999999998s for a response
W20260709 13:00:46.067216  1707 connection.cc:256] RPC call timeout handler was delayed by -1.3298714349999727s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1537s for a response
W20260709 13:00:46.067660  1707 connection.cc:256] RPC call timeout handler was delayed by -1.3277090340000086s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2162s for a response
W20260709 13:00:46.068086  1707 connection.cc:256] RPC call timeout handler was delayed by -1.2902714349999655s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15810000000000002s for a response
W20260709 13:00:46.068498  1707 connection.cc:256] RPC call timeout handler was delayed by -1.2821714350000093s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15900000000000003s for a response
W20260709 13:00:46.068953  1707 connection.cc:256] RPC call timeout handler was delayed by -1.2686714349999875s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1605s for a response
W20260709 13:00:46.069943  1707 connection.cc:256] RPC call timeout handler was delayed by -1.2678542539999853s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19970000000000002s for a response
W20260709 13:00:46.070474  1705 connection.cc:256] RPC call timeout handler was delayed by -1.3912536539999678s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1768s for a response
W20260709 13:00:46.071025  1705 connection.cc:256] RPC call timeout handler was delayed by -1.3066536540000016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18620000000000003s for a response
W20260709 13:00:46.071465  1705 connection.cc:256] RPC call timeout handler was delayed by -1.3021536539999943s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1867s for a response
W20260709 13:00:46.071895  1705 connection.cc:256] RPC call timeout handler was delayed by -1.2724536540000031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19s for a response
W20260709 13:00:46.072322  1705 connection.cc:256] RPC call timeout handler was delayed by -1.2670536539999944s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1906s for a response
W20260709 13:00:46.072751  1705 connection.cc:256] RPC call timeout handler was delayed by -1.2274536539999872s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.195s for a response
W20260709 13:00:46.073271  1705 connection.cc:256] RPC call timeout handler was delayed by -1.1851536539999756s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19970000000000002s for a response
W20260709 13:00:46.073730  1705 connection.cc:256] RPC call timeout handler was delayed by -1.1596472660000359s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1633s for a response
W20260709 13:00:46.074158  1705 connection.cc:256] RPC call timeout handler was delayed by -1.1554536539999845s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20299999999999999s for a response
W20260709 13:00:46.074563  1705 connection.cc:256] RPC call timeout handler was delayed by -1.0870536539999875s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2106s for a response
W20260709 13:00:46.075357  1705 connection.cc:256] RPC call timeout handler was delayed by -1.0735536539999657s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2121s for a response
W20260709 13:00:46.075693  1705 connection.cc:256] RPC call timeout handler was delayed by -1.0690536539999584s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2126s for a response
W20260709 13:00:46.075986  1705 connection.cc:256] RPC call timeout handler was delayed by -1.0501536539999847s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2147s for a response
W20260709 13:00:46.076336  1705 connection.cc:256] RPC call timeout handler was delayed by -1.0366536539999629s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2162s for a response
W20260709 13:00:46.076779  1705 connection.cc:256] RPC call timeout handler was delayed by -1.0132585009999957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19410000000000002s for a response
W20260709 13:00:46.077250  1705 connection.cc:256] RPC call timeout handler was delayed by -1.0058759450000139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19740000000000002s for a response
I20260709 13:00:46.048363  2791 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:46.081359  1707 connection.cc:256] RPC call timeout handler was delayed by -1.2358494789999668s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19990000000000002s for a response
W20260709 13:00:46.082508  1707 connection.cc:256] RPC call timeout handler was delayed by -1.1562542539999754s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2121s for a response
W20260709 13:00:46.083096  1707 connection.cc:256] RPC call timeout handler was delayed by -1.1328542539999944s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2147s for a response
W20260709 13:00:46.083581  1707 connection.cc:256] RPC call timeout handler was delayed by -1.0860542539999756s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21989999999999998s for a response
W20260709 13:00:46.084131  1707 connection.cc:256] RPC call timeout handler was delayed by -1.0332600220000359s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2247s for a response
W20260709 13:00:46.084642  1707 connection.cc:256] RPC call timeout handler was delayed by -1.0031714350000129s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19s for a response
I20260709 13:00:46.061455  2860 raft_consensus.cc:2804] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:46.078766  2694 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:46.075043  2789 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.088810  2509 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:46.061995  2845 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:46.090458  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 51293.9us
I20260709 13:00:46.074873  2735 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.090337  2509 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.092118  1558 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:46.091586  2509 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:46.085162  2791 raft_consensus.cc:3060] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:46.089287  2860 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.091013  2694 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:46.100955  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:00:46.101722  2553 raft_consensus.cc:1240] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 3 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:46.102316  2694 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:46.091185  2789 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:46.104966  2789 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:46.095197  2735 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:46.092494  2845 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:46.107560  2735 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:46.100015  2860 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:46.107569  2848 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:46.097836  1707 leader_election.cc:336] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.771s (SENT)
I20260709 13:00:46.112071  2554 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 3 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:46.115264  2883 consensus_queue.cc:1059] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:46.116675  2554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:49238 (request call id 7) took 3000 ms. Trace:
I20260709 13:00:46.116987  2883 raft_consensus.cc:3055] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:46.112466  2509 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:46.115193  1558 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:46.118696  1705 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:46.113680  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.120718  2926 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:46.121312  1664 raft_consensus.cc:3060] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:46.121464  2926 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.122058  2926 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:46.127157  2509 raft_consensus.cc:2749] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:46.127991  1707 leader_election.cc:336] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.871s (SENT)
I20260709 13:00:46.130597  2845 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:46.131501  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 94234.6us
W20260709 13:00:46.133661  1707 leader_election.cc:336] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.926s (SENT)
W20260709 13:00:46.136101  1707 leader_election.cc:336] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.999s (SENT)
I20260709 13:00:46.136368  2863 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:00:46.143095  1707 leader_election.cc:336] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 2.099s (SENT)
I20260709 13:00:46.144899  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:00:46.117163  2554 rpcz_store.cc:276] 0709 13:00:43.116277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.116915 (+   638us) service_pool.cc:224] Handling call
0709 13:00:45.971201 (+2854286us) spinlock_profiling.cc:243] Waited 3.03 ms on lock 0x7b58001c3b98. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7de6ab71 00007f1b7de6aa22 00007f1b86d83c09 00007f1b85eddee0 00007f1b85fa70ab 00007f1b85fa7131 00007f1b85f6ba40 00007f1b85f571e9 00007f1b85f56c85 00007f1b7f4db254
0709 13:00:46.116543 (+145342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6966656}
I20260709 13:00:46.151607  1664 raft_consensus.cc:2468] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 3.
I20260709 13:00:46.153388  2848 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:46.154381  1705 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:46.155706  1705 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:46.117758  2883 raft_consensus.cc:740] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:46.157328  1705 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:46.158062  1705 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:46.162047  1705 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:46.161543  2674 raft_consensus.cc:2804] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:46.165522  1556 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:46.168373  2509 raft_consensus.cc:2804] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:46.172535  2509 raft_consensus.cc:697] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 5 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:46.155710  2663 raft_consensus.cc:2804] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:46.162171  1613 debug-util.cc:398] Leaking SignalData structure 0x7b08002ab6e0 after lost signal to thread 1691
I20260709 13:00:46.161926  2863 raft_consensus.cc:2804] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:46.180152  2509 consensus_queue.cc:237] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:46.166337  2674 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:00:46.177023  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 61917.1us
I20260709 13:00:46.126340  2735 consensus_queue.cc:1048] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:00:46.160004  2848 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:46.184125  2848 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:46.166635  2780 raft_consensus.cc:2804] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:46.194622  1707 leader_election.cc:336] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 2.121s (SENT)
I20260709 13:00:46.178323  2931 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:00:46.211779  1707 leader_election.cc:336] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 2.126s (SENT)
W20260709 13:00:46.213631  1707 leader_election.cc:336] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 2.170s (SENT)
I20260709 13:00:46.214872  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:46.177789  2663 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:46.168608  2791 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:46.217537  1707 leader_election.cc:336] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 2.199s (SENT)
I20260709 13:00:46.210695  2931 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.185333  2674 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:46.219523  1707 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:46.206176  2780 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:46.191638  2928 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:46.226322  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:46.226703  1732 raft_consensus.cc:1275] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:00:46.231416  1633 connection.cc:256] RPC call timeout handler was delayed by -3.0545962269999904s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19490000000000002s for a response
W20260709 13:00:46.227420  1613 debug-util.cc:398] Leaking SignalData structure 0x7b0800369bc0 after lost signal to thread 2594
I20260709 13:00:46.228073  2845 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:46.232860  1613 debug-util.cc:398] Leaking SignalData structure 0x7b08000e6920 after lost signal to thread 2861
W20260709 13:00:46.233206  1613 debug-util.cc:398] Leaking SignalData structure 0x7b080030a3a0 after lost signal to thread 2862
W20260709 13:00:46.233520  1613 debug-util.cc:398] Leaking SignalData structure 0x7b08002caca0 after lost signal to thread 2865
W20260709 13:00:46.233798  1613 debug-util.cc:398] Leaking SignalData structure 0x7b08002f2e80 after lost signal to thread 2867
W20260709 13:00:46.234071  1613 debug-util.cc:398] Leaking SignalData structure 0x7b08002a44a0 after lost signal to thread 2869
W20260709 13:00:46.234346  1613 debug-util.cc:398] Leaking SignalData structure 0x7b08002b7820 after lost signal to thread 2871
I20260709 13:00:46.218947  2663 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:46.234601  1613 debug-util.cc:398] Leaking SignalData structure 0x7b08002c8860 after lost signal to thread 2873
W20260709 13:00:46.234943  1613 debug-util.cc:398] Leaking SignalData structure 0x7b0800302500 after lost signal to thread 2878
W20260709 13:00:46.235195  1613 debug-util.cc:398] Leaking SignalData structure 0x7b0800302a60 after lost signal to thread 2879
I20260709 13:00:46.235539  2848 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:46.235833  2926 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:46.237444  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:46.235924  2928 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:46.235466  1613 debug-util.cc:398] Leaking SignalData structure 0x7b0800302580 after lost signal to thread 2880
I20260709 13:00:46.238381  1737 raft_consensus.cc:2468] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 2.
I20260709 13:00:46.238574  2926 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:46.211063  2863 raft_consensus.cc:697] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
W20260709 13:00:46.239827  1613 debug-util.cc:398] Leaking SignalData structure 0x7b0800302600 after lost signal to thread 2881
I20260709 13:00:46.216526  2927 raft_consensus.cc:2749] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:46.239660  2780 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:46.224776  2931 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:46.249615  1705 leader_election.cc:336] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.579s (SENT)
I20260709 13:00:46.245858  2935 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.264945  2791 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:46.262573  2863 consensus_queue.cc:237] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:46.262619  1633 connection.cc:256] RPC call timeout handler was delayed by -2.8929259939999952s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1552s for a response
I20260709 13:00:46.261226  1705 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:00:46.254839  1613 debug-util.cc:398] Leaking SignalData structure 0x7b0800279fc0 after lost signal to thread 2884
W20260709 13:00:46.280447  1633 connection.cc:256] RPC call timeout handler was delayed by -2.8758259939999675s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15710000000000002s for a response
W20260709 13:00:46.281494  1633 connection.cc:256] RPC call timeout handler was delayed by -2.8349962269999764s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21930000000000002s for a response
W20260709 13:00:46.282110  1633 connection.cc:256] RPC call timeout handler was delayed by -2.7966259939999532s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16590000000000002s for a response
W20260709 13:00:46.282451  1633 connection.cc:256] RPC call timeout handler was delayed by -2.7930259940000042s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
W20260709 13:00:46.283227  1633 connection.cc:256] RPC call timeout handler was delayed by -2.7237259940000058s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17400000000000002s for a response
W20260709 13:00:46.286113  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 68600.2us
I20260709 13:00:46.220194  2883 consensus_queue.cc:260] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:00:46.279285  1613 debug-util.cc:398] Leaking SignalData structure 0x7b0800302960 after lost signal to thread 2885
W20260709 13:00:46.288316  1707 leader_election.cc:336] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 2.247s (SENT)
I20260709 13:00:46.256951  2934 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
W20260709 13:00:46.288851  1633 connection.cc:256] RPC call timeout handler was delayed by -2.6778259939999884s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1791s for a response
I20260709 13:00:46.257663  2936 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:46.296665  1633 connection.cc:256] RPC call timeout handler was delayed by -2.6193259940000075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18560000000000001s for a response
W20260709 13:00:46.298409  1633 connection.cc:256] RPC call timeout handler was delayed by -2.6058259939999857s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18710000000000002s for a response
W20260709 13:00:46.298751  1633 connection.cc:256] RPC call timeout handler was delayed by -2.5635259939999742s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1918s for a response
W20260709 13:00:46.299005  1633 connection.cc:256] RPC call timeout handler was delayed by -2.5095259940000005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1978s for a response
W20260709 13:00:46.299292  1633 connection.cc:256] RPC call timeout handler was delayed by -2.5059259939999947s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19820000000000002s for a response
W20260709 13:00:46.299579  1633 connection.cc:256] RPC call timeout handler was delayed by -2.4717259939999963s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.202s for a response
W20260709 13:00:46.299849  1633 connection.cc:256] RPC call timeout handler was delayed by -2.42042599399997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2077s for a response
W20260709 13:00:46.299067  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 88505us
W20260709 13:00:46.300094  1633 connection.cc:256] RPC call timeout handler was delayed by -2.3880259939999746s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21130000000000002s for a response
W20260709 13:00:46.300422  1633 connection.cc:256] RPC call timeout handler was delayed by -2.3592259939999849s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21450000000000002s for a response
W20260709 13:00:46.300664  1633 connection.cc:256] RPC call timeout handler was delayed by -2.347525993999966s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2158s for a response
W20260709 13:00:46.300920  1633 connection.cc:256] RPC call timeout handler was delayed by -2.1536962270000117s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29500000000000004s for a response
W20260709 13:00:46.301188  1633 connection.cc:256] RPC call timeout handler was delayed by -2.0024962269999946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3118s for a response
W20260709 13:00:46.301443  1633 connection.cc:256] RPC call timeout handler was delayed by -1.8861661789999857s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1527s for a response
W20260709 13:00:46.301695  1633 connection.cc:256] RPC call timeout handler was delayed by -1.8285661790000063s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15910000000000002s for a response
W20260709 13:00:46.301952  1633 connection.cc:256] RPC call timeout handler was delayed by -1.8258661790000019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15940000000000001s for a response
W20260709 13:00:46.302197  1633 connection.cc:256] RPC call timeout handler was delayed by -1.8231661789999976s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1597s for a response
W20260709 13:00:46.302443  1633 connection.cc:256] RPC call timeout handler was delayed by -1.657566179000014s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1781s for a response
W20260709 13:00:46.302690  1633 connection.cc:256] RPC call timeout handler was delayed by -1.6332661789999747s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18080000000000002s for a response
W20260709 13:00:46.302945  1633 connection.cc:256] RPC call timeout handler was delayed by -1.6116661789999966s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18320000000000003s for a response
W20260709 13:00:46.303208  1633 connection.cc:256] RPC call timeout handler was delayed by -1.54956617900001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19010000000000002s for a response
W20260709 13:00:46.303504  1633 connection.cc:256] RPC call timeout handler was delayed by -1.5324661789999823s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.192s for a response
W20260709 13:00:46.303769  1633 connection.cc:256] RPC call timeout handler was delayed by -1.5018661789999896s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19540000000000002s for a response
W20260709 13:00:46.304066  1633 connection.cc:256] RPC call timeout handler was delayed by -1.4919661789999736s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1965s for a response
W20260709 13:00:46.304360  1633 connection.cc:256] RPC call timeout handler was delayed by -1.3299661789999959s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21450000000000002s for a response
W20260709 13:00:46.304630  1633 connection.cc:256] RPC call timeout handler was delayed by -1.304766179000012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21730000000000002s for a response
W20260709 13:00:46.304910  1633 connection.cc:256] RPC call timeout handler was delayed by -1.2945259939999687s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3328s for a response
I20260709 13:00:46.265161  2935 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:46.288498  2938 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:46.311949  2426 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:46.322804  2902 consensus_queue.cc:1048] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:46.306440  1558 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:46.306341  2934 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:46.326020  2791 raft_consensus.cc:2804] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:46.326444  2791 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.326905  2791 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:46.329543  2883 raft_consensus.cc:3060] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:46.335058  1558 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:46.337831  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.313206  2928 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:46.295826  1613 debug-util.cc:398] Leaking SignalData structure 0x7b08002a42a0 after lost signal to thread 2886
W20260709 13:00:46.342037  1613 debug-util.cc:398] Leaking SignalData structure 0x7b08003025e0 after lost signal to thread 2887
W20260709 13:00:46.342700  1613 debug-util.cc:398] Leaking SignalData structure 0x7b0800302880 after lost signal to thread 2889
I20260709 13:00:46.318483  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:46.345192  1658 raft_consensus.cc:2368] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 3. Current term is 4.
I20260709 13:00:46.345201  1664 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:46.289165  2677 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.351240  2677 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:46.356712  2677 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:46.345454  2902 raft_consensus.cc:2804] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:46.357389  2902 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:46.357810  2902 raft_consensus.cc:3060] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:46.345587  2845 raft_consensus.cc:2804] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:46.361449  2845 raft_consensus.cc:697] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:46.361745  2934 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:00:46.332012  2935 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:46.362385  2845 consensus_queue.cc:237] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:46.356932  2663 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:46.319320  2674 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:46.370668  2674 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:46.374110  1558 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:00:46.352751  1705 leader_election.cc:336] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.121s (SENT)
I20260709 13:00:46.384093  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:46.378023  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 191960us
I20260709 13:00:46.390827  1705 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:46.393954  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:46.390834  2928 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.396118  1664 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:46.398955  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.399940  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.400513  1662 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:46.400533  1661 raft_consensus.cc:2376] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5. Re-sending same reply.
W20260709 13:00:46.400827  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 48583.7us
I20260709 13:00:46.398579  2928 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:46.399904  2863 raft_consensus.cc:2749] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:46.403852  2940 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.406358  2940 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:46.407613  2928 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:46.408537  2940 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:46.396163  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:46.408582  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:46.409443  1658 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:46.409761  1661 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:46.408871  2663 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:46.409183  2791 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:46.412647  2791 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:46.376758  2860 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } }
I20260709 13:00:46.419051  2860 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:46.418645  2780 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:46.423768  2931 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:46.426980  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:00:46.427206  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:46.428175  1592 raft_consensus.cc:1275] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:00:46.428723  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:46.429205  2945 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:46.433437  2926 consensus_queue.cc:1059] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:46.429251  2935 consensus_queue.cc:1048] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:00:46.459316  2426 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:46.459827  2928 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.429205  1558 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:46.435621  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:46.436079  2780 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:46.436921  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.437522  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.440920  1738 raft_consensus.cc:2468] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 3.
I20260709 13:00:46.441963  1663 raft_consensus.cc:1240] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:46.442104  1662 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:46.442675  2902 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:46.443318  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.464994  1660 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:46.432586  1556 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:46.446980  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:46.473760  1659 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5.
I20260709 13:00:46.452153  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.475294  1666 raft_consensus.cc:2393] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 2: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:46.453596  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.476353  1665 raft_consensus.cc:3060] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:46.462507  1661 raft_consensus.cc:2393] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 4: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
W20260709 13:00:46.480759  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 51668.3us
I20260709 13:00:46.480422  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.482417  1660 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:46.481124  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.484208  1662 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:46.488090  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 55593.2us
I20260709 13:00:46.490065  1663 raft_consensus.cc:2393] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 3: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:46.490710  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.494112  1659 raft_consensus.cc:2393] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 3: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:46.494467  1738 raft_consensus.cc:1240] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:46.495524  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.496554  1660 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:46.461745  1584 raft_consensus.cc:2468] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 2.
I20260709 13:00:46.502545  1732 raft_consensus.cc:1240] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:46.503065  2883 consensus_queue.cc:1048] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:46.478363  1658 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:46.518733  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:46.504503  1738 raft_consensus.cc:1275] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:46.509438  1741 raft_consensus.cc:1240] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:46.510639  2954 raft_consensus.cc:2749] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:46.522341  1738 raft_consensus.cc:1240] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:46.480381  2945 raft_consensus.cc:697] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:46.496462  2791 raft_consensus.cc:2749] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:46.513737  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:46.525229  1733 raft_consensus.cc:2393] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 3: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:46.514796  1735 raft_consensus.cc:1240] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:46.516170  1662 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:46.517408  1660 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:00:46.461577  2928 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:46.511816  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:46.530689  1733 raft_consensus.cc:1240] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:46.530897  1739 raft_consensus.cc:2393] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 3: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:46.496286  2932 raft_consensus.cc:2804] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:46.532434  1738 raft_consensus.cc:1240] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:46.535131  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:46.537771  2931 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:46.537998  1738 raft_consensus.cc:2393] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 4: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:46.538206  2933 raft_consensus.cc:3055] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:46.538751  2933 raft_consensus.cc:740] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:46.539157  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:46.539695  1734 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:46.539899  2902 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 3 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:46.539636  2933 consensus_queue.cc:260] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:46.541525  2945 consensus_queue.cc:237] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:46.546115  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.546917  1659 raft_consensus.cc:2393] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 2: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:46.546866  1556 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:46.548992  1665 raft_consensus.cc:2468] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:46.551478  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:46.552031  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:46.552840  1584 raft_consensus.cc:2376] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4. Re-sending same reply.
I20260709 13:00:46.552711  1736 raft_consensus.cc:2393] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 3: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:46.541018  2933 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:46.564467  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:46.568214  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.568478  1736 raft_consensus.cc:2393] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 3: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:46.568493  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:46.578826  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:46.568593  1734 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:46.563215  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.569936  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:46.581578  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.571909  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:46.573477  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:46.584474  1663 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:46.563509  2935 raft_consensus.cc:2749] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:46.573896  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:46.576962  2928 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:00:46.547600  2932 raft_consensus.cc:697] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:46.578617  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:46.582623  1665 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:46.582669  1659 raft_consensus.cc:2393] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 2: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:46.590628  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:46.583628  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:46.569723  1556 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:46.586838  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:46.588883  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:46.590324  1591 raft_consensus.cc:2393] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 3: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:46.592432  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.594394  1736 raft_consensus.cc:2468] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:46.595034  1662 raft_consensus.cc:2393] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 3: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:46.595621  1590 raft_consensus.cc:2393] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 4: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:46.597487  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.598445  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:46.598604  1659 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:46.599054  1592 raft_consensus.cc:2393] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 3: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:46.600386  2845 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:46.602593  1556 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:46.604779  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:46.605062  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:46.605573  1583 raft_consensus.cc:3060] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:46.605167  2932 consensus_queue.cc:237] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:46.606303  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:46.608624  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:46.609436  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:46.609957  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:46.610356  1586 raft_consensus.cc:2393] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 3: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:46.584501  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:00:46.612246  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:00:46.580308  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 121109us
I20260709 13:00:46.629151  1736 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:00:46.636616  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:46.639078  1556 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:46.651950  1665 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:00:46.659139  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:46.658882  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:46.660522  1590 raft_consensus.cc:2393] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 3: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:46.660709  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:46.661890  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.664767  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:46.670583  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:46.672207  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:46.675485  1662 raft_consensus.cc:1275] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:46.676609  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:46.677875  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:46.678467  1662 raft_consensus.cc:2468] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:46.679280  1663 raft_consensus.cc:1275] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:46.679524  1662 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:46.680855  1556 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:46.681741  1734 raft_consensus.cc:1240] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:46.682502  1556 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:46.681766  1666 raft_consensus.cc:1275] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:46.684228  2945 raft_consensus.cc:2764] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:00:46.685240  2928 raft_consensus.cc:2764] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:00:46.690066  2426 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:00:46.691143  1556 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:46.692920  1667 raft_consensus.cc:2393] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 3: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:46.673905  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:46.690709  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:46.695955  1734 raft_consensus.cc:3060] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:46.698737  1659 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:46.639446  2845 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:46.702759  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:46.684929  2945 raft_consensus.cc:2749] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:46.710206  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:46.714059  1666 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:00:46.717522  1662 raft_consensus.cc:1275] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:46.718947  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:46.701646  2928 raft_consensus.cc:2804] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:46.696489  1664 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:00:46.704327  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:46.727684  1590 raft_consensus.cc:1275] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:46.712761  2902 raft_consensus.cc:2764] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:00:46.730759  1734 raft_consensus.cc:2468] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 3.
I20260709 13:00:46.731858  1732 raft_consensus.cc:2393] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 4: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:46.734004  1556 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:46.732753  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:46.737854  1588 raft_consensus.cc:2376] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5. Re-sending same reply.
I20260709 13:00:46.738579  1556 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:46.739833  2945 raft_consensus.cc:2749] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:46.742395  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:46.743466  1556 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:46.743877  1588 raft_consensus.cc:2393] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 3: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:46.744750  2945 raft_consensus.cc:2749] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:46.732527  2953 consensus_queue.cc:1048] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:00:46.748558  1584 raft_consensus.cc:1275] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:46.749102  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:46.748875  1556 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:46.750238  1584 raft_consensus.cc:1275] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:46.751823  1584 raft_consensus.cc:1275] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:46.752506  1556 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:46.748566  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:46.755836  1588 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:46.770548  1658 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:00:46.721612  2928 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:46.773070  1556 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:46.775506  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:46.732497  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:46.780050  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:46.781039  1588 raft_consensus.cc:2468] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:46.777578  1591 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:00:46.784600  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:46.770606  2791 raft_consensus.cc:2749] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:00:46.789549  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.789984  1556 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:46.791235  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.791610  2926 consensus_queue.cc:1048] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:46.792436  1658 raft_consensus.cc:2376] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3. Re-sending same reply.
I20260709 13:00:46.794427  2933 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:46.795044  1556 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:46.796587  2927 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:46.797256  1590 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:00:46.798549  2926 consensus_queue.cc:1048] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:46.798959  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.799366  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:46.799561  1667 raft_consensus.cc:2376] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2. Re-sending same reply.
I20260709 13:00:46.799839  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:46.799607  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.799965  1661 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5.
I20260709 13:00:46.800674  1662 raft_consensus.cc:2393] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 3: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:46.798570  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:46.801676  1660 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:46.783437  1490 catalog_manager.cc:5697] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: config changed from index 4 to 5, VOTER 6d4de2ce0683442498244b9529127f91 (127.0.107.193) evicted. New cstate: current_term: 2 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:00:46.802713  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:46.802932  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.776603  2928 raft_consensus.cc:3060] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:46.805365  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.805727  1662 raft_consensus.cc:2393] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 3: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:46.806062  1665 raft_consensus.cc:2376] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2. Re-sending same reply.
I20260709 13:00:46.808522  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:46.809000  1556 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:46.809832  1661 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:46.809721  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.811621  1663 raft_consensus.cc:2376] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4. Re-sending same reply.
I20260709 13:00:46.812172  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.813006  1660 raft_consensus.cc:2376] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4. Re-sending same reply.
I20260709 13:00:46.813283  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.815074  1663 raft_consensus.cc:2376] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3. Re-sending same reply.
I20260709 13:00:46.815201  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.816409  1667 raft_consensus.cc:2393] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 2: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:46.816367  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.794294  1583 raft_consensus.cc:2468] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:46.817940  2945 raft_consensus.cc:2764] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:00:46.813714  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.819587  1662 raft_consensus.cc:2393] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 2: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:46.819406  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.820045  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:46.820367  1488 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55132 (request call id 171) took 4046 ms. Trace:
I20260709 13:00:46.820796  1660 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:46.822005  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.823310  1665 raft_consensus.cc:2393] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 3: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:46.821064  1663 raft_consensus.cc:2393] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 3: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:46.824150  1588 raft_consensus.cc:2393] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 3: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:46.827199  1660 raft_consensus.cc:2368] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 3. Current term is 4.
I20260709 13:00:46.839577  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.823433  1490 catalog_manager.cc:5697] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 3 to 4, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:46.845014  1661 raft_consensus.cc:2376] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4. Re-sending same reply.
I20260709 13:00:46.853681  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.826205  2933 raft_consensus.cc:2749] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:46.855127  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:46.835422  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.833545  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:46.821019  1488 rpcz_store.cc:276] 0709 13:00:42.774472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.774611 (+   139us) service_pool.cc:224] Handling call
0709 13:00:42.896607 (+121996us) spinlock_profiling.cc:243] Waited 99.5 ms on lock 0x7b5400119254. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef9090 00007f1b80f97f3a 00007f1b86d4e1cc 00007f1b86e4c37e 00007f1b8530d2a4 00007f1b8530d232 00007f1b8530d161 00007f1b8530d0dc 00007f1b8530c392 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:00:46.820307 (+3923700us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:46.125588 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:46.133720 (+  8132us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:46.133761 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:00:46.133781 (+    20us) tablet.cc:662] Decoding operations
0709 13:00:46.176312 (+ 42531us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:46.181400 (+  5088us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:46.185588 (+  4188us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:00:46.237688 (+ 52100us) tablet.cc:701] Row locks acquired
0709 13:00:46.237713 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:00:46.237890 (+   177us) write_op.cc:270] Start()
0709 13:00:46.238019 (+   129us) write_op.cc:276] Timestamp: P: 1783602046237835 usec, L: 0
0709 13:00:46.238137 (+   118us) op_driver.cc:348] REPLICATION: starting
0709 13:00:46.239329 (+  1192us) log.cc:844] Serialized 1316 byte log entry
0709 13:00:46.535956 (+296627us) op_driver.cc:464] REPLICATION: finished
0709 13:00:46.670241 (+134285us) write_op.cc:301] APPLY: starting
0709 13:00:46.670334 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:46.670488 (+   154us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:46.670610 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:46.671253 (+   643us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:46.671517 (+   264us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:00:46.671562 (+    45us) write_op.cc:312] APPLY: finished
0709 13:00:46.671755 (+   193us) log.cc:844] Serialized 34 byte log entry
0709 13:00:46.673866 (+  2111us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:46.673958 (+    92us) write_op.cc:454] Released schema lock
0709 13:00:46.674000 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:46.712436 (+ 38436us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:46.715333 (+  2897us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2795820,"reported_tablets":12,"spinlock_wait_cycles":228838784,"child_traces":[["op",{"apply.queue_time_us":124489,"apply.run_cpu_time_us":2603,"apply.run_wall_time_us":25883,"num_ops":3,"prepare.queue_time_us":123826,"prepare.run_cpu_time_us":26957,"prepare.run_wall_time_us":165715,"raft.queue_time_us":76856,"raft.run_cpu_time_us":52263,"raft.run_wall_time_us":160588,"replication_time_us":285916,"thread_start_us":275237,"threads_started":4,"wal-append.queue_time_us":142594}]]}
I20260709 13:00:46.865617  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.866747  1663 raft_consensus.cc:2393] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 3: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:46.855831  1665 raft_consensus.cc:2393] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 3: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:46.835279  2931 raft_consensus.cc:2804] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:00:46.827651  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 93592.6us
I20260709 13:00:46.877249  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:46.878624  1590 raft_consensus.cc:2376] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3. Re-sending same reply.
I20260709 13:00:46.863546  2845 raft_consensus.cc:2749] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:46.864416  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:46.864220  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:46.874037  1664 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:46.885424  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:46.875136  2932 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.890906  1583 raft_consensus.cc:2393] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 3: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:46.898738  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:46.899154  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:46.896700  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:46.917934  2927 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.920842  2927 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:46.923082  1590 raft_consensus.cc:2393] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 3: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:46.923331  1591 raft_consensus.cc:2393] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 4: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:46.923954  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:46.927265  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:46.928512  1590 raft_consensus.cc:2368] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3.
W20260709 13:00:46.933216  1538 auto_rebalancer.cc:893] Removing replace marker failed: Replica 5ced62816f8545cd9b63a27e9055e42d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:00:46.897531  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.934767  1663 raft_consensus.cc:2393] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 3: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:46.936195  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:00:46.937578  2956 log.cc:927] Time spent T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:00:46.937480  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.938944  1663 raft_consensus.cc:2393] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 4: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:46.940088  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:46.951529  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.952462  1663 raft_consensus.cc:2393] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 4: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:46.953502  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:46.955087  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.956467  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:46.957741  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:46.959801  2426 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:46.963030  2954 raft_consensus.cc:2804] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:46.963210  1663 raft_consensus.cc:2393] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 4: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
W20260709 13:00:46.933921  1538 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 4490828942174c3c9092820cf3a81fe3 already in progress
I20260709 13:00:46.963757  2954 raft_consensus.cc:697] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 3 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
W20260709 13:00:46.964028  1538 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 4490828942174c3c9092820cf3a81fe3 already in progress
I20260709 13:00:46.966343  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.966111  2954 consensus_queue.cc:237] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:46.892606  2933 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.967505  2933 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:46.897991  1477 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 3f75a0ee5c184536abc81f5a366016fb with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 6d4de2ce0683442498244b9529127f91 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
W20260709 13:00:46.970103  1477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 80524.8us
I20260709 13:00:46.971544  1663 raft_consensus.cc:2393] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 2: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:46.972064  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:46.896345  2932 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:46.980926  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:46.974040  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:46.982347  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.984148  1663 raft_consensus.cc:2393] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 4: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:46.982347  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:46.985001  1588 raft_consensus.cc:2368] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 3. Current term is 4.
I20260709 13:00:46.985029  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:46.990244  1663 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:46.990379  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:46.892715  1658 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:46.991247  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.992544  1667 raft_consensus.cc:2376] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4. Re-sending same reply.
I20260709 13:00:46.993016  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.996543  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:46.997591  1662 raft_consensus.cc:2376] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3. Re-sending same reply.
I20260709 13:00:46.998970  1583 raft_consensus.cc:2393] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 3: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:46.991492  1661 raft_consensus.cc:2393] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 4: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:46.991328  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:47.002302  1663 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:00:47.011091  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:47.015321  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:47.162856  1660 raft_consensus.cc:2393] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 3: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:47.164500  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:47.165599  1667 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:47.095103  1664 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:00:47.172447  1586 raft_consensus.cc:2393] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 3: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:47.174904  1665 raft_consensus.cc:1275] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:00:47.013922  2966 log.cc:927] Time spent T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.068s	user 0.000s	sys 0.004s
I20260709 13:00:47.176851  1664 raft_consensus.cc:1240] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:47.180789  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:47.239368  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:47.242630  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:47.244432  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:47.246376  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:47.248227  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:47.250155  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:47.255635  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.256527  1586 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 3.
I20260709 13:00:47.257964  1583 raft_consensus.cc:2376] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4. Re-sending same reply.
I20260709 13:00:47.259182  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:47.262171  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:00:47.263921  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 272198us
I20260709 13:00:47.154151  2928 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:00:47.262974  1667 raft_consensus.cc:1275] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:47.265636  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:47.276785  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:47.297051  1591 raft_consensus.cc:2393] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 3: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:47.299496  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:47.300949  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:47.302835  1588 raft_consensus.cc:2468] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:47.276396  2927 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:47.303701  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:47.304452  1588 raft_consensus.cc:2376] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4. Re-sending same reply.
I20260709 13:00:47.311659  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:47.312543  1583 raft_consensus.cc:2393] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 3: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:47.313160  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:47.314555  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:47.314988  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:47.315652  1590 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:47.316031  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:47.316716  1583 raft_consensus.cc:2376] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5. Re-sending same reply.
I20260709 13:00:47.317559  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:47.318252  1583 raft_consensus.cc:2393] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 3: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:47.319022  1588 raft_consensus.cc:2393] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 4: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
W20260709 13:00:47.344264  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.275940  1584 raft_consensus.cc:2376] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3. Re-sending same reply.
I20260709 13:00:47.346659  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:47.347467  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:47.348578  1592 raft_consensus.cc:2368] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3.
I20260709 13:00:47.351622  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:47.392016  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 91716.4us
I20260709 13:00:47.399787  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:47.374346  2931 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:47.400619  1586 raft_consensus.cc:2368] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3.
I20260709 13:00:47.400722  2931 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:47.401670  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:47.402289  1586 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 6.
I20260709 13:00:47.403038  1590 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 3.
I20260709 13:00:47.400646  1633 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:47.356802  1660 raft_consensus.cc:1240] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:00:47.356089  2932 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:00:47.407302  2967 log.cc:927] Time spent T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.147s	user 0.004s	sys 0.000s
I20260709 13:00:47.408006  1633 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:47.408416  2977 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:47.409291  2977 raft_consensus.cc:2749] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.399443  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:47.410172  1583 raft_consensus.cc:2376] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3. Re-sending same reply.
I20260709 13:00:47.413272  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:47.415294  1661 raft_consensus.cc:1240] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:47.405652  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:47.411155  1663 raft_consensus.cc:1240] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:47.355741  1664 raft_consensus.cc:1240] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:47.418988  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:47.419217  1556 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:00:47.420475  1592 raft_consensus.cc:2393] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 3: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:47.420550  1588 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 4.
I20260709 13:00:47.424191  1556 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:47.425088  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:47.427335  1667 raft_consensus.cc:2393] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 3: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:47.425390  1556 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:47.432251  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:47.432246  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:47.433506  2932 raft_consensus.cc:2804] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:47.433984  1659 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:00:47.435633  1633 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:47.439096  1556 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:47.434178  2932 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.422108  2933 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:47.423269  2927 raft_consensus.cc:2749] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:47.424187  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:00:47.436477  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:47.458320  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:47.441655  2935 raft_consensus.cc:2804] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:47.454099  2972 log.cc:927] Time spent T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:00:47.440217  2976 raft_consensus.cc:2804] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:47.443750  2932 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:47.478575  1556 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:00:47.527889  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 49700.5us
I20260709 13:00:47.529855  2926 raft_consensus.cc:2749] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:47.530524  2926 consensus_queue.cc:1059] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:47.531394  2926 consensus_queue.cc:1059] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:47.532207  2926 raft_consensus.cc:3055] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:47.532492  2926 raft_consensus.cc:740] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:47.533236  2845 raft_consensus.cc:3055] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:47.528990  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:47.533671  2845 raft_consensus.cc:740] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:47.534925  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:47.535369  1732 raft_consensus.cc:1275] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:47.504979  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:47.537467  1588 raft_consensus.cc:2393] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 3: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:47.537166  2926 consensus_queue.cc:260] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:47.538691  2926 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:47.539037  1588 raft_consensus.cc:1275] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:47.507966  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:47.511096  1734 raft_consensus.cc:1240] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:00:47.511839  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:47.513069  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:47.481022  2935 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.542282  2935 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:47.480258  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:47.510812  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:47.546305  1585 raft_consensus.cc:2368] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 3. Current term is 4.
I20260709 13:00:47.444610  2791 consensus_queue.cc:1059] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 13:00:47.511898  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:47.522922  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:47.515853  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:47.519173  2976 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.549918  2976 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:47.479678  2928 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:47.525925  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:47.534806  2845 consensus_queue.cc:260] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:47.558295  2663 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.501224  2554 raft_consensus.cc:2393] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 3: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:47.559099  2663 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:47.560671  1555 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:00:47.558540  2845 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.536557  1556 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:47.455837  2977 raft_consensus.cc:2749] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.563486  1663 raft_consensus.cc:3055] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:47.564757  1663 raft_consensus.cc:740] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:47.563977  2944 raft_consensus.cc:3055] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:47.563512  2927 consensus_queue.cc:1059] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:00:47.565236  2944 raft_consensus.cc:740] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:47.565593  1663 consensus_queue.cc:260] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:47.566416  2928 raft_consensus.cc:2804] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:47.566834  2928 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.566123  2944 consensus_queue.cc:260] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:47.567196  2928 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:47.566964  1663 raft_consensus.cc:3060] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:47.568100  2944 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.570269  2927 raft_consensus.cc:3055] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:47.570797  1665 raft_consensus.cc:1240] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:47.459228  2933 consensus_queue.cc:1059] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 13:00:47.572616  2945 raft_consensus.cc:3055] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:47.573040  2945 raft_consensus.cc:740] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:47.573668  1664 raft_consensus.cc:1240] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:47.573865  2945 consensus_queue.cc:260] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:47.574932  2945 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:47.570709  2927 raft_consensus.cc:740] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:47.576998  1659 raft_consensus.cc:1275] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:47.578795  1664 raft_consensus.cc:1240] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:47.580117  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:47.581000  1664 raft_consensus.cc:2393] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 3: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:00:47.583410  1733 raft_consensus.cc:1240] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:47.583731  1734 raft_consensus.cc:1240] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:47.565217  1588 raft_consensus.cc:1275] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:47.586503  1733 raft_consensus.cc:1275] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:47.587589  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:47.590425  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:47.591925  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:47.592482  1733 raft_consensus.cc:2393] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 3: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:47.593060  1736 raft_consensus.cc:2410] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 3 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:00:47.600211  1661 raft_consensus.cc:1275] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:47.602193  2663 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:47.608348  1665 raft_consensus.cc:1240] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 1. Current term is 2. Ops: []
W20260709 13:00:47.609113  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 173575us
I20260709 13:00:47.611778  2933 consensus_queue.cc:1059] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:47.548445  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:47.613256  1658 raft_consensus.cc:3055] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:47.613538  1737 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:47.614141  1658 raft_consensus.cc:740] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:47.577065  2926 raft_consensus.cc:2749] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:47.615561  1658 consensus_queue.cc:260] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:47.624944  1633 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:47.628068  1658 raft_consensus.cc:3060] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:47.628997  1663 raft_consensus.cc:1275] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:47.629503  2977 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:47.602939  2791 consensus_queue.cc:1059] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:00:47.620652  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:00:47.639948  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 61623us
I20260709 13:00:47.641325  1633 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:47.619172  2902 consensus_queue.cc:1048] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:00:47.657666  1633 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:47.662173  1658 raft_consensus.cc:1275] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:00:47.662585  1658 pending_rounds.cc:85] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 1
I20260709 13:00:47.664371  1633 leader_election.cc:400] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5.
I20260709 13:00:47.665293  2988 raft_consensus.cc:3055] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:47.665761  2988 raft_consensus.cc:740] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:47.667461  2953 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.668090  2953 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:47.666880  2988 consensus_queue.cc:260] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:47.650513  2977 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:47.677776  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 60819.5us
I20260709 13:00:47.662823  1658 pending_rounds.cc:107] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:00:47.679841  1658 raft_consensus.cc:2889] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:47.680325  1633 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:47.682564  1633 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:47.692444  2988 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.691960  2933 consensus_queue.cc:1059] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:47.692790  1737 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
W20260709 13:00:47.692022  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.677882  2974 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.639318  2927 consensus_queue.cc:260] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:47.659631  2954 consensus_queue.cc:1048] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:00:47.726537  1581 tablet_service.cc:1558] Processing DeleteTablet for tablet 75a149db07824e3fb3c1f721b61d6c20 with delete_type TABLET_DATA_TOMBSTONED (TS 6d4de2ce0683442498244b9529127f91 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:59092
I20260709 13:00:47.740897  1490 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51168 (request call id 18) took 1557 ms. Trace:
W20260709 13:00:47.766734  2980 log.cc:927] Time spent T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.140s	user 0.000s	sys 0.002s
I20260709 13:00:47.693595  2979 raft_consensus.cc:2749] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:47.711987  2986 raft_consensus.cc:3055] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:47.752379  1633 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:00:47.770017  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.765544  1490 rpcz_store.cc:276] 0709 13:00:46.183765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.183912 (+   147us) service_pool.cc:224] Handling call
0709 13:00:47.740826 (+1556914us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:47.367076 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:47.367707 (+   631us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:47.367752 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:00:47.367773 (+    21us) tablet.cc:662] Decoding operations
0709 13:00:47.368227 (+   454us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:47.368285 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:47.368320 (+    35us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:00:47.368666 (+   346us) tablet.cc:701] Row locks acquired
0709 13:00:47.368869 (+   203us) write_op.cc:260] PREPARE: finished
0709 13:00:47.369054 (+   185us) write_op.cc:270] Start()
0709 13:00:47.378529 (+  9475us) write_op.cc:276] Timestamp: P: 1783602047369002 usec, L: 0
0709 13:00:47.378560 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:00:47.444448 (+ 65888us) log.cc:844] Serialized 981 byte log entry
0709 13:00:47.563626 (+119178us) op_driver.cc:464] REPLICATION: finished
0709 13:00:47.678632 (+115006us) write_op.cc:301] APPLY: starting
0709 13:00:47.688612 (+  9980us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:47.688746 (+   134us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:47.688887 (+   141us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:47.689577 (+   690us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:47.689761 (+   184us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:00:47.690407 (+   646us) write_op.cc:312] APPLY: finished
0709 13:00:47.690624 (+   217us) log.cc:844] Serialized 28 byte log entry
0709 13:00:47.690946 (+   322us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:47.691207 (+   261us) write_op.cc:454] Released schema lock
0709 13:00:47.691261 (+    54us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":84761,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":97518,"apply.run_cpu_time_us":11843,"apply.run_wall_time_us":49706,"num_ops":2,"prepare.queue_time_us":517204,"prepare.run_cpu_time_us":5012,"prepare.run_wall_time_us":89692,"replication_time_us":181855,"thread_start_us":242993,"threads_started":2}]]}
I20260709 13:00:47.784204  1633 leader_election.cc:400] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3.
I20260709 13:00:47.786046  2677 raft_consensus.cc:2749] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.720433  2977 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.750738  1486 catalog_manager.cc:5697] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 1 to 2, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 2 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:47.802430  1633 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:47.804698  1486 catalog_manager.cc:5697] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 1 to 2, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 2 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:47.780498  2986 raft_consensus.cc:740] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:47.792589  2987 raft_consensus.cc:3055] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:47.812741  2931 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:47.809381  1633 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:47.793529  2927 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:47.815716  2987 raft_consensus.cc:740] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:47.837143  1633 leader_election.cc:400] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 3. Current term is 4.
I20260709 13:00:47.837800  1633 leader_election.cc:403] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:00:47.811745  2663 consensus_queue.cc:1048] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:00:47.811548  2979 raft_consensus.cc:2749] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:00:47.844658  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 93804.5us
I20260709 13:00:47.832545  2935 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:47.855010  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.844069  2977 raft_consensus.cc:2804] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:47.878149  1486 catalog_manager.cc:5697] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 1 to 2, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 2 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:47.877666  1707 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:47.877666  1633 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:00:47.857270  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 143970us
I20260709 13:00:47.846956  2974 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 3. Current term is 4.
W20260709 13:00:47.889606  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 99052us
I20260709 13:00:47.891026  1558 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:47.892434  1486 catalog_manager.cc:5697] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:47.891135  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 247434us
I20260709 13:00:47.904568  1633 leader_election.cc:400] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3.
I20260709 13:00:47.905699  1633 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:47.885839  2977 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:47.853737  2985 consensus_queue.cc:1048] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
W20260709 13:00:47.913323  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.914662  2985 raft_consensus.cc:2804] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:47.915158  2985 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.915573  2985 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:47.907459  1486 catalog_manager.cc:5697] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 1 to 2, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 2 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:47.903049  2677 raft_consensus.cc:2749] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.843642  2987 consensus_queue.cc:260] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:47.888099  2979 consensus_queue.cc:1048] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:00:47.938611  2926 consensus_queue.cc:1048] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:47.939349  3000 tablet_replica.cc:333] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:00:47.940061  2996 consensus_queue.cc:1048] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:00:47.941601  2935 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:47.941320  2928 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:47.943908  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:47.951647  1658 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 3.
I20260709 13:00:47.910707  2977 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:47.929185  2997 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:47.934253  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:47.909255  2974 consensus_queue.cc:1048] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:00:47.906665  2995 consensus_queue.cc:1048] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
W20260709 13:00:47.962967  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.964152  3000 raft_consensus.cc:2243] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:47.964496  2992 consensus_queue.cc:1048] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:00:47.977819  1558 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:47.890841  2986 consensus_queue.cc:260] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:47.975004  2677 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:47.989486  2845 raft_consensus.cc:2749] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:47.966368  2987 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:47.991990  1558 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:47.990327  2953 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:47.999854  2791 consensus_queue.cc:1059] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:00:48.000778  2845 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:48.001230  2931 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:48.005052  1558 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:48.005950  2931 raft_consensus.cc:2749] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:48.007673  1558 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:47.976979  2998 consensus_queue.cc:1059] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:00:48.010340  1558 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:48.011205  2845 raft_consensus.cc:2749] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:48.011521  1558 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:48.010926  2998 raft_consensus.cc:3055] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:48.012390  2998 raft_consensus.cc:740] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:48.012671  1558 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:48.009488  3000 raft_consensus.cc:2272] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:48.022907  3000 ts_tablet_manager.cc:1916] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:00:48.023871  2941 log.cc:927] Time spent T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
W20260709 13:00:48.029354  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 123683us
I20260709 13:00:48.013190  2945 consensus_queue.cc:1059] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:47.981002  1584 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 3.
I20260709 13:00:48.030653  2928 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:48.031314  1490 catalog_manager.cc:5697] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 2 to 3, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:48.032737  3003 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.035517  3003 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:47.979466  2993 consensus_queue.cc:1059] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 13:00:48.037227  2993 raft_consensus.cc:3055] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:48.037586  2993 raft_consensus.cc:740] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:48.009388  2931 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:48.037777  3003 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:48.048851  1633 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:48.049211  2932 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:48.032720  2985 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:48.052896  1558 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:00:48.063799  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 104335us
I20260709 13:00:47.973459  2935 consensus_queue.cc:1048] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.077s
I20260709 13:00:48.013001  2927 raft_consensus.cc:2749] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:48.051812  2944 raft_consensus.cc:2804] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:48.063081  2974 raft_consensus.cc:2749] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:48.038424  2993 consensus_queue.cc:260] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:48.072800  1558 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:00:48.071317  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 215048us
I20260709 13:00:48.076488  1658 raft_consensus.cc:1240] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:48.063668  2987 raft_consensus.cc:2749] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:48.066429  1633 leader_election.cc:400] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3.
I20260709 13:00:48.080633  1707 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:48.085366  1658 raft_consensus.cc:1240] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:48.085611  1707 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:48.087021  1633 leader_election.cc:403] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:00:48.081815  1558 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:48.083262  2663 consensus_queue.cc:1048] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:00:48.093235  2995 raft_consensus.cc:2804] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:48.093672  2995 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:48.094034  2995 raft_consensus.cc:3060] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.094702  2998 consensus_queue.cc:260] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:48.097224  2928 raft_consensus.cc:2749] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:48.097445  3001 raft_consensus.cc:2749] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3.
W20260709 13:00:48.098009  2976 consensus_meta.cc:287] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.547s	user 0.005s	sys 0.008s
I20260709 13:00:48.097265  2989 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:48.088973  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:48.087919  1707 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:48.099715  1658 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:48.105830  2931 raft_consensus.cc:2749] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:48.098651  2989 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.106699  2986 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.106853  2989 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:48.081396  2944 raft_consensus.cc:697] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:48.110114  2944 consensus_queue.cc:237] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:48.111099  2985 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:48.111955  2993 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:48.096035  2998 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.116609  2995 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:48.119352  2995 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:48.121230  2927 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:48.121845  2927 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:48.124035  2927 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:48.126498  3003 raft_consensus.cc:2804] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:48.127087  3003 raft_consensus.cc:697] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:48.098215  2932 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:48.098465  2976 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:48.131300  1707 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:48.132169  2976 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:48.132519  1707 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:48.134977  2945 consensus_queue.cc:1059] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:48.136466  2987 raft_consensus.cc:3055] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:48.136818  2987 raft_consensus.cc:740] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:48.137658  2987 consensus_queue.cc:260] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:48.140259  2987 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:48.141512  1486 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55138 (request call id 173) took 1937 ms. Trace:
W20260709 13:00:48.142215  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.096709  2977 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:48.141893  1486 rpcz_store.cc:276] 0709 13:00:46.204301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.205071 (+   770us) service_pool.cc:224] Handling call
0709 13:00:48.141453 (+1936382us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:47.939698 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:47.940260 (+   562us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:47.940312 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:00:47.940338 (+    26us) tablet.cc:662] Decoding operations
0709 13:00:47.941031 (+   693us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:47.941106 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:47.941133 (+    27us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:00:47.941685 (+   552us) tablet.cc:701] Row locks acquired
0709 13:00:47.941706 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:00:47.941868 (+   162us) write_op.cc:270] Start()
0709 13:00:47.941976 (+   108us) write_op.cc:276] Timestamp: P: 1783602047941828 usec, L: 0
0709 13:00:47.941997 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:00:47.942642 (+   645us) log.cc:844] Serialized 2089 byte log entry
0709 13:00:48.025241 (+ 82599us) op_driver.cc:464] REPLICATION: finished
0709 13:00:48.025722 (+   481us) write_op.cc:301] APPLY: starting
0709 13:00:48.025804 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:48.025973 (+   169us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:48.026070 (+    97us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:48.026790 (+   720us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:48.026984 (+   194us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:00:48.027036 (+    52us) write_op.cc:312] APPLY: finished
0709 13:00:48.027283 (+   247us) log.cc:844] Serialized 46 byte log entry
0709 13:00:48.027457 (+   174us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:48.027568 (+   111us) write_op.cc:454] Released schema lock
0709 13:00:48.027612 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:48.028059 (+   447us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:48.028088 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":422,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":254,"apply.run_cpu_time_us":2286,"apply.run_wall_time_us":2290,"num_ops":5,"prepare.queue_time_us":1336,"prepare.run_cpu_time_us":3419,"prepare.run_wall_time_us":7264,"replication_time_us":83104}]]}
I20260709 13:00:48.128206  3003 consensus_queue.cc:237] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:48.146577  1558 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:48.146916  2977 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:48.147270  2426 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:00:48.136916  1488 catalog_manager.cc:5697] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 1 to 2, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 2 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:00:48.165735  1633 leader_election.cc:400] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 3. Current term is 4.
I20260709 13:00:48.171659  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:48.173894  1633 leader_election.cc:403] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:00:48.174074  1664 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:48.162791  1558 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:48.178835  1558 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:48.179031  1707 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:48.174460  1488 catalog_manager.cc:5697] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 2 to 4, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:48.180946  1488 catalog_manager.cc:5697] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 2 to 4, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:48.182700  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:48.188995  1633 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:48.191238  1488 catalog_manager.cc:5697] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 2 to 3, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:48.205493  1664 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:00:48.175122  2993 raft_consensus.cc:2749] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:48.219089  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:48.219485  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:48.203527  1488 catalog_manager.cc:5697] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:00:48.192531  3002 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:48.168104  2985 raft_consensus.cc:2804] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:48.163362  2976 consensus_queue.cc:1048] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:00:48.232688  1586 raft_consensus.cc:1240] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:00:48.183879  3001 raft_consensus.cc:2749] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 3. Current term is 4.
I20260709 13:00:48.183705  2945 raft_consensus.cc:2749] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:48.128774  2989 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:48.197638  2995 raft_consensus.cc:2804] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:48.163522  2663 raft_consensus.cc:2804] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:48.189544  2953 raft_consensus.cc:2804] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:48.184437  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 103865us
I20260709 13:00:48.241647  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:48.242647  1586 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5.
I20260709 13:00:48.244194  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:48.245054  1586 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:48.245242  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:48.245923  1592 raft_consensus.cc:3060] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.191854  1658 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:00:48.221048  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:48.222939  1633 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:48.225142  3002 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:48.224092  1707 leader_election.cc:400] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 3. Current term is 4.
I20260709 13:00:48.224696  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:48.250190  1707 leader_election.cc:403] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:00:48.250465  1736 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 3.
I20260709 13:00:48.227994  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:48.210217  2974 raft_consensus.cc:2749] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:48.251605  1633 leader_election.cc:400] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3.
I20260709 13:00:48.252259  1633 leader_election.cc:403] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:00:48.222653  2993 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:48.255746  1633 leader_election.cc:400] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3.
I20260709 13:00:48.267043  1633 leader_election.cc:403] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:00:48.267542  1592 raft_consensus.cc:2468] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:48.267894  1633 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:48.272699  1588 raft_consensus.cc:1240] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:00:48.276279  1633 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:00:48.277402  1633 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:48.237254  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:48.253304  2953 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.265380  3001 raft_consensus.cc:2804] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:48.253458  2977 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3.
I20260709 13:00:48.266425  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:48.287482  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:48.321542  1658 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:48.292368  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:48.324014  1659 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:48.311992  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:48.327236  3015 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.327853  3015 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:48.285378  2979 raft_consensus.cc:2804] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:48.339098  1556 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:48.312016  2974 raft_consensus.cc:2749] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:48.285472  2677 raft_consensus.cc:2804] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:00:48.320117  3012 log.cc:927] Time spent T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:00:48.340476  1556 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:48.341666  2995 raft_consensus.cc:697] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:48.342483  3020 raft_consensus.cc:2749] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 3. Current term is 4.
I20260709 13:00:48.280208  2993 raft_consensus.cc:697] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:48.315441  2953 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:48.318811  3001 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:48.313812  2945 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:48.357986  1658 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
W20260709 13:00:48.351176  1705 leader_election.cc:336] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.537s (SENT)
I20260709 13:00:48.385092  1705 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:48.367823  1659 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:00:48.282656  3004 raft_consensus.cc:2749] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3.
I20260709 13:00:48.350041  2845 raft_consensus.cc:2804] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:48.392102  1588 raft_consensus.cc:1240] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:48.344328  2979 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.398279  3016 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:48.398880  2979 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:48.376187  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 98860.8us
I20260709 13:00:48.368769  2932 raft_consensus.cc:2804] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:48.395565  1556 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:48.369395  2677 raft_consensus.cc:697] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 3 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:48.406060  1633 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:48.329612  3009 consensus_queue.cc:1048] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.093s
I20260709 13:00:48.385130  3001 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:48.425500  1556 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:48.429399  1556 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:48.399307  2985 raft_consensus.cc:697] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:48.433561  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:48.434696  1584 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 5.
I20260709 13:00:48.435768  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:48.436482  1584 raft_consensus.cc:2368] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3.
I20260709 13:00:48.406819  2845 raft_consensus.cc:697] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:48.443478  2677 consensus_queue.cc:237] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:48.449290  2935 raft_consensus.cc:2804] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:00:48.422072  3017 log.cc:927] Time spent T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 13:00:48.454294  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.459668  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:48.460487  1735 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 1.
I20260709 13:00:48.454888  1558 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:48.459565  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:48.392520  2945 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:48.462087  1736 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 5.
I20260709 13:00:48.462363  1741 raft_consensus.cc:1240] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:48.467192  1736 raft_consensus.cc:1275] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:48.463726  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:48.463148  1735 raft_consensus.cc:1240] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:48.467649  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:48.420079  2932 raft_consensus.cc:697] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:48.423009  2974 raft_consensus.cc:2804] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:48.424906  2988 raft_consensus.cc:2749] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:48.465701  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:48.477463  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:48.478267  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:48.479120  1584 raft_consensus.cc:2368] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 3. Current term is 4.
I20260709 13:00:48.481439  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:48.485167  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:48.486321  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:48.487018  1584 raft_consensus.cc:2368] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3.
I20260709 13:00:48.489444  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:48.490480  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:48.491056  1584 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 4.
I20260709 13:00:48.491899  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:48.432121  2989 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:48.492518  1584 raft_consensus.cc:2368] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5.
I20260709 13:00:48.493224  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:48.451321  2931 raft_consensus.cc:2804] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:48.495873  1738 raft_consensus.cc:2393] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 4: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
W20260709 13:00:48.504376  3014 log.cc:927] Time spent T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:00:48.472847  2928 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:00:48.512369  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.480345  2974 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.485766  2935 raft_consensus.cc:697] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:48.504410  2931 raft_consensus.cc:697] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:00:48.534704  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 310714us
W20260709 13:00:48.564783  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 75896us
I20260709 13:00:48.563987  2974 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:48.574770  2931 consensus_queue.cc:237] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:48.432447  2995 consensus_queue.cc:237] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:48.579793  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:48.580574  1591 raft_consensus.cc:2368] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3.
I20260709 13:00:48.582301  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:48.586864  2974 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:48.589258  2845 consensus_queue.cc:237] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:48.590106  2974 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:48.596268  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:48.498098  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:48.598616  1737 raft_consensus.cc:2393] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 4: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:48.599066  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:48.597028  1592 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:48.604858  1586 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:00:48.610258  1588 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 4.
I20260709 13:00:48.625422  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:48.630295  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.628557  1590 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 4.
I20260709 13:00:48.482604  2926 consensus_queue.cc:1048] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.083s
I20260709 13:00:48.637571  1590 raft_consensus.cc:1240] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 3. Current term is 4. Ops: []
W20260709 13:00:48.644371  1633 connection.cc:256] RPC call timeout handler was delayed by -1.2575812470000187s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1509s for a response
W20260709 13:00:48.662461  1633 connection.cc:256] RPC call timeout handler was delayed by -1.1927812469999708s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15810000000000002s for a response
W20260709 13:00:48.662973  1633 connection.cc:256] RPC call timeout handler was delayed by -1.1558812470000248s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
I20260709 13:00:48.641047  1592 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 3.
I20260709 13:00:48.648378  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:48.663430  1633 connection.cc:256] RPC call timeout handler was delayed by -1.1432812470000044s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
W20260709 13:00:48.664283  1633 connection.cc:256] RPC call timeout handler was delayed by -1.140581247s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16390000000000002s for a response
W20260709 13:00:48.664695  1633 connection.cc:256] RPC call timeout handler was delayed by -1.1315812469999855s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16490000000000002s for a response
W20260709 13:00:48.665071  1633 connection.cc:256] RPC call timeout handler was delayed by -1.0451812470000164s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17450000000000002s for a response
W20260709 13:00:48.665469  1633 connection.cc:256] RPC call timeout handler was delayed by -1.0154812470000252s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1778s for a response
W20260709 13:00:48.681591  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 295307us
I20260709 13:00:48.685513  1588 raft_consensus.cc:2368] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3.
I20260709 13:00:48.623756  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:48.685340  1592 raft_consensus.cc:1240] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:48.729434  1633 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:48.739542  1633 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:48.736901  1592 raft_consensus.cc:1240] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:00:48.471830  2993 consensus_queue.cc:237] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:48.732103  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:48.745967  1633 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:00:48.747010  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 104358us
I20260709 13:00:48.641446  2989 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.747038  1592 raft_consensus.cc:1240] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:00:48.727732  3016 consensus_queue.cc:1048] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:00:48.748231  2944 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.806521  1707 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:48.753278  2935 consensus_queue.cc:237] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:48.754896  3023 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.746927  2977 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:00:48.759132  2986 consensus_meta.cc:287] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.652s	user 0.010s	sys 0.000s
I20260709 13:00:48.685706  3002 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:00:48.745011  1705 leader_election.cc:336] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.581s (SENT)
I20260709 13:00:48.785647  3004 raft_consensus.cc:2749] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:00:48.789827  3021 log.cc:927] Time spent T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
W20260709 13:00:48.790386  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 190337us
I20260709 13:00:48.748387  3018 raft_consensus.cc:2749] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:48.811681  1705 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:00:48.831924  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 86965.4us
W20260709 13:00:48.832536  1705 leader_election.cc:336] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.581s (SENT)
I20260709 13:00:48.832906  1705 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:48.820297  3015 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:48.793597  1633 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
W20260709 13:00:48.873250  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 79786.8us
I20260709 13:00:48.874394  1633 leader_election.cc:400] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3.
I20260709 13:00:48.875468  1633 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:48.633736  2985 consensus_queue.cc:237] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:48.881335  1633 leader_election.cc:400] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3.
I20260709 13:00:48.882347  1633 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:48.829859  3009 raft_consensus.cc:2804] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:48.782158  2989 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:00:48.861825  2998 consensus_meta.cc:287] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.748s	user 0.006s	sys 0.005s
I20260709 13:00:48.766252  2932 consensus_queue.cc:237] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:48.880378  2974 raft_consensus.cc:2804] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:48.884073  3018 raft_consensus.cc:2749] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:48.827469  2944 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:48.890913  3009 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.893582  1733 raft_consensus.cc:2955] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 6d4de2ce0683442498244b9529127f91 (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:00:48.897593  3004 raft_consensus.cc:2804] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:48.854919  2979 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:48.911193  2974 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:48.910825  2998 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.917266  2995 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:48.970585  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 346450us
I20260709 13:00:48.950340  1732 raft_consensus.cc:1275] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:00:48.951092  2663 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.011s	sys 0.014s
I20260709 13:00:48.919104  2945 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:48.953693  3009 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:48.935086  3002 raft_consensus.cc:2749] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:00:48.971201  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 161049us
I20260709 13:00:48.961408  3004 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:48.835209  3023 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:48.978509  2974 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:48.998731  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.989916  1707 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:00:48.985426  2663 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.012s	sys 0.014s
I20260709 13:00:48.989666  3004 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:49.062043  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.045656  1707 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:48.982414  2998 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:49.042920  2995 raft_consensus.cc:2804] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:00:49.098497  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.042341  2663 raft_consensus.cc:697] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:49.049542  3019 consensus_queue.cc:1059] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.143s
W20260709 13:00:49.107869  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 225582us
W20260709 13:00:49.100293  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 54767.7us
I20260709 13:00:49.108891  1633 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:49.110970  1633 leader_election.cc:400] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3.
I20260709 13:00:49.112228  1633 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:49.113018  1633 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:49.041759  3006 consensus_queue.cc:1059] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.288s
I20260709 13:00:49.117900  3018 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:49.133028  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 300494us
W20260709 13:00:49.133847  1705 leader_election.cc:336] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.590s (SENT)
I20260709 13:00:49.106935  3015 raft_consensus.cc:2804] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:00:49.134676  1705 leader_election.cc:336] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.605s (SENT)
I20260709 13:00:49.140930  1705 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:00:49.135174  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 154201us
I20260709 13:00:49.117600  2995 raft_consensus.cc:697] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:49.135133  3018 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:49.153988  2677 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:00:49.165133  2941 log.cc:927] Time spent T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
W20260709 13:00:49.191021  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 56363.5us
I20260709 13:00:49.124677  3026 consensus_queue.cc:1059] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.118s
I20260709 13:00:49.165236  2944 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:49.195864  1705 leader_election.cc:336] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.629s (SENT)
I20260709 13:00:49.163419  2945 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.199357  1705 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:49.165009  3018 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:49.225739  3019 raft_consensus.cc:3055] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:49.174399  2979 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:49.226854  1705 leader_election.cc:336] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.633s (SENT)
I20260709 13:00:49.236825  1705 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:00:49.243666  1705 connection.cc:256] RPC call timeout handler was delayed by -1.0101565880000294s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20299999999999999s for a response
W20260709 13:00:49.203488  3034 log.cc:927] Time spent T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:00:49.194959  3002 raft_consensus.cc:3055] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:00:49.233300  2953 consensus_meta.cc:287] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent flushing consensus metadata: real 0.841s	user 0.013s	sys 0.000s
I20260709 13:00:49.174155  2663 consensus_queue.cc:237] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:49.193653  3015 raft_consensus.cc:697] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:49.227545  3051 raft_consensus.cc:2749] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:00:49.245910  1705 leader_election.cc:336] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.689s (SENT)
I20260709 13:00:49.265429  1705 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:49.245451  3026 raft_consensus.cc:2749] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:49.222442  2945 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:49.236817  2989 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:00:49.236083  3019 raft_consensus.cc:740] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:49.255564  2953 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:49.248922  3002 raft_consensus.cc:740] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
W20260709 13:00:49.267302  1705 leader_election.cc:336] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.768s (SENT)
W20260709 13:00:49.292060  1705 leader_election.cc:336] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.837s (SENT)
I20260709 13:00:49.292595  1705 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:49.274246  3045 raft_consensus.cc:2749] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:49.294915  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 47709.8us
I20260709 13:00:49.289849  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:00:49.249266  2995 consensus_queue.cc:237] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:49.325685  1705 leader_election.cc:336] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.862s (SENT)
W20260709 13:00:49.327816  1705 leader_election.cc:336] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.867s (SENT)
I20260709 13:00:49.328327  1705 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:49.314627  2554 raft_consensus.cc:2468] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:49.352739  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:49.358208  1588 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:49.356199  1705 leader_election.cc:336] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.900s (SENT)
W20260709 13:00:49.309581  3054 log.cc:927] Time spent T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:00:49.356230  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:49.365952  2677 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.366739  2677 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:49.317610  3044 log.cc:927] Time spent T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:00:49.320777  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:49.370522  1585 raft_consensus.cc:2468] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 3.
W20260709 13:00:49.314930  3038 log.cc:927] Time spent T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.180s	user 0.000s	sys 0.002s
W20260709 13:00:49.321031  3039 log.cc:927] Time spent T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:00:49.308868  2953 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:49.361855  1705 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:49.303279  3053 raft_consensus.cc:2804] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:49.319818  1587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 1054) took 1086 ms. Trace:
I20260709 13:00:49.357611  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:49.437327  1667 raft_consensus.cc:2468] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 3.
I20260709 13:00:49.316480  2979 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:49.439881  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 83719.7us
I20260709 13:00:49.308218  3047 raft_consensus.cc:2749] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:49.440024  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 298076us
W20260709 13:00:49.440899  1705 leader_election.cc:336] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.906s (SENT)
W20260709 13:00:49.441974  1705 leader_election.cc:336] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.941s (SENT)
I20260709 13:00:49.442255  1705 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:49.357386  3026 raft_consensus.cc:2749] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:49.357249  2977 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:49.318699  3015 consensus_queue.cc:237] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:49.314472  3028 log.cc:927] Time spent T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.236s	user 0.002s	sys 0.000s
I20260709 13:00:49.358104  3045 raft_consensus.cc:2749] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:49.433192  3053 raft_consensus.cc:697] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 4 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:49.459640  3056 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:49.465755  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:49.318336  3000 ts_tablet_manager.cc:1929] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:00:49.471808  3000 log.cc:1199] T 75a149db07824e3fb3c1f721b61d6c20 P 6d4de2ce0683442498244b9529127f91: Deleting WAL directory at /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-0-root/wals/75a149db07824e3fb3c1f721b61d6c20
W20260709 13:00:49.473877  3031 log.cc:927] Time spent T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.272s	user 0.001s	sys 0.001s
I20260709 13:00:49.476651  1589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 1050) took 1245 ms. Trace:
I20260709 13:00:49.476945  1583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 1049) took 1246 ms. Trace:
I20260709 13:00:49.477290  1589 rpcz_store.cc:276] 0709 13:00:48.230832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.230942 (+   110us) service_pool.cc:224] Handling call
0709 13:00:48.231192 (+   250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:48.264519 (+ 33327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:48.264567 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:48.374664 (+110097us) spinlock_profiling.cc:243] Waited 4.37 ms on lock 0x7b2c00000658. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7f888a11 00007f1b7f898372 00007f1b80fcaa01 00007f1b80f8f43a 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2
0709 13:00:48.390060 (+ 15396us) log.cc:844] Serialized 26 byte log entry
0709 13:00:48.646991 (+256931us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:48.647033 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.647097 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:49.476078 (+828981us) raft_consensus.cc:1685] finished
0709 13:00:49.476109 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:49.476549 (+   440us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45795,"raft.queue_time_us":38907,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":7180,"spinlock_wait_cycles":10043136,"thread_start_us":222815,"threads_started":1,"wal-append.queue_time_us":560045}
I20260709 13:00:49.479990  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:49.466215  3049 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.455475  2989 raft_consensus.cc:2749] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:49.477392  1583 rpcz_store.cc:276] 0709 13:00:48.230517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.230665 (+   148us) service_pool.cc:224] Handling call
0709 13:00:48.230955 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:48.234643 (+  3688us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:48.234672 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:48.239312 (+  4640us) log.cc:844] Serialized 26 byte log entry
0709 13:00:48.534311 (+294999us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:48.534372 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.534480 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:49.476541 (+942061us) raft_consensus.cc:1685] finished
0709 13:00:49.476560 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:49.476822 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4843,"raft.queue_time_us":4727,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":25832,"thread_start_us":226465,"threads_started":1,"wal-append.queue_time_us":853097}
W20260709 13:00:49.509233  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.468374  1585 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:49.511451  3055 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.511876  3059 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.512166  3055 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:49.512796  3059 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:49.516149  3055 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:49.488360  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:49.518445  1588 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 4.
I20260709 13:00:49.519794  1589 raft_consensus.cc:1240] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:00:49.506028  2935 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.443768  2979 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:49.373924  3002 consensus_queue.cc:260] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:49.523789  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:49.461741  3023 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:49.485018  2977 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:49.357625  3019 consensus_queue.cc:260] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:49.471256  3053 consensus_queue.cc:237] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:49.534185  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:49.554283  1588 raft_consensus.cc:1240] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:49.571056  1586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 653) took 1128 ms. Trace:
I20260709 13:00:49.527745  1583 raft_consensus.cc:2468] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:49.571507  1586 rpcz_store.cc:276] 0709 13:00:48.442358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.612622 (+170264us) service_pool.cc:224] Handling call
0709 13:00:49.533952 (+921330us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b5800002798. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7de6ab71 00007f1b7de6aa22 00007f1b86d83c09 00007f1b85eddee0 00007f1b85fa70ab 00007f1b85fa7131 00007f1b85f550a0 00007f1b85f54984 00007f1b7f4cf6d4 00007f1b7f4cf662
0709 13:00:49.570990 (+ 37038us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31129344}
W20260709 13:00:49.575542  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.581218  1586 raft_consensus.cc:1275] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:49.525533  2677 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:49.536772  2979 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:49.436966  1587 rpcz_store.cc:276] 0709 13:00:48.233378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.233610 (+   232us) service_pool.cc:224] Handling call
0709 13:00:48.235395 (+  1785us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:48.266729 (+ 31334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:48.269697 (+  2968us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:48.338471 (+ 68774us) log.cc:844] Serialized 26 byte log entry
0709 13:00:48.909930 (+571459us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:48.929929 (+ 19999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.949572 (+ 19643us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:49.319546 (+369974us) raft_consensus.cc:1685] finished
0709 13:00:49.319565 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:49.319744 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":494065,"threads_started":1,"wal-append.queue_time_us":872462}
W20260709 13:00:49.591143  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 50212.5us
I20260709 13:00:49.516983  3059 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:49.528693  3061 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.606511  2986 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.584162  2945 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:49.587353  3002 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:49.521711  2426 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:00:49.505429  3049 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:49.631908  3061 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:49.633008  3000 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:59092 (request call id 63) took 1907 ms. Trace:
I20260709 13:00:49.602043  2677 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.604580  2979 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:49.652829  2677 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:49.653985  3058 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:00:49.654837  3058 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:49.526835  2935 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:49.633613  3000 rpcz_store.cc:276] 0709 13:00:47.725698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.726073 (+   375us) service_pool.cc:224] Handling call
0709 13:00:47.938914 (+212841us) ts_tablet_manager.cc:1151] Deleting tablet 75a149db07824e3fb3c1f721b61d6c20
0709 13:00:47.939013 (+    99us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:00:48.196203 (+257190us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:49.318059 (+1121856us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:49.632895 (+314836us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":160219,"thread_start_us":43212,"threads_started":1}
I20260709 13:00:49.601423  3019 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:49.658859  1585 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5.
I20260709 13:00:49.629506  2986 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:49.620054  3059 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.671730  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:00:49.663666  3001 consensus_meta.cc:287] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 1.225s	user 0.012s	sys 0.006s
I20260709 13:00:49.660962  3058 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:00:49.697221  2677 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:49.648113  2977 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:49.634655  3049 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:49.644570  3061 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:49.699474  2986 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:49.692727  3055 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.715598  1663 raft_consensus.cc:3055] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:49.716009  1663 raft_consensus.cc:740] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
W20260709 13:00:49.693226  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 172852us
I20260709 13:00:49.716836  1663 consensus_queue.cc:260] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:49.722132  1663 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:49.723347  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:49.723989  1659 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:49.678263  2979 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:49.726830  1633 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.034s	sys 0.075s
W20260709 13:00:49.727545  1633 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.034s	sys 0.075s
I20260709 13:00:49.708178  3037 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:49.728251  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 615229us
I20260709 13:00:49.707775  3058 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:49.730396  1633 leader_election.cc:400] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 election: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 3. Current term is 4.
I20260709 13:00:49.712292  2677 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:49.731206  1633 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:49.731594  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:49.702355  3059 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:49.734354  1633 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:49.733872  1665 raft_consensus.cc:2468] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:49.740064  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:49.740854  1662 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:49.745507  1633 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:49.706773  3001 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:49.716879  1477 catalog_manager.cc:5028] TS 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): tablet 75a149db07824e3fb3c1f721b61d6c20 (table test-workload [id=8a8e3153ff4e476f890a0820215f177a]) successfully deleted
W20260709 13:00:49.739518  2974 consensus_meta.cc:287] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.694s	user 0.011s	sys 0.005s
I20260709 13:00:49.718048  3055 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:49.752964  1663 raft_consensus.cc:1275] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:00:49.755291  2994 raft_consensus.cc:2804] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:49.756913  2979 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:49.762100  3001 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:49.745217  2931 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:49.741824  2977 raft_consensus.cc:2749] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:49.742311  2976 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.779690  2976 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:49.783993  3016 raft_consensus.cc:3055] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:49.784628  3016 raft_consensus.cc:740] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:49.768115  1663 pending_rounds.cc:85] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 1
I20260709 13:00:49.739230  2677 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:49.771176  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:49.733336  3058 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:49.773626  1661 raft_consensus.cc:1275] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 13:00:49.804577  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 361164us
W20260709 13:00:49.805269  3042 log.cc:927] Time spent T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.582s	user 0.003s	sys 0.000s
I20260709 13:00:49.805397  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:49.806245  1661 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:49.806839  3058 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:49.771054  2987 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
W20260709 13:00:49.767396  1477 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 50574.9us
I20260709 13:00:49.773054  2979 raft_consensus.cc:2804] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:49.767478  2974 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:49.825600  2979 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.826138  2979 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:49.826967  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:49.827713  1659 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:00:49.827860  2974 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:49.828701  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:49.771868  2994 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.748615  3071 raft_consensus.cc:2749] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:49.776795  2931 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:49.778137  3018 consensus_meta.cc:287] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.534s	user 0.014s	sys 0.001s
W20260709 13:00:49.769421  3004 consensus_meta.cc:287] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.719s	user 0.017s	sys 0.000s
I20260709 13:00:49.766850  1633 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
W20260709 13:00:49.789006  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.742157  3037 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:49.797739  1556 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:49.798133  1663 pending_rounds.cc:107] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:00:49.850787  1663 raft_consensus.cc:2889] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:49.851028  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 53370.5us
I20260709 13:00:49.802934  1666 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:00:49.807341  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:49.774694  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:49.808300  1705 leader_election.cc:336] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.950s (SENT)
I20260709 13:00:49.781678  2554 consensus_queue.cc:237] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:49.852636  1661 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:49.824360  2987 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:49.776341  3040 log.cc:927] Time spent T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.653s	user 0.001s	sys 0.007s
I20260709 13:00:49.829136  2935 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:49.824919  2677 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:49.830588  3016 consensus_queue.cc:260] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:49.832449  3055 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:49.834378  3009 consensus_meta.cc:287] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.792s	user 0.008s	sys 0.009s
I20260709 13:00:49.848709  3018 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:49.835075  1592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 660) took 1272 ms. Trace:
I20260709 13:00:49.870224  1664 raft_consensus.cc:1240] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:49.869994  1592 rpcz_store.cc:276] 0709 13:00:48.562336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.741513 (+179177us) service_pool.cc:224] Handling call
0709 13:00:48.741917 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:48.782618 (+ 40701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.834733 (+1052115us) spinlock_profiling.cc:243] Waited 4.32 ms on lock 0x7b54003921d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:00:49.835003 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9932544}
I20260709 13:00:49.841881  1659 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:49.839557  2994 raft_consensus.cc:3060] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:49.853158  1705 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:49.856040  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:49.874243  1663 raft_consensus.cc:2468] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
W20260709 13:00:49.874352  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 66080.9us
W20260709 13:00:49.875006  1705 leader_election.cc:336] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.962s (SENT)
I20260709 13:00:49.875362  1705 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:49.875804  1663 raft_consensus.cc:1275] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260709 13:00:49.857540  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 91376.8us
I20260709 13:00:49.877557  1633 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
W20260709 13:00:49.877878  1705 leader_election.cc:336] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.974s (SENT)
I20260709 13:00:49.878427  1705 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:49.878564  1633 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:49.860450  1556 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:49.880056  3045 raft_consensus.cc:2749] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:49.880152  1556 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:49.880944  2996 raft_consensus.cc:2804] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:49.881124  3045 raft_consensus.cc:2749] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:49.867059  2931 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:49.859543  3068 raft_consensus.cc:2804] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:49.862633  3027 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:49.866322  1666 raft_consensus.cc:1240] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:49.860643  1733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35672 (request call id 13) took 1636 ms. Trace:
I20260709 13:00:49.894042  1733 rpcz_store.cc:276] 0709 13:00:48.223906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.225946 (+  2040us) service_pool.cc:224] Handling call
0709 13:00:48.226524 (+   578us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:48.564262 (+337738us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:48.564298 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:48.625490 (+ 61192us) log.cc:844] Serialized 527 byte log entry
0709 13:00:48.893406 (+267916us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:49.112884 (+219478us) log.cc:844] Serialized 14 byte log entry
0709 13:00:49.113569 (+   685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.113672 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:49.698524 (+584852us) spinlock_profiling.cc:243] Waited 999 us on lock 0x7b4400022b4c. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7ddc8c85 00007f1b7ddc96a2 00007f1b80b3b1db 00007f1b80b36aaf 00007f1b80b2a86e 00007f1b80b29bb6 00007f1b80b297d8 00007f1b80b33221 00007f1b80b331d9 00007f1b80b33169
0709 13:00:49.860201 (+161677us) raft_consensus.cc:1685] finished
0709 13:00:49.860359 (+   158us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:49.860537 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46884,"raft.queue_time_us":101359,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":10932,"spinlock_wait_cycles":2298240,"thread_start_us":499208,"threads_started":2,"wal-append.queue_time_us":323942}
I20260709 13:00:49.869055  3009 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:49.852851  3004 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:49.882155  1705 leader_election.cc:336] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.997s (SENT)
I20260709 13:00:49.897306  1705 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:49.881560  1556 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:49.861114  3037 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:49.885864  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:49.881548  2996 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:49.889005  2985 raft_consensus.cc:2749] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:49.900882  3068 raft_consensus.cc:697] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 4 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:49.893050  2935 raft_consensus.cc:2804] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:49.893245  2988 consensus_queue.cc:1048] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:00:49.892670  3071 raft_consensus.cc:2804] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:49.893397  3058 raft_consensus.cc:2804] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:49.867565  2992 raft_consensus.cc:2804] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:49.905010  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:49.904371  1556 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:00:49.910929  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.912103  2976 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:49.873306  3018 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:49.915122  3055 raft_consensus.cc:2804] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:49.928145  1662 raft_consensus.cc:1240] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:49.903321  2931 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.900931  2987 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:49.903272  3016 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:49.903250  3045 raft_consensus.cc:2749] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:49.935657  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:49.947870  1663 raft_consensus.cc:2393] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 4: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:49.917306  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:49.948859  1666 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:49.916610  2996 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:49.903021  3001 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:49.930944  3058 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.938556  3070 consensus_queue.cc:1059] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:00:49.925817  2935 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.935429  2992 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.954599  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:49.930891  3071 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:49.956256  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:49.973419  1736 raft_consensus.cc:2468] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 3.
I20260709 13:00:49.954690  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:49.974937  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:49.975533  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:49.976034  1589 raft_consensus.cc:1240] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:49.977156  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:49.977756  1584 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:00:49.941762  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:49.942857  3055 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.980937  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:49.981195  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:49.984673  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:49.985826  1584 raft_consensus.cc:2393] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 5: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:49.980561  1666 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5.
I20260709 13:00:49.986882  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:49.987440  1666 raft_consensus.cc:2468] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:49.981359  1741 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:49.988219  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:49.991698  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:49.991986  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:49.994717  1590 raft_consensus.cc:1240] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:49.994971  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:49.954262  3037 raft_consensus.cc:2804] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:49.997394  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:49.996115  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:49.972561  2935 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:49.959010  3058 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:49.946246  2931 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:50.015735  2931 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:49.954583  2976 consensus_queue.cc:1048] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:00:49.972268  3059 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:49.998878  3037 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.935782  3027 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:50.002153  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:49.986416  3071 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:50.010515  2677 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:49.997733  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:49.985152  2992 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:49.989945  3055 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:50.023628  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:50.009176  3053 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:50.005784  2977 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.048954  1705 leader_election.cc:400] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Vote denied by peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683) with higher term. Message: Invalid argument: T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 3. Current term is 4.
I20260709 13:00:49.972899  3001 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:50.055935  3027 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:50.042630  3037 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:50.058555  3076 log.cc:927] Time spent T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:00:50.022832  2993 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:50.061000  2987 consensus_queue.cc:1048] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:50.076970  1705 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:50.114050  1705 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:50.080719  3053 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:50.029796  3002 consensus_queue.cc:1048] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:00:50.033360  2663 consensus_queue.cc:1048] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:00:50.115291  1584 raft_consensus.cc:1275] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:00:50.115767  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.053617  1585 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 4.
I20260709 13:00:50.022584  3068 consensus_queue.cc:237] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:50.051867  2677 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:50.082250  1587 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:00:50.126389  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:50.133827  1592 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:50.130780  2998 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:50.083690  2977 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:50.129554  3085 log.cc:927] Time spent T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:00:50.128737  3015 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:50.129990  3004 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:50.117369  2993 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:50.184667  1739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43678 (request call id 1043) took 1957 ms. Trace:
I20260709 13:00:50.185146  1739 rpcz_store.cc:276] 0709 13:00:48.219338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.220701 (+  1363us) service_pool.cc:224] Handling call
0709 13:00:50.176918 (+1956217us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b54000ff5d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:00:50.177054 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3677496576}
I20260709 13:00:50.145215  3009 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:50.190183  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:50.191862  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:50.193257  1664 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:00:50.193584  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:50.194614  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:50.197450  1667 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:00:50.192610  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:50.198477  1662 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:00:50.153386  3019 raft_consensus.cc:2804] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:50.199604  1666 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:50.195653  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:50.209353  1659 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:50.210587  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:50.210472  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:50.211331  1665 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:50.211297  1661 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:50.149188  3043 consensus_queue.cc:1048] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 13:00:50.239286  2977 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:50.240170  2977 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.202826  3019 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:50.241454  3019 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:50.255149  1592 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:00:50.258419  1590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 654) took 1815 ms. Trace:
I20260709 13:00:50.258980  1590 rpcz_store.cc:276] 0709 13:00:48.442748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.639622 (+196874us) service_pool.cc:224] Handling call
0709 13:00:48.728819 (+ 89197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.995162 (+1266343us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.258125 (+262963us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54003cf354. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:00:50.258336 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2910425472}
I20260709 13:00:50.261797  2988 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.262583  2988 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:50.294857  3053 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:50.295251  1661 raft_consensus.cc:1275] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:00:50.297430  1556 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:50.298725  1666 raft_consensus.cc:1275] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:50.300387  1556 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:50.295749  3053 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.304795  1659 raft_consensus.cc:3055] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:50.304201  3053 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:50.305337  1659 raft_consensus.cc:740] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:50.306363  1659 consensus_queue.cc:260] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:50.307480  1659 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:50.223495  2987 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:50.307089  3035 log.cc:927] Time spent T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 1.094s	user 0.010s	sys 0.010s
I20260709 13:00:50.303707  3004 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.240857  2977 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:50.308581  2976 raft_consensus.cc:2764] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:00:50.320050  1556 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:50.309906  3018 raft_consensus.cc:3055] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:50.341133  1633 leader_election.cc:400] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3.
I20260709 13:00:50.355528  1633 leader_election.cc:400] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 3. Current term is 4.
I20260709 13:00:50.366915  1488 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55132 (request call id 172) took 2921 ms. Trace:
I20260709 13:00:50.377561  3001 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:50.379896  3048 consensus_queue.cc:1048] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:50.327204  2945 raft_consensus.cc:2804] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:50.321799  2932 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.382241  1556 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:50.314474  2987 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:50.347033  3018 raft_consensus.cc:740] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:50.392462  1659 raft_consensus.cc:1275] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:00:50.382758  3058 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:50.397778  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.377458  3046 raft_consensus.cc:2804] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:50.372896  2426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.389614  2977 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:50.341264  3004 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:50.381016  2845 consensus_queue.cc:1059] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:00:50.414196  2677 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:50.377193  2994 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:50.426276  1556 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:50.430742  1659 pending_rounds.cc:85] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 1
I20260709 13:00:50.450666  1659 pending_rounds.cc:107] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:00:50.451251  1659 raft_consensus.cc:2889] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:50.431912  3052 raft_consensus.cc:2804] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:50.433681  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 319671us
I20260709 13:00:50.384909  2931 consensus_queue.cc:1059] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:00:50.413512  1488 rpcz_store.cc:276] 0709 13:00:47.445545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.445719 (+   174us) service_pool.cc:224] Handling call
0709 13:00:50.366822 (+2921103us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:48.269398 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:48.396715 (+127317us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:48.404428 (+  7713us) write_op.cc:435] Acquired schema lock
0709 13:00:48.404454 (+    26us) tablet.cc:662] Decoding operations
0709 13:00:48.632917 (+228463us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:48.642190 (+  9273us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:48.644741 (+  2551us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:00:48.835871 (+191130us) tablet.cc:701] Row locks acquired
0709 13:00:48.850289 (+ 14418us) write_op.cc:260] PREPARE: finished
0709 13:00:48.887133 (+ 36844us) write_op.cc:270] Start()
0709 13:00:48.897875 (+ 10742us) write_op.cc:276] Timestamp: P: 1783602048887079 usec, L: 0
0709 13:00:48.902948 (+  5073us) op_driver.cc:348] REPLICATION: starting
0709 13:00:48.991090 (+ 88142us) log.cc:844] Serialized 2093 byte log entry
0709 13:00:49.732268 (+741178us) op_driver.cc:464] REPLICATION: finished
0709 13:00:49.924995 (+192727us) write_op.cc:301] APPLY: starting
0709 13:00:49.930538 (+  5543us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:49.973801 (+ 43263us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:49.999997 (+ 26196us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:50.011916 (+ 11919us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:50.012234 (+   318us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:00:50.012315 (+    81us) write_op.cc:312] APPLY: finished
0709 13:00:50.012683 (+   368us) log.cc:844] Serialized 46 byte log entry
0709 13:00:50.024974 (+ 12291us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:50.044805 (+ 19831us) write_op.cc:454] Released schema lock
0709 13:00:50.046966 (+  2161us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:50.110483 (+ 63517us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:50.112817 (+  2334us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":142,"reported_tablets":8,"spinlock_wait_cycles":33024,"child_traces":[["op",{"apply.queue_time_us":180818,"apply.run_cpu_time_us":8681,"apply.run_wall_time_us":168043,"num_ops":5,"prepare.queue_time_us":965,"prepare.run_cpu_time_us":19969,"prepare.run_wall_time_us":846729,"replication_time_us":821005,"thread_start_us":167618,"threads_started":1}]]}
I20260709 13:00:50.453089  3052 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:50.425139  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 69804us
I20260709 13:00:50.453824  1705 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:50.429970  2945 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.456022  1705 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:50.460371  1663 raft_consensus.cc:2393] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 6: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:50.457985  1556 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:50.421298  3027 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:50.436609  3046 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:50.464063  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 325855us
I20260709 13:00:50.453775  3052 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:50.443202  2993 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:50.444350  3001 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.474056  1633 leader_election.cc:400] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3.
I20260709 13:00:50.462905  3006 raft_consensus.cc:2749] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:50.436930  3060 consensus_queue.cc:1059] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:00:50.484465  1741 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 4.
I20260709 13:00:50.457969  2926 raft_consensus.cc:3055] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:50.478785  1489 catalog_manager.cc:5697] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:50.460072  2928 raft_consensus.cc:2804] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:50.494606  1489 catalog_manager.cc:5697] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:50.461359  2945 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:50.493834  1705 connection.cc:256] RPC call timeout handler was delayed by -1.1544662550000453s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19140000000000001s for a response
I20260709 13:00:50.485605  1556 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:00:50.485189  2974 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.000s	sys 0.027s
I20260709 13:00:50.460019  2995 raft_consensus.cc:2804] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:50.433807  2932 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:50.499878  1489 catalog_manager.cc:5697] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:50.471453  3046 raft_consensus.cc:3060] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:50.471791  2931 raft_consensus.cc:3055] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:50.503466  1556 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:50.507480  1489 catalog_manager.cc:5697] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:50.469363  3002 consensus_queue.cc:1048] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:00:50.509537  1741 raft_consensus.cc:1275] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:50.495488  2845 raft_consensus.cc:2804] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:50.513978  1556 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:50.522171  1556 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:50.523175  1556 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:00:50.523528  3088 log.cc:927] Time spent T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:00:50.524111  2791 raft_consensus.cc:2804] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:50.524554  2791 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.524909  2791 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:50.515599  2995 raft_consensus.cc:697] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:50.534507  2995 consensus_queue.cc:237] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:50.515447  2933 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.537699  3053 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:50.537549  2933 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:50.473138  2988 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:50.498881  3020 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.506675  2998 raft_consensus.cc:2804] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:50.486572  2976 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
W20260709 13:00:50.503398  2974 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.000s	sys 0.027s
I20260709 13:00:50.519524  1489 catalog_manager.cc:5697] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:50.489034  2926 raft_consensus.cc:740] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:50.494985  2928 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:50.479679  3016 consensus_queue.cc:1048] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
W20260709 13:00:50.503216  3087 log.cc:927] Time spent T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:00:50.474473  3027 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:50.551939  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 58535.4us
I20260709 13:00:50.492115  3001 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } }
I20260709 13:00:50.496201  3018 consensus_queue.cc:260] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:50.520262  2993 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:50.521638  2845 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.545945  3069 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:50.550532  2998 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.564174  3015 consensus_queue.cc:1059] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:00:50.571368  2933 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:50.572865  2979 consensus_meta.cc:287] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.746s	user 0.016s	sys 0.000s
I20260709 13:00:50.574591  2426 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:50.575080  2791 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:50.575680  2994 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:50.567164  3004 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:50.575999  2987 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:50.559710  2976 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:50.554549  2988 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:50.513016  2931 raft_consensus.cc:740] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:50.579857  1633 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:50.579927  1489 catalog_manager.cc:5697] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
W20260709 13:00:50.583539  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.565346  2928 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:50.610948  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:50.554332  3020 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:50.600562  2993 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:50.600116  2663 consensus_queue.cc:1059] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
W20260709 13:00:50.722138  1706 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.017s	sys 0.027s
I20260709 13:00:50.602557  2845 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:50.643002  1705 leader_election.cc:336] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.614s (SENT)
I20260709 13:00:50.760026  1705 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:50.603826  3048 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:50.601897  3069 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:50.607558  2998 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:50.750046  1706 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.018s	sys 0.027s
W20260709 13:00:50.764361  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 121423us
W20260709 13:00:50.783366  1705 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.914s (SENT) [suppressed 76 similar messages]
W20260709 13:00:50.712523  2935 consensus_meta.cc:287] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.699s	user 0.012s	sys 0.001s
I20260709 13:00:50.784850  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:00:50.784873  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 205096us
I20260709 13:00:50.786949  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:50.785671  1739 raft_consensus.cc:1240] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:50.793247  1633 leader_election.cc:400] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5.
I20260709 13:00:50.786489  1733 raft_consensus.cc:1240] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:50.777570  2987 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.795547  2987 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:50.795617  2935 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:50.781155  3002 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:50.762049  2988 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.799310  2988 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:50.805509  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 231417us
I20260709 13:00:50.809276  2953 consensus_queue.cc:1048] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:50.809994  3020 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:50.779866  2663 consensus_queue.cc:1243] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer 6d4de2ce0683442498244b9529127f91 log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:00:50.812376  3001 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:00:50.657585  3060 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:50.813529  3060 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:50.814019  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:50.814716  1732 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:00:50.712080  3059 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.815912  3059 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:50.816474  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.778028  3095 raft_consensus.cc:2764] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:00:50.817438  2932 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:50.818099  3030 raft_consensus.cc:3055] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:50.818455  3030 raft_consensus.cc:740] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:50.818779  3009 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:50.819267  3030 consensus_queue.cc:260] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:50.820194  3094 raft_consensus.cc:3055] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:50.820664  3094 raft_consensus.cc:740] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:50.820812  2976 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:50.821376  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.821730  3094 consensus_queue.cc:260] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:50.611236  3018 raft_consensus.cc:3060] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:50.732439  2996 consensus_meta.cc:287] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.760s	user 0.007s	sys 0.006s
W20260709 13:00:50.616755  3055 consensus_meta.cc:287] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.541s	user 0.013s	sys 0.000s
I20260709 13:00:50.657471  3058 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:50.790262  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:50.819272  3009 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:50.823236  2931 consensus_queue.cc:260] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:50.780691  3069 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:50.825094  3059 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:50.828392  3030 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:50.762909  2944 raft_consensus.cc:3055] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:50.829716  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:50.861747  3095 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.832122  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:50.832825  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:50.873658  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:00:50.873888  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.874239  1733 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:50.875245  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:50.875922  1733 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:50.833815  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:00:50.834411  3071 consensus_meta.cc:287] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.772s	user 0.012s	sys 0.003s
I20260709 13:00:50.834823  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:50.863013  3001 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.611258  2926 consensus_queue.cc:260] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:50.837071  3037 consensus_meta.cc:287] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.720s	user 0.010s	sys 0.002s
I20260709 13:00:50.838016  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:50.886752  1740 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:50.840579  2992 consensus_meta.cc:287] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.778s	user 0.010s	sys 0.003s
W20260709 13:00:50.843413  3019 consensus_meta.cc:287] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.601s	user 0.011s	sys 0.002s
I20260709 13:00:50.844799  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:50.846550  2791 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:50.847627  3002 raft_consensus.cc:2749] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:50.758002  2993 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:50.564741  3003 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.018s	sys 0.032s
I20260709 13:00:50.750996  1663 raft_consensus.cc:3060] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:50.712620  3027 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:50.711232  3096 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:50.854907  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 331785us
I20260709 13:00:50.777839  1489 catalog_manager.cc:5697] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:50.794982  2994 raft_consensus.cc:2804] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:00:50.864284  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 71143.8us
I20260709 13:00:50.761782  2979 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:50.856132  2976 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.937677  1633 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:50.861125  3055 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:50.831387  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:50.871145  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:50.948002  1736 raft_consensus.cc:2393] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 5: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:50.948521  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:50.948819  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:50.949309  3055 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:50.949443  1736 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:50.949620  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:50.950146  3004 raft_consensus.cc:2749] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:50.950452  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:50.877584  1739 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 1.
I20260709 13:00:50.876878  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:50.836356  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:50.951278  1733 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:00:50.951378  1735 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:50.951548  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:50.952145  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:50.952632  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:50.952709  1733 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:50.953852  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:50.953965  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:50.954880  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:50.955003  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:50.955880  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:50.880158  1741 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 1.
I20260709 13:00:50.785296  3048 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:50.893934  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 392253us
I20260709 13:00:50.893695  1738 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 4.
I20260709 13:00:50.957345  1707 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:00:50.958343  3048 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:50.869642  2987 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:50.958994  3016 raft_consensus.cc:2804] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:50.959405  3016 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.959822  3016 raft_consensus.cc:3060] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:50.869690  2944 raft_consensus.cc:740] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:50.880113  2931 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:50.975934  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:50.905424  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:50.977662  1590 raft_consensus.cc:3060] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:50.882944  3043 raft_consensus.cc:2955] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 4 to 6, VOTER 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:00:50.904459  2926 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:50.926802  1592 raft_consensus.cc:2955] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, VOTER 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:00:50.942706  2979 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:50.943341  2976 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:50.944518  1660 raft_consensus.cc:2393] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 4: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:50.945595  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:50.946422  2994 raft_consensus.cc:697] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:00:50.861277  2996 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:50.840926  2845 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:50.962838  1707 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:50.950614  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:00:51.007819  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 45104.5us
W20260709 13:00:50.919560  3003 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.019s	sys 0.032s
I20260709 13:00:50.974259  1633 leader_election.cc:400] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3.
I20260709 13:00:50.893873  1732 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 1.
I20260709 13:00:50.887656  3071 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:50.919355  3059 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.986831  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:51.019272  1661 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:00:50.987982  1741 raft_consensus.cc:1275] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:00:50.991148  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:50.917006  3060 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:51.021409  1665 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:51.022682  1741 pending_rounds.cc:85] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 1
I20260709 13:00:50.999473  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:50.998852  1663 raft_consensus.cc:2468] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 4.
I20260709 13:00:50.897886  3037 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:50.895150  3001 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:51.007123  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 223779us
I20260709 13:00:51.007913  1734 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:50.963676  1739 raft_consensus.cc:2410] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:50.973248  3004 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.902516  3019 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:50.961328  3093 consensus_queue.cc:1048] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
W20260709 13:00:50.986114  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.016676  1633 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:51.015209  3045 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:50.884651  3095 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:51.096397  1660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39146 (request call id 1037) took 1325 ms. Trace:
I20260709 13:00:51.100744  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:51.096961  1660 rpcz_store.cc:276] 0709 13:00:49.774319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.774440 (+   121us) service_pool.cc:224] Handling call
0709 13:00:51.096119 (+1321679us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540041c3d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:00:51.096314 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2510306048}
I20260709 13:00:51.106248  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:51.109479  1736 raft_consensus.cc:1240] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:51.060961  3060 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.029371  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:50.974752  2987 consensus_queue.cc:1048] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:00:50.979173  3048 consensus_queue.cc:1048] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:00:51.035480  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:50.897755  2992 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:51.062150  1662 raft_consensus.cc:1240] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 1. Current term is 2. Ops: []
W20260709 13:00:51.062526  1705 leader_election.cc:336] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.553s (SENT)
I20260709 13:00:51.062445  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:51.136423  1705 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:51.136629  1665 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:51.137328  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 74831.3us
I20260709 13:00:51.010126  2935 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:50.992348  3027 consensus_queue.cc:1048] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:00:51.010658  1737 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:51.063251  1707 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:51.073504  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:51.107072  1660 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:51.094882  2979 raft_consensus.cc:2804] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:51.127344  1659 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:51.141532  2927 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.024610  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:51.174000  1663 raft_consensus.cc:2393] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 5: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
W20260709 13:00:51.128782  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 111905us
I20260709 13:00:51.175216  1633 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:51.023041  1741 pending_rounds.cc:107] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:00:51.176173  1741 raft_consensus.cc:2889] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:51.145910  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.992173  3096 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:51.160676  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:00:51.177855  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 114708us
I20260709 13:00:51.178139  1660 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:51.161576  1739 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:00:51.127866  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:51.030925  3059 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:51.170486  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:51.181058  1734 raft_consensus.cc:2468] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
I20260709 13:00:51.072491  3004 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:51.108175  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:51.181972  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:51.027940  2944 consensus_queue.cc:260] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:51.183291  1633 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:51.183560  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:00:51.183736  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 182462us
I20260709 13:00:51.184346  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:51.184180  1737 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:51.124120  3045 raft_consensus.cc:697] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 5 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:51.188633  1590 raft_consensus.cc:2468] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 4.
I20260709 13:00:51.190605  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:51.191219  1734 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:00:51.191573  1663 raft_consensus.cc:1240] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:51.188287  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:51.141932  2989 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:51.142325  3009 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:51.194433  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:51.194649  1633 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:51.202229  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:51.204744  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:51.199360  1660 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:51.207015  1661 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:51.182798  2927 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } }
I20260709 13:00:51.190035  2979 raft_consensus.cc:697] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 4 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:51.239297  3101 raft_consensus.cc:2804] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:51.206525  1663 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:51.226750  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:51.309854  1591 raft_consensus.cc:2468] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:00:51.198566  1732 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:51.162745  2791 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.208199  1741 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:00:51.281293  1735 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 5.
I20260709 13:00:51.207373  3104 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:51.204026  3068 raft_consensus.cc:2804] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:00:51.226096  3107 log.cc:927] Time spent T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 13:00:51.193902  3058 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:51.186097  3103 raft_consensus.cc:2804] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:51.135551  3060 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:51.162250  2994 consensus_queue.cc:237] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:00:51.320430  3052 consensus_meta.cc:287] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.829s	user 0.015s	sys 0.006s
I20260709 13:00:51.208006  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:51.216113  1589 raft_consensus.cc:1240] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:51.240777  1556 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:00:51.295339  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.237317  1740 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 6.
I20260709 13:00:51.296584  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:51.174482  3105 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.217622  3092 consensus_queue.cc:1059] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.087s
W20260709 13:00:51.315056  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 106219us
I20260709 13:00:51.368091  1558 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:00:51.369287  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 128582us
I20260709 13:00:51.370054  1556 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:00:51.317504  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:51.370239  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 175677us
I20260709 13:00:51.317905  3125 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:51.298458  2945 consensus_meta.cc:287] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.788s	user 0.011s	sys 0.007s
W20260709 13:00:51.328627  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.332093  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:00:51.338425  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.338222  1737 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:51.281697  1665 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:51.351018  1738 raft_consensus.cc:1240] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:51.351563  1660 raft_consensus.cc:2393] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 7: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:51.351596  1734 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:51.384117  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:51.307062  2933 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:51.287506  2424 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:00:51.366549  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:51.330549  3071 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:51.378233  1633 leader_election.cc:400] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3.
I20260709 13:00:51.340363  3037 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:51.410386  3037 consensus_queue.cc:1048] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:51.385566  1735 raft_consensus.cc:1240] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:00:51.415804  2927 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:51.398715  3004 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:51.418272  3110 log.cc:927] Time spent T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 13:00:51.418573  2927 raft_consensus.cc:2804] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:51.420215  1664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1055) took 1227 ms. Trace:
I20260709 13:00:51.420691  1664 rpcz_store.cc:276] 0709 13:00:50.192762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:50.197374 (+  4612us) service_pool.cc:224] Handling call
0709 13:00:50.197722 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:50.637776 (+440054us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:50.637823 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:50.638503 (+   680us) log.cc:844] Serialized 26 byte log entry
0709 13:00:50.988601 (+350098us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:50.988645 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.992702 (+  4057us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:51.419942 (+427240us) raft_consensus.cc:1685] finished
0709 13:00:51.419984 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:51.420145 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2060,"raft.queue_time_us":96136,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":114,"thread_start_us":787018,"threads_started":2,"wal-append.queue_time_us":472270}
I20260709 13:00:51.419660  2927 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:51.426218  2927 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:51.354856  2845 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:51.390204  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:51.332723  2791 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:51.346302  3095 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:51.403136  1740 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:51.350185  3102 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.368309  3103 raft_consensus.cc:697] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:51.462391  1633 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:51.381287  2987 raft_consensus.cc:2749] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:51.373752  3118 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:00:51.444581  1663 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
W20260709 13:00:51.390708  2988 consensus_meta.cc:287] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.591s	user 0.011s	sys 0.001s
W20260709 13:00:51.392405  3046 consensus_meta.cc:287] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.852s	user 0.006s	sys 0.007s
W20260709 13:00:51.457371  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 87384.7us
I20260709 13:00:51.476209  1556 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:51.392149  3027 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:51.328361  3045 consensus_queue.cc:237] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:51.470363  1740 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:51.478611  1556 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:51.482563  3071 raft_consensus.cc:2749] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:51.484058  1556 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:51.459268  1585 raft_consensus.cc:1275] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:51.493072  1740 raft_consensus.cc:3055] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:51.493569  1740 raft_consensus.cc:740] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:51.458515  3101 raft_consensus.cc:697] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 3 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:51.366684  3052 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:51.488528  3113 log.cc:927] Time spent T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:00:51.460639  3019 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:51.463517  1732 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:51.478886  3111 log.cc:927] Time spent T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.283s	user 0.001s	sys 0.000s
I20260709 13:00:51.471894  2902 raft_consensus.cc:2804] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:00:51.542191  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.392705  2945 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:51.353883  3104 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:51.430277  2933 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:51.500445  1633 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:00:51.553272  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 182862us
I20260709 13:00:51.494524  1740 consensus_queue.cc:260] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:51.467088  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 206477us
I20260709 13:00:51.479132  3027 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.481894  3059 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:51.505429  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:51.496196  3109 log.cc:927] Time spent T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
I20260709 13:00:51.484906  2845 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:51.492020  2987 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:51.543844  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.474529  3095 consensus_queue.cc:1059] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:00:51.397055  3125 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:51.472169  3102 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:51.497267  3123 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.505748  3071 consensus_queue.cc:1059] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.098s
W20260709 13:00:51.553795  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 53417.3us
I20260709 13:00:51.481261  3046 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:51.453001  2979 consensus_queue.cc:237] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:51.502470  3006 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.554524  2902 raft_consensus.cc:697] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:00:51.531581  2992 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:51.536577  3094 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:51.543588  2993 consensus_meta.cc:287] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.608s	user 0.011s	sys 0.007s
I20260709 13:00:51.479343  2988 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:51.554172  3068 raft_consensus.cc:697] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 4 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:51.504139  3119 raft_consensus.cc:2804] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:00:51.607174  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 140190us
I20260709 13:00:51.629098  1658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1052) took 1437 ms. Trace:
I20260709 13:00:51.601416  3027 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:51.616681  1734 raft_consensus.cc:1275] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:51.555711  3096 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:51.369074  3105 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:51.478744  3118 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:51.608465  2987 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:51.623293  3095 raft_consensus.cc:2804] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:00:51.633276  2931 consensus_meta.cc:287] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.647s	user 0.007s	sys 0.007s
W20260709 13:00:51.635548  2926 consensus_meta.cc:287] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.644s	user 0.007s	sys 0.008s
I20260709 13:00:51.626660  2791 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:51.641979  3136 raft_consensus.cc:3055] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:51.630013  3102 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:51.641160  3060 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:51.654850  3119 raft_consensus.cc:697] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:00:51.658557  3016 consensus_meta.cc:287] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.698s	user 0.014s	sys 0.004s
I20260709 13:00:51.669644  3118 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:00:51.612124  3103 consensus_queue.cc:237] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:51.674270  3125 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:51.657704  2987 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:51.642362  2993 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:51.659425  3095 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.669234  3105 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:51.629192  2902 consensus_queue.cc:237] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:51.682700  3095 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:51.625931  3101 consensus_queue.cc:237] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:51.666390  3136 raft_consensus.cc:740] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:51.615382  3123 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } }
I20260709 13:00:51.626430  3006 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:51.692787  2928 consensus_meta.cc:287] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.929s	user 0.012s	sys 0.001s
I20260709 13:00:51.693305  2933 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:51.707499  3104 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:51.707685  3046 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:51.709249  3018 consensus_meta.cc:287] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.848s	user 0.011s	sys 0.013s
W20260709 13:00:51.713176  3030 consensus_meta.cc:287] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.842s	user 0.005s	sys 0.015s
I20260709 13:00:51.687187  3052 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:51.681272  3016 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:00:51.718863  3069 consensus_meta.cc:287] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.847s	user 0.012s	sys 0.006s
I20260709 13:00:51.694893  3068 consensus_queue.cc:237] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:51.716250  3132 raft_consensus.cc:3055] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:51.730602  3132 raft_consensus.cc:740] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:51.712939  3119 consensus_queue.cc:237] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:51.731171  3123 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:00:51.733628  3136 consensus_queue.cc:260] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:51.750711  3136 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:51.738941  3132 consensus_queue.cc:260] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:51.758154  3132 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:51.554039  1558 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:51.799172  1584 raft_consensus.cc:2393] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 4: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:51.801887  1592 raft_consensus.cc:1240] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:51.802002  1587 raft_consensus.cc:1240] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 2. Current term is 3. Ops: []
W20260709 13:00:51.803421  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 247030us
W20260709 13:00:51.603329  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 118462us
I20260709 13:00:51.809274  1558 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:51.616199  1633 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:51.638592  1658 rpcz_store.cc:276] 0709 13:00:50.191911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:50.192033 (+   122us) service_pool.cc:224] Handling call
0709 13:00:50.192334 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:50.565791 (+373457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:50.565837 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:50.566429 (+   592us) log.cc:844] Serialized 26 byte log entry
0709 13:00:50.902358 (+335929us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:50.902397 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.902462 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:51.628859 (+726397us) raft_consensus.cc:1685] finished
0709 13:00:51.628880 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:51.629012 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101249,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":171,"thread_start_us":650773,"threads_started":2,"wal-append.queue_time_us":537486}
W20260709 13:00:51.818674  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:51.826066  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 209782us
I20260709 13:00:51.831595  1556 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:51.828552  1633 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:51.842417  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:00:51.843039  2988 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:51.852742  2933 raft_consensus.cc:2804] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:51.853377  2933 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:51.853880  2933 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:51.855315  3006 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:51.855891  3018 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.856745  3018 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:51.857401  2993 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:51.860162  3018 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:51.706578  2928 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:51.864513  1586 raft_consensus.cc:1240] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:51.866576  1584 raft_consensus.cc:1275] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:00:51.869107  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:51.869542  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.871680  2993 raft_consensus.cc:2804] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:51.877995  2993 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.878110  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:00:51.873281  2928 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:51.878818  2993 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:51.877413  2979 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:51.887331  2979 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:51.875582  1733 raft_consensus.cc:1275] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
W20260709 13:00:51.881043  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 46186.3us
I20260709 13:00:51.876539  3016 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:00:51.870908  3018 raft_consensus.cc:2804] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:51.876703  2998 consensus_meta.cc:287] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 1.028s	user 0.008s	sys 0.006s
W20260709 13:00:51.876940  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 49193.8us
I20260709 13:00:51.888507  1733 pending_rounds.cc:85] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 2
I20260709 13:00:51.887956  2979 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:51.895677  1662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1059) took 1594 ms. Trace:
I20260709 13:00:51.895406  3018 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.913847  3018 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:51.917245  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.898367  2927 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:51.919620  2845 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:51.919957  2927 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:51.920154  2933 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:51.922605  2933 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:51.901397  2928 raft_consensus.cc:2804] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:51.925493  1556 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:51.926379  2994 consensus_queue.cc:1048] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:51.926239  1736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1053) took 1089 ms. Trace:
I20260709 13:00:51.926201  2998 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:51.900534  3043 consensus_meta.cc:287] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6: Time spent flushing consensus metadata: real 0.800s	user 0.007s	sys 0.009s
W20260709 13:00:51.936460  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.912001  1733 pending_rounds.cc:107] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:00:51.945937  1733 raft_consensus.cc:2889] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:51.913195  1662 rpcz_store.cc:276] 0709 13:00:50.293593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:50.296461 (+  2868us) service_pool.cc:224] Handling call
0709 13:00:50.296856 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:51.136276 (+839420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:51.887627 (+751351us) spinlock_profiling.cc:243] Waited 765 ms on lock 0x7b540044e654. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:00:51.888003 (+   376us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1759388032}
I20260709 13:00:51.941393  2928 raft_consensus.cc:697] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:51.942281  1736 rpcz_store.cc:276] 0709 13:00:50.836607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:50.955973 (+119366us) service_pool.cc:224] Handling call
0709 13:00:50.956405 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:51.110043 (+153638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:51.925689 (+815646us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b5400143f54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:00:51.926048 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":351444736}
I20260709 13:00:51.980101  1732 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
W20260709 13:00:51.981716  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 56470.4us
I20260709 13:00:51.982592  2998 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:51.983457  2998 raft_consensus.cc:2804] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:51.983567  1556 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:51.984045  2998 raft_consensus.cc:697] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:51.984992  1556 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:51.996989  1558 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:00:52.003990  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.730983  3069 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:52.019701  3136 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.020490  3136 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:52.021714  2993 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:52.022203  2987 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:52.023042  3136 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:52.023958  2993 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:52.024371  2987 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:52.026512  2979 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:52.027143  2791 raft_consensus.cc:2749] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:52.029700  2933 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:52.030339  2933 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.029877  2928 consensus_queue.cc:237] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:52.030808  2933 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:52.032830  3060 raft_consensus.cc:2804] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:52.033393  3060 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.012302  2998 consensus_queue.cc:237] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:52.034021  3060 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:52.057832  2945 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:52.060055  3001 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:52.067808  1737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1082) took 1069 ms. Trace:
I20260709 13:00:52.068341  1737 rpcz_store.cc:276] 0709 13:00:50.998260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.453941 (+455681us) service_pool.cc:224] Handling call
0709 13:00:51.459769 (+  5828us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:51.460018 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:51.460048 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:51.474396 (+ 14348us) log.cc:844] Serialized 26 byte log entry
0709 13:00:52.050269 (+575873us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:52.063053 (+ 12784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.067323 (+  4270us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:52.067379 (+    56us) raft_consensus.cc:1685] finished
0709 13:00:52.067393 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:52.067579 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":491210,"threads_started":1,"wal-append.queue_time_us":564796}
W20260709 13:00:52.081802  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 136187us
I20260709 13:00:52.092351  3043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:41902 (request call id 0) took 2288 ms. Trace:
I20260709 13:00:52.065872  2979 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:52.080780  3027 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:52.107527  3092 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.003s	sys 0.018s
W20260709 13:00:52.121420  3092 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.004s	sys 0.019s
I20260709 13:00:52.121554  1738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1061) took 1282 ms. Trace:
I20260709 13:00:52.121677  3069 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:52.122041  1738 rpcz_store.cc:276] 0709 13:00:50.839046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:50.958467 (+119421us) service_pool.cc:224] Handling call
0709 13:00:51.350677 (+392210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:51.384300 (+ 33623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.121172 (+736872us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b54002562d0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8e8ad 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:00:52.121370 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":901237120}
W20260709 13:00:52.134390  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 72501.7us
W20260709 13:00:52.148602  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.150807  2935 consensus_queue.cc:1059] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:00:52.152307  1737 raft_consensus.cc:1240] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:52.160450  2933 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:52.162575  2976 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:52.165467  2933 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:52.168092  2985 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.168787  2985 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:52.174086  1740 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:52.153878  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:52.177796  3058 raft_consensus.cc:3055] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:52.178311  3058 raft_consensus.cc:740] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:52.177862  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:00:52.181433  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 56053.2us
I20260709 13:00:52.146790  3092 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:52.186429  1732 raft_consensus.cc:2393] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 in current term 4: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:52.186630  3092 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:52.187412  3095 consensus_meta.cc:287] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.502s	user 0.009s	sys 0.008s
I20260709 13:00:52.141724  3018 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:52.188038  1741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43678 (request call id 1094) took 1022 ms. Trace:
I20260709 13:00:52.152839  2935 raft_consensus.cc:3055] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:00:52.199461  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.200376  1558 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:52.201388  1732 raft_consensus.cc:1275] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:52.203616  1558 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:52.204824  3037 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:52.197841  3092 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:52.210014  2998 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:52.192519  1741 rpcz_store.cc:276] 0709 13:00:51.165848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.181735 (+ 15887us) service_pool.cc:224] Handling call
0709 13:00:52.187534 (+1005799us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b54001581d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:00:52.187735 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58937088}
I20260709 13:00:52.188607  3058 consensus_queue.cc:260] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:52.194017  2935 raft_consensus.cc:740] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:52.218979  3058 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:52.231532  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.218992  2985 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:52.237394  2996 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:52.106128  3043 rpcz_store.cc:276] 0709 13:00:49.777069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.777859 (+   790us) service_pool.cc:224] Handling call
0709 13:00:49.872784 (+ 94925us) log.cc:844] Serialized 501 byte log entry
0709 13:00:52.062206 (+2189422us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6136,"raft.run_cpu_time_us":2260,"raft.run_wall_time_us":79846,"thread_start_us":115099,"threads_started":1,"wal-append.queue_time_us":126589,"wal-append.run_cpu_time_us":6704,"wal-append.run_wall_time_us":1095527}
I20260709 13:00:52.241835  3027 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:52.243839  3018 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:52.220275  2935 consensus_queue.cc:260] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:52.188532  3095 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:52.252437  2935 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:52.255834  1733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1055) took 1418 ms. Trace:
I20260709 13:00:52.279948  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:52.272969  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:52.212708  3060 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:52.256458  1733 rpcz_store.cc:276] 0709 13:00:50.837136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:50.956841 (+119705us) service_pool.cc:224] Handling call
0709 13:00:50.959121 (+  2280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:52.006368 (+1047247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.255439 (+249071us) spinlock_profiling.cc:243] Waited 874 ms on lock 0x7b54000ff0d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:00:52.255749 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2009187200}
I20260709 13:00:52.261978   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:52.306412  1738 raft_consensus.cc:1275] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:52.270453  1667 raft_consensus.cc:1275] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 4. (term mismatch)
I20260709 13:00:52.257690  1474 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3f75a0ee5c184536abc81f5a366016fb with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 5)
I20260709 13:00:52.339564  1667 pending_rounds.cc:85] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 3
I20260709 13:00:52.343454  1667 pending_rounds.cc:107] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 3.4
I20260709 13:00:52.343835  1667 raft_consensus.cc:2889] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:52.350244  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:52.307976  2985 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.351672  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:52.272305  2944 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:52.357580  2988 consensus_queue.cc:1059] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:52.362370  3037 raft_consensus.cc:2749] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:52.363286  2985 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:52.299964  2994 consensus_queue.cc:1048] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:00:52.365252  2932 consensus_queue.cc:1048] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:00:52.365975  1558 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:52.356163  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:52.383072  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.376498  2985 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:52.377585  1658 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:52.378412  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:00:52.378772  1474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 121236us
I20260709 13:00:52.380168  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:52.399168  1666 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:52.374629  3130 raft_consensus.cc:3055] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:52.388747  1661 raft_consensus.cc:2468] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:52.401261  3130 raft_consensus.cc:740] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:52.402503  3130 consensus_queue.cc:260] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:52.404425  3130 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:52.372208  1741 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 3.
I20260709 13:00:52.409085  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:52.411674  1738 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 3.
I20260709 13:00:52.412482  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:52.414187  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:52.415143  1739 raft_consensus.cc:2410] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:00:52.416230  1705 leader_election.cc:336] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.767s (SENT)
I20260709 13:00:52.416711  1705 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:00:52.418937  1705 leader_election.cc:336] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.800s (SENT)
I20260709 13:00:52.421388  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:52.422755  1732 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 4.
I20260709 13:00:52.425179  2985 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:00:52.432793  1705 leader_election.cc:336] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.944s (SENT)
W20260709 13:00:52.435012  1705 leader_election.cc:336] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.945s (SENT)
I20260709 13:00:52.436067  1705 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:52.440037  3095 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:52.439951  2985 raft_consensus.cc:2749] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:52.443663  1732 raft_consensus.cc:1275] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:00:52.443882  1659 raft_consensus.cc:1275] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:00:52.449190  1586 raft_consensus.cc:1275] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:00:52.458665  3105 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.460110  3030 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:52.462206  1733 raft_consensus.cc:1240] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:52.465461  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:52.467371  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:52.466279  1741 raft_consensus.cc:2955] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:00:52.468775  1735 raft_consensus.cc:1240] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3. Ops: []
W20260709 13:00:52.478051  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 112259us
W20260709 13:00:52.490651  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:52.491109  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.491660  1738 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 4.
I20260709 13:00:52.492852  1734 raft_consensus.cc:1275] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:00:52.492583  3135 consensus_queue.cc:1048] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:52.493448  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:52.494113  1659 raft_consensus.cc:2468] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
W20260709 13:00:52.494946  1705 leader_election.cc:336] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.994s (SENT)
I20260709 13:00:52.495369  1705 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:52.499751  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:52.492522  3030 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:52.504153  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:52.494413  3043 consensus_queue.cc:1048] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:00:52.489917  2988 raft_consensus.cc:2804] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:52.511958  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:52.521410  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:52.523128  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:52.523212  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:52.526093  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.524014  1661 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:52.520597  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:52.494647  3135 consensus_queue.cc:1048] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:00:52.530192  1740 raft_consensus.cc:1275] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:00:52.531203  3027 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.533149  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:52.533694  2663 raft_consensus.cc:2749] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:52.480749  3105 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:52.535458  1733 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:52.541278  1663 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:52.536365  1740 pending_rounds.cc:85] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 2
I20260709 13:00:52.541908  1740 pending_rounds.cc:107] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:00:52.537362  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:52.539059  2902 consensus_queue.cc:1048] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:00:52.544068  1732 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:00:52.533689  1659 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:00:52.520018  3060 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:52.542382  1740 raft_consensus.cc:2889] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:52.520823  2988 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.540447  3027 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:52.502288  2932 consensus_queue.cc:1048] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:00:52.549422  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:52.550058  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:52.551566  1667 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:52.554164  1661 raft_consensus.cc:2393] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 3: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:52.547878  2988 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:52.561812  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 66920us
I20260709 13:00:52.563549  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:52.566977  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:52.569443  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:52.549379  2996 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.568917  1735 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 3.
I20260709 13:00:52.574257  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:52.576264  3030 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:00:52.577838  1633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.579017  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:52.580057  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:52.582345  1659 raft_consensus.cc:2393] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 4: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
W20260709 13:00:52.582438  1705 leader_election.cc:336] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.040s (SENT)
I20260709 13:00:52.578353  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:52.583060  1740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1083) took 1580 ms. Trace:
I20260709 13:00:52.585505  1740 rpcz_store.cc:276] 0709 13:00:51.004534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.492472 (+487938us) service_pool.cc:224] Handling call
0709 13:00:51.492917 (+   445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:52.173583 (+680666us) spinlock_profiling.cc:243] Waited 560 ms on lock 0x7b58004d21d0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80eeb0aa 00007f1b80f6d447 00007f1b80f85fe7 00007f1b80f877de 00007f1b80f91b49 00007f1b80f92416 00007f1b80f8ed8f 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4
0709 13:00:52.577812 (+404229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.582987 (+  5175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1287682432}
I20260709 13:00:52.585197  1705 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:00:52.591652  1733 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:00:52.598474  1658 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:00:52.597301  1586 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 5.
I20260709 13:00:52.604331  1661 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:52.600649  1587 raft_consensus.cc:2393] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 5: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
W20260709 13:00:52.611865  3161 log.cc:927] Time spent T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:00:52.612879  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:52.579200  2996 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:52.615697  1736 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 3.
I20260709 13:00:52.602926  3030 raft_consensus.cc:2749] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:52.613325  2998 raft_consensus.cc:2749] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:52.612032  3003 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:52.618984  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:52.621964  1633 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:52.616819  3027 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:52.626619  1586 raft_consensus.cc:1240] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:52.628595  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:52.622830  3045 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.630311  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:00:52.632185  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 58834.8us
I20260709 13:00:52.622864  3003 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:52.634716  1707 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:00:52.635668  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.640522  1659 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:52.643296  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:00:52.644907  1705 leader_election.cc:336] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.105s (SENT)
I20260709 13:00:52.645825  1658 raft_consensus.cc:3060] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:52.633553  3045 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:52.650046  1705 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:52.651394  3030 raft_consensus.cc:2804] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:52.651691  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:52.651883  3030 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:00:52.652483  3030 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:52.640005  3095 raft_consensus.cc:2749] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:52.665061  3045 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:52.665761  3003 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:00:52.666752  3168 log.cc:927] Time spent T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:00:52.674968  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:52.675303  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:52.675745  1664 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:52.675644  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:52.676029  1660 raft_consensus.cc:2393] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 3: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:52.676432  1665 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:52.677412  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:52.678197  1660 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:52.679767  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.680667  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:52.681581  1584 raft_consensus.cc:2393] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 4: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
W20260709 13:00:52.684459  1705 leader_election.cc:336] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.111s (SENT)
I20260709 13:00:52.679531  1633 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:52.693143  1705 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:52.693948  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:52.694702  3045 raft_consensus.cc:2749] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:52.695289  1633 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:52.695920  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:52.696221  3018 raft_consensus.cc:2749] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:52.696736  1589 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 4.
I20260709 13:00:52.697149  3018 raft_consensus.cc:2749] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:52.695327  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:52.698208  1590 raft_consensus.cc:2393] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 4: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:52.698953  1633 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:00:52.699903  3095 raft_consensus.cc:2749] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:52.703428  1633 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:52.648648  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:52.662115  3169 log.cc:927] Time spent T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:00:52.705802  1587 raft_consensus.cc:2393] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 3: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:52.686930  1660 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:00:52.684479  1664 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:00:52.689553  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:52.707233  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:52.707226  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:52.708041  1664 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:52.708396  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.708949  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:52.690132  2996 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:52.691742  1583 raft_consensus.cc:1240] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:52.716162  1736 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:00:52.691856  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:52.692524  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:52.692819  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:52.719062  1658 raft_consensus.cc:2468] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:00:52.703552  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:52.685350  3003 raft_consensus.cc:2749] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:52.707219  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:52.709707  1660 raft_consensus.cc:2393] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 5: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:52.720191  1589 raft_consensus.cc:2393] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 3: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:52.721007  1588 raft_consensus.cc:2410] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:52.722513  1587 raft_consensus.cc:2468] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 3.
I20260709 13:00:52.735200  1665 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:00:52.737282  1584 raft_consensus.cc:1240] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:52.742647  1664 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:00:52.743891  1661 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
W20260709 13:00:52.747202  1705 leader_election.cc:336] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.166s (SENT)
I20260709 13:00:52.751407  1585 raft_consensus.cc:2393] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 6: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:52.751189  2979 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:52.761777  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:52.762511  1658 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:52.766623  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:52.768671  3020 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:52.769450  3020 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:52.771723  3020 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:52.775821  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:52.781675  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:52.746328  3058 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.785593  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:52.786510  1660 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:52.793134  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:52.793833  1732 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:52.797520  3003 consensus_queue.cc:1059] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:52.798823  3003 raft_consensus.cc:3055] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:52.799212  3003 raft_consensus.cc:740] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:52.800148  3003 consensus_queue.cc:260] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:52.781188  3166 log.cc:927] Time spent T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 13:00:52.808190  1732 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:00:52.808092  1591 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
W20260709 13:00:52.815948  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 112625us
W20260709 13:00:52.821547  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 89285.5us
I20260709 13:00:52.829290  1633 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:52.810531  3003 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:52.845321  3102 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.845942  3102 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:52.847729  3030 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:52.848259  3102 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:52.851729  3105 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:52.824707  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:52.852883  1585 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 3.
I20260709 13:00:52.854333  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:52.856384  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:52.858425  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:52.862610  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:52.860110  1739 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:00:52.867578  1666 raft_consensus.cc:2468] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:00:52.869380  1733 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:52.790462  3058 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:52.870568  1667 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:00:52.872696  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:00:52.875401  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 49974us
I20260709 13:00:52.875449  1734 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:52.882010  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:52.883013  1735 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:52.884881  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:52.884182  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:52.893360  1737 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:52.902900  1592 raft_consensus.cc:2393] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 3: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:52.912194  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:52.914598  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:52.919411  1738 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:52.922166  3020 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:52.922806  3020 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:52.925554  3172 log.cc:927] Time spent T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:00:52.927186  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:52.897512  2979 raft_consensus.cc:2804] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:00:52.929883  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 50909.6us
W20260709 13:00:52.928714  1705 leader_election.cc:336] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.355s (SENT)
I20260709 13:00:52.934317  1705 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:00:52.937166  3020 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:52.917939  1734 raft_consensus.cc:2955] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, VOTER 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:00:52.946177  1633 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:52.950143  1733 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:52.936055  2979 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:52.966322  1658 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:00:52.926644  3102 consensus_queue.cc:1048] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
W20260709 13:00:52.979475  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 45419.6us
W20260709 13:00:52.987648  3167 log.cc:927] Time spent T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.367s	user 0.000s	sys 0.005s
I20260709 13:00:52.993332  3030 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:52.962965  3095 raft_consensus.cc:2804] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:00:52.976454  3130 consensus_meta.cc:287] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.571s	user 0.007s	sys 0.007s
I20260709 13:00:52.966594  2979 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:53.003991  1633 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:53.005960  1660 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:00:53.003247  1556 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:52.999418  3095 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:53.013661  1592 raft_consensus.cc:1240] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:53.014909  1591 raft_consensus.cc:1240] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:00:53.017263  3130 raft_consensus.cc:2804] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:53.017640  3130 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.018150  3130 raft_consensus.cc:3060] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:53.010401  2998 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.016079  3095 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:53.030951  1556 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:00:53.031610  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 74704.4us
I20260709 13:00:53.031816  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:53.025197  2998 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:53.044869  3105 raft_consensus.cc:2804] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:53.045372  3105 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.045711  3105 raft_consensus.cc:3060] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:53.033488  3020 raft_consensus.cc:2749] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:53.059963  1556 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:53.065675  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:53.069334  1585 raft_consensus.cc:1240] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:53.075454  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:53.076157  1587 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:00:53.073413  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:53.077417  1591 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:53.080312  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:53.081068  1588 raft_consensus.cc:2393] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 4: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:00:53.073729  2935 raft_consensus.cc:2804] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:53.088207  1556 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:53.099504  1588 raft_consensus.cc:1275] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:53.100322  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:53.099687  1587 raft_consensus.cc:1240] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:53.085608  2935 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.102900  2935 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:53.097646  1738 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:00:53.105556  1591 raft_consensus.cc:1275] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:00:53.112715  1732 raft_consensus.cc:2468] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
W20260709 13:00:53.115523  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 45574us
I20260709 13:00:53.123347  1556 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:53.122211  1583 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:53.128625  1591 raft_consensus.cc:1275] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 13:00:53.162338  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 45927.3us
I20260709 13:00:53.162533  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:53.117867  2996 raft_consensus.cc:2804] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:53.164915  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:53.169277  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:53.169735  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.164372  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:53.173664  1586 raft_consensus.cc:2393] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 4: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:53.167171  2996 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.181325  2996 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:53.182006  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:53.182717  1665 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:53.183095  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:53.187671  2988 consensus_meta.cc:287] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.617s	user 0.011s	sys 0.000s
I20260709 13:00:53.188146  2988 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:53.178551  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:53.177685  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 181332us
I20260709 13:00:53.189764  1583 raft_consensus.cc:1240] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 3. Current term is 4. Ops: []
W20260709 13:00:53.162554  3177 log.cc:927] Time spent T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
W20260709 13:00:53.189667  3182 log.cc:927] Time spent T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:00:53.206065  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:53.194962  1665 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
W20260709 13:00:53.209864  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 44007.4us
I20260709 13:00:53.201251  1556 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:53.213693  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:53.214624  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:53.171715  2945 raft_consensus.cc:2804] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:53.216459  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:53.217799  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:53.218106  1658 raft_consensus.cc:1275] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:53.220402  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:53.207804  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:53.222193  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:53.223141  1591 raft_consensus.cc:2393] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 2: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:53.225063  1633 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:53.227223  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:53.234536  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:53.235622  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:53.236255  1732 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:53.236660  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.239352  1665 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:00:53.239877  1591 raft_consensus.cc:1240] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:53.240916  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:53.243482  1633 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:53.246273  1659 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:53.218890  3178 log.cc:927] Time spent T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:00:53.209542  2998 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:53.204124  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 101921us
I20260709 13:00:53.218863  2945 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.264786  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:53.267009  1586 raft_consensus.cc:1240] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 3. Current term is 4. Ops: []
W20260709 13:00:53.275859  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 84543.8us
I20260709 13:00:53.278349  1556 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:53.217628  3095 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:53.260015  3183 raft_consensus.cc:2804] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:53.277688  1590 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:53.278585  2663 consensus_queue.cc:1059] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:00:53.295959  2663 raft_consensus.cc:3055] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:53.296352  2663 raft_consensus.cc:740] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:53.297333  2979 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:53.298427  3003 consensus_queue.cc:1059] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:53.298756  1663 raft_consensus.cc:1240] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:53.299583  3095 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:53.299944  3003 raft_consensus.cc:3055] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:53.300325  3003 raft_consensus.cc:740] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:53.300455  3095 raft_consensus.cc:2804] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:53.302094  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:53.266431  2945 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:53.305994  1556 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:53.312922  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:53.315703  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:53.297448  2663 consensus_queue.cc:260] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:53.324136  1662 raft_consensus.cc:1275] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:53.343595  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:53.314253  3095 raft_consensus.cc:697] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:53.350215  1732 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:00:53.352627  1737 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:53.352909  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:53.354974  1740 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:53.352645  1556 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:53.350853  3193 raft_consensus.cc:2804] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:00:53.335659  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 68652.7us
I20260709 13:00:53.357034  2979 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:53.357533  3184 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:53.358170  3184 raft_consensus.cc:697] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 5 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:53.358215  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:53.359385  3184 consensus_queue.cc:237] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:53.351079  3003 consensus_queue.cc:260] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:53.364359  2988 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:53.352670  2998 raft_consensus.cc:2804] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:53.365072  3003 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:53.365267  2998 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:53.365737  2998 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:53.367465  3185 log.cc:927] Time spent T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:00:53.368414  3030 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.368969  3030 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:53.369480  3045 consensus_queue.cc:1059] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:53.371179  3030 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:53.371738  3030 raft_consensus.cc:3055] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:53.372058  3030 raft_consensus.cc:740] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:53.373157  3020 consensus_queue.cc:1059] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:53.374184  3020 raft_consensus.cc:3055] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:53.373167  3030 consensus_queue.cc:260] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:53.374586  3020 raft_consensus.cc:740] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:53.375129  3030 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:53.375385  3058 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:53.375545  3020 consensus_queue.cc:260] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:53.380997  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 137603us
I20260709 13:00:53.383025  1659 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:53.389495  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:53.395437  3095 consensus_queue.cc:237] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:53.398336  1707 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:53.387149  2663 raft_consensus.cc:3060] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:53.400203  3020 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:53.351102  3102 consensus_queue.cc:1059] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:00:53.418653  3190 consensus_queue.cc:1048] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:53.420341  3190 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:53.427052  1737 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:00:53.420852  3190 raft_consensus.cc:697] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:53.415026  2988 raft_consensus.cc:2804] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:53.421432  3187 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.459002  1740 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:00:53.453835  2988 raft_consensus.cc:697] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:53.462250  2998 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:53.462785  2988 consensus_queue.cc:237] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:53.465247  3009 raft_consensus.cc:2804] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:53.465827  3009 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:53.468122  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 119549us
W20260709 13:00:53.468662  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 70477.6us
W20260709 13:00:53.470899  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 82547.5us
I20260709 13:00:53.470399  1707 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:00:53.473984  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 70543.4us
I20260709 13:00:53.464839  2998 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:53.438865  3058 consensus_queue.cc:1048] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
W20260709 13:00:53.481125  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.487629  1737 raft_consensus.cc:1275] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:00:53.489109  1558 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:53.472173  3009 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:53.488338  1737 pending_rounds.cc:85] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 1
I20260709 13:00:53.497773  1737 pending_rounds.cc:107] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:00:53.498150  1737 raft_consensus.cc:2889] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:53.496238  1633 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:53.501777  1556 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:53.503700  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:53.509763  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:53.510393  1740 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:53.467200  2996 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:53.511861  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:53.512431  1733 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:53.516034  1740 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:00:53.525715  1733 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:53.527335  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:53.525686  1558 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:53.533535  1738 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:53.507470  3102 raft_consensus.cc:3055] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:53.536928  1589 raft_consensus.cc:2393] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 4: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
W20260709 13:00:53.541074  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 50551.6us
W20260709 13:00:53.527575  3130 consensus_meta.cc:287] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.006s
I20260709 13:00:53.473667  3187 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:53.552258  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 81039.6us
I20260709 13:00:53.553512  1556 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:53.554497  1556 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:53.555498  1556 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:53.521818  3196 raft_consensus.cc:2804] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:53.538026  3102 raft_consensus.cc:740] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:53.543651  2998 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.544082  3192 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.581477  1633 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:53.565193  3058 raft_consensus.cc:2764] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 13:00:53.575939  3105 consensus_meta.cc:287] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.530s	user 0.011s	sys 0.004s
I20260709 13:00:53.572453  2945 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } }
W20260709 13:00:53.611305  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 87686us
W20260709 13:00:53.641316  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.646620  1738 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:00:53.563534  3130 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:53.611503  1633 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
W20260709 13:00:53.609623  3203 log.cc:927] Time spent T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:00:53.566872  2935 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:53.635460  3193 raft_consensus.cc:697] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:53.653271  1592 raft_consensus.cc:2393] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 4: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
W20260709 13:00:53.653914  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 98560.6us
W20260709 13:00:53.659442  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 133758us
I20260709 13:00:53.579101  2998 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:53.639274  3202 consensus_queue.cc:1059] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:00:53.681751  2996 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:53.682418  2945 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:53.682813  2998 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:53.682662  3102 consensus_queue.cc:260] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:53.683809  3058 raft_consensus.cc:2804] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:53.684065  3102 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:53.684307  3058 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:53.684655  3130 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:53.684899  3058 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:53.685911  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:53.611083  3018 raft_consensus.cc:2804] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:53.662587  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 54692.9us
I20260709 13:00:53.662900  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:53.635591  3105 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:53.648327  3192 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:53.676021  3206 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.675670  3193 consensus_queue.cc:237] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:53.541981  3190 consensus_queue.cc:237] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:53.664822  1707 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:53.610898  3045 consensus_queue.cc:1048] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:00:53.705067  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:53.705461  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:53.706164  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:53.705125  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:53.710597  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:53.711155  1739 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:00:53.714614  1733 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:00:53.714741  1586 raft_consensus.cc:2393] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 2: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:53.716377  1586 raft_consensus.cc:1240] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:53.636632  3009 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } }
I20260709 13:00:53.719256  3009 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:00:53.720602  1733 raft_consensus.cc:1275] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:53.727489  1584 raft_consensus.cc:2393] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 3: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
W20260709 13:00:53.729468  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.698808  3018 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:53.708618  1585 raft_consensus.cc:1240] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:53.734905  1736 raft_consensus.cc:1275] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:53.708058  2945 raft_consensus.cc:2804] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:53.736477  1737 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:00:53.753575  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:53.738417  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:53.738572  1633 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:53.754292  1739 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:53.705842  2996 raft_consensus.cc:2804] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:53.753378  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:53.755573  1737 raft_consensus.cc:2393] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 5: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:53.757877  1558 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:53.740010  3018 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:53.761396  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:53.762161  1738 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:53.762585  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:53.765168  3209 consensus_queue.cc:1048] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:00:53.769155  3210 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:53.769840  2935 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:53.749502  3003 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.771294  3003 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:53.771842  3192 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:53.772713  3105 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:53.750694  2945 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.775631  1737 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:00:53.753034  3195 raft_consensus.cc:2804] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:53.788223  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:53.750898  3201 raft_consensus.cc:2749] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:53.782419  1739 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:00:53.789343  1558 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:53.751040  3198 raft_consensus.cc:2804] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:53.764091  2996 raft_consensus.cc:697] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:53.722743  3206 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:53.786473  2945 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:53.784559  3210 raft_consensus.cc:697] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:53.763609  3196 raft_consensus.cc:697] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:53.805653  1633 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:53.774286  3205 raft_consensus.cc:2804] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:53.848687  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 59478.1us
I20260709 13:00:53.850984  3214 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:53.848059  3200 consensus_queue.cc:1048] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 13:00:53.801594  2935 raft_consensus.cc:2804] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:53.857812  1733 raft_consensus.cc:1275] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:53.798875  3195 raft_consensus.cc:697] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:00:53.874014  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 80904us
I20260709 13:00:53.847375  3198 raft_consensus.cc:697] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:00:53.888294  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.853519  3184 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.888031  1738 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:00:53.855837  3205 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.884096  3207 raft_consensus.cc:2764] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:00:53.902134  3183 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:53.901824  3187 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:53.905702  3195 consensus_queue.cc:237] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:53.909853  3206 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:53.883916  2935 raft_consensus.cc:697] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:53.919582  3205 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:53.916318  3198 consensus_queue.cc:237] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:53.923710  3183 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:53.925704  1633 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
W20260709 13:00:53.925935  3216 log.cc:927] Time spent T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:00:53.852367  3196 consensus_queue.cc:237] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:53.928640  2935 consensus_queue.cc:237] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:53.936057  3210 consensus_queue.cc:237] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:53.936851  3213 raft_consensus.cc:3055] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:53.937254  3213 raft_consensus.cc:740] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
W20260709 13:00:53.900225  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 245537us
W20260709 13:00:53.941146  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 52290.2us
I20260709 13:00:53.941239  1556 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:53.947135  1633 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:00:53.949453  3207 raft_consensus.cc:2764] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:00:53.919981  3184 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:53.960932  1556 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:53.961956  3184 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:53.962394  1556 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:53.962546  3184 raft_consensus.cc:2749] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:53.963568  1556 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:53.964278  1558 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:53.964489  2998 raft_consensus.cc:2804] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:53.965046  2998 raft_consensus.cc:697] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:53.966027  2998 consensus_queue.cc:237] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:53.960084  1633 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:53.906971  2996 consensus_queue.cc:237] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:53.971755  1558 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:00:53.968051  3211 log.cc:927] Time spent T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 13:00:53.989006  1633 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:53.972577  3207 raft_consensus.cc:2804] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:53.998499  3226 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:53.978860  2988 raft_consensus.cc:2749] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:54.009377  3180 raft_consensus.cc:2955] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:00:54.011538  3058 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:54.012557  1584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 696) took 1194 ms. Trace:
I20260709 13:00:53.978513  3228 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:53.976181  3193 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:00:54.024102  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 53813.3us
I20260709 13:00:53.964318  3218 raft_consensus.cc:2804] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:54.013914  1591 raft_consensus.cc:1240] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:00:54.028632  3187 raft_consensus.cc:2804] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:54.029064  3018 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:54.023660  3207 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.026721  1584 rpcz_store.cc:276] 0709 13:00:52.818516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.818660 (+   144us) service_pool.cc:224] Handling call
0709 13:00:53.162380 (+343720us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b5800002798. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7de6ab71 00007f1b7de6aa22 00007f1b86d83c09 00007f1b85eddee0 00007f1b85fa70ab 00007f1b85fa7131 00007f1b85f550a0 00007f1b85f54984 00007f1b7f4cf6d4 00007f1b7f4cf662
0709 13:00:54.012317 (+849937us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b54002b75d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:00:54.012466 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1292578432}
W20260709 13:00:54.034297  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 62600.6us
I20260709 13:00:54.032186  3205 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } }
I20260709 13:00:54.044289  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:54.061053  1661 raft_consensus.cc:2410] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:54.044902  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:54.062208  1659 raft_consensus.cc:2368] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 4. Current term is 5.
I20260709 13:00:54.050211  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:54.062572  1558 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:53.968178  3213 consensus_queue.cc:260] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:53.975334  3183 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:54.063486  1665 raft_consensus.cc:2468] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:54.059734  1658 raft_consensus.cc:2955] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:00:54.075264  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:54.076468  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 106988us
I20260709 13:00:54.076579  1558 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:54.078007  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:54.059595  3228 raft_consensus.cc:697] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:54.059849  3207 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:54.081467  1556 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:00:54.074942  3232 log.cc:927] Time spent T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.076s	user 0.000s	sys 0.007s
I20260709 13:00:54.069528  3193 raft_consensus.cc:697] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:54.085503  1556 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:54.086810  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:54.088631  1665 raft_consensus.cc:2410] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 3 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:54.082633  3105 raft_consensus.cc:2804] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:54.093204  3018 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:54.087955  3195 raft_consensus.cc:2804] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:54.093835  3193 consensus_queue.cc:237] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:54.073124  3187 raft_consensus.cc:697] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:54.095206  3187 consensus_queue.cc:237] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:54.087292  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:54.097718  3228 consensus_queue.cc:237] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:54.074342  3218 raft_consensus.cc:697] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:54.117911  3210 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:54.118690  3210 raft_consensus.cc:697] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:54.119777  3210 consensus_queue.cc:237] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:54.122723  3234 consensus_queue.cc:1048] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:54.123914  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:54.085994  3213 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:54.127763  2663 raft_consensus.cc:2804] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:54.128899  2663 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.129514  2663 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:54.137346  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:54.137988  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:54.138340  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:54.138862  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:54.139165  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:54.139427  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.141130  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:54.125310  2988 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:54.141763  1659 raft_consensus.cc:2376] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5. Re-sending same reply.
I20260709 13:00:54.158213  2663 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:54.166810  3105 raft_consensus.cc:697] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:54.169695  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:54.167570  2988 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.125030  3234 consensus_queue.cc:1048] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:00:54.173233  2663 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:54.175410  1665 raft_consensus.cc:1240] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 3. Current term is 4. Ops: []
W20260709 13:00:54.176483  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 88682.6us
I20260709 13:00:54.176607  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:54.177700  1558 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:54.179183  1660 raft_consensus.cc:2410] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:00:54.171111  2988 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:54.197597  1558 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:54.199189  1658 raft_consensus.cc:2393] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 6: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:54.199357  1558 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:54.170547  2945 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:54.205263  1665 raft_consensus.cc:1240] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 3 LEADER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:54.174067  3195 raft_consensus.cc:697] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:54.202775  1558 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:54.203850  3228 raft_consensus.cc:2804] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:54.198464  3102 consensus_meta.cc:287] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.514s	user 0.003s	sys 0.010s
I20260709 13:00:54.202796  3190 raft_consensus.cc:2804] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:54.207154  3218 consensus_queue.cc:237] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:54.204293  3058 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:54.207894  3233 consensus_queue.cc:1048] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:00:54.215620  3205 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:00:54.216148  3183 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:54.217245  3228 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.256779  1665 raft_consensus.cc:1240] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 13:00:54.257198  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 47668.8us
I20260709 13:00:54.268067  1558 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:54.208194  1660 raft_consensus.cc:1240] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:54.269027  1558 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:54.256134  3190 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.291476  3190 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:54.292536  1665 raft_consensus.cc:1240] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:00:54.214749  3207 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:54.294636  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:54.295279  1705 leader_election.cc:336] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.510s (SENT)
I20260709 13:00:54.295562  3207 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:54.296137  1705 leader_election.cc:336] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.529s (SENT)
I20260709 13:00:54.296559  1705 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:54.299409  1660 raft_consensus.cc:1240] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:54.269846  3228 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:54.304312  3199 log.cc:927] Time spent T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.641s	user 0.003s	sys 0.000s
I20260709 13:00:54.253365  3193 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:54.214407  1585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 1097) took 1129 ms. Trace:
I20260709 13:00:54.239666  2945 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:54.259254  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 594505us
I20260709 13:00:54.270967  3245 raft_consensus.cc:2804] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:54.271849  1658 raft_consensus.cc:1240] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:00:54.272315  1558 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:54.273450  3196 raft_consensus.cc:2804] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:54.274467  1661 raft_consensus.cc:1240] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:00:54.274741  1667 raft_consensus.cc:1217] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Deduplicated request from leader. Original: 3.2->[5.3-5.3]   Dedup: 5.3->[]
W20260709 13:00:54.319314  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 47076us
I20260709 13:00:54.319852  1667 raft_consensus.cc:1240] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:00:54.275048  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:54.275382  3195 consensus_queue.cc:237] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:54.321028  1663 raft_consensus.cc:2393] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 4: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:54.276106  1664 raft_consensus.cc:1240] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:54.273001  3244 raft_consensus.cc:2804] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:54.276978  1662 raft_consensus.cc:1240] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 3. Current term is 4. Ops: []
W20260709 13:00:54.286785  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.287014  3003 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:00:54.316610  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 231157us
I20260709 13:00:54.324393  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:54.298261  2988 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:54.261404  3198 consensus_queue.cc:1048] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 13:00:54.314754  3193 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.313058  3214 raft_consensus.cc:2749] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:54.332484  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:54.341360  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:54.314555  1585 rpcz_store.cc:276] 0709 13:00:53.084998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.096901 (+ 11903us) service_pool.cc:224] Handling call
0709 13:00:53.109069 (+ 12168us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.750303 (+641234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.214128 (+463825us) spinlock_profiling.cc:243] Waited 578 ms on lock 0x7b54003cf854. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:00:54.214315 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1328482688}
I20260709 13:00:54.270135  3105 consensus_queue.cc:237] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:54.330672  2935 raft_consensus.cc:2804] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:54.330768  3245 raft_consensus.cc:697] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:54.330289  3196 raft_consensus.cc:697] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:54.323518  3247 raft_consensus.cc:2749] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:54.356192  3207 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.335358  3193 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:54.364871  1707 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:54.369356  2663 raft_consensus.cc:2804] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:54.369689  2663 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.369982  2663 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:54.371374  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:54.372180  1662 raft_consensus.cc:2393] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 6: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:54.328536  3020 consensus_queue.cc:1048] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:00:54.353509  2935 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.348331  3244 raft_consensus.cc:697] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:54.337402  3003 consensus_queue.cc:1059] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:00:54.396570  3003 raft_consensus.cc:3055] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:54.396415  3244 consensus_queue.cc:237] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:54.389365  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:54.398016  1659 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:00:54.389580  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:54.390197  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:54.400650  1660 raft_consensus.cc:3060] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:54.400540  2998 consensus_queue.cc:1059] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:54.401616  2998 raft_consensus.cc:3055] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:54.401932  2998 raft_consensus.cc:740] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:54.402756  2998 consensus_queue.cc:260] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:54.404002  2998 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:54.390388  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:54.374462  3207 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:54.380270  3233 consensus_queue.cc:1048] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:00:54.407109  3207 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:54.379956  3058 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.407876  1664 raft_consensus.cc:1275] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:54.408226  3058 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:54.410286  3058 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:54.366747  2988 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:54.410854  2935 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:54.373540  3183 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.411460  3183 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:54.413439  3183 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:54.385000  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:54.386435  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:54.414228  1658 raft_consensus.cc:2393] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 5: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:54.414278  1665 raft_consensus.cc:2393] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 4: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:54.388233  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:54.415180  1667 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:54.388479  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:54.415756  1661 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:54.370915  3102 consensus_queue.cc:1059] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:00:54.389289  1489 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55154 (request call id 165) took 7697 ms. Trace:
I20260709 13:00:54.370991  3206 consensus_queue.cc:1059] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
W20260709 13:00:54.394042  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.341624  3212 consensus_queue.cc:1048] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:00:54.394971  3196 consensus_queue.cc:237] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:54.416910  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:54.442456  1660 raft_consensus.cc:2468] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:00:54.396968  3003 raft_consensus.cc:740] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:54.443578  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:54.447392  1665 raft_consensus.cc:1240] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:54.447485  1663 raft_consensus.cc:1240] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:54.456598  1661 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:00:54.461879  1664 raft_consensus.cc:1275] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:54.467995  2663 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:54.472872  1486 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51168 (request call id 23) took 3654 ms. Trace:
I20260709 13:00:54.475654  3198 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.480365  3003 consensus_queue.cc:260] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:54.498241  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 159046us
W20260709 13:00:54.523967  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 167176us
I20260709 13:00:54.525964  1663 raft_consensus.cc:1240] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:54.429860  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 84029.2us
I20260709 13:00:54.528774  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:54.536887  1736 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:54.539162  2663 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:00:54.549486  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.505899  1486 rpcz_store.cc:276] 0709 13:00:50.817865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:50.820264 (+  2399us) service_pool.cc:224] Handling call
0709 13:00:54.472639 (+3652375us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1233561,"reported_tablets":1}
I20260709 13:00:54.564502  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:54.568298  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:00:54.599237  1705 leader_election.cc:336] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.589s (SENT)
I20260709 13:00:54.597335  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:00:54.617056  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.610316  1663 raft_consensus.cc:2376] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5. Re-sending same reply.
I20260709 13:00:54.632616  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:54.634578  1740 raft_consensus.cc:2393] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 4: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
W20260709 13:00:54.634903  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:54.649664  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 50500.4us
W20260709 13:00:54.657002  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.531633  3198 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:54.668030  1667 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:00:54.429237  1489 rpcz_store.cc:276] 0709 13:00:46.675430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.675620 (+   190us) service_pool.cc:224] Handling call
0709 13:00:46.753555 (+ 77935us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b5400119254. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef9090 00007f1b80f97f3a 00007f1b86d4e1cc 00007f1b86e4c37e 00007f1b8530d2a4 00007f1b8530d232 00007f1b8530d161 00007f1b8530d0dc 00007f1b8530c392 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:00:54.367079 (+7613524us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:51.289207 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:51.338203 (+ 48996us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:51.338281 (+    78us) write_op.cc:435] Acquired schema lock
0709 13:00:51.338325 (+    44us) tablet.cc:662] Decoding operations
0709 13:00:51.608516 (+270191us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:51.613049 (+  4533us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:51.615107 (+  2058us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:00:51.683379 (+ 68272us) tablet.cc:701] Row locks acquired
0709 13:00:51.685156 (+  1777us) write_op.cc:260] PREPARE: finished
0709 13:00:51.685382 (+   226us) write_op.cc:270] Start()
0709 13:00:51.685534 (+   152us) write_op.cc:276] Timestamp: P: 1783602051685320 usec, L: 0
0709 13:00:51.685572 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:00:51.717109 (+ 31537us) log.cc:844] Serialized 2869 byte log entry
0709 13:00:52.366438 (+649329us) op_driver.cc:464] REPLICATION: finished
0709 13:00:52.556138 (+189700us) write_op.cc:301] APPLY: starting
0709 13:00:52.558603 (+  2465us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:52.564204 (+  5601us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:52.568088 (+  3884us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:52.602152 (+ 34064us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:52.603669 (+  1517us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:00:52.603740 (+    71us) write_op.cc:312] APPLY: finished
0709 13:00:52.647365 (+ 43625us) log.cc:844] Serialized 58 byte log entry
0709 13:00:52.651366 (+  4001us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:52.651549 (+   183us) write_op.cc:454] Released schema lock
0709 13:00:52.651613 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:52.652156 (+   543us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:52.652191 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":65358,"reported_tablets":20,"spinlock_wait_cycles":33556736,"child_traces":[["op",{"apply.queue_time_us":157651,"apply.run_cpu_time_us":5254,"apply.run_wall_time_us":109936,"num_ops":7,"prepare.queue_time_us":223226,"prepare.run_cpu_time_us":32923,"prepare.run_wall_time_us":785818,"raft.queue_time_us":189720,"raft.run_cpu_time_us":101922,"raft.run_wall_time_us":135942,"replication_time_us":680523,"thread_start_us":568212,"threads_started":4,"wal-append.queue_time_us":376128,"wal-append.run_cpu_time_us":15599,"wal-append.run_wall_time_us":1567721}]]}
I20260709 13:00:54.596479  3003 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:54.668941  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.549620  3245 consensus_queue.cc:237] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:54.684367  1663 raft_consensus.cc:1240] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:54.806387  1661 raft_consensus.cc:1240] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:54.807507  1662 raft_consensus.cc:1240] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:54.704224  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:54.687294  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:54.836345  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:54.840811  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:54.842845  1658 raft_consensus.cc:2393] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 5: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:54.845229  1736 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
W20260709 13:00:54.845835  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:54.703751  3236 log.cc:927] Time spent T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.413s	user 0.003s	sys 0.000s
I20260709 13:00:54.858531  1665 raft_consensus.cc:2393] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 5: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
W20260709 13:00:54.805281  3250 log.cc:927] Time spent T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.374s	user 0.004s	sys 0.003s
I20260709 13:00:54.805850  3201 raft_consensus.cc:3055] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:00:54.673305  1707 connection.cc:256] RPC call timeout handler was delayed by -1.0489913069999375s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16590000000000002s for a response
I20260709 13:00:54.871593  1667 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:54.880626  1734 raft_consensus.cc:1275] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:00:54.873919  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:54.886904  1658 raft_consensus.cc:2393] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 4: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:54.802520  3247 raft_consensus.cc:3055] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:00:54.874939  1705 leader_election.cc:336] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.696s (SENT)
I20260709 13:00:54.894908  1705 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:00:54.858103  3228 consensus_meta.cc:287] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.557s	user 0.007s	sys 0.007s
I20260709 13:00:54.893781  3247 raft_consensus.cc:740] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
W20260709 13:00:54.927426  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.863153  3187 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.933002  1590 raft_consensus.cc:1240] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:00:54.934849  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:54.953369  1592 raft_consensus.cc:2393] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 4: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:54.936060  3233 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.938359  2988 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.939384  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:54.932495  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:54.879865  3201 raft_consensus.cc:740] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
W20260709 13:00:54.991286  3213 consensus_meta.cc:287] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.857s	user 0.020s	sys 0.000s
I20260709 13:00:54.995352  2945 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.939335  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:54.998533  3243 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.998916  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:54.952126  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:54.941951  1658 raft_consensus.cc:1275] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:00:54.974069  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:55.002170  1733 raft_consensus.cc:1275] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:00:54.953778  3206 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:55.114825  1733 pending_rounds.cc:85] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 2
I20260709 13:00:55.115381  1733 pending_rounds.cc:107] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:00:55.115979  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:55.007124  1665 raft_consensus.cc:2393] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 5: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:55.040683  1741 raft_consensus.cc:1275] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:55.064906  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:55.116230  1733 raft_consensus.cc:2889] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:55.122803  1584 raft_consensus.cc:2393] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 5: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:55.002195  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:00:55.028430  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 120828us
I20260709 13:00:55.047442  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:54.989769  1583 raft_consensus.cc:2376] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2. Re-sending same reply.
I20260709 13:00:55.130571  1591 raft_consensus.cc:1240] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:55.131100  1590 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:54.688237  1585 raft_consensus.cc:2955] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
W20260709 13:00:55.134693  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 259814us
I20260709 13:00:55.156296  1667 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2.
I20260709 13:00:55.132227  1661 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:55.144168  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:54.975347  2935 consensus_meta.cc:287] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.564s	user 0.014s	sys 0.006s
I20260709 13:00:55.145433  1659 raft_consensus.cc:1275] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
W20260709 13:00:55.052179  3218 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.026s	sys 0.063s
I20260709 13:00:55.123010  1660 raft_consensus.cc:2393] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 4: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
W20260709 13:00:55.157290  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:55.047175  3190 consensus_meta.cc:287] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.750s	user 0.021s	sys 0.002s
I20260709 13:00:54.953163  3102 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.179517  1591 raft_consensus.cc:1240] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 3. Current term is 4. Ops: []
W20260709 13:00:55.180527  1705 leader_election.cc:336] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.878s (SENT)
I20260709 13:00:55.177150  1659 pending_rounds.cc:85] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 1
I20260709 13:00:55.181597  1659 pending_rounds.cc:107] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:00:54.929281  3228 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:55.181847  1659 raft_consensus.cc:2889] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:55.182255  2663 consensus_queue.cc:1059] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:55.183321  1661 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
W20260709 13:00:55.179427  3218 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.027s	sys 0.064s
I20260709 13:00:54.966773  3187 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:54.996801  2945 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:55.180133  3206 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.129757  2988 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:55.209039  1705 leader_election.cc:336] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.914s (SENT)
I20260709 13:00:55.209574  1705 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:55.214522  1488 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55138 (request call id 174) took 4511 ms. Trace:
I20260709 13:00:55.184594  3102 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:55.215075  1488 rpcz_store.cc:276] 0709 13:00:50.516776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:50.522742 (+  5966us) service_pool.cc:224] Handling call
0709 13:00:50.529165 (+  6423us) spinlock_profiling.cc:243] Waited 3.39 ms on lock 0x7b5400119254. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef9090 00007f1b80f97f3a 00007f1b86d4e1cc 00007f1b86e4c37e 00007f1b8530d2a4 00007f1b8530d232 00007f1b8530d161 00007f1b8530d0dc 00007f1b8530c392 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:00:54.974494 (+4445329us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":282743,"reported_tablets":10,"spinlock_wait_cycles":7789312}
I20260709 13:00:55.208276  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:55.251245  1661 raft_consensus.cc:2393] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 2: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:55.218063  1666 raft_consensus.cc:1275] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:55.261526  3183 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:55.263630  3183 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:55.266578  3183 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:55.263648  3255 log.cc:927] Time spent T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.337s	user 0.001s	sys 0.001s
W20260709 13:00:55.263648  3258 log.cc:927] Time spent T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 13:00:55.000277  3243 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:55.183370  2935 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:55.182206  3190 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:54.990417  3233 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:54.992360  3201 consensus_queue.cc:260] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:54.914921  3247 consensus_queue.cc:260] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:55.261722  3205 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.217489  3206 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:55.287210  2998 consensus_meta.cc:287] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.876s	user 0.013s	sys 0.008s
I20260709 13:00:55.320776  1661 raft_consensus.cc:1240] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:55.303427  3183 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:00:55.337639  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:55.357520  1667 raft_consensus.cc:1240] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:55.324194  3201 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:55.335132  3193 consensus_meta.cc:287] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.946s	user 0.014s	sys 0.005s
I20260709 13:00:55.332098  3247 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:55.370904  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 166043us
I20260709 13:00:55.373627  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:55.377122  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:55.334378  3253 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:00:55.346498  3102 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:55.324860  3205 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:55.408018  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 198992us
I20260709 13:00:55.411212  1667 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:00:55.389137  2988 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:55.373265  3193 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:55.418964  1661 raft_consensus.cc:1240] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 2. Current term is 3. Ops: []
W20260709 13:00:55.419592  1705 leader_election.cc:336] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.076s (SENT)
I20260709 13:00:55.423804  1667 raft_consensus.cc:1275] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:00:55.413223  3228 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:55.435838  3243 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:55.370214  3183 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:55.396522  3102 consensus_queue.cc:1059] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:00:55.448546  2663 raft_consensus.cc:2749] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:55.452147  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:55.454006  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:55.454946  1661 raft_consensus.cc:2393] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 6: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:55.421514  3187 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:55.387359  3253 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:00:55.433537  3260 log.cc:927] Time spent T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:00:55.471172  2663 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:55.472353  2663 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:55.474203  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:55.475006  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:55.451608  2945 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:55.481761  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:55.462982  2935 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:55.482460  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.484735  1590 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:00:55.482144  3281 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.497578  3281 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:55.500303  3213 raft_consensus.cc:3055] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:55.507848  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:55.474370  3233 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:55.509114  2663 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:00:55.510793  3264 log.cc:927] Time spent T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:00:55.517536  3263 log.cc:927] Time spent T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
W20260709 13:00:55.519537  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.519448  1664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1138) took 1009 ms. Trace:
W20260709 13:00:55.520298  3265 log.cc:927] Time spent T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:00:55.520574  1665 raft_consensus.cc:2393] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 2: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:55.522701  3193 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:55.525007  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.525661  3183 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:00:55.527139  3205 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:55.476990  3276 consensus_queue.cc:1059] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:00:55.534664  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:00:55.535566  3276 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.536123  3276 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:55.543015  3198 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:55.509768  2663 raft_consensus.cc:3055] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:55.545513  2663 raft_consensus.cc:740] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:55.546928  2663 consensus_queue.cc:260] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:55.548334  2663 raft_consensus.cc:3060] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:55.554558  1588 raft_consensus.cc:1240] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:55.566704  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:55.567445  1660 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:00:55.566857  1663 raft_consensus.cc:1275] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:00:55.572829  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:55.573594  1667 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:55.574366  1663 raft_consensus.cc:1275] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:55.576747  1658 raft_consensus.cc:1240] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:55.577663  3102 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.578487  1667 raft_consensus.cc:1275] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:55.578197  3102 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:55.500895  3213 raft_consensus.cc:740] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:55.520313  1664 rpcz_store.cc:276] 0709 13:00:54.510131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.510523 (+   392us) service_pool.cc:224] Handling call
0709 13:00:54.535405 (+ 24882us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:54.597180 (+ 61775us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:54.597211 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:54.614577 (+ 17366us) log.cc:844] Serialized 26 byte log entry
0709 13:00:54.951512 (+336935us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:54.952515 (+  1003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.952720 (+   205us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:55.519209 (+566489us) raft_consensus.cc:1685] finished
0709 13:00:55.519238 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:55.519377 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3038,"raft.queue_time_us":21263,"raft.run_cpu_time_us":471,"raft.run_wall_time_us":35505,"spinlock_wait_cycles":9984,"thread_start_us":246481,"threads_started":1,"wal-append.queue_time_us":644530}
I20260709 13:00:55.590953  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:55.675566  1661 raft_consensus.cc:2393] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 2: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:55.596125  1665 raft_consensus.cc:3055] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:55.609208  3285 raft_consensus.cc:3055] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:55.677675  1665 raft_consensus.cc:740] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:55.677745  3285 raft_consensus.cc:740] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:55.678705  1665 consensus_queue.cc:260] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:55.678944  3285 consensus_queue.cc:260] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:55.680246  3285 raft_consensus.cc:3060] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:55.680446  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:55.676882  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:55.615927  3268 log.cc:927] Time spent T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:00:55.675601  3276 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:55.503476  3273 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
W20260709 13:00:55.619834  3003 consensus_meta.cc:287] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.787s	user 0.015s	sys 0.000s
W20260709 13:00:55.628389  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:55.656512  1705 leader_election.cc:336] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.694s (SENT)
I20260709 13:00:55.673338  3205 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.505837  3206 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:55.681928  1661 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:00:55.682147  1666 raft_consensus.cc:2410] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:00:55.683267  1665 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:55.684986  1705 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:55.668242  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:55.692488  1556 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:55.683938  3273 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:55.701169  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:00:55.702165  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 45714.2us
I20260709 13:00:55.686321  3003 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:55.707244  1556 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:55.710234  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:00:55.711825  3003 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:55.714367  3003 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:55.714570  3102 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:55.715626  3273 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:00:55.717110  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:00:55.693327  3205 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:55.706111  1705 leader_election.cc:336] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.460s (SENT)
I20260709 13:00:55.722981  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:55.684193  3213 consensus_queue.cc:260] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:55.700263  3206 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:55.704926  3196 raft_consensus.cc:2749] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:55.727404  1556 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:55.696962  2945 consensus_queue.cc:1048] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:00:55.703637  3253 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:00:55.731225  1665 raft_consensus.cc:1275] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:55.731379  1664 raft_consensus.cc:2393] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 4: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:55.732858  1734 raft_consensus.cc:1275] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:55.728288  3195 raft_consensus.cc:2804] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:55.733712  3213 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:55.734139  3195 raft_consensus.cc:697] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:55.735257  3195 consensus_queue.cc:237] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:55.736927  3196 consensus_queue.cc:1059] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:55.728457  3210 consensus_queue.cc:1048] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:00:55.738107  3196 raft_consensus.cc:3055] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:55.738543  3196 raft_consensus.cc:740] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:55.739477  3196 consensus_queue.cc:260] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:55.740816  3196 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:55.732154  2935 raft_consensus.cc:2804] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:55.741634  2935 raft_consensus.cc:697] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:55.742552  2935 consensus_queue.cc:237] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:55.743765  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:55.744933  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:55.745990  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:55.746459  1667 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:55.750308  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:55.750375  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:55.753950  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:55.755067  1667 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:00:55.755529  1666 raft_consensus.cc:2376] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 2. Re-sending same reply.
I20260709 13:00:55.756165  1556 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:55.756474  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:55.757429  1667 raft_consensus.cc:2393] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 4: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:55.757709  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:55.758211  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:55.758757  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:55.758948  1667 raft_consensus.cc:2393] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 4: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
W20260709 13:00:55.759783  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 53710us
I20260709 13:00:55.760104  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:55.760617  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:55.761150  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.761204  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:55.762677  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:55.762898  3249 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:55.768778  3249 raft_consensus.cc:697] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:55.770049  3249 consensus_queue.cc:237] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:55.762328  2945 consensus_queue.cc:1048] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:00:55.776649  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:55.778939  1665 raft_consensus.cc:2410] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:00:55.765647  1556 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:55.763331  1666 raft_consensus.cc:2393] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 5: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:55.779510  1667 raft_consensus.cc:2393] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 5: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
W20260709 13:00:55.885349  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 120578us
I20260709 13:00:55.885795  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:55.830974  1732 raft_consensus.cc:2955] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:00:55.822194  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:55.887482  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:55.849697  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:55.897994  1667 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:55.887542  3270 raft_consensus.cc:2804] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:55.822219  1585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46836 (request call id 35) took 1210 ms. Trace:
W20260709 13:00:55.895467  1705 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.528s (SENT) [suppressed 26 similar messages]
I20260709 13:00:55.766132  3205 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:55.856791  3257 log.cc:927] Time spent T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.537s	user 0.003s	sys 0.004s
I20260709 13:00:55.911839  1556 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:55.899601  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:00:55.906538  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.895836  3206 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.898128  1666 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:00:55.780121  3201 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.898389  1662 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:55.779366  3213 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.897329  2945 consensus_queue.cc:1048] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:00:55.763974  3212 consensus_queue.cc:1048] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.142s
I20260709 13:00:55.931632  1590 raft_consensus.cc:1240] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:55.931547  1705 leader_election.cc:336] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.867s (SENT)
I20260709 13:00:55.933897  1586 raft_consensus.cc:1240] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:55.933792  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:55.928007  3249 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.934476  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:55.935062  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:55.935417  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:55.911160  3195 consensus_queue.cc:1048] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:00:55.935837  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:55.958343  1734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1163) took 1016 ms. Trace:
I20260709 13:00:55.971702  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:55.979964  1734 rpcz_store.cc:276] 0709 13:00:54.943885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.944122 (+   237us) service_pool.cc:224] Handling call
0709 13:00:54.991186 (+ 47064us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.733308 (+742122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.958024 (+224716us) spinlock_profiling.cc:243] Waited 741 ms on lock 0x7b54000e6d54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:00:55.958253 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1705030016}
I20260709 13:00:55.902971  1585 rpcz_store.cc:276] 0709 13:00:54.612514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.624930 (+ 12416us) service_pool.cc:224] Handling call
0709 13:00:54.687451 (+ 62521us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:54.687877 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:55.543155 (+855278us) log.cc:844] Serialized 14 byte log entry
0709 13:00:55.821542 (+278387us) log.cc:844] Serialized 14 byte log entry
0709 13:00:55.821785 (+   243us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:55.821851 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:55.821918 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.821995 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:55.822129 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1114,"prepare.queue_time_us":121523,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":12868,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":17294,"thread_start_us":211671,"threads_started":2,"wal-append.queue_time_us":223365}
I20260709 13:00:55.913987  3243 raft_consensus.cc:2804] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:55.922006  1665 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:00:55.999137  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:56.000780  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:55.922534  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:55.901554  3270 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.946969  3228 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.949599  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:55.950325  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:55.950996  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:55.951591  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.951422  3281 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:55.944049  3213 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:55.957010  1660 raft_consensus.cc:3055] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:56.027336  1660 raft_consensus.cc:740] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:55.958199  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:55.961241  1556 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:55.963582  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:55.943135  3201 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:56.035508  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 74316.6us
I20260709 13:00:56.037038  1665 raft_consensus.cc:1275] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:55.972189  1663 raft_consensus.cc:3055] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:56.038988  1663 raft_consensus.cc:740] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:55.975492  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:55.974502  1662 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:55.985246  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:56.041515  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:55.902750  2935 consensus_queue.cc:1048] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.078s
I20260709 13:00:55.982084  3249 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:55.941865  3285 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.993148  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:56.027102  3187 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.964535  3205 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:56.007090  1667 raft_consensus.cc:2393] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 5: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:55.898928  3183 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.031083  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:55.960433  3234 consensus_queue.cc:1048] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:00:56.058957  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:00:56.034489  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 102935us
I20260709 13:00:56.034937  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:56.059954  1661 raft_consensus.cc:1275] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:00:56.047652  1660 consensus_queue.cc:260] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:55.985844  1666 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:00:56.060571  1558 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:56.044167  1658 raft_consensus.cc:1240] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:56.040442  1663 consensus_queue.cc:260] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:56.046025  1665 raft_consensus.cc:1275] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:00:56.094584  1663 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:56.004179  3243 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.012038  3270 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:55.978828  3206 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:56.049677  1589 raft_consensus.cc:2393] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 4: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:55.912002  2996 consensus_queue.cc:1059] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 13:00:56.051064  1556 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:56.059510  1667 raft_consensus.cc:1275] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:56.060525  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:56.067838  1664 raft_consensus.cc:1275] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:56.061424  1583 raft_consensus.cc:2393] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 5: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:56.043565  3210 raft_consensus.cc:2804] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:56.029729  3228 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:56.092950  1660 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:56.089607  1633 connection.cc:256] RPC call timeout handler was delayed by -2.3978588399999694s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1503s for a response
W20260709 13:00:56.111191  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.131408  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:56.132364  1590 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 4.
W20260709 13:00:56.132376  1633 connection.cc:256] RPC call timeout handler was delayed by -2.3213588400000162s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15880000000000002s for a response
W20260709 13:00:56.133550  1633 connection.cc:256] RPC call timeout handler was delayed by -2.130558839999992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18000000000000002s for a response
W20260709 13:00:56.133657  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 82685us
W20260709 13:00:56.134114  1633 connection.cc:256] RPC call timeout handler was delayed by -2.0360588400000097s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1905s for a response
W20260709 13:00:56.134617  1633 connection.cc:256] RPC call timeout handler was delayed by -1.9190588399999911s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20350000000000001s for a response
W20260709 13:00:56.135020  1633 connection.cc:256] RPC call timeout handler was delayed by -1.8713588399999708s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2088s for a response
W20260709 13:00:56.135396  1633 connection.cc:256] RPC call timeout handler was delayed by -1.6580588400000238s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23250000000000004s for a response
W20260709 13:00:56.135767  1633 connection.cc:256] RPC call timeout handler was delayed by -1.5464588400000139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2449s for a response
W20260709 13:00:56.136162  1633 connection.cc:256] RPC call timeout handler was delayed by -1.4699588400000039s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2534s for a response
W20260709 13:00:56.136514  1633 connection.cc:256] RPC call timeout handler was delayed by -1.3835588399999779s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.263s for a response
W20260709 13:00:56.136896  1633 connection.cc:256] RPC call timeout handler was delayed by -1.1333588399999712s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2908s for a response
W20260709 13:00:56.137850  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.138451  1633 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:56.141789  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:56.143591  1583 raft_consensus.cc:2410] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:00:56.145282  1583 raft_consensus.cc:1240] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:56.147756  1583 raft_consensus.cc:1240] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:56.142509  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:56.149274  1590 raft_consensus.cc:2393] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 4: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
W20260709 13:00:56.157708  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 43673.4us
I20260709 13:00:56.060261  3205 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:56.093568  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:56.061730  3234 consensus_queue.cc:1243] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer 5bb87fe07da2414e84ee578c3b176ede log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:00:56.055356  3285 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:56.167294  1660 raft_consensus.cc:1275] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:00:56.057776  3187 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:56.132658  3243 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:56.184093  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.180073  1660 pending_rounds.cc:85] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 2
I20260709 13:00:56.062268  3183 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:56.182972  1664 raft_consensus.cc:1275] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:00:56.191013  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:56.192764  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:56.194073  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:56.194471  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:56.194950  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:56.195288  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.186321  1660 pending_rounds.cc:107] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:00:56.196101  1660 raft_consensus.cc:2889] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:56.198284  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:56.198923  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:56.199397  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:56.199847  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.176826  3195 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:56.233834  3296 raft_consensus.cc:2804] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:56.234488  3296 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.234807  3296 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:56.236366  3233 consensus_queue.cc:1048] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:00:56.228399  3289 log.cc:927] Time spent T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
I20260709 13:00:56.228302  3281 consensus_queue.cc:1059] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:00:56.233668  3303 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.245064  1737 raft_consensus.cc:1240] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:56.245936  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:56.247340  1664 raft_consensus.cc:1275] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:56.253654  1733 raft_consensus.cc:2393] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 3: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
W20260709 13:00:56.247304  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 186834us
I20260709 13:00:56.250339  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:56.254585  1738 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:56.254547  1558 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:56.269569  1737 raft_consensus.cc:1240] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:00:56.273185  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:56.274435  1737 raft_consensus.cc:2410] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:56.275389  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:56.276564  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:56.280858  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:56.281675  1733 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 4.
I20260709 13:00:56.301962  1558 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:56.295207  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:56.303766  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:56.289366  1591 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:00:56.306272  1739 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 3.
I20260709 13:00:56.306294  1737 raft_consensus.cc:2393] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 4: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:56.307197  1735 raft_consensus.cc:2393] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 5: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:56.292045  1738 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:00:56.309167  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:56.309132  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:56.310212  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:56.311110  1738 raft_consensus.cc:2393] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 5: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:00:56.308344  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:56.313205  1735 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:56.311592  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:56.310845  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:56.314234  1737 raft_consensus.cc:2368] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 3. Current term is 4.
I20260709 13:00:56.314283  1733 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:56.247553  3288 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.248692  3247 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.315562  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:56.315498  3195 raft_consensus.cc:2804] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:56.321995  3196 consensus_queue.cc:1048] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:56.283386  2935 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:56.325604  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:56.311825  3299 raft_consensus.cc:2804] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:56.332302  3213 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:56.249890  3003 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.332806  1737 raft_consensus.cc:2410] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:00:56.325134  1735 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:00:56.332948  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:56.266039  3102 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:00:56.334481  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:56.346758  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:56.347761  1738 raft_consensus.cc:2393] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 4: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:56.323909  3212 consensus_queue.cc:1048] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:00:56.330327  1734 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 3.
I20260709 13:00:56.309860  3201 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:00:56.351019  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.364199  1739 raft_consensus.cc:1240] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:56.365368  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:00:56.369629  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 235004us
I20260709 13:00:56.404258  1556 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:00:56.407426  1738 raft_consensus.cc:1275] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:00:56.407745  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:56.408296  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.387655  1733 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 5.
I20260709 13:00:56.339148  3195 raft_consensus.cc:697] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:56.396749  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:56.396751  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:56.398722  1734 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 5.
W20260709 13:00:56.400514  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 262974us
I20260709 13:00:56.366678  1737 raft_consensus.cc:1275] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:00:56.365824  3294 log.cc:927] Time spent T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.316s	user 0.001s	sys 0.000s
I20260709 13:00:56.348508  3299 raft_consensus.cc:697] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 5 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:56.333875  3288 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:56.411737  1741 raft_consensus.cc:1240] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:00:56.416545  1633 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:56.336388  3247 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:56.346233  3277 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.410605  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:56.432958  1556 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:56.420428  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:00:56.432521  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 160483us
I20260709 13:00:56.434187  1735 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 4.
I20260709 13:00:56.280189  3303 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:56.437459  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 124882us
I20260709 13:00:56.345352  3302 consensus_queue.cc:1048] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.086s
W20260709 13:00:56.430100  3295 log.cc:927] Time spent T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.333s	user 0.000s	sys 0.001s
I20260709 13:00:56.348426  3003 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:56.446879  1584 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:00:56.418645  3190 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:56.400920  3201 consensus_queue.cc:1059] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:00:56.429883  3249 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:56.387774  3102 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:56.441527  1733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:55694
I20260709 13:00:56.422935  1488 catalog_manager.cc:5697] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 1 to 4, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:56.466506  1733 raft_consensus.cc:606] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:56.466884  1733 raft_consensus.cc:614] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:56.461161  3003 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:56.461903  1736 raft_consensus.cc:1275] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:56.469484  1662 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:00:56.447918  3198 raft_consensus.cc:2749] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:56.453258  3205 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:56.485841  3307 log.cc:927] Time spent T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:00:56.452734  3206 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:56.486663  1739 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 4.
I20260709 13:00:56.458724  3281 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.438441  3277 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:56.455945  3285 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:56.475199  3183 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:56.496840  1663 raft_consensus.cc:1275] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:00:56.461185  3288 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:56.475782  1488 catalog_manager.cc:5697] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: config changed from index 2 to 4, term changed from 2 to 4, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:56.492149  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:56.515225  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 98554.4us
I20260709 13:00:56.566959  1633 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:00:56.516561  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.506467  1663 pending_rounds.cc:85] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 2
I20260709 13:00:56.456154  3234 consensus_queue.cc:1048] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:00:56.483512  3190 raft_consensus.cc:2804] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:56.475080  3187 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:56.570716  1663 pending_rounds.cc:107] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 4.3
W20260709 13:00:56.571147  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 103167us
I20260709 13:00:56.513242  1488 catalog_manager.cc:5697] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: config changed from index 4 to 6, VOTER 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) evicted. New cstate: current_term: 4 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:56.505513  3311 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:56.483359  3304 consensus_queue.cc:1059] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:00:56.583262  1663 raft_consensus.cc:2889] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:56.494364  3214 consensus_queue.cc:1048] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.089s
I20260709 13:00:56.589103  3303 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:56.494383  3249 consensus_queue.cc:1048] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.099s
W20260709 13:00:56.584575  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 135370us
I20260709 13:00:56.497462  3003 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.510564  3308 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:56.559056  3288 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.579213  3210 raft_consensus.cc:697] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:56.594928  3314 consensus_queue.cc:1048] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:00:56.508854  3281 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:56.580123  3190 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:56.631146  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:56.639727  1738 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:56.643118  3318 log.cc:927] Time spent T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:00:56.644331  3270 consensus_meta.cc:287] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.503s	user 0.003s	sys 0.007s
I20260709 13:00:56.618638  3003 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:56.648177  3003 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:56.652513  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:56.653522  1732 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:56.653972  3247 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:56.503736  3195 consensus_queue.cc:237] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:56.654894  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:56.656085  1732 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:00:56.659515  3228 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:56.670516  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 103676us
I20260709 13:00:56.673671  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:56.675503  1732 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:56.680092  1736 raft_consensus.cc:1275] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:00:56.680454  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:56.511862  3299 consensus_queue.cc:237] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:56.703534  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:56.705019  1735 raft_consensus.cc:1275] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:56.683627  1739 raft_consensus.cc:1275] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:00:56.687505  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.696178  3198 raft_consensus.cc:3055] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:56.699298  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:56.701648  1741 raft_consensus.cc:1275] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:56.587184  3196 consensus_queue.cc:1048] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:00:56.708796  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:00:56.717176  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 211276us
I20260709 13:00:56.717226  1733 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:56.718870  1707 leader_election.cc:336] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.540s (SENT)
I20260709 13:00:56.637658  3187 raft_consensus.cc:2749] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:56.665409  3190 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:56.722643  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:56.725296  1735 raft_consensus.cc:1275] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:00:56.716581  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 44976.3us
I20260709 13:00:56.593274  3311 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:56.731539  1707 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:56.724644  1732 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:00:56.708281  1737 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:00:56.748445  1633 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:56.748620  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:56.660607  2996 consensus_queue.cc:1048] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:00:56.644778  3270 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:56.746902  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:56.747218  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:56.735090  1739 raft_consensus.cc:1275] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:00:56.754747  1739 pending_rounds.cc:85] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 1
I20260709 13:00:56.755018  1739 pending_rounds.cc:107] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:00:56.755286  1739 raft_consensus.cc:2889] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:56.749990  1737 raft_consensus.cc:1275] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:56.729344  1738 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:00:56.624989  3288 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:56.750864  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:56.758432  1735 raft_consensus.cc:1275] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:56.749742  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:56.709491  3102 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:00:56.751662  1732 raft_consensus.cc:1275] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:56.752156  1741 raft_consensus.cc:1275] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:00:56.756155  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.756884  1737 raft_consensus.cc:1275] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:56.709501  3198 raft_consensus.cc:740] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:56.760704  1738 raft_consensus.cc:1275] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:56.764719  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:56.761422  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:56.761566  1734 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:00:56.767225  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:56.767580  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:56.673214  3304 consensus_queue.cc:1048] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.079s
I20260709 13:00:56.768050  1592 raft_consensus.cc:2393] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 7: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
W20260709 13:00:56.768738  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 131896us
I20260709 13:00:56.771697  1740 raft_consensus.cc:1275] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:56.772871  1586 raft_consensus.cc:1240] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:56.769616  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:56.769675  1736 raft_consensus.cc:1275] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:00:56.770418  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:56.763396  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:56.774690  1588 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:56.744768  3003 raft_consensus.cc:2804] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:56.776608  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:56.777547  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:56.778553  1736 pending_rounds.cc:85] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 1
I20260709 13:00:56.778829  1736 pending_rounds.cc:107] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:00:56.729928  3247 consensus_queue.cc:1059] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:00:56.795007  3277 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:56.795408  3247 consensus_queue.cc:1059] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:56.798151  3233 consensus_queue.cc:1048] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:56.800272  3233 consensus_queue.cc:1048] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:56.803296  1633 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:56.766284  3187 raft_consensus.cc:2749] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:56.807753  1733 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:00:56.779096  1736 raft_consensus.cc:2889] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:56.760504  3312 consensus_queue.cc:1059] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:00:56.785522  3198 consensus_queue.cc:260] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:56.785857  3201 consensus_queue.cc:1048] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:56.786827  1585 raft_consensus.cc:1240] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:56.787333  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:56.822144  1666 raft_consensus.cc:1275] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:56.822609  1589 raft_consensus.cc:2393] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 5: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:56.788512  1740 raft_consensus.cc:1275] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:56.788707  3253 raft_consensus.cc:3055] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:56.791836  3270 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:56.792119  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.793543  3281 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:56.814437  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:56.829255  1739 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:55694
I20260709 13:00:56.829478  1662 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:56.829908  1739 raft_consensus.cc:606] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:56.815783  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:56.816347  1667 raft_consensus.cc:1275] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:56.830276  1739 raft_consensus.cc:614] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:56.820952  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:56.835629  1733 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:56.824002  1633 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:56.836162  1661 pending_rounds.cc:85] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 1
I20260709 13:00:56.836513  1661 pending_rounds.cc:107] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 13:00:56.836794  1661 raft_consensus.cc:2889] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:56.837872  1664 raft_consensus.cc:1275] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:56.825574  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:56.826030  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:56.842672  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:56.845736  1738 raft_consensus.cc:1240] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:56.851699  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:00:56.852988  3281 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.853452  3317 raft_consensus.cc:3055] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:56.854046  3317 raft_consensus.cc:740] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:56.853717  3281 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:56.855002  3317 consensus_queue.cc:260] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:56.856415  3281 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:56.856913  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:56.859215  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:56.859411  1633 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:56.859897  1740 raft_consensus.cc:2468] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:00:56.888449  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:56.891822  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:56.820942  3310 raft_consensus.cc:2749] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:56.809980  3003 raft_consensus.cc:697] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:56.893469  1666 raft_consensus.cc:1275] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:00:56.903044  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:56.903884  1663 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
W20260709 13:00:56.910458  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 131520us
I20260709 13:00:56.827412  3253 raft_consensus.cc:740] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:56.913007  1736 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
W20260709 13:00:56.921257  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 61958.7us
I20260709 13:00:56.922295  1633 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:56.856573  3317 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:56.860543  3198 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:56.927902  1733 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:00:56.933722  1707 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:56.777611  3210 consensus_queue.cc:237] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:56.910202  3187 raft_consensus.cc:2764] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:00:56.914588  3270 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:00:56.925312  3205 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:56.965647  1707 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:00:56.936429  3319 consensus_queue.cc:1059] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.091s
I20260709 13:00:56.971616  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:00:57.064860  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 99340.4us
I20260709 13:00:57.060315  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:57.070514  1737 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:57.075158  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 123163us
I20260709 13:00:56.972007  1660 raft_consensus.cc:1240] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:56.948066  3296 consensus_meta.cc:287] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.713s	user 0.011s	sys 0.002s
W20260709 13:00:57.080107  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 137356us
I20260709 13:00:57.097752  1633 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:57.083201  1705 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:57.086323  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:57.099180  1660 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:57.089387  1558 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:56.990384  3213 raft_consensus.cc:3055] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:57.062532  3277 raft_consensus.cc:3055] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:56.946334  3313 raft_consensus.cc:2749] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:57.118050  1558 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:57.135921  1558 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
W20260709 13:00:57.138839  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 55751us
I20260709 13:00:57.139712  1705 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:57.024085  3281 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:57.114634  2996 raft_consensus.cc:2804] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:56.987479  3253 consensus_queue.cc:260] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:57.190733  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 93070.1us
I20260709 13:00:57.061233  3311 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:00:57.169513  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.073738  3201 consensus_queue.cc:1048] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:00:57.111752  3335 raft_consensus.cc:2749] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:57.131664  3277 raft_consensus.cc:740] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:57.191624  1633 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:57.125774  3233 consensus_queue.cc:1048] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 13:00:57.119263  3213 raft_consensus.cc:740] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:56.970131  3334 consensus_queue.cc:1059] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.186s
I20260709 13:00:57.152333  3206 raft_consensus.cc:2804] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:57.153033  3234 raft_consensus.cc:2804] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:57.133904  3314 consensus_queue.cc:1048] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 13:00:56.969707  3270 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:57.128058  1660 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:00:57.215564  1633 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:00:57.168028  3281 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.193353  2996 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.259955  1737 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:00:57.181062  3288 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:57.131528  3303 consensus_queue.cc:1048] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.077s
I20260709 13:00:57.152386  3267 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:57.110544  3296 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:57.204908  3187 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.207171  3205 raft_consensus.cc:2749] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:57.100514  3003 consensus_queue.cc:237] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:57.152814  3195 consensus_queue.cc:1048] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 13:00:57.207347  3305 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.131399  2945 consensus_queue.cc:1048] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.078s
W20260709 13:00:57.304589  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:57.339977  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 157805us
I20260709 13:00:57.194242  3214 consensus_queue.cc:1048] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 13:00:57.194386  3228 consensus_queue.cc:1048] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
W20260709 13:00:57.342427  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 202788us
I20260709 13:00:57.401347  1660 raft_consensus.cc:1240] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:57.402208  1705 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:57.131408  3325 consensus_queue.cc:1048] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.093s
I20260709 13:00:57.222090  3319 raft_consensus.cc:3060] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:57.204896  3302 consensus_queue.cc:1048] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.089s
I20260709 13:00:57.380726  2996 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:57.294814  3234 raft_consensus.cc:697] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:57.262517  3313 consensus_queue.cc:1059] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.085s
I20260709 13:00:57.419607  3313 raft_consensus.cc:2749] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:57.289114  2935 consensus_queue.cc:1048] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.099s
I20260709 13:00:57.344996  3338 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:57.378252  3281 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:57.373867  3206 raft_consensus.cc:697] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:57.212225  3311 consensus_queue.cc:1059] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.089s
I20260709 13:00:57.299435  3321 consensus_queue.cc:1059] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.179s
I20260709 13:00:57.390558  3288 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:00:57.417029  3212 consensus_queue.cc:1048] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:00:57.391386  3187 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:57.465891  1558 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:00:57.433575  3243 consensus_meta.cc:287] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 1.234s	user 0.009s	sys 0.005s
W20260709 13:00:57.481503  3344 log.cc:927] Time spent T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:00:57.482975  3355 consensus_queue.cc:1048] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:57.393421  3305 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:57.485090  3234 consensus_queue.cc:237] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:57.487687  3296 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:57.433703  3302 consensus_queue.cc:1048] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
W20260709 13:00:57.489745  3343 log.cc:927] Time spent T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:00:57.489986  3270 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:00:57.430889  3313 raft_consensus.cc:3055] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:57.491418  1737 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:55694
I20260709 13:00:57.492198  3201 raft_consensus.cc:2749] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:57.541229  3338 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.493427  3311 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.493815  3321 raft_consensus.cc:3055] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:57.493963  3102 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
W20260709 13:00:57.494393  3342 log.cc:927] Time spent T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
W20260709 13:00:57.495412  3340 log.cc:927] Time spent T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.283s	user 0.001s	sys 0.000s
W20260709 13:00:57.495832  3330 log.cc:927] Time spent T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.485s	user 0.001s	sys 0.001s
W20260709 13:00:57.496272  3190 consensus_meta.cc:287] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.748s	user 0.009s	sys 0.000s
W20260709 13:00:57.528388  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 312869us
I20260709 13:00:57.650450  1633 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:57.382069  3277 consensus_queue.cc:260] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:57.501444  1558 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:00:57.655745  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 154491us
W20260709 13:00:57.615798  3356 log.cc:927] Time spent T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.067s	user 0.003s	sys 0.000s
I20260709 13:00:57.431195  3233 consensus_queue.cc:1048] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.110s
I20260709 13:00:57.498080  3354 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.543124  3212 raft_consensus.cc:2804] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:57.583128  1737 raft_consensus.cc:606] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:57.667186  1737 raft_consensus.cc:614] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:57.474239  3314 consensus_queue.cc:1048] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
W20260709 13:00:57.548684  3198 consensus_meta.cc:287] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.613s	user 0.012s	sys 0.000s
I20260709 13:00:57.546236  3267 raft_consensus.cc:697] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:00:57.589457  1664 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.000s	sys 0.007s
I20260709 13:00:57.505983  3243 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:57.478662  3288 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:00:57.593627  1739 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.001s	sys 0.009s
W20260709 13:00:57.678020  1739 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.002s	sys 0.009s
I20260709 13:00:57.582652  3313 raft_consensus.cc:740] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:57.628363  3320 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.631891  3253 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:57.634093  3341 log.cc:927] Time spent T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.286s	user 0.002s	sys 0.000s
I20260709 13:00:57.643095  3213 consensus_queue.cc:260] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:57.587826  3334 consensus_queue.cc:1243] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer 6d4de2ce0683442498244b9529127f91 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:00:57.666925  3212 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.680193  3361 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:57.691061  3361 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:57.692889  3312 consensus_queue.cc:1059] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:57.497454  3206 consensus_queue.cc:237] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:57.693797  3305 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:57.608410  3339 log.cc:927] Time spent T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da: Append to log took a long time: real 0.401s	user 0.000s	sys 0.002s
W20260709 13:00:57.583084  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 199542us
W20260709 13:00:57.497038  3348 log.cc:927] Time spent T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
W20260709 13:00:57.596381  3317 consensus_meta.cc:287] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.663s	user 0.012s	sys 0.000s
I20260709 13:00:57.656390  1558 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:57.700875  1558 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:57.593185  3321 raft_consensus.cc:740] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:57.661830  1633 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:57.652081  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:00:57.671720  1664 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.000s	sys 0.008s
W20260709 13:00:57.672143  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.709232  1658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1184) took 1657 ms. Trace:
I20260709 13:00:57.670586  3359 consensus_queue.cc:1059] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:00:57.724067  3183 raft_consensus.cc:3055] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:57.724464  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:00:57.662910  3193 raft_consensus.cc:2804] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:57.596997  3311 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:57.709792  1658 rpcz_store.cc:276] 0709 13:00:56.052304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.269442 (+217138us) service_pool.cc:224] Handling call
0709 13:00:56.269723 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:56.457487 (+187764us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:56.457524 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:56.536198 (+ 78674us) log.cc:844] Serialized 26 byte log entry
0709 13:00:56.737648 (+201450us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:56.737740 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.737853 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:57.708959 (+971106us) raft_consensus.cc:1685] finished
0709 13:00:57.708991 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.709167 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":207972,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":22718,"thread_start_us":314374,"threads_started":2,"wal-append.queue_time_us":276173}
I20260709 13:00:57.689888  3288 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:00:57.690413  3267 consensus_queue.cc:237] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:57.619509  3102 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:00:57.705313  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 43555.9us
I20260709 13:00:57.714824  3321 consensus_queue.cc:260] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:57.716902  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:00:57.718103  3365 consensus_queue.cc:1059] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:00:57.700488  3214 raft_consensus.cc:2804] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:57.683835  3320 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:57.720324  3187 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:57.705307  3201 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.659711  3308 raft_consensus.cc:2804] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:57.656769  3190 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:57.682617  3351 log.cc:927] Time spent T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
W20260709 13:00:57.741670  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.755070  3361 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:57.744282  3359 raft_consensus.cc:3055] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:57.745564  3311 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:57.753826  1633 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:57.685818  3212 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:57.724552  3183 raft_consensus.cc:740] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:57.762387  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:57.594517  3338 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:57.833540  1658 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:57.833840  3183 consensus_queue.cc:260] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:57.834991  3183 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:57.835451  3338 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:57.777642  1737 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:55694
W20260709 13:00:57.789529  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 52629.6us
I20260709 13:00:57.836887  1737 raft_consensus.cc:606] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:57.837306  1737 raft_consensus.cc:614] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:57.840432  1739 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:55694
I20260709 13:00:57.788062  3319 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:57.738062  3305 raft_consensus.cc:2804] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:00:57.799166  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 56631.8us
W20260709 13:00:57.811764  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 111371us
W20260709 13:00:57.796042  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 255787us
W20260709 13:00:57.842633  1705 leader_election.cc:336] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.657s (SENT)
I20260709 13:00:57.843117  1705 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:57.776567  3310 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:57.752991  3249 raft_consensus.cc:2804] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:00:57.847963  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 94205.4us
I20260709 13:00:57.852708  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:57.852994  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:57.853458  1738 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 3.
I20260709 13:00:57.853756  1734 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 4.
I20260709 13:00:57.669955  3354 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:57.687773  3313 consensus_queue.cc:260] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:57.841305  1658 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
W20260709 13:00:57.844328  1705 leader_election.cc:336] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.714s (SENT)
I20260709 13:00:57.855032  1705 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:57.857362  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:57.740173  3193 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.859407  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:00:57.863710  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.815762  3321 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:57.865489  1592 raft_consensus.cc:1240] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:57.814649  3308 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:57.869357  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:57.796813  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 99840.6us
I20260709 13:00:57.810154  3296 consensus_queue.cc:1048] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:00:57.843364  3214 raft_consensus.cc:697] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:57.910580  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:00:57.911052  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 48854.8us
I20260709 13:00:57.921821  1734 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 3.
I20260709 13:00:57.921793  1740 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 4.
I20260709 13:00:57.817796  3301 consensus_queue.cc:1048] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
W20260709 13:00:57.915402  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 52460.2us
I20260709 13:00:57.910486  1737 raft_consensus.cc:1240] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:57.818223  3201 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:57.919039  3354 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:57.866706  3310 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:57.877687  3305 raft_consensus.cc:697] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:57.845213  3359 raft_consensus.cc:740] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:57.812891  3355 consensus_queue.cc:1048] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:00:57.862442  3193 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:57.931785  1592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 1151) took 1111 ms. Trace:
W20260709 13:00:57.911264  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 73893us
W20260709 13:00:57.962952  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:57.922506  1705 leader_election.cc:336] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.848s (SENT)
W20260709 13:00:57.980775  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.982342  1556 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:00:57.928208  3214 consensus_queue.cc:237] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:57.874467  3338 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:57.874850  3365 raft_consensus.cc:2804] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:57.909492  3313 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:57.911470  3308 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:57.862649  3361 raft_consensus.cc:2749] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:58.040606  3359 consensus_queue.cc:260] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:58.041510  3213 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:58.041956  1662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1201) took 1074 ms. Trace:
I20260709 13:00:58.042374  1662 rpcz_store.cc:276] 0709 13:00:56.967414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.967684 (+   270us) service_pool.cc:224] Handling call
0709 13:00:57.060840 (+ 93156us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:57.539790 (+478950us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:57.539821 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:57.544331 (+  4510us) log.cc:844] Serialized 26 byte log entry
0709 13:00:57.701655 (+157324us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:57.701690 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.791181 (+ 89491us) spinlock_profiling.cc:243] Waited 428 ms on lock 0x7b54000a78d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:00:57.791249 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:58.041646 (+250397us) raft_consensus.cc:1685] finished
0709 13:00:58.041671 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.041894 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17445,"raft.queue_time_us":106139,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":48187,"spinlock_wait_cycles":984805248,"thread_start_us":114472,"threads_started":1,"wal-append.queue_time_us":288859}
W20260709 13:00:58.044708  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.046257  3369 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:58.046895  3369 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:58.051944  1739 raft_consensus.cc:606] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:00:58.052459  1739 raft_consensus.cc:614] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:57.980623  3247 raft_consensus.cc:3055] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:57.980623  3299 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:58.030377  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 107910us
I20260709 13:00:58.014137  1592 rpcz_store.cc:276] 0709 13:00:56.820350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.820484 (+   134us) service_pool.cc:224] Handling call
0709 13:00:56.820846 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.874024 (+1053178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.931459 (+ 57435us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54000316d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:00:57.931705 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2401940224}
I20260709 13:00:58.023257  3305 consensus_queue.cc:237] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:58.059069  1741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1197) took 1225 ms. Trace:
W20260709 13:00:58.022053  1558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.925998  2935 consensus_queue.cc:1048] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.126s
W20260709 13:00:58.114176  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 80772.4us
I20260709 13:00:57.988024  3249 raft_consensus.cc:697] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:58.111747  1741 rpcz_store.cc:276] 0709 13:00:56.833314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.833513 (+   199us) service_pool.cc:224] Handling call
0709 13:00:56.891843 (+ 58330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:56.910412 (+ 18569us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:56.910444 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:56.923196 (+ 12752us) log.cc:844] Serialized 26 byte log entry
0709 13:00:57.379833 (+456637us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:57.379906 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.380005 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:58.058853 (+678848us) raft_consensus.cc:1685] finished
0709 13:00:58.058876 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.059009 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2073,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":16196,"spinlock_wait_cycles":12032,"thread_start_us":433525,"threads_started":1,"wal-append.queue_time_us":500707}
W20260709 13:00:58.115561  1705 leader_election.cc:336] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.974s (SENT)
I20260709 13:00:58.120525  1705 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:58.049218  3195 raft_consensus.cc:2804] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:58.121685  1705 leader_election.cc:336] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.094s (SENT)
I20260709 13:00:58.122100  1705 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:00:58.101418  2996 consensus_meta.cc:287] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.670s	user 0.011s	sys 0.001s
W20260709 13:00:58.148130  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.100979  3247 raft_consensus.cc:740] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:58.103049  3365 raft_consensus.cc:697] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:58.123628  3195 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:58.173972  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:58.174309  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.123040  3243 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:58.161484  3361 raft_consensus.cc:2749] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:58.152980  3288 raft_consensus.cc:2749] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:58.114953  3299 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:58.176582  3195 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:58.153290  2996 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:58.179349  3187 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:00:58.191237  3190 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:58.190568  3102 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:00:58.248512  3365 consensus_queue.cc:237] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:58.263926  3370 log.cc:927] Time spent T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.354s	user 0.001s	sys 0.000s
W20260709 13:00:58.268138  3391 log.cc:927] Time spent T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:00:58.211757  3187 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:58.272544  3187 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:00:58.274137  3390 log.cc:927] Time spent T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:00:58.278254  3281 consensus_meta.cc:287] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.832s	user 0.009s	sys 0.001s
I20260709 13:00:58.278765  3281 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:58.280207  3372 log.cc:927] Time spent T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 13:00:58.282950  3201 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:58.283360  3299 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:58.219602  3320 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:58.285151  2996 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:58.286190  3310 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:58.286937  3281 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:58.302136  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:00:58.342536  3212 consensus_meta.cc:287] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.514s	user 0.011s	sys 0.000s
I20260709 13:00:58.343401  3212 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:58.353561  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:58.359222  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.193449  3249 consensus_queue.cc:237] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:58.201122  3247 consensus_queue.cc:260] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:58.367841  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:58.368587  1735 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:58.370216  3247 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:58.378991  1734 raft_consensus.cc:1275] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:00:58.379532  1734 pending_rounds.cc:85] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 1
I20260709 13:00:58.379812  1734 pending_rounds.cc:107] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:00:58.380081  1734 raft_consensus.cc:2889] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:58.383057  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:58.383744  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:58.383631  1705 leader_election.cc:336] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.174s (SENT)
I20260709 13:00:58.399168  1705 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:58.404306  1735 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:00:58.410341  3319 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:58.410975  3277 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:58.416460  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:58.417191  1739 raft_consensus.cc:2468] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
W20260709 13:00:58.418677  3392 log.cc:927] Time spent T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.212s	user 0.002s	sys 0.000s
I20260709 13:00:58.423633  3193 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:58.425673  3288 raft_consensus.cc:2749] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:58.428169  3193 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:58.428462  1663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1198) took 1510 ms. Trace:
I20260709 13:00:58.429167  1663 rpcz_store.cc:276] 0709 13:00:56.918232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.918669 (+   437us) service_pool.cc:224] Handling call
0709 13:00:56.934666 (+ 15997us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:56.946805 (+ 12139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:56.946835 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:56.966734 (+ 19899us) log.cc:844] Serialized 26 byte log entry
0709 13:00:57.624899 (+658165us) spinlock_profiling.cc:243] Waited 4.4 ms on lock 0x7b1800164380. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7de84e07 00007f1b86cdfab9 00007f1b7dea169b 00007f1b7de9f93f 00007f1b7dea1c02 00007f1b80b2920b 00007f1b80b2ed23 00007f1b80b2f0d1 00007f1b80f4aa0f
0709 13:00:57.825524 (+200625us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:57.825572 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.825643 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:58.428152 (+602509us) raft_consensus.cc:1685] finished
0709 13:00:58.428174 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.428402 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71584,"raft.queue_time_us":14728,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":105236,"spinlock_wait_cycles":10109184,"thread_start_us":199254,"threads_started":1,"wal-append.queue_time_us":1400135}
I20260709 13:00:58.394279  2996 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.410984  3319 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:58.426177  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 77623.2us
W20260709 13:00:58.438828  3397 log.cc:927] Time spent T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
W20260709 13:00:58.459404  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.441560  3195 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:58.473517  3195 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:58.476895  3205 raft_consensus.cc:3055] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:58.477617  3205 raft_consensus.cc:740] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:58.477958  1660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1206) took 1296 ms. Trace:
I20260709 13:00:58.478506  3205 consensus_queue.cc:260] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:58.479590  3205 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:58.478327  1660 rpcz_store.cc:276] 0709 13:00:57.182008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.402425 (+220417us) service_pool.cc:224] Handling call
0709 13:00:57.429930 (+ 27505us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:57.690879 (+260949us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b48001bc258. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b85eb8aa1 00007f1b85eafb37 00007f1b85eaf9ca 00007f1b85fa726f 00007f1b85fa6f37 00007f1b85fbb55c 00007f1b85fbb508 00007f1b85fbb488 00007f1b85fbb443 00007f1b85fba6ec 00007f1b84ee4a96
0709 13:00:57.767560 (+ 76681us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:57.767606 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:57.768254 (+   648us) log.cc:844] Serialized 26 byte log entry
0709 13:00:58.106526 (+338272us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:58.106574 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.477637 (+371063us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b540019dcd4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:00:58.477693 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:58.477737 (+    44us) raft_consensus.cc:1685] finished
0709 13:00:58.477752 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.477899 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10268,"raft.queue_time_us":57948,"raft.run_cpu_time_us":1437,"raft.run_wall_time_us":55041,"spinlock_wait_cycles":379071616,"thread_start_us":468660,"threads_started":2,"wal-append.queue_time_us":311689}
W20260709 13:00:58.490624  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.494748  3212 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:58.439069  2996 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:58.515460  1633 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.024s	sys 0.016s
W20260709 13:00:58.515895  1633 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.024s	sys 0.016s
I20260709 13:00:58.516872  1633 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:58.519205  1633 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:58.520496  1633 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
W20260709 13:00:58.521256  3399 log.cc:927] Time spent T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.257s	user 0.002s	sys 0.003s
W20260709 13:00:58.521610  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.516834  3321 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
W20260709 13:00:58.530190  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.519754  3313 raft_consensus.cc:2749] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:58.521996  3310 raft_consensus.cc:2749] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:58.537395  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:58.543329  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:58.548704  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:58.539209  3363 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:00:58.563352  3363 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:58.566293  3363 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:58.566918  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:58.567963  1592 raft_consensus.cc:2393] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 4: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:00:58.568378  3195 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.569062  3195 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:58.571784  3195 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:58.574831  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:58.579686  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:58.580684  1592 raft_consensus.cc:2368] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 5. Current term is 6.
I20260709 13:00:58.582629  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:58.531172  3321 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:58.594008  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:58.594652  1586 raft_consensus.cc:2468] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:00:58.595328  3380 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:58.596709  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:58.596076  3380 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:58.600082  3380 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:58.602383  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:58.604446  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.604471  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:58.557262  3319 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:58.556073  3245 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
W20260709 13:00:58.614064  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.614459  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:58.616770  1586 raft_consensus.cc:2393] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 2: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:00:58.617214  1585 raft_consensus.cc:1240] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:58.620560  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:58.623332  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:58.625725  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:00:58.626461  1585 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:58.628355  3369 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:58.632863  1586 raft_consensus.cc:1240] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:58.629303  3369 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.633515  3369 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:58.640527  1585 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:00:58.536630  3308 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:58.657428  3102 consensus_queue.cc:1059] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:58.658367  3319 raft_consensus.cc:2804] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:58.658797  3319 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.659137  3319 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:58.663681  3359 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:58.649573  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 129137us
I20260709 13:00:58.667202  1633 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:58.668180  3380 raft_consensus.cc:2804] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:58.668892  3380 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:58.669493  3380 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:58.671988  3308 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:58.673565  2996 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:58.676457  3321 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:00:58.619251  3245 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:00:58.678920  1707 leader_election.cc:336] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.528s (SENT)
I20260709 13:00:58.677848  1589 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:00:58.696252  1633 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:58.697751  3102 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:58.699841  1707 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:58.701830  3245 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:00:58.702471  3201 raft_consensus.cc:3055] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:58.702875  3201 raft_consensus.cc:740] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:00:58.703454  3213 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.704084  3213 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:58.703806  3201 consensus_queue.cc:260] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:58.698585  3288 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.705981  3288 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:58.706892  3213 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:58.708171  3288 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:58.708541  1707 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:58.710575  1707 leader_election.cc:400] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 5. Current term is 6.
I20260709 13:00:58.710927  1707 leader_election.cc:403] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:58.712023  3281 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:58.712919  3281 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:00:58.698387  3102 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:58.716672  3102 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:58.717607  3201 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:58.717754  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.718490  1707 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:00:58.708796  3288 raft_consensus.cc:2749] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:58.722925  1707 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:58.727574  3321 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:58.727639  3213 raft_consensus.cc:2749] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:58.732896  3213 raft_consensus.cc:2804] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:58.733520  3213 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.734063  3213 raft_consensus.cc:3060] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:58.728096  1633 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:58.736344  1633 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:58.730322  1741 raft_consensus.cc:1275] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:58.737048  3321 raft_consensus.cc:2749] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:58.737267  3359 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:58.738480  1633 leader_election.cc:400] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 election: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 3. Current term is 4.
I20260709 13:00:58.738767  1633 leader_election.cc:403] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:00:58.739365  3380 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:58.655820  3369 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:58.740352  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:58.730185  3319 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:58.741106  1741 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:00:58.744029  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:58.744905  1741 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:58.763485  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:00:58.763592  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:00:58.766461  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:00:58.769883  3319 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:58.774904  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:58.782977  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:58.788748  1556 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.000s	sys 0.068s
W20260709 13:00:58.790258  1556 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.000s	sys 0.069s
W20260709 13:00:58.798542  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 683455us
W20260709 13:00:58.782992  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 44650.7us
I20260709 13:00:58.816123  1633 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:00:58.790202  3323 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.000s	sys 0.029s
I20260709 13:00:58.787952  3359 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 3. Current term is 4.
I20260709 13:00:58.818475  3205 raft_consensus.cc:2749] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:58.820704  1741 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
W20260709 13:00:58.819936  3323 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.000s	sys 0.030s
W20260709 13:00:58.811120  3267 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.009s	sys 0.020s
W20260709 13:00:58.841218  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.838433  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:00:58.854426  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:58.855752  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:58.860351  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 94730us
W20260709 13:00:58.860549  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 45118.2us
I20260709 13:00:58.828711  3369 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:00:58.831116  2426 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.013s	sys 0.020s
W20260709 13:00:58.842633  3267 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.009s	sys 0.020s
I20260709 13:00:58.838126  3281 raft_consensus.cc:2749] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 5. Current term is 6.
I20260709 13:00:58.868588  1556 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:00:58.875214  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 59158.6us
W20260709 13:00:58.870772  2426 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.014s	sys 0.021s
W20260709 13:00:58.880748  3301 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.012s	sys 0.048s
I20260709 13:00:58.894060  1556 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:00:58.873840  1542 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.012s	sys 0.012s
I20260709 13:00:58.876336  1633 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:58.907238  1633 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:58.912959  1633 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:00:58.893530  3301 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.012s	sys 0.048s
I20260709 13:00:58.925405  1633 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:00:58.926654  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.870105  3369 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:58.958269  3419 log.cc:927] Time spent T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:00:58.958278  3369 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:00:58.931613  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 69502.7us
I20260709 13:00:58.960633  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:58.962237  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:58.962659  3205 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:58.963626  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:58.963406  3205 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:58.934602  3301 consensus_queue.cc:1048] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:58.966421  3205 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:58.921475  3195 raft_consensus.cc:2749] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:58.967113  3205 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:58.924309  3196 raft_consensus.cc:2804] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:58.924038  3404 raft_consensus.cc:2749] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:58.940034  3359 raft_consensus.cc:2749] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:58.968189  3196 raft_consensus.cc:697] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:00:58.940704  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.929148  3321 raft_consensus.cc:2804] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:58.942536  3380 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:58.969683  3321 raft_consensus.cc:697] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:58.969836  3196 consensus_queue.cc:237] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:58.971084  3321 consensus_queue.cc:237] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:58.944967  1705 leader_election.cc:336] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.528s (SENT)
I20260709 13:00:58.972795  1705 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:58.948163  1741 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:00:58.949582  2945 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
W20260709 13:00:58.950361  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 48683.7us
W20260709 13:00:58.953377  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:58.901461  3385 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.015s	sys 0.030s
W20260709 13:00:58.905519  1542 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.013s	sys 0.013s
W20260709 13:00:58.984110  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:58.974501  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 49253.4us
I20260709 13:00:58.991307  1732 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:00:59.003726  1633 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:58.894445  3213 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:58.985544  3385 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.015s	sys 0.031s
I20260709 13:00:59.012712  1633 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:59.006182  1558 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:59.029373  3380 raft_consensus.cc:2749] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:59.023829  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:59.032080  3301 consensus_queue.cc:1048] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:59.005467  3359 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:59.036738  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:58.980329  3201 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:59.039494  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:00:59.061069  1741 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:59.041754  1558 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:00:59.042116  1738 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.007s	sys 0.021s
W20260709 13:00:59.062911  1738 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.007s	sys 0.021s
I20260709 13:00:59.045140  1732 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:59.048293  1659 raft_consensus.cc:1240] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:00:59.052647  1740 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.005s	sys 0.067s
W20260709 13:00:59.064179  1740 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.005s	sys 0.068s
I20260709 13:00:59.064740  1558 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:59.066944  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:59.067679  1658 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:59.055912  1633 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:00:59.070272  1633 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
W20260709 13:00:59.047395  3210 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.029s	sys 0.051s
I20260709 13:00:59.005569  3319 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:59.048151  3304 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.862s	user 0.005s	sys 0.029s
I20260709 13:00:59.076237  1660 raft_consensus.cc:1275] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:00:59.048907  3324 raft_consensus.cc:2804] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:59.080819  1664 raft_consensus.cc:1240] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 3. Current term is 4. Ops: []
W20260709 13:00:59.079526  3249 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.000s	sys 0.032s
W20260709 13:00:59.082650  1736 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.021s	sys 0.021s
I20260709 13:00:59.053409  3404 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:59.066437  3369 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:59.089555  1736 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.021s	sys 0.021s
I20260709 13:00:59.080421  1633 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:00:59.072224  3193 raft_consensus.cc:2804] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:00:59.078482  3210 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.030s	sys 0.052s
I20260709 13:00:58.990262  2945 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:59.099964  1558 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:00:59.109972  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.097142  1741 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:00:59.074488  3308 raft_consensus.cc:2804] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:00:59.088276  3304 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.901s	user 0.006s	sys 0.029s
I20260709 13:00:59.086975  3324 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:59.089179  3249 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.000s	sys 0.033s
I20260709 13:00:59.119310  1732 raft_consensus.cc:2468] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
W20260709 13:00:59.111563  3214 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.829s	user 0.049s	sys 0.056s
I20260709 13:00:59.069736  3359 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:59.129631  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 49318.1us
I20260709 13:00:59.145785  1633 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
W20260709 13:00:59.146088  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 46223.2us
W20260709 13:00:59.148674  1734 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.006s	sys 0.019s
W20260709 13:00:59.149080  1734 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.006s	sys 0.019s
I20260709 13:00:59.149988  1707 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:00:59.151353  1707 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:59.131548  1658 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:00:59.135706  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:00:59.094812  3380 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:59.125646  3404 raft_consensus.cc:697] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 3 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:00:59.085151  3319 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:59.142143  3214 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.860s	user 0.049s	sys 0.056s
W20260709 13:00:59.163825  1592 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.001s	sys 0.034s
I20260709 13:00:59.141563  3324 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:59.150384  3270 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.935s	user 0.002s	sys 0.023s
I20260709 13:00:59.225839  1658 raft_consensus.cc:1275] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:00:59.124282  3369 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:59.140818  3205 raft_consensus.cc:2749] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:59.206559  1592 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.002s	sys 0.035s
I20260709 13:00:59.141595  3408 raft_consensus.cc:2804] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:59.143538  3308 raft_consensus.cc:697] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 5 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
W20260709 13:00:59.239689  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:59.305048  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.165179  3201 consensus_queue.cc:1059] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.106s
I20260709 13:00:59.253434  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:59.253809  1558 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:00:59.253901  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:59.255290  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:59.306250  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 52528.1us
I20260709 13:00:59.306918  1558 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:00:59.153198  3228 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.002s	sys 0.021s
I20260709 13:00:59.152448  3193 raft_consensus.cc:697] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:59.254611  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:59.249258  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 45577.2us
W20260709 13:00:59.314168  1705 leader_election.cc:336] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.879s (SENT)
I20260709 13:00:59.314770  1705 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:00:59.238066  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.164783  3288 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:59.164070  3281 raft_consensus.cc:2804] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:59.316876  3281 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:00:59.163785  3195 raft_consensus.cc:2804] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:00:59.248739  3270 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.045s	user 0.002s	sys 0.024s
W20260709 13:00:59.238286  3366 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.026s	sys 0.020s
I20260709 13:00:59.292725  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:59.294281  1588 raft_consensus.cc:1275] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:59.300017  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:59.172904  3310 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:59.309881  3228 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.003s	sys 0.021s
I20260709 13:00:59.256206  3247 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:00:59.264364  3400 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.317775  3281 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:59.267154  3355 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.001s	user 0.016s	sys 0.017s
W20260709 13:00:59.322878  1735 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.037s	sys 0.060s
I20260709 13:00:59.293411  3408 raft_consensus.cc:697] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:59.340238  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:00:59.362054  1733 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
W20260709 13:00:59.355829  1735 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.037s	sys 0.060s
I20260709 13:00:59.300428  3404 consensus_queue.cc:237] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:59.367791  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.314985  3245 raft_consensus.cc:2804] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:59.366397  1558 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:00:59.327658  3366 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.899s	user 0.029s	sys 0.020s
W20260709 13:00:59.361449  3233 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.840s	user 0.025s	sys 0.036s
W20260709 13:00:59.362798  3355 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.097s	user 0.016s	sys 0.017s
I20260709 13:00:59.353288  2996 raft_consensus.cc:2804] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:59.342301  3310 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:00:59.385361  3405 log.cc:927] Time spent T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:00:59.341794  3205 consensus_queue.cc:1048] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
W20260709 13:00:59.385931  3233 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.025s	sys 0.037s
I20260709 13:00:59.446346  3310 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:59.447191  3213 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:59.445889  3329 raft_consensus.cc:2804] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:59.364250  3247 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:00:59.448094  2996 raft_consensus.cc:697] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:00:59.509289  2945 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:00:59.498611  3329 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:59.518541  3425 log.cc:927] Time spent T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 13:00:59.518873  1740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1214) took 1162 ms. Trace:
I20260709 13:00:59.543386  1740 rpcz_store.cc:276] 0709 13:00:58.356029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.356155 (+   126us) service_pool.cc:224] Handling call
0709 13:00:58.373699 (+ 17544us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:58.390515 (+ 16816us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.390559 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:58.413499 (+ 22940us) log.cc:844] Serialized 26 byte log entry
0709 13:00:59.064617 (+651118us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:59.064654 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.064715 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:59.518663 (+453948us) raft_consensus.cc:1685] finished
0709 13:00:59.518683 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.518818 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31596,"raft.queue_time_us":16988,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":12777,"thread_start_us":629339,"threads_started":1,"wal-append.queue_time_us":947169}
I20260709 13:00:59.504386  3213 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.363849  3400 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:59.506296  3359 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:59.446470  3193 consensus_queue.cc:237] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:59.518673  3319 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:59.521023  3234 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.006s	sys 0.024s
W20260709 13:00:59.550275  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 403034us
I20260709 13:00:59.490037  3308 consensus_queue.cc:237] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:59.542884  3329 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:59.559048  1633 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:59.587528  1633 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
W20260709 13:00:59.551389  3305 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.298s	user 0.023s	sys 0.028s
W20260709 13:00:59.557035  3212 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.021s	sys 0.030s
W20260709 13:00:59.555377  3234 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.006s	sys 0.024s
I20260709 13:00:59.609544  1633 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
W20260709 13:00:59.831732  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 222247us
I20260709 13:00:59.833209  1633 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:00:59.555336  3359 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:59.638458  2996 consensus_queue.cc:237] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:59.555809  3369 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:59.557426  3319 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:59.662358  1666 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.006s	sys 0.031s
W20260709 13:00:59.844118  1666 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.007s	sys 0.031s
I20260709 13:00:59.514776  3408 consensus_queue.cc:237] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:59.550684  3213 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:59.623891  3305 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.371s	user 0.024s	sys 0.028s
W20260709 13:00:59.721212  1556 thread.cc:641] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.015s	sys 0.024s
W20260709 13:00:59.846657  1556 thread.cc:608] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.016s	sys 0.024s
W20260709 13:00:59.705617  3422 log.cc:927] Time spent T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 13:00:59.750156  1739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1222) took 1380 ms. Trace:
W20260709 13:00:59.644771  3401 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.000s	sys 0.036s
W20260709 13:00:59.766011  1662 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.000s	sys 0.039s
W20260709 13:00:59.719751  3417 log.cc:927] Time spent T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.275s	user 0.000s	sys 0.001s
W20260709 13:00:59.553791  3402 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.015s	sys 0.015s
W20260709 13:00:59.836530  1661 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.009s	sys 0.033s
W20260709 13:00:59.723130  3196 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.015s	sys 0.014s
W20260709 13:00:59.810634  3212 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.029s	sys 0.062s
W20260709 13:00:59.838153  3304 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.013s	sys 0.021s
W20260709 13:00:59.853895  1662 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.000s	sys 0.039s
I20260709 13:00:59.849431  1739 rpcz_store.cc:276] 0709 13:00:58.369859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.417924 (+ 48065us) service_pool.cc:224] Handling call
0709 13:00:58.432144 (+ 14220us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:58.436540 (+  4396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.436570 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:58.439840 (+  3270us) log.cc:844] Serialized 52 byte log entry
0709 13:00:58.472824 (+ 32984us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b4800120858. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b85eb8aa1 00007f1b85eafb37 00007f1b85eaf9ca 00007f1b85fa726f 00007f1b85fa6f37 00007f1b85fbb55c 00007f1b85fbb508 00007f1b85fbb488 00007f1b85fbb443 00007f1b85fba6ec 00007f1b84ee4a96
0709 13:00:58.863731 (+390907us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:58.863773 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.863847 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:59.725466 (+861619us) raft_consensus.cc:1685] finished
0709 13:00:59.725497 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.750056 (+ 24559us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":84,"raft.run_cpu_time_us":2110,"raft.run_wall_time_us":39061,"spinlock_wait_cycles":4045056,"thread_start_us":373858,"threads_started":1,"wal-append.queue_time_us":701361}
W20260709 13:00:59.866533  1661 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.009s	sys 0.033s
I20260709 13:00:59.869784  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:59.877748  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:59.870034  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:59.870775  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:00:59.871842  1587 raft_consensus.cc:1240] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:00:59.863977  3401 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.829s	user 0.000s	sys 0.039s
W20260709 13:00:59.897523  1660 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.013s	sys 0.027s
W20260709 13:00:59.877616  3304 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.013s	sys 0.022s
W20260709 13:00:59.845578  3210 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.019s	sys 0.028s
I20260709 13:00:59.918313  1739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1228) took 1501 ms. Trace:
I20260709 13:00:59.918829  1739 rpcz_store.cc:276] 0709 13:00:58.417979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.896632 (+1478653us) service_pool.cc:224] Handling call
0709 13:00:59.917668 (+ 21036us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:59.917897 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:59.917933 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:59.917988 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:59.918031 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.918101 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.918243 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:59.908636  1660 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.013s	sys 0.027s
W20260709 13:00:59.938094  3420 log.cc:927] Time spent T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.327s	user 0.000s	sys 0.001s
I20260709 13:00:59.844014  3359 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:59.942183  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.906818  3305 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:59.914302  3210 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.019s	sys 0.028s
I20260709 13:00:59.910109  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:00:59.875844  3196 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.016s	sys 0.014s
W20260709 13:00:59.875989  3402 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.015s	sys 0.019s
I20260709 13:00:59.864261  3369 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.955325  3213 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:59.867339  3319 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:59.916955  3401 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:59.952016  3424 log.cc:927] Time spent T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.288s	user 0.001s	sys 0.000s
I20260709 13:00:59.974931  1588 raft_consensus.cc:1240] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:59.947556  3304 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.980101  3304 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:59.975792  3369 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:00:59.979560  3432 log.cc:927] Time spent T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:00:59.983095  3304 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:59.983829  3369 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:00:59.984457  3369 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:59.986732  3319 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:00:59.908571  1741 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.007s	sys 0.007s
W20260709 13:00:59.987489  1741 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.007s	sys 0.007s
I20260709 13:00:59.987813  3401 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:59.990784  3359 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:00:59.991557  3359 raft_consensus.cc:2804] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:59.992022  3359 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:59.992519  3359 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:59.993623  3247 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:00:59.994741  3247 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:00:59.995349  3247 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:00:59.962648  3305 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:00.014093  1735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1223) took 1643 ms. Trace:
I20260709 13:00:59.972856  3442 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:01:00.022341  1707 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.010s	sys 0.038s
W20260709 13:01:00.022848  1707 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.010s	sys 0.038s
I20260709 13:01:00.025023  1736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1217) took 1666 ms. Trace:
I20260709 13:01:00.025624  1736 rpcz_store.cc:276] 0709 13:00:58.358784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.360122 (+  1338us) service_pool.cc:224] Handling call
0709 13:00:58.371334 (+ 11212us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:58.389865 (+ 18531us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.389925 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:58.414171 (+ 24246us) log.cc:844] Serialized 26 byte log entry
0709 13:00:59.103710 (+689539us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:59.103769 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.103871 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:00.024715 (+920844us) raft_consensus.cc:1685] finished
0709 13:01:00.024750 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:00.024944 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33316,"raft.queue_time_us":19252,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":12748,"thread_start_us":666583,"threads_started":1,"wal-append.queue_time_us":994368}
W20260709 13:01:00.027803  1663 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.854s	user 0.011s	sys 0.009s
I20260709 13:01:00.014631  1735 rpcz_store.cc:276] 0709 13:00:58.371278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.464868 (+ 93590us) service_pool.cc:224] Handling call
0709 13:00:58.492818 (+ 27950us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:58.524740 (+ 31922us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.524785 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:58.530604 (+  5819us) log.cc:844] Serialized 26 byte log entry
0709 13:00:59.363577 (+832973us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:59.363633 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.363724 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:00.013761 (+650037us) raft_consensus.cc:1685] finished
0709 13:01:00.013794 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:00.014006 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30040,"raft.queue_time_us":35365,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":2344,"thread_start_us":805307,"threads_started":1,"wal-append.queue_time_us":1328011}
W20260709 13:01:00.028844  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.028999  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:00.029434  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:00.031105  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:00.031551  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:01:00.028463  1732 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.006s	sys 0.014s
W20260709 13:01:00.028187  1663 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.011s	sys 0.009s
W20260709 13:01:00.032608  1732 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.006s	sys 0.014s
I20260709 13:01:00.003512  3305 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:00.041498  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:00.042232  1589 raft_consensus.cc:3060] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:00.043015  1704 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.008s	sys 0.012s
W20260709 13:01:00.043488  1704 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.008s	sys 0.013s
W20260709 13:01:00.045002  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:00.048673  1667 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.963s	user 0.012s	sys 0.010s
W20260709 13:01:00.049362  1667 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.964s	user 0.012s	sys 0.010s
I20260709 13:01:00.028790  3442 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:01:00.085140  1592 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.031s	sys 0.042s
W20260709 13:01:00.085779  1592 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.032s	sys 0.042s
I20260709 13:01:00.086699  1592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 1159) took 1504 ms. Trace:
I20260709 13:01:00.087221  1592 rpcz_store.cc:276] 0709 13:00:58.581844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.584397 (+  2553us) service_pool.cc:224] Handling call
0709 13:00:58.584770 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.585018 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:00:58.585404 (+   386us) log.cc:844] Serialized 14 byte log entry
0709 13:01:00.086223 (+1500819us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:00.086306 (+    83us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:00.086362 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.086460 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:00.086626 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":738,"prepare.queue_time_us":406,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":31626,"spinlock_wait_cycles":8769792,"thread_start_us":1499590,"threads_started":2,"wal-append.queue_time_us":937390}
W20260709 13:01:00.091339  1664 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.834s	user 0.024s	sys 0.020s
W20260709 13:01:00.092355  1664 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.025s	sys 0.020s
I20260709 13:01:00.091482  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:00.116647  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:00.054456  3442 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:00.044144  3369 consensus_queue.cc:1048] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.044s
W20260709 13:01:00.129837  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:00.130151  1705 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.014s	sys 0.025s
W20260709 13:01:00.163645  1705 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.014s	sys 0.026s
W20260709 13:01:00.164392  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 850201us
W20260709 13:01:00.172945  1665 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.135s	user 0.015s	sys 0.009s
W20260709 13:01:00.173630  1665 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.136s	user 0.015s	sys 0.009s
W20260709 13:01:00.181118  1706 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.015s	sys 0.007s
W20260709 13:01:00.182834  1706 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.015s	sys 0.007s
W20260709 13:01:00.184923  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:00.130373  3201 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.797s	user 0.000s	sys 0.041s
I20260709 13:01:00.188350  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:00.189033  1658 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:00.204926  1704 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:01:00.172869  1632 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.878s	user 0.011s	sys 0.011s
W20260709 13:01:00.272699  1632 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.977s	user 0.011s	sys 0.011s
W20260709 13:01:00.273710  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:00.165584  3288 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.832s	user 0.024s	sys 0.017s
W20260709 13:01:00.295563  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 105221us
W20260709 13:01:00.182258  3270 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.808s	user 0.012s	sys 0.010s
I20260709 13:01:00.164657  3234 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:00.260092  3281 consensus_meta.cc:287] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.883s	user 0.014s	sys 0.002s
W20260709 13:01:00.259609  3324 consensus_meta.cc:287] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.998s	user 0.015s	sys 0.003s
W20260709 13:01:00.349603  3435 log.cc:927] Time spent T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.343s	user 0.000s	sys 0.001s
W20260709 13:01:00.385221  1733 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.009s	user 0.014s	sys 0.018s
W20260709 13:01:00.385993  1733 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.010s	user 0.014s	sys 0.018s
I20260709 13:01:00.399712  1658 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
W20260709 13:01:00.317613  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:00.401849  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:00.422029  1666 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.014s	sys 0.010s
W20260709 13:01:00.422555  1666 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.014s	sys 0.011s
I20260709 13:01:00.365413  3401 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:00.365118  3247 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:01:00.267935  3201 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.935s	user 0.000s	sys 0.042s
W20260709 13:01:00.300534  3288 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.966s	user 0.024s	sys 0.017s
W20260709 13:01:00.386749  3228 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.934s	user 0.017s	sys 0.031s
W20260709 13:01:00.402608  3270 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.032s	user 0.012s	sys 0.011s
I20260709 13:01:00.366663  3234 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } }
I20260709 13:01:00.453524  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:01:00.434320  3323 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.857s	user 0.007s	sys 0.027s
W20260709 13:01:00.437631  2425 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.930s	user 0.015s	sys 0.019s
I20260709 13:01:00.371855  3324 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:00.372083  3281 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:00.434600  3441 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:00.464452  3228 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.019s	user 0.017s	sys 0.031s
W20260709 13:01:00.491593  3321 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.150s	user 0.014s	sys 0.009s
W20260709 13:01:00.506028  3443 log.cc:927] Time spent T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
W20260709 13:01:00.506011  3321 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.165s	user 0.014s	sys 0.009s
I20260709 13:01:00.507342  3321 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.508257  3321 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:00.509838  1589 raft_consensus.cc:2468] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:01:00.510710  3321 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:00.512405  3321 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.497490  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:00.513549  1658 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
W20260709 13:01:00.467767  3323 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.910s	user 0.008s	sys 0.027s
W20260709 13:01:00.521688  3440 log.cc:927] Time spent T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:01:00.522861  3450 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:00.523407  3450 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:00.525668  3436 log.cc:927] Time spent T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 13:01:00.461496  3247 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:00.494776  2425 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.989s	user 0.015s	sys 0.020s
I20260709 13:01:00.460731  3288 raft_consensus.cc:697] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
W20260709 13:01:00.653784  3439 log.cc:927] Time spent T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
I20260709 13:01:00.654568  3288 consensus_queue.cc:237] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:00.655906  3445 log.cc:927] Time spent T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
W20260709 13:01:00.469671  3233 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.927s	user 0.007s	sys 0.030s
I20260709 13:01:00.657591  1738 raft_consensus.cc:2393] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 5: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:01:00.655050  1661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1228) took 1618 ms. Trace:
I20260709 13:01:00.660674  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:00.661859  1658 raft_consensus.cc:2393] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 5: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:01:00.512988  3321 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:00.539959  3302 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.993s	user 0.016s	sys 0.024s
I20260709 13:01:00.658866  1661 rpcz_store.cc:276] 0709 13:00:59.036855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.039373 (+  2518us) service_pool.cc:224] Handling call
0709 13:00:59.039627 (+   254us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:59.050488 (+ 10861us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:59.050533 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:59.073209 (+ 22676us) log.cc:844] Serialized 26 byte log entry
0709 13:00:59.876877 (+803668us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:59.876919 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.876981 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:00.654808 (+777827us) raft_consensus.cc:1685] finished
0709 13:01:00.654828 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:00.654992 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7015,"raft.queue_time_us":122,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":19691,"thread_start_us":754371,"threads_started":1,"wal-append.queue_time_us":1276452}
I20260709 13:01:00.697243  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:00.699714  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:00.700481  1658 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:00.666100  3233 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.146s	user 0.008s	sys 0.032s
W20260709 13:01:00.696130  3302 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.154s	user 0.017s	sys 0.024s
I20260709 13:01:00.736430  1661 raft_consensus.cc:2410] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:01:00.780076  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.634476  3441 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:00.788408  1740 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.948s	user 0.003s	sys 0.030s
W20260709 13:01:00.788897  1740 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.949s	user 0.003s	sys 0.030s
I20260709 13:01:00.698434  3247 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:00.794555  1658 raft_consensus.cc:2468] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:01:00.739562  3456 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:00.789784  1633 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.956s	user 0.021s	sys 0.012s
W20260709 13:01:00.801368  1633 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.967s	user 0.022s	sys 0.013s
W20260709 13:01:00.801753  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 968586us
W20260709 13:01:00.803165  3447 log.cc:927] Time spent T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.146s	user 0.001s	sys 0.001s
I20260709 13:01:00.799449  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:00.805339  1658 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
W20260709 13:01:00.807165  3423 log.cc:927] Time spent T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.976s	user 0.004s	sys 0.013s
W20260709 13:01:00.808914  3451 log.cc:927] Time spent T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 13:01:00.820639  3213 raft_consensus.cc:3055] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:00.821242  3213 raft_consensus.cc:740] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:00.822345  3213 consensus_queue.cc:260] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:00.823927  3213 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:00.825405  3464 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:00.826122  3464 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:00.832167  3329 consensus_meta.cc:287] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 1.214s	user 0.010s	sys 0.000s
W20260709 13:01:00.832876  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.837302  1667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1225) took 1801 ms. Trace:
I20260709 13:01:00.838038  3281 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:00.839437  3234 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:00.840385  3400 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:00.846131  3415 log.cc:927] Time spent T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 1.521s	user 0.001s	sys 0.016s
I20260709 13:01:00.848771  1737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1210) took 2494 ms. Trace:
I20260709 13:01:00.849241  1737 rpcz_store.cc:276] 0709 13:00:58.354423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.355634 (+  1211us) service_pool.cc:224] Handling call
0709 13:00:58.378623 (+ 22989us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:58.415210 (+ 36587us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.415255 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:58.415815 (+   560us) log.cc:844] Serialized 26 byte log entry
0709 13:00:58.881065 (+465250us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:58.883973 (+  2908us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.884073 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:00.845396 (+1961323us) spinlock_profiling.cc:243] Waited 3.99 ms on lock 0x7b4400022b4c. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7ddc8c85 00007f1b7ddc96a2 00007f1b80b3b1db 00007f1b80b36aaf 00007f1b80b2a86e 00007f1b80b29bb6 00007f1b80b297d8 00007f1b80b33221 00007f1b80b331d9 00007f1b80b33169
0709 13:01:00.848361 (+  2965us) raft_consensus.cc:1685] finished
0709 13:01:00.848389 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:00.848670 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36122,"raft.queue_time_us":42392,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":243,"spinlock_wait_cycles":9177984,"thread_start_us":462209,"threads_started":1,"wal-append.queue_time_us":838610}
I20260709 13:01:00.852241  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:01:00.856477  1738 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43678 (request call id 1251) took 1702 ms (client timeout 1953 ms). Trace:
I20260709 13:01:00.807051  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:01:00.857064  1738 rpcz_store.cc:269] 0709 13:00:59.153571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.299692 (+146121us) service_pool.cc:224] Handling call
0709 13:01:00.856179 (+1556487us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400183b54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:01:00.856357 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3024634112}
I20260709 13:01:00.878644  1732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1225) took 2489 ms. Trace:
I20260709 13:01:00.784917  3201 raft_consensus.cc:2749] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:00.882980  1732 rpcz_store.cc:276] 0709 13:00:58.389655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.139916 (+750261us) service_pool.cc:224] Handling call
0709 13:00:59.159720 (+ 19804us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:59.160152 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:59.160192 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:59.185316 (+ 25124us) log.cc:844] Serialized 26 byte log entry
0709 13:01:00.033219 (+847903us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:00.033291 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.033400 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:00.878355 (+844955us) raft_consensus.cc:1685] finished
0709 13:01:00.878374 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:00.878570 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":592,"spinlock_wait_cycles":13258624,"thread_start_us":828192,"threads_started":1,"wal-append.queue_time_us":1288502}
I20260709 13:01:00.858214  1658 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5.
I20260709 13:01:00.890648  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:00.891506  1738 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 1.
W20260709 13:01:00.790258  3355 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.306s	user 0.019s	sys 0.024s
I20260709 13:01:00.794699  3460 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:00.871205  3421 log.cc:927] Time spent T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 1.025s	user 0.025s	sys 0.000s
W20260709 13:01:00.874097  3365 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.611s	user 0.033s	sys 0.042s
W20260709 13:01:00.874500  3310 consensus_meta.cc:287] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 1.365s	user 0.009s	sys 0.004s
W20260709 13:01:00.924757  1660 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.983s	user 0.038s	sys 0.053s
W20260709 13:01:00.926898  1660 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.985s	user 0.038s	sys 0.053s
I20260709 13:01:00.928859  1660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1232) took 1855 ms. Trace:
I20260709 13:01:00.931478  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:00.932400  1732 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:01:00.931834  1660 rpcz_store.cc:276] 0709 13:00:59.073624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.089600 (+ 15976us) service_pool.cc:224] Handling call
0709 13:00:59.126233 (+ 36633us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:59.126482 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:59.941200 (+814718us) log.cc:844] Serialized 14 byte log entry
0709 13:01:00.928535 (+987335us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:00.928588 (+    53us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:00.928627 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.928687 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:00.928797 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1234732,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"thread_start_us":1764408,"threads_started":2}
W20260709 13:01:00.922538  3365 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.659s	user 0.033s	sys 0.042s
I20260709 13:01:00.905823  3458 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
W20260709 13:01:00.790416  3195 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.432s	user 0.009s	sys 0.027s
I20260709 13:01:00.875918  3441 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:00.913843  1738 raft_consensus.cc:1275] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:01:00.981348  1738 pending_rounds.cc:85] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 2
I20260709 13:01:00.981657  1738 pending_rounds.cc:107] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:01:00.981930  1738 raft_consensus.cc:2889] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:00.982775  1738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1233) took 2333 ms. Trace:
I20260709 13:01:00.828939  3464 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:01:00.893399  3359 consensus_meta.cc:287] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.900s	user 0.009s	sys 0.004s
I20260709 13:01:00.911919  1737 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
W20260709 13:01:00.864600  3305 consensus_meta.cc:287] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.821s	user 0.007s	sys 0.003s
I20260709 13:01:00.875182  3205 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:01:00.930958  1663 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.898s	user 0.016s	sys 0.039s
W20260709 13:01:00.986362  1663 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.953s	user 0.016s	sys 0.039s
I20260709 13:01:00.858789  3321 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:00.832579  3329 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:00.914327  3245 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.465s	user 0.014s	sys 0.039s
I20260709 13:01:01.004077  1734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1221) took 2642 ms. Trace:
I20260709 13:01:01.004635  1734 rpcz_store.cc:276] 0709 13:00:58.361614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.399246 (+ 37632us) service_pool.cc:224] Handling call
0709 13:00:58.429520 (+ 30274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:58.432877 (+  3357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.432916 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:58.439141 (+  6225us) log.cc:844] Serialized 26 byte log entry
0709 13:00:59.149714 (+710573us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:59.149756 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.149825 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:00.870471 (+1720646us) spinlock_profiling.cc:243] Waited 31.8 ms on lock 0x7b4400022b4c. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7ddc8c85 00007f1b7ddc96a2 00007f1b80b3b1db 00007f1b80b36aaf 00007f1b80b2a86e 00007f1b80b29bb6 00007f1b80b297d8 00007f1b80b33221 00007f1b80b331d9 00007f1b80b33169
0709 13:01:01.003710 (+133239us) raft_consensus.cc:1685] finished
0709 13:01:01.003742 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.004006 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2959,"raft.queue_time_us":3047,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":4735,"spinlock_wait_cycles":73207680,"thread_start_us":668409,"threads_started":1,"wal-append.queue_time_us":1186346}
I20260709 13:01:00.837837  1667 rpcz_store.cc:276] 0709 13:00:59.035967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.038017 (+  2050us) service_pool.cc:224] Handling call
0709 13:00:59.038377 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:59.038748 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:59.038786 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:59.043706 (+  4920us) log.cc:844] Serialized 26 byte log entry
0709 13:01:00.050264 (+1006558us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:00.050326 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.050420 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:00.836972 (+786552us) raft_consensus.cc:1685] finished
0709 13:01:00.837001 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:00.837226 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2366,"raft.queue_time_us":1181,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":15942,"thread_start_us":964811,"threads_started":1,"wal-append.queue_time_us":1713959}
W20260709 13:01:00.937305  1741 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.949s	user 0.030s	sys 0.063s
W20260709 13:01:01.007187  1741 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.019s	user 0.030s	sys 0.064s
I20260709 13:01:01.007634  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:00.873802  3450 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:00.921113  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:00.975164  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:01.009615  1660 raft_consensus.cc:2410] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:00.977424  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:01.009721  1667 raft_consensus.cc:2410] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:01:00.984032  1732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1236) took 2328 ms. Trace:
I20260709 13:01:00.983467  1738 rpcz_store.cc:276] 0709 13:00:58.649254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.913031 (+2263777us) service_pool.cc:224] Handling call
0709 13:01:00.913402 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:00.982453 (+ 69051us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.982708 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:00.998211  1663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1234) took 1912 ms. Trace:
I20260709 13:01:01.011375  1661 raft_consensus.cc:2410] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 5 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:01:00.915025  3355 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.463s	user 0.020s	sys 0.024s
I20260709 13:01:01.000500  1558 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:01.008338  1741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1224) took 2634 ms. Trace:
W20260709 13:01:00.960330  1739 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.952s	user 0.031s	sys 0.072s
W20260709 13:01:01.036161  1739 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.028s	user 0.031s	sys 0.072s
W20260709 13:01:01.011768  1705 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.846s	user 0.009s	sys 0.034s
I20260709 13:01:01.012487  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:01:01.003885  3245 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.559s	user 0.014s	sys 0.039s
I20260709 13:01:01.013898  1732 rpcz_store.cc:276] 0709 13:00:58.655637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.933739 (+2278102us) service_pool.cc:224] Handling call
0709 13:01:00.983405 (+ 49666us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:00.983637 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:00.983673 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:00.983728 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:00.983770 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.983837 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:00.983966 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:01.016520  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.040194  1585 raft_consensus.cc:1240] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 3. Current term is 5. Ops: [3.3-3.3]
W20260709 13:01:00.972013  3308 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.010s	user 0.013s	sys 0.041s
I20260709 13:01:01.032482  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:01:00.978636  3195 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.626s	user 0.009s	sys 0.028s
I20260709 13:01:01.037469  1661 raft_consensus.cc:2410] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:01:01.014014  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:01:00.980337  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 45630.6us
W20260709 13:01:01.037796  1705 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.872s	user 0.009s	sys 0.034s
W20260709 13:01:01.046926  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 881747us
I20260709 13:01:00.930214  3310 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:01.042236  1667 raft_consensus.cc:2410] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:01:01.042210  1735 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.952s	user 0.027s	sys 0.020s
I20260709 13:01:01.044819  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:01.052963  1658 raft_consensus.cc:2410] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:01:01.053254  1632 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.779s	user 0.013s	sys 0.007s
W20260709 13:01:01.053704  1632 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.013s	sys 0.007s
I20260709 13:01:01.053867  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:00.884655  3456 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:01.044385  3308 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.083s	user 0.013s	sys 0.041s
I20260709 13:01:01.041504  1660 raft_consensus.cc:2468] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:01:01.070518  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:01.071832  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:01.072618  1660 raft_consensus.cc:2368] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 2. Current term is 3.
I20260709 13:01:01.005393  3324 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:00.925626  3460 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:01.059720  1735 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.970s	user 0.027s	sys 0.020s
I20260709 13:01:01.002982  3305 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:01.046361  1704 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.016s	sys 0.003s
W20260709 13:01:01.063148  1736 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.002s	sys 0.018s
W20260709 13:01:01.063364  1662 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.093s	user 0.006s	sys 0.014s
W20260709 13:01:01.068367  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 67985us
W20260709 13:01:01.043483  3442 consensus_meta.cc:287] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.875s	user 0.012s	sys 0.000s
I20260709 13:01:01.074420  3321 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.074877  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:01.092558  1734 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 2.
I20260709 13:01:01.076122  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:01.091455  1558 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:01.094184  1667 raft_consensus.cc:2410] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:01:01.051792  1705 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.901s (SENT) [suppressed 26 similar messages]
I20260709 13:01:01.080209  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:00.998548  3359 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:01.060094  1665 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.886s	user 0.015s	sys 0.035s
I20260709 13:01:01.094884  1558 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:01:01.095346  1665 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.921s	user 0.015s	sys 0.035s
I20260709 13:01:01.042548  3245 raft_consensus.cc:697] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:01.002738  3205 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:01.097908  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:01:01.086386  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:01.090098  1664 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.915s	user 0.008s	sys 0.047s
I20260709 13:01:01.097234  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:01:01.097949  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 46167.4us
W20260709 13:01:01.087188  1704 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.016s	sys 0.003s
W20260709 13:01:01.100455  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 895600us
W20260709 13:01:01.101053  1664 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.935s	user 0.008s	sys 0.047s
W20260709 13:01:01.087414  1736 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.002s	sys 0.019s
W20260709 13:01:01.089596  1662 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.119s	user 0.006s	sys 0.015s
W20260709 13:01:01.102974  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:01.100620  1705 connection.cc:256] RPC call timeout handler was delayed by -1.7238096639999867s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21200000000000002s for a response
I20260709 13:01:01.057435  3441 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:01:01.105103  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:01.106353  1705 leader_election.cc:336] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.019s (SENT)
I20260709 13:01:01.078456  3452 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:01:01.107163  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.107611  1705 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:01.099443  1667 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:01:01.110208  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:01.045938  3195 raft_consensus.cc:697] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:01:01.092631  3193 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.014s	sys 0.009s
I20260709 13:01:00.992272  3458 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:01.077925  3465 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:01.138088  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:01.138471  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:01.139335  1734 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:01:01.113936  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:01.140913  1667 raft_consensus.cc:2468] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:01:01.142004  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:01.114918  1658 raft_consensus.cc:2410] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:01:01.115473  1665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1226) took 2079 ms. Trace:
W20260709 13:01:01.125183  1705 connection.cc:256] RPC call timeout handler was delayed by -1.4318407140000318s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16000000000000003s for a response
W20260709 13:01:01.144758  1705 connection.cc:256] RPC call timeout handler was delayed by -1.3948557990000268s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1718s for a response
W20260709 13:01:01.145241  1705 connection.cc:256] RPC call timeout handler was delayed by -1.3111557990000051s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1811s for a response
W20260709 13:01:01.145601  1705 connection.cc:256] RPC call timeout handler was delayed by -1.2828096640000126s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.261s for a response
W20260709 13:01:01.146080  1705 connection.cc:256] RPC call timeout handler was delayed by -1.1327173640000296s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17720000000000002s for a response
W20260709 13:01:01.146446  1705 connection.cc:256] RPC call timeout handler was delayed by -1.1273173640000778s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1778s for a response
W20260709 13:01:01.146800  1705 connection.cc:256] RPC call timeout handler was delayed by -1.0814173640000604s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1829s for a response
W20260709 13:01:01.147161  1705 connection.cc:256] RPC call timeout handler was delayed by -1.0375557990000175s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21150000000000002s for a response
W20260709 13:01:01.147521  1705 connection.cc:256] RPC call timeout handler was delayed by -1.0175173640000708s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19s for a response
I20260709 13:01:01.105451  3210 raft_consensus.cc:2804] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:01.150527  1661 raft_consensus.cc:2393] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 5: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:01:01.151765  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:01.143198  1665 rpcz_store.cc:276] 0709 13:00:59.036242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.036631 (+   389us) service_pool.cc:224] Handling call
0709 13:00:59.036999 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:59.037253 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:00.174115 (+1136862us) log.cc:844] Serialized 14 byte log entry
0709 13:01:01.115025 (+940910us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:01.115099 (+    74us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:01.115157 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.115250 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.115397 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9245,"prepare.queue_time_us":1265184,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":68,"raft.queue_time_us":29185,"thread_start_us":2057547,"threads_started":2}
I20260709 13:01:01.153048  3454 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:01.103971  3464 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.157416  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:01:01.131563  3193 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.014s	sys 0.010s
I20260709 13:01:01.153280  3470 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.168156  3245 consensus_queue.cc:237] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:01.186071  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:01:01.112733  3408 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.009s	sys 0.015s
I20260709 13:01:01.129671  3452 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:01.157858  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:01.125550  3319 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:01.133273  3201 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.181589  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:01.188778  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:01:01.189519  3449 raft_consensus.cc:2804] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:01.104091  3321 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } }
I20260709 13:01:01.160379  3210 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.153062  3457 raft_consensus.cc:2749] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:01.096129  3442 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:01.112382  3441 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:01.212152  1707 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.870s	user 0.013s	sys 0.034s
W20260709 13:01:01.249836  1707 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.936s	user 0.014s	sys 0.035s
I20260709 13:01:01.214556  1665 raft_consensus.cc:2410] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:01.169446  3308 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:01:01.215850  1659 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.912s	user 0.008s	sys 0.041s
W20260709 13:01:01.213162  1556 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.339s	user 0.000s	sys 0.068s
W20260709 13:01:01.201303  1705 leader_election.cc:336] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.532s (SENT)
W20260709 13:01:01.251766  1659 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.952s	user 0.010s	sys 0.047s
I20260709 13:01:01.255095  1705 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:01:01.256477  1556 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.382s	user 0.005s	sys 0.071s
I20260709 13:01:01.175959  3380 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:01:01.182195  3459 log.cc:927] Time spent T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
W20260709 13:01:01.239172  1733 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.016s	sys 0.034s
W20260709 13:01:01.261694  1733 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.016s	sys 0.034s
I20260709 13:01:01.237923  3449 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:01.213994  3408 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.010s	sys 0.023s
I20260709 13:01:01.238420  3201 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:01.267076  3365 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.267604  3365 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:01.268467  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.268669  3201 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:01.269155  3450 raft_consensus.cc:2749] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:01.174669  3454 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:01.270390  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:01.270995  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:01.272086  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:01.266881  3449 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:01.273514  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 72183.4us
W20260709 13:01:01.269881  3472 log.cc:927] Time spent T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 13:01:01.275370  1705 leader_election.cc:336] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.551s (SENT)
W20260709 13:01:01.270578  3462 log.cc:927] Time spent T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:01:01.272609  1739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1229) took 2854 ms. Trace:
I20260709 13:01:01.329277  1739 rpcz_store.cc:276] 0709 13:00:58.418245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.920014 (+1501769us) service_pool.cc:224] Handling call
0709 13:00:59.953390 (+ 33376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:59.953797 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:59.953838 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:59.968946 (+ 15108us) log.cc:844] Serialized 26 byte log entry
0709 13:01:01.036604 (+1067658us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:01.036645 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.036713 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:01.272428 (+235715us) raft_consensus.cc:1685] finished
0709 13:01:01.272446 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.272557 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":60546,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":15530,"thread_start_us":1028369,"threads_started":1,"wal-append.queue_time_us":1273964}
I20260709 13:01:01.332134  1739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1239) took 2653 ms. Trace:
I20260709 13:01:01.212242  3247 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:01:01.284363  1666 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.861s	user 0.019s	sys 0.056s
I20260709 13:01:01.332273  1707 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:01.284204  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:01.301494  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:01.246717  3210 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:01.260615  3380 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:01.243850  2425 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.016s	sys 0.040s
I20260709 13:01:01.309593  1705 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:01.310755  1667 raft_consensus.cc:2410] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:01:01.333467  1666 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.910s	user 0.019s	sys 0.056s
I20260709 13:01:01.334373  1591 raft_consensus.cc:1240] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 1. Current term is 3. Ops: []
W20260709 13:01:01.299712  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.332657  1739 rpcz_store.cc:276] 0709 13:00:58.678598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.331250 (+2652652us) service_pool.cc:224] Handling call
0709 13:01:01.331579 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.331750 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:01.331778 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:01.331813 (+    35us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:01.331848 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.331910 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.332061 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:01.339076  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:01.351305  1660 raft_consensus.cc:2468] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:01:01.351810  1739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1243) took 2651 ms. Trace:
I20260709 13:01:01.352489  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:01.353346  1660 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5.
I20260709 13:01:01.352284  1739 rpcz_store.cc:276] 0709 13:00:58.699976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.351082 (+2651106us) service_pool.cc:224] Handling call
0709 13:01:01.351368 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.351530 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:01.351553 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:01.351592 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:01.351618 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.351664 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.351750 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:01.354405  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:01.187544  3464 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:01.357419  3485 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.357980  3484 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:01.354862  3102 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.360539  3319 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:01.010756  1663 rpcz_store.cc:276] 0709 13:00:59.085477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.137030 (+ 51553us) service_pool.cc:224] Handling call
0709 13:00:59.146303 (+  9273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:59.146508 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:00.032957 (+886449us) log.cc:844] Serialized 14 byte log entry
0709 13:01:00.988308 (+955351us) log.cc:844] Serialized 14 byte log entry
0709 13:01:00.997856 (+  9548us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:00.997907 (+    51us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:00.997953 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.998022 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:00.998150 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14103,"prepare.queue_time_us":1222484,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":66,"raft.queue_time_us":14915,"thread_start_us":1812374,"threads_started":2}
I20260709 13:01:01.365464  3205 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:01.385921  3404 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.017s	sys 0.017s
I20260709 13:01:01.367437  3452 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:01.369195  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 93859us
I20260709 13:01:01.369760  3201 raft_consensus.cc:2749] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:01.369994  3441 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:01.371529  1739 raft_consensus.cc:1275] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:01:01.372524  3460 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:01.521446  1739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1245) took 2820 ms. Trace:
I20260709 13:01:01.373137  3442 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:01.357452  1666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1223) took 2314 ms. Trace:
I20260709 13:01:01.529723  1739 rpcz_store.cc:276] 0709 13:00:58.700673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.355738 (+2655065us) service_pool.cc:224] Handling call
0709 13:01:01.371172 (+ 15434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.521053 (+149881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.521357 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:01.375424  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:01:01.417618  3404 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.017s	sys 0.017s
I20260709 13:01:01.036057  1741 rpcz_store.cc:276] 0709 13:00:58.373932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.129563 (+755631us) service_pool.cc:224] Handling call
0709 13:00:59.150890 (+ 21327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:59.151319 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:59.151357 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:59.167595 (+ 16238us) log.cc:844] Serialized 26 byte log entry
0709 13:00:59.987953 (+820358us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:01.007620 (+1019667us) log.cc:844] Serialized 14 byte log entry
0709 13:01:01.007943 (+   323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.008037 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:01.008103 (+    66us) raft_consensus.cc:1685] finished
0709 13:01:01.008122 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.008274 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3625,"raft.run_cpu_time_us":364,"raft.run_wall_time_us":41364,"thread_start_us":1742228,"threads_started":2,"wal-append.queue_time_us":1237753}
I20260709 13:01:01.388604  1735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1231) took 2952 ms. Trace:
W20260709 13:01:01.349390  2425 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.017s	sys 0.040s
W20260709 13:01:01.356302  3409 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.516s	user 0.012s	sys 0.029s
I20260709 13:01:01.548527  1735 rpcz_store.cc:276] 0709 13:00:58.435910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.037411 (+1601501us) service_pool.cc:224] Handling call
0709 13:01:00.046888 (+  9477us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:00.047314 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:00.047352 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:00.047923 (+   571us) log.cc:844] Serialized 26 byte log entry
0709 13:01:00.848077 (+800154us) spinlock_profiling.cc:243] Waited 6.65 ms on lock 0x7b4800120858. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b85eb8aa1 00007f1b85eafb37 00007f1b85eaf9ca 00007f1b85fa726f 00007f1b85fa6f37 00007f1b85fbb55c 00007f1b85fbb508 00007f1b85fbb488 00007f1b85fbb443 00007f1b85fba6ec 00007f1b84ee4a96
0709 13:01:01.082007 (+233930us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:01.082065 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.082156 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:01.374145 (+291989us) raft_consensus.cc:1685] finished
0709 13:01:01.374162 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.388511 (+ 14349us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":587023,"raft.run_cpu_time_us":2077,"raft.run_wall_time_us":209552,"spinlock_wait_cycles":15298944,"thread_start_us":991748,"threads_started":1,"wal-append.queue_time_us":1273942}
I20260709 13:01:01.399610  1585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 729) took 1529 ms. Trace:
I20260709 13:01:01.551529  1741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35672 (request call id 38) took 2502 ms. Trace:
W20260709 13:01:01.403759  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.406298  1738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1246) took 2705 ms. Trace:
I20260709 13:01:01.413043  3359 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:01.365998  3457 raft_consensus.cc:2804] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:01.350029  3310 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:01.420898  3474 consensus_queue.cc:1059] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.083s
W20260709 13:01:01.504448  3490 log.cc:927] Time spent T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 13:01:01.418104  1705 leader_election.cc:336] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.556s (SENT)
I20260709 13:01:01.569875  1705 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:01.507257  3458 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:01:01.508195  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.517303  1732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1247) took 2760 ms. Trace:
I20260709 13:01:01.245719  3195 consensus_queue.cc:237] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:01.236382  3470 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:01.271831  3308 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:01.584698  1707 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:01.520999  3205 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:01.545511  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:01.546500  1739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1248) took 2788 ms. Trace:
I20260709 13:01:01.607674  1739 rpcz_store.cc:276] 0709 13:00:58.758367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.530893 (+2772526us) service_pool.cc:224] Handling call
0709 13:01:01.545828 (+ 14935us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.546059 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:01.546096 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:01.546154 (+    58us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:01.546197 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.546269 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.546424 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:01.536561  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 157506us
I20260709 13:01:01.609462  1556 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:01.611562  1556 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:01:01.390214  3288 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.016s	sys 0.020s
W20260709 13:01:01.612789  3288 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.018s	sys 0.021s
I20260709 13:01:01.413224  3365 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:01.552361  1738 rpcz_store.cc:276] 0709 13:00:58.701161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.405274 (+2704113us) service_pool.cc:224] Handling call
0709 13:01:01.405662 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.405870 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:01.405904 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:01.405961 (+    57us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:01.406008 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.406083 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.406226 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:01.529872  1666 rpcz_store.cc:276] 0709 13:00:59.035390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.035504 (+   114us) service_pool.cc:224] Handling call
0709 13:00:59.035822 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:59.036020 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:59.844733 (+808713us) log.cc:844] Serialized 14 byte log entry
0709 13:01:01.349883 (+1505150us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:01.349954 (+    71us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:01.349999 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.350068 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.350219 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":124257,"prepare.queue_time_us":1052816,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":12235,"raft.queue_time_us":373631,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":87270,"thread_start_us":2312931,"threads_started":3,"wal-append.queue_time_us":1194823}
I20260709 13:01:01.410171  1737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43678 (request call id 1258) took 1224 ms. Trace:
I20260709 13:01:01.551909  1741 rpcz_store.cc:276] 0709 13:00:59.049505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.548560 (+2499055us) service_pool.cc:224] Handling call
0709 13:01:01.551032 (+  2472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.551229 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:01.551255 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:01.551295 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:01.551322 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.551372 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.551479 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:01.615459  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:01.616130  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:01.616773  1741 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:01.617493  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:01.618022  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:01.551074  1585 rpcz_store.cc:276] 0709 13:00:59.870510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.875640 (+  5130us) service_pool.cc:224] Handling call
0709 13:00:59.970745 (+ 95105us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:01.040700 (+1069955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.399213 (+358513us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400437bd4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:01:01.399522 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2454924160}
I20260709 13:01:01.411556  3305 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:01.414947  3319 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:01.393872  3485 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:01.565716  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:01:01.582360  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 164282us
I20260709 13:01:01.585480  1732 rpcz_store.cc:276] 0709 13:00:58.756691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.411248 (+2654557us) service_pool.cc:224] Handling call
0709 13:01:01.516560 (+105312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.516819 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:01.516855 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:01.516915 (+    60us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:01.516959 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.517032 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.517223 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:01.414166  3102 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:01.550513  3409 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.719s	user 0.012s	sys 0.029s
W20260709 13:01:01.616945  3471 log.cc:927] Time spent T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.402s	user 0.001s	sys 0.002s
I20260709 13:01:01.311718  3329 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:01.618618  1667 raft_consensus.cc:2468] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:01:01.530933  1660 raft_consensus.cc:2468] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:01:01.630064  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:01:01.630399  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 45799.6us
I20260709 13:01:01.630772  1663 raft_consensus.cc:2393] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 4: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:01:01.631019  1667 raft_consensus.cc:2393] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 4: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:01:01.416519  3400 consensus_queue.cc:1048] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.140s
I20260709 13:01:01.606069  1735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1249) took 2453 ms. Trace:
I20260709 13:01:01.615121  1737 rpcz_store.cc:276] 0709 13:01:00.186044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.851845 (+665801us) service_pool.cc:224] Handling call
0709 13:01:01.409956 (+558111us) spinlock_profiling.cc:243] Waited 58.8 ms on lock 0x7b540001d954. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:01:01.410097 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":135324544}
I20260709 13:01:01.624614  1664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1233) took 2541 ms. Trace:
I20260709 13:01:01.624895  1591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 728) took 1754 ms. Trace:
W20260709 13:01:01.625499  1705 leader_election.cc:336] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.600s (SENT)
I20260709 13:01:01.618546  1666 raft_consensus.cc:2410] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:01:01.634117  1705 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:01.631881  1735 rpcz_store.cc:276] 0709 13:00:59.152898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.550864 (+2397966us) service_pool.cc:224] Handling call
0709 13:01:01.605433 (+ 54569us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.605659 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:01.605696 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:01.605749 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:01.605800 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.605864 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.605998 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:01.635298  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:01.636196  1666 raft_consensus.cc:2410] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:01:01.632990  1664 rpcz_store.cc:276] 0709 13:00:59.083745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.096952 (+ 13207us) service_pool.cc:224] Handling call
0709 13:00:59.125745 (+ 28793us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:59.159509 (+ 33764us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:00.092852 (+933343us) log.cc:844] Serialized 14 byte log entry
0709 13:01:01.167601 (+1074749us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:01.175680 (+  8079us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:01.175757 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.624348 (+448591us) spinlock_profiling.cc:243] Waited 33.4 ms on lock 0x7b540040e2d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:01:01.624393 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.624538 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44417,"prepare.queue_time_us":1202259,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":80,"raft.queue_time_us":70918,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":7550,"spinlock_wait_cycles":76916096,"thread_start_us":1771340,"threads_started":2,"wal-append.queue_time_us":1337177}
I20260709 13:01:01.637583  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:01.637790  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:01.638271  1739 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:01.639158  1667 raft_consensus.cc:2410] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:01.649567  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:01.642335  1740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1227) took 3225 ms. Trace:
I20260709 13:01:01.650727  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:01.651337  1740 rpcz_store.cc:276] 0709 13:00:58.416642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.576110 (+1159468us) service_pool.cc:224] Handling call
0709 13:00:59.652933 (+ 76823us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:59.693379 (+ 40446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:59.693428 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:59.707689 (+ 14261us) log.cc:844] Serialized 26 byte log entry
0709 13:01:00.789332 (+1081643us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:00.789386 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.789481 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:01.616365 (+826884us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b4400022b4c. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7ddc8c85 00007f1b7ddc96a2 00007f1b80b3b1db 00007f1b80b36aaf 00007f1b80b2a86e 00007f1b80b29bb6 00007f1b80b297d8 00007f1b80b33221 00007f1b80b331d9 00007f1b80b33169
0709 13:01:01.628982 (+ 12617us) raft_consensus.cc:1685] finished
0709 13:01:01.629007 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.642257 (+ 13250us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":346035,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":7541,"spinlock_wait_cycles":41070976,"thread_start_us":949055,"threads_started":1,"wal-append.queue_time_us":1378071}
I20260709 13:01:01.652830  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:01.653743  1666 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:01:01.414800  3408 consensus_queue.cc:1059] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.169s
I20260709 13:01:01.655329  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:01:01.655887  1705 leader_election.cc:336] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.778s (SENT)
I20260709 13:01:01.656320  1705 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:01.660181  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:01.661269  1667 raft_consensus.cc:2393] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 5: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:01:01.662343  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:01:01.663504  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.665729  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:01.665894  1660 raft_consensus.cc:2410] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:01.666565  1663 raft_consensus.cc:2410] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:01:01.667245  1661 raft_consensus.cc:2410] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:01:01.667837  1705 leader_election.cc:336] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.829s (SENT)
I20260709 13:01:01.633639  1591 rpcz_store.cc:276] 0709 13:00:59.870239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.870422 (+   183us) service_pool.cc:224] Handling call
0709 13:00:59.870775 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.350302 (+1479527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.624676 (+274374us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b54002ecf54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:01:01.624834 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3365333888}
I20260709 13:01:01.594998  3450 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:01.624616  3475 log.cc:927] Time spent T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.298s	user 0.001s	sys 0.001s
W20260709 13:01:01.623083  3469 log.cc:927] Time spent T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.441s	user 0.000s	sys 0.002s
W20260709 13:01:01.669023  1705 leader_election.cc:336] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.900s (SENT)
I20260709 13:01:01.604669  3456 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:01.606953  3457 raft_consensus.cc:697] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:01.676882  1705 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:01.677021  1659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1238) took 1544 ms. Trace:
I20260709 13:01:01.628559  1741 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:01:01.663084  1667 raft_consensus.cc:2376] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4. Re-sending same reply.
I20260709 13:01:01.750689  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:01:01.751044  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.751420  1667 raft_consensus.cc:2393] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 5: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:01:01.671370  3458 raft_consensus.cc:2749] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:01.559082  2996 consensus_queue.cc:1048] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.098s
I20260709 13:01:01.627938  3102 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:01.625126  3485 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:01.604278  3460 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:01.677809  3355 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.063s	sys 0.062s
I20260709 13:01:01.625880  3454 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:01.743680  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:01.744940  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:01.804718  1663 raft_consensus.cc:2393] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 5: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:01:01.650205  3201 raft_consensus.cc:2749] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:01.640174  2945 raft_consensus.cc:2804] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:01.749629  1659 rpcz_store.cc:276] 0709 13:01:00.132646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.132763 (+   117us) service_pool.cc:224] Handling call
0709 13:01:00.133121 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:00.133363 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:01.252268 (+1118905us) log.cc:844] Serialized 14 byte log entry
0709 13:01:01.676678 (+424410us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:01.676733 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:01.676783 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.676848 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.676965 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":198349,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":3313,"thread_start_us":1375653,"threads_started":2}
I20260709 13:01:01.768133  3196 raft_consensus.cc:2804] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:01.753405  1658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1245) took 1386 ms. Trace:
I20260709 13:01:01.817852  1658 rpcz_store.cc:276] 0709 13:01:00.367434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.232877 (+865443us) service_pool.cc:224] Handling call
0709 13:01:01.233324 (+   447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.670716 (+437392us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:01.670757 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:01.670807 (+    50us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:01.670841 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.753190 (+ 82349us) spinlock_profiling.cc:243] Waited 437 ms on lock 0x7b54003f9154. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:01:01.753234 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.753355 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3115,"raft.run_cpu_time_us":9351,"raft.run_wall_time_us":64899,"spinlock_wait_cycles":1005173504}
W20260709 13:01:01.759662  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 148190us
W20260709 13:01:01.755169  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:01.820211  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.673969  3288 raft_consensus.cc:2749] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:01.763280  1664 raft_consensus.cc:1275] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:01.753670  1665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1246) took 1381 ms. Trace:
I20260709 13:01:01.825062  1665 rpcz_store.cc:276] 0709 13:01:00.372661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.250750 (+878089us) service_pool.cc:224] Handling call
0709 13:01:01.251053 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.251402 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:01.301614 (+ 50212us) log.cc:844] Serialized 14 byte log entry
0709 13:01:01.753368 (+451754us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:01.753418 (+    50us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:01.753457 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.753519 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.753620 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27548,"prepare.queue_time_us":32634,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":5031,"raft.queue_time_us":822,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":19321,"thread_start_us":447501,"threads_started":1}
I20260709 13:01:01.826876  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:01.828270  1664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1248) took 1446 ms. Trace:
I20260709 13:01:01.828642  1664 rpcz_store.cc:276] 0709 13:01:00.381710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.681175 (+1299465us) service_pool.cc:224] Handling call
0709 13:01:01.762960 (+ 81785us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.824763 (+ 61803us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.828202 (+  3439us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:01.831889  1665 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:01:01.832358  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:01.752265  1739 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:01:01.641181  3205 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:01.778252  1660 raft_consensus.cc:1275] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
W20260709 13:01:01.799393  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.413424  3484 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:01.677508  3450 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:01.811602  1666 raft_consensus.cc:2393] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 4: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:01:01.814894  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:01:01.671831  3466 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.010s	sys 0.050s
I20260709 13:01:01.822747  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:01.767355  3321 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:01:01.833997  1660 pending_rounds.cc:85] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 2
I20260709 13:01:01.842973  1660 pending_rounds.cc:107] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:01:01.843236  1660 raft_consensus.cc:2889] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:01.843905  1660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1247) took 1465 ms. Trace:
I20260709 13:01:01.806461  3102 raft_consensus.cc:2749] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:01.837642  1659 raft_consensus.cc:2468] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 1.
I20260709 13:01:01.834703  2945 raft_consensus.cc:697] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:01.844337  1660 rpcz_store.cc:276] 0709 13:01:00.379030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.681577 (+1302547us) service_pool.cc:224] Handling call
0709 13:01:01.759657 (+ 78080us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.843644 (+ 83987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.843852 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:01.824441  3454 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.852202  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:01.853189  1660 raft_consensus.cc:2410] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:01.849222  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:01.855057  1659 raft_consensus.cc:2410] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:01:01.856302  1659 raft_consensus.cc:1240] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:01.850687  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:01.817632  3196 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
W20260709 13:01:01.860543  3495 log.cc:927] Time spent T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:01:01.861605  3212 raft_consensus.cc:3055] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:01.862133  3212 raft_consensus.cc:740] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:01.863111  3212 consensus_queue.cc:260] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:01.869222  3196 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:01.856976  1659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1256) took 1352 ms. Trace:
I20260709 13:01:01.868595  3474 consensus_queue.cc:1048] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:01.874395  1659 rpcz_store.cc:276] 0709 13:01:00.504417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.855738 (+1351321us) service_pool.cc:224] Handling call
0709 13:01:01.856079 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.856726 (+   647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.856914 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:01.877540  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:01.879793  1659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1257) took 1244 ms. Trace:
I20260709 13:01:01.880362  1659 rpcz_store.cc:276] 0709 13:01:00.635477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.878775 (+1243298us) service_pool.cc:224] Handling call
0709 13:01:01.879174 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.879387 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:01.879424 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:01.879478 (+    54us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:01.879522 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.879591 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.879722 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:01.881937  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:01.864535  3319 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:01.882642  1659 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5.
W20260709 13:01:01.873710  3491 log.cc:927] Time spent T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
W20260709 13:01:01.859793  3210 consensus_meta.cc:287] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.505s	user 0.012s	sys 0.000s
I20260709 13:01:01.898439  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:01.864594  3212 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:01.909734  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 338468us
I20260709 13:01:01.927460  1738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1256) took 2572 ms. Trace:
I20260709 13:01:01.910267  1734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1237) took 3254 ms. Trace:
I20260709 13:01:01.934471  1666 raft_consensus.cc:2393] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 5: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:01:01.932582  1734 rpcz_store.cc:276] 0709 13:00:58.656345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.158043 (+2501698us) service_pool.cc:224] Handling call
0709 13:01:01.182316 (+ 24273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.182530 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:01.657116 (+474586us) log.cc:844] Serialized 14 byte log entry
0709 13:01:01.909848 (+252732us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:01.909917 (+    69us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:01.909973 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.910058 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.910198 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":148499,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":31,"raft.queue_time_us":523,"thread_start_us":694388,"threads_started":2}
I20260709 13:01:01.926411  1558 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:01.952937  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:01.953624  1659 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:01:01.955156  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:01.956636  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:01.957357  1659 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
W20260709 13:01:01.958518  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.958448  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:01.944862  1734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1260) took 1687 ms. Trace:
I20260709 13:01:01.986416  1734 rpcz_store.cc:276] 0709 13:01:00.257593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.943696 (+1686103us) service_pool.cc:224] Handling call
0709 13:01:01.944069 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.944461 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:01.944488 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:01.944531 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:01.944583 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.944649 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.944794 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100,"spinlock_wait_cycles":23417088}
I20260709 13:01:01.877801  3454 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:01.993248  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 66915.2us
I20260709 13:01:02.001942  1558 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:01:01.953583  3488 log.cc:927] Time spent T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.401s	user 0.000s	sys 0.001s
I20260709 13:01:01.844820  3457 consensus_queue.cc:237] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:02.009699  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.014704  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:01:02.045612  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 43776.6us
W20260709 13:01:01.984704  3465 consensus_meta.cc:287] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.796s	user 0.007s	sys 0.004s
I20260709 13:01:01.951875  3321 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.911537  3210 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:01.966431  3324 consensus_queue.cc:1048] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.174s
I20260709 13:01:02.055094  1586 raft_consensus.cc:1240] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:01:02.293715  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.294904  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:01:02.288606  3504 log.cc:927] Time spent T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 13:01:02.296439  1588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 1183) took 1028 ms. Trace:
W20260709 13:01:02.289105  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:02.219646  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.220729  1739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1259) took 2034 ms. Trace:
I20260709 13:01:01.927937  1738 rpcz_store.cc:276] 0709 13:00:59.355096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.667838 (+2312742us) service_pool.cc:224] Handling call
0709 13:01:01.668136 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.668339 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:01.740170 (+ 71831us) log.cc:844] Serialized 14 byte log entry
0709 13:01:01.927011 (+186841us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:01.927081 (+    70us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:01.927140 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.927235 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.927378 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17137,"prepare.queue_time_us":91121,"prepare.run_cpu_time_us":3224,"prepare.run_wall_time_us":36078,"raft.queue_time_us":79,"thread_start_us":184893,"threads_started":1}
W20260709 13:01:02.276316  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 58782.8us
I20260709 13:01:02.126348  1590 raft_consensus.cc:1240] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3. Ops: []
W20260709 13:01:02.300290  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.300673  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:02.296449  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:01:02.166538  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.216403  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:02.303933  1734 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 3.
I20260709 13:01:02.103972  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:02.298465  1739 rpcz_store.cc:276] 0709 13:01:00.186406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.833716 (+1647310us) service_pool.cc:224] Handling call
0709 13:01:01.835243 (+  1527us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.835456 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:01.860309 (+ 24853us) log.cc:844] Serialized 14 byte log entry
0709 13:01:02.220324 (+360015us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:02.220387 (+    63us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:02.220441 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.220521 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.220656 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13765,"prepare.queue_time_us":147417,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":14510,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":15759,"thread_start_us":359619,"threads_started":1}
I20260709 13:01:02.305397  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:02.074021  1591 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:02.308154  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:02.356474  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:02.357514  1591 raft_consensus.cc:606] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:02.064597  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:02.359434  1734 raft_consensus.cc:1813] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Handling vote request from an unknown peer 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:02.360212  1734 raft_consensus.cc:2393] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 5: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
W20260709 13:01:02.315778  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 646698us
W20260709 13:01:02.260361  1735 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.014s	sys 0.026s
I20260709 13:01:02.364823  1735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1253) took 3210 ms. Trace:
I20260709 13:01:02.296882  1588 rpcz_store.cc:276] 0709 13:01:01.267677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.269376 (+  1699us) service_pool.cc:224] Handling call
0709 13:01:01.269811 (+   435us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:01.325762 (+ 55951us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:01.325800 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:01.349807 (+ 24007us) log.cc:844] Serialized 52 byte log entry
0709 13:01:01.848209 (+498402us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:01.848265 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.853221 (+  4956us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:02.296168 (+442947us) raft_consensus.cc:1685] finished
0709 13:01:02.296189 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.296353 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13852,"raft.queue_time_us":55965,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":122,"thread_start_us":490384,"threads_started":1,"wal-append.queue_time_us":659661}
I20260709 13:01:02.362906  1659 raft_consensus.cc:2410] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:01:02.358059  1738 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 5.
W20260709 13:01:02.298600  3496 log.cc:927] Time spent T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da: Append to log took a long time: real 0.482s	user 0.000s	sys 0.001s
I20260709 13:01:02.382266  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:02.382432  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:02.382799  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:01:02.383517  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 84045.2us
W20260709 13:01:02.290516  3476 log.cc:927] Time spent T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.451s	user 0.001s	sys 0.000s
W20260709 13:01:02.372613  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 67230.9us
W20260709 13:01:02.339457  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:02.129336  3482 log.cc:927] Time spent T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.372s	user 0.000s	sys 0.001s
I20260709 13:01:02.341509  3465 raft_consensus.cc:2749] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:02.393153  3503 log.cc:927] Time spent T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.436s	user 0.001s	sys 0.000s
W20260709 13:01:02.393848  1705 leader_election.cc:336] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.097s (SENT)
I20260709 13:01:02.369887  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:02.384631  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:02.397467  1734 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:02.385146  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:02.169963  1665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1252) took 1703 ms. Trace:
W20260709 13:01:02.387032  1633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.014165  3363 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:02.216958  3493 log.cc:927] Time spent T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.461s	user 0.000s	sys 0.001s
I20260709 13:01:02.401088  1665 rpcz_store.cc:276] 0709 13:01:00.467032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.832670 (+1365638us) service_pool.cc:224] Handling call
0709 13:01:01.832938 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.833153 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:01.849676 (+ 16523us) log.cc:844] Serialized 14 byte log entry
0709 13:01:02.169484 (+319808us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:02.169562 (+    78us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:02.169625 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.169720 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.169885 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57960,"prepare.queue_time_us":17054,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":43,"raft.queue_time_us":42565,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":22807,"thread_start_us":276840,"threads_started":1}
I20260709 13:01:02.304961  3308 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:02.306135  3102 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.991078  2945 consensus_queue.cc:237] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:02.291499  3454 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:02.300009  3366 consensus_queue.cc:1059] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.091s
I20260709 13:01:02.230973  3408 consensus_queue.cc:1048] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.169s
I20260709 13:01:02.076393  3466 raft_consensus.cc:2804] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:02.396381  1705 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:02.398470  1738 raft_consensus.cc:2393] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 5: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:01:02.104018  2996 raft_consensus.cc:2804] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:02.371273  1736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1230) took 3945 ms. Trace:
I20260709 13:01:02.402081  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:02.365377  1735 rpcz_store.cc:276] 0709 13:00:59.154210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.635131 (+2480921us) service_pool.cc:224] Handling call
0709 13:01:01.675788 (+ 40657us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.675985 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:01.758953 (+ 82968us) log.cc:844] Serialized 14 byte log entry
0709 13:01:02.364381 (+605428us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:02.364446 (+    65us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:02.364502 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.364601 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.364755 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66098,"prepare.queue_time_us":173183,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":3338,"raft.queue_time_us":99,"thread_start_us":604896,"threads_started":1}
W20260709 13:01:02.371486  3499 log.cc:927] Time spent T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.572s	user 0.000s	sys 0.001s
W20260709 13:01:02.388028  3489 log.cc:927] Time spent T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.574s	user 0.000s	sys 0.001s
I20260709 13:01:02.407656  3363 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:02.306768  3321 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:02.424083  1733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1226) took 4007 ms. Trace:
I20260709 13:01:02.448414  1733 rpcz_store.cc:276] 0709 13:00:58.416320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.371777 (+955457us) service_pool.cc:224] Handling call
0709 13:00:59.372228 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:00.386501 (+1014273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:00.386548 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:00.460333 (+ 73785us) log.cc:844] Serialized 26 byte log entry
0709 13:01:01.262184 (+801851us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:01.262241 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.262332 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:02.423809 (+1161477us) raft_consensus.cc:1685] finished
0709 13:01:02.423841 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.424015 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":621878,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"thread_start_us":1804597,"threads_started":2,"wal-append.queue_time_us":1117679}
I20260709 13:01:02.450242  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:02.417225  3102 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:02.435415  2996 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:02.407893  3497 log.cc:927] Time spent T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.561s	user 0.000s	sys 0.001s
I20260709 13:01:02.436605  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:02.216250  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:02.451682  1738 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 4.
I20260709 13:01:02.437155  1736 rpcz_store.cc:276] 0709 13:00:58.426335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.037589 (+1611254us) service_pool.cc:224] Handling call
0709 13:01:00.044732 (+  7143us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:00.045164 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:00.045205 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:00.111008 (+ 65803us) log.cc:844] Serialized 26 byte log entry
0709 13:01:01.102285 (+991277us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:01.102352 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.102443 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:02.371033 (+1268590us) raft_consensus.cc:1685] finished
0709 13:01:02.371063 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.371207 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":417767,"raft.run_cpu_time_us":514,"raft.run_wall_time_us":183734,"thread_start_us":801977,"threads_started":1,"wal-append.queue_time_us":1198472}
I20260709 13:01:02.454520  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:02.456379  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:02.457057  1738 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 6.
I20260709 13:01:02.446341  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:02.457827  1739 raft_consensus.cc:2468] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 4.
I20260709 13:01:02.458029  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:02.459998  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:02.461441  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:02.462148  1738 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 5.
I20260709 13:01:02.463140  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:02.306057  3452 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.485852  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:02.487216  1739 raft_consensus.cc:2393] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 5: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:01:02.436666  3466 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.491880  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:02.490829  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:02.493551  1735 raft_consensus.cc:2393] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 3: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:01:02.494524  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:02.494693  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:02.495464  1738 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 6.
I20260709 13:01:02.442631  3454 raft_consensus.cc:2749] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:02.497871  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:02.443611  3450 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:02.452550  2996 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:02.487316  3319 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:02.497025  3466 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:02.512591  3196 consensus_meta.cc:287] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.643s	user 0.012s	sys 0.001s
I20260709 13:01:02.493813  3452 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:02.546268  3321 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:02.630537  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 231169us
I20260709 13:01:02.389210  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:02.390751  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:02.639534  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:02.393640  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:01:02.641892  1658 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.007s	sys 0.012s
W20260709 13:01:02.642534  1658 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.007s	sys 0.013s
I20260709 13:01:02.643874  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:02.645483  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:01:02.645975  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.639811  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:02.648384  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:02.646701  1659 raft_consensus.cc:2393] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 5: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:01:02.650514  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:02.650688  1589 raft_consensus.cc:1240] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:02.652029  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:02.657567  1662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1230) took 3613 ms. Trace:
I20260709 13:01:02.658257  1662 rpcz_store.cc:276] 0709 13:00:59.043635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.043765 (+   130us) service_pool.cc:224] Handling call
0709 13:00:59.071801 (+ 28036us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:59.895313 (+823512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:59.895347 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:59.914049 (+ 18702us) log.cc:844] Serialized 26 byte log entry
0709 13:01:01.110929 (+1196880us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:01.111000 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.111097 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:02.656821 (+1545724us) raft_consensus.cc:1685] finished
0709 13:01:02.656871 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.657290 (+   419us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7725,"raft.queue_time_us":22272,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":22470,"thread_start_us":1928465,"threads_started":2,"wal-append.queue_time_us":1725422}
I20260709 13:01:02.662249  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:02.664108  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:02.665972  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:02.667042  1662 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:01:02.668526  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:02.404220  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:02.675640  1665 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:02.678537  1667 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.003s	sys 0.009s
I20260709 13:01:02.652901  1659 raft_consensus.cc:3060] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:02.679111  1667 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.003s	sys 0.009s
W20260709 13:01:02.681519  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:02.432530  1705 leader_election.cc:336] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.120s (SENT)
I20260709 13:01:02.687466  1705 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:01:02.689723  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 257205us
W20260709 13:01:02.691082  1705 leader_election.cc:336] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.141s (SENT)
I20260709 13:01:02.691773  1705 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:02.699492  1732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1255) took 3531 ms. Trace:
I20260709 13:01:02.699996  1732 rpcz_store.cc:276] 0709 13:00:59.168048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.667305 (+2499257us) service_pool.cc:224] Handling call
0709 13:01:01.744340 (+ 77035us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:01.753210 (+  8870us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:01.753239 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:01.753694 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 13:01:02.104400 (+350706us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:02.104442 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.104517 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:02.698957 (+594440us) raft_consensus.cc:1685] finished
0709 13:01:02.698998 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.699251 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8372,"raft.queue_time_us":9729,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":12204,"thread_start_us":303966,"threads_started":1,"wal-append.queue_time_us":810878}
I20260709 13:01:02.703119  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:02.704770  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:02.705618  1732 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:02.710242  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:02.711054  1736 raft_consensus.cc:1275] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:02.711393  1733 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 5.
I20260709 13:01:02.712015  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:02.712122  1736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1262) took 2308 ms. Trace:
I20260709 13:01:02.713716  1734 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 4.
W20260709 13:01:02.714090  3380 consensus_meta.cc:287] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 1.330s	user 0.013s	sys 0.003s
I20260709 13:01:02.714447  1740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1254) took 3554 ms. Trace:
I20260709 13:01:02.714768  3380 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:02.714999  1740 rpcz_store.cc:276] 0709 13:00:59.160135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.652972 (+2492837us) service_pool.cc:224] Handling call
0709 13:01:01.748754 (+ 95782us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:02.208964 (+460210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:02.209010 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:02.209593 (+   583us) log.cc:844] Serialized 26 byte log entry
0709 13:01:02.713763 (+504170us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:02.713880 (+   117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.713981 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:02.714032 (+    51us) raft_consensus.cc:1685] finished
0709 13:01:02.714044 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.714254 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4574,"raft.queue_time_us":16187,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":8861,"thread_start_us":920237,"threads_started":2,"wal-append.queue_time_us":350818}
I20260709 13:01:02.710377  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:02.712761  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:02.712947  1739 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:02.714346  1741 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.000s	sys 0.018s
I20260709 13:01:02.712785  1736 rpcz_store.cc:276] 0709 13:01:00.403670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.709397 (+2305727us) service_pool.cc:224] Handling call
0709 13:01:02.710129 (+   732us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:02.711711 (+  1582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.712028 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42752}
I20260709 13:01:02.697983  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:01:02.737937  1741 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.000s	sys 0.019s
W20260709 13:01:02.747926  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:02.765877  1661 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.022s	sys 0.041s
W20260709 13:01:02.766410  1661 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.023s	sys 0.041s
I20260709 13:01:02.764518  1585 raft_consensus.cc:1240] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:02.770529  1662 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:01:02.736410  3512 raft_consensus.cc:2749] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:02.787108  1659 raft_consensus.cc:2468] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:01:02.788020  1665 raft_consensus.cc:2410] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:02.789397  1735 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 4.
W20260709 13:01:02.797657  1663 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.005s	sys 0.009s
W20260709 13:01:02.798329  1663 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.005s	sys 0.009s
I20260709 13:01:02.720963  3195 consensus_queue.cc:1048] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
W20260709 13:01:02.811736  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 176030us
W20260709 13:01:02.812884  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.547364  3196 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:02.825169  1737 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.012s	user 0.010s	sys 0.005s
W20260709 13:01:02.825624  1737 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.048s	user 0.010s	sys 0.005s
W20260709 13:01:02.826660  1664 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.790s	user 0.004s	sys 0.013s
I20260709 13:01:02.827068  3102 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:02.827513  1736 raft_consensus.cc:1240] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:02.828263  1736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1267) took 1901 ms. Trace:
I20260709 13:01:02.828601  1736 rpcz_store.cc:276] 0709 13:01:00.927137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.739852 (+1812715us) service_pool.cc:224] Handling call
0709 13:01:02.793561 (+ 53709us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:02.827980 (+ 34419us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.828176 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:02.830705  1736 raft_consensus.cc:1275] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:02.831329  1736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1272) took 1840 ms. Trace:
I20260709 13:01:02.831697  1736 rpcz_store.cc:276] 0709 13:01:00.990605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.829536 (+1838931us) service_pool.cc:224] Handling call
0709 13:01:02.830023 (+   487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:02.831074 (+  1051us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.831253 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:02.836364  1741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1257) took 3471 ms. Trace:
I20260709 13:01:02.836822  1741 rpcz_store.cc:276] 0709 13:00:59.364946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.750649 (+2385703us) service_pool.cc:224] Handling call
0709 13:01:01.754609 (+  3960us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.809585 (+ 54976us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:02.179569 (+369984us) log.cc:844] Serialized 14 byte log entry
0709 13:01:02.835820 (+656251us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:02.835923 (+   103us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:02.836055 (+   132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.836152 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.836306 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45981,"prepare.queue_time_us":93691,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":63,"raft.queue_time_us":34799,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":2972,"thread_start_us":899659,"threads_started":2,"wal-append.queue_time_us":417628}
I20260709 13:01:02.839843  1741 raft_consensus.cc:1240] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:02.840524  1741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35672 (request call id 39) took 1664 ms. Trace:
I20260709 13:01:02.863238  1741 rpcz_store.cc:276] 0709 13:01:01.183397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.838985 (+1655588us) service_pool.cc:224] Handling call
0709 13:01:02.839505 (+   520us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:02.840258 (+   753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.840465 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:02.840698  1658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1253) took 2342 ms. Trace:
W20260709 13:01:02.827080  1664 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.004s	sys 0.013s
W20260709 13:01:02.865379  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.873059  1732 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 4.
W20260709 13:01:02.824913  3212 consensus_meta.cc:287] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.891s	user 0.009s	sys 0.005s
I20260709 13:01:02.865151  1658 rpcz_store.cc:276] 0709 13:01:00.468280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.833177 (+1364897us) service_pool.cc:224] Handling call
0709 13:01:01.843255 (+ 10078us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.843441 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:02.020969 (+177528us) log.cc:844] Serialized 14 byte log entry
0709 13:01:02.764856 (+743887us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:02.777970 (+ 13114us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:02.791352 (+ 13382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.796276 (+  4924us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.810113 (+ 13837us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85047,"prepare.queue_time_us":148159,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":97261,"spinlock_wait_cycles":5435648,"thread_start_us":751221,"threads_started":2,"wal-append.queue_time_us":534419}
W20260709 13:01:02.876927  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.868623  1734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1265) took 1965 ms. Trace:
I20260709 13:01:02.824827  3196 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:02.879907  1733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1268) took 1948 ms. Trace:
I20260709 13:01:02.882642  1733 rpcz_store.cc:276] 0709 13:01:00.931062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.769329 (+1838267us) service_pool.cc:224] Handling call
0709 13:01:02.820184 (+ 50855us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:02.879308 (+ 59124us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:02.879356 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:02.879451 (+    95us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:02.879519 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.879622 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.879822 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58322,"raft.queue_time_us":58598,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":121}
W20260709 13:01:02.898751  1584 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 1173) took 3646 ms (client timeout 1699 ms). Trace:
W20260709 13:01:02.899497  1584 rpcz_store.cc:269] 0709 13:00:59.252528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.252700 (+   172us) service_pool.cc:224] Handling call
0709 13:01:02.898137 (+3645437us) spinlock_profiling.cc:243] Waited 2.8 s on lock 0x7b54002eca54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:01:02.898468 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6438665472}
W20260709 13:01:02.900713  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.899003  1665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1259) took 2203 ms. Trace:
I20260709 13:01:02.905160  1665 rpcz_store.cc:276] 0709 13:01:00.695569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.897631 (+2202062us) service_pool.cc:224] Handling call
0709 13:01:02.898313 (+   682us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:02.898669 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:02.898694 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:02.898752 (+    58us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:02.898778 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.898829 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.898926 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:02.918030  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:01:02.921223  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.921759  1665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58814 (request call id 55) took 2087 ms. Trace:
I20260709 13:01:02.922127  1665 rpcz_store.cc:276] 0709 13:01:00.834259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.920623 (+2086364us) service_pool.cc:224] Handling call
0709 13:01:02.921032 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:02.921392 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:02.921422 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:02.921490 (+    68us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:02.921522 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.921575 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.921700 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:02.862099  3454 raft_consensus.cc:2749] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:02.881450  1734 rpcz_store.cc:276] 0709 13:01:00.902966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.714692 (+1811726us) service_pool.cc:224] Handling call
0709 13:01:02.715214 (+   522us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:02.715798 (+   584us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:02.716335 (+   537us) log.cc:844] Serialized 14 byte log entry
0709 13:01:02.793307 (+ 76972us) log.cc:844] Serialized 14 byte log entry
0709 13:01:02.868277 (+ 74970us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:02.868330 (+    53us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:02.868370 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.868447 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.868567 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73377,"prepare.queue_time_us":52854,"prepare.run_cpu_time_us":121,"prepare.run_wall_time_us":9688,"raft.queue_time_us":164487,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":143,"thread_start_us":71037,"threads_started":1,"wal-append.queue_time_us":160772}
W20260709 13:01:02.929497  1633 connection.cc:256] RPC call timeout handler was delayed by -2.7425928140000337s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
W20260709 13:01:02.930059  1633 connection.cc:256] RPC call timeout handler was delayed by -2.5904928140000152s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1688s for a response
I20260709 13:01:02.932320  1738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1264) took 2022 ms. Trace:
I20260709 13:01:02.932760  1738 rpcz_store.cc:276] 0709 13:01:00.889244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.496176 (+1606932us) service_pool.cc:224] Handling call
0709 13:01:02.496495 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:02.496744 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:02.713516 (+216772us) log.cc:844] Serialized 14 byte log entry
0709 13:01:02.809294 (+ 95778us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:02.863867 (+ 54573us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:02.881715 (+ 17848us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.881779 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.911978 (+ 30199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4724,"prepare.queue_time_us":228419,"prepare.run_cpu_time_us":129,"prepare.run_wall_time_us":24463,"raft.queue_time_us":80932,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":216,"thread_start_us":64839,"threads_started":1,"wal-append.queue_time_us":68332}
I20260709 13:01:02.934819  3546 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.935570  3546 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:02.930387  1633 connection.cc:256] RPC call timeout handler was delayed by -2.27099281400001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20430000000000004s for a response
W20260709 13:01:02.938652  1633 connection.cc:256] RPC call timeout handler was delayed by -2.2025928140000133s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21190000000000003s for a response
I20260709 13:01:02.937147  1659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 1131) took 1030 ms. Trace:
I20260709 13:01:02.941210  1741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1275) took 1385 ms. Trace:
I20260709 13:01:02.941697  1741 rpcz_store.cc:276] 0709 13:01:01.555440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.872050 (+1316610us) service_pool.cc:224] Handling call
0709 13:01:02.919980 (+ 47930us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:02.940737 (+ 20757us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:02.940774 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:02.940845 (+    71us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:02.940890 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.940963 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.941120 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11472}
I20260709 13:01:02.939697  1659 rpcz_store.cc:276] 0709 13:01:01.907193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.808345 (+901152us) service_pool.cc:224] Handling call
0709 13:01:02.937066 (+128721us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:02.950001  3544 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:02.951025  3544 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:02.930333  3193 raft_consensus.cc:3055] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:02.953130  1558 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:02.953343  3193 raft_consensus.cc:740] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:02.953965  3329 raft_consensus.cc:3055] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:02.954433  3329 raft_consensus.cc:740] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:02.954643  1558 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:02.954880  3193 consensus_queue.cc:260] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:02.955868  3212 raft_consensus.cc:2804] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:02.955806  3329 consensus_queue.cc:260] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:02.956643  3212 raft_consensus.cc:697] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:02.957753  3321 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.945284  1735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1270) took 1969 ms. Trace:
I20260709 13:01:02.981504  1586 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 4.
I20260709 13:01:02.989415  1662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1258) took 2340 ms. Trace:
I20260709 13:01:02.990237  1662 rpcz_store.cc:276] 0709 13:01:00.646398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.800165 (+2153767us) service_pool.cc:224] Handling call
0709 13:01:02.902612 (+102447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:02.903066 (+   454us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:02.903499 (+   433us) log.cc:844] Serialized 14 byte log entry
0709 13:01:02.986523 (+ 83024us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:02.986594 (+    71us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:02.986654 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.986740 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.986903 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":782,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":7070,"raft.queue_time_us":5833,"thread_start_us":77445,"threads_started":1}
I20260709 13:01:02.992731  3329 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:02.994341  3484 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:02.993958  3212 consensus_queue.cc:237] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:02.998548  3505 log.cc:927] Time spent T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 1.233s	user 0.009s	sys 0.004s
I20260709 13:01:02.989531  1737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1252) took 3835 ms. Trace:
I20260709 13:01:02.980024  1735 rpcz_store.cc:276] 0709 13:01:00.976453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.801564 (+1825111us) service_pool.cc:224] Handling call
0709 13:01:02.833492 (+ 31928us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:02.833875 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:02.834283 (+   408us) log.cc:844] Serialized 14 byte log entry
0709 13:01:02.943975 (+109692us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:02.944957 (+   982us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:02.945008 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.945077 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.945228 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90,"prepare.queue_time_us":7160,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":31338,"raft.queue_time_us":719,"thread_start_us":109193,"threads_started":1}
I20260709 13:01:02.999329  1488 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51168 (request call id 24) took 7390 ms. Trace:
I20260709 13:01:03.021733  1741 raft_consensus.cc:1275] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:03.022555  1741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1280) took 1373 ms. Trace:
I20260709 13:01:03.023020  1741 rpcz_store.cc:276] 0709 13:01:01.649416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.942799 (+1293383us) service_pool.cc:224] Handling call
0709 13:01:03.021182 (+ 78383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.022217 (+  1035us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.022480 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:03.024540  1663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1254) took 2532 ms. Trace:
I20260709 13:01:03.025099  1663 rpcz_store.cc:276] 0709 13:01:00.492299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.839708 (+1347409us) service_pool.cc:224] Handling call
0709 13:01:01.845526 (+  5818us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.845779 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:02.000463 (+154684us) log.cc:844] Serialized 14 byte log entry
0709 13:01:02.991967 (+991504us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:03.016250 (+ 24283us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:03.024168 (+  7918us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.024274 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.024447 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26610,"prepare.queue_time_us":320909,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":51,"raft.queue_time_us":73148,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":50717,"thread_start_us":1108231,"threads_started":3,"wal-append.queue_time_us":810438}
I20260709 13:01:03.029280  3321 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:03.030413  2553 consensus_queue.cc:237] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:03.031738  3321 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:03.021487  3366 raft_consensus.cc:2804] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:03.027513  1663 raft_consensus.cc:1240] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:01:03.032292  1650 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f75a0ee5c184536abc81f5a366016fb with delete_type TABLET_DATA_TOMBSTONED (TS 5bb87fe07da2414e84ee578c3b176ede not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:39130
I20260709 13:01:03.000020  1737 rpcz_store.cc:276] 0709 13:00:59.153914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.632212 (+2478298us) service_pool.cc:224] Handling call
0709 13:01:01.677742 (+ 45530us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.677919 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:02.826062 (+1148143us) log.cc:844] Serialized 14 byte log entry
0709 13:01:02.927614 (+101552us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:02.936859 (+  9245us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:02.980112 (+ 43253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.982295 (+  2183us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.989467 (+  7172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":125800,"prepare.queue_time_us":223884,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":17152,"raft.queue_time_us":43105,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":5695,"thread_start_us":1091722,"threads_started":2,"wal-append.queue_time_us":114709}
I20260709 13:01:03.044718  1665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58814 (request call id 56) took 2210 ms. Trace:
I20260709 13:01:03.041725  1663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 1088) took 1851 ms. Trace:
I20260709 13:01:03.045090  1665 rpcz_store.cc:276] 0709 13:01:00.834595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.937609 (+2103014us) service_pool.cc:224] Handling call
0709 13:01:03.037067 (+ 99458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.044360 (+  7293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.044384 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:03.044452 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:03.044481 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.044536 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.044642 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:03.045778  1663 rpcz_store.cc:276] 0709 13:01:01.187906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.026708 (+1838802us) service_pool.cc:224] Handling call
0709 13:01:03.027191 (+   483us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:03.038629 (+ 11438us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.038914 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:03.044448  1734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1279) took 1408 ms. Trace:
I20260709 13:01:03.053592  1734 rpcz_store.cc:276] 0709 13:01:01.636548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.939413 (+1302865us) service_pool.cc:224] Handling call
0709 13:01:02.958193 (+ 18780us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.042855 (+ 84662us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.042898 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:03.044148 (+  1250us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:03.044191 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.044264 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.044375 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:03.002425  1488 rpcz_store.cc:276] 0709 13:00:55.608668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.608937 (+   269us) service_pool.cc:224] Handling call
0709 13:01:02.999054 (+7390117us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:56.851732 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:56.852479 (+   747us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:56.852535 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:00:56.852560 (+    25us) tablet.cc:662] Decoding operations
0709 13:00:56.853324 (+   764us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:56.853462 (+   138us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:56.853498 (+    36us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:00:56.854003 (+   505us) tablet.cc:701] Row locks acquired
0709 13:00:56.854066 (+    63us) write_op.cc:260] PREPARE: finished
0709 13:00:56.854245 (+   179us) write_op.cc:270] Start()
0709 13:00:56.854428 (+   183us) write_op.cc:276] Timestamp: P: 1783602056854177 usec, L: 0
0709 13:00:56.854457 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:00:56.855175 (+   718us) log.cc:844] Serialized 1427 byte log entry
0709 13:00:58.183915 (+1328740us) op_driver.cc:464] REPLICATION: finished
0709 13:00:59.311709 (+1127794us) write_op.cc:301] APPLY: starting
0709 13:00:59.321843 (+ 10134us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:59.357169 (+ 35326us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:59.386502 (+ 29333us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:59.547898 (+161396us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:59.576209 (+ 28311us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:00:59.610361 (+ 34152us) write_op.cc:312] APPLY: finished
0709 13:00:59.640204 (+ 29843us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x7b5400119254. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8c32a 00007f1b80f11f14 00007f1b80f11ec3 00007f1b80f11e38 00007f1b80f11df3 00007f1b80f110dc 00007f1b80f3ae16 00007f1b80f22cbb 00007f1b80f0d39d 00007f1b80f10d75
0709 13:00:59.702704 (+ 62500us) log.cc:844] Serialized 34 byte log entry
0709 13:01:00.830207 (+1127503us) spinlock_profiling.cc:243] Waited 51 ms on lock 0x7b4400022b4c. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7ddc8c85 00007f1b7ddc96a2 00007f1b80b3b1db 00007f1b80b36aaf 00007f1b7de850ac 00007f1b86cdfab9 00007f1b7dea169b 00007f1b7de9f93f 00007f1b7dea1c02 00007f1b80b2920b
0709 13:01:01.628236 (+798029us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:01.628332 (+    96us) write_op.cc:454] Released schema lock
0709 13:01:01.628373 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:01.628775 (+   402us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:01.628810 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":43486,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":1063494,"apply.run_cpu_time_us":53414,"apply.run_wall_time_us":2363455,"num_ops":3,"prepare.queue_time_us":203629,"prepare.run_cpu_time_us":15158,"prepare.run_wall_time_us":113382,"raft.queue_time_us":423187,"raft.run_cpu_time_us":57522,"raft.run_wall_time_us":1517108,"replication_time_us":1304848,"spinlock_wait_cycles":173458432,"thread_start_us":3077519,"threads_started":5,"wal-append.queue_time_us":2318469,"wal-append.run_cpu_time_us":12914,"wal-append.run_wall_time_us":1703888}]]}
I20260709 13:01:03.070781  1740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1266) took 2147 ms. Trace:
I20260709 13:01:03.071507  1740 rpcz_store.cc:276] 0709 13:01:00.923480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.730647 (+1807167us) service_pool.cc:224] Handling call
0709 13:01:02.786710 (+ 56063us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:02.923447 (+136737us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:02.936023 (+ 12576us) log.cc:844] Serialized 14 byte log entry
0709 13:01:03.065406 (+129383us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:03.066074 (+   668us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:03.070508 (+  4434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.070580 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.070718 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26741,"prepare.queue_time_us":6477,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":2262,"raft.queue_time_us":102,"thread_start_us":128911,"threads_started":1}
I20260709 13:01:03.060098  3366 raft_consensus.cc:697] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:03.079689  1659 raft_consensus.cc:1240] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 3. Current term is 5. Ops: []
I20260709 13:01:03.080258  1659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 1083) took 2037 ms. Trace:
I20260709 13:01:03.082676  1659 rpcz_store.cc:276] 0709 13:01:01.043046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.033524 (+1990478us) service_pool.cc:224] Handling call
0709 13:01:03.043114 (+  9590us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.080087 (+ 36973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.080218 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:03.085590  1733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1277) took 1529 ms. Trace:
I20260709 13:01:03.085140  1664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1251) took 2624 ms. Trace:
W20260709 13:01:03.090538  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 112473us
I20260709 13:01:03.092957  1739 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 5.
I20260709 13:01:03.094974  1665 raft_consensus.cc:1240] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:03.096899  1732 raft_consensus.cc:1240] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:03.097342  1665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 1095) took 1757 ms. Trace:
I20260709 13:01:03.097759  1734 raft_consensus.cc:1240] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 6. Current term is 7. Ops: []
W20260709 13:01:03.098094  3534 log.cc:927] Time spent T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:01:03.097754  1665 rpcz_store.cc:276] 0709 13:01:01.338893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.065557 (+1726664us) service_pool.cc:224] Handling call
0709 13:01:03.085279 (+ 19722us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.095505 (+ 10226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.095749 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:03.098541  1734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43686 (request call id 757) took 1137 ms. Trace:
W20260709 13:01:03.098824  2996 consensus_meta.cc:287] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.556s	user 0.010s	sys 0.002s
I20260709 13:01:03.098912  1734 rpcz_store.cc:276] 0709 13:01:01.961476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.060990 (+1099514us) service_pool.cc:224] Handling call
0709 13:01:03.085384 (+ 24394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.098286 (+ 12902us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.098472 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:03.099757  1665 raft_consensus.cc:1275] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:01:03.099959  3466 consensus_meta.cc:287] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.558s	user 0.008s	sys 0.007s
I20260709 13:01:03.100406  1665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 1106) took 1553 ms. Trace:
I20260709 13:01:03.100745  1734 raft_consensus.cc:1240] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:03.100903  3452 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:03.099545  2996 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } }
I20260709 13:01:03.097759  1735 raft_consensus.cc:1275] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:03.107270  1735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1281) took 1438 ms. Trace:
I20260709 13:01:03.107743  1739 raft_consensus.cc:1240] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:01:03.100916  1665 rpcz_store.cc:276] 0709 13:01:01.547607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.098939 (+1551332us) service_pool.cc:224] Handling call
0709 13:01:03.099340 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.100161 (+   821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.100343 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:03.100492  3466 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:03.110376  2554 consensus_queue.cc:237] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:01:03.111716  3449 consensus_meta.cc:287] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 1.786s	user 0.006s	sys 0.011s
I20260709 13:01:03.112145  3449 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:03.105372  1736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1273) took 2106 ms. Trace:
I20260709 13:01:03.109393  1734 raft_consensus.cc:1240] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:03.112468  3466 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:03.101446  1737 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:03.107626  1735 rpcz_store.cc:276] 0709 13:01:01.669290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.042967 (+1373677us) service_pool.cc:224] Handling call
0709 13:01:03.092469 (+ 49502us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.106988 (+ 14519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.107212 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:03.101337  2425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.105630  1660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1255) took 2606 ms. Trace:
I20260709 13:01:03.088325  1733 rpcz_store.cc:276] 0709 13:01:01.556045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.886982 (+1330937us) service_pool.cc:224] Handling call
0709 13:01:02.887541 (+   559us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:02.887996 (+   455us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:02.904465 (+ 16469us) log.cc:844] Serialized 14 byte log entry
0709 13:01:03.084957 (+180492us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:03.085065 (+   108us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:03.085174 (+   109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.085275 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.085511 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":377,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":63,"raft.queue_time_us":5926,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":144,"thread_start_us":99574,"threads_started":1}
I20260709 13:01:03.101054  3193 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:03.089938  1664 rpcz_store.cc:276] 0709 13:01:00.460330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.831584 (+1371254us) service_pool.cc:224] Handling call
0709 13:01:01.845828 (+ 14244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.846093 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:01.991677 (+145584us) log.cc:844] Serialized 14 byte log entry
0709 13:01:03.062463 (+1070786us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:03.062640 (+   177us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:03.064757 (+  2117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.070336 (+  5579us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.084512 (+ 14176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36970,"prepare.queue_time_us":454109,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":7136,"raft.queue_time_us":41491,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":115,"thread_start_us":1122065,"threads_started":3,"wal-append.queue_time_us":822015}
I20260709 13:01:03.122718  1664 raft_consensus.cc:1275] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:03.123359  1664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1262) took 1217 ms. Trace:
I20260709 13:01:03.124115  3470 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:03.125454  1663 raft_consensus.cc:1240] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:01:03.126241  1663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 1089) took 1892 ms. Trace:
W20260709 13:01:03.126274  1666 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 1118) took 1299 ms (client timeout 1556 ms). Trace:
I20260709 13:01:03.126748  1663 rpcz_store.cc:276] 0709 13:01:01.234255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.063007 (+1828752us) service_pool.cc:224] Handling call
0709 13:01:03.101897 (+ 38890us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:03.125950 (+ 24053us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.126187 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:03.132089  1740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43686 (request call id 764) took 1077 ms. Trace:
I20260709 13:01:03.128129  1586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 746) took 1048 ms. Trace:
I20260709 13:01:03.138307  1740 rpcz_store.cc:276] 0709 13:01:02.054378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.073447 (+1019069us) service_pool.cc:224] Handling call
0709 13:01:03.102348 (+ 28901us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.131697 (+ 29349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.131742 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:03.131818 (+    76us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:03.131860 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.131926 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.132031 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13329,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":149}
I20260709 13:01:03.123735  1664 rpcz_store.cc:276] 0709 13:01:01.905761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.121741 (+1215980us) service_pool.cc:224] Handling call
0709 13:01:03.122224 (+   483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.123072 (+   848us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.123300 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:03.131793  1667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1249) took 2740 ms. Trace:
I20260709 13:01:03.130767  3267 consensus_queue.cc:1048] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:01:03.142122  1663 raft_consensus.cc:1240] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:03.133875  3205 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:03.143234  1663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1267) took 1206 ms. Trace:
I20260709 13:01:03.143687  1663 rpcz_store.cc:276] 0709 13:01:01.936742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.141442 (+1204700us) service_pool.cc:224] Handling call
0709 13:01:03.141899 (+   457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.142889 (+   990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.143157 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:03.141449  1667 rpcz_store.cc:276] 0709 13:01:00.391484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.758343 (+1366859us) service_pool.cc:224] Handling call
0709 13:01:01.758674 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.850168 (+ 91494us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:02.173783 (+323615us) log.cc:844] Serialized 14 byte log entry
0709 13:01:02.733412 (+559629us) log.cc:844] Serialized 14 byte log entry
0709 13:01:02.733745 (+   333us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:02.733823 (+    78us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:02.733974 (+   151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.131492 (+397518us) spinlock_profiling.cc:243] Waited 91.3 ms on lock 0x7b5400242554. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:01:03.131546 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.131726 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79898,"prepare.queue_time_us":554513,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":94,"raft.queue_time_us":136259,"raft.run_cpu_time_us":565,"raft.run_wall_time_us":68344,"spinlock_wait_cycles":209943296,"thread_start_us":754871,"threads_started":2,"wal-append.queue_time_us":415685}
I20260709 13:01:03.113307  3544 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:03.131323  3465 consensus_queue.cc:1048] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:01:03.145531  1667 raft_consensus.cc:1275] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:01:03.146262  1667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1271) took 1208 ms. Trace:
I20260709 13:01:03.146603  1667 rpcz_store.cc:276] 0709 13:01:01.937920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.144732 (+1206812us) service_pool.cc:224] Handling call
0709 13:01:03.145184 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.145945 (+   761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.146201 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:03.147274  1587 raft_consensus.cc:2393] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 3: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:01:03.147428  1633 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:03.117687  3546 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:03.148319  1667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1272) took 1210 ms. Trace:
I20260709 13:01:03.118870  3454 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:03.149748  1665 raft_consensus.cc:1240] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:03.150542  1665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 1107) took 1592 ms. Trace:
I20260709 13:01:03.150172  3454 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:03.153425  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:03.153750  3210 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:03.154197  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:03.153424  3454 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:03.155736  1663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1269) took 1218 ms. Trace:
I20260709 13:01:03.155875  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:03.156126  1663 rpcz_store.cc:276] 0709 13:01:01.937353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.144588 (+1207235us) service_pool.cc:224] Handling call
0709 13:01:03.155131 (+ 10543us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.155361 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.155399 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:03.155484 (+    85us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:03.155514 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.155570 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.155676 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:03.157588  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:03.157902  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:01:03.158547  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.130851  3366 consensus_queue.cc:237] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:03.159979  1585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 733) took 1145 ms. Trace:
I20260709 13:01:03.160171  3464 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:03.160425  1585 rpcz_store.cc:276] 0709 13:01:02.014905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.015467 (+   562us) service_pool.cc:224] Handling call
0709 13:01:02.126958 (+111491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:02.789975 (+663017us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.159670 (+369695us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b54003b4cd4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:01:03.159882 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1366934912}
I20260709 13:01:03.161859  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:03.164098  1659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58814 (request call id 57) took 1790 ms. Trace:
I20260709 13:01:03.164443  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:03.165179  1665 rpcz_store.cc:276] 0709 13:01:01.558590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.117738 (+1559148us) service_pool.cc:224] Handling call
0709 13:01:03.149522 (+ 31784us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.150271 (+   749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.150479 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:03.167424  1665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1273) took 1229 ms. Trace:
I20260709 13:01:03.167845  1665 rpcz_store.cc:276] 0709 13:01:01.938506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.166119 (+1227613us) service_pool.cc:224] Handling call
0709 13:01:03.166626 (+   507us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.167062 (+   436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.167087 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:03.167142 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:03.167205 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.167260 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.167374 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:03.170047  1665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1274) took 1231 ms. Trace:
I20260709 13:01:03.171607  1591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:47714 (request call id 0) took 1177 ms. Trace:
W20260709 13:01:03.126880  1666 rpcz_store.cc:269] 0709 13:01:01.826927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.837554 (+ 10627us) service_pool.cc:224] Handling call
0709 13:01:03.125821 (+1288267us) spinlock_profiling.cc:243] Waited 76.7 ms on lock 0x7b54003589d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:01:03.126080 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":176421632}
W20260709 13:01:03.172693  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.138547  1586 rpcz_store.cc:276] 0709 13:01:02.079436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.296168 (+216732us) service_pool.cc:224] Handling call
0709 13:01:03.127895 (+831727us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b54003921d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:01:03.128026 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1405241728}
I20260709 13:01:03.164523  1659 rpcz_store.cc:276] 0709 13:01:01.374027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.086042 (+1712015us) service_pool.cc:224] Handling call
0709 13:01:03.119036 (+ 32994us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.163688 (+ 44652us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.163719 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:03.163780 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:03.163844 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.163909 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.164042 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:03.173485  1665 rpcz_store.cc:276] 0709 13:01:01.938776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.168946 (+1230170us) service_pool.cc:224] Handling call
0709 13:01:03.169359 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.169697 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.169726 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:03.169788 (+    62us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:03.169819 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.169873 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.169995 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:03.148689  1667 rpcz_store.cc:276] 0709 13:01:01.938200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.147342 (+1209142us) service_pool.cc:224] Handling call
0709 13:01:03.147704 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.147999 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.148021 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:03.148058 (+    37us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:03.148090 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.148146 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.148245 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:03.177831  3450 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:03.130996  1661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1250) took 2694 ms. Trace:
W20260709 13:01:03.181156  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 82778.9us
I20260709 13:01:03.173523  1591 rpcz_store.cc:276] 0709 13:01:02.014513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.015369 (+   856us) service_pool.cc:224] Handling call
0709 13:01:03.170958 (+1155589us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b540035b4a0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f0c520 00007f1b80f89652 00007f1b85f5760a 00007f1b7f4dd7d4 00007f1b7f4dd762 00007f1b7f4dd691 00007f1b7f4dd60c 00007f1b7f4dc8c2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:01:03.171363 (+   405us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":649920256}
W20260709 13:01:03.194164  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.114367  1736 rpcz_store.cc:276] 0709 13:01:00.999749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.832511 (+1832762us) service_pool.cc:224] Handling call
0709 13:01:02.832942 (+   431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:02.982790 (+149848us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:03.043165 (+ 60375us) log.cc:844] Serialized 14 byte log entry
0709 13:01:03.105018 (+ 61853us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:03.105067 (+    49us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:03.105119 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.105183 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.105319 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87,"prepare.queue_time_us":67550,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":4139,"raft.queue_time_us":315,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":135,"thread_start_us":23099,"threads_started":1}
W20260709 13:01:03.197510  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:03.200368  1705 leader_election.cc:336] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.658s (SENT)
I20260709 13:01:03.201047  1705 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:03.202338  3487 raft_consensus.cc:2749] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:03.203680  3400 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.331s	user 0.005s	sys 0.019s
I20260709 13:01:03.118537  1660 rpcz_store.cc:276] 0709 13:01:00.499658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.853828 (+1354170us) service_pool.cc:224] Handling call
0709 13:01:01.854078 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.854256 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:02.385539 (+531283us) log.cc:844] Serialized 14 byte log entry
0709 13:01:03.078441 (+692902us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:03.084401 (+  5960us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:03.096164 (+ 11763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.096231 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.105470 (+  9239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91318,"prepare.queue_time_us":591971,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":136487,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":188,"thread_start_us":1030195,"threads_started":3,"wal-append.queue_time_us":540681}
I20260709 13:01:03.206555  1737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43686 (request call id 763) took 1192 ms. Trace:
I20260709 13:01:03.212805  1737 rpcz_store.cc:276] 0709 13:01:02.014616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.059192 (+1044576us) service_pool.cc:224] Handling call
0709 13:01:03.074340 (+ 15148us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.206071 (+131731us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.206120 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:03.206183 (+    63us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:03.206229 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.206318 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.206480 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3947,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":186}
I20260709 13:01:03.178673  1661 rpcz_store.cc:276] 0709 13:01:00.436306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.759796 (+1323490us) service_pool.cc:224] Handling call
0709 13:01:01.799511 (+ 39715us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.850168 (+ 50657us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:02.235114 (+384946us) log.cc:844] Serialized 14 byte log entry
0709 13:01:02.992613 (+757499us) log.cc:844] Serialized 14 byte log entry
0709 13:01:02.992858 (+   245us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:02.992936 (+    78us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:02.993054 (+   118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.130694 (+137640us) spinlock_profiling.cc:243] Waited 50.4 ms on lock 0x7b54002e6dd4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:01:03.130745 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.130927 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48558,"prepare.queue_time_us":604589,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":100,"raft.queue_time_us":47273,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"spinlock_wait_cycles":188904576,"thread_start_us":1065836,"threads_started":3,"wal-append.queue_time_us":530946}
I20260709 13:01:03.219497  1663 raft_consensus.cc:1275] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:01:03.210814  2425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.222379  1663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1275) took 1283 ms. Trace:
W20260709 13:01:03.204227  3400 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.332s	user 0.005s	sys 0.020s
I20260709 13:01:03.224601  1663 rpcz_store.cc:276] 0709 13:01:01.939059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.178678 (+1239619us) service_pool.cc:224] Handling call
0709 13:01:03.204963 (+ 26285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.220092 (+ 15129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.222301 (+  2209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:03.213027  3546 raft_consensus.cc:2749] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:03.232564  1705 leader_election.cc:336] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.679s (SENT)
I20260709 13:01:03.233184  1705 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:01:03.234282  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:03.234761  1705 leader_election.cc:336] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.973s (SENT)
I20260709 13:01:03.235281  1705 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:03.236277  3454 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:03.237116  3454 raft_consensus.cc:2749] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:01:03.245316  1705 leader_election.cc:336] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 3.048s (SENT)
W20260709 13:01:03.245642  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 118783us
W20260709 13:01:03.246506  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.249447  3380 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:03.251976  1662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 1085) took 2199 ms. Trace:
I20260709 13:01:03.253245  3454 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:03.179313  3450 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:03.253949  3454 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:03.257706  3450 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:03.258878  1666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1276) took 1319 ms. Trace:
I20260709 13:01:03.259375  1666 rpcz_store.cc:276] 0709 13:01:01.939336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.182771 (+1243435us) service_pool.cc:224] Handling call
0709 13:01:03.205745 (+ 22974us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.258396 (+ 52651us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.258432 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:03.258511 (+    79us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:03.258556 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.258646 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.258807 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:03.262264  3557 tablet_replica.cc:333] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:01:03.262640  3363 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:03.265556  1664 raft_consensus.cc:1240] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:03.266489  1664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1268) took 1329 ms. Trace:
I20260709 13:01:03.267104  1664 rpcz_store.cc:276] 0709 13:01:01.937027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.175422 (+1238395us) service_pool.cc:224] Handling call
0709 13:01:03.211392 (+ 35970us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.266159 (+ 54767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.266415 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:03.252511  1662 rpcz_store.cc:276] 0709 13:01:01.052980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.018113 (+1965133us) service_pool.cc:224] Handling call
0709 13:01:03.018715 (+   602us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:03.019363 (+   648us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.019401 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:03.020045 (+   644us) log.cc:844] Serialized 26 byte log entry
0709 13:01:03.092733 (+ 72688us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:03.118028 (+ 25295us) log.cc:844] Serialized 14 byte log entry
0709 13:01:03.120067 (+  2039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.120136 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:03.251689 (+131553us) raft_consensus.cc:1685] finished
0709 13:01:03.251722 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.251889 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7810,"prepare.queue_time_us":25070,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":53,"raft.queue_time_us":58702,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":7510,"thread_start_us":72210,"threads_started":1,"wal-append.queue_time_us":205690}
I20260709 13:01:03.282048  3454 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:03.285817  1662 raft_consensus.cc:1240] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:03.287777  1662 raft_consensus.cc:1240] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:03.288893  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:03.289453  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:03.290640  1591 raft_consensus.cc:1240] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:03.293491  3465 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:03.293988  2996 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:03.294315  3465 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:03.307240  1732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1276) took 1751 ms. Trace:
I20260709 13:01:03.307803  1732 rpcz_store.cc:276] 0709 13:01:01.555741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.904984 (+1349243us) service_pool.cc:224] Handling call
0709 13:01:03.093530 (+188546us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.097360 (+  3830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.306967 (+209607us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b54000e6d50. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8e8ad 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:01:03.307156 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":398167296}
I20260709 13:01:03.317282  3465 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:03.322197  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 48548.1us
I20260709 13:01:03.321112  1705 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:03.324453  1738 raft_consensus.cc:1275] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:03.325345  1705 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:03.328207  1659 raft_consensus.cc:1275] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:03.328979  1659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1277) took 1389 ms. Trace:
I20260709 13:01:03.329407  1659 rpcz_store.cc:276] 0709 13:01:01.939625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.186057 (+1246432us) service_pool.cc:224] Handling call
0709 13:01:03.268851 (+ 82794us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.328695 (+ 59844us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.328915 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:03.333637  1741 raft_consensus.cc:1240] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:03.336932  1663 pending_rounds.cc:85] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 3
I20260709 13:01:03.337227  1663 pending_rounds.cc:107] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:01:03.341833  1663 raft_consensus.cc:2889] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:03.339051  1665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1281) took 1324 ms. Trace:
I20260709 13:01:03.331593  3454 raft_consensus.cc:2749] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:03.341531  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:03.348434  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:03.349833  1583 raft_consensus.cc:1275] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:03.350232  1589 raft_consensus.cc:1275] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:03.351135  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:03.351616  1583 raft_consensus.cc:1275] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:03.357438  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:03.358695  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:03.360077  1584 raft_consensus.cc:1240] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:03.333030  3450 raft_consensus.cc:2749] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:03.361486  1584 raft_consensus.cc:1240] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:03.361717  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:03.362516  1589 raft_consensus.cc:2393] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 4: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:01:03.363543  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:01:03.366101  3556 log.cc:927] Time spent T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:01:03.366359  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:01:03.366578  3550 log.cc:927] Time spent T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.264s	user 0.001s	sys 0.003s
I20260709 13:01:03.359834  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:03.344055  1662 raft_consensus.cc:1275] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:01:03.433238  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 89232us
I20260709 13:01:03.369120  3407 consensus_queue.cc:1048] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 13:01:03.456593  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:03.369644  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:01:03.381795  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.377656  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:03.367739  1738 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:01:03.343806  1665 rpcz_store.cc:276] 0709 13:01:02.014578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.251639 (+1237061us) service_pool.cc:224] Handling call
0709 13:01:03.252013 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.252385 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:03.252688 (+   303us) log.cc:844] Serialized 14 byte log entry
0709 13:01:03.333112 (+ 80424us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:03.333167 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:03.338537 (+  5370us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.338624 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.338993 (+   369us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":7478,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":6985,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":1676,"thread_start_us":78002,"threads_started":1}
I20260709 13:01:03.369994  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:03.371799  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:01:03.370446  1587 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 1187) took 2101 ms (client timeout 1910 ms). Trace:
I20260709 13:01:03.372246  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:03.432248  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:03.371222  1660 pending_rounds.cc:85] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 3
W20260709 13:01:03.419974  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 94759.4us
I20260709 13:01:03.489322  1660 pending_rounds.cc:107] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:01:03.491503  1666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1282) took 1364 ms. Trace:
I20260709 13:01:03.493847  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:03.493991  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:03.490517  1660 raft_consensus.cc:2889] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:03.496140  1735 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:03.487901  1587 rpcz_store.cc:269] 0709 13:01:01.268880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.301174 (+ 32294us) service_pool.cc:224] Handling call
0709 13:01:03.370223 (+2069049us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b54002b0554. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:01:03.370381 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4090284416}
I20260709 13:01:03.498302  1591 raft_consensus.cc:2393] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 6: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:01:03.502727  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:03.341455  3449 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:03.496990  2425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.377185  3454 consensus_queue.cc:1048] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.115s
I20260709 13:01:03.432826  1486 catalog_manager.cc:5697] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 2 to 5, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:01:03.512534  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:03.510728  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:03.374755  3450 consensus_queue.cc:1059] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.131s
I20260709 13:01:03.541465  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:03.542474  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:03.515350  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:03.545835  1592 raft_consensus.cc:2393] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 3: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
W20260709 13:01:03.546314  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 134942us
I20260709 13:01:03.546430  3537 consensus_queue.cc:1059] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:03.369628  3463 consensus_queue.cc:1048] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.142s
I20260709 13:01:03.549732  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:03.499577  3366 consensus_queue.cc:1048] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:01:03.572301  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:01:03.578107  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 71435.8us
I20260709 13:01:03.579115  1705 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
W20260709 13:01:03.594380  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 45805.7us
I20260709 13:01:03.580971  3464 raft_consensus.cc:2764] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:01:03.585816  1735 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:01:03.613576  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:03.584869  3537 consensus_queue.cc:1243] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer 6d4de2ce0683442498244b9529127f91 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:01:03.628012  1590 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 4.
W20260709 13:01:03.649736  2425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:03.655864  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.580875  3566 consensus_queue.cc:1059] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:01:03.656486  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:03.663247  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:03.665020  3474 consensus_queue.cc:1048] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:01:03.666119   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 13:01:03.669888  3570 log.cc:927] Time spent T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:01:03.670722   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:03.671260  1658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1283) took 1524 ms. Trace:
W20260709 13:01:03.671733  3569 log.cc:927] Time spent T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:01:03.671880  1658 rpcz_store.cc:276] 0709 13:01:02.147365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.264417 (+1117052us) service_pool.cc:224] Handling call
0709 13:01:03.264829 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:03.265286 (+   457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.265322 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:03.265885 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 13:01:03.491333 (+225448us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:03.491365 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.495654 (+  4289us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:03.670919 (+175265us) raft_consensus.cc:1685] finished
0709 13:01:03.670947 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.671152 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3653,"raft.run_cpu_time_us":445,"raft.run_wall_time_us":14601,"thread_start_us":224973,"threads_started":1,"wal-append.queue_time_us":310645}
I20260709 13:01:03.674793  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:03.675472  1663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1280) took 1682 ms. Trace:
I20260709 13:01:03.675916  1663 rpcz_store.cc:276] 0709 13:01:01.993047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.227274 (+1234227us) service_pool.cc:224] Handling call
0709 13:01:03.310273 (+ 82999us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:03.433642 (+123369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.433700 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:03.434269 (+   569us) log.cc:844] Serialized 26 byte log entry
0709 13:01:03.470817 (+ 36548us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:03.470864 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.470951 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:03.675217 (+204266us) raft_consensus.cc:1685] finished
0709 13:01:03.675241 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.675391 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":36191,"threads_started":1,"wal-append.queue_time_us":189389}
I20260709 13:01:03.676999  1658 raft_consensus.cc:3055] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:03.677752  1658 raft_consensus.cc:740] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:03.678210  1663 raft_consensus.cc:1275] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:03.679167  1658 consensus_queue.cc:260] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:03.681155  1658 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:03.684901  3583 consensus_queue.cc:1048] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:03.685514  1661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1278) took 1745 ms. Trace:
I20260709 13:01:03.493191  1666 rpcz_store.cc:276] 0709 13:01:02.126814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.260661 (+1133847us) service_pool.cc:224] Handling call
0709 13:01:03.269234 (+  8573us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.278302 (+  9068us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:03.332064 (+ 53762us) log.cc:844] Serialized 14 byte log entry
0709 13:01:03.491176 (+159112us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:03.491226 (+    50us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:03.491268 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.491330 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.491444 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":52125,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":2411,"raft.queue_time_us":349,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":2216,"thread_start_us":109232,"threads_started":1}
I20260709 13:01:03.686043  1661 rpcz_store.cc:276] 0709 13:01:01.939938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.222189 (+1282251us) service_pool.cc:224] Handling call
0709 13:01:03.279968 (+ 57779us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:03.305609 (+ 25641us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.305643 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:03.306203 (+   560us) log.cc:844] Serialized 26 byte log entry
0709 13:01:03.497626 (+191423us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:03.497692 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.497825 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:03.685275 (+187450us) raft_consensus.cc:1685] finished
0709 13:01:03.685294 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.685455 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1248,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":140,"thread_start_us":190888,"threads_started":1,"wal-append.queue_time_us":276996}
I20260709 13:01:03.689289  1486 catalog_manager.cc:5697] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 2 to 3, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
W20260709 13:01:03.711263  3565 log.cc:927] Time spent T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:01:03.713457  1633 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:03.714896  3487 raft_consensus.cc:3055] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:03.715337  3487 raft_consensus.cc:740] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:03.715971  1633 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:03.716809  3537 raft_consensus.cc:2749] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:03.717520  3537 raft_consensus.cc:2749] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:03.720137  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:03.720718  1739 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:03.721838  3319 raft_consensus.cc:3055] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:03.722122  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:03.722383  3319 raft_consensus.cc:740] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:03.723695  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:03.723474  3319 consensus_queue.cc:260] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:03.728401  1707 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:03.724925  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:03.724830  3319 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:03.738941  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:03.777787  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 49508.9us
I20260709 13:01:03.787601  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:03.788590  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:03.792275  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:03.792853  1661 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:03.803824  1666 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:01:03.716279  3487 consensus_queue.cc:260] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:03.820216  3487 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:03.805743  3450 raft_consensus.cc:2749] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:03.806864  1486 catalog_manager.cc:5697] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 3 to 5, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 5 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:03.857357  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.860369  1486 catalog_manager.cc:5697] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 3 to 4, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
W20260709 13:01:03.863495  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 87085.7us
W20260709 13:01:03.875460  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.879136  1667 raft_consensus.cc:1240] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:03.886498  1661 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:01:03.893208  1486 catalog_manager.cc:5697] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 5 to 6, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
W20260709 13:01:03.901851  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 322834us
I20260709 13:01:03.903254  1705 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:03.905471  3449 consensus_queue.cc:1059] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:03.905859  3450 raft_consensus.cc:2749] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:03.907395  1705 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:01:03.918251  3474 consensus_queue.cc:1048] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:03.920626  3449 raft_consensus.cc:3055] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:03.921048  3449 raft_consensus.cc:740] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:03.922097  3546 consensus_queue.cc:1059] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:03.923007  1633 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:03.923228  3546 raft_consensus.cc:3055] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:03.923669  3546 raft_consensus.cc:740] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:03.926088  3546 consensus_queue.cc:260] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:03.927786  3546 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:03.922073  3449 consensus_queue.cc:260] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:03.933108  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.933348  3537 raft_consensus.cc:2804] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:03.934065  1739 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:01:03.935649  1739 raft_consensus.cc:1275] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:03.937031  3449 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:03.937551  3324 consensus_queue.cc:1048] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:03.938009  3355 consensus_queue.cc:1059] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:03.939134  3324 consensus_queue.cc:1048] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:01:03.923621  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 384673us
W20260709 13:01:03.918282  1705 connection.cc:256] RPC call timeout handler was delayed by -1.2106221209999717s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1835s for a response
W20260709 13:01:03.951658  1705 leader_election.cc:336] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.786s (SENT)
I20260709 13:01:03.936862  1739 raft_consensus.cc:1275] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:01:03.957455  1558 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:03.958849  1705 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:01:03.958499  2425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.964521  3454 raft_consensus.cc:2749] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:03.994488  1486 catalog_manager.cc:5697] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
W20260709 13:01:04.013412  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 56063.4us
I20260709 13:01:04.016197  1659 raft_consensus.cc:1275] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:01:04.016729  1659 pending_rounds.cc:85] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 1
I20260709 13:01:04.017014  1659 pending_rounds.cc:107] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:01:04.017534  1659 raft_consensus.cc:2889] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:04.016753  1486 catalog_manager.cc:5697] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 3 to 4, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 4 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:04.028731  1558 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:01:04.029124  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 80516.9us
I20260709 13:01:04.026700  1739 raft_consensus.cc:1275] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:04.024524  3407 consensus_queue.cc:1059] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:01:04.033321  1486 catalog_manager.cc:5697] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
W20260709 13:01:04.075533  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.028573  3319 consensus_queue.cc:1059] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:01:04.045749  3463 raft_consensus.cc:3055] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:04.043326  3212 raft_consensus.cc:2804] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:01:04.111054  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.088179  3463 raft_consensus.cc:740] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:01:04.089610  3193 raft_consensus.cc:2804] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:04.126557  1660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1279) took 2133 ms. Trace:
I20260709 13:01:04.130422  1660 rpcz_store.cc:276] 0709 13:01:01.992788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.224093 (+1231305us) service_pool.cc:224] Handling call
0709 13:01:03.318685 (+ 94592us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:03.543221 (+224536us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.543266 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:03.545367 (+  2101us) log.cc:844] Serialized 26 byte log entry
0709 13:01:03.945966 (+400599us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:03.946002 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.946064 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:04.126207 (+180143us) raft_consensus.cc:1685] finished
0709 13:01:04.126236 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:04.126473 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":364524,"threads_started":1,"wal-append.queue_time_us":541910}
I20260709 13:01:04.133287  3193 raft_consensus.cc:697] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:01:04.172827  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.178985  1739 raft_consensus.cc:1275] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:04.174849  3193 consensus_queue.cc:237] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:04.184255  3578 log.cc:927] Time spent T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:01:04.176278  1486 catalog_manager.cc:5697] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:04.189538  2425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.192373  3557 raft_consensus.cc:2243] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.209864  1486 catalog_manager.cc:5697] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 2 to 3, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:01:04.214659  3557 raft_consensus.cc:2272] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:04.222692  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 285137us
I20260709 13:01:04.233639  1486 catalog_manager.cc:5697] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:01:04.236598  1741 raft_consensus.cc:1275] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:01:04.240921  1741 pending_rounds.cc:85] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 1
I20260709 13:01:04.241263  1741 pending_rounds.cc:107] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:01:04.241524  1741 raft_consensus.cc:2889] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:04.224539  3537 raft_consensus.cc:697] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 4 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:04.230376  3212 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:01:04.206676  3463 consensus_queue.cc:260] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:01:04.256451  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.240350  3450 raft_consensus.cc:2804] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:04.274724  1741 raft_consensus.cc:1275] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:04.249730  3212 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:04.300681  1664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1284) took 1904 ms. Trace:
I20260709 13:01:04.301334  1664 rpcz_store.cc:276] 0709 13:01:02.396534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.276864 (+880330us) service_pool.cc:224] Handling call
0709 13:01:03.336563 (+ 59699us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:03.343640 (+  7077us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.343669 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:03.487744 (+144075us) log.cc:844] Serialized 52 byte log entry
0709 13:01:03.951315 (+463571us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:03.951361 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.951436 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:04.300357 (+348921us) raft_consensus.cc:1685] finished
0709 13:01:04.300385 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:04.300593 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":90,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":11477,"thread_start_us":454988,"threads_started":1,"wal-append.queue_time_us":624354}
W20260709 13:01:04.307756  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 382837us
I20260709 13:01:04.326967  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:04.329402  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:04.307113  3487 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:04.335081  3587 log.cc:927] Time spent T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:01:04.330595  3324 raft_consensus.cc:3055] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:04.334817  3546 raft_consensus.cc:3055] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:01:04.336548  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 302340us
I20260709 13:01:04.336364  3450 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:01:04.363076  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 247461us
I20260709 13:01:04.342104  3464 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:04.358829  3324 raft_consensus.cc:740] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:04.316784  3537 consensus_queue.cc:237] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:04.367897  3324 consensus_queue.cc:260] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:04.360117  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 126788us
I20260709 13:01:04.374779  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:01:04.375981  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.383214  1739 raft_consensus.cc:1240] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:04.384526  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:04.385459  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:04.386613  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:04.387621  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:04.388844  1741 raft_consensus.cc:2410] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:01:04.396759  3589 log.cc:927] Time spent T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:01:04.395752  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:01:04.400460  3591 log.cc:927] Time spent T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:01:04.401957  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:04.404832  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:01:04.409394  3595 log.cc:927] Time spent T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
W20260709 13:01:04.410562  3590 log.cc:927] Time spent T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
W20260709 13:01:04.414244  3588 log.cc:927] Time spent T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:01:04.399526  1741 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 3.
W20260709 13:01:04.415867  2425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.417256  3407 consensus_queue.cc:1048] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:04.420264  3557 ts_tablet_manager.cc:1916] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:04.422482  3607 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.423030  3607 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:04.361460  3546 raft_consensus.cc:740] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:04.426502  3546 consensus_queue.cc:260] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:04.427796  3546 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:04.364686  3450 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:04.354288  3487 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:04.372189  3463 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:04.446734  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:04.439251  3324 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:04.374146  3464 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:04.452147  3449 consensus_meta.cc:287] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.514s	user 0.006s	sys 0.007s
W20260709 13:01:04.460210  3594 log.cc:927] Time spent T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:01:04.462679  3464 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:04.464277  3610 consensus_queue.cc:1048] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:04.464550  3566 raft_consensus.cc:2955] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 3 to 5, VOTER 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:04.466913  1585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 1205) took 1124 ms. Trace:
I20260709 13:01:04.469302  1585 rpcz_store.cc:276] 0709 13:01:03.342253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.342356 (+   103us) service_pool.cc:224] Handling call
0709 13:01:03.344297 (+  1941us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.344537 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:03.880243 (+535706us) log.cc:844] Serialized 14 byte log entry
0709 13:01:04.435705 (+555462us) log.cc:844] Serialized 14 byte log entry
0709 13:01:04.466517 (+ 30812us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:04.466578 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:04.466640 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:04.466712 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:04.466845 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":112767,"prepare.queue_time_us":152934,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":1441,"raft.queue_time_us":192279,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":191,"thread_start_us":940853,"threads_started":3,"wal-append.queue_time_us":475788}
W20260709 13:01:04.463166  1633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.479445  3487 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:04.480945  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:01:04.501106  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.456363  3607 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:04.517524  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 120158us
W20260709 13:01:04.529834  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.532879  1558 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:01:04.542634  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:04.543294  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.520407  3616 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:01:04.545886  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 175700us
I20260709 13:01:04.527001  3613 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.547926  1705 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:01:04.557821  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.553037  3487 raft_consensus.cc:2749] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:04.546198  3604 raft_consensus.cc:2804] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:01:04.562558  3612 log.cc:927] Time spent T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.061s	user 0.001s	sys 0.001s
W20260709 13:01:04.562955  1633 connection.cc:256] RPC call timeout handler was delayed by -1.0045918640000195s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15100000000000002s for a response
I20260709 13:01:04.569463  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:04.551824  3613 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:04.571583  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:04.572088  3613 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:04.573377  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:04.577015  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:04.551215  3212 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:04.583564  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:04.584683  1661 raft_consensus.cc:2410] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:01:04.585456  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:04.585558  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:04.586239  1661 raft_consensus.cc:2468] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:01:04.586627  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:04.587412  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:04.587980  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:04.588236  1665 raft_consensus.cc:2393] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 6: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:01:04.589244  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:04.589630  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:04.590111  1660 raft_consensus.cc:2410] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:01:04.590685  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:04.590998  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:04.591305  1665 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:01:04.591463  1633 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:01:04.591693  1660 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5.
I20260709 13:01:04.592396  3537 raft_consensus.cc:2804] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:04.592869  3537 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:04.592989  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:04.593348  3537 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:04.594076  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:04.594187  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:04.592578  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:04.594698  1666 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:01:04.595363  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:04.595755  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:04.596457  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:04.596778  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:04.597014  1663 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
W20260709 13:01:04.597198  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.597920  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:04.593259  3608 consensus_queue.cc:1048] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:04.598557  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:04.599275  1661 raft_consensus.cc:2393] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 4: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:01:04.592661  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:04.599635  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:04.593413  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:04.587462  1664 raft_consensus.cc:2393] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 5: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:01:04.601814  1659 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
W20260709 13:01:04.603147  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 55545.3us
I20260709 13:01:04.594717  1665 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:01:04.608161  1658 raft_consensus.cc:2410] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:04.601027  1660 raft_consensus.cc:2376] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4. Re-sending same reply.
I20260709 13:01:04.611218  3193 consensus_queue.cc:1048] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:04.614964  1585 raft_consensus.cc:1240] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:04.565500  3618 consensus_queue.cc:1048] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:01:04.621372  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:04.581000  3604 raft_consensus.cc:697] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:04.619704  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:04.635448  1658 raft_consensus.cc:1275] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:04.519315  3586 raft_consensus.cc:2955] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 4 to 6, VOTER 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:04.622577  1665 raft_consensus.cc:2393] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 4: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:01:04.622552  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:04.623602  1633 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:01:04.624182  3366 consensus_queue.cc:1048] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:01:04.625211  3610 consensus_queue.cc:1048] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:04.625730  3615 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.618088  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:04.626186  3620 consensus_queue.cc:1059] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:04.627187  3609 consensus_queue.cc:1059] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:01:04.566717  3616 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:04.613207  3606 log.cc:927] Time spent T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:01:04.648088  1633 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:04.648914  3624 raft_consensus.cc:2804] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:04.662720  3624 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:04.663146  3624 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:04.649214  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.665150  1587 raft_consensus.cc:2955] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, VOTER 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:04.650478  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:04.657306  1661 raft_consensus.cc:2368] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 2. Current term is 3.
I20260709 13:01:04.661558  3607 raft_consensus.cc:2749] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:04.662070  1633 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:04.669275  1663 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
W20260709 13:01:04.686543  3623 log.cc:927] Time spent T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:01:04.692448  1633 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:01:04.673507  3319 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:04.714133   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:04.699143  3607 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:04.656774  3615 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:04.734113  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 108063us
I20260709 13:01:04.732020  3607 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:04.729812  3616 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:04.751278  3212 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:04.732513  3450 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:04.726249  2554 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5.
I20260709 13:01:04.735445  1633 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:04.728751  3463 consensus_queue.cc:1059] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:01:04.775384  3546 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:04.775609  1633 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:01:04.732316  3487 consensus_queue.cc:1048] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:01:04.784435  3546 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:04.789458  1633 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:04.789764  3615 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:04.790076  3602 raft_consensus.cc:2804] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:04.784514  3624 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:04.759879  3607 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:04.782544  3319 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:04.795749  3610 consensus_queue.cc:1048] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:01:04.798981  3602 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:04.799733  3616 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:04.800478  3613 raft_consensus.cc:3055] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:04.736857  3604 consensus_queue.cc:237] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } }
I20260709 13:01:04.802181  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:01:04.806797  3450 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:01:04.818125  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 187672us
I20260709 13:01:04.794662  3546 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:04.839783  1737 raft_consensus.cc:1240] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:04.840852  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:01:04.774729  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 150972us
I20260709 13:01:04.844612  1556 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:01:04.846355  1705 leader_election.cc:336] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.665s (SENT)
I20260709 13:01:04.846978  1705 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:04.758616  3537 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:04.819044  3602 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:04.852272  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:04.858398  1738 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
W20260709 13:01:04.856081  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.822820  3613 raft_consensus.cc:740] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:04.865921  1556 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:04.819011  3319 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:04.881552  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:01:04.882465  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 93114.9us
W20260709 13:01:04.884239  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 63078.2us
W20260709 13:01:04.885008  1705 leader_election.cc:336] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.699s (SENT)
I20260709 13:01:04.885495  1705 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:04.870085  3450 raft_consensus.cc:2749] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:04.870551  3608 raft_consensus.cc:2749] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:04.879546  3566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:41902 (request call id 1) took 1915 ms. Trace:
W20260709 13:01:04.920199  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 72024.6us
W20260709 13:01:04.921169  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.928463  1633 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:01:04.928174  1740 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
W20260709 13:01:04.930739  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 64899us
W20260709 13:01:04.931114  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 46156.5us
W20260709 13:01:04.939538  1705 leader_election.cc:336] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.718s (SENT)
I20260709 13:01:04.944804  1705 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:04.928805  3619 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:04.938810  3616 raft_consensus.cc:2804] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:01:04.986775  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 58432.1us
I20260709 13:01:04.947417  3487 raft_consensus.cc:2749] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:04.975030  3624 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:04.990391  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 58555.6us
W20260709 13:01:04.994107  3637 log.cc:927] Time spent T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:01:04.995381  3614 raft_consensus.cc:3055] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:04.995826  3614 raft_consensus.cc:740] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:04.971478  3616 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:01:05.018815  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 87356.4us
W20260709 13:01:05.019506  1705 leader_election.cc:336] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.772s (SENT)
I20260709 13:01:05.027071  1705 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:05.028337  1633 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:05.025346  3616 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:05.038932  1587 raft_consensus.cc:1240] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:05.040609  3319 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:05.043843  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.997454  3644 raft_consensus.cc:2749] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:05.045457  3537 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:05.049707  3626 log.cc:927] Time spent T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.320s	user 0.004s	sys 0.000s
I20260709 13:01:05.062924  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:05.062634  1556 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:04.996670  3614 consensus_queue.cc:260] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:05.077888  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 56480.1us
I20260709 13:01:05.079687  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:05.080673  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:05.054644  3319 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:05.088141  1558 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:05.061792  2996 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.094338  1556 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:05.094929  3366 consensus_queue.cc:1059] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:05.095382  1633 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:05.081115  3579 consensus_queue.cc:1059] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.016s
W20260709 13:01:05.097815  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 105491us
W20260709 13:01:05.108724  1705 leader_election.cc:336] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.774s (SENT)
I20260709 13:01:05.059612  3647 raft_consensus.cc:2749] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:05.056147  3608 consensus_queue.cc:1048] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:01:04.895009  3566 rpcz_store.cc:276] 0709 13:01:02.956547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.957282 (+   735us) service_pool.cc:224] Handling call
0709 13:01:03.189185 (+231903us) log.cc:844] Serialized 501 byte log entry
0709 13:01:04.871305 (+1682120us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":451,"raft.queue_time_us":204,"raft.run_cpu_time_us":1427,"raft.run_wall_time_us":1428,"thread_start_us":124210,"threads_started":1,"wal-append.queue_time_us":124697,"wal-append.run_cpu_time_us":2563,"wal-append.run_wall_time_us":1002788}
I20260709 13:01:05.114871  1556 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:05.107366  3324 raft_consensus.cc:2749] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:05.120500  1633 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:05.121796  1633 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:05.122565  3624 raft_consensus.cc:2749] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:05.123039  1633 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:01:05.123340  3624 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:05.124213  3624 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:05.124825  1633 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:05.111568  3319 raft_consensus.cc:2749] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:05.113345  3603 raft_consensus.cc:3055] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:05.116158  3449 raft_consensus.cc:2749] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:05.117303  3212 raft_consensus.cc:2804] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:05.107564  2996 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:05.124778  3624 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:05.131733  3619 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:05.134462  3603 raft_consensus.cc:740] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:05.154218  3641 raft_consensus.cc:2749] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:05.154577  1474 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 161aba2b69844461b9d8ed3cdf147919 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:05.156455  1590 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5.
I20260709 13:01:05.149827  3624 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:05.142939  3212 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:05.154739  3603 consensus_queue.cc:260] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:05.174407  3603 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:05.174325  1633 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:05.176203  1633 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:05.177052  3319 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:05.177937  3319 raft_consensus.cc:2764] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:01:05.182929  1633 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:05.187404  3641 raft_consensus.cc:2804] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:05.187836  3641 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:05.188208  3641 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:05.196034  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 50361.2us
I20260709 13:01:05.207816  3609 consensus_queue.cc:1059] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:05.208330  3649 consensus_queue.cc:1048] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:05.208992  3609 raft_consensus.cc:3055] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:05.209409  3609 raft_consensus.cc:740] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:05.209625  2996 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:05.210321  3609 consensus_queue.cc:260] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:05.212499  1633 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:05.172691  3212 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:05.219231  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 68732us
W20260709 13:01:05.220065  1705 leader_election.cc:336] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.792s (SENT)
I20260709 13:01:05.225438  1705 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:05.226871  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:05.227710  1732 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
W20260709 13:01:05.256285  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.258208  1633 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:05.266031  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:05.209959  3602 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:05.267172  3641 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:05.268697  3602 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:05.269400  3602 consensus_queue.cc:1059] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:05.277228  3642 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:05.213279  3624 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:05.287537  3624 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:05.288682  1705 leader_election.cc:336] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.811s (SENT)
I20260709 13:01:05.248739  3319 raft_consensus.cc:2804] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:05.260314  3537 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:05.301254  3613 consensus_queue.cc:260] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:05.326658  1558 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:05.288403  3624 raft_consensus.cc:3055] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:01:05.329504  1705 leader_election.cc:336] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.881s (SENT)
W20260709 13:01:05.338722  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 78900.1us
I20260709 13:01:05.339442  1705 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:05.340678  1662 raft_consensus.cc:1275] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
W20260709 13:01:05.345479  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.340984  1662 pending_rounds.cc:85] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 2
I20260709 13:01:05.346946  1662 pending_rounds.cc:107] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:01:05.347210  1662 raft_consensus.cc:2889] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:05.340229  3618 raft_consensus.cc:2804] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:05.338238  3624 raft_consensus.cc:740] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:05.351769  3642 raft_consensus.cc:2749] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:05.385018  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 55530.4us
W20260709 13:01:05.386250  1705 leader_election.cc:336] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.892s (SENT)
I20260709 13:01:05.386833  1705 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:05.362164  3613 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:05.361464  3618 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.354562  3586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:41902 (request call id 2) took 2389 ms. Trace:
W20260709 13:01:05.445698  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 77690.8us
I20260709 13:01:05.368515  3557 ts_tablet_manager.cc:1929] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 13:01:05.518791  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:01:05.557928  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 101550us
I20260709 13:01:05.457301  3618 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:05.455503  3319 raft_consensus.cc:697] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 4 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:05.451530  3487 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:05.513809  3641 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:05.631140  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:05.632601  1658 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:01:05.625761  1704 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:01:05.631099  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 244883us
I20260709 13:01:05.636454  1558 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:01:05.606278  3607 consensus_meta.cc:287] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.784s	user 0.009s	sys 0.005s
W20260709 13:01:05.620467  3616 consensus_meta.cc:287] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.570s	user 0.004s	sys 0.008s
W20260709 13:01:05.639313  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 113446us
W20260709 13:01:05.639725  1705 leader_election.cc:336] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.901s (SENT)
I20260709 13:01:05.641738  1705 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:05.630203  3642 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:05.606477  3673 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:05.634249  3557 log.cc:1199] T 3f75a0ee5c184536abc81f5a366016fb P 5bb87fe07da2414e84ee578c3b176ede: Deleting WAL directory at /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-1-root/wals/3f75a0ee5c184536abc81f5a366016fb
I20260709 13:01:05.609490  3624 consensus_queue.cc:260] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:05.644941  3647 raft_consensus.cc:2804] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:05.705489  3537 raft_consensus.cc:697] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 5 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:05.645489  3616 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:05.771147  3546 consensus_meta.cc:287] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.918s	user 0.023s	sys 0.000s
I20260709 13:01:05.643640  3607 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:05.727929  3450 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:05.793663  3667 log.cc:927] Time spent T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.243s	user 0.000s	sys 0.002s
I20260709 13:01:05.794550  1659 raft_consensus.cc:1240] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:05.785946  3647 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.794123  3624 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:05.812726  1662 raft_consensus.cc:1240] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:05.819271  1659 raft_consensus.cc:1240] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 4. Current term is 5. Ops: []
W20260709 13:01:05.821744  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 186640us
W20260709 13:01:05.825465  1705 leader_election.cc:336] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.906s (SENT)
I20260709 13:01:05.832895  1659 raft_consensus.cc:1240] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:05.834431  1659 raft_consensus.cc:1240] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:05.811115  3647 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:05.835943  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 382434us
W20260709 13:01:05.844151  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 206326us
I20260709 13:01:05.854537  1558 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:05.855729  3633 raft_consensus.cc:2804] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:05.856217  3633 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.856647  3633 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:05.838493  1705 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:05.786697  3319 consensus_queue.cc:237] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:05.455921  3586 rpcz_store.cc:276] 0709 13:01:02.957013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.987596 (+ 30583us) service_pool.cc:224] Handling call
0709 13:01:03.123113 (+135517us) log.cc:844] Serialized 501 byte log entry
0709 13:01:05.341836 (+2218723us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":46468,"raft.queue_time_us":1220,"raft.run_cpu_time_us":1361,"raft.run_wall_time_us":1361,"thread_start_us":100169,"threads_started":1,"wal-append.queue_time_us":195017,"wal-append.run_cpu_time_us":1890,"wal-append.run_wall_time_us":1049413}
I20260709 13:01:05.863034  1474 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4490828942174c3c9092820cf3a81fe3 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:05.807762  3546 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:05.842095  3669 log.cc:927] Time spent T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
W20260709 13:01:05.867715  3672 log.cc:927] Time spent T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.129s	user 0.002s	sys 0.000s
W20260709 13:01:05.877462  3671 log.cc:927] Time spent T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
W20260709 13:01:05.881333  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.884387  1660 raft_consensus.cc:1240] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:05.878846  3634 raft_consensus.cc:2804] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:05.898710  1633 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
W20260709 13:01:05.881695  3212 consensus_meta.cc:287] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.655s	user 0.017s	sys 0.003s
I20260709 13:01:05.879864  3678 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.654155  3673 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:05.910269  3678 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:05.913707  3212 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:05.916574  3212 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:05.921865  3607 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:05.922361  1558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.923290  3614 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:05.923417  3670 log.cc:927] Time spent T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.282s	user 0.000s	sys 0.001s
W20260709 13:01:05.924098  3668 log.cc:927] Time spent T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da: Append to log took a long time: real 0.413s	user 0.002s	sys 0.000s
I20260709 13:01:05.924948  1737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1343) took 1084 ms. Trace:
I20260709 13:01:05.925392  1737 rpcz_store.cc:276] 0709 13:01:04.840145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.025938 (+185793us) service_pool.cc:224] Handling call
0709 13:01:05.035878 (+  9940us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:05.146822 (+110944us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:05.146850 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:05.153503 (+  6653us) log.cc:844] Serialized 26 byte log entry
0709 13:01:05.294812 (+141309us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:05.301689 (+  6877us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.301783 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:05.924689 (+622906us) raft_consensus.cc:1685] finished
0709 13:01:05.924710 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:05.924874 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4396,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":20413,"thread_start_us":188165,"threads_started":2,"wal-append.queue_time_us":200893}
I20260709 13:01:05.927161  3684 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:05.650929  3642 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:05.929366  3546 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:05.930822  3557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39130 (request call id 60) took 2899 ms. Trace:
I20260709 13:01:05.899260  3634 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.931818  3634 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:05.931245  3557 rpcz_store.cc:276] 0709 13:01:03.031762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.031998 (+   236us) service_pool.cc:224] Handling call
0709 13:01:03.261445 (+229447us) ts_tablet_manager.cc:1151] Deleting tablet 3f75a0ee5c184536abc81f5a366016fb
0709 13:01:03.261589 (+   144us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:01:04.990110 (+1728521us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:05.362358 (+372248us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:05.930731 (+568373us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":763375,"tablet-delete.queue_time_us":170128,"thread_start_us":96743,"threads_started":1}
I20260709 13:01:05.934024  1590 raft_consensus.cc:1240] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:05.938956  3566 raft_consensus.cc:3055] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:05.939451  3566 raft_consensus.cc:740] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:01:05.940508  3566 consensus_queue.cc:260] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:01:05.944031  3679 log.cc:927] Time spent T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:01:05.901145  3537 consensus_queue.cc:237] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:05.938985  1475 catalog_manager.cc:5028] TS 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): tablet 3f75a0ee5c184536abc81f5a366016fb (table test-workload [id=8a8e3153ff4e476f890a0820215f177a]) successfully deleted
I20260709 13:01:05.949025  1590 raft_consensus.cc:1240] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 4. Current term is 5. Ops: []
W20260709 13:01:05.953612  3677 log.cc:927] Time spent T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:01:05.955585  3673 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:05.957536  3464 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.957911  3616 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:05.961532  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 61671.6us
I20260709 13:01:05.958050  3464 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:05.975137  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:05.984517  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:01:05.990387  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 164986us
W20260709 13:01:05.991220  1705 leader_election.cc:336] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.916s (SENT)
I20260709 13:01:05.999322  1738 raft_consensus.cc:1275] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:01:06.000808  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:06.001353  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:06.002178  1584 raft_consensus.cc:2393] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 5: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:01:06.003197  1584 raft_consensus.cc:1240] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:06.004352  1584 raft_consensus.cc:1240] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:06.006207  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:06.007119  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:06.006781  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:06.006485  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:01:06.013878  3613 consensus_meta.cc:287] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.556s	user 0.010s	sys 0.000s
I20260709 13:01:06.005379  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:06.014046  3642 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:05.989991  3610 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.015111  3610 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:06.015549  3464 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:05.975536  3684 consensus_queue.cc:1059] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:01:06.016659  3684 raft_consensus.cc:3055] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:06.016995  3684 raft_consensus.cc:740] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:06.017355  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:06.017874  3684 consensus_queue.cc:260] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:06.019150  3684 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:06.021520  3610 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:06.005564  1583 raft_consensus.cc:1240] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:06.002002  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:06.022643  1734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1337) took 1184 ms. Trace:
I20260709 13:01:06.023250  1586 raft_consensus.cc:2410] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:06.023175  1734 rpcz_store.cc:276] 0709 13:01:04.838584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.847741 (+  9157us) service_pool.cc:224] Handling call
0709 13:01:04.863573 (+ 15832us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:05.029192 (+165619us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:05.029223 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:05.036225 (+  7002us) log.cc:844] Serialized 26 byte log entry
0709 13:01:05.250603 (+214378us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:05.250663 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.250749 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:06.022368 (+771619us) raft_consensus.cc:1685] finished
0709 13:01:06.022397 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.022573 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10042,"raft.queue_time_us":60714,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":9641,"thread_start_us":310532,"threads_started":2,"wal-append.queue_time_us":386311}
I20260709 13:01:06.005303  1663 raft_consensus.cc:1275] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:01:06.027391  1663 pending_rounds.cc:85] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 2
I20260709 13:01:06.031016  1588 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 6.
I20260709 13:01:06.043926  1663 pending_rounds.cc:107] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:01:06.044502  1663 raft_consensus.cc:2889] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:06.048543  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:06.048717  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:06.049441  1592 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5.
I20260709 13:01:06.058872  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:06.065809  1707 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:06.077250  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:06.012619  3647 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:06.080940  3319 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:06.081269  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:06.081537  3319 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:06.083491  1633 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.622s (SENT) [suppressed 32 similar messages]
I20260709 13:01:06.089581  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:06.090334  1741 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:01:06.092031  3628 consensus_queue.cc:1059] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.131s
I20260709 13:01:06.098454  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:06.100298  1741 raft_consensus.cc:1240] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 2. Current term is 3. Ops: []
W20260709 13:01:06.119854  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 128662us
I20260709 13:01:06.075763  3660 raft_consensus.cc:2804] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:01:06.120779  1705 leader_election.cc:336] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.923s (SENT)
I20260709 13:01:06.083964  3319 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:06.130326  1705 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:06.131332   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:06.122611  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:06.123031  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:06.134584  1732 raft_consensus.cc:2393] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 7: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:01:06.141522  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:06.143112  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:01:06.160512  1661 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.818s	user 0.003s	sys 0.021s
W20260709 13:01:06.160912  1661 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.003s	sys 0.021s
I20260709 13:01:06.124337  3660 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.163971  3660 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:06.170907  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:06.173653  1741 raft_consensus.cc:1275] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:06.173930  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:01:06.166038  1630 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.005s	sys 0.003s
W20260709 13:01:06.175297  1630 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.005s	sys 0.003s
I20260709 13:01:06.145567  3464 raft_consensus.cc:2749] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:06.174050  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:06.178540  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:06.180183  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:06.124423  3633 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:06.184875  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 64137.2us
I20260709 13:01:06.186836  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:06.196743  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:06.199929  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:06.200593  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:06.201399  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:01:06.202176  1704 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.003s	sys 0.007s
W20260709 13:01:06.202685  1704 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.003s	sys 0.007s
W20260709 13:01:06.203581  1705 leader_election.cc:336] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.937s (SENT)
I20260709 13:01:06.203990  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:06.204716  1737 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:06.199084  1663 raft_consensus.cc:2955] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, VOTER 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:06.207660  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:06.208036  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:06.209523  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:06.222739  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:06.195854  3614 consensus_queue.cc:1048] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:01:06.266280  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:01:06.270444  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 72782.3us
W20260709 13:01:06.272228  1705 leader_election.cc:336] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.958s (SENT)
I20260709 13:01:06.273015  1705 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:06.268160  1592 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 3.
I20260709 13:01:06.230298  3678 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:06.258260  2426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.317170  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:06.318085  1665 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:06.257704  3680 raft_consensus.cc:2804] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:01:06.321555  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 68138.5us
W20260709 13:01:06.321976  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:06.324594  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 249266us
W20260709 13:01:06.338284  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 66194us
I20260709 13:01:06.266057  3319 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
W20260709 13:01:06.344857  1705 leader_election.cc:336] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.115s (SENT)
I20260709 13:01:06.347781  1705 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:01:06.340523  2423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.354939  1661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1308) took 1024 ms. Trace:
I20260709 13:01:06.355409  1737 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 5.
I20260709 13:01:06.322698  3464 raft_consensus.cc:2749] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:06.363099  1661 rpcz_store.cc:276] 0709 13:01:05.330746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.330966 (+   220us) service_pool.cc:224] Handling call
0709 13:01:05.342130 (+ 11164us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:05.342412 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:06.164904 (+822492us) log.cc:844] Serialized 14 byte log entry
0709 13:01:06.354245 (+189341us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:06.354381 (+   136us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:06.354464 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.354602 (+   138us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.354840 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":920772,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":16104,"thread_start_us":961041,"threads_started":2}
I20260709 13:01:06.342245  3649 consensus_queue.cc:1048] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:01:06.361678  3627 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.389747  3678 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:06.428368  1633 connection.cc:256] RPC call timeout handler was delayed by -1.340138201000002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.296s for a response
W20260709 13:01:06.429342  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 90194.5us
I20260709 13:01:06.354212  3319 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:06.406160  3647 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:06.433377  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:06.413501  3324 consensus_queue.cc:1059] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:01:06.418665  3366 consensus_queue.cc:1059] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.037s
W20260709 13:01:06.473562  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 70020.2us
I20260709 13:01:06.361131  3698 raft_consensus.cc:2749] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:06.471997  3693 log.cc:927] Time spent T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 13:01:06.479869  1665 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:01:06.470979  3633 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:06.431066  3627 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:06.401787  3689 consensus_queue.cc:1059] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
W20260709 13:01:06.488973  3696 log.cc:927] Time spent T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:01:06.425679  3614 consensus_queue.cc:1059] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:01:06.454463  3678 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:06.484015  3692 log.cc:927] Time spent T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:01:06.489281  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:01:06.505275  1667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1311) took 1164 ms. Trace:
W20260709 13:01:06.496165  3688 log.cc:927] Time spent T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 13:01:06.524700  1659 pending_rounds.cc:85] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 3
I20260709 13:01:06.525126  1659 pending_rounds.cc:107] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:01:06.525444  1659 raft_consensus.cc:2889] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:06.511968  1667 rpcz_store.cc:276] 0709 13:01:05.340482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.341027 (+   545us) service_pool.cc:224] Handling call
0709 13:01:05.350540 (+  9513us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:05.777246 (+426706us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:05.777278 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:05.802800 (+ 25522us) log.cc:844] Serialized 52 byte log entry
0709 13:01:06.130209 (+327409us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:06.130255 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.130326 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:06.505030 (+374704us) raft_consensus.cc:1685] finished
0709 13:01:06.505046 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.505207 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13533,"raft.queue_time_us":430569,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":3373,"thread_start_us":655290,"threads_started":2,"wal-append.queue_time_us":497337}
I20260709 13:01:06.528173  1662 raft_consensus.cc:1240] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:06.534832  3690 consensus_queue.cc:1048] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:01:06.535964  1666 raft_consensus.cc:1240] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:06.522884  3698 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:06.490298  3604 consensus_queue.cc:1059] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:01:06.544888  1667 raft_consensus.cc:1275] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:01:06.547897  3698 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:06.549587  3366 raft_consensus.cc:3055] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:06.560171  3678 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:06.527913  2554 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:06.563907  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 73606.1us
I20260709 13:01:06.569509  1666 raft_consensus.cc:1240] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:06.556119  3319 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:06.555578  3366 raft_consensus.cc:740] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:06.556810  3627 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:06.573557  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:06.579913  3604 raft_consensus.cc:3055] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:06.583103  1667 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:06.584748  3634 consensus_meta.cc:287] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.652s	user 0.013s	sys 0.000s
I20260709 13:01:06.583151  3633 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.585165  3634 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:06.585610  1633 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:06.585893  3633 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:06.587188  3634 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:06.587245  1633 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:06.587960  3633 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:06.588291  3366 consensus_queue.cc:260] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:06.583040  3604 raft_consensus.cc:740] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:06.589722  3366 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:06.589964  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:06.590497  3537 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:06.591081  3537 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:06.592528  3678 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:01:06.593284  3678 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:06.594290  3681 raft_consensus.cc:2749] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:06.583079  3632 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.595047  3681 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:06.595351  3632 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:06.596650  3657 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.599074  3698 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:01:06.600947  3618 consensus_meta.cc:287] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.981s	user 0.009s	sys 0.007s
I20260709 13:01:06.583705  1664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1318) took 1066 ms. Trace:
W20260709 13:01:06.606938  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 149980us
I20260709 13:01:06.614557  1633 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:06.620105  1666 raft_consensus.cc:3055] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:06.620559  1666 raft_consensus.cc:740] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:06.621781  3618 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:06.623023  3632 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:06.623927  3618 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:06.590386  3604 consensus_queue.cc:260] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:06.626448  3604 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:06.628172  2554 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:01:06.630230  1704 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:01:06.631120  3698 raft_consensus.cc:2804] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:06.631625  3698 raft_consensus.cc:697] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:06.632545  3698 consensus_queue.cc:237] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:06.633993  3650 raft_consensus.cc:3055] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:06.634399  3650 raft_consensus.cc:740] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:06.611725  3537 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:06.619678  3657 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:06.617116  1664 rpcz_store.cc:276] 0709 13:01:05.516847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.516994 (+   147us) service_pool.cc:224] Handling call
0709 13:01:05.524698 (+  7704us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:05.832335 (+307637us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:05.832366 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:05.832934 (+   568us) log.cc:844] Serialized 52 byte log entry
0709 13:01:06.185329 (+352395us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:06.404827 (+219498us) log.cc:844] Serialized 14 byte log entry
0709 13:01:06.415161 (+ 10334us) log.cc:844] Serialized 14 byte log entry
0709 13:01:06.583356 (+168195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.583427 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:06.583472 (+    45us) raft_consensus.cc:1685] finished
0709 13:01:06.583484 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.583639 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":223602,"prepare.queue_time_us":403182,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":1756,"raft.queue_time_us":399493,"raft.run_cpu_time_us":483,"raft.run_wall_time_us":50093,"thread_start_us":696695,"threads_started":3,"wal-append.queue_time_us":452982}
I20260709 13:01:06.642410  1664 raft_consensus.cc:1240] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:06.619674  3683 raft_consensus.cc:2749] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:06.653036  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:06.653780  1664 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:01:06.657876  3566 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:06.661965  3613 raft_consensus.cc:3055] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:06.662431  3613 raft_consensus.cc:740] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:06.662817  3657 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:06.663236  3613 consensus_queue.cc:260] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:06.664271  3613 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:06.665941  3680 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:06.666410  3680 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:06.667343  3660 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:06.671854  3705 log.cc:927] Time spent T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.190s	user 0.001s	sys 0.002s
I20260709 13:01:06.672629  3609 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:06.673877  1666 consensus_queue.cc:260] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:06.674968  1666 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:06.674890  1667 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:01:06.678735  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:06.670825  3678 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:01:06.681385  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 351383us
I20260709 13:01:06.652104  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:06.688310  3610 raft_consensus.cc:3055] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:06.688651  3660 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:06.688783  3610 raft_consensus.cc:740] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:06.689977  3610 consensus_queue.cc:260] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:06.691185  1556 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:06.691680  3610 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:06.695647  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:01:06.696521  2553 raft_consensus.cc:2393] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 6: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
W20260709 13:01:06.698850  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.618839  1633 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:06.704583  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:01:06.705579  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 86822us
I20260709 13:01:06.705736  1658 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:01:06.709684  1633 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:06.713586  3613 raft_consensus.cc:2804] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:06.713829  3678 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:06.714349  3613 raft_consensus.cc:697] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:06.715557  3613 consensus_queue.cc:237] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:06.720319  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:06.721145  1583 raft_consensus.cc:2393] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 in current term 6: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
W20260709 13:01:06.730634  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 48229.4us
W20260709 13:01:06.733160  1705 connection.cc:256] RPC call timeout handler was delayed by -1.3283839499999885s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1653s for a response
I20260709 13:01:06.722800  3602 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:06.756091  1705 connection.cc:256] RPC call timeout handler was delayed by -1.2644839499999989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1724s for a response
I20260709 13:01:06.726449  3684 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:06.757148  1705 connection.cc:256] RPC call timeout handler was delayed by -1.1834839499999816s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1814s for a response
I20260709 13:01:06.724709  3683 consensus_queue.cc:1059] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
W20260709 13:01:06.759848  1705 connection.cc:256] RPC call timeout handler was delayed by -1.1654839500000094s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1834s for a response
I20260709 13:01:06.759245  3647 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:06.760876  3355 consensus_queue.cc:1059] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:06.763166  1633 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:06.726977  3660 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
W20260709 13:01:06.781914  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 59343.8us
I20260709 13:01:06.782979  1633 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:06.786650  1666 raft_consensus.cc:1275] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
W20260709 13:01:06.787779  1705 connection.cc:256] RPC call timeout handler was delayed by -1.1375839500000211s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1865s for a response
I20260709 13:01:06.787073  1666 pending_rounds.cc:85] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 1
I20260709 13:01:06.789336  1666 pending_rounds.cc:107] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:01:06.789690  1666 raft_consensus.cc:2889] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:06.788224  1705 connection.cc:256] RPC call timeout handler was delayed by -1.095898711000018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32620000000000005s for a response
I20260709 13:01:06.792071  1558 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:06.780130  3602 raft_consensus.cc:3055] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:06.797044  1705 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:06.759315  3615 consensus_queue.cc:1059] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:01:06.786060  3683 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:06.798127  1633 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:06.765570  3684 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:06.804801  1633 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:06.791471  3537 raft_consensus.cc:2749] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:06.807737  1705 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:01:06.785494  3647 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:06.802668  3680 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:06.811933  3647 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:06.799067  3642 raft_consensus.cc:2749] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:06.784169  3660 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:06.815393  3660 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:06.812877  3680 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:06.817144  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:06.819021  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:06.820815  1585 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 5.
I20260709 13:01:06.821885  1633 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:06.804242  3682 consensus_queue.cc:1048] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:01:06.797526  3602 raft_consensus.cc:740] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
W20260709 13:01:06.828050  3723 log.cc:927] Time spent T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:01:06.833989  3473 raft_consensus.cc:2804] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:06.834910  2996 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.836880  1705 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:01:06.801693  3681 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:06.841683  3642 raft_consensus.cc:2804] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:06.838701  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:06.842088  3642 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:06.842442  1666 raft_consensus.cc:2393] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 5: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:01:06.841976  2996 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:06.842614  3642 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:06.839483  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:06.839836  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:06.843974  1667 raft_consensus.cc:2393] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 5: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:01:06.844308  2996 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:06.844849  3473 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.845160  1705 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:06.845376  3473 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:06.846009  3647 raft_consensus.cc:2749] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:06.846786  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:06.847741  3728 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:06.848305  3728 raft_consensus.cc:697] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:06.849305  3728 consensus_queue.cc:237] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:06.850160  1735 raft_consensus.cc:1240] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:06.840674  3660 raft_consensus.cc:2804] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:06.852309  3660 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:06.852804  3660 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:06.853019  1739 raft_consensus.cc:1275] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:06.854321  3647 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:01:06.854904  3647 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:06.854084  3649 consensus_queue.cc:1059] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:06.855717  1556 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:06.856585  3649 raft_consensus.cc:3055] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:06.857021  3649 raft_consensus.cc:740] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:06.857249  3616 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:06.821727  3212 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.858350  3661 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:06.858922  3661 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.859432  3661 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:06.857998  3649 consensus_queue.cc:260] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:06.860323  3649 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:06.867230  1705 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:01:06.870759  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:06.872294  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:06.872942  1738 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:01:06.872956  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:06.865098  1556 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:06.874562  1736 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:06.875379  1556 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:06.871666  1732 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:01:06.877051  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:06.877665  1663 raft_consensus.cc:2376] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4. Re-sending same reply.
I20260709 13:01:06.878535  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:06.879631  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:06.880805  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:06.882143  1705 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:01:06.836714  3683 raft_consensus.cc:2804] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:06.894404  1658 raft_consensus.cc:1240] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:06.917550  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:06.920557  1739 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:01:06.895027  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:06.891453  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:06.922680  1666 raft_consensus.cc:2393] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 7: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:01:06.920441  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:06.892242  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:06.924966  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:06.925606  1733 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:01:06.926126  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:06.892215  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:06.929718  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:06.925673  1660 raft_consensus.cc:1240] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:01:06.938480  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:06.866761  3616 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:06.935984  3602 consensus_queue.cc:260] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:06.881814  3366 raft_consensus.cc:2804] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:06.947135  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:01:06.936126  3725 log.cc:927] Time spent T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:01:06.858865  3212 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:06.933941  3464 raft_consensus.cc:2804] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:06.961242  3464 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:06.961690  3464 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:06.965384  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:06.965651  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:06.965953  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:06.966168  1583 raft_consensus.cc:2393] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 6: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:01:06.967751  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:06.966254  1589 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:06.973574  3634 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.974181  3634 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:06.976095  3634 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:06.976621  1589 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:01:06.978313  3616 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:06.927646  3631 consensus_queue.cc:1048] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 13:01:06.983387  3678 raft_consensus.cc:2749] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:06.984927  1659 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:06.985711  3602 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:06.918936  3683 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.924888  3698 raft_consensus.cc:2804] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:06.881652  3613 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:06.949910  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:06.992041  1658 raft_consensus.cc:2368] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 5. Current term is 6.
W20260709 13:01:06.937474  3723 log.cc:927] Time spent T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:01:06.956044  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:06.956712  1661 raft_consensus.cc:2393] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 5: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:01:06.957825  3684 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:06.959069  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:06.960510  3633 raft_consensus.cc:3055] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:07.002095  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:06.942806  2996 consensus_queue.cc:1059] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:01:07.012844  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:07.013638  1589 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5.
I20260709 13:01:06.994825  1659 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:01:06.951107  3736 consensus_queue.cc:1048] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:07.001008  1660 raft_consensus.cc:2393] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 5: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:01:06.999953  3613 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.009902  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:07.016870  1739 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:01:07.022054  1707 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:06.989346  3683 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:06.990762  3698 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:07.018954  3613 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:07.001471  3633 raft_consensus.cc:740] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:07.019238  3684 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.045212  2554 raft_consensus.cc:1813] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Handling vote request from an unknown peer 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:07.063215  3603 raft_consensus.cc:3055] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:07.063635  3603 raft_consensus.cc:740] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:07.060904  2554 raft_consensus.cc:2410] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:01:07.055562  3684 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:07.067734  3684 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:07.068532  3684 raft_consensus.cc:2804] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:07.069725  3633 consensus_queue.cc:260] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:07.068302  3464 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:07.071051  3633 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:07.049817  3698 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:07.064805  3642 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:07.069021  3684 raft_consensus.cc:697] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:07.078742  3647 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:01:07.086673  1633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.092147  1633 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:07.094059  1633 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:07.082247  1558 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:07.059594  3366 raft_consensus.cc:697] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:01:07.089572  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 138607us
I20260709 13:01:07.076224  3660 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:07.072072  3658 consensus_queue.cc:1048] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:01:07.098166  1659 raft_consensus.cc:1240] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:07.100835  1665 raft_consensus.cc:1240] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:07.102157  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:07.102861  3603 consensus_queue.cc:260] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:07.104192  1660 raft_consensus.cc:1240] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:07.105887  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 83920.2us
W20260709 13:01:07.130029  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:07.105453  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 211400us
I20260709 13:01:07.131757  1705 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:07.134441  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:07.136682  1707 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:07.096840  3319 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:07.161690  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 67729.5us
I20260709 13:01:07.166977  1633 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:07.168342  1633 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:07.177536  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:07.178393  1633 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:01:07.179383  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 47721.2us
I20260709 13:01:07.180183  1705 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:07.175166  3675 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:07.182364  3650 consensus_queue.cc:260] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:07.183787  3650 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:07.184084  3473 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:07.171977  3680 raft_consensus.cc:2749] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:07.186225  1585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 769) took 1202 ms. Trace:
I20260709 13:01:07.171586  3684 consensus_queue.cc:237] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:07.186713  1585 rpcz_store.cc:276] 0709 13:01:05.984154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.984271 (+   117us) service_pool.cc:224] Handling call
0709 13:01:07.186006 (+1201735us) spinlock_profiling.cc:243] Waited 828 ms on lock 0x7b54003b3dd4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:01:07.186134 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1904900864}
I20260709 13:01:07.189788  3464 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:07.190733  3464 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:07.191355  3464 raft_consensus.cc:2749] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:07.191771  3537 raft_consensus.cc:2749] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:07.191994  3464 raft_consensus.cc:2749] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:07.132342  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:07.171790  3719 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.193500  3719 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:07.195809  3719 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:07.198529  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:07.105463  3678 consensus_queue.cc:1048] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
W20260709 13:01:07.206837  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 70369.5us
I20260709 13:01:07.165681  3603 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:07.179803  1633 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:07.212050  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:07.214713  1592 raft_consensus.cc:2393] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 5: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:01:07.215034  1633 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:07.221562  1736 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:01:07.161357  3602 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:07.230451  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:07.231380  1585 raft_consensus.cc:2368] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5.
I20260709 13:01:07.231423  1633 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:07.177639  3616 raft_consensus.cc:2749] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:07.234514  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:07.239292  1707 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:07.243044  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:07.106539  2996 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:07.246951  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:07.251015  1585 raft_consensus.cc:2410] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:01:07.227064  3537 raft_consensus.cc:2749] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:07.264312  1633 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:07.266935  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:07.284464  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:01:07.294952  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.279328  1558 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:07.303100  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:07.274497  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:07.316115  1737 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:01:07.316525  1733 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:01:07.273648  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:07.273067  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:07.234483  3680 raft_consensus.cc:2749] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:07.272498  1736 raft_consensus.cc:1240] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:07.318224  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 138144us
I20260709 13:01:07.318251  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:07.322014  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:07.323074  1740 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:07.323843  1738 raft_consensus.cc:1240] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:07.251772  3647 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:07.250569  2996 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.324911  1585 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 5.
I20260709 13:01:07.317638  1732 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:01:07.248910  3675 raft_consensus.cc:2749] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:07.263870  3464 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:01:07.333698  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:07.293970  3642 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:07.269676  3616 raft_consensus.cc:2749] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:07.336741  1705 leader_election.cc:400] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Vote denied by peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683) with higher term. Message: Invalid argument: T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 2. Current term is 3.
I20260709 13:01:07.341725  1705 leader_election.cc:403] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:07.234481  3602 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:07.338924  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:07.339614  1704 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:07.271752  3473 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:07.227288  3366 consensus_queue.cc:237] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:07.335660  2996 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:07.379817  2553 raft_consensus.cc:1275] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:07.298979  3613 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:07.382887  3613 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:07.383388  1740 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:01:07.384349  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:07.385691  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:07.367975  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:01:07.349642  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 70401us
I20260709 13:01:07.317061  1734 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:55694
I20260709 13:01:07.397923  1734 raft_consensus.cc:606] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:07.398525  1734 raft_consensus.cc:614] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:07.330868  3647 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.371771  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:07.340881  3464 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:07.385811  1589 raft_consensus.cc:2368] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 5. Current term is 6.
I20260709 13:01:07.371819  1583 raft_consensus.cc:1240] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:07.368106  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:07.387672  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:07.314574  3698 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:07.391211  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 68647.3us
I20260709 13:01:07.393774  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:07.395391  3746 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.419973  3746 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:07.424226  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:07.424906  1592 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 5.
I20260709 13:01:07.426352  2426 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:01:07.426637  3464 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:07.427382  3627 raft_consensus.cc:2804] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:07.407675  3647 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:07.427812  3627 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.428499  3627 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:07.401587  1558 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:07.332882  3683 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:07.413168  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:07.413065  3744 consensus_queue.cc:1048] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:07.387233  3684 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:07.343086  3615 raft_consensus.cc:2749] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:07.415760  3698 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:07.415778  3602 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:07.417673  3740 log.cc:927] Time spent T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:01:07.418623  1739 raft_consensus.cc:1240] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:07.427747  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:07.409153  1705 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:01:07.453477  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 44458.3us
W20260709 13:01:07.453806  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.454201  1705 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:07.454679  1664 raft_consensus.cc:1275] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:01:07.435472  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 171255us
I20260709 13:01:07.435786  1584 raft_consensus.cc:1813] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Handling vote request from an unknown peer 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:07.388674  3642 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:07.400954  1734 raft_consensus.cc:1240] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:07.442243  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:07.449168  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:07.446930  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:07.456090  1584 raft_consensus.cc:2393] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 5: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:01:07.456661  1661 raft_consensus.cc:1240] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:07.457119  1633 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:07.435379  3619 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:07.514636  3683 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:07.505597  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 51454.7us
I20260709 13:01:07.537346  1705 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:07.538246  3744 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:07.538638  1705 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:07.539621  3212 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:07.540318  1705 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:07.540937  3741 raft_consensus.cc:2749] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:07.543032  3675 raft_consensus.cc:2749] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:07.549623  3742 log.cc:927] Time spent T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:01:07.552320  1705 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:07.553187  3736 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:07.553833  3736 raft_consensus.cc:2749] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:07.555019  1705 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:07.555779  3736 raft_consensus.cc:2749] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:07.558198  1705 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:07.559332  3741 raft_consensus.cc:2749] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:07.456377  3464 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:07.437134  3746 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:07.501663  3661 consensus_meta.cc:287] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.642s	user 0.013s	sys 0.000s
I20260709 13:01:07.569504  3661 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:07.572294  3661 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:07.573153  3744 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:07.500952  3319 raft_consensus.cc:2749] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:07.587067  1663 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:01:07.487679  1732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:55694
I20260709 13:01:07.588761  1732 raft_consensus.cc:606] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:07.589231  1732 raft_consensus.cc:614] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:07.500764  1658 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:07.507632  3698 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:07.595427  3193 raft_consensus.cc:3055] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:01:07.531893  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 76738.8us
I20260709 13:01:07.596819  3741 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:07.597506  3741 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:07.599526  1556 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:07.600265  3627 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:07.605985  3736 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:07.606663  3736 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:07.607000  3647 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:07.609404  1740 raft_consensus.cc:1240] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:07.610204  3610 consensus_queue.cc:1059] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:07.595981  3193 raft_consensus.cc:740] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:07.611511  3737 raft_consensus.cc:2804] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:07.609319  1738 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:55694
I20260709 13:01:07.612625  1738 raft_consensus.cc:606] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
W20260709 13:01:07.533826  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 76813.5us
I20260709 13:01:07.621691  1633 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:07.622975  1633 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:01:07.626011  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:07.626713  1663 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:01:07.635102  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:07.635816  1663 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:07.640654  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:07.641561  1740 raft_consensus.cc:2393] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 6: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:01:07.644184  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:01:07.647817  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 89702.7us
I20260709 13:01:07.648612  1705 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:07.652316  1705 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:07.665802  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:07.666577  1588 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:07.647471  3744 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:07.673472  1488 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51168 (request call id 25) took 3960 ms. Trace:
I20260709 13:01:07.663085  3747 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:07.673936  1488 rpcz_store.cc:276] 0709 13:01:03.704150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.706632 (+  2482us) service_pool.cc:224] Handling call
0709 13:01:07.664514 (+3957882us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":621309,"reported_tablets":1}
I20260709 13:01:07.654817  3681 consensus_queue.cc:1059] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:01:07.673961  3744 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:07.676249  3681 raft_consensus.cc:3055] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:07.676817  3681 raft_consensus.cc:740] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:07.678570  3744 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:07.678350  3681 consensus_queue.cc:260] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:07.680361  3681 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:07.655047  3683 raft_consensus.cc:2804] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:07.681964  3683 raft_consensus.cc:697] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 5 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:07.683423  3683 consensus_queue.cc:237] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:07.650255  3319 raft_consensus.cc:2749] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:07.685752  1739 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:55694
I20260709 13:01:07.686386  1739 raft_consensus.cc:606] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:07.686514  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:01:07.686817  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 229417us
I20260709 13:01:07.686779  1739 raft_consensus.cc:614] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:07.687661  1558 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:07.688087  1732 raft_consensus.cc:1240] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:01:07.680932  1486 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55154 (request call id 166) took 10380 ms. Trace:
I20260709 13:01:07.694708  3735 raft_consensus.cc:2749] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:07.696020  1585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:07.696645  1585 raft_consensus.cc:606] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:07.697001  1585 raft_consensus.cc:614] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:07.698001  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:07.600638  3741 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:07.699998  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:07.655146  3602 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:07.702098  3602 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:07.705345  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:07.706238  1592 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:07.705427  3193 consensus_queue.cc:260] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:07.707562  3193 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:07.603904  3621 consensus_queue.cc:1048] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:01:07.690184  3618 raft_consensus.cc:2804] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:01:07.714450  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 62183.9us
I20260709 13:01:07.715523  1705 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:07.710397  1556 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:07.612058  3737 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.728101  1658 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:01:07.712191  3618 raft_consensus.cc:697] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:07.690462  1486 rpcz_store.cc:276] 0709 13:00:57.378875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.385037 (+  6162us) service_pool.cc:224] Handling call
0709 13:01:07.680822 (+10295785us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:04.660781 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:04.790201 (+129420us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:04.790268 (+    67us) write_op.cc:435] Acquired schema lock
0709 13:01:04.790290 (+    22us) tablet.cc:662] Decoding operations
0709 13:01:04.791749 (+  1459us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:04.791865 (+   116us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:04.791903 (+    38us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:01:04.941169 (+149266us) tablet.cc:701] Row locks acquired
0709 13:01:04.955199 (+ 14030us) write_op.cc:260] PREPARE: finished
0709 13:01:04.988298 (+ 33099us) write_op.cc:270] Start()
0709 13:01:05.030508 (+ 42210us) write_op.cc:276] Timestamp: P: 1783602064974153 usec, L: 0
0709 13:01:05.030553 (+    45us) op_driver.cc:348] REPLICATION: starting
0709 13:01:05.124204 (+ 93651us) log.cc:844] Serialized 4417 byte log entry
0709 13:01:06.454953 (+1330749us) op_driver.cc:464] REPLICATION: finished
0709 13:01:06.504456 (+ 49503us) write_op.cc:301] APPLY: starting
0709 13:01:06.504565 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:06.504831 (+   266us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:06.504966 (+   135us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:06.531636 (+ 26670us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:06.531997 (+   361us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:01:06.532043 (+    46us) write_op.cc:312] APPLY: finished
0709 13:01:06.532444 (+   401us) log.cc:844] Serialized 82 byte log entry
0709 13:01:06.532684 (+   240us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:06.532867 (+   183us) write_op.cc:454] Released schema lock
0709 13:01:06.532999 (+   132us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:06.560130 (+ 27131us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:06.560176 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":15873,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":45381,"apply.run_cpu_time_us":4316,"apply.run_wall_time_us":55606,"num_ops":11,"prepare.queue_time_us":61046,"prepare.run_cpu_time_us":18298,"prepare.run_wall_time_us":611818,"raft.queue_time_us":376430,"raft.run_cpu_time_us":24968,"raft.run_wall_time_us":101811,"replication_time_us":1387821,"thread_start_us":421317,"threads_started":4,"wal-append.queue_time_us":213728,"wal-append.run_cpu_time_us":40988,"wal-append.run_wall_time_us":2194290}]]}
I20260709 13:01:07.753463  1705 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:07.755157  1705 leader_election.cc:400] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Vote denied by peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683) with higher term. Message: Invalid argument: T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 5. Current term is 6.
I20260709 13:01:07.755554  1705 leader_election.cc:403] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:07.672551  3660 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:07.722671  3741 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:07.725570  3737 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:07.756989  1663 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:01:07.769335  1489 catalog_manager.cc:5697] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 4 to 5, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 5 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:07.772051  1489 catalog_manager.cc:5697] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:01:07.768186  1705 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:07.763263  3744 raft_consensus.cc:2749] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683) with higher term. Message: Invalid argument: T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 5. Current term is 6.
I20260709 13:01:07.661303  3675 consensus_queue.cc:1059] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.093s
W20260709 13:01:07.740649  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 203154us
I20260709 13:01:07.758837  3735 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:07.783078  1558 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:07.760773  3633 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:07.760685  3736 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:07.761623  3627 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 6 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:07.803802  1588 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 6.
I20260709 13:01:07.803879  1558 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:07.814740  1489 catalog_manager.cc:5697] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:01:07.788599  3633 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.843565  3744 raft_consensus.cc:2749] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:07.845463  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 77499.9us
I20260709 13:01:07.791414  3642 raft_consensus.cc:2749] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:07.818508  3324 raft_consensus.cc:2764] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:01:07.814321  3602 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:07.866729  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:01:07.849110  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 44134.2us
I20260709 13:01:07.846666  3650 raft_consensus.cc:2804] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:07.849843  2426 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:01:07.868257  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:07.809798  3621 consensus_queue.cc:1059] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:01:07.849558  3633 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:07.875300  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:07.865872  1489 catalog_manager.cc:5697] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 1 to 4, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:01:07.878055  1737 raft_consensus.cc:1813] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Handling vote request from an unknown peer 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:07.881758  1737 raft_consensus.cc:2410] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:01:07.846747  3736 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:07.879691  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:07.884176  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:07.884415  1489 catalog_manager.cc:5697] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 2 to 5, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:01:07.886067  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:07.853884  3684 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683) with higher term. Message: Invalid argument: T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 2. Current term is 3.
I20260709 13:01:07.883628  1592 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 4.
I20260709 13:01:07.887842  1585 raft_consensus.cc:1275] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:07.865669  3744 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:07.889925  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:07.839418  3739 consensus_queue.cc:1059] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:01:07.866587  3747 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.893540  3744 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:07.846942  3618 consensus_queue.cc:237] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:07.896960  1489 catalog_manager.cc:5697] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:01:07.901096  1734 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:07.901834  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:07.854095  2996 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:07.912774  1586 raft_consensus.cc:2368] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 5. Current term is 6.
I20260709 13:01:07.914535  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:07.915577  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:07.916338  1583 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
W20260709 13:01:07.884024  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 44755.5us
I20260709 13:01:07.930150  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:07.931241  1736 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:07.933594  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:07.922098  1556 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:07.938570  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:07.939270  1585 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5.
I20260709 13:01:07.892136  3650 raft_consensus.cc:697] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:07.920571  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:07.940368  1590 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:01:07.892256  3751 raft_consensus.cc:2804] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:07.911265  1489 catalog_manager.cc:5697] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 1 to 2, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 2 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:07.947108  1556 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:01:07.955169  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 310675us
I20260709 13:01:07.956187  1633 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:07.959003  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:07.959812  1733 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:01:07.961387  1633 leader_election.cc:400] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5.
I20260709 13:01:07.964973  1633 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:07.970284  1732 raft_consensus.cc:1240] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:07.891829  3736 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:07.942992  1489 catalog_manager.cc:5697] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:01:07.902884  3747 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:07.990456  1633 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:07.969580  3728 raft_consensus.cc:2749] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:07.969514  3602 raft_consensus.cc:2749] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:07.997540  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.978587  3751 raft_consensus.cc:697] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:01:08.001893  1736 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:01:08.003777  2996 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:08.004031  1633 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:08.007088  3736 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:08.008620  1738 raft_consensus.cc:1275] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:08.015008  1489 catalog_manager.cc:5697] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 1 to 4, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:01:08.016559  1489 catalog_manager.cc:5697] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 3 to 4, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:01:07.998370  3739 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:08.000644  3749 raft_consensus.cc:2749] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:08.027906  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 65561.5us
I20260709 13:01:07.989377  2426 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:01:08.037375  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 59296.2us
I20260709 13:01:08.040407  3751 consensus_queue.cc:237] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:08.041242  3566 raft_consensus.cc:2749] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:08.044243  3752 log.cc:927] Time spent T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:01:08.044716  3319 raft_consensus.cc:3055] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:08.045179  3319 raft_consensus.cc:740] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:08.046085  3319 consensus_queue.cc:260] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:08.047401  3319 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:08.048373  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:08.049484  1590 raft_consensus.cc:2393] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 6: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
W20260709 13:01:08.049566  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 45621.3us
I20260709 13:01:08.050688  1633 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:08.052126  3647 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:08.053262  3602 raft_consensus.cc:2749] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:08.053938  1633 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:08.055218  1633 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:08.019531  3650 consensus_queue.cc:237] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:08.064747  1734 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 4.
I20260709 13:01:08.026033  1489 catalog_manager.cc:5697] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 1 to 4, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:01:08.055490  3744 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:08.015980  3741 raft_consensus.cc:2749] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:08.017900  3661 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:08.061642  1633 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:08.075664  1633 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:08.049361  1587 raft_consensus.cc:1240] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:08.068385  1736 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:55694
I20260709 13:01:08.072194  1489 catalog_manager.cc:5697] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 2 to 4, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:01:08.078445  1633 leader_election.cc:400] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 5. Current term is 6.
I20260709 13:01:08.029858  3464 raft_consensus.cc:2749] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:08.078802  1633 leader_election.cc:403] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:01:08.077360  1736 raft_consensus.cc:606] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:08.080492  1736 raft_consensus.cc:614] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:08.060640  3683 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:08.079998  3675 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:08.088577  1633 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:08.090999  3728 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 5. Current term is 6.
I20260709 13:01:08.091758  3728 raft_consensus.cc:2804] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:08.092203  3728 raft_consensus.cc:697] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 4 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:08.080430  3749 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:08.099222  1591 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:01:08.083294  1489 catalog_manager.cc:5697] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 1 to 4, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:01:08.084573  1707 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:08.104080  1489 catalog_manager.cc:5697] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 3 to 4, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:01:08.070685  3616 raft_consensus.cc:2749] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:08.073774  3602 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:08.112198  1489 catalog_manager.cc:5697] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 5 to 6, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:01:08.114214  1489 catalog_manager.cc:5697] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:01:08.112699  1707 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:08.109701  1733 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:01:08.076795  3739 raft_consensus.cc:697] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:08.118566  1707 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:01:08.108661  3698 consensus_meta.cc:287] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.516s	user 0.007s	sys 0.004s
I20260709 13:01:08.135174   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:01:08.110251  3761 consensus_queue.cc:1048] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:01:08.117336  3464 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:08.156188   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:08.096942  3737 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:08.122586  3744 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:08.125989  3741 raft_consensus.cc:2804] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:08.128641  3698 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:08.126374  3661 raft_consensus.cc:697] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:08.140007  3324 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.169585  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:08.172621  3747 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:08.176409  3737 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:08.178406  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:08.157418  3464 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:08.163533  3741 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:08.181259  1707 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:08.182607  1664 raft_consensus.cc:2410] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:01:08.161226  3744 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:01:08.189428  3759 log.cc:927] Time spent T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:01:08.182945  3464 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:08.186236  3741 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:08.197229  3744 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:08.121982  3728 consensus_queue.cc:237] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:08.179957  3739 consensus_queue.cc:237] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:08.223274  3744 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:08.227268  3744 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:08.230775  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:08.237511  1591 raft_consensus.cc:1275] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:01:08.242475  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:08.243255  3684 consensus_queue.cc:1048] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:08.248775  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:08.249969  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:08.251091  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:08.251480  1590 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5.
I20260709 13:01:08.251828  1658 raft_consensus.cc:2393] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 6: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:01:08.252434  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:08.252537  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:08.253721  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:08.254478  1667 raft_consensus.cc:2410] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:01:08.255275  1707 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:08.255746  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:08.255995  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:08.256394  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:08.256619  1659 raft_consensus.cc:2393] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 4: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:01:08.257562  3684 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:08.258275  1659 pending_rounds.cc:85] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 2
I20260709 13:01:08.258517  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:08.258869  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:08.258291  3684 raft_consensus.cc:697] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 5 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:08.260320  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:08.261178  1666 raft_consensus.cc:2393] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 6: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:01:08.260838  3684 consensus_queue.cc:237] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:08.262136  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:08.251497  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:08.268693  3619 raft_consensus.cc:3055] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:08.269316  3619 raft_consensus.cc:740] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:08.270505  3619 consensus_queue.cc:260] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:08.258741  1659 pending_rounds.cc:107] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:01:08.271802  3735 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:08.272188  1659 raft_consensus.cc:2889] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:08.272799  1741 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:01:08.205260  3698 raft_consensus.cc:2804] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:08.274864  3698 raft_consensus.cc:697] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:08.279089  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:08.280000  1661 raft_consensus.cc:2393] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 7: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:01:08.280666  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:08.281440  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:08.281777  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:08.281462  1658 raft_consensus.cc:2393] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 5: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:01:08.282567  1667 raft_consensus.cc:2410] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:01:08.283138  1633 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:08.283349  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:08.284686  1633 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:08.289117  1665 raft_consensus.cc:1275] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:01:08.180389  3324 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:08.292124  1590 raft_consensus.cc:1275] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:08.292593  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:08.293946  1664 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:08.272269  3619 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:08.276062  3698 consensus_queue.cc:237] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:08.311326  1705 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:08.315066  1705 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:08.291906  3765 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:08.316776  1705 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:08.321861  1633 leader_election.cc:400] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 5. Current term is 6.
I20260709 13:01:08.322443  1591 raft_consensus.cc:1275] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:08.323956  1705 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:08.308231  3602 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:08.302029  3675 raft_consensus.cc:2749] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:08.329679  1705 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:08.337446  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:08.338304  1739 raft_consensus.cc:2393] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 6: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:01:08.340034  3682 raft_consensus.cc:3055] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:08.340636  3682 raft_consensus.cc:740] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:01:08.342149  3760 log.cc:927] Time spent T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.216s	user 0.002s	sys 0.000s
I20260709 13:01:08.322588  3684 raft_consensus.cc:2749] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:08.354529  1705 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:08.356529  1705 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:08.358522  1705 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:08.328707  3735 raft_consensus.cc:2749] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:08.359385  3736 raft_consensus.cc:2749] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:08.322077  3616 consensus_queue.cc:1059] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:01:08.351866  3741 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:08.359133  3647 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:08.363037  3464 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:08.363206  3682 consensus_queue.cc:260] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:08.289590  3661 consensus_queue.cc:237] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:08.371928  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:08.390019  1737 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:08.322686  3660 raft_consensus.cc:2749] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:08.394629  1739 raft_consensus.cc:1240] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:08.349171  3747 raft_consensus.cc:2749] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:08.390976  1738 raft_consensus.cc:1240] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:08.395692  1732 raft_consensus.cc:1275] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:08.374163  3642 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:08.404292  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:08.412236  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:08.414672  3675 raft_consensus.cc:3055] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:01:08.419020  3768 log.cc:927] Time spent T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:01:08.418831  3675 raft_consensus.cc:740] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:08.360129  3728 consensus_queue.cc:1048] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:01:08.426149  1733 raft_consensus.cc:1240] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:01:08.426608  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.424914  1558 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:08.400439  3735 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:08.434924  1633 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:08.437588  1584 raft_consensus.cc:1240] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:08.421054  3324 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:08.406243  3647 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:08.449887  1737 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:01:08.420552  3631 consensus_queue.cc:1059] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:01:08.429052  3682 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:08.440975  3633 consensus_meta.cc:287] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.551s	user 0.010s	sys 0.003s
I20260709 13:01:08.457751  1732 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:08.458122  3650 raft_consensus.cc:2749] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:08.462961  3741 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:08.468613  1664 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:01:08.469946  3719 raft_consensus.cc:3055] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:08.470649  3719 raft_consensus.cc:740] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:08.473941  3620 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.474723  3620 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:08.482525  3620 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:08.472078  3719 consensus_queue.cc:260] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:08.484107  1660 raft_consensus.cc:1275] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:08.421566  3366 consensus_queue.cc:1048] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:01:08.445716  3683 raft_consensus.cc:2749] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:08.497053  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:01:08.502497  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 143992us
I20260709 13:01:08.494674  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:08.504422  1658 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:01:08.508723  1705 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:08.511020  1705 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:08.517452  1705 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:08.523751  1705 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:08.522603  1556 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:08.540442  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:08.541385  1658 raft_consensus.cc:2393] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 6: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:01:08.544456  1732 raft_consensus.cc:1275] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:08.519526  3744 raft_consensus.cc:2749] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:08.545805  1737 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:08.546262  3744 raft_consensus.cc:2749] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:08.512449  3642 raft_consensus.cc:2749] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:08.488724  3633 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:08.518528  3719 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:08.518888  3741 raft_consensus.cc:2749] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:08.498950  3616 consensus_queue.cc:1048] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:01:08.487952  3647 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:08.516106  3681 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.575382  1737 raft_consensus.cc:1275] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:01:08.581341  3650 raft_consensus.cc:2804] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:08.554359  2996 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.596944  1586 raft_consensus.cc:2368] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 5. Current term is 6.
I20260709 13:01:08.537412  3736 consensus_queue.cc:1048] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:01:08.495990  3675 consensus_queue.cc:260] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:08.545833  3613 consensus_queue.cc:1048] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.055s
W20260709 13:01:08.702942  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 164305us
I20260709 13:01:08.707157  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:08.707947  1661 raft_consensus.cc:2393] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 7: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:01:08.603072  3319 consensus_queue.cc:1048] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:01:08.712915  3647 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:08.713478  3650 raft_consensus.cc:697] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:08.714429  3650 consensus_queue.cc:237] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:08.718909  1584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 810) took 1022 ms. Trace:
I20260709 13:01:08.719311  1584 rpcz_store.cc:276] 0709 13:01:07.696362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.699069 (+  2707us) service_pool.cc:224] Handling call
0709 13:01:07.699454 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:08.438188 (+738734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.718655 (+280467us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b54003921d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:01:08.718845 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1696918272}
W20260709 13:01:08.721608  3771 log.cc:927] Time spent T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:01:08.615496  3751 consensus_queue.cc:1048] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 13:01:08.605161  3681 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:08.727703  3681 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:08.616187  2996 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:08.730975  2996 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:08.707243  3464 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:08.736222  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:08.737227  1662 raft_consensus.cc:2393] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 4: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:01:08.742960  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:08.743834  1738 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:01:08.731549  3633 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:08.710175  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 96001.8us
I20260709 13:01:08.752667  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:08.753311  1734 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:08.762261  1734 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:01:08.768347  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:08.772779  1737 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 3.
W20260709 13:01:08.709154  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 109947us
I20260709 13:01:08.770509  3355 consensus_queue.cc:1048] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:08.769817  1732 raft_consensus.cc:1275] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:08.783588  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:08.798708  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:08.799678  1633 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:08.799608  1735 raft_consensus.cc:2468] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:01:08.781468  3675 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:08.772791  3765 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:08.819768  1633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.819882  1556 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:08.795133  3602 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:08.832679  1558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:08.833269  1558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.808688  3681 raft_consensus.cc:2804] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:08.825942  3684 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:01:08.843564  1740 raft_consensus.cc:2955] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, VOTER 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:08.808857  3616 consensus_queue.cc:1048] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:01:08.836992  3681 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:08.859241  3781 log.cc:927] Time spent T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.147s	user 0.003s	sys 0.000s
I20260709 13:01:08.849946  3621 raft_consensus.cc:2804] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:08.859882  3621 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.860482  3621 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:08.870886  3619 consensus_meta.cc:287] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.568s	user 0.012s	sys 0.000s
I20260709 13:01:08.871878  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:08.872653  1658 raft_consensus.cc:2468] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:01:08.873688  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:08.873984  1633 leader_election.cc:400] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 5. Current term is 6.
I20260709 13:01:08.874315  1633 leader_election.cc:403] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:01:08.878247  3735 raft_consensus.cc:2749] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:08.880744  1739 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:01:08.853722  3681 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:08.850899  3684 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:08.874320  1665 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:08.884982  3728 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.885249  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:08.885735  3728 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:08.891062  1558 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:08.891402  1735 raft_consensus.cc:1275] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:08.879122  3647 raft_consensus.cc:993] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:08.879621  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:08.834424  3602 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:08.893154  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:08.899168  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:08.899335  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:08.901357  1663 raft_consensus.cc:1275] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:08.902467  1735 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 6.
I20260709 13:01:08.884443  3782 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:08.955072  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 51378.9us
I20260709 13:01:08.958316  1586 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:01:08.958413  3621 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:08.959319  3793 log.cc:927] Time spent T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:01:08.947487  3698 raft_consensus.cc:1081] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:08.903589  3609 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:08.902388  3765 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.975776  1584 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
I20260709 13:01:08.948886  1665 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:01:08.896567  3728 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:09.014673  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 113059us
I20260709 13:01:09.019200  1584 raft_consensus.cc:1275] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:01:09.021364  1558 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:09.016387  3736 consensus_queue.cc:1048] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:01:09.025455  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:08.979270  3782 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:09.030215  3684 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:09.030741  1591 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:01:09.033640  3782 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:09.035207  3773 log.cc:927] Time spent T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.442s	user 0.000s	sys 0.003s
I20260709 13:01:09.040158  1704 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:09.037719  3650 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.041532  3650 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:09.055058  1590 raft_consensus.cc:1275] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:09.058506  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:09.059146  1590 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 3.
I20260709 13:01:09.061913  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:09.062624  1583 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 6.
I20260709 13:01:09.070745  1665 raft_consensus.cc:1275] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:01:09.071159  1665 pending_rounds.cc:85] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 2
I20260709 13:01:09.071405  1665 pending_rounds.cc:107] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:01:09.071691  1665 raft_consensus.cc:2889] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:08.984045  3609 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:09.075377  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 54129.9us
I20260709 13:01:09.078094  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:09.079921  1662 raft_consensus.cc:1275] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:09.016227  3319 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 5. Current term is 6.
I20260709 13:01:09.076233  1558 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:09.096374  1707 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:09.100658  1707 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:09.103837  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:09.088353  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:09.107008  1661 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
W20260709 13:01:09.085729  3786 log.cc:927] Time spent T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.111s	user 0.004s	sys 0.000s
I20260709 13:01:09.107547  1590 raft_consensus.cc:1275] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:09.072746  3684 raft_consensus.cc:2749] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:09.104795  1733 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:01:09.083480  3473 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:01:09.088905  3793 log.cc:927] Time spent T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:01:09.082136  3609 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:09.091049  3615 raft_consensus.cc:2804] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:09.128201  3627 consensus_queue.cc:1048] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:01:09.128599  3616 consensus_queue.cc:1048] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:01:09.132669  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:09.115775  3741 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:09.134500  3602 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:09.018543  3765 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:09.110788  3779 raft_consensus.cc:2804] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:09.135255  3615 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.172685  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:09.173458  1736 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:01:09.141314  3650 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:09.143553  3473 raft_consensus.cc:697] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:09.159273  3602 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.157188  3728 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
W20260709 13:01:09.253738  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 78593.7us
I20260709 13:01:09.170104  1663 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:01:09.154057  3684 consensus_queue.cc:1048] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 13:01:09.179905  3615 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:09.175171  3779 raft_consensus.cc:697] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:09.255484  3690 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:09.307524  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 46277us
W20260709 13:01:09.308624  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 46185.8us
I20260709 13:01:09.256422  3741 raft_consensus.cc:697] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
W20260709 13:01:09.312965  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 228146us
I20260709 13:01:09.315088  1633 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:09.321748  1662 raft_consensus.cc:1275] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:09.323750  3741 consensus_queue.cc:237] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:09.316591  3690 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:09.330863  3690 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:09.268450  3728 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:09.318764  3621 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:09.271121  3602 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:09.346052  1661 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39162
I20260709 13:01:09.368711  1661 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:09.369649  1661 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:09.342944  3619 consensus_queue.cc:1048] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:01:09.379621  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:01:09.383635  3801 log.cc:927] Time spent T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 13:01:09.389199  3795 log.cc:927] Time spent T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 13:01:09.356326  3802 consensus_queue.cc:1048] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:01:09.344794  3473 consensus_queue.cc:237] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:09.361521  3803 consensus_queue.cc:1048] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:01:09.366441  3631 consensus_queue.cc:1048] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:01:09.373755  3800 raft_consensus.cc:2804] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:09.397938  1661 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:09.404659  3675 consensus_meta.cc:287] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.586s	user 0.009s	sys 0.000s
I20260709 13:01:09.368287  3779 consensus_queue.cc:237] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:09.399304  3794 log.cc:927] Time spent T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:01:09.469785  1558 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:09.410430  1556 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:09.392762  3784 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:09.475930  3355 raft_consensus.cc:2804] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:01:09.477996  3776 log.cc:927] Time spent T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.771s	user 0.006s	sys 0.003s
W20260709 13:01:09.482029  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 360219us
I20260709 13:01:09.482252  1659 raft_consensus.cc:1275] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
W20260709 13:01:09.490155  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 79807.9us
I20260709 13:01:09.490417  1659 pending_rounds.cc:85] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 2
I20260709 13:01:09.490746  1659 pending_rounds.cc:107] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:01:09.490996  1659 raft_consensus.cc:2889] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:09.392879  3765 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:09.481874  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:01:09.474746  3681 consensus_meta.cc:287] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.593s	user 0.010s	sys 0.005s
I20260709 13:01:09.493373  1741 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 3.
I20260709 13:01:09.473162  3800 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.498755  1661 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:09.426851  3602 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:09.481737  3675 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:09.505373  3675 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:09.500240  3604 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:09.511593  3604 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.512157  3604 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:09.514701   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:09.483820  3355 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.517592  3355 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:09.492213  3784 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:09.499840  3681 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:09.539821  3609 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:09.545974  1585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 1248) took 1299 ms. Trace:
I20260709 13:01:09.550271  1585 rpcz_store.cc:276] 0709 13:01:08.246367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.247880 (+  1513us) service_pool.cc:224] Handling call
0709 13:01:08.248116 (+   236us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:08.265156 (+ 17040us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:08.265189 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:08.410386 (+145197us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b2c00000658. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7f888a11 00007f1b7f898372 00007f1b80fcaa01 00007f1b80f8f43a 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2
0709 13:01:08.421801 (+ 11415us) log.cc:844] Serialized 26 byte log entry
0709 13:01:08.541021 (+119220us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:08.541056 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.541147 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:09.476995 (+935848us) spinlock_profiling.cc:243] Waited 4.34 ms on lock 0x7b4400022b4c. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7ddc8c85 00007f1b7ddc96a2 00007f1b80b3b1db 00007f1b80b36aaf 00007f1b80b2a86e 00007f1b80b29bb6 00007f1b80b297d8 00007f1b80b33221 00007f1b80b331d9 00007f1b80b33169
0709 13:01:09.545687 (+ 68692us) raft_consensus.cc:1685] finished
0709 13:01:09.545719 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:09.545889 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"spinlock_wait_cycles":34016896,"thread_start_us":86709,"threads_started":1,"wal-append.queue_time_us":162030}
W20260709 13:01:09.547111  3805 log.cc:927] Time spent T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:01:09.487470  3728 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:09.549199  3615 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:09.500803  3800 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:09.529886  3675 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:09.556416  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 155836us
W20260709 13:01:09.558151  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 44188.2us
W20260709 13:01:09.559684  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 68644us
W20260709 13:01:09.562830  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 59878.3us
I20260709 13:01:09.566334  3615 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:09.562505  1633 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:09.568225  1586 raft_consensus.cc:1240] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:01:09.569651  3806 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.569829  3616 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:09.570205  3806 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:09.570397  3616 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:09.572507  3616 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:09.572781  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:09.574431  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:09.574687  1737 raft_consensus.cc:1275] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:09.575698  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:09.577698  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:09.578109  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:09.578819  1666 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:09.580304  1665 raft_consensus.cc:1275] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:09.585413  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:09.587167  1664 raft_consensus.cc:1240] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:09.590595  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:09.591460  1735 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 6.
I20260709 13:01:09.553269  3784 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:09.538367  3681 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:09.572680  3806 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:09.595901  1707 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:09.598582  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:09.608867  1666 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:01:09.609243  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:09.610361  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:09.611204  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:09.611578  1737 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 5.
I20260709 13:01:09.612071  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:09.612517  1737 raft_consensus.cc:2393] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 4: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:01:09.613159  3660 raft_consensus.cc:2804] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:09.613562  3660 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:09.613915  3660 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:09.615984  3796 log.cc:927] Time spent T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.365s	user 0.000s	sys 0.001s
I20260709 13:01:09.616751  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:09.617399  1741 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:09.573014  3616 raft_consensus.cc:2804] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:09.621220  3616 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.656769  1741 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 4.
I20260709 13:01:09.635087  3803 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.642818  3616 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:09.628168  3807 consensus_queue.cc:1059] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:01:09.681437   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:09.687192  3808 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.674568  3784 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.701519  3602 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.713035  3602 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:09.716068  3609 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:09.688094  3808 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:09.721889  3808 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:09.726181  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:09.729051  3604 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:09.668860  3803 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:09.733208  3604 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:09.737491  3784 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:09.744715  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:09.716575  3602 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:09.740806  3784 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:09.784798  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:09.784493  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:09.785362  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:09.785996  1590 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:09.785943  1591 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 7.
I20260709 13:01:09.787304  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:01:09.752385  3813 log.cc:927] Time spent T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:01:09.788102  1592 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 5.
I20260709 13:01:09.769779  1585 raft_consensus.cc:2955] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, VOTER 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:09.793702  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:09.803488  1738 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 6.
I20260709 13:01:09.794721  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:09.794900  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:09.805408  1589 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:09.807125  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:09.807963  1588 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 4.
I20260709 13:01:09.809827  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:09.810490  1583 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 6.
I20260709 13:01:09.810593  3803 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:09.814604  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:09.815348  1664 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:01:09.817265  1705 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:09.818269  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:09.819916  1589 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 4.
I20260709 13:01:09.824836  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:09.828946  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:09.833380  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:09.833415  1633 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:09.836735  1736 raft_consensus.cc:3055] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:09.837173  1736 raft_consensus.cc:740] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:09.841365  1633 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:09.842590  1633 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:09.843432  1633 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:09.848307  1590 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 7.
I20260709 13:01:09.853701  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:09.854394  1664 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:09.865286  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:09.866065  1667 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:09.744707  3660 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:09.878423  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 46321.8us
I20260709 13:01:09.873698  1664 raft_consensus.cc:2468] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:01:09.837962  1736 consensus_queue.cc:260] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:09.850143  3801 log.cc:927] Time spent T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:01:09.822546  3602 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:09.832643  3807 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:09.839486  3684 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:09.859644  3808 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:09.876839  3765 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:09.880600  3778 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:09.894598  3728 raft_consensus.cc:2804] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:01:09.946815  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 63993.7us
I20260709 13:01:09.901721  3807 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.968192  1667 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:01:09.913194  3808 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:10.008888  3816 log.cc:927] Time spent T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.289s	user 0.002s	sys 0.000s
I20260709 13:01:10.012759  3616 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:10.022902  3660 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:01:10.038971  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 195579us
I20260709 13:01:09.947296  3765 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:10.040158  1633 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:01:10.041966  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.910051  3602 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:09.988142  3807 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:09.972657  3728 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:09.913389  3684 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:10.052078  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 59367us
I20260709 13:01:10.055311  1633 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:10.029791  3808 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:10.065887  3833 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:10.066646  3833 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:10.068699  3675 raft_consensus.cc:2804] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:10.068876  3616 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:10.069726  3675 raft_consensus.cc:697] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 4 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:10.069950  3833 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:10.070564  3319 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:10.071225  3319 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.071830  3319 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:10.080783  3618 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.081772  1588 raft_consensus.cc:1240] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:10.081681  3618 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:10.082530  3650 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.083185  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:10.084419  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:10.086069  1586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 818) took 1032 ms. Trace:
I20260709 13:01:10.086556  1586 rpcz_store.cc:276] 0709 13:01:09.053922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.056667 (+  2745us) service_pool.cc:224] Handling call
0709 13:01:09.056997 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:09.568675 (+511678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.085779 (+517104us) spinlock_profiling.cc:243] Waited 511 ms on lock 0x7b54003b38d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:01:10.086003 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1175147392}
W20260709 13:01:10.052152  3355 consensus_meta.cc:287] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.534s	user 0.012s	sys 0.003s
W20260709 13:01:10.099977  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 43672.6us
I20260709 13:01:10.047411  3765 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:10.091419  1588 raft_consensus.cc:1275] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:10.095098  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:01:10.104696  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 49501.5us
I20260709 13:01:10.128415  1735 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:10.106348  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:10.108156  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:10.131305  1732 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:10.128684  1633 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:01:10.109344  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:10.055488  3728 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:10.148919  1734 raft_consensus.cc:1275] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:10.146850  1558 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:09.985044  3778 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } }
I20260709 13:01:10.084933  3618 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:10.155616  1633 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:10.104205  3681 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.161054  1558 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:10.057580  3690 consensus_queue.cc:1048] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.099s
I20260709 13:01:10.170234  1556 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:10.135967  3833 raft_consensus.cc:2749] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:10.171779  1633 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:10.180541  1735 raft_consensus.cc:2468] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:01:10.160528  3616 raft_consensus.cc:2804] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:10.083225  3650 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:10.182408  3738 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:10.190529  3616 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:10.197685  3616 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:10.198401  3828 log.cc:927] Time spent T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.293s	user 0.000s	sys 0.001s
I20260709 13:01:10.204591  1734 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:55694
I20260709 13:01:10.211234  1734 raft_consensus.cc:606] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:10.211845  1734 raft_consensus.cc:614] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:10.152549  3803 consensus_queue.cc:1059] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:01:10.218261  3642 consensus_queue.cc:1048] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:01:10.204479  3823 log.cc:927] Time spent T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:01:10.223605  1584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 817) took 1170 ms. Trace:
I20260709 13:01:10.214057  3660 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.227850  3660 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:10.229592  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 48758.8us
I20260709 13:01:10.232827  3817 consensus_queue.cc:1048] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:10.237172  3616 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:10.238637  1736 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:10.224162  1584 rpcz_store.cc:276] 0709 13:01:09.053620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.054318 (+   698us) service_pool.cc:224] Handling call
0709 13:01:09.749673 (+695355us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b5800002798. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7de6ab71 00007f1b7de6aeee 0000000000375939 00007f1b85ede1e0 00007f1b85fa70c4 00007f1b85fa7131 00007f1b85f68fc0 00007f1b85f53929 00007f1b85f533d2 00007f1b7f4cabd4
0709 13:01:09.749866 (+   193us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:09.750363 (+   497us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:09.750408 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:09.751036 (+   628us) log.cc:844] Serialized 26 byte log entry
0709 13:01:10.013920 (+262884us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b18003158e0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7dea23f3 00007f1b7dea47c1 00007f1b7dea4779 00007f1b7dea4709 00007f1b7dea46d1 00007f1b7dea39cd 000000000038f354 000000000038f199 00007f1b7de8583a
0709 13:01:10.223018 (+209098us) spinlock_profiling.cc:243] Waited 2.76 ms on lock 0x7b18003158e0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b80b374bc 00007f1b7de8548b 00007f1b86cdfab9 00007f1b7dea169b 00007f1b7de9f93f 00007f1b7dea1c02 00007f1b80b2920b 00007f1b80b2ed23 00007f1b80b2f0d1
0709 13:01:10.223210 (+   192us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:10.223254 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.223338 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:10.223387 (+    49us) raft_consensus.cc:1685] finished
0709 13:01:10.223401 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.223538 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38649,"raft.queue_time_us":1897,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":11415,"spinlock_wait_cycles":13965696,"thread_start_us":40571,"threads_started":1,"wal-append.queue_time_us":40644}
I20260709 13:01:10.247537  1556 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:10.253316  3604 raft_consensus.cc:2804] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:10.253722  1556 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:10.254025  3604 raft_consensus.cc:697] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:10.255772  3324 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:10.255468  3604 consensus_queue.cc:237] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:10.256606  3324 raft_consensus.cc:697] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:10.258298  3324 consensus_queue.cc:237] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:10.262935  3684 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:10.263799  3616 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:10.263968  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:10.280349  1584 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:01:10.137051  3355 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:10.266371  1736 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 7.
I20260709 13:01:10.270165  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:10.272053  1732 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:01:10.172432  3832 raft_consensus.cc:2749] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:10.165174  3610 consensus_queue.cc:1048] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:01:10.209921  3618 raft_consensus.cc:2804] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:10.310886  1707 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:10.215766  3833 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:10.319159  3833 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.267100  3619 raft_consensus.cc:2749] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:10.319679  3833 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:10.320071  3838 log.cc:927] Time spent T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:01:10.320533  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:10.321374  1738 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:01:10.327912  3355 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:10.328979  1587 raft_consensus.cc:2393] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 5: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:01:10.166098  3675 consensus_queue.cc:237] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:10.305716  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 131426us
I20260709 13:01:10.318552  3761 raft_consensus.cc:2804] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:10.343894  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:10.173130  3681 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:10.344826  1662 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:01:10.362617  1633 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:10.391305  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:10.392151  1741 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:10.299417  3804 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:10.311722  3736 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:10.354456  3797 log.cc:927] Time spent T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da: Append to log took a long time: real 0.962s	user 0.004s	sys 0.011s
I20260709 13:01:10.418059  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:10.426149  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:10.426721  1740 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:10.353502  3761 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.431739  3832 consensus_queue.cc:1059] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:10.432958  3675 raft_consensus.cc:2804] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:01:10.498606  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 55052.5us
I20260709 13:01:10.499349  3675 raft_consensus.cc:697] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 7 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:10.500639  3675 consensus_queue.cc:237] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:10.502985  3835 raft_consensus.cc:3055] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:10.503504  3835 raft_consensus.cc:740] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:10.439900  1738 raft_consensus.cc:1275] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:01:10.441430  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:10.445490  1558 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:10.455789  1740 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 6.
I20260709 13:01:10.465456  3735 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.485425  3660 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:10.341462  3618 raft_consensus.cc:697] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:01:10.509773  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 64400us
I20260709 13:01:10.389359  3747 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:10.519304  1558 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:01:10.422698  3800 consensus_meta.cc:287] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.848s	user 0.014s	sys 0.001s
I20260709 13:01:10.504592  3835 consensus_queue.cc:260] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:10.534973  3800 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:10.512894  3761 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:10.556512  3800 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:10.513377  3647 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:10.518184  3621 raft_consensus.cc:2749] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:10.566164  3657 consensus_queue.cc:1048] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:10.523586  3735 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:10.581617  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:10.582932  3650 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:10.424252  3736 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:10.600425  1741 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:01:10.602435  1558 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:10.423506  3804 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:10.561113  3602 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:10.618973  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:10.613233  3778 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:01:10.621577  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:10.622540  3631 raft_consensus.cc:2804] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:10.623284  3631 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.623795  3631 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:10.627830  1558 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:10.628984  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:10.629946  1666 raft_consensus.cc:2393] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 5: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:01:10.617290  1591 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:10.631223  1591 raft_consensus.cc:606] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:10.617399  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:10.632655  1587 raft_consensus.cc:2393] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 5: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:01:10.537145  3747 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:10.649281  1663 raft_consensus.cc:1240] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:10.650846  1660 raft_consensus.cc:1275] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:01:10.592319  3660 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:10.590564  3681 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:10.672225  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:10.681339  1660 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:01:10.592587  3647 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:10.667914  3319 consensus_meta.cc:287] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.595s	user 0.003s	sys 0.012s
I20260709 13:01:10.694537  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:10.695784  1740 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
W20260709 13:01:10.701224  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 53010.9us
W20260709 13:01:10.683993  3808 consensus_meta.cc:287] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.584s	user 0.009s	sys 0.004s
I20260709 13:01:10.665849  3803 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:10.684604  3608 raft_consensus.cc:2804] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:01:10.718982  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 352586us
I20260709 13:01:10.723512  1738 raft_consensus.cc:1240] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:01:10.671674  3722 consensus_queue.cc:1048] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:01:10.716188  3682 raft_consensus.cc:2749] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:10.683990  3660 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:10.723281  3736 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:10.739609  3803 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:10.664149  3618 consensus_queue.cc:237] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:10.701671  3833 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:10.711503  3319 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:10.722795  3808 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:10.922515  1664 raft_consensus.cc:1240] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 6. Current term is 7. Ops: []
W20260709 13:01:10.914073  3728 consensus_meta.cc:287] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.748s	user 0.007s	sys 0.007s
I20260709 13:01:10.902904  3675 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
W20260709 13:01:10.950073  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 231561us
I20260709 13:01:10.954155  1660 raft_consensus.cc:1240] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 7. Current term is 8. Ops: []
W20260709 13:01:10.954807  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:10.923115  3765 consensus_meta.cc:287] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.776s	user 0.012s	sys 0.003s
I20260709 13:01:10.954216  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:10.957475  1663 raft_consensus.cc:2368] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 4. Current term is 5.
I20260709 13:01:10.957959  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:01:10.958979  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.960223  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:01:10.946697  3807 consensus_meta.cc:287] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.870s	user 0.013s	sys 0.002s
I20260709 13:01:10.991638  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:11.009344  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:11.009348  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:11.010572  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:11.011096  1737 raft_consensus.cc:1275] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:11.006283  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:11.013458  1664 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:01:11.014957  1705 leader_election.cc:400] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Vote denied by peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683) with higher term. Message: Invalid argument: T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 4. Current term is 5.
I20260709 13:01:11.015312  1705 leader_election.cc:403] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:01:11.020773  1633 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:10.985970  3608 raft_consensus.cc:697] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:10.947358  3728 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:11.027340  1633 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:01:10.954039  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 184194us
I20260709 13:01:10.958757  3675 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:10.961287  3765 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:11.021386  3849 log.cc:927] Time spent T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.408s	user 0.002s	sys 0.000s
I20260709 13:01:11.092468  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:11.098726  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:11.103022  1662 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:01:11.029452  3800 raft_consensus.cc:2804] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:11.104241  1587 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:01:10.986716  3807 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:11.107462  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:11.108481  3675 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:11.017450  3779 consensus_queue.cc:1059] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 13:01:11.109448  1659 raft_consensus.cc:1240] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:11.128520  1667 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.009s	sys 0.013s
W20260709 13:01:11.130573  1667 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.009s	sys 0.013s
I20260709 13:01:11.090009  3736 raft_consensus.cc:2749] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683) with higher term. Message: Invalid argument: T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 4. Current term is 5.
I20260709 13:01:11.133122  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:01:11.106261  3843 log.cc:927] Time spent T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
W20260709 13:01:11.112521  3604 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.008s	sys 0.007s
I20260709 13:01:11.105338  3602 raft_consensus.cc:2749] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:11.157203  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 205236us
I20260709 13:01:11.161384  1735 raft_consensus.cc:1240] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:11.163515  1586 raft_consensus.cc:2393] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 7: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
W20260709 13:01:11.157203  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 142389us
I20260709 13:01:11.128887  3800 raft_consensus.cc:697] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:11.167352  1705 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:11.135154  3804 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:01:11.156847  3604 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.008s	sys 0.007s
I20260709 13:01:11.183660  3779 raft_consensus.cc:2749] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:11.172574  3660 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:11.136687  3803 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:11.188170  1586 raft_consensus.cc:1275] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:11.161445  3747 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:01:11.162981  3838 log.cc:927] Time spent T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:01:11.190908  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 163658us
I20260709 13:01:11.202257  3735 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:11.198580  3602 consensus_queue.cc:1048] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:11.205482  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:11.205626  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:01:11.207890  3860 log.cc:927] Time spent T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:01:11.188133  3808 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:11.210659  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:11.211203  1737 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:11.209093  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:11.209494  1705 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:11.213517  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:11.213737  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:11.214784  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:11.217839  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:11.197242  3319 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:11.227793  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:11.228819  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:11.231178  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:11.160017  3608 consensus_queue.cc:237] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:11.258625  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:11.219549  3803 raft_consensus.cc:2804] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:11.218055  3804 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:11.266695  1737 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 7.
I20260709 13:01:11.267941  1633 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:11.280741  3804 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:11.284590  3804 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:11.281997  3319 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:01:11.287639  3848 log.cc:927] Time spent T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.420s	user 0.004s	sys 0.000s
I20260709 13:01:11.287864  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:11.293622  3807 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:11.264726  3355 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.294720  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:11.294827  3355 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:11.295913  1663 raft_consensus.cc:2393] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 7: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:01:11.293612  3647 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:01:11.269577  3854 log.cc:927] Time spent T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 13:01:11.338864  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:01:11.340407  3858 log.cc:927] Time spent T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 13:01:11.265105  3803 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:11.324023  3871 log.cc:927] Time spent T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
W20260709 13:01:11.338524  3863 log.cc:927] Time spent T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:01:11.345288  3835 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:11.346161  3803 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:11.344563  3852 log.cc:927] Time spent T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 13:01:11.336004  3861 log.cc:927] Time spent T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:01:11.348840  1585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46836 (request call id 68) took 1646 ms. Trace:
I20260709 13:01:11.350394  1735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 1547) took 1164 ms. Trace:
I20260709 13:01:11.349278  1585 rpcz_store.cc:276] 0709 13:01:09.702272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.702539 (+   267us) service_pool.cc:224] Handling call
0709 13:01:09.703000 (+   461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:09.769600 (+ 66600us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:09.845550 (+ 75950us) log.cc:844] Serialized 14 byte log entry
0709 13:01:10.526718 (+681168us) spinlock_profiling.cc:243] Waited 7.59 ms on lock 0x7b18001a9920. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7de84e07 00007f1b86cdfab9 00007f1b7dea169b 00007f1b7de9f93f 00007f1b7dea1c02 00007f1b80b2920b 00007f1b80b2ed23 00007f1b80b2f23a 00007f1b80f99a2a
0709 13:01:10.712749 (+186031us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:10.713266 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 13:01:10.713494 (+   228us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:10.713541 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.990433 (+276892us) spinlock_profiling.cc:243] Waited 49 ms on lock 0x7b54003cfd54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:01:10.990487 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:11.348592 (+358105us) raft_consensus.cc:1685] finished
0709 13:01:11.348616 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:11.348776 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":286763,"raft.queue_time_us":44143,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":30670,"spinlock_wait_cycles":130223104,"thread_start_us":175462,"threads_started":1,"wal-append.queue_time_us":1366845}
I20260709 13:01:11.350835  1735 rpcz_store.cc:276] 0709 13:01:10.185951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.186140 (+   189us) service_pool.cc:224] Handling call
0709 13:01:10.186526 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:11.162457 (+975931us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:11.350180 (+187723us) spinlock_profiling.cc:243] Waited 952 ms on lock 0x7b54004394d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:01:11.350334 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2189604224}
I20260709 13:01:11.352903  3681 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:11.324474  3319 raft_consensus.cc:697] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 7 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:11.353482  3681 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:11.354218  3855 log.cc:927] Time spent T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.285s	user 0.001s	sys 0.000s
I20260709 13:01:11.354030  3319 consensus_queue.cc:237] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:11.355255  3675 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:11.355938  3675 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:11.356907  3834 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.227207  3800 consensus_queue.cc:237] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:11.358083  3802 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:11.358867  3802 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:11.359938  3765 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:11.362172  1667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 1513) took 1013 ms. Trace:
I20260709 13:01:11.357694  3834 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:11.362720  1667 rpcz_store.cc:276] 0709 13:01:10.348675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.350021 (+  1346us) service_pool.cc:224] Handling call
0709 13:01:10.350330 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:10.354607 (+  4277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:10.354655 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:10.367380 (+ 12725us) log.cc:844] Serialized 26 byte log entry
0709 13:01:11.136983 (+769603us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:11.165213 (+ 28230us) log.cc:844] Serialized 14 byte log entry
0709 13:01:11.165428 (+   215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:11.165506 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:11.292380 (+126874us) spinlock_profiling.cc:243] Waited 3.47 ms on lock 0x7b18001001e0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7dea23f3 00007f1b7dea47c1 00007f1b7dea4779 00007f1b7dea4709 00007f1b7dea46d1 00007f1b7dea39cd 000000000038f354 000000000038f199 00007f1b7de8583a
0709 13:01:11.361750 (+ 69370us) raft_consensus.cc:1685] finished
0709 13:01:11.361902 (+   152us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:11.362088 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59902,"prepare.queue_time_us":35082,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":11561,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":42056,"spinlock_wait_cycles":7992448,"thread_start_us":769252,"threads_started":1,"wal-append.queue_time_us":884234}
W20260709 13:01:11.372576  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 103761us
I20260709 13:01:11.342037  3355 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:11.341897  3728 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:11.385320  3866 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.386026  3866 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:11.389061  3866 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:11.389643  1667 raft_consensus.cc:1240] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:11.393549  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:01:11.394891  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 108674us
I20260709 13:01:11.399869  1558 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:11.406229  3687 raft_consensus.cc:2804] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:11.414984  3834 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:11.415781  3675 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:11.416983  2996 consensus_queue.cc:1059] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:11.417908  3608 raft_consensus.cc:3055] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:11.420626  3608 raft_consensus.cc:740] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:11.422655  3608 consensus_queue.cc:260] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:11.406857  3687 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.430373  3681 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:11.430637  3687 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:11.436555  3833 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:11.424988  3608 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:11.447783  1707 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:11.450448  1707 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:11.457793  1707 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:11.456954  3642 raft_consensus.cc:2749] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:11.461666  3779 consensus_queue.cc:1048] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:11.437934  3464 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:01:11.472438  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 96500.9us
I20260709 13:01:11.465237  3784 raft_consensus.cc:993] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:11.473359  1707 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:01:11.470388  3631 consensus_meta.cc:287] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.846s	user 0.012s	sys 0.005s
I20260709 13:01:11.477746  3833 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:11.477905  3631 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:11.478431  3833 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:11.480710  3833 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:11.483484  3642 raft_consensus.cc:2749] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:11.469113  3802 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:11.474900  3761 consensus_meta.cc:287] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.883s	user 0.013s	sys 0.008s
W20260709 13:01:11.488778  3864 log.cc:927] Time spent T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.287s	user 0.001s	sys 0.001s
I20260709 13:01:11.455792  3866 raft_consensus.cc:2749] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:11.481395  3631 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:11.492861  3784 raft_consensus.cc:1081] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:11.473225  3804 raft_consensus.cc:2749] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:11.496884  3761 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:11.506685  1733 raft_consensus.cc:2368] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5.
I20260709 13:01:11.508530  3761 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:11.519609  1707 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:11.518445  1741 raft_consensus.cc:1275] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:11.518865  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:11.520306  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:11.527444  1735 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:11.474359  3464 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:11.525830  3866 raft_consensus.cc:2749] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:11.501719  3604 consensus_queue.cc:1059] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:01:11.531773  3832 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:11.537925  1633 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:11.540023  1735 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:01:11.544011  1633 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:11.511396  3778 raft_consensus.cc:3055] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:11.545749  3778 raft_consensus.cc:740] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:11.545929  3602 raft_consensus.cc:2749] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:11.546713  3778 consensus_queue.cc:260] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:11.517356  3800 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:11.504662  3782 consensus_queue.cc:1048] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:01:11.548728  3661 raft_consensus.cc:3055] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:11.548943  3615 consensus_queue.cc:1059] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:01:11.553962  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:11.554462  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:11.562045  1665 raft_consensus.cc:1275] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:11.562347  1586 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:01:11.549634  1735 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:55694
I20260709 13:01:11.556788  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:11.563206  1664 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
I20260709 13:01:11.547812  3778 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:11.559796  3661 raft_consensus.cc:740] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:11.558686  3832 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:11.570152  3832 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:11.556291  3602 raft_consensus.cc:2749] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:11.577301  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:11.578007  1584 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:11.559722  3800 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:11.586223  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:11.589396  1667 raft_consensus.cc:2393] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 7: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:01:11.595070  1558 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:11.516155  3803 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:11.594053  3827 consensus_queue.cc:1048] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:11.584374  3661 consensus_queue.cc:260] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:11.601681  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:01:11.603111  3859 log.cc:927] Time spent T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.393s	user 0.000s	sys 0.003s
I20260709 13:01:11.592962  3464 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:11.605309  3747 consensus_queue.cc:1059] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:11.606489  3747 raft_consensus.cc:3055] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:11.606917  3747 raft_consensus.cc:740] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:11.608078  3747 consensus_queue.cc:260] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:11.612594  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:11.612908  3631 raft_consensus.cc:2804] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:11.613277  1660 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:01:11.613677  3631 raft_consensus.cc:697] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:11.614419  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:11.614861  3631 consensus_queue.cc:237] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:11.616647  1741 raft_consensus.cc:1275] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:11.618772  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:11.619881  1662 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39146
I20260709 13:01:11.620431  1662 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:11.620249  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:11.620759  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:11.621563  1733 raft_consensus.cc:2393] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 7: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:01:11.620949  1662 raft_consensus.cc:3060] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:11.620247  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:11.563444  1735 raft_consensus.cc:606] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:11.629355  1735 raft_consensus.cc:614] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:11.632244  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:11.638095  3747 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:11.639043  1738 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:55694
I20260709 13:01:11.639798  1738 raft_consensus.cc:606] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:11.640535  3803 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:11.644224  1736 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:55694
I20260709 13:01:11.644802  1736 raft_consensus.cc:606] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:11.646169  1736 raft_consensus.cc:614] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:11.648936  1486 catalog_manager.cc:5697] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: config changed from index 4 to 6, VOTER 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) evicted. New cstate: current_term: 4 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:11.651685  1664 raft_consensus.cc:1240] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:01:11.653834  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:11.654618  1667 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:11.656802  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:11.656955  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:11.652240  1584 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5.
I20260709 13:01:11.659937  1660 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:01:11.668475  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:11.669160  1664 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:11.670110  1633 leader_election.cc:400] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5.
I20260709 13:01:11.670580  1633 leader_election.cc:403] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:01:11.677794  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:11.678920  1660 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:01:11.667224  1486 catalog_manager.cc:5697] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: config changed from index 3 to 5, term changed from 4 to 6, VOTER 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) evicted. New cstate: current_term: 6 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:11.685312  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 48850.1us
I20260709 13:01:11.684361  1705 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:01:11.687242  3800 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:11.700133  1667 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5.
I20260709 13:01:11.706449  1733 raft_consensus.cc:1240] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:01:11.707149  1705 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:11.690032  1707 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:11.709424  1707 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:11.709355  1705 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:11.710602  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:11.718097  1707 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:11.716969  3661 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:11.721987  1733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:55694
I20260709 13:01:11.722872  1733 raft_consensus.cc:606] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:11.723281  1733 raft_consensus.cc:614] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:11.702497  3832 raft_consensus.cc:2749] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5.
I20260709 13:01:11.727810  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:11.683965  3833 consensus_queue.cc:1048] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:01:11.726084  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:11.726495  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:11.730065  1585 raft_consensus.cc:1275] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:11.689779  3778 consensus_queue.cc:1059] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:01:11.714068  3807 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:11.717576  3804 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:11.741443  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:11.741904  1583 raft_consensus.cc:1275] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:11.742611  1664 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
I20260709 13:01:11.720889  3866 raft_consensus.cc:2749] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:11.746316  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:11.746745   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:01:11.725159  3660 raft_consensus.cc:2749] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:11.753425  1486 catalog_manager.cc:5697] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 4 to 6, leader changed from 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 6 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:11.754980   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:11.758901  1705 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:11.760622  3761 raft_consensus.cc:2804] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:01:11.761729  3878 log.cc:927] Time spent T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:01:11.743459  3803 raft_consensus.cc:2804] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:11.762848  3803 raft_consensus.cc:697] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 5 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:11.741981  3804 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:11.769327  3804 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:11.774102  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:11.775831  3761 raft_consensus.cc:697] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:11.785508  3642 raft_consensus.cc:3055] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:11.786118  3642 raft_consensus.cc:740] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:11.787271  3642 consensus_queue.cc:260] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:11.790473  3761 consensus_queue.cc:237] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:11.764393  3803 consensus_queue.cc:237] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:11.740195  3807 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:11.813602  3602 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:11.814067  3807 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:11.814558  3602 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:11.817711  3833 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:11.818444  3833 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:11.819504  3832 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:11.847651  3835 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:11.848718  3800 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:11.849259  3800 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:11.848251  3835 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:11.851104  3802 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:11.851856  3802 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:11.856297  3681 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:11.856974  3835 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:11.857362  3681 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:11.866537  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:11.875802  1662 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:11.820307  3832 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:11.788830  3642 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:11.885179  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:11.893654  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:11.898747  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:11.902431  1738 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:11.907706  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:11.908443  1583 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:11.888816  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:11.910522  1587 raft_consensus.cc:2368] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5.
I20260709 13:01:11.912961  3681 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:11.884253  3687 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:11.918840  3602 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:11.920490  3687 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:11.917757  3800 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:11.923034  1585 raft_consensus.cc:2393] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 7: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:01:11.928334  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:11.934017  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:11.937412  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:01:11.957841  1489 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55138 (request call id 175) took 13086 ms (client timeout 15000 ms). Trace:
I20260709 13:01:11.929108  3779 raft_consensus.cc:2804] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:11.965911  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:11.969751  1662 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:11.951532  3649 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.001016  3833 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:12.001613  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:11.957732  3778 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.005797  3778 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:11.995204  3602 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:12.009634  3602 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:12.008780  3778 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:12.019435  1583 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 7.
I20260709 13:01:12.042960  3802 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:12.050418  3608 consensus_meta.cc:287] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.608s	user 0.010s	sys 0.006s
I20260709 13:01:12.012733  3602 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:12.065315  1738 raft_consensus.cc:1275] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:12.073746  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:12.077674  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:12.084627  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:12.063411  3647 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
W20260709 13:01:11.958386  1489 rpcz_store.cc:269] 0709 13:00:58.871443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.871692 (+   249us) service_pool.cc:224] Handling call
0709 13:01:00.009541 (+1137849us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b5400119254. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef9090 00007f1b80f97f3a 00007f1b86d4e1cc 00007f1b86e4c37e 00007f1b8530d2a4 00007f1b8530d232 00007f1b8530d161 00007f1b8530d0dc 00007f1b8530c392 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:01:11.957771 (+11948230us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:08.313395 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:08.333417 (+ 20022us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:08.333473 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:01:08.333492 (+    19us) tablet.cc:662] Decoding operations
0709 13:01:08.335112 (+  1620us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:08.335213 (+   101us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:08.335248 (+    35us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:01:08.477877 (+142629us) tablet.cc:701] Row locks acquired
0709 13:01:08.477921 (+    44us) write_op.cc:260] PREPARE: finished
0709 13:01:08.478182 (+   261us) write_op.cc:270] Start()
0709 13:01:08.478396 (+   214us) write_op.cc:276] Timestamp: P: 1783602068478098 usec, L: 0
0709 13:01:08.478443 (+    47us) op_driver.cc:348] REPLICATION: starting
0709 13:01:08.609975 (+131532us) log.cc:844] Serialized 6361 byte log entry
0709 13:01:09.036443 (+426468us) spinlock_profiling.cc:243] Waited 60.3 ms on lock 0x7b4400022b4c. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7ddc8c85 00007f1b7ddc96a2 00007f1b80b3b1db 00007f1b80b36aaf 00007f1b7de850ac 00007f1b86cdfab9 00007f1b7dea169b 00007f1b7de9f93f 00007f1b7dea1c02 00007f1b80b2920b
0709 13:01:09.530685 (+494242us) spinlock_profiling.cc:243] Waited 9.33 ms on lock 0x7b5400119254. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8ae28 00007f1b849c5581 00007f1b849c4d58 00007f1b849c99f1 00007f1b849c99a9 00007f1b849c9939 00007f1b849c9901 00007f1b849c8b2d 000000000038f354 000000000038f199
0709 13:01:10.255669 (+724984us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b4400022b4c. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7ddc8c85 00007f1b7ddc96a2 00007f1b80b3b1db 00007f1b80b36aaf 00007f1b80b2a86e 00007f1b80b29bb6 00007f1b80b297d8 00007f1b80b33221 00007f1b80b331d9 00007f1b80b33169
0709 13:01:11.216294 (+960625us) op_driver.cc:464] REPLICATION: finished
0709 13:01:11.426582 (+210288us) write_op.cc:301] APPLY: starting
0709 13:01:11.426753 (+   171us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:11.427202 (+   449us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:11.427237 (+    35us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:11.432259 (+  5022us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:11.432880 (+   621us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 13:01:11.432978 (+    98us) write_op.cc:312] APPLY: finished
0709 13:01:11.477457 (+ 44479us) log.cc:844] Serialized 112 byte log entry
0709 13:01:11.485016 (+  7559us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:11.485196 (+   180us) write_op.cc:454] Released schema lock
0709 13:01:11.485258 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:11.505369 (+ 20111us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:11.509910 (+  4541us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":26874,"reported_tablets":35,"spinlock_wait_cycles":243894656,"child_traces":[["op",{"apply.queue_time_us":175489,"apply.run_cpu_time_us":6589,"apply.run_wall_time_us":79151,"num_ops":16,"prepare.queue_time_us":30404,"prepare.run_cpu_time_us":109404,"prepare.run_wall_time_us":1252687,"raft.queue_time_us":511371,"raft.run_cpu_time_us":20324,"raft.run_wall_time_us":250662,"replication_time_us":2680501,"spinlock_wait_cycles":163783552,"thread_start_us":868730,"threads_started":4,"wal-append.queue_time_us":703278}]]}
I20260709 13:01:12.053745  3649 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:12.099769  3802 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.107848  1591 raft_consensus.cc:2410] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:01:12.111227  3649 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:12.112722  3832 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:12.094537  3647 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:12.107818  3802 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:12.137719  3800 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:12.165962  3800 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:12.168488  3800 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:12.139277  3833 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:12.169806  3833 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:12.139400  3602 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:12.174013  3602 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:12.176606  3602 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:12.177418  3800 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:12.172946  3833 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:12.147614  3681 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:12.152009  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:12.154062  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:12.200161  3681 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:12.202108  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:12.202373  3681 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:12.203140  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:12.203424  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:12.204430  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:12.204430  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:12.205879  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:12.179339  3835 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:12.206552  3835 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:12.208485  3835 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:12.208910  3835 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:12.209370  3835 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:12.210296  3658 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.210824  3658 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:12.212728  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:12.162528  1592 raft_consensus.cc:1275] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:01:12.162911  1583 raft_consensus.cc:1275] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:12.162890  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:12.156623  3647 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:12.156034  3802 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:12.163265  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:12.215286  1741 raft_consensus.cc:1275] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:12.189070  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:12.190168  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:12.205581  3804 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:12.212852  3658 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:12.217597  1735 raft_consensus.cc:1240] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:12.218397  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:12.129014  3807 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:12.218793  3804 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:12.220369  3807 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:12.220513  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:12.221180  3835 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:12.221782  1589 raft_consensus.cc:3055] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:12.222107  1589 raft_consensus.cc:740] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:01:12.143116  3747 consensus_meta.cc:287] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.504s	user 0.011s	sys 0.002s
I20260709 13:01:12.216748  1587 raft_consensus.cc:2410] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:01:12.222798  1589 consensus_queue.cc:260] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:12.224227  1589 raft_consensus.cc:3060] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:12.225533  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:12.229317  1633 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:12.230397  1660 raft_consensus.cc:1275] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:01:12.230577  1633 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:12.232000  1707 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:12.232753  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:12.233201  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:12.234687  1633 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:12.236662  1633 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:12.237339  3802 raft_consensus.cc:2749] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:12.240257  3832 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:12.240370  3802 consensus_queue.cc:1048] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:12.240949  3832 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:12.237855  3835 raft_consensus.cc:2749] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:12.238323  3681 consensus_queue.cc:1048] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:12.242769  1633 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:12.243757  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:12.243959  1633 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:12.244577  3747 raft_consensus.cc:2749] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:12.233955  1586 raft_consensus.cc:2393] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 7: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:01:12.245237  3602 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:12.245980  3602 raft_consensus.cc:2749] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:12.247397  1665 raft_consensus.cc:1240] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:12.249255  1741 raft_consensus.cc:1275] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:12.250078  1633 leader_election.cc:400] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5.
I20260709 13:01:12.251422  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:12.252650  1741 raft_consensus.cc:2410] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:01:12.254278  1589 raft_consensus.cc:2468] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:01:12.200243  3800 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:12.262840  3800 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:12.264894  1633 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:12.266921  1633 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:12.267491  3602 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:12.271852  3660 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.272403  3660 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:12.273391  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:12.274387  1661 raft_consensus.cc:2393] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 7: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:01:12.275315  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:12.276525  3779 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:12.276955  1661 raft_consensus.cc:1275] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:12.278142  3779 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:12.278271  1661 raft_consensus.cc:1275] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:12.292418  3660 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:12.296183  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:12.297276  3604 consensus_queue.cc:1048] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:12.300258  1664 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
I20260709 13:01:12.302242  1665 raft_consensus.cc:1275] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:12.303385  3687 consensus_queue.cc:1048] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:12.317070  1707 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:12.310262  3681 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:12.311678  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 44870.4us
I20260709 13:01:12.319514  1633 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:12.319578  3747 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:12.308972  3779 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:12.323486  3681 raft_consensus.cc:2749] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:12.326257  3800 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.326851  3800 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:12.328117  1633 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:12.328207  1486 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51168 (request call id 26) took 4131 ms. Trace:
I20260709 13:01:12.330969  1633 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:12.331676  1650 tablet_service.cc:1558] Processing DeleteTablet for tablet 161aba2b69844461b9d8ed3cdf147919 with delete_type TABLET_DATA_TOMBSTONED (TS 5bb87fe07da2414e84ee578c3b176ede not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:39130
I20260709 13:01:12.332091  1725 tablet_service.cc:1558] Processing DeleteTablet for tablet 4490828942174c3c9092820cf3a81fe3 with delete_type TABLET_DATA_TOMBSTONED (TS 5ced62816f8545cd9b63a27e9055e42d not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:43674
I20260709 13:01:12.334237  1633 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:12.340166  1633 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:12.342100  1705 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:12.342540  1735 raft_consensus.cc:1275] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:01:12.342523  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 64349.6us
I20260709 13:01:12.343576  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:12.330089  1486 rpcz_store.cc:276] 0709 13:01:08.196563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.201225 (+  4662us) service_pool.cc:224] Handling call
0709 13:01:12.328137 (+4126912us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:12.189349 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:12.189910 (+   561us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:12.189944 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:01:12.189969 (+    25us) tablet.cc:662] Decoding operations
0709 13:01:12.190506 (+   537us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:12.190583 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:12.190609 (+    26us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:01:12.190917 (+   308us) tablet.cc:701] Row locks acquired
0709 13:01:12.190937 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:01:12.191081 (+   144us) write_op.cc:270] Start()
0709 13:01:12.191196 (+   115us) write_op.cc:276] Timestamp: P: 1783602072191028 usec, L: 0
0709 13:01:12.191217 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:01:12.191832 (+   615us) log.cc:844] Serialized 1301 byte log entry
0709 13:01:12.253132 (+ 61300us) op_driver.cc:464] REPLICATION: finished
0709 13:01:12.286740 (+ 33608us) write_op.cc:301] APPLY: starting
0709 13:01:12.286828 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:12.286961 (+   133us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:12.287065 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:12.287625 (+   560us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:12.287808 (+   183us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:01:12.287855 (+    47us) write_op.cc:312] APPLY: finished
0709 13:01:12.288138 (+   283us) log.cc:844] Serialized 34 byte log entry
0709 13:01:12.288347 (+   209us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:12.288444 (+    97us) write_op.cc:454] Released schema lock
0709 13:01:12.288486 (+    42us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":143853,"reported_tablets":3,"spinlock_wait_cycles":3200,"child_traces":[["op",{"apply.queue_time_us":33343,"num_ops":3,"prepare.queue_time_us":431122,"prepare.run_cpu_time_us":2793,"prepare.run_wall_time_us":2793,"replication_time_us":15335,"thread_start_us":429386,"threads_started":2}]]}
I20260709 13:01:12.345870  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:12.373574  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:12.368432  1740 raft_consensus.cc:1275] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:12.376224  1705 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:12.379420  1733 raft_consensus.cc:3060] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:12.361531  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:12.369009  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:12.380134  1705 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:01:12.381422  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:12.349458  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:12.380530  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:12.354173  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:12.384694  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:12.384749  1665 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
I20260709 13:01:12.385416  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:12.390225  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:12.390574  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:12.391711  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:12.392385  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:12.389534  1741 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 7.
I20260709 13:01:12.392774  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:12.395293  1740 raft_consensus.cc:1240] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:12.337477  3832 raft_consensus.cc:2749] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:12.396842  1733 raft_consensus.cc:2468] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 2.
I20260709 13:01:12.348002  3602 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:12.400343  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:12.380730  3803 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:12.337659  3681 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:12.348155  3802 raft_consensus.cc:2749] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:12.381486  3464 raft_consensus.cc:2749] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:12.403579  1556 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:12.385529  3866 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:12.375327  3604 consensus_queue.cc:1048] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:01:12.436429  3779 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:12.434556  3835 consensus_queue.cc:1048] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:01:12.440279  1705 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:01:12.444144  1633 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:12.460484  3904 raft_consensus.cc:2749] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:12.403494  3682 consensus_queue.cc:1048] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:01:12.465775  1633 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
W20260709 13:01:12.469588  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 72348.5us
I20260709 13:01:12.445667  3689 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:12.458177  3833 consensus_queue.cc:1048] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:01:12.503358  1490 catalog_manager.cc:5697] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 1 to 4, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:12.520612  1490 catalog_manager.cc:5697] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 4 to 6, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:12.523120  1490 catalog_manager.cc:5697] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 5 to 6, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:12.526333  1490 catalog_manager.cc:5697] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:12.528592  1490 catalog_manager.cc:5697] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 3 to 5, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:12.501503  3904 raft_consensus.cc:2804] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:12.531450  3904 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.531908  3904 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:12.532146  3902 log.cc:927] Time spent T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:01:12.530583  1490 catalog_manager.cc:5697] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:12.534137  1490 catalog_manager.cc:5697] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 5 to 6, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:12.536370  1490 catalog_manager.cc:5697] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:12.538158  1490 catalog_manager.cc:5697] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 6 to 8, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:12.551242  1490 catalog_manager.cc:5697] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 3 to 5, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:12.555073  3904 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:12.553579  1490 catalog_manager.cc:5697] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 2 to 3, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:12.564258  3800 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:12.564539  1490 catalog_manager.cc:5697] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 3 to 4, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:12.569500  1490 catalog_manager.cc:5697] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 3 to 4, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:12.579751  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 157742us
I20260709 13:01:12.580783  1490 catalog_manager.cc:5697] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 2 to 5, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:12.509114  3866 raft_consensus.cc:697] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:12.585877  1490 catalog_manager.cc:5697] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:12.605983  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:12.606828  1589 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:12.583623  3903 tablet_replica.cc:333] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:01:12.579228  3647 raft_consensus.cc:2804] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:12.616057  1586 raft_consensus.cc:1275] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:12.518785  3802 consensus_queue.cc:1059] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.078s
W20260709 13:01:12.618619  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 130065us
I20260709 13:01:12.623405  1633 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:12.623776  1589 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5.
W20260709 13:01:12.619596  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 179380us
I20260709 13:01:12.611930  3604 consensus_queue.cc:1059] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:01:12.618651  3904 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:12.648523  1707 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:12.653259  3642 raft_consensus.cc:2804] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:12.656414  3642 raft_consensus.cc:697] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 5 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:12.657344  3642 consensus_queue.cc:237] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:12.676553  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 53258.4us
I20260709 13:01:12.686524  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:12.687237  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:12.688400  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:12.693738  1658 raft_consensus.cc:1275] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:12.650285  3890 consensus_queue.cc:1048] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:01:12.682855  3689 raft_consensus.cc:2749] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:12.696727  1665 raft_consensus.cc:1275] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:12.684039  3833 raft_consensus.cc:2804] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:12.706288  3212 consensus_queue.cc:1048] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:12.708129  3690 raft_consensus.cc:3055] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:12.708563  3690 raft_consensus.cc:740] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:12.709383  3690 consensus_queue.cc:260] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:12.704663  3833 raft_consensus.cc:697] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:12.710531  3690 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:12.711033  3833 consensus_queue.cc:237] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:12.716027  3899 log.cc:927] Time spent T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.278s	user 0.001s	sys 0.002s
I20260709 13:01:12.687278  3866 consensus_queue.cc:237] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:12.747802  3647 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:12.748503  3647 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:12.754305  1556 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:12.775013  1556 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:12.782116  3903 raft_consensus.cc:2243] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:12.783059  3903 raft_consensus.cc:2272] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:12.797068  3924 tablet_replica.cc:333] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:01:12.776629  3689 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:12.805330  3657 consensus_queue.cc:1048] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:01:12.811818  3657 consensus_queue.cc:1048] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:12.813970  3911 raft_consensus.cc:3055] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:12.814424  3911 raft_consensus.cc:740] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:12.815414  3911 consensus_queue.cc:260] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:12.802510  3803 raft_consensus.cc:993] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:12.821216  3911 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:12.825346  3647 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:12.836743  1733 raft_consensus.cc:1240] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 5 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5. Ops: []
W20260709 13:01:12.837811  1633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.795694  3909 raft_consensus.cc:2749] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:12.846686  1736 raft_consensus.cc:1240] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:12.839820  3833 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.843719  3804 raft_consensus.cc:1081] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:12.871047  1633 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:12.875048  1664 raft_consensus.cc:1240] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:01:12.850553  3912 consensus_queue.cc:1048] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:01:12.883464  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:12.885634  1662 raft_consensus.cc:2410] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:01:12.893673  3904 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:12.894287  1633 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:12.895443  3904 raft_consensus.cc:2749] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:12.896005  1633 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:12.897120  3904 raft_consensus.cc:2749] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:12.897678  1633 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:12.852702  3803 consensus_queue.cc:1048] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:01:12.899552  1633 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:12.862015  3833 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:12.870590  3657 consensus_queue.cc:1048] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:01:12.903337  3904 raft_consensus.cc:2749] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:12.903314  3800 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:12.902436  3647 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:01:12.941649  3930 log.cc:927] Time spent T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:01:12.934921  3642 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.920754  3681 consensus_queue.cc:1048] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:01:12.950621  3833 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:12.964534  3903 ts_tablet_manager.cc:1916] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:01:12.969550  3923 log.cc:927] Time spent T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:01:12.973486  3912 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.974258  3912 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:12.956195  3919 log.cc:927] Time spent T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:01:12.956480  3642 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:12.980104  3901 log.cc:927] Time spent T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.545s	user 0.006s	sys 0.000s
I20260709 13:01:12.982321  3924 raft_consensus.cc:2243] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:12.982964  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 81993.8us
I20260709 13:01:12.990613  1633 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:13.001428  3602 raft_consensus.cc:2749] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:12.997323  3914 consensus_queue.cc:1048] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:01:13.012693  3912 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:13.037694  3912 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:13.038623  3912 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:13.041290  3932 log.cc:927] Time spent T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:01:13.074851  3912 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:13.075546  3924 raft_consensus.cc:2272] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.078639  3924 ts_tablet_manager.cc:1916] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:13.083400  3903 ts_tablet_manager.cc:1929] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.4
I20260709 13:01:13.084014  3903 log.cc:1199] T 161aba2b69844461b9d8ed3cdf147919 P 5bb87fe07da2414e84ee578c3b176ede: Deleting WAL directory at /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-1-root/wals/161aba2b69844461b9d8ed3cdf147919
W20260709 13:01:13.123850  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 133223us
I20260709 13:01:13.126262  1633 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:13.146422  1667 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39162
I20260709 13:01:13.148061  1667 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:13.149058  1667 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:13.156754  3934 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:13.157160  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:13.158845  1662 raft_consensus.cc:2393] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 8: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:01:13.158125  3934 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:13.159170  3911 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:13.160148  3911 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:13.161502  3602 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:13.166651  3602 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:13.162371  3681 raft_consensus.cc:2749] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:13.184357  3602 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:13.185385  3911 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:12.755973   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:13.188776  3934 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:13.190342  3642 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:13.118716  1475 catalog_manager.cc:5028] TS 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): tablet 161aba2b69844461b9d8ed3cdf147919 (table test-workload [id=8a8e3153ff4e476f890a0820215f177a]) successfully deleted
W20260709 13:01:13.203644  1475 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 85185.2us
I20260709 13:01:13.209690  3747 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:13.210644  3747 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:13.211325  3803 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:13.212172  3803 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:13.238904  3803 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:13.243899  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:13.245203  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:13.246282  1585 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
I20260709 13:01:13.247561  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:13.248347  1590 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
I20260709 13:01:13.253638  3687 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.254400  3687 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:13.255797  3747 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:13.256426  3747 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:13.256589  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:13.257031  3687 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:13.258014  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:13.257185  3747 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:13.260814  3934 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:13.261492  3934 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:13.263110  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:13.263787  3934 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:13.273204  3747 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:13.229166  1667 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:13.273646  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:13.286796  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:13.293244  3661 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.293594  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:13.294034  3661 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:13.297189  1667 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:13.298535  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:13.300223  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:13.300235  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:13.308784  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:13.309254  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:13.308806  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:13.318516  1707 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:13.322160  3866 raft_consensus.cc:2749] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:13.323470  1707 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:13.324896  3912 raft_consensus.cc:2804] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:13.325359  3912 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.325867  3661 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:13.272789  3924 ts_tablet_manager.cc:1929] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 13:01:13.325871  3912 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:13.325266  1707 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:13.337283  3924 log.cc:1199] T 4490828942174c3c9092820cf3a81fe3 P 5ced62816f8545cd9b63a27e9055e42d: Deleting WAL directory at /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-2-root/wals/4490828942174c3c9092820cf3a81fe3
I20260709 13:01:13.343716  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:01:13.344638  3937 log.cc:927] Time spent T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:01:13.357630  3866 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:13.358614  3866 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.359356  3866 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:13.360669  3924 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43674 (request call id 62) took 1031 ms. Trace:
I20260709 13:01:13.364661  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:13.366591  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:13.361423  3924 rpcz_store.cc:276] 0709 13:01:12.331605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.331810 (+   205us) service_pool.cc:224] Handling call
0709 13:01:12.718302 (+386492us) spinlock_profiling.cc:243] Waited 3.96 ms on lock 0x7b4400022b4c. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7ddc8c85 00007f1b7ddc96a2 00007f1b80b3b1db 00007f1b80b36aaf 00007f1b7de850ac 00007f1b86cdfab9 00007f1b7dea169b 00007f1b7de9f93f 00007f1b7dea1c02 00007f1b85fa5044
0709 13:01:12.779514 (+ 61212us) ts_tablet_manager.cc:1151] Deleting tablet 4490828942174c3c9092820cf3a81fe3
0709 13:01:12.780587 (+  1073us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:01:13.158252 (+377665us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:13.272413 (+114161us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:13.360502 (+ 88089us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":183711,"spinlock_wait_cycles":9118464,"tablet-delete.queue_time_us":403060,"thread_start_us":345069,"threads_started":1}
I20260709 13:01:13.369891  1734 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:01:13.375756  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:13.376683  1665 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:01:13.377691  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:13.386408  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:13.390376  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:13.390951  1734 raft_consensus.cc:1275] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:13.394392  1477 catalog_manager.cc:5028] TS 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): tablet 4490828942174c3c9092820cf3a81fe3 (table test-workload [id=8a8e3153ff4e476f890a0820215f177a]) successfully deleted
I20260709 13:01:13.399691  1665 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
I20260709 13:01:13.394766  1486 catalog_manager.cc:5697] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:01:13.400552  1490 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55132 (request call id 173) took 9510 ms. Trace:
I20260709 13:01:13.400708  1659 raft_consensus.cc:1240] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:13.395318  1587 raft_consensus.cc:1240] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:01:13.396071  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:13.414080  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:13.405551  1490 rpcz_store.cc:276] 0709 13:01:03.894444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.903131 (+  8687us) service_pool.cc:224] Handling call
0709 13:01:13.400297 (+9497166us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:12.632711 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:12.633470 (+   759us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:12.633512 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:01:12.633539 (+    27us) tablet.cc:662] Decoding operations
0709 13:01:12.635352 (+  1813us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:12.635430 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:12.635470 (+    40us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:01:12.636999 (+  1529us) tablet.cc:701] Row locks acquired
0709 13:01:12.637020 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:01:12.652956 (+ 15936us) write_op.cc:270] Start()
0709 13:01:12.666542 (+ 13586us) write_op.cc:276] Timestamp: P: 1783602072652255 usec, L: 0
0709 13:01:12.666559 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:01:12.718287 (+ 51728us) log.cc:844] Serialized 5973 byte log entry
0709 13:01:12.721020 (+  2733us) op_driver.cc:464] REPLICATION: finished
0709 13:01:12.721531 (+   511us) write_op.cc:301] APPLY: starting
0709 13:01:12.721611 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:12.721909 (+   298us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:12.722006 (+    97us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:12.748045 (+ 26039us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:12.748409 (+   364us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:01:12.748480 (+    71us) write_op.cc:312] APPLY: finished
0709 13:01:12.748953 (+   473us) log.cc:844] Serialized 106 byte log entry
0709 13:01:12.749215 (+   262us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:12.749432 (+   217us) write_op.cc:454] Released schema lock
0709 13:01:12.749510 (+    78us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:12.749905 (+   395us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:12.749937 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":11242,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":238,"apply.run_cpu_time_us":4504,"apply.run_wall_time_us":28323,"num_ops":15,"prepare.queue_time_us":326,"prepare.run_cpu_time_us":6234,"prepare.run_wall_time_us":85879,"replication_time_us":44855}]]}
I20260709 13:01:13.428859  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:13.432683  3618 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:13.433459  3909 consensus_queue.cc:1059] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:13.433632  3618 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:13.434623  3909 raft_consensus.cc:3055] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:13.435011  3909 raft_consensus.cc:740] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:13.436023  3909 consensus_queue.cc:260] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:13.436417  3618 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:13.439445  2996 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:13.446291  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:13.444955  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:13.448539  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:13.448315  2996 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:13.441212  1486 catalog_manager.cc:5697] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:13.452212  1665 raft_consensus.cc:1275] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:13.453030  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:13.451036  1662 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5.
I20260709 13:01:13.456061  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:13.457037  3909 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:13.461393  2996 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:13.472646  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:01:13.474843  3938 log.cc:927] Time spent T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.069s	user 0.002s	sys 0.000s
I20260709 13:01:13.474730  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:13.476462  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:13.478509  1586 raft_consensus.cc:1275] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:13.480952  1665 raft_consensus.cc:1275] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:13.482446  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:13.485409  1736 raft_consensus.cc:3055] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:13.485737  1736 raft_consensus.cc:740] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:13.487850  1736 consensus_queue.cc:260] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:13.489195  1736 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:13.489408  3319 consensus_queue.cc:1048] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:13.492964  1705 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:01:13.499642  3942 log.cc:927] Time spent T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:01:13.501830  1705 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:01:13.502908  3803 raft_consensus.cc:2749] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:13.502969  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:13.505267  3642 raft_consensus.cc:2804] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:13.509959  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:13.497445  1486 catalog_manager.cc:5697] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:01:13.504330  3803 consensus_queue.cc:1048] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:13.519642  1586 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:13.459547  3912 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:13.521247  1736 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 5.
I20260709 13:01:13.521068  3642 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:13.530311  3642 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:13.530200  1486 catalog_manager.cc:5697] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 1 to 4, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 4 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:13.532009  1486 catalog_manager.cc:5697] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 3 to 6, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:01:13.534667  1558 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:13.536129  3689 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:13.536545  3689 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.536911  3689 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:13.537305  3912 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:01:13.541211  1633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.551710  1633 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:13.555223  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:13.566783  1486 catalog_manager.cc:5697] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 1 to 4, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 4 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:13.575831  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 74096.3us
I20260709 13:01:13.580323  1705 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:13.588124  1590 raft_consensus.cc:1275] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:13.600490  1705 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:13.602447  3803 consensus_queue.cc:1048] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:13.602638  1586 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 5.
I20260709 13:01:13.606086  1592 raft_consensus.cc:1275] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:13.606539  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:13.607503  1586 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:13.498005  3866 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:13.609509  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:13.610906  1486 catalog_manager.cc:5697] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 1 to 4, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 4 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:01:13.577857  3319 raft_consensus.cc:2749] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:13.626499  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 74912us
I20260709 13:01:13.608400  3747 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:13.626960  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:13.627358  1633 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:13.601507  3912 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:13.624645  1664 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:01:13.639494  3835 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:13.627763  3803 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.639797  3945 consensus_queue.cc:1048] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:01:13.633636  3747 consensus_queue.cc:1048] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:01:13.648087  1633 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:13.644973  1486 catalog_manager.cc:5697] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 1 to 4, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:01:13.658435  1586 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:01:13.665175  1486 catalog_manager.cc:5697] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:01:13.665952  1707 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:13.649636  3803 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:13.670630  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:13.674723  1740 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:01:13.668620  1486 catalog_manager.cc:5697] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 6 to 7, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:01:13.650578  3689 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:13.675863  3803 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:13.677455  3689 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:13.678259  3866 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:13.654505  3835 raft_consensus.cc:2749] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:13.638350  3642 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:13.673504  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:13.679659  3912 raft_consensus.cc:2804] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:13.677600  1486 catalog_manager.cc:5697] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 2 to 5, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:01:13.684428  3642 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:13.691440  1587 raft_consensus.cc:2410] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:01:13.690560  1486 catalog_manager.cc:5697] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 2 to 5, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:01:13.696328  1633 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:13.697912  1633 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:13.698814  3835 raft_consensus.cc:2749] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:13.699297  1486 catalog_manager.cc:5697] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 4 to 5, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 5 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:13.706583  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:13.705933  1486 catalog_manager.cc:5697] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 4 to 5, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 5 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:01:13.712283  1633 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:01:13.713403  3946 log.cc:927] Time spent T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.139s	user 0.002s	sys 0.000s
I20260709 13:01:13.713675  3319 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:13.704921  3912 raft_consensus.cc:697] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:13.699751  3835 raft_consensus.cc:2749] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:13.722041  1558 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:13.725411  1556 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:13.731590  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:13.733714  1662 raft_consensus.cc:2393] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 6: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:01:13.727380  1486 catalog_manager.cc:5697] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 2 to 6, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } }
I20260709 13:01:13.734786  1633 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:13.729437  3909 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:13.750567  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:13.751034  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:13.751971  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:13.752483  1736 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:13.755106  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 122665us
I20260709 13:01:13.716774  3912 consensus_queue.cc:237] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:13.761562  1486 catalog_manager.cc:5697] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 5 to 6, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 6 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:01:13.748494  3909 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:13.746745  3835 raft_consensus.cc:2749] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:13.769454  3909 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:13.776239  1486 catalog_manager.cc:5697] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 1 to 3, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
W20260709 13:01:13.779805  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 50079.6us
I20260709 13:01:13.776922  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:13.781606  1588 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:01:13.787662  1633 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:13.788501  3319 raft_consensus.cc:2749] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:13.785952  1486 catalog_manager.cc:5697] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:01:13.792572  1486 catalog_manager.cc:5697] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:01:13.794016  1486 catalog_manager.cc:5697] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:01:13.795336  1486 catalog_manager.cc:5697] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:01:13.797870  1633 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:13.806890  3319 raft_consensus.cc:2749] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:13.812853  1633 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:13.816532  1588 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:01:13.818483  1707 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:13.821915  1633 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:13.825862  1736 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:01:13.828508  3911 raft_consensus.cc:2749] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:13.832818  1633 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:13.843214  1633 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:13.824128  3319 raft_consensus.cc:2749] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:13.834775  3866 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:13.841672  3911 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:13.874678  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 71725.4us
I20260709 13:01:13.873015  1558 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:01:13.879792  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 85116.5us
I20260709 13:01:13.887914  2996 raft_consensus.cc:2749] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:13.865691  3835 raft_consensus.cc:2749] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:13.889457  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 50348.5us
I20260709 13:01:13.897346   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:13.889663  3689 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.898343  3689 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:13.900390  3689 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:13.852463  3934 consensus_queue.cc:1048] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:01:13.871717  3866 raft_consensus.cc:697] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 9 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
W20260709 13:01:13.926103  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 55759us
W20260709 13:01:13.939175  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 96060.2us
W20260709 13:01:13.941449  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 51257.5us
I20260709 13:01:13.905260  3866 consensus_queue.cc:237] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:13.955317  1556 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:13.970407  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:13.974782  1666 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:13.976056  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:13.976814  1667 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:13.977505  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:13.983034  1633 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:13.986976  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:13.987661  1658 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:01:13.988754  3909 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:14.023833  1667 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
W20260709 13:01:14.028714  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 45778us
I20260709 13:01:14.051297  1585 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:01:14.036475  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:14.036279  3631 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:14.067044  3952 raft_consensus.cc:2749] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:14.049769  3959 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:14.079932  3909 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:14.081818  3959 raft_consensus.cc:697] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 5 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:14.083022  3959 consensus_queue.cc:237] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:14.072944  3631 raft_consensus.cc:697] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:14.087327  3631 consensus_queue.cc:237] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:14.093550  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 63864.2us
I20260709 13:01:14.096536  1666 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
W20260709 13:01:14.078748  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 123508us
I20260709 13:01:14.102177  1705 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:14.101727  3909 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.137370  3909 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:14.139739  3909 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:14.154139  1707 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:14.123291  3866 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:14.161253  1556 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:01:14.165623  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 63579us
I20260709 13:01:14.177259  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:14.177887  1666 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:14.179948  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:14.176427  3642 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:14.190524  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:14.192407  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:14.193274  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:14.207036  1663 raft_consensus.cc:2393] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 6: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:01:14.196355  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:14.197468  1741 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:01:14.213505  1660 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:01:14.214931  1633 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:14.196424  3642 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.220484  3319 raft_consensus.cc:2749] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:14.220827  3642 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:14.263825  3967 raft_consensus.cc:2749] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:14.265743  1591 consensus_queue.cc:237] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:14.293286  1558 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:14.294289  3962 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:14.294698  3962 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.295195  3962 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:14.294849  3642 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:14.294309  1741 raft_consensus.cc:1240] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:14.307085  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 92286.3us
I20260709 13:01:14.284925  1556 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:14.314935  1666 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:01:14.307318  3962 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:14.331643  1739 raft_consensus.cc:2368] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for earlier term 6. Current term is 7.
W20260709 13:01:14.334168  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 49370.5us
I20260709 13:01:14.338676  3962 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:14.342893  1558 leader_election.cc:400] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for earlier term 6. Current term is 7.
I20260709 13:01:14.343248  1558 leader_election.cc:403] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:01:14.343604  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:14.343789  3967 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:14.344228  1741 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:14.338580  3981 consensus_queue.cc:1059] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:14.346804  3642 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:14.348037  3981 raft_consensus.cc:3055] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:14.348438  3981 raft_consensus.cc:740] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:14.356978  1741 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:01:14.364219  3961 raft_consensus.cc:2749] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:14.349414  3981 consensus_queue.cc:260] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:14.376611  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:14.379415  3981 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:14.387593  1555 consensus_peers.cc:597] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 -> Peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157): Couldn't send request to peer 7e839e91a1314c2f9a99b25b17c916a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0d14bd0bd4204ece94fb1bfe29d407f8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:14.391752  3967 raft_consensus.cc:2749] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for earlier term 6. Current term is 7.
I20260709 13:01:14.397593  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:14.398169  1666 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:01:14.398861  1558 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:01:14.401224  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 69398.1us
I20260709 13:01:14.402725  1665 raft_consensus.cc:1275] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:14.406152  3631 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:14.406967  3631 raft_consensus.cc:697] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:14.409070  3631 consensus_queue.cc:237] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:14.414058  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:14.414672  1662 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:14.415144  1660 raft_consensus.cc:1275] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:01:14.417802  1741 raft_consensus.cc:1275] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:01:14.423758  1662 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
I20260709 13:01:14.425810  1660 raft_consensus.cc:1275] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:01:14.425448  3909 consensus_queue.cc:1048] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:01:14.428642  1585 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
I20260709 13:01:14.430982  1591 raft_consensus.cc:1275] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:14.431807  1666 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:01:14.440373  3982 consensus_queue.cc:1048] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:14.448443  3945 consensus_queue.cc:1048] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:14.449169  3962 consensus_queue.cc:1048] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:14.450451  1705 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:14.451428  3945 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:14.451714  1489 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51168 (request call id 27) took 1767 ms. Trace:
I20260709 13:01:14.451921  3945 raft_consensus.cc:697] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:14.452062  1489 rpcz_store.cc:276] 0709 13:01:12.684309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.686778 (+  2469us) service_pool.cc:224] Handling call
0709 13:01:12.793660 (+106882us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b5400119254. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef9090 00007f1b80f97f3a 00007f1b86d4e1cc 00007f1b86e4c37e 00007f1b8530d2a4 00007f1b8530d232 00007f1b8530d161 00007f1b8530d0dc 00007f1b8530c392 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:01:14.451497 (+1657837us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":398752,"reported_tablets":3,"spinlock_wait_cycles":28590976}
I20260709 13:01:14.457296  3982 consensus_queue.cc:1048] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:14.453030  3945 consensus_queue.cc:237] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:14.475970  1591 raft_consensus.cc:1275] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:01:14.483889  3982 consensus_queue.cc:1048] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:14.515920  3962 raft_consensus.cc:2955] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index -1 to 6, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:14.534106  1486 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55154 (request call id 167) took 2002 ms. Trace:
I20260709 13:01:14.535681  1738 raft_consensus.cc:2955] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index -1 to 6, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:14.534550  1486 rpcz_store.cc:276] 0709 13:01:12.531819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.534062 (+  2243us) service_pool.cc:224] Handling call
0709 13:01:14.534041 (+1999979us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:14.061458 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:14.064288 (+  2830us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:14.064352 (+    64us) write_op.cc:435] Acquired schema lock
0709 13:01:14.064371 (+    19us) tablet.cc:662] Decoding operations
0709 13:01:14.089514 (+ 25143us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:14.089596 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:14.089631 (+    35us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:01:14.091798 (+  2167us) tablet.cc:701] Row locks acquired
0709 13:01:14.091857 (+    59us) write_op.cc:260] PREPARE: finished
0709 13:01:14.092054 (+   197us) write_op.cc:270] Start()
0709 13:01:14.092231 (+   177us) write_op.cc:276] Timestamp: P: 1783602074091985 usec, L: 0
0709 13:01:14.092252 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:01:14.115544 (+ 23292us) log.cc:844] Serialized 8297 byte log entry
0709 13:01:14.335737 (+220193us) op_driver.cc:464] REPLICATION: finished
0709 13:01:14.376675 (+ 40938us) write_op.cc:301] APPLY: starting
0709 13:01:14.376775 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:14.377247 (+   472us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:14.377401 (+   154us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:14.380104 (+  2703us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:14.423960 (+ 43856us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=21
0709 13:01:14.424017 (+    57us) write_op.cc:312] APPLY: finished
0709 13:01:14.424469 (+   452us) log.cc:844] Serialized 144 byte log entry
0709 13:01:14.424672 (+   203us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:14.424875 (+   203us) write_op.cc:454] Released schema lock
0709 13:01:14.424952 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:14.437413 (+ 12461us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:14.437451 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3254,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":39824,"apply.run_cpu_time_us":5278,"apply.run_wall_time_us":60709,"num_ops":21,"prepare.queue_time_us":115719,"prepare.run_cpu_time_us":20926,"prepare.run_wall_time_us":131051,"raft.queue_time_us":93175,"raft.run_cpu_time_us":14118,"raft.run_wall_time_us":40192,"replication_time_us":243264,"thread_start_us":249215,"threads_started":4,"wal-append.queue_time_us":100244}]]}
I20260709 13:01:14.544281  1666 raft_consensus.cc:2955] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index -1 to 6, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:14.547040  1490 catalog_manager.cc:5697] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:01:14.579924  1588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:14.580698  1588 raft_consensus.cc:606] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:14.579934  1591 raft_consensus.cc:1275] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:14.593245  3319 consensus_queue.cc:1048] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:14.597165  1490 catalog_manager.cc:5697] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 2 to 5, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:01:14.601363  1490 catalog_manager.cc:5697] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 3 to 6, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 6 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:14.604244  1490 catalog_manager.cc:5697] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 4 to 7, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 7 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:14.616287  1588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:14.651983  1588 raft_consensus.cc:606] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:14.652491  1588 raft_consensus.cc:614] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:01:14.625005  1538 auto_rebalancer.cc:629] Failed to schedule move for tablet bd6e8a8a10c144f1bd64e638805e7a5a: Illegal state: Replica 5ced62816f8545cd9b63a27e9055e42d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:01:14.658551  1588 consensus_queue.cc:237] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:14.606907  1490 catalog_manager.cc:5697] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 4 to 7, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 7 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:14.664018  1490 catalog_manager.cc:5697] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 5 to 7, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 7 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:01:14.680377  1591 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:14.681062  1591 raft_consensus.cc:606] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:14.681429  1591 raft_consensus.cc:614] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:01:14.698424  1555 consensus_peers.cc:597] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 -> Peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157): Couldn't send request to peer 7e839e91a1314c2f9a99b25b17c916a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f52de8c1489f4f9aabb361c6c02bb3de. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:14.704860  1662 raft_consensus.cc:1275] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:14.705180  1588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:14.706125  1588 raft_consensus.cc:606] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:14.706903  3631 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.707876  3631 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:14.710480  1739 raft_consensus.cc:1275] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:14.716053  3687 consensus_queue.cc:1048] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:14.717131  3962 consensus_queue.cc:1048] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:14.718775  3631 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:14.719918  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:14.720605  1658 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:01:14.721175  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:14.719385  3967 raft_consensus.cc:993] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:14.722313  1739 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:01:14.723919  3967 raft_consensus.cc:1081] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:14.725478  1739 raft_consensus.cc:1275] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:14.726481  1558 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:14.727095  3835 consensus_queue.cc:1048] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:14.720813  1588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:14.730361  1662 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39146
I20260709 13:01:14.730484  1588 raft_consensus.cc:606] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:14.730912  1662 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:14.731350  1662 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:14.745671  3631 raft_consensus.cc:2804] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:14.746368  3631 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.747929   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:14.749292  1666 raft_consensus.cc:1275] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:01:14.750847   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:14.746816  3631 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:14.763849  1662 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:14.764174  3908 raft_consensus.cc:2955] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:14.765936  1662 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:14.769306  3958 consensus_queue.cc:1048] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:14.770999  1741 raft_consensus.cc:1275] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:01:14.771303  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:14.771885  1739 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:14.772430  1732 raft_consensus.cc:2955] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:14.756353  1489 catalog_manager.cc:5697] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:14.777436  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:14.778059  1585 raft_consensus.cc:3055] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:14.778335  1585 raft_consensus.cc:740] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:14.778636  1489 catalog_manager.cc:5697] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 6 to 7, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 7 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:01:14.779098  1585 consensus_queue.cc:260] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:14.780267  1585 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:14.787289  1585 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 6.
I20260709 13:01:14.791373  1739 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 6.
I20260709 13:01:14.791949  3631 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:14.796964  3631 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:14.780885  1489 catalog_manager.cc:5697] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:14.801373  1633 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:14.803246  3987 raft_consensus.cc:2804] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:14.803786  3987 raft_consensus.cc:697] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:14.804316  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:14.804957  1665 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:14.804673  3987 consensus_queue.cc:237] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:14.809870  1664 raft_consensus.cc:2955] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:14.815466  3908 raft_consensus.cc:993] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:14.816082  3631 raft_consensus.cc:1081] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:14.821319  1658 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39146
I20260709 13:01:14.821935  1658 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:14.821004  1489 catalog_manager.cc:5697] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 3 to 5, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 5 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:01:14.822259  1658 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:14.835016  1489 catalog_manager.cc:5697] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:14.837145  3908 consensus_queue.cc:1048] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:14.838209  1665 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:01:14.837965  1489 catalog_manager.cc:5697] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 1 to 5, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 5 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:01:14.843379  1490 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55138 (request call id 176) took 1338 ms. Trace:
I20260709 13:01:14.849255  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:14.849951  1732 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:14.851275  1556 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:14.860706  1732 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:01:14.860838  1741 raft_consensus.cc:1275] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:01:14.862793  3908 raft_consensus.cc:2804] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:14.863543  3908 raft_consensus.cc:697] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:14.844094  1490 rpcz_store.cc:276] 0709 13:01:13.505395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.510789 (+  5394us) service_pool.cc:224] Handling call
0709 13:01:14.843315 (+1332526us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:14.680881 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:14.681424 (+   543us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:14.681457 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:01:14.681476 (+    19us) tablet.cc:662] Decoding operations
0709 13:01:14.682155 (+   679us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:14.682207 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:14.682233 (+    26us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:01:14.682713 (+   480us) tablet.cc:701] Row locks acquired
0709 13:01:14.682731 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:01:14.682873 (+   142us) write_op.cc:270] Start()
0709 13:01:14.682974 (+   101us) write_op.cc:276] Timestamp: P: 1783602074682822 usec, L: 0
0709 13:01:14.682996 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:01:14.683584 (+   588us) log.cc:844] Serialized 2477 byte log entry
0709 13:01:14.685988 (+  2404us) op_driver.cc:464] REPLICATION: finished
0709 13:01:14.686511 (+   523us) write_op.cc:301] APPLY: starting
0709 13:01:14.686606 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:14.686783 (+   177us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:14.686875 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:14.687648 (+   773us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:14.687835 (+   187us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:01:14.687878 (+    43us) write_op.cc:312] APPLY: finished
0709 13:01:14.688136 (+   258us) log.cc:844] Serialized 52 byte log entry
0709 13:01:14.688289 (+   153us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:14.688402 (+   113us) write_op.cc:454] Released schema lock
0709 13:01:14.688476 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:14.688865 (+   389us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:14.688902 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":989,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":260,"apply.run_cpu_time_us":2291,"apply.run_wall_time_us":2290,"num_ops":6,"prepare.queue_time_us":117,"prepare.run_cpu_time_us":2957,"prepare.run_wall_time_us":2973,"replication_time_us":2858}]]}
I20260709 13:01:14.881273  3908 consensus_queue.cc:237] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:14.832994  1658 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:14.897778  3631 consensus_queue.cc:1048] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:14.899861  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:14.900708  1741 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:14.896638  1486 catalog_manager.cc:5697] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 1 to 2, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 2 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:01:14.901736  1486 catalog_manager.cc:5697] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: config changed from index -1 to 6, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New cstate: current_term: 6 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:14.903154  1486 catalog_manager.cc:5697] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 6 to 9, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 9 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:14.903780  1664 raft_consensus.cc:1275] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:01:14.913146  1585 consensus_queue.cc:237] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:14.921849  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:14.922525  1588 raft_consensus.cc:3055] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:14.922811  1588 raft_consensus.cc:740] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:14.923749  1588 consensus_queue.cc:260] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:14.925467  1588 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:14.929201  1658 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:14.930737  1741 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 5.
I20260709 13:01:14.931803  1633 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:14.932562  3934 raft_consensus.cc:2804] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:14.933105  3934 raft_consensus.cc:697] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 5 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:14.934033  3934 consensus_queue.cc:237] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:14.938333  1588 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 5.
I20260709 13:01:14.947729  3631 consensus_queue.cc:1048] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:01:14.996695  1555 consensus_peers.cc:597] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 -> Peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157): Couldn't send request to peer 7e839e91a1314c2f9a99b25b17c916a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 40fb069a8f6e4d0c885835eee0132b00. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:15.005985  1739 raft_consensus.cc:1275] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:15.006038  1660 raft_consensus.cc:1275] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:15.010619  1486 catalog_manager.cc:5697] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:15.027160  1486 catalog_manager.cc:5697] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 3 to 8, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 8 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:15.039837  4008 ts_tablet_manager.cc:933] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6: Initiating tablet copy from peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:01:15.044076  4008 tablet_copy_client.cc:323] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:33325
I20260709 13:01:15.045909  3689 consensus_queue.cc:1048] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:15.046960  1587 raft_consensus.cc:1275] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:01:15.047103  1601 tablet_copy_service.cc:140] P 6d4de2ce0683442498244b9529127f91: Received BeginTabletCopySession request for tablet 0d14bd0bd4204ece94fb1bfe29d407f8 from peer 7e839e91a1314c2f9a99b25b17c916a6 ({username='slave'} at 127.0.0.1:46836)
I20260709 13:01:15.047786  1601 tablet_copy_service.cc:161] P 6d4de2ce0683442498244b9529127f91: Beginning new tablet copy session on tablet 0d14bd0bd4204ece94fb1bfe29d407f8 from peer 7e839e91a1314c2f9a99b25b17c916a6 at {username='slave'} at 127.0.0.1:46836: session id = 7e839e91a1314c2f9a99b25b17c916a6-0d14bd0bd4204ece94fb1bfe29d407f8
I20260709 13:01:15.065196  3967 consensus_queue.cc:1048] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:15.073519  1601 tablet_copy_source_session.cc:215] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:15.098097  4008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d14bd0bd4204ece94fb1bfe29d407f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.108264  1666 raft_consensus.cc:1275] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:01:15.086838  3945 consensus_queue.cc:1048] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:01:15.140113  3982 consensus_queue.cc:1048] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:15.154800  1490 catalog_manager.cc:5697] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 4 to 5, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 5 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:15.157094  1490 catalog_manager.cc:5697] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 5 to 6, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 6 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:15.145924  4012 log.cc:927] Time spent T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:01:15.175969  1490 catalog_manager.cc:5697] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: config changed from index -1 to 4, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New cstate: current_term: 5 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:15.183650  3962 raft_consensus.cc:993] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:15.185969  3981 raft_consensus.cc:1081] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:15.223336  1486 catalog_manager.cc:5697] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:15.225739  1658 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39146
I20260709 13:01:15.226647  1658 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:15.227257  1658 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:15.216269  3689 raft_consensus.cc:2955] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Committing config change with OpId 4.3: config changed from index -1 to 3, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:15.248624  1658 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:15.293749  1735 raft_consensus.cc:2955] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Committing config change with OpId 4.3: config changed from index -1 to 3, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:15.307854  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:15.308812  1585 raft_consensus.cc:3055] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:15.309237  1585 raft_consensus.cc:740] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:15.317929  1658 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:15.322502  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:15.323449  1736 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:15.325558  1585 consensus_queue.cc:260] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:15.333966  1585 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:15.332643  4022 ts_tablet_manager.cc:933] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6: Initiating tablet copy from peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:01:15.354980  1585 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 9.
W20260709 13:01:15.404048  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 68430.3us
I20260709 13:01:15.410362  1736 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 9.
I20260709 13:01:15.412117  1633 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:15.413148  3319 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:15.420744  3319 raft_consensus.cc:697] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:15.425781  3319 consensus_queue.cc:237] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:15.427273  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 57686.8us
I20260709 13:01:15.439519  1658 raft_consensus.cc:2955] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Committing config change with OpId 4.3: config changed from index -1 to 3, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:15.445760  1741 raft_consensus.cc:1275] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:01:15.473328  3969 consensus_queue.cc:1048] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:01:15.490404  4022 tablet_copy_client.cc:323] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:33325
I20260709 13:01:15.498764  4008 tablet_copy_client.cc:806] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:15.499694  4008 tablet_copy_client.cc:670] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:15.501683  1741 raft_consensus.cc:1275] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:15.504850  3987 consensus_queue.cc:1048] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:15.518239  1736 raft_consensus.cc:1275] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:15.517742  1601 tablet_copy_service.cc:140] P 6d4de2ce0683442498244b9529127f91: Received BeginTabletCopySession request for tablet f52de8c1489f4f9aabb361c6c02bb3de from peer 7e839e91a1314c2f9a99b25b17c916a6 ({username='slave'} at 127.0.0.1:46836)
I20260709 13:01:15.520330  1601 tablet_copy_service.cc:161] P 6d4de2ce0683442498244b9529127f91: Beginning new tablet copy session on tablet f52de8c1489f4f9aabb361c6c02bb3de from peer 7e839e91a1314c2f9a99b25b17c916a6 at {username='slave'} at 127.0.0.1:46836: session id = 7e839e91a1314c2f9a99b25b17c916a6-f52de8c1489f4f9aabb361c6c02bb3de
I20260709 13:01:15.524400  3835 consensus_queue.cc:1048] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:01:15.546381  4008 tablet_copy_client.cc:538] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:15.565814  4008 tablet_bootstrap.cc:492] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap starting.
I20260709 13:01:15.593720  1601 tablet_copy_source_session.cc:215] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:15.704615  4008 tablet_bootstrap.cc:492] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:15.705822  4008 tablet_bootstrap.cc:492] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap complete.
I20260709 13:01:15.706636  4008 ts_tablet_manager.cc:1403] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent bootstrapping tablet: real 0.142s	user 0.023s	sys 0.021s
I20260709 13:01:15.711159  4008 raft_consensus.cc:359] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:15.712342  4008 raft_consensus.cc:740] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Initialized, Role: LEARNER
I20260709 13:01:15.713686  4008 consensus_queue.cc:260] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:15.718080  4008 ts_tablet_manager.cc:1434] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:01:15.797739  4037 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:15.798410  4037 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:15.800544  4037 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:15.809566  1601 tablet_copy_service.cc:342] P 6d4de2ce0683442498244b9529127f91: Request end of tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-0d14bd0bd4204ece94fb1bfe29d407f8 received from {username='slave'} at 127.0.0.1:46836
I20260709 13:01:15.810156  1601 tablet_copy_service.cc:434] P 6d4de2ce0683442498244b9529127f91: ending tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-0d14bd0bd4204ece94fb1bfe29d407f8 on tablet 0d14bd0bd4204ece94fb1bfe29d407f8 with peer 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:15.811568  4022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f52de8c1489f4f9aabb361c6c02bb3de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.854202  4022 tablet_copy_client.cc:806] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:15.855170  4022 tablet_copy_client.cc:670] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:15.877803  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:15.878589  1735 raft_consensus.cc:2393] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 6: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:01:15.958776  3982 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.959342  3982 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:15.961395  3982 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:01:15.971920  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 503426us
I20260709 13:01:15.984720  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:15.985450  1660 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5.
I20260709 13:01:15.987522  1705 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:15.991556  4018 raft_consensus.cc:2804] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:15.992004  4018 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.992560  4018 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:16.000866  4018 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:16.018885  1665 raft_consensus.cc:1275] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:01:16.023524  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:16.024224  1665 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:01:16.024358  4022 tablet_copy_client.cc:538] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:01:16.026187  1557 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.006s	sys 0.014s
W20260709 13:01:16.026551  1557 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.006s	sys 0.014s
I20260709 13:01:16.037974  4022 tablet_bootstrap.cc:492] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap starting.
I20260709 13:01:16.043574  1665 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
I20260709 13:01:16.050246  4018 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:16.063812  3962 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.064461  3962 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:16.071703  2553 raft_consensus.cc:1217] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 LEARNER]: Deduplicated request from leader. Original: 6.5->[6.6-6.6]   Dedup: 6.6->[]
I20260709 13:01:16.072606  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:16.069921  4008 ts_tablet_manager.cc:933] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6: Initiating tablet copy from peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:01:16.073328  1590 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:01:16.074615  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:16.075245  1592 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:16.080899  3962 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:16.087682  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:16.092384  1590 raft_consensus.cc:1275] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:16.093307  1588 raft_consensus.cc:1275] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:16.095897  4008 tablet_copy_client.cc:323] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:33325
I20260709 13:01:16.097631  1601 tablet_copy_service.cc:140] P 6d4de2ce0683442498244b9529127f91: Received BeginTabletCopySession request for tablet 40fb069a8f6e4d0c885835eee0132b00 from peer 7e839e91a1314c2f9a99b25b17c916a6 ({username='slave'} at 127.0.0.1:46836)
I20260709 13:01:16.098184  1601 tablet_copy_service.cc:161] P 6d4de2ce0683442498244b9529127f91: Beginning new tablet copy session on tablet 40fb069a8f6e4d0c885835eee0132b00 from peer 7e839e91a1314c2f9a99b25b17c916a6 at {username='slave'} at 127.0.0.1:46836: session id = 7e839e91a1314c2f9a99b25b17c916a6-40fb069a8f6e4d0c885835eee0132b00
I20260709 13:01:16.096694  1705 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:16.101212  4017 raft_consensus.cc:2804] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:16.101869  4017 raft_consensus.cc:697] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:16.102761  4017 consensus_queue.cc:237] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:16.117341  1490 catalog_manager.cc:5697] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 4 to 5, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 5 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:15.974411   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:16.124383  1736 raft_consensus.cc:1275] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:16.130970  1601 tablet_copy_source_session.cc:215] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:16.144693  4022 tablet_bootstrap.cc:492] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:16.150102  4008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40fb069a8f6e4d0c885835eee0132b00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.138868  1592 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
I20260709 13:01:16.157352  3319 consensus_queue.cc:1048] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:16.157806  4022 tablet_bootstrap.cc:492] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap complete.
I20260709 13:01:16.162009  4022 ts_tablet_manager.cc:1403] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6: Time spent bootstrapping tablet: real 0.124s	user 0.030s	sys 0.006s
I20260709 13:01:16.165005  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:16.165382  4022 raft_consensus.cc:359] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:16.166256  4022 raft_consensus.cc:740] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Initialized, Role: LEARNER
I20260709 13:01:16.165005  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:16.169498  1665 raft_consensus.cc:2393] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 7: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:01:16.166937  4022 consensus_queue.cc:260] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:16.205582  4022 ts_tablet_manager.cc:1434] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.002s
I20260709 13:01:16.226713  1601 tablet_copy_service.cc:342] P 6d4de2ce0683442498244b9529127f91: Request end of tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-f52de8c1489f4f9aabb361c6c02bb3de received from {username='slave'} at 127.0.0.1:46836
I20260709 13:01:16.226596  4032 consensus_queue.cc:1048] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:16.227288  1601 tablet_copy_service.cc:434] P 6d4de2ce0683442498244b9529127f91: ending tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-f52de8c1489f4f9aabb361c6c02bb3de on tablet f52de8c1489f4f9aabb361c6c02bb3de with peer 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:16.227759  1556 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:16.228613  3961 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:16.230403  1633 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:16.231173  3319 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:16.234266  1592 raft_consensus.cc:1275] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:16.237118  3934 consensus_queue.cc:1048] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:01:16.252092  4008 tablet_copy_client.cc:806] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:16.252981  4008 tablet_copy_client.cc:670] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:16.275496  4008 tablet_copy_client.cc:538] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:16.277659  3835 consensus_queue.cc:1048] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:01:16.281879  3835 consensus_queue.cc:1048] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:16.307118  1488 catalog_manager.cc:5697] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 reported cstate change: config changed from index -1 to 3, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New cstate: current_term: 4 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:16.311936  1489 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55154 (request call id 169) took 1105 ms. Trace:
I20260709 13:01:16.422137  1489 rpcz_store.cc:276] 0709 13:01:15.206162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.206291 (+   129us) service_pool.cc:224] Handling call
0709 13:01:16.311867 (+1105576us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":247626,"reported_tablets":6}
I20260709 13:01:16.437739   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:16.476444  4008 tablet_bootstrap.cc:492] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap starting.
I20260709 13:01:16.565327  1592 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59092
I20260709 13:01:16.565979  1592 raft_consensus.cc:606] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Received request to transfer leadership
I20260709 13:01:16.566087  1662 raft_consensus.cc:1275] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:16.568408  4017 consensus_queue.cc:1048] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:16.696712  1489 catalog_manager.cc:5697] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 8 to 9, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 9 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:16.748236  1592 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59092
I20260709 13:01:16.749006  1592 raft_consensus.cc:606] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Received request to transfer leadership
W20260709 13:01:16.750890  1477 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 40fb069a8f6e4d0c885835eee0132b00 already in progress [suppressed 12 similar messages]
I20260709 13:01:16.768208  1592 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59092
I20260709 13:01:16.770022  1592 raft_consensus.cc:606] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Received request to transfer leadership
I20260709 13:01:16.778223  1486 catalog_manager.cc:5697] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 5 to 7, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 7 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:16.861207  2591 debug-util.cc:398] Leaking SignalData structure 0x7b0800291300 after lost signal to thread 434
W20260709 13:01:16.862565  2591 debug-util.cc:398] Leaking SignalData structure 0x7b080030ed60 after lost signal to thread 1524
W20260709 13:01:16.864916  2591 debug-util.cc:398] Leaking SignalData structure 0x7b08003399a0 after lost signal to thread 1616
W20260709 13:01:16.879043  2591 debug-util.cc:398] Leaking SignalData structure 0x7b08003a2960 after lost signal to thread 1691
W20260709 13:01:16.887467  2591 debug-util.cc:398] Leaking SignalData structure 0x7b0800163080 after lost signal to thread 1765
W20260709 13:01:16.893572  2591 debug-util.cc:398] Leaking SignalData structure 0x7b08002bd420 after lost signal to thread 2594
I20260709 13:01:16.927295  1588 raft_consensus.cc:1275] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:01:16.954177  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 369521us
I20260709 13:01:17.095463  3982 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:17.138025  3982 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:17.216260  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:17.177783  3747 consensus_queue.cc:1048] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:01:17.220013  3982 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:01:17.292979  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 123936us
I20260709 13:01:17.418597  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:01:17.567346  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 121899us
I20260709 13:01:17.556224  4008 tablet_bootstrap.cc:492] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:17.504002  3987 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:17.588941  1588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:17.598857  2554 raft_consensus.cc:1217] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 LEARNER]: Deduplicated request from leader. Original: 5.3->[5.4-5.4]   Dedup: 5.4->[]
I20260709 13:01:17.585911  3987 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:17.618692  3987 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:17.619678  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:17.628855  4008 tablet_bootstrap.cc:492] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap complete.
I20260709 13:01:17.635947  4069 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:17.651513  3987 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:17.710001  4008 ts_tablet_manager.cc:1403] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent bootstrapping tablet: real 1.234s	user 0.030s	sys 0.059s
W20260709 13:01:17.734422  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 125017us
I20260709 13:01:17.778666  1588 raft_consensus.cc:606] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:17.779392  1588 raft_consensus.cc:614] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:17.792102  4031 raft_consensus.cc:1064] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91: attempting to promote NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 to VOTER
I20260709 13:01:17.713559  3987 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:17.798650  4031 consensus_queue.cc:237] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:01:17.800734  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 96328.1us
I20260709 13:01:17.713250  4069 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
W20260709 13:01:17.824553  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 105863us
I20260709 13:01:17.831974  3987 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:17.834172  4069 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:01:17.840606  1538 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:01:17.841053  1538 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 40fb069a8f6e4d0c885835eee0132b00 already in progress
W20260709 13:01:17.841362  1538 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 40fb069a8f6e4d0c885835eee0132b00 already in progress
I20260709 13:01:17.760831  4008 raft_consensus.cc:359] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:17.849972  3631 raft_consensus.cc:993] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:17.851778  3631 raft_consensus.cc:1081] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:17.853986  4008 raft_consensus.cc:740] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Initialized, Role: LEARNER
I20260709 13:01:17.856083  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:17.859877  4008 consensus_queue.cc:260] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:17.898671  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:17.902369  1707 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:17.928467  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:17.929703  1664 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39146
I20260709 13:01:17.930012  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:17.930307  1664 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:17.930711  1664 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:17.920454  4066 raft_consensus.cc:2749] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:17.949652  4008 ts_tablet_manager.cc:1434] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent starting tablet: real 0.219s	user 0.007s	sys 0.006s
I20260709 13:01:17.953598  1601 tablet_copy_service.cc:342] P 6d4de2ce0683442498244b9529127f91: Request end of tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-40fb069a8f6e4d0c885835eee0132b00 received from {username='slave'} at 127.0.0.1:46836
I20260709 13:01:17.954098  1601 tablet_copy_service.cc:434] P 6d4de2ce0683442498244b9529127f91: ending tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-40fb069a8f6e4d0c885835eee0132b00 on tablet 40fb069a8f6e4d0c885835eee0132b00 with peer 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:17.965685  1664 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:17.914635  4087 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:17.968199  1661 raft_consensus.cc:1240] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:17.968564  4087 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:17.975207  4087 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:17.975334  2554 raft_consensus.cc:1275] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 LEARNER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:17.996613  1664 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:17.997620  4073 consensus_queue.cc:1048] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:18.009510  4031 consensus_queue.cc:1059] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:18.010973  4033 raft_consensus.cc:3055] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:18.011417  4033 raft_consensus.cc:740] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:18.017747  1664 raft_consensus.cc:1275] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:18.012478  4033 consensus_queue.cc:260] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
W20260709 13:01:18.029263  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 94809.5us
I20260709 13:01:18.037338  1633 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:18.038424  4082 raft_consensus.cc:2749] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:18.039387  1737 raft_consensus.cc:1275] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:18.040997  1633 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:18.041857  4082 raft_consensus.cc:2749] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:18.045652  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:18.046247  1740 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:18.049033  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:18.054257  4033 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:18.080682  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:18.085541  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:18.085821  1585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:18.094820  4085 raft_consensus.cc:1064] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91: attempting to promote NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 to VOTER
I20260709 13:01:18.106528  1740 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 5.
I20260709 13:01:18.108201  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:18.097980  4085 consensus_queue.cc:237] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 2, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:18.110664  1633 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:18.115628  4091 raft_consensus.cc:2804] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:18.116201  4091 raft_consensus.cc:697] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 5 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:18.117216  4091 consensus_queue.cc:237] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:18.127358  3962 consensus_queue.cc:1048] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:18.135391  1707 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:18.144901  4066 raft_consensus.cc:2749] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:18.152300  1585 raft_consensus.cc:606] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:18.152817  1585 raft_consensus.cc:614] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:18.154410  1588 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5.
W20260709 13:01:18.158820  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 46462.8us
I20260709 13:01:18.160111  3962 consensus_queue.cc:1048] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:18.178413  1490 catalog_manager.cc:5697] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 4 to 5, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 5 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:18.226898  3908 raft_consensus.cc:2955] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 6 to 7, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:18.229841  1585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:18.230470  1707 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:18.230924  1585 raft_consensus.cc:606] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:18.232673  1658 raft_consensus.cc:2955] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:18.234440  1664 raft_consensus.cc:1275] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:18.235549  4069 raft_consensus.cc:2764] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:01:18.248346  2554 raft_consensus.cc:1275] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 LEARNER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:18.246407  4073 consensus_queue.cc:1048] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:01:18.252375  4067 consensus_queue.cc:1048] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:18.257882  1588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:18.258782  1588 raft_consensus.cc:606] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
W20260709 13:01:18.266665  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 89559.5us
I20260709 13:01:18.272142  1588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9831da869404fb79a22d3887701ca69"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:18.276763  1588 raft_consensus.cc:606] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:18.284154  1739 raft_consensus.cc:1275] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:18.291232   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:18.295038   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:18.414921  4030 raft_consensus.cc:2955] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index 4 to 5, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:18.417963  2554 raft_consensus.cc:2955] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:18.424437  4073 consensus_queue.cc:1048] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:18.432861  1664 raft_consensus.cc:2955] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 4 to 5, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:18.452482  1739 raft_consensus.cc:2955] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:18.503984  1589 raft_consensus.cc:1275] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:18.509707  4033 raft_consensus.cc:993] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:18.515197  3319 consensus_queue.cc:1048] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:18.516263  1740 raft_consensus.cc:2955] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 4 to 5, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:18.521554  1488 catalog_manager.cc:5697] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: config changed from index 6 to 7, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:18.512353  2553 raft_consensus.cc:2955] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 4 to 5, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:18.513319  4056 raft_consensus.cc:1081] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:18.563719  1658 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c9831da869404fb79a22d3887701ca69"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39146
I20260709 13:01:18.564323  1658 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:18.564728  1658 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:18.576360  1658 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:18.580314  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:18.580929  1658 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:18.581023  1588 raft_consensus.cc:3055] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:18.581641  1588 raft_consensus.cc:740] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:18.582413  1588 consensus_queue.cc:260] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:18.583570  1588 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:18.585561  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:18.586166  1739 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:18.593425  1739 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 6.
I20260709 13:01:18.595023  1633 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:18.596805  3319 raft_consensus.cc:2804] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:18.597297  3319 raft_consensus.cc:697] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:18.603664  1588 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 6.
I20260709 13:01:18.602438  3319 consensus_queue.cc:237] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:18.608713  4084 raft_consensus.cc:993] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:18.609830  4073 raft_consensus.cc:1081] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Signalling peer 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:18.621346  1737 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:43678
I20260709 13:01:18.622027  1737 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:18.622421  1737 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:18.624519  2553 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 LEARNER]: Advancing to term 5
I20260709 13:01:18.666221  1739 raft_consensus.cc:1275] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:18.667742  4091 consensus_queue.cc:1048] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:18.681164  2553 raft_consensus.cc:1275] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 LEARNER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:18.693872  4091 consensus_queue.cc:1048] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:18.706946  1737 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:18.714191  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:18.714984  1658 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:18.723120  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:18.724043  1585 raft_consensus.cc:3055] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:18.724437  1585 raft_consensus.cc:740] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:18.726269  1737 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:18.725931  1585 consensus_queue.cc:260] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:18.730546  1658 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:01:18.717749  1486 catalog_manager.cc:5697] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 reported cstate change: config changed from index 4 to 5, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:18.734328  1705 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:18.735144  1585 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:18.752373  3866 raft_consensus.cc:2804] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:18.760298  1585 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:01:18.755749  3866 raft_consensus.cc:697] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:18.789842  4056 raft_consensus.cc:993] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:18.797762  3981 raft_consensus.cc:1081] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:18.800942  1665 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39146
I20260709 13:01:18.801609  1665 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:18.801976  1665 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:18.814092  1665 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:18.817127  1665 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:18.821264  3866 consensus_queue.cc:237] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:18.825749  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:18.826646  1736 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:18.827564  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:18.829478  1589 raft_consensus.cc:3055] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:18.829803  1589 raft_consensus.cc:740] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:18.830466  1589 consensus_queue.cc:260] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:18.861620  1589 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:18.887959  1488 catalog_manager.cc:5697] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 5 to 6, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 6 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:18.892716  1585 consensus_queue.cc:237] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:18.901638  1590 consensus_queue.cc:237] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:18.921761  1736 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
I20260709 13:01:18.921888  1589 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
I20260709 13:01:18.924986  1664 raft_consensus.cc:1275] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:18.925710  1665 raft_consensus.cc:1275] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:18.927160  1633 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:18.920439  2554 raft_consensus.cc:1275] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:18.932930  3962 consensus_queue.cc:1048] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:01:18.937754  2552 raft_consensus.cc:1275] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:18.933346  4084 consensus_queue.cc:1048] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:01:18.930265  4082 raft_consensus.cc:2804] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:18.955806  3981 consensus_queue.cc:1048] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:18.956487  3962 consensus_queue.cc:1048] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:01:18.956532  4082 raft_consensus.cc:697] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:18.969193  4071 raft_consensus.cc:2955] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 5 to 6, VOTER 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:18.971292  4082 consensus_queue.cc:237] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:18.981385  3908 raft_consensus.cc:2955] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Committing config change with OpId 6.8: config changed from index 7 to 8, VOTER 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:18.982573  1664 raft_consensus.cc:2955] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, VOTER 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:18.992115  2553 raft_consensus.cc:2955] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Committing config change with OpId 6.8: config changed from index 7 to 8, VOTER 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:19.001803  4081 raft_consensus.cc:1064] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede: attempting to promote NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 to VOTER
I20260709 13:01:19.004733  4081 consensus_queue.cc:237] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:19.050869  2552 raft_consensus.cc:2955] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, VOTER 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:19.055689  1490 catalog_manager.cc:5697] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 3 to 4, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 4 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:19.060776  2554 raft_consensus.cc:1275] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 LEARNER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:19.062773  4091 consensus_queue.cc:1048] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:19.064870  1477 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0d14bd0bd4204ece94fb1bfe29d407f8 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:19.080488  1739 raft_consensus.cc:1275] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:19.131047  4091 consensus_queue.cc:1048] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:19.142532  1490 catalog_manager.cc:5697] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 9 to 10, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 10 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:19.148788  1488 catalog_manager.cc:5697] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: config changed from index 7 to 8, VOTER 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) evicted. New cstate: current_term: 6 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:19.163877  1725 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d14bd0bd4204ece94fb1bfe29d407f8 with delete_type TABLET_DATA_TOMBSTONED (TS 5ced62816f8545cd9b63a27e9055e42d not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:43674
I20260709 13:01:19.174646  4117 tablet_replica.cc:333] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:01:19.184031  4117 raft_consensus.cc:2243] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:19.185233  4117 raft_consensus.cc:2272] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:19.186404  1490 catalog_manager.cc:5697] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: config changed from index 5 to 6, VOTER 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) evicted. New cstate: current_term: 5 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:19.196468  3319 raft_consensus.cc:2955] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index 3 to 5, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
W20260709 13:01:19.200306  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 129753us
W20260709 13:01:19.203991  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 129449us
I20260709 13:01:19.206941  1477 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f52de8c1489f4f9aabb361c6c02bb3de with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:19.211980  1737 raft_consensus.cc:1275] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:19.215114  4117 ts_tablet_manager.cc:1916] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:19.214450  1739 raft_consensus.cc:2955] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 3 to 5, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:19.233768  4081 consensus_queue.cc:1048] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:19.239506  1664 raft_consensus.cc:2955] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Committing config change with OpId 6.8: config changed from index 7 to 8, VOTER 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:19.248550  1588 raft_consensus.cc:1275] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:19.252604  1588 raft_consensus.cc:1275] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:19.272317  2552 raft_consensus.cc:2955] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 3 to 5, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:19.297736   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:19.316542  1488 catalog_manager.cc:5697] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: config changed from index 3 to 5, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:19.319172  1725 tablet_service.cc:1558] Processing DeleteTablet for tablet f52de8c1489f4f9aabb361c6c02bb3de with delete_type TABLET_DATA_TOMBSTONED (TS 5ced62816f8545cd9b63a27e9055e42d not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:43674
I20260709 13:01:19.329770  3319 consensus_queue.cc:1048] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:19.352519  1661 consensus_queue.cc:237] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:01:19.369503  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 63921.2us
I20260709 13:01:19.370949  4081 consensus_queue.cc:1048] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:01:19.383283  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 61136.1us
I20260709 13:01:19.391595  1590 raft_consensus.cc:1275] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:19.392983  1739 raft_consensus.cc:1275] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:19.391304  1588 raft_consensus.cc:2955] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 3 to 5, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:19.394521  2553 raft_consensus.cc:1275] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:19.413160  4091 consensus_queue.cc:1048] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:19.416108  4091 consensus_queue.cc:1048] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:19.426795  4117 ts_tablet_manager.cc:1929] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.7
I20260709 13:01:19.427534  4117 log.cc:1199] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5ced62816f8545cd9b63a27e9055e42d: Deleting WAL directory at /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-2-root/wals/0d14bd0bd4204ece94fb1bfe29d407f8
I20260709 13:01:19.430560  1477 catalog_manager.cc:5028] TS 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): tablet 0d14bd0bd4204ece94fb1bfe29d407f8 (table test-workload [id=8a8e3153ff4e476f890a0820215f177a]) successfully deleted
I20260709 13:01:19.431291  4117 tablet_replica.cc:333] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:01:19.433192  4117 raft_consensus.cc:2243] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:19.445170  2552 raft_consensus.cc:2955] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, VOTER 6d4de2ce0683442498244b9529127f91 (127.0.107.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:19.463792  1661 raft_consensus.cc:1275] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:01:19.465596  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 74290.2us
I20260709 13:01:19.451982  4091 raft_consensus.cc:2955] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 5 to 6, VOTER 6d4de2ce0683442498244b9529127f91 (127.0.107.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:19.474535  1590 raft_consensus.cc:1275] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:19.486874  4069 consensus_queue.cc:1048] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:19.488379  4069 consensus_queue.cc:1048] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:19.501169  4082 consensus_queue.cc:1048] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:19.506983  1739 raft_consensus.cc:2955] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, VOTER 6d4de2ce0683442498244b9529127f91 (127.0.107.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:19.511369  1737 raft_consensus.cc:1275] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:19.528964  4117 raft_consensus.cc:2272] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:19.534344  4117 ts_tablet_manager.cc:1916] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:19.539837  4082 consensus_queue.cc:1048] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:19.564280  1489 catalog_manager.cc:5697] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: config changed from index 5 to 6, VOTER 6d4de2ce0683442498244b9529127f91 (127.0.107.193) evicted. New cstate: current_term: 5 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
W20260709 13:01:19.651114  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 69206.6us
I20260709 13:01:19.682336   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:19.653224  1581 tablet_service.cc:1558] Processing DeleteTablet for tablet 40fb069a8f6e4d0c885835eee0132b00 with delete_type TABLET_DATA_TOMBSTONED (TS 6d4de2ce0683442498244b9529127f91 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:59092
I20260709 13:01:19.719828  1475 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 40fb069a8f6e4d0c885835eee0132b00 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:19.728853  4134 tablet_replica.cc:333] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:01:19.730230  4134 raft_consensus.cc:2243] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:19.731074  4134 raft_consensus.cc:2272] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:19.836622  4117 ts_tablet_manager.cc:1929] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.5
I20260709 13:01:19.837356  4117 log.cc:1199] T f52de8c1489f4f9aabb361c6c02bb3de P 5ced62816f8545cd9b63a27e9055e42d: Deleting WAL directory at /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-2-root/wals/f52de8c1489f4f9aabb361c6c02bb3de
W20260709 13:01:19.881281  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 111649us
I20260709 13:01:19.864513  1477 catalog_manager.cc:5028] TS 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): tablet f52de8c1489f4f9aabb361c6c02bb3de (table test-workload [id=8a8e3153ff4e476f890a0820215f177a]) successfully deleted
W20260709 13:01:19.915702  1477 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 51214us
I20260709 13:01:19.917311  1588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:19.917959  1588 raft_consensus.cc:606] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
W20260709 13:01:19.939644  4131 log.cc:927] Time spent T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:01:19.941354  4134 ts_tablet_manager.cc:1916] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:20.007117  1588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:20.007771  1588 raft_consensus.cc:606] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:20.021410  1588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:20.022404  1588 raft_consensus.cc:606] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:20.027842  1592 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:20.028497  1592 raft_consensus.cc:606] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:20.039635  1592 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:20.040345  1592 raft_consensus.cc:606] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:20.051581  4134 ts_tablet_manager.cc:1929] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.5
I20260709 13:01:20.053941   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:20.063892   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:20.065550  4134 log.cc:1199] T 40fb069a8f6e4d0c885835eee0132b00 P 6d4de2ce0683442498244b9529127f91: Deleting WAL directory at /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-0-root/wals/40fb069a8f6e4d0c885835eee0132b00
I20260709 13:01:20.074594  1477 catalog_manager.cc:5028] TS 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): tablet 40fb069a8f6e4d0c885835eee0132b00 (table test-workload [id=8a8e3153ff4e476f890a0820215f177a]) successfully deleted
I20260709 13:01:20.098619  4033 raft_consensus.cc:993] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:20.099308  4033 raft_consensus.cc:1081] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:20.110849  1665 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39146
I20260709 13:01:20.112511  1665 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:20.112954  1665 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:20.135747  1665 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:20.142323  1665 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:20.149866  4056 raft_consensus.cc:993] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:20.150384  4030 raft_consensus.cc:1081] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Signalling peer 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:20.155500  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:20.156059  1740 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:20.157600  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:20.158206  1588 raft_consensus.cc:3055] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:20.158532  1588 raft_consensus.cc:740] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:20.159195  1588 consensus_queue.cc:260] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:20.160144  1588 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:20.166864  1739 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:43678
I20260709 13:01:20.167810  1739 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:20.168176  1739 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:20.169330  1740 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 6.
I20260709 13:01:20.172679  1588 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 6.
I20260709 13:01:20.175001  4074 raft_consensus.cc:993] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:20.178162  4074 raft_consensus.cc:1081] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Signalling peer 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:20.187973  1732 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:43678
I20260709 13:01:20.188725  1732 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:20.189200  1732 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:20.200966  1732 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:20.203373  1732 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:20.222210  1633 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:20.223951  3319 raft_consensus.cc:2804] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:20.224462  3319 raft_consensus.cc:697] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:20.225344  3319 consensus_queue.cc:237] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:20.227648  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:20.228370  1590 raft_consensus.cc:3055] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:20.228677  1590 raft_consensus.cc:740] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:20.229486  1590 consensus_queue.cc:260] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:20.231226  1590 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:20.237112  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:20.237797  1664 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:20.246312  1664 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:01:20.258492  1739 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:20.265249  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:20.265862  1588 raft_consensus.cc:3055] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:20.266172  1588 raft_consensus.cc:740] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:20.267072  1588 consensus_queue.cc:260] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:20.268213  1588 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:20.273203  1705 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:20.273517  1739 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:20.274406  4086 raft_consensus.cc:2804] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:20.274919  4086 raft_consensus.cc:697] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 9 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:20.275781  4086 consensus_queue.cc:237] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:20.285259  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:20.287344  1665 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:20.290130  1588 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5.
I20260709 13:01:20.291323  1707 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:20.292335  3866 raft_consensus.cc:2804] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:20.292819  3866 raft_consensus.cc:697] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 5 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:20.293653  3866 consensus_queue.cc:237] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:20.310055  1486 catalog_manager.cc:5697] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 8 to 9, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 9 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:20.353461  4074 raft_consensus.cc:993] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:20.353992  4074 raft_consensus.cc:1081] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Signalling peer 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:20.357859  1732 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:43678
I20260709 13:01:20.358541  1732 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:20.358930  1732 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:20.365531  1590 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:01:20.367623  1665 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5.
I20260709 13:01:20.369856  1732 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:20.373276  1732 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:20.378818  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:20.382717  1590 raft_consensus.cc:3055] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:20.383153  1590 raft_consensus.cc:740] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:20.383880  1590 consensus_queue.cc:260] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:20.377562  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:20.386207  1665 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:20.407407  1590 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:20.407940  1665 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:01:20.409641  1705 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:20.410491  3866 raft_consensus.cc:2804] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:20.411003  3866 raft_consensus.cc:697] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:20.411952  3866 consensus_queue.cc:237] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:20.422572  3969 raft_consensus.cc:993] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:20.423090  3969 raft_consensus.cc:1081] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:20.423840  1590 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:01:20.430557  1664 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39146
I20260709 13:01:20.431156  1664 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:20.431537  1664 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:20.439350  1664 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:20.446758  1489 catalog_manager.cc:5697] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 5 to 6, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 6 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:20.474557  1664 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:20.479044  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:20.479699  1732 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:20.482060  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:20.482796  1590 raft_consensus.cc:3055] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:20.483084  1590 raft_consensus.cc:740] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:20.483834  1590 consensus_queue.cc:260] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:20.485035  1590 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:20.505589  1732 raft_consensus.cc:2468] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 4.
I20260709 13:01:20.505180  1489 catalog_manager.cc:5697] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 4 to 5, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 5 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:20.507120  1633 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:20.507896  3319 raft_consensus.cc:2804] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:20.507943  1489 catalog_manager.cc:5697] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 3 to 4, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 4 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:20.508541  3319 raft_consensus.cc:697] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 4 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:20.511116  3319 consensus_queue.cc:237] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:20.516045  1590 raft_consensus.cc:2468] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 4.
I20260709 13:01:20.560573  1489 catalog_manager.cc:5697] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 3 to 4, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 4 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:20.714445  1590 raft_consensus.cc:1275] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:20.718698  4086 consensus_queue.cc:1048] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:20.739207  1732 raft_consensus.cc:1275] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:20.741518  3319 consensus_queue.cc:1048] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:20.746132  1739 consensus_queue.cc:237] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:20.751995  1590 raft_consensus.cc:1275] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:20.758026  3319 consensus_queue.cc:1048] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:01:20.774020  1704 consensus_peers.cc:597] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d -> Peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157): Couldn't send request to peer 7e839e91a1314c2f9a99b25b17c916a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d1fb6d43d14545a9872b287d4096ff1a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:20.775130  1592 raft_consensus.cc:1275] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:20.775713  1665 raft_consensus.cc:1275] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:20.779495  3866 consensus_queue.cc:1048] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:20.782321  4075 consensus_queue.cc:1048] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:20.811273  1664 raft_consensus.cc:1275] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:20.813563  3866 consensus_queue.cc:1048] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:20.869279  1661 raft_consensus.cc:1275] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:20.938995  1588 raft_consensus.cc:1275] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:20.927240  3866 consensus_queue.cc:1048] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:01:20.962497  4157 raft_consensus.cc:2955] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
W20260709 13:01:20.965160  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 73015.1us
I20260709 13:01:20.960294  4086 consensus_queue.cc:1048] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:01:21.066022   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:01:21.081398  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 116506us
W20260709 13:01:21.090149  4150 log.cc:927] Time spent T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.051s	user 0.001s	sys 0.002s
W20260709 13:01:21.117339  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 182606us
I20260709 13:01:21.144826  1590 raft_consensus.cc:1275] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:01:21.158381  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 217699us
W20260709 13:01:21.177165  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 96091.3us
I20260709 13:01:21.193763  1732 raft_consensus.cc:1275] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:21.219128  4164 consensus_queue.cc:1048] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:01:21.249953  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 57009.2us
W20260709 13:01:21.269872  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 51399.4us
I20260709 13:01:21.273070  4175 ts_tablet_manager.cc:933] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6: Initiating tablet copy from peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:21.280200  1590 raft_consensus.cc:1275] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:21.297140   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:21.311462  1489 catalog_manager.cc:5697] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: config changed from index -1 to 6, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New cstate: current_term: 8 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:21.320364  4175 tablet_copy_client.cc:323] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:32843
I20260709 13:01:21.319559  4132 consensus_queue.cc:1048] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:01:21.362138  1661 raft_consensus.cc:1275] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:21.364838  1665 raft_consensus.cc:2955] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:21.383201  4086 consensus_queue.cc:1048] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:21.384548  1589 raft_consensus.cc:2955] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:21.391824  1751 tablet_copy_service.cc:140] P 5ced62816f8545cd9b63a27e9055e42d: Received BeginTabletCopySession request for tablet d1fb6d43d14545a9872b287d4096ff1a from peer 7e839e91a1314c2f9a99b25b17c916a6 ({username='slave'} at 127.0.0.1:35672)
I20260709 13:01:21.392464  1751 tablet_copy_service.cc:161] P 5ced62816f8545cd9b63a27e9055e42d: Beginning new tablet copy session on tablet d1fb6d43d14545a9872b287d4096ff1a from peer 7e839e91a1314c2f9a99b25b17c916a6 at {username='slave'} at 127.0.0.1:35672: session id = 7e839e91a1314c2f9a99b25b17c916a6-d1fb6d43d14545a9872b287d4096ff1a
W20260709 13:01:21.423110  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 113216us
I20260709 13:01:21.462968  4170 consensus_queue.cc:1048] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:01:21.477450  1592 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:21.478132  1592 raft_consensus.cc:606] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:21.571689  4033 raft_consensus.cc:993] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:21.572239  4033 raft_consensus.cc:1081] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:21.581419  1660 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39146
I20260709 13:01:21.582015  1660 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:21.582374  1660 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:21.582937  1589 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:21.583737  1589 raft_consensus.cc:606] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:21.610941  1589 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:21.611747  1589 raft_consensus.cc:606] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:21.620957  1751 tablet_copy_source_session.cc:215] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:21.625228  4175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1fb6d43d14545a9872b287d4096ff1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:21.643646  1589 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:21.644286  1589 raft_consensus.cc:606] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:21.664880  1589 consensus_queue.cc:237] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:21.675657  1590 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:21.676576  1590 raft_consensus.cc:606] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:21.678224   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:21.680040   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:21.650425  1660 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:21.689906  1660 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:21.693886  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 165438us
I20260709 13:01:21.700832  4030 raft_consensus.cc:993] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:21.701529  4030 raft_consensus.cc:1081] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Signalling peer 5ced62816f8545cd9b63a27e9055e42d to start an election
W20260709 13:01:21.702581  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 88307.8us
I20260709 13:01:21.714689  1732 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:43678
I20260709 13:01:21.715301  1732 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:21.715652  1732 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:21.731840  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:21.732149  1732 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:21.735606  1732 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:21.732509  1736 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:21.757385  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:21.758021  1592 raft_consensus.cc:3055] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:21.758280  1592 raft_consensus.cc:740] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:21.854535  4074 raft_consensus.cc:993] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:21.838637  4175 tablet_copy_client.cc:806] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:21.858677  4172 raft_consensus.cc:1081] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:21.858846  4175 tablet_copy_client.cc:670] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:21.761112  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:01:21.816577  1555 consensus_peers.cc:597] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 -> Peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157): Couldn't send request to peer 7e839e91a1314c2f9a99b25b17c916a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 67b5a70a2de54935b60554301e6de808. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:21.860121  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 43715.9us
I20260709 13:01:21.772282  1592 consensus_queue.cc:260] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:21.862447  1592 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:21.863293  4175 tablet_copy_client.cc:538] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:21.773830  1736 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 7.
I20260709 13:01:21.758520  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:21.869807  1664 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:21.873137  1587 raft_consensus.cc:3055] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:21.873558  1587 raft_consensus.cc:740] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:21.874377  1587 consensus_queue.cc:260] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:21.875769  1587 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:21.885550  1660 raft_consensus.cc:1240] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:21.891412  1660 raft_consensus.cc:1275] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:21.894188  4175 tablet_bootstrap.cc:492] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap starting.
I20260709 13:01:21.894444  1633 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:21.897003  1660 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39146
I20260709 13:01:21.897647  1660 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:21.898043  1660 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:21.901129  1592 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 7.
I20260709 13:01:21.901777  1732 raft_consensus.cc:1275] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:21.919281  4194 raft_consensus.cc:2804] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:21.905958  1664 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:01:21.926170  4194 raft_consensus.cc:697] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 7 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:21.927134  4194 consensus_queue.cc:237] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:21.933386  1587 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:01:21.946014  1705 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:21.947118  4192 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:21.947649  4192 raft_consensus.cc:697] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 9 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:21.948670  4192 consensus_queue.cc:237] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:21.962565  1660 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:21.968780  1660 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:21.987887  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:21.988559  1732 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:21.996897  1732 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 9.
I20260709 13:01:22.007251  1633 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
W20260709 13:01:22.017339  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 100518us
I20260709 13:01:22.049837  4174 raft_consensus.cc:2804] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:01:22.050772  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 140780us
I20260709 13:01:22.050712  4174 raft_consensus.cc:697] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 9 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:22.052836  4174 consensus_queue.cc:237] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:22.046638  1489 catalog_manager.cc:5697] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 8 to 9, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 9 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:22.065675  4159 consensus_queue.cc:1048] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:22.065167  1488 catalog_manager.cc:5697] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 6 to 7, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 7 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:22.070042  4172 consensus_queue.cc:1048] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:22.135521  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:22.136183  1585 raft_consensus.cc:3055] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:22.136489  1585 raft_consensus.cc:740] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:22.137300  1585 consensus_queue.cc:260] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:22.139498  1585 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:22.152596  1585 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 9.
I20260709 13:01:22.186913  4120 raft_consensus.cc:993] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:22.187580  4120 raft_consensus.cc:1081] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Signalling peer 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:22.218750  4120 raft_consensus.cc:993] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:22.219260  4120 raft_consensus.cc:1081] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:22.223166  1740 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:43678
I20260709 13:01:22.224249  1740 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:22.224884  1740 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:22.229234  4200 raft_consensus.cc:2955] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Committing config change with OpId 4.3: config changed from index -1 to 3, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:22.238072  1740 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:22.247087  1488 catalog_manager.cc:5697] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 8 to 9, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 9 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:22.286509  1736 raft_consensus.cc:2955] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Committing config change with OpId 4.3: config changed from index -1 to 3, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:22.291312  1660 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39146
I20260709 13:01:22.291920  1660 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:22.292291  1660 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:22.297292  1489 catalog_manager.cc:5697] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 reported cstate change: config changed from index -1 to 3, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New cstate: current_term: 4 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:22.307897  1740 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:22.314009  1661 raft_consensus.cc:2955] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Committing config change with OpId 4.3: config changed from index -1 to 3, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:22.317836  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:22.318511  1665 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:22.323675  1660 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:22.326752  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:22.327365  1590 raft_consensus.cc:3055] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:22.327680  1590 raft_consensus.cc:740] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:22.331561  1590 consensus_queue.cc:260] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:22.332481  1590 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:22.336014  1740 consensus_queue.cc:237] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:22.344724  1590 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 7.
I20260709 13:01:22.345999  1633 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:22.346866  4161 raft_consensus.cc:2804] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:22.347878  4161 raft_consensus.cc:697] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 7 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:22.349145  1665 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:01:22.348853  4161 consensus_queue.cc:237] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:22.357841  1705 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:22.359323  4192 raft_consensus.cc:2804] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:22.359511  1660 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:22.360199  4192 raft_consensus.cc:697] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:22.361337  4192 consensus_queue.cc:237] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:22.373224  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:22.373891  1592 raft_consensus.cc:3055] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:22.374230  1592 raft_consensus.cc:740] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:22.374951  1592 consensus_queue.cc:260] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:22.376247  1592 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:22.375965  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:22.377570  1736 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:22.380283  1661 raft_consensus.cc:1275] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:01:22.385224  4075 consensus_queue.cc:1048] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:01:22.375345  4175 log.cc:927] Time spent T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.093s	user 0.002s	sys 0.000s
I20260709 13:01:22.394038  1736 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 7.
I20260709 13:01:22.394686  4175 tablet_bootstrap.cc:492] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:22.394778  1739 raft_consensus.cc:1240] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:22.395843  4175 tablet_bootstrap.cc:492] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap complete.
I20260709 13:01:22.396631  4175 ts_tablet_manager.cc:1403] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6: Time spent bootstrapping tablet: real 0.503s	user 0.035s	sys 0.011s
I20260709 13:01:22.403944  1592 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:01:22.423225  4175 raft_consensus.cc:359] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:22.424608  4175 raft_consensus.cc:740] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Initialized, Role: LEARNER
I20260709 13:01:22.426776  4175 consensus_queue.cc:260] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:22.429379  4175 ts_tablet_manager.cc:1434] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.004s
I20260709 13:01:22.433823  1751 tablet_copy_service.cc:342] P 5ced62816f8545cd9b63a27e9055e42d: Request end of tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-d1fb6d43d14545a9872b287d4096ff1a received from {username='slave'} at 127.0.0.1:35672
I20260709 13:01:22.613950  1751 tablet_copy_service.cc:434] P 5ced62816f8545cd9b63a27e9055e42d: ending tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-d1fb6d43d14545a9872b287d4096ff1a on tablet d1fb6d43d14545a9872b287d4096ff1a with peer 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:22.615396  1489 catalog_manager.cc:5697] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 5 to 6, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 6 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:22.618053  1488 catalog_manager.cc:5697] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 6 to 7, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 7 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:22.618891  2552 raft_consensus.cc:1217] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 LEARNER]: Deduplicated request from leader. Original: 8.5->[8.6-8.6]   Dedup: 8.6->[]
I20260709 13:01:22.653576  4175 ts_tablet_manager.cc:933] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6: Initiating tablet copy from peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:01:22.668540  1736 raft_consensus.cc:1275] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:22.681033   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:01:22.693210  1704 consensus_peers.cc:597] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d -> Peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157): Couldn't send request to peer 7e839e91a1314c2f9a99b25b17c916a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 03d9f5135e0d4c0091fe4ba5bed83ffd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:22.701745  1660 raft_consensus.cc:1275] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:22.711437  1736 raft_consensus.cc:1275] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:22.751291  4175 tablet_copy_client.cc:323] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:33325
I20260709 13:01:22.771216  1592 raft_consensus.cc:1275] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:01:22.771915  1585 raft_consensus.cc:1275] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:22.772852  1592 raft_consensus.cc:1275] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:22.785287  1601 tablet_copy_service.cc:140] P 6d4de2ce0683442498244b9529127f91: Received BeginTabletCopySession request for tablet 67b5a70a2de54935b60554301e6de808 from peer 7e839e91a1314c2f9a99b25b17c916a6 ({username='slave'} at 127.0.0.1:46836)
I20260709 13:01:22.789656  1601 tablet_copy_service.cc:161] P 6d4de2ce0683442498244b9529127f91: Beginning new tablet copy session on tablet 67b5a70a2de54935b60554301e6de808 from peer 7e839e91a1314c2f9a99b25b17c916a6 at {username='slave'} at 127.0.0.1:46836: session id = 7e839e91a1314c2f9a99b25b17c916a6-67b5a70a2de54935b60554301e6de808
I20260709 13:01:22.787726  4086 consensus_queue.cc:1048] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:01:22.798306  1590 raft_consensus.cc:1275] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:22.800716  1601 tablet_copy_source_session.cc:215] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:22.765543  4165 consensus_queue.cc:1048] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:01:22.817276  4175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67b5a70a2de54935b60554301e6de808. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:01:22.834283  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 52846us
I20260709 13:01:22.835418  4086 consensus_queue.cc:1048] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:22.839125  4086 consensus_queue.cc:1048] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:22.852334  3866 raft_consensus.cc:1064] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d: attempting to promote NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 to VOTER
I20260709 13:01:22.855180  3866 consensus_queue.cc:237] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 4, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:01:22.857758  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 84033.1us
I20260709 13:01:22.863508  4164 consensus_queue.cc:1048] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:22.873698  4192 consensus_queue.cc:1048] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:22.884555  4175 tablet_copy_client.cc:806] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:22.886288  1587 raft_consensus.cc:1275] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:22.890379  4175 tablet_copy_client.cc:670] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:22.895664  4175 tablet_copy_client.cc:538] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:22.966454   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:01:22.971177  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 100353us
I20260709 13:01:22.947146  4224 consensus_queue.cc:1048] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
W20260709 13:01:23.052071  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 172291us
W20260709 13:01:23.092978  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 154151us
W20260709 13:01:23.090863  4226 log.cc:927] Time spent T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:01:23.101490  4224 consensus_queue.cc:1048] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:23.100762  2552 raft_consensus.cc:1275] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 LEARNER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:01:23.182157  1585 raft_consensus.cc:1275] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:23.188295  1588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:23.188952  1588 raft_consensus.cc:606] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:23.193163  4175 tablet_bootstrap.cc:492] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap starting.
I20260709 13:01:23.204032  1585 raft_consensus.cc:1275] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:01:23.206007  1667 raft_consensus.cc:1275] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:23.207086  1660 raft_consensus.cc:1275] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:01:23.216444  4075 raft_consensus.cc:2955] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:23.218153  1586 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:23.218741  1586 raft_consensus.cc:606] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:23.201350  4223 consensus_queue.cc:1048] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:01:23.239228  1739 raft_consensus.cc:1275] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:23.267634  1590 raft_consensus.cc:2955] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:23.296111  4155 consensus_queue.cc:1048] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
W20260709 13:01:23.342813  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 43977.7us
I20260709 13:01:23.304648  4237 consensus_queue.cc:1048] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:01:23.324028  4132 consensus_queue.cc:1048] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:01:23.354928  3866 consensus_queue.cc:1048] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:01:23.355737  4239 log.cc:927] Time spent T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:01:23.364125  4246 ts_tablet_manager.cc:933] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6: Initiating tablet copy from peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:23.384727  4075 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:35682 (request call id 3) took 1051 ms. Trace:
I20260709 13:01:23.385265  4075 rpcz_store.cc:276] 0709 13:01:22.333779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.333935 (+   156us) service_pool.cc:224] Handling call
0709 13:01:22.356242 (+ 22307us) log.cc:844] Serialized 506 byte log entry
0709 13:01:22.615754 (+259512us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b18003f4240. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7de1cc0a 00007f1b8755c219 00007f1b7dea4a40 00007f1b7de9f4e4 00007f1b7de9f455 00007f1b80ee8b0b 00007f1b80f6db63 00007f1b80f95752 00007f1b85f55d29
0709 13:01:22.655548 (+ 39794us) spinlock_profiling.cc:243] Waited 9.82 ms on lock 0x7b18000f4aa0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80fcbd01 00007f1b80f08691 00007f1b80ee8eaa 00007f1b80eefd53 00007f1b80eefcd9 00007f1b80eefc69 00007f1b80eefc31 00007f1b80eeedfd 000000000038f354 000000000038f199
0709 13:01:22.658103 (+  2555us) spinlock_profiling.cc:243] Waited 5.25 ms on lock 0x7b18000f4aa0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80fcbd01 00007f1b80f08691 00007f1b80ee8eaa 00007f1b80eefd53 00007f1b80eefcd9 00007f1b80eefc69 00007f1b80eefc31 00007f1b80eeedfd 000000000038f354 000000000038f199
0709 13:01:23.384617 (+726514us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5724,"raft.queue_time_us":363870,"raft.run_cpu_time_us":30537,"raft.run_wall_time_us":295597,"spinlock_wait_cycles":38027776,"thread_start_us":77960,"threads_started":1,"wal-append.queue_time_us":266989}
I20260709 13:01:23.399338  4246 tablet_copy_client.cc:323] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:32843
W20260709 13:01:23.469835  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 170568us
W20260709 13:01:23.546150  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 211032us
I20260709 13:01:23.546518  1751 tablet_copy_service.cc:140] P 5ced62816f8545cd9b63a27e9055e42d: Received BeginTabletCopySession request for tablet 03d9f5135e0d4c0091fe4ba5bed83ffd from peer 7e839e91a1314c2f9a99b25b17c916a6 ({username='slave'} at 127.0.0.1:35672)
I20260709 13:01:23.559223  4175 tablet_bootstrap.cc:700] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent opening tablet: real 0.185s	user 0.008s	sys 0.011s
I20260709 13:01:23.540472  1589 consensus_queue.cc:237] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:23.588440  4218 raft_consensus.cc:993] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:23.589699  4218 raft_consensus.cc:1081] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Signalling peer 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:23.644860  1660 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:40572
I20260709 13:01:23.646275  1751 tablet_copy_service.cc:161] P 5ced62816f8545cd9b63a27e9055e42d: Beginning new tablet copy session on tablet 03d9f5135e0d4c0091fe4ba5bed83ffd from peer 7e839e91a1314c2f9a99b25b17c916a6 at {username='slave'} at 127.0.0.1:35672: session id = 7e839e91a1314c2f9a99b25b17c916a6-03d9f5135e0d4c0091fe4ba5bed83ffd
W20260709 13:01:23.647773  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 76778.9us
I20260709 13:01:23.649483  4165 consensus_queue.cc:1048] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:01:23.683851  1555 consensus_peers.cc:597] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 -> Peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157): Couldn't send request to peer 7e839e91a1314c2f9a99b25b17c916a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f6f62b0e67804bcba2b2f2b49e0b7623. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:23.704994  1660 raft_consensus.cc:606] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 9 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:23.715333  4247 raft_consensus.cc:2955] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index 6 to 7, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:23.719885  2552 raft_consensus.cc:2955] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 6 to 7, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:23.726778  1739 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:43678
I20260709 13:01:23.727555  1739 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:23.728044  1739 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:23.730610  4197 raft_consensus.cc:993] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:23.731410  4200 raft_consensus.cc:1081] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Signalling peer 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:23.736153  1738 raft_consensus.cc:1275] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:01:23.741863  1737 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:55694
I20260709 13:01:23.742580  1737 raft_consensus.cc:606] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 5 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:23.753446  1488 catalog_manager.cc:5697] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: config changed from index -1 to 5, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New cstate: current_term: 7 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:23.782583  4229 raft_consensus.cc:993] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:23.783279  4229 raft_consensus.cc:1081] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 5 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:23.784574  1751 tablet_copy_source_session.cc:215] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:01:23.785236  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 64494.7us
I20260709 13:01:23.793432  1665 raft_consensus.cc:2955] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:23.827584  1739 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:23.837323  1660 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39162
I20260709 13:01:23.838042  1660 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:23.838442  1660 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:23.876281  4252 consensus_queue.cc:1048] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:23.883492  1589 raft_consensus.cc:2955] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 6 to 7, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:23.899199  1739 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:23.916455  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:23.917274  1663 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:23.936131  1660 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:23.946055  1662 raft_consensus.cc:1240] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:23.947974  1663 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:01:23.953603  1737 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:43678
I20260709 13:01:23.954435  1737 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:23.954933  1737 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:23.966302  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:23.966986  1589 raft_consensus.cc:3055] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:23.967394  1589 raft_consensus.cc:740] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:23.981712  1664 raft_consensus.cc:1275] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:01:23.981870  1661 raft_consensus.cc:1240] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:23.992168  1737 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:23.996738  4222 raft_consensus.cc:993] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede: : Instructing follower 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:23.997534  4222 raft_consensus.cc:1081] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 9 LEADER]: Signalling peer 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:24.001488  1737 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:24.008592  1592 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:24.009362  1592 raft_consensus.cc:606] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:24.011380  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:24.016758  1592 raft_consensus.cc:3055] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:24.017297  1592 raft_consensus.cc:740] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:24.020349  1592 consensus_queue.cc:260] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:24.023041  1736 raft_consensus.cc:1240] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:24.022806  1592 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:24.018191  1738 raft_consensus.cc:1240] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:24.025540  1733 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:43686
I20260709 13:01:24.026379  1733 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:24.046888  1733 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:24.015370  4246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03d9f5135e0d4c0091fe4ba5bed83ffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:24.012588  1705 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:24.042500  1665 raft_consensus.cc:2955] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 6 to 7, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:24.012557  1486 catalog_manager.cc:5697] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: config changed from index 6 to 7, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:24.042141  1589 consensus_queue.cc:260] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:24.055075  1589 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:24.062785  1592 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:01:24.066710  1660 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:24.066453  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 54096.4us
I20260709 13:01:24.054323  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:24.068830  1659 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:24.093565  4235 consensus_queue.cc:1059] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:01:24.094739  4192 raft_consensus.cc:2804] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:24.095427  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:24.096222  1584 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:24.099440   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:24.104090  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:24.111152  1659 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:01:24.123961  4192 raft_consensus.cc:697] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:24.125480   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:24.128019  4192 consensus_queue.cc:237] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:24.177974  1707 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:24.201627  1733 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:24.224177  1738 raft_consensus.cc:3055] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:24.224632  1738 raft_consensus.cc:740] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:24.245457  4074 consensus_queue.cc:1048] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:01:24.265799  4075 raft_consensus.cc:2804] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:24.270779  1733 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:24.274004  1584 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 6.
I20260709 13:01:24.261986  1738 consensus_queue.cc:260] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:24.299860  1589 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:01:24.313920  1738 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:24.289412  4075 raft_consensus.cc:697] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
W20260709 13:01:24.348129  4175 log.cc:927] Time spent T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:01:24.368337  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.369944  1738 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 6.
W20260709 13:01:24.370932  4235 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:01:24.371713  4075 consensus_queue.cc:237] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:24.395747  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:24.396481  1590 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:24.414007  1590 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
I20260709 13:01:24.443414  4175 tablet_bootstrap.cc:492] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:24.444617  4175 tablet_bootstrap.cc:492] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap complete.
I20260709 13:01:24.448158  1739 raft_consensus.cc:1240] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:24.457443  1707 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:24.470973  1633 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:24.480091  4174 raft_consensus.cc:2804] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:24.480747  4174 raft_consensus.cc:697] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:24.481173  4074 raft_consensus.cc:2955] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:24.482074  4174 consensus_queue.cc:237] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:24.476543  4229 raft_consensus.cc:2804] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:24.488780  1739 raft_consensus.cc:2955] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
W20260709 13:01:24.500224  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 254820us
I20260709 13:01:24.514148  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:24.515743  4252 raft_consensus.cc:993] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:24.516263  4252 raft_consensus.cc:1081] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:24.502558  4229 raft_consensus.cc:697] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 10 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:24.525231  4229 consensus_queue.cc:237] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:24.504889  4175 ts_tablet_manager.cc:1403] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent bootstrapping tablet: real 1.312s	user 0.048s	sys 0.025s
I20260709 13:01:24.537284  4215 consensus_queue.cc:1059] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
W20260709 13:01:24.588970  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 80798.2us
W20260709 13:01:24.599690  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 62526.7us
I20260709 13:01:24.599779  1658 raft_consensus.cc:3055] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:24.605813  1658 raft_consensus.cc:740] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:24.606678  1658 consensus_queue.cc:260] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:24.607977  1658 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:24.591015  4074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:46830 (request call id 7) took 1060 ms. Trace:
I20260709 13:01:24.622723  4074 rpcz_store.cc:276] 0709 13:01:23.530552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.533924 (+  3372us) service_pool.cc:224] Handling call
0709 13:01:23.595304 (+ 61380us) log.cc:844] Serialized 506 byte log entry
0709 13:01:24.590890 (+995586us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17776,"raft.queue_time_us":18569,"raft.run_cpu_time_us":2415,"raft.run_wall_time_us":2478,"spinlock_wait_cycles":17280,"thread_start_us":75662,"threads_started":1,"wal-append.queue_time_us":99018}
I20260709 13:01:24.636667  4175 raft_consensus.cc:359] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:24.637646  4175 raft_consensus.cc:740] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Initialized, Role: LEARNER
I20260709 13:01:24.640128  1658 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
W20260709 13:01:24.642583  4161 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:01:24.667855  1662 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39146
I20260709 13:01:24.668592  1662 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:24.668974  1662 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:24.688558  4246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:49238 (request call id 60) took 1425 ms. Trace:
I20260709 13:01:24.689101  4246 rpcz_store.cc:276] 0709 13:01:23.263200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.263475 (+   275us) service_pool.cc:224] Handling call
0709 13:01:23.364531 (+101056us) ts_tablet_manager.cc:934] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6: Initiating tablet copy from peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
0709 13:01:24.012458 (+647927us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:01:24.505190 (+492732us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:24.508813 (+  3623us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:01:24.687577 (+178764us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:01:24.687897 (+   320us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:24.688245 (+   348us) ts_tablet_manager.cc:989] Replica registered.
0709 13:01:24.688433 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":298,"tablet-copy.queue_time_us":100019,"thread_start_us":103352,"threads_started":2}
I20260709 13:01:24.691838  4246 tablet_copy_client.cc:806] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:24.692093  1585 raft_consensus.cc:1275] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:24.692476  4246 tablet_copy_client.cc:670] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:24.638356  4175 consensus_queue.cc:260] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:24.695235  4175 ts_tablet_manager.cc:1434] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent starting tablet: real 0.160s	user 0.011s	sys 0.008s
I20260709 13:01:24.703007  1601 tablet_copy_service.cc:342] P 6d4de2ce0683442498244b9529127f91: Request end of tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-67b5a70a2de54935b60554301e6de808 received from {username='slave'} at 127.0.0.1:46836
I20260709 13:01:24.703609  1601 tablet_copy_service.cc:434] P 6d4de2ce0683442498244b9529127f91: ending tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-67b5a70a2de54935b60554301e6de808 on tablet 67b5a70a2de54935b60554301e6de808 with peer 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:24.710887  1662 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:24.727607  1662 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:24.737165  1662 raft_consensus.cc:1275] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:24.724270  4268 consensus_queue.cc:1048] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:01:24.744650  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:24.745350  1739 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:24.746979  2552 raft_consensus.cc:1217] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 LEARNER]: Deduplicated request from leader. Original: 4.2->[4.3-4.3]   Dedup: 4.3->[]
I20260709 13:01:24.754822  4246 tablet_copy_client.cc:538] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:24.756193  4230 consensus_queue.cc:1048] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:01:24.758852  4175 ts_tablet_manager.cc:933] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6: Initiating tablet copy from peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:01:24.784860  1739 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 4.
I20260709 13:01:24.807893  1662 raft_consensus.cc:1240] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:24.813489  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:24.794517  1486 catalog_manager.cc:5697] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 5 to 6, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 6 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:24.814365  1590 raft_consensus.cc:3055] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:24.814841  1590 raft_consensus.cc:740] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:24.815582  1590 consensus_queue.cc:260] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:24.829650  4175 tablet_copy_client.cc:323] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:33325
I20260709 13:01:24.867635  1590 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:24.867242  1633 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:24.879530  1601 tablet_copy_service.cc:140] P 6d4de2ce0683442498244b9529127f91: Received BeginTabletCopySession request for tablet f6f62b0e67804bcba2b2f2b49e0b7623 from peer 7e839e91a1314c2f9a99b25b17c916a6 ({username='slave'} at 127.0.0.1:46836)
I20260709 13:01:24.887823  1601 tablet_copy_service.cc:161] P 6d4de2ce0683442498244b9529127f91: Beginning new tablet copy session on tablet f6f62b0e67804bcba2b2f2b49e0b7623 from peer 7e839e91a1314c2f9a99b25b17c916a6 at {username='slave'} at 127.0.0.1:46836: session id = 7e839e91a1314c2f9a99b25b17c916a6-f6f62b0e67804bcba2b2f2b49e0b7623
I20260709 13:01:24.914268  4253 raft_consensus.cc:2804] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:24.914991  4253 raft_consensus.cc:697] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 4 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:24.916249  4253 consensus_queue.cc:237] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:24.928939  4246 tablet_bootstrap.cc:492] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap starting.
I20260709 13:01:24.996628  1589 raft_consensus.cc:1275] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:01:24.998251  1658 raft_consensus.cc:2955] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:24.992811  1585 raft_consensus.cc:1275] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:25.005934  1590 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 4.
I20260709 13:01:25.019948  4160 consensus_queue.cc:1048] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:01:25.072031  1739 raft_consensus.cc:1275] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:25.033742  4253 consensus_queue.cc:1048] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
W20260709 13:01:25.095204  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 61257.4us
I20260709 13:01:25.105314  1601 tablet_copy_source_session.cc:215] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:25.109210  4175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6f62b0e67804bcba2b2f2b49e0b7623. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:25.124271  4236 consensus_queue.cc:1048] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:25.129350   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:25.129949  1658 raft_consensus.cc:1275] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:01:25.187240  1585 raft_consensus.cc:1275] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:01:25.187829  1658 raft_consensus.cc:1275] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:01:25.190006  4175 tablet_copy_client.cc:806] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:25.190642  4175 tablet_copy_client.cc:670] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:25.201619  4175 tablet_copy_client.cc:538] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:25.221271  4293 consensus_queue.cc:1048] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:01:25.208508  4275 consensus_queue.cc:1048] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:01:25.274681  4175 tablet_bootstrap.cc:492] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap starting.
W20260709 13:01:25.277868  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 60952.7us
W20260709 13:01:25.291991  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 70858.3us
W20260709 13:01:25.305608  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 83464.7us
I20260709 13:01:25.354526  4287 raft_consensus.cc:1064] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91: attempting to promote NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 to VOTER
I20260709 13:01:25.381791  4287 consensus_queue.cc:237] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 1, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:25.389820  4160 consensus_queue.cc:1048] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:01:25.402542  1584 raft_consensus.cc:1275] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:25.489874  1489 catalog_manager.cc:5697] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 reported cstate change: config changed from index -1 to 5, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New cstate: current_term: 6 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:25.495728  1733 raft_consensus.cc:1275] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:25.497666  4252 consensus_queue.cc:1048] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:25.530917  1665 raft_consensus.cc:1275] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:01:25.556628  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 80036.7us
I20260709 13:01:25.561170  2553 raft_consensus.cc:1275] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 LEARNER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:25.544128  4197 consensus_queue.cc:1048] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
W20260709 13:01:25.634368  4246 log.cc:927] Time spent T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 13:01:25.676206  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 89942.8us
I20260709 13:01:25.717741  1489 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55132 (request call id 206) took 1014 ms. Trace:
I20260709 13:01:25.725001   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:25.725391  1490 catalog_manager.cc:5697] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 9 to 10, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 10 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:25.718315  1489 rpcz_store.cc:276] 0709 13:01:24.703070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.721288 (+ 18218us) service_pool.cc:224] Handling call
0709 13:01:25.717643 (+996355us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:25.553121 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:25.577793 (+ 24672us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:25.577856 (+    63us) write_op.cc:435] Acquired schema lock
0709 13:01:25.577884 (+    28us) tablet.cc:662] Decoding operations
0709 13:01:25.578386 (+   502us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:25.578461 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:25.578508 (+    47us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:01:25.578738 (+   230us) tablet.cc:701] Row locks acquired
0709 13:01:25.578764 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:01:25.579027 (+   263us) write_op.cc:270] Start()
0709 13:01:25.579181 (+   154us) write_op.cc:276] Timestamp: P: 1783602085578962 usec, L: 0
0709 13:01:25.579213 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:01:25.580079 (+   866us) log.cc:844] Serialized 599 byte log entry
0709 13:01:25.598420 (+ 18341us) op_driver.cc:464] REPLICATION: finished
0709 13:01:25.598885 (+   465us) write_op.cc:301] APPLY: starting
0709 13:01:25.598973 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:25.599083 (+   110us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:25.599189 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:25.599453 (+   264us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:25.599632 (+   179us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:01:25.599682 (+    50us) write_op.cc:312] APPLY: finished
0709 13:01:25.599885 (+   203us) log.cc:844] Serialized 23 byte log entry
0709 13:01:25.600058 (+   173us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:25.600145 (+    87us) write_op.cc:454] Released schema lock
0709 13:01:25.600188 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:25.600552 (+   364us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:25.600589 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":242,"apply.run_cpu_time_us":1630,"apply.run_wall_time_us":1630,"num_ops":1,"prepare.queue_time_us":152,"prepare.run_cpu_time_us":3673,"prepare.run_wall_time_us":48485,"replication_time_us":19057}]]}
I20260709 13:01:25.768464  4319 consensus_queue.cc:1048] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:25.758436  1490 catalog_manager.cc:5697] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 5 to 6, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 6 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:25.776242  1490 catalog_manager.cc:5697] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 5 to 6, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 6 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:25.785710  4175 tablet_bootstrap.cc:492] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:25.804795  1739 raft_consensus.cc:1275] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:25.815061  4175 tablet_bootstrap.cc:492] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap complete.
I20260709 13:01:25.816504  4175 ts_tablet_manager.cc:1403] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent bootstrapping tablet: real 0.542s	user 0.044s	sys 0.038s
I20260709 13:01:25.828627  4276 consensus_queue.cc:1048] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:01:25.867376  4246 tablet_bootstrap.cc:492] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:01:25.910537  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 55647.4us
W20260709 13:01:25.910236  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 107847us
I20260709 13:01:25.910048  4246 tablet_bootstrap.cc:492] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap complete.
I20260709 13:01:25.951911  4246 ts_tablet_manager.cc:1403] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6: Time spent bootstrapping tablet: real 1.023s	user 0.037s	sys 0.029s
I20260709 13:01:25.919255  4165 consensus_queue.cc:1048] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
W20260709 13:01:26.045277  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 69679us
W20260709 13:01:26.052680  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 64988.7us
I20260709 13:01:26.054297  4246 raft_consensus.cc:359] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:26.055203  4246 raft_consensus.cc:740] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Initialized, Role: LEARNER
I20260709 13:01:26.055893  4246 consensus_queue.cc:260] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
W20260709 13:01:26.056876  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 85165.5us
I20260709 13:01:26.068418  4175 raft_consensus.cc:359] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:26.069396  4175 raft_consensus.cc:740] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Initialized, Role: LEARNER
I20260709 13:01:26.077824  4175 consensus_queue.cc:260] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:26.114837  4175 ts_tablet_manager.cc:1434] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent starting tablet: real 0.298s	user 0.009s	sys 0.001s
W20260709 13:01:26.125917  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 66806.9us
I20260709 13:01:26.173156  1486 catalog_manager.cc:5697] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 3 to 4, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 4 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:26.193742  4246 ts_tablet_manager.cc:1434] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6: Time spent starting tablet: real 0.229s	user 0.011s	sys 0.000s
I20260709 13:01:26.194234  4197 raft_consensus.cc:2955] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index 3 to 4, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
W20260709 13:01:26.205282  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 51658.5us
I20260709 13:01:26.230167  1736 consensus_queue.cc:237] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:01:26.237443  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 129653us
I20260709 13:01:26.259459  2552 raft_consensus.cc:2955] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 3 to 4, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:26.273245  1751 tablet_copy_service.cc:342] P 5ced62816f8545cd9b63a27e9055e42d: Request end of tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-03d9f5135e0d4c0091fe4ba5bed83ffd received from {username='slave'} at 127.0.0.1:35672
I20260709 13:01:26.273801  1751 tablet_copy_service.cc:434] P 5ced62816f8545cd9b63a27e9055e42d: ending tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-03d9f5135e0d4c0091fe4ba5bed83ffd on tablet 03d9f5135e0d4c0091fe4ba5bed83ffd with peer 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:26.260799  1662 raft_consensus.cc:2955] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 3 to 4, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:26.280910  1490 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55154 (request call id 200) took 1166 ms. Trace:
I20260709 13:01:26.306929  1601 tablet_copy_service.cc:342] P 6d4de2ce0683442498244b9529127f91: Request end of tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-f6f62b0e67804bcba2b2f2b49e0b7623 received from {username='slave'} at 127.0.0.1:46836
I20260709 13:01:26.307726  1601 tablet_copy_service.cc:434] P 6d4de2ce0683442498244b9529127f91: ending tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-f6f62b0e67804bcba2b2f2b49e0b7623 on tablet f6f62b0e67804bcba2b2f2b49e0b7623 with peer 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:26.313920  1591 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:26.314882  1591 raft_consensus.cc:606] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:26.300981  1490 rpcz_store.cc:276] 0709 13:01:25.104264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.104439 (+   175us) service_pool.cc:224] Handling call
0709 13:01:26.270907 (+1166468us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:25.827897 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:25.870164 (+ 42267us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:25.870227 (+    63us) write_op.cc:435] Acquired schema lock
0709 13:01:25.870245 (+    18us) tablet.cc:662] Decoding operations
0709 13:01:25.870839 (+   594us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:25.870898 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:25.870927 (+    29us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:01:25.871287 (+   360us) tablet.cc:701] Row locks acquired
0709 13:01:25.871308 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:01:25.871458 (+   150us) write_op.cc:270] Start()
0709 13:01:25.871605 (+   147us) write_op.cc:276] Timestamp: P: 1783602085871405 usec, L: 0
0709 13:01:25.871625 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:01:25.872429 (+   804us) log.cc:844] Serialized 1317 byte log entry
0709 13:01:25.883134 (+ 10705us) op_driver.cc:464] REPLICATION: finished
0709 13:01:25.884669 (+  1535us) write_op.cc:301] APPLY: starting
0709 13:01:25.884775 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:25.884941 (+   166us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:25.885053 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:25.885547 (+   494us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:25.885739 (+   192us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:01:25.885792 (+    53us) write_op.cc:312] APPLY: finished
0709 13:01:25.886005 (+   213us) log.cc:844] Serialized 35 byte log entry
0709 13:01:25.886174 (+   169us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:25.886273 (+    99us) write_op.cc:454] Released schema lock
0709 13:01:25.886317 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:25.886656 (+   339us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:25.886694 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":21007,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":1248,"apply.run_cpu_time_us":1959,"apply.run_wall_time_us":1960,"num_ops":3,"prepare.queue_time_us":985,"prepare.run_cpu_time_us":3350,"prepare.run_wall_time_us":51688,"replication_time_us":11355}]]}
I20260709 13:01:26.377238  2552 raft_consensus.cc:1217] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 LEARNER]: Deduplicated request from leader. Original: 7.4->[7.5-7.5]   Dedup: 7.5->[]
W20260709 13:01:26.430296  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 74129us
I20260709 13:01:26.447593  1490 catalog_manager.cc:5697] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: config changed from index 3 to 4, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:26.452018  2552 raft_consensus.cc:1275] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:26.472343  1591 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:26.472934  1591 raft_consensus.cc:606] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:26.480576  2552 raft_consensus.cc:1217] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 LEARNER]: Deduplicated request from leader. Original: 6.4->[6.5-6.5]   Dedup: 6.5->[]
I20260709 13:01:26.481420  4267 consensus_queue.cc:1048] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:01:26.499778  1662 raft_consensus.cc:1275] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:26.505254  4160 consensus_queue.cc:1048] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:26.507076  1732 raft_consensus.cc:2955] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 3 to 4, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:26.616740  4281 raft_consensus.cc:993] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:26.603379  1732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:55694
I20260709 13:01:26.622715  1732 raft_consensus.cc:606] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:26.629141  1663 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:40572
I20260709 13:01:26.629794  1663 raft_consensus.cc:606] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 7 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:26.633767  1591 consensus_queue.cc:237] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:26.634828  1585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:26.635525  1585 raft_consensus.cc:606] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:26.638862  4229 raft_consensus.cc:2955] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 7 to 8, VOTER 6d4de2ce0683442498244b9529127f91 (127.0.107.193) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:26.643452  2553 raft_consensus.cc:1275] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:26.646495  4281 raft_consensus.cc:1081] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Signalling peer 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:26.650585  1739 raft_consensus.cc:1275] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:26.654601   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:26.661880  4332 consensus_queue.cc:1048] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:26.663201  4197 raft_consensus.cc:993] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:26.671540  4197 raft_consensus.cc:1081] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:26.666900   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:26.676205  2552 raft_consensus.cc:2955] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, VOTER 6d4de2ce0683442498244b9529127f91 (127.0.107.193) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:26.684000  1663 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39146
I20260709 13:01:26.684588  1734 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:43678
I20260709 13:01:26.687511  1734 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:26.687923  1734 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:26.688496  1663 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:26.690861  1663 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:26.672803  4321 consensus_queue.cc:1048] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:01:26.709259  1734 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:26.711458  1734 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:26.713557  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:26.714188  1584 raft_consensus.cc:3055] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:26.714499  1584 raft_consensus.cc:740] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:26.715265  1584 consensus_queue.cc:260] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:26.716400  1584 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:26.718487  4275 raft_consensus.cc:993] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:26.719220  4301 raft_consensus.cc:1081] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:26.730001  1488 catalog_manager.cc:5697] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: config changed from index 7 to 8, VOTER 6d4de2ce0683442498244b9529127f91 (127.0.107.193) evicted. New cstate: current_term: 8 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:26.733008  4339 raft_consensus.cc:2955] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, VOTER 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:26.743129  1662 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39162
I20260709 13:01:26.743742  1662 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:26.744072  1662 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:26.744104  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:26.744724  1664 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:26.739318  1739 raft_consensus.cc:2955] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, VOTER 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:26.755836  2553 raft_consensus.cc:2955] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, VOTER 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:26.758737  1477 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d1fb6d43d14545a9872b287d4096ff1a with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:26.768532  1663 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:26.774842  1664 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:01:26.776018  1663 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:26.781314  1662 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:26.782289  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:01:26.790047  1581 tablet_service.cc:1558] Processing DeleteTablet for tablet d1fb6d43d14545a9872b287d4096ff1a with delete_type TABLET_DATA_TOMBSTONED (TS 6d4de2ce0683442498244b9529127f91 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:59092
I20260709 13:01:26.795518  2552 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:26.763160  1584 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:01:26.812348  1662 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:26.809366  1705 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:26.810230  1664 raft_consensus.cc:2955] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, VOTER 6d4de2ce0683442498244b9529127f91 (127.0.107.193) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:26.818135  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:26.818811  1739 raft_consensus.cc:3055] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:26.819164  1739 raft_consensus.cc:740] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:26.822538  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:26.822386  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:26.823875  1585 raft_consensus.cc:3055] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:26.824194  1585 raft_consensus.cc:740] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:26.825919  1739 consensus_queue.cc:260] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:26.828089  2552 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 6.
I20260709 13:01:26.828814  4229 raft_consensus.cc:2804] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:26.832002  1584 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:26.834321  1739 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:26.837221  1477 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 67b5a70a2de54935b60554301e6de808 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:26.837989  4236 raft_consensus.cc:993] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede: : Instructing follower 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:26.839036  1490 catalog_manager.cc:5697] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: config changed from index 4 to 5, VOTER 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) evicted. New cstate: current_term: 4 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:26.852228  1585 consensus_queue.cc:260] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:26.853574  4312 raft_consensus.cc:1081] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 7 LEADER]: Signalling peer 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:26.854287  1585 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:26.861508  1734 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:43686
I20260709 13:01:26.832690  4229 raft_consensus.cc:697] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:26.862357  1734 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:26.862767  1734 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:26.861248  1630 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:01:26.877040  1584 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 7.
I20260709 13:01:26.882910  4267 raft_consensus.cc:1064] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d: attempting to promote NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 to VOTER
I20260709 13:01:26.885365  4216 raft_consensus.cc:2804] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:26.895371  4216 raft_consensus.cc:697] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:26.896384  4216 consensus_queue.cc:237] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:26.902333  4229 consensus_queue.cc:237] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:26.904201  1633 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:26.914451  4253 raft_consensus.cc:2804] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:26.915130  4253 raft_consensus.cc:697] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 7 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:26.916113  4253 consensus_queue.cc:237] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:26.924450  4074 raft_consensus.cc:993] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:26.925068  4074 raft_consensus.cc:1081] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Signalling peer 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:26.924686  4267 consensus_queue.cc:237] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 3, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:26.933564  4344 tablet_replica.cc:333] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:01:26.944320  1739 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 7.
I20260709 13:01:26.934839  4344 raft_consensus.cc:2243] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:26.994630  4344 raft_consensus.cc:2272] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:26.946940  1734 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:26.950376  1733 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:43678
I20260709 13:01:26.995411  1733 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:26.995817  1733 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:26.999971  4344 ts_tablet_manager.cc:1916] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:26.974109  2552 raft_consensus.cc:1275] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 LEARNER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:01:26.980914  1584 raft_consensus.cc:1275] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:01:26.983412  1664 raft_consensus.cc:1275] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:01:26.939949  1585 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 6.
I20260709 13:01:27.005411  4229 consensus_queue.cc:1048] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:27.008688  1733 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:27.010810  4268 consensus_queue.cc:1048] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:01:27.017652  4267 consensus_queue.cc:1048] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:27.026273  1650 tablet_service.cc:1558] Processing DeleteTablet for tablet 67b5a70a2de54935b60554301e6de808 with delete_type TABLET_DATA_TOMBSTONED (TS 5bb87fe07da2414e84ee578c3b176ede not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:39130
I20260709 13:01:27.042196  1489 catalog_manager.cc:5697] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 5 to 6, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 6 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:27.059078  1734 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:27.058651  1489 catalog_manager.cc:5697] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 6 to 7, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 7 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:27.059219  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:27.059947  1584 raft_consensus.cc:3055] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:27.060185  1584 raft_consensus.cc:740] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:27.055621  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:27.061913  1733 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:27.062388  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:27.063153  1664 raft_consensus.cc:3055] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:27.063519  1664 raft_consensus.cc:740] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:27.062049  1583 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:27.067543  1584 consensus_queue.cc:260] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:27.066835  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:27.069722  1662 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:27.072549  1584 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:27.075019  1664 consensus_queue.cc:260] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:27.076131  1664 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:27.079967  1584 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:01:27.084622  1664 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:01:27.085645  1583 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:01:27.086933  1705 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:27.088786  4299 raft_consensus.cc:2804] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:27.089339  4299 raft_consensus.cc:697] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:27.090276  4299 consensus_queue.cc:237] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:27.109555  4197 raft_consensus.cc:1064] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91: attempting to promote NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 to VOTER
I20260709 13:01:27.112507  4197 consensus_queue.cc:237] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 3, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:27.081399  1707 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:01:27.133745  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 52465.3us
I20260709 13:01:27.135331  4160 raft_consensus.cc:2804] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:27.135854  4160 raft_consensus.cc:697] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:27.136749  4160 consensus_queue.cc:237] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:27.143640  1490 catalog_manager.cc:5697] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 7 to 8, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 8 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:27.187270  1662 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:01:27.234472  4350 tablet_replica.cc:333] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:01:27.235958  4350 raft_consensus.cc:2243] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.236937  4350 raft_consensus.cc:2272] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.285805  1490 catalog_manager.cc:5697] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 5 to 6, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 6 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:27.288798  1490 catalog_manager.cc:5697] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 7 to 8, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 8 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:27.308727  4267 raft_consensus.cc:2955] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index 5 to 6, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:27.320956  1662 raft_consensus.cc:2955] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 5 to 6, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:27.329970  4350 ts_tablet_manager.cc:1916] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:27.339210  2552 raft_consensus.cc:1275] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 LEARNER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:01:27.372874  2552 raft_consensus.cc:1275] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:27.374635  4313 consensus_queue.cc:1048] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:01:27.390771  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 45980us
I20260709 13:01:27.393378  1585 raft_consensus.cc:1275] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:27.395100  1737 raft_consensus.cc:1275] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:01:27.396932  4339 consensus_queue.cc:1048] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:01:27.401250  4287 consensus_queue.cc:1048] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:27.407920  4313 consensus_queue.cc:1048] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:27.425966  1667 raft_consensus.cc:1275] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:27.429204  4268 consensus_queue.cc:1048] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:01:27.434319  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 130158us
I20260709 13:01:27.436283  1585 raft_consensus.cc:2955] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 5 to 6, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:27.442852  1591 raft_consensus.cc:1275] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:27.445261  1664 raft_consensus.cc:1275] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:01:27.446751  4287 consensus_queue.cc:1048] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:01:27.459596  2554 raft_consensus.cc:2955] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 5 to 6, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:27.487022  4294 consensus_queue.cc:1048] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:01:27.460930  4344 ts_tablet_manager.cc:1929] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.7
I20260709 13:01:27.498554  1591 raft_consensus.cc:1275] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:27.503259  4313 consensus_queue.cc:1048] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:27.507244  4344 log.cc:1199] T d1fb6d43d14545a9872b287d4096ff1a P 6d4de2ce0683442498244b9529127f91: Deleting WAL directory at /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-0-root/wals/d1fb6d43d14545a9872b287d4096ff1a
I20260709 13:01:27.509245  1477 catalog_manager.cc:5028] TS 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): tablet d1fb6d43d14545a9872b287d4096ff1a (table test-workload [id=8a8e3153ff4e476f890a0820215f177a]) successfully deleted
I20260709 13:01:27.553558  1733 raft_consensus.cc:1275] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:27.557217  1591 raft_consensus.cc:1275] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:27.572770  1490 catalog_manager.cc:5697] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: config changed from index 5 to 6, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:27.571833  4268 consensus_queue.cc:1048] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:01:27.571586  4165 consensus_queue.cc:1048] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
W20260709 13:01:27.663501  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 48972.9us
I20260709 13:01:27.674984   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:01:27.686913  4360 log.cc:927] Time spent T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:01:27.720881  1667 raft_consensus.cc:2955] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
W20260709 13:01:27.793918  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 53700.8us
W20260709 13:01:27.803722  4358 log.cc:927] Time spent T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:01:27.710332  4340 raft_consensus.cc:2955] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:27.961019  4350 ts_tablet_manager.cc:1929] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.4
I20260709 13:01:27.961596  4350 log.cc:1199] T 67b5a70a2de54935b60554301e6de808 P 5bb87fe07da2414e84ee578c3b176ede: Deleting WAL directory at /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-1-root/wals/67b5a70a2de54935b60554301e6de808
I20260709 13:01:27.978912  1475 catalog_manager.cc:5028] TS 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): tablet 67b5a70a2de54935b60554301e6de808 (table test-workload [id=8a8e3153ff4e476f890a0820215f177a]) successfully deleted
I20260709 13:01:28.009734  2550 raft_consensus.cc:2955] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:28.014704  1734 consensus_queue.cc:237] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:01:28.042734  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 87266.2us
I20260709 13:01:28.071489  1590 raft_consensus.cc:1275] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:28.075937  1661 raft_consensus.cc:1275] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:28.079138  1663 raft_consensus.cc:1275] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:28.109318  1737 raft_consensus.cc:2955] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:28.125816  2552 raft_consensus.cc:1275] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:01:28.137733  4325 consensus_queue.cc:1048] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:28.143705  4299 consensus_queue.cc:1048] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:28.150842  4275 consensus_queue.cc:1048] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:28.160209  4274 raft_consensus.cc:2955] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 6 to 7, VOTER 6d4de2ce0683442498244b9529127f91 (127.0.107.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:28.162178  2550 raft_consensus.cc:2955] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, VOTER 6d4de2ce0683442498244b9529127f91 (127.0.107.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
W20260709 13:01:28.203039  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 67513.2us
I20260709 13:01:28.188134   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:28.212966  4380 consensus_queue.cc:1048] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:01:28.215004  1489 catalog_manager.cc:5697] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: config changed from index 5 to 6, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:28.294004  1664 raft_consensus.cc:1275] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:01:28.334201  4075 consensus_queue.cc:1048] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:28.354115  1664 raft_consensus.cc:2955] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, VOTER 6d4de2ce0683442498244b9529127f91 (127.0.107.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:28.384528  1477 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 03d9f5135e0d4c0091fe4ba5bed83ffd with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:28.485666  1666 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
mode: GRACEFUL
new_leader_uuid: "6d4de2ce0683442498244b9529127f91"
 from {username='slave'} at 127.0.0.1:40572
I20260709 13:01:28.486263  1666 raft_consensus.cc:606] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Received request to transfer leadership to TS 6d4de2ce0683442498244b9529127f91
I20260709 13:01:28.492200  1666 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
mode: GRACEFUL
new_leader_uuid: "6d4de2ce0683442498244b9529127f91"
 from {username='slave'} at 127.0.0.1:40572
I20260709 13:01:28.492801  1666 raft_consensus.cc:606] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Received request to transfer leadership to TS 6d4de2ce0683442498244b9529127f91
I20260709 13:01:28.503472  1489 catalog_manager.cc:5697] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: config changed from index 6 to 7, VOTER 6d4de2ce0683442498244b9529127f91 (127.0.107.193) evicted. New cstate: current_term: 7 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:28.520437  1734 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd728f93afb447e384035fae1af6b006"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:55694
I20260709 13:01:28.522925  1734 raft_consensus.cc:606] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 5 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:28.683771  1581 tablet_service.cc:1558] Processing DeleteTablet for tablet 03d9f5135e0d4c0091fe4ba5bed83ffd with delete_type TABLET_DATA_TOMBSTONED (TS 6d4de2ce0683442498244b9529127f91 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:59092
I20260709 13:01:28.717690  4374 raft_consensus.cc:993] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede: : Instructing follower 6d4de2ce0683442498244b9529127f91 to start an election
I20260709 13:01:28.718286  4374 raft_consensus.cc:1081] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Signalling peer 6d4de2ce0683442498244b9529127f91 to start an election
I20260709 13:01:28.724344  1667 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9831da869404fb79a22d3887701ca69"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
mode: GRACEFUL
new_leader_uuid: "6d4de2ce0683442498244b9529127f91"
 from {username='slave'} at 127.0.0.1:40572
I20260709 13:01:28.724988  1667 raft_consensus.cc:606] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Received request to transfer leadership to TS 6d4de2ce0683442498244b9529127f91
I20260709 13:01:28.726554  1589 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
 from {username='slave'} at 127.0.0.1:59106
I20260709 13:01:28.727111  1589 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:28.727470  1589 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:28.727759  1664 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
mode: GRACEFUL
new_leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
 from {username='slave'} at 127.0.0.1:40572
I20260709 13:01:28.728368  1664 raft_consensus.cc:606] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Received request to transfer leadership to TS 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:28.729748   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:28.728236  1586 consensus_queue.cc:237] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:28.735294  1589 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:28.741649  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:28.742444  1667 raft_consensus.cc:3055] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:28.742813  1667 raft_consensus.cc:740] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:28.742983   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:28.743717  1667 consensus_queue.cc:260] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:28.744989  1667 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:28.755646  1589 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:28.752627  1667 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:01:28.759039  1556 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:28.760062  4383 raft_consensus.cc:2804] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:28.761201  4383 raft_consensus.cc:697] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:28.762094  4383 consensus_queue.cc:237] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:28.772539  4376 raft_consensus.cc:993] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede: : Instructing follower 6d4de2ce0683442498244b9529127f91 to start an election
I20260709 13:01:28.773013  4376 raft_consensus.cc:1081] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Signalling peer 6d4de2ce0683442498244b9529127f91 to start an election
I20260709 13:01:28.773562  2550 raft_consensus.cc:1275] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:28.775282  4332 consensus_queue.cc:1048] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:28.776094  1589 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
 from {username='slave'} at 127.0.0.1:59106
I20260709 13:01:28.776654  1589 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:28.777021  1589 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:28.782502  4339 raft_consensus.cc:2955] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 6 to 7, VOTER 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:28.791790  2553 raft_consensus.cc:2955] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, VOTER 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:28.792687  1589 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:28.812739  1477 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f6f62b0e67804bcba2b2f2b49e0b7623 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:28.815660  1589 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:28.816056  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:28.817806  1667 raft_consensus.cc:3055] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:28.818097  1667 raft_consensus.cc:740] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:28.818950  1667 consensus_queue.cc:260] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:28.820328  1667 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:28.820187  1488 catalog_manager.cc:5697] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: config changed from index 6 to 7, VOTER 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) evicted. New cstate: current_term: 6 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:28.836710  1667 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:01:28.839097  1556 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:28.839797  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:28.840444  1733 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:28.843716  1650 tablet_service.cc:1558] Processing DeleteTablet for tablet f6f62b0e67804bcba2b2f2b49e0b7623 with delete_type TABLET_DATA_TOMBSTONED (TS 5bb87fe07da2414e84ee578c3b176ede not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:39130
I20260709 13:01:28.845660  4399 tablet_replica.cc:333] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:01:28.847086  4399 raft_consensus.cc:2243] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:28.850921  1732 raft_consensus.cc:1275] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:28.851500  4399 raft_consensus.cc:2272] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:28.857228  4399 ts_tablet_manager.cc:1916] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:28.865958  4374 raft_consensus.cc:993] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede: : Instructing follower 6d4de2ce0683442498244b9529127f91 to start an election
I20260709 13:01:28.866624  4376 raft_consensus.cc:1081] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Signalling peer 6d4de2ce0683442498244b9529127f91 to start an election
I20260709 13:01:28.854166  4383 raft_consensus.cc:2804] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:28.867662  4383 raft_consensus.cc:697] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:28.872243  1585 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c9831da869404fb79a22d3887701ca69"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
 from {username='slave'} at 127.0.0.1:59106
I20260709 13:01:28.873313  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:28.873943  1734 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:28.873337  1585 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:28.881404  1585 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:28.886144  1734 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:01:28.887745  1733 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:01:28.888067  1488 catalog_manager.cc:5697] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 6 to 7, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:28.901208  4268 raft_consensus.cc:993] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:28.907703  4383 consensus_queue.cc:237] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:28.922755  4268 raft_consensus.cc:1081] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 5 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:28.925912  1667 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd728f93afb447e384035fae1af6b006"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39162
I20260709 13:01:28.926538  1667 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:28.926987  1667 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:28.942909  4340 consensus_queue.cc:1048] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:28.956734  1667 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:28.959070  1667 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:28.960690  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:28.963771  1734 raft_consensus.cc:3055] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:28.964056  1734 raft_consensus.cc:740] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:28.961606  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:28.962533  1733 raft_consensus.cc:2955] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, VOTER 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:28.947726  4401 tablet_replica.cc:333] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:01:28.966979  1585 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:28.968086  1586 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:28.972918  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:28.973658  1667 raft_consensus.cc:3055] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:28.974016  1667 raft_consensus.cc:740] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:28.978408  1585 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:28.980614  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:28.981257  1737 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:28.982247  1667 consensus_queue.cc:260] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:28.983193  1667 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:28.966495  1734 consensus_queue.cc:260] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:28.984412  1734 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:28.985826  4376 consensus_queue.cc:1175] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5ced62816f8545cd9b63a27e9055e42d" responder_term: 6 status { last_received { term: 6 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 6 index: 4 } }
I20260709 13:01:28.991010  1586 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 6.
I20260709 13:01:28.994484  1633 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:28.994833  1737 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:01:28.996129  4376 raft_consensus.cc:2804] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:28.996663  4376 raft_consensus.cc:697] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:28.997630  4376 consensus_queue.cc:237] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:29.013247  1734 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 6.
I20260709 13:01:29.021373  1667 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:01:29.030917  1558 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:29.037257  4340 raft_consensus.cc:2804] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:29.037783  4340 raft_consensus.cc:697] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:29.038630  4340 consensus_queue.cc:237] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:29.046224  4401 raft_consensus.cc:2243] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.047191  4401 raft_consensus.cc:2272] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.052904  1488 catalog_manager.cc:5697] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 6 to 7, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:29.071588  4401 ts_tablet_manager.cc:1916] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:29.077515  4399 ts_tablet_manager.cc:1929] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.6
I20260709 13:01:29.078115  4399 log.cc:1199] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 6d4de2ce0683442498244b9529127f91: Deleting WAL directory at /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-0-root/wals/03d9f5135e0d4c0091fe4ba5bed83ffd
I20260709 13:01:29.107254  1488 catalog_manager.cc:5697] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 6 to 7, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:29.108743  1477 catalog_manager.cc:5028] TS 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): tablet 03d9f5135e0d4c0091fe4ba5bed83ffd (table test-workload [id=8a8e3153ff4e476f890a0820215f177a]) successfully deleted
I20260709 13:01:29.111593  1489 catalog_manager.cc:5697] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 5 to 6, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 6 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:29.124452  4370 raft_consensus.cc:993] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede: : Instructing follower 7e839e91a1314c2f9a99b25b17c916a6 to start an election
I20260709 13:01:29.129318  4370 raft_consensus.cc:1081] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Signalling peer 7e839e91a1314c2f9a99b25b17c916a6 to start an election
I20260709 13:01:29.135450  2552 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de"
dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
 from {username='slave'} at 127.0.0.1:49218
I20260709 13:01:29.136039  2552 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:29.136397  2552 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:29.143006  2552 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:29.146588  2552 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:29.147213  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:29.147902  1666 raft_consensus.cc:3055] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:29.148249  1666 raft_consensus.cc:740] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:29.149117  1666 consensus_queue.cc:260] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:29.150753  1666 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:29.157405  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:29.158056  1586 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:29.164590  1586 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 7.
I20260709 13:01:29.165838  2426 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:01:29.166863  4366 raft_consensus.cc:2804] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:29.169160  1666 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 7.
I20260709 13:01:29.182045  4366 raft_consensus.cc:697] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:01:29.185545  4366 consensus_queue.cc:237] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:29.204695  1667 raft_consensus.cc:1275] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:29.206418  4340 consensus_queue.cc:1048] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:29.226140  4401 ts_tablet_manager.cc:1929] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.6
I20260709 13:01:29.226696  4401 log.cc:1199] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5bb87fe07da2414e84ee578c3b176ede: Deleting WAL directory at /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-1-root/wals/f6f62b0e67804bcba2b2f2b49e0b7623
I20260709 13:01:29.228391  1475 catalog_manager.cc:5028] TS 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): tablet f6f62b0e67804bcba2b2f2b49e0b7623 (table test-workload [id=8a8e3153ff4e476f890a0820215f177a]) successfully deleted
I20260709 13:01:29.258245  1733 raft_consensus.cc:1275] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:29.260514  4340 consensus_queue.cc:1048] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:29.276722  1489 catalog_manager.cc:5697] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 6 to 7, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 7 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:29.295056  1666 raft_consensus.cc:1275] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:29.296805  4340 consensus_queue.cc:1048] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:29.435786  1733 raft_consensus.cc:1275] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:01:29.437386  4376 consensus_queue.cc:1048] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:29.440093  1733 raft_consensus.cc:1275] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:01:29.440775  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 67365.3us
I20260709 13:01:29.447379  4332 consensus_queue.cc:1048] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:29.465181  1667 raft_consensus.cc:1275] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:29.466656  4287 consensus_queue.cc:1048] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:29.505440  1585 raft_consensus.cc:1275] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:01:29.508795  4376 consensus_queue.cc:1048] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:01:29.571825  1737 raft_consensus.cc:1275] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:29.580134  4340 consensus_queue.cc:1048] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:29.691135  1667 raft_consensus.cc:1275] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:29.692983  4366 consensus_queue.cc:1048] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:29.744102   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:29.775753  1586 raft_consensus.cc:1275] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:29.777526  4366 consensus_queue.cc:1048] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:30.149364  1585 consensus_queue.cc:237] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
W20260709 13:01:30.172184  1555 consensus_peers.cc:597] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 -> Peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157): Couldn't send request to peer 7e839e91a1314c2f9a99b25b17c916a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 619fbae81e504a9b9671de42f0e75aea. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:30.179622  1664 raft_consensus.cc:1275] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:30.179622  1737 raft_consensus.cc:1275] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:30.182461  4287 consensus_queue.cc:1048] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:30.183487  4340 consensus_queue.cc:1048] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:30.194034  4340 raft_consensus.cc:2955] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:30.199749  1739 raft_consensus.cc:2955] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:30.213752  1664 raft_consensus.cc:2955] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:30.255355  1488 catalog_manager.cc:5697] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: config changed from index -1 to 5, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New cstate: current_term: 7 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:30.274971  1585 consensus_queue.cc:237] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
W20260709 13:01:30.291163  1555 consensus_peers.cc:597] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 -> Peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157): Couldn't send request to peer 7e839e91a1314c2f9a99b25b17c916a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c5248b829f494452a558e65e2342b6f0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:30.295149  1664 raft_consensus.cc:1275] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:30.297049  4287 consensus_queue.cc:1048] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:30.298040  1739 raft_consensus.cc:1275] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:30.300076  4287 consensus_queue.cc:1048] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:30.307895  4287 raft_consensus.cc:2955] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Committing config change with OpId 4.3: config changed from index -1 to 3, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:30.313161  1664 raft_consensus.cc:2955] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Committing config change with OpId 4.3: config changed from index -1 to 3, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:30.328321  1739 consensus_queue.cc:237] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
W20260709 13:01:30.346436  1704 consensus_peers.cc:597] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d -> Peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157): Couldn't send request to peer 7e839e91a1314c2f9a99b25b17c916a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1633c35f1cea4228894a2e7872612d9e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:30.349776  1667 raft_consensus.cc:1275] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:01:30.352102  4417 consensus_queue.cc:1048] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:30.359295  1585 raft_consensus.cc:1275] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:01:30.361181  4416 consensus_queue.cc:1048] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:30.394898  1737 raft_consensus.cc:2955] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Committing config change with OpId 4.3: config changed from index -1 to 3, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:30.469587   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:30.477670  4416 raft_consensus.cc:2955] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index -1 to 6, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:30.479377  1586 raft_consensus.cc:2955] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index -1 to 6, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:30.494313  1667 raft_consensus.cc:2955] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index -1 to 6, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:30.523064  1489 catalog_manager.cc:5697] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: config changed from index -1 to 3, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New cstate: current_term: 4 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:30.612473  1737 consensus_queue.cc:237] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:30.628177  1486 catalog_manager.cc:5697] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: config changed from index -1 to 6, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New cstate: current_term: 6 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
W20260709 13:01:30.638447  1704 consensus_peers.cc:597] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d -> Peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157): Couldn't send request to peer 7e839e91a1314c2f9a99b25b17c916a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0500c740c1014c08b4ea992c888446ed. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:30.653398  1667 raft_consensus.cc:1275] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:30.653661  1585 raft_consensus.cc:1275] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:30.657793  4442 consensus_queue.cc:1048] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:30.662910  4442 consensus_queue.cc:1048] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:30.676266  4441 raft_consensus.cc:2955] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:30.692101  1585 raft_consensus.cc:2955] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:30.747700  1486 catalog_manager.cc:5697] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: config changed from index -1 to 4, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New cstate: current_term: 4 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:30.771719  1734 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:55694
I20260709 13:01:30.772375  1734 raft_consensus.cc:606] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 9 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:30.790944  4450 ts_tablet_manager.cc:933] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6: Initiating tablet copy from peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:01:30.805848  1585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:30.806699  1585 raft_consensus.cc:606] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:30.776088  1661 raft_consensus.cc:2955] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:30.821940  4451 ts_tablet_manager.cc:933] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6: Initiating tablet copy from peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:01:30.822050  1734 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:55694
I20260709 13:01:30.822728  1734 raft_consensus.cc:606] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 9 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:30.824396   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:01:30.827611   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:30.854034  4450 tablet_copy_client.cc:323] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:33325
I20260709 13:01:30.856832  1601 tablet_copy_service.cc:140] P 6d4de2ce0683442498244b9529127f91: Received BeginTabletCopySession request for tablet 619fbae81e504a9b9671de42f0e75aea from peer 7e839e91a1314c2f9a99b25b17c916a6 ({username='slave'} at 127.0.0.1:46836)
I20260709 13:01:30.857620  1601 tablet_copy_service.cc:161] P 6d4de2ce0683442498244b9529127f91: Beginning new tablet copy session on tablet 619fbae81e504a9b9671de42f0e75aea from peer 7e839e91a1314c2f9a99b25b17c916a6 at {username='slave'} at 127.0.0.1:46836: session id = 7e839e91a1314c2f9a99b25b17c916a6-619fbae81e504a9b9671de42f0e75aea
I20260709 13:01:30.877501  4451 tablet_copy_client.cc:323] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:33325
I20260709 13:01:30.884279  1602 tablet_copy_service.cc:140] P 6d4de2ce0683442498244b9529127f91: Received BeginTabletCopySession request for tablet c5248b829f494452a558e65e2342b6f0 from peer 7e839e91a1314c2f9a99b25b17c916a6 ({username='slave'} at 127.0.0.1:46836)
I20260709 13:01:30.885000  1602 tablet_copy_service.cc:161] P 6d4de2ce0683442498244b9529127f91: Beginning new tablet copy session on tablet c5248b829f494452a558e65e2342b6f0 from peer 7e839e91a1314c2f9a99b25b17c916a6 at {username='slave'} at 127.0.0.1:46836: session id = 7e839e91a1314c2f9a99b25b17c916a6-c5248b829f494452a558e65e2342b6f0
I20260709 13:01:30.906147  4454 ts_tablet_manager.cc:933] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6: Initiating tablet copy from peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:30.923736  4441 raft_consensus.cc:993] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:30.924283  4441 raft_consensus.cc:1081] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 9 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:30.926939  1602 tablet_copy_source_session.cc:215] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:30.927211  1666 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39162
I20260709 13:01:30.933449  1666 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:30.933841  1666 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:30.945297  1666 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:30.928836  1601 tablet_copy_source_session.cc:215] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:30.951376  1666 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:30.951886  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:30.952549  1586 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:30.962229  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:30.962884  1737 raft_consensus.cc:3055] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:30.963186  1737 raft_consensus.cc:740] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:30.963889  1737 consensus_queue.cc:260] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:30.964964  1737 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:30.969656  4451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5248b829f494452a558e65e2342b6f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:30.976964  4450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 619fbae81e504a9b9671de42f0e75aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:30.981734  4454 tablet_copy_client.cc:323] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:32843
I20260709 13:01:30.983508  1751 tablet_copy_service.cc:140] P 5ced62816f8545cd9b63a27e9055e42d: Received BeginTabletCopySession request for tablet 1633c35f1cea4228894a2e7872612d9e from peer 7e839e91a1314c2f9a99b25b17c916a6 ({username='slave'} at 127.0.0.1:35672)
I20260709 13:01:30.984120  1751 tablet_copy_service.cc:161] P 5ced62816f8545cd9b63a27e9055e42d: Beginning new tablet copy session on tablet 1633c35f1cea4228894a2e7872612d9e from peer 7e839e91a1314c2f9a99b25b17c916a6 at {username='slave'} at 127.0.0.1:35672: session id = 7e839e91a1314c2f9a99b25b17c916a6-1633c35f1cea4228894a2e7872612d9e
I20260709 13:01:30.986764  1737 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
I20260709 13:01:30.987998  1586 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
I20260709 13:01:31.004555  1751 tablet_copy_source_session.cc:215] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:31.007104  1633 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:31.011839  4370 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:31.012283  4454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1633c35f1cea4228894a2e7872612d9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:31.012368  4370 raft_consensus.cc:697] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:31.013443  4370 consensus_queue.cc:237] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:31.013424  4450 tablet_copy_client.cc:806] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:31.019708  4450 tablet_copy_client.cc:670] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:31.026197  4450 tablet_copy_client.cc:538] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:31.076637  4450 tablet_bootstrap.cc:492] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap starting.
I20260709 13:01:31.078529  4454 tablet_copy_client.cc:806] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:31.081447  4454 tablet_copy_client.cc:670] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:31.093240  1486 catalog_manager.cc:5697] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 9 to 10, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 10 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:31.103669  4454 tablet_copy_client.cc:538] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:31.112145  4451 tablet_copy_client.cc:806] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:31.112900  4451 tablet_copy_client.cc:670] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:31.118422  4417 raft_consensus.cc:993] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:31.118981  4442 raft_consensus.cc:1081] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 9 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:31.121174  4451 tablet_copy_client.cc:538] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:31.123656  1666 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39162
I20260709 13:01:31.124372  1666 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:31.128521  1666 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:31.137190  4457 ts_tablet_manager.cc:933] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6: Initiating tablet copy from peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:31.138811  4454 tablet_bootstrap.cc:492] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap starting.
I20260709 13:01:31.153780  1666 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:31.161671  4287 raft_consensus.cc:993] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:31.162204  4287 raft_consensus.cc:1081] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Signalling peer 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:31.166483  1737 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:43678
I20260709 13:01:31.167093  1737 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:31.167455  1737 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:31.174911  1737 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:31.178330  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:31.178927  1585 raft_consensus.cc:3055] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:31.179219  1585 raft_consensus.cc:740] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:31.179963  1585 consensus_queue.cc:260] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:31.181869  1585 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:31.186810  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:31.187404  1667 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:31.191540  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:31.192183  1586 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:31.206166  1737 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:31.214489  1586 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
I20260709 13:01:31.214543  1667 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:01:31.216069  1585 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:01:31.215845  1633 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:31.219194  4370 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:31.219761  4370 raft_consensus.cc:697] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:31.220638  4370 consensus_queue.cc:237] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:31.223021  1705 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:31.227229  4417 raft_consensus.cc:2804] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:31.227810  4417 raft_consensus.cc:697] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:31.233590  1666 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:31.234318  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:31.234920  1737 raft_consensus.cc:3055] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:31.235204  1737 raft_consensus.cc:740] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:31.237174  1737 consensus_queue.cc:260] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:31.245965  1737 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:31.251961  4451 tablet_bootstrap.cc:492] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap starting.
I20260709 13:01:31.228924  4417 consensus_queue.cc:237] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:31.238950  4457 tablet_copy_client.cc:323] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:32843
I20260709 13:01:31.280776  1737 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
W20260709 13:01:31.356921  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 64394.9us
I20260709 13:01:31.356806  1486 catalog_manager.cc:5697] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 9 to 10, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 10 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:31.364478  1489 catalog_manager.cc:5697] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 7 to 8, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 8 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:31.378538  1751 tablet_copy_service.cc:140] P 5ced62816f8545cd9b63a27e9055e42d: Received BeginTabletCopySession request for tablet 0500c740c1014c08b4ea992c888446ed from peer 7e839e91a1314c2f9a99b25b17c916a6 ({username='slave'} at 127.0.0.1:35672)
I20260709 13:01:31.379204  1751 tablet_copy_service.cc:161] P 5ced62816f8545cd9b63a27e9055e42d: Beginning new tablet copy session on tablet 0500c740c1014c08b4ea992c888446ed from peer 7e839e91a1314c2f9a99b25b17c916a6 at {username='slave'} at 127.0.0.1:35672: session id = 7e839e91a1314c2f9a99b25b17c916a6-0500c740c1014c08b4ea992c888446ed
I20260709 13:01:31.393913  1751 tablet_copy_source_session.cc:215] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:31.398447  4450 tablet_bootstrap.cc:492] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:31.450809  4450 tablet_bootstrap.cc:492] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap complete.
I20260709 13:01:31.451674  4450 ts_tablet_manager.cc:1403] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6: Time spent bootstrapping tablet: real 0.375s	user 0.021s	sys 0.014s
I20260709 13:01:31.431406  1737 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:43674
I20260709 13:01:31.453459  1737 raft_consensus.cc:606] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Received request to transfer leadership
I20260709 13:01:31.449255  1734 raft_consensus.cc:1275] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:31.457448  4450 raft_consensus.cc:359] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:31.458952  1734 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:43674
I20260709 13:01:31.459601  1734 raft_consensus.cc:606] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Received request to transfer leadership
W20260709 13:01:31.460695  1477 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 619fbae81e504a9b9671de42f0e75aea already in progress
I20260709 13:01:31.460742  4450 raft_consensus.cc:740] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Initialized, Role: LEARNER
I20260709 13:01:31.463104  4370 consensus_queue.cc:1048] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:31.508909  4457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0500c740c1014c08b4ea992c888446ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:31.548324  4454 tablet_bootstrap.cc:492] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:31.550043  4454 tablet_bootstrap.cc:492] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap complete.
I20260709 13:01:31.551867  4454 ts_tablet_manager.cc:1403] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6: Time spent bootstrapping tablet: real 0.413s	user 0.029s	sys 0.021s
I20260709 13:01:31.485868  4450 consensus_queue.cc:260] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:31.580842  4451 tablet_bootstrap.cc:492] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:01:31.588596  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 51237.7us
W20260709 13:01:31.558131  1477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 97448.4us
I20260709 13:01:31.595748  1586 raft_consensus.cc:1275] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:31.587657  4454 raft_consensus.cc:359] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:31.614981  4454 raft_consensus.cc:740] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Initialized, Role: LEARNER
I20260709 13:01:31.615890  4454 consensus_queue.cc:260] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:31.631793  1734 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:43674
I20260709 13:01:31.632581  1734 raft_consensus.cc:606] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Received request to transfer leadership
I20260709 13:01:31.644390  4445 consensus_queue.cc:1048] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:01:31.650523  4450 ts_tablet_manager.cc:1434] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6: Time spent starting tablet: real 0.199s	user 0.016s	sys 0.000s
I20260709 13:01:31.656067  1601 tablet_copy_service.cc:342] P 6d4de2ce0683442498244b9529127f91: Request end of tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-619fbae81e504a9b9671de42f0e75aea received from {username='slave'} at 127.0.0.1:46836
I20260709 13:01:31.656548  1601 tablet_copy_service.cc:434] P 6d4de2ce0683442498244b9529127f91: ending tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-619fbae81e504a9b9671de42f0e75aea on tablet 619fbae81e504a9b9671de42f0e75aea with peer 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:31.657315  4451 tablet_bootstrap.cc:492] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap complete.
I20260709 13:01:31.658762  4451 ts_tablet_manager.cc:1403] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent bootstrapping tablet: real 0.407s	user 0.012s	sys 0.025s
I20260709 13:01:31.660135  2553 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 LEARNER]: Advancing to term 8
I20260709 13:01:31.684080  4454 ts_tablet_manager.cc:1434] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6: Time spent starting tablet: real 0.131s	user 0.008s	sys 0.002s
I20260709 13:01:31.688052  1733 raft_consensus.cc:1275] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:31.689823  1751 tablet_copy_service.cc:342] P 5ced62816f8545cd9b63a27e9055e42d: Request end of tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-1633c35f1cea4228894a2e7872612d9e received from {username='slave'} at 127.0.0.1:35672
I20260709 13:01:31.690524  1751 tablet_copy_service.cc:434] P 5ced62816f8545cd9b63a27e9055e42d: ending tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-1633c35f1cea4228894a2e7872612d9e on tablet 1633c35f1cea4228894a2e7872612d9e with peer 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:31.694685  1585 raft_consensus.cc:1275] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:31.711512  2553 raft_consensus.cc:1275] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 LEARNER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:01:31.713543  1538 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:01:31.713973  1538 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 619fbae81e504a9b9671de42f0e75aea already in progress
W20260709 13:01:31.714282  1538 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 619fbae81e504a9b9671de42f0e75aea already in progress
I20260709 13:01:31.714090  4441 consensus_queue.cc:1048] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:31.709040  4477 consensus_queue.cc:1048] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:01:31.722790  4253 consensus_queue.cc:1048] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:31.723120  4451 raft_consensus.cc:359] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:31.724049  4451 raft_consensus.cc:740] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Initialized, Role: LEARNER
I20260709 13:01:31.741881  4457 tablet_copy_client.cc:806] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:31.748004  4457 tablet_copy_client.cc:670] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:31.755841  4457 tablet_copy_client.cc:538] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:31.762887  2552 raft_consensus.cc:1217] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 LEARNER]: Deduplicated request from leader. Original: 6.5->[6.6-6.6]   Dedup: 6.6->[]
I20260709 13:01:31.733291  4451 consensus_queue.cc:260] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:31.768496  1586 raft_consensus.cc:1275] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:31.771368  4464 consensus_queue.cc:1048] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:31.779289  4451 ts_tablet_manager.cc:1434] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent starting tablet: real 0.120s	user 0.005s	sys 0.004s
I20260709 13:01:31.781599  1601 tablet_copy_service.cc:342] P 6d4de2ce0683442498244b9529127f91: Request end of tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-c5248b829f494452a558e65e2342b6f0 received from {username='slave'} at 127.0.0.1:46836
I20260709 13:01:31.782167  1601 tablet_copy_service.cc:434] P 6d4de2ce0683442498244b9529127f91: ending tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-c5248b829f494452a558e65e2342b6f0 on tablet c5248b829f494452a558e65e2342b6f0 with peer 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:31.829021   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:31.847635  4457 tablet_bootstrap.cc:492] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap starting.
W20260709 13:01:31.978991  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 53374.4us
W20260709 13:01:31.979321  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 83599.7us
W20260709 13:01:31.998764  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 86843.3us
W20260709 13:01:32.014544  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 43988.6us
W20260709 13:01:32.012737  4484 log.cc:927] Time spent T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
W20260709 13:01:32.022044  4485 log.cc:927] Time spent T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 13:01:32.033000  4481 log.cc:927] Time spent T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
W20260709 13:01:32.049932  4483 log.cc:927] Time spent T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:01:32.069926  4496 raft_consensus.cc:1064] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d: attempting to promote NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 to VOTER
W20260709 13:01:32.070467  4496 raft_consensus.cc:1068] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d: Unable to promote non-voter 7e839e91a1314c2f9a99b25b17c916a6: Service unavailable: leader transfer in progress
I20260709 13:01:32.071338  4496 raft_consensus.cc:993] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d: : Instructing follower 6d4de2ce0683442498244b9529127f91 to start an election
I20260709 13:01:32.071787  4496 raft_consensus.cc:1081] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Signalling peer 6d4de2ce0683442498244b9529127f91 to start an election
I20260709 13:01:32.075615  1586 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
 from {username='slave'} at 127.0.0.1:59112
I20260709 13:01:32.076241  1586 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:32.076576  1586 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:32.093214  1586 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:32.099282  1586 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:32.110466  1585 raft_consensus.cc:1240] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:32.141462  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:32.142144  1737 raft_consensus.cc:3055] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:32.142508  1737 raft_consensus.cc:740] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:32.143332  1737 consensus_queue.cc:260] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:32.144503  1737 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:32.154187  1667 raft_consensus.cc:1275] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:32.159325  2552 raft_consensus.cc:1217] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 LEARNER]: Deduplicated request from leader. Original: 4.2->[4.3-4.3]   Dedup: 4.3->[]
I20260709 13:01:32.198117  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:32.198712  1661 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:32.209990  1661 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:01:32.210872  1737 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:01:32.212574  1558 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:32.217360  4466 raft_consensus.cc:2804] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:32.217911  4466 raft_consensus.cc:697] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:32.218811  4466 consensus_queue.cc:237] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:32.241353  1486 catalog_manager.cc:5697] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 8 to 9, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:32.266137  4457 tablet_bootstrap.cc:492] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:32.290254  4457 tablet_bootstrap.cc:492] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap complete.
I20260709 13:01:32.291371  4457 ts_tablet_manager.cc:1403] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6: Time spent bootstrapping tablet: real 0.486s	user 0.041s	sys 0.027s
I20260709 13:01:32.314708  4457 raft_consensus.cc:359] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:32.315985  4457 raft_consensus.cc:740] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Initialized, Role: LEARNER
I20260709 13:01:32.317018  4457 consensus_queue.cc:260] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:32.359414  4457 ts_tablet_manager.cc:1434] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6: Time spent starting tablet: real 0.066s	user 0.010s	sys 0.000s
I20260709 13:01:32.386667  1751 tablet_copy_service.cc:342] P 5ced62816f8545cd9b63a27e9055e42d: Request end of tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-0500c740c1014c08b4ea992c888446ed received from {username='slave'} at 127.0.0.1:35672
I20260709 13:01:32.387127  4464 raft_consensus.cc:1064] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d: attempting to promote NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 to VOTER
I20260709 13:01:32.387323  1751 tablet_copy_service.cc:434] P 5ced62816f8545cd9b63a27e9055e42d: ending tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-0500c740c1014c08b4ea992c888446ed on tablet 0500c740c1014c08b4ea992c888446ed with peer 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:32.390666  4464 consensus_queue.cc:237] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:32.418864  2553 raft_consensus.cc:1275] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 LEARNER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:32.420466  4497 consensus_queue.cc:1048] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:32.424762  1586 raft_consensus.cc:1275] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:32.426476  4497 consensus_queue.cc:1048] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:32.437059  1662 raft_consensus.cc:1275] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:32.439667  4464 consensus_queue.cc:1048] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:32.548074  4464 raft_consensus.cc:2955] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 6 to 7, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:32.557329  1662 raft_consensus.cc:2955] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:32.556025  1586 raft_consensus.cc:2955] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:32.591835  1486 catalog_manager.cc:5697] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 reported cstate change: config changed from index 6 to 7, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:32.604630  2553 raft_consensus.cc:2955] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:32.627084  4499 raft_consensus.cc:1064] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91: attempting to promote NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 to VOTER
I20260709 13:01:32.643381  4499 consensus_queue.cc:237] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 1, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:32.656554  1733 consensus_queue.cc:237] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:32.671330  1586 raft_consensus.cc:1275] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:32.673497  4497 consensus_queue.cc:1048] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:32.677764  2553 raft_consensus.cc:1275] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:32.684017  4441 consensus_queue.cc:1048] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:32.718549  2553 raft_consensus.cc:2955] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Committing config change with OpId 6.8: config changed from index 7 to 8, VOTER 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:32.730908  2552 raft_consensus.cc:1217] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 13:01:32.766135  1489 catalog_manager.cc:5697] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: config changed from index 7 to 8, VOTER 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) evicted. New cstate: current_term: 6 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
W20260709 13:01:32.777846  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 43805.5us
I20260709 13:01:32.791874  2553 raft_consensus.cc:1275] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 LEARNER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:01:32.793756  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 52121.6us
I20260709 13:01:32.795408  4497 raft_consensus.cc:2955] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Committing config change with OpId 6.8: config changed from index 7 to 8, VOTER 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:32.795089  4466 consensus_queue.cc:1048] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:01:32.835147  1584 raft_consensus.cc:2955] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Committing config change with OpId 6.8: config changed from index 7 to 8, VOTER 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:32.845691  1739 raft_consensus.cc:1275] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:01:32.846467  1734 raft_consensus.cc:1275] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:32.850013  1650 tablet_service.cc:1558] Processing DeleteTablet for tablet 1633c35f1cea4228894a2e7872612d9e with delete_type TABLET_DATA_TOMBSTONED (TS 5bb87fe07da2414e84ee578c3b176ede not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:39130
I20260709 13:01:32.853423  1477 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1633c35f1cea4228894a2e7872612d9e with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:01:32.870306  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 45969.4us
I20260709 13:01:32.874253  1661 raft_consensus.cc:1275] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:01:32.878544  1662 raft_consensus.cc:1275] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:32.888193  2552 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 LEARNER]: Advancing to term 9
I20260709 13:01:32.889554  4516 tablet_replica.cc:333] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:01:32.890064  4467 consensus_queue.cc:1048] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:32.890755  4516 raft_consensus.cc:2243] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:32.891479  4467 consensus_queue.cc:1048] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:32.891752  4516 raft_consensus.cc:2272] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:32.898240  2552 raft_consensus.cc:1275] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 LEARNER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:01:32.900224  4467 consensus_queue.cc:1048] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:32.925662  4514 consensus_queue.cc:1048] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:32.929003  4514 consensus_queue.cc:1048] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:32.933594  4332 raft_consensus.cc:1064] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91: attempting to promote NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 to VOTER
I20260709 13:01:32.967870  4332 consensus_queue.cc:237] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:32.985069  4516 ts_tablet_manager.cc:1916] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:33.022646  2550 raft_consensus.cc:1275] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 LEARNER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:01:33.025614  1733 raft_consensus.cc:1275] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:01:33.029479  4332 consensus_queue.cc:1048] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:33.043421  4467 consensus_queue.cc:1048] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:33.048758  4511 raft_consensus.cc:2955] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index 3 to 4, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:33.054392  4495 raft_consensus.cc:2955] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index 5 to 8, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:33.063431  2552 raft_consensus.cc:2955] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 5 to 8, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:33.066757  2554 raft_consensus.cc:2955] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 3 to 4, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:33.079105  1733 raft_consensus.cc:2955] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 3 to 4, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:33.092128  1489 catalog_manager.cc:5697] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: config changed from index 3 to 4, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:33.099099  1737 raft_consensus.cc:2955] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 5 to 8, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:33.115363  1661 raft_consensus.cc:1275] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:01:33.118405  1667 raft_consensus.cc:2955] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 3 to 4, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:33.130012  4524 consensus_queue.cc:1048] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:33.143859  1661 raft_consensus.cc:2955] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 5 to 8, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:33.171448  1486 catalog_manager.cc:5697] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 reported cstate change: config changed from index 5 to 8, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:33.159884  4516 ts_tablet_manager.cc:1929] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.7
I20260709 13:01:33.188925  4516 log.cc:1199] T 1633c35f1cea4228894a2e7872612d9e P 5bb87fe07da2414e84ee578c3b176ede: Deleting WAL directory at /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-1-root/wals/1633c35f1cea4228894a2e7872612d9e
I20260709 13:01:33.192411  1475 catalog_manager.cc:5028] TS 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): tablet 1633c35f1cea4228894a2e7872612d9e (table test-workload [id=8a8e3153ff4e476f890a0820215f177a]) successfully deleted
I20260709 13:01:33.215270   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:33.225500  1584 consensus_queue.cc:237] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:33.232812  2552 raft_consensus.cc:1275] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:33.234932  4495 consensus_queue.cc:1048] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:33.260373  4332 raft_consensus.cc:2955] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, VOTER 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:33.278923  2552 raft_consensus.cc:2955] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, VOTER 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:33.282493  1661 raft_consensus.cc:1275] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:33.286710  4467 consensus_queue.cc:1048] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:33.293360  1661 raft_consensus.cc:2955] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, VOTER 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:33.304464  4497 raft_consensus.cc:1064] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d: attempting to promote NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 to VOTER
I20260709 13:01:33.307503  4497 consensus_queue.cc:237] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:33.338636  1477 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c5248b829f494452a558e65e2342b6f0 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:33.335244  1486 catalog_manager.cc:5697] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: config changed from index 4 to 5, VOTER 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) evicted. New cstate: current_term: 4 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
W20260709 13:01:33.514467  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 74740.6us
I20260709 13:01:33.533934  1725 tablet_service.cc:1558] Processing DeleteTablet for tablet c5248b829f494452a558e65e2342b6f0 with delete_type TABLET_DATA_TOMBSTONED (TS 5ced62816f8545cd9b63a27e9055e42d not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:43674
I20260709 13:01:33.576606  1662 raft_consensus.cc:1275] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:33.577219  2552 raft_consensus.cc:1275] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 LEARNER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:33.578789  4464 consensus_queue.cc:1048] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:33.581068  4464 consensus_queue.cc:1048] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:33.583406  1733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:55694
I20260709 13:01:33.584172  1733 raft_consensus.cc:606] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:33.586104  1585 raft_consensus.cc:1275] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:33.588886  4526 consensus_queue.cc:1048] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:01:33.593550  1667 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
mode: GRACEFUL
new_leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
 from {username='slave'} at 127.0.0.1:40572
I20260709 13:01:33.594156  1667 raft_consensus.cc:606] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 5 LEADER]: Received request to transfer leadership to TS 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:33.599036  1733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:55694
I20260709 13:01:33.600775  1733 raft_consensus.cc:606] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 9 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:33.614187  4530 tablet_replica.cc:333] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:01:33.620472  1584 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:33.621162  1584 raft_consensus.cc:606] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:33.629624  1667 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:40572
I20260709 13:01:33.630226  1667 raft_consensus.cc:606] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:33.643517  1583 consensus_queue.cc:237] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:33.645867  1667 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
mode: GRACEFUL
new_leader_uuid: "6d4de2ce0683442498244b9529127f91"
 from {username='slave'} at 127.0.0.1:40572
I20260709 13:01:33.646536  1667 raft_consensus.cc:606] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 5 LEADER]: Received request to transfer leadership to TS 6d4de2ce0683442498244b9529127f91
I20260709 13:01:33.648263   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:01:33.650058   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:33.655349  1667 raft_consensus.cc:1275] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:33.658633  4530 raft_consensus.cc:2243] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:33.661098  4530 raft_consensus.cc:2272] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:33.663093  4253 raft_consensus.cc:993] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede: : Instructing follower 7e839e91a1314c2f9a99b25b17c916a6 to start an election
I20260709 13:01:33.663605  4474 raft_consensus.cc:1081] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 5 LEADER]: Signalling peer 7e839e91a1314c2f9a99b25b17c916a6 to start an election
I20260709 13:01:33.665544  4467 consensus_queue.cc:1048] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:33.666543  4530 ts_tablet_manager.cc:1916] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:33.658656  2552 raft_consensus.cc:1275] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:33.671702  4467 consensus_queue.cc:1048] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:33.672104  4526 raft_consensus.cc:993] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:33.672660  4526 raft_consensus.cc:1081] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:33.674347  1664 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39162
I20260709 13:01:33.674925  1664 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:33.675273  1664 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:33.678052  4524 raft_consensus.cc:2955] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:33.687461  1661 raft_consensus.cc:2955] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:33.695664  1664 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:33.700950  2552 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00"
dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
 from {username='slave'} at 127.0.0.1:49218
I20260709 13:01:33.701574  2552 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:33.701957  2552 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:33.704854  2553 raft_consensus.cc:2955] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:33.714028  2552 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:33.731385  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:33.731992  1585 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:33.734431  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:33.735097  1739 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:33.735327  1477 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 619fbae81e504a9b9671de42f0e75aea with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:33.736474  2552 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 6 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:33.740469  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:33.745519  1662 raft_consensus.cc:3055] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:33.745828  1662 raft_consensus.cc:740] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:33.746526  1662 consensus_queue.cc:260] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:33.747771  1662 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:33.743824  4464 raft_consensus.cc:2955] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:33.754076  2552 raft_consensus.cc:2955] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:33.763485  1666 raft_consensus.cc:2955] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:33.775995  1489 catalog_manager.cc:5697] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: config changed from index 4 to 5, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:33.778581  1664 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:33.741402  1486 catalog_manager.cc:5697] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: config changed from index 8 to 9, VOTER 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) evicted. New cstate: current_term: 9 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:33.797585  1662 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 6.
I20260709 13:01:33.799036  2424 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:01:33.800019  4498 raft_consensus.cc:2804] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:33.800549  4498 raft_consensus.cc:697] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:01:33.801445  4498 consensus_queue.cc:237] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:33.806520  4513 raft_consensus.cc:993] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede: : Instructing follower 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:33.815455  4513 raft_consensus.cc:1081] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Signalling peer 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:33.816828  1585 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 5.
I20260709 13:01:33.818491  1732 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:43686
I20260709 13:01:33.818612  1633 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:33.819108  1732 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:33.819454  4474 raft_consensus.cc:2804] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:33.821341  4474 raft_consensus.cc:697] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 5 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:33.822324  4474 consensus_queue.cc:237] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:33.825851  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:33.826493  1733 raft_consensus.cc:3055] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:33.819505  1732 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:33.834131  1725 tablet_service.cc:1558] Processing DeleteTablet for tablet 619fbae81e504a9b9671de42f0e75aea with delete_type TABLET_DATA_TOMBSTONED (TS 5ced62816f8545cd9b63a27e9055e42d not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:43674
I20260709 13:01:33.768492  1739 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 6.
I20260709 13:01:33.826792  1733 raft_consensus.cc:740] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:33.838402  1733 consensus_queue.cc:260] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:33.845181  4526 raft_consensus.cc:993] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:33.847061  4528 raft_consensus.cc:1081] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 9 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:33.849043  4530 ts_tablet_manager.cc:1929] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.4
I20260709 13:01:33.849586  4530 log.cc:1199] T c5248b829f494452a558e65e2342b6f0 P 5ced62816f8545cd9b63a27e9055e42d: Deleting WAL directory at /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-2-root/wals/c5248b829f494452a558e65e2342b6f0
I20260709 13:01:33.851902  4530 tablet_replica.cc:333] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:01:33.852661  1733 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:33.863986  1664 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39162
I20260709 13:01:33.864755  1664 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:33.865903  1664 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:33.869818  1732 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:33.877097  1733 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 5.
I20260709 13:01:33.878230  1732 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:33.880017  4530 raft_consensus.cc:2243] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:33.881064  4530 raft_consensus.cc:2272] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:33.885960  4530 ts_tablet_manager.cc:1916] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:33.910235  1477 catalog_manager.cc:5028] TS 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): tablet c5248b829f494452a558e65e2342b6f0 (table test-workload [id=8a8e3153ff4e476f890a0820215f177a]) successfully deleted
W20260709 13:01:33.935767  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 62560.1us
I20260709 13:01:33.921411  1584 raft_consensus.cc:2955] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:33.938553  1489 catalog_manager.cc:5697] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 5 to 6, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 6 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:33.955528  1664 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:33.984338  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:33.985642  1662 raft_consensus.cc:3055] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:33.986018  1662 raft_consensus.cc:740] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:33.987439  1662 consensus_queue.cc:260] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:33.991910  1662 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:33.994069  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:33.995158  1584 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:34.010746  1664 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:34.011860  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:34.012796  1585 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:34.014274  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:34.015251  1733 raft_consensus.cc:3055] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:34.015587  1733 raft_consensus.cc:740] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:34.049839  1662 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
I20260709 13:01:34.058530  1585 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
I20260709 13:01:34.049254  1733 consensus_queue.cc:260] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:34.061532  1584 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
I20260709 13:01:34.070801  1705 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:34.076802  4492 raft_consensus.cc:2804] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:34.090509  4492 raft_consensus.cc:697] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 11 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:34.091877  4492 consensus_queue.cc:237] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:34.083724  1733 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:34.138789  1633 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:01:34.145206  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 86837.9us
I20260709 13:01:34.151346  1732 consensus_queue.cc:237] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:34.153460  4473 raft_consensus.cc:2804] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:34.154098  4473 raft_consensus.cc:697] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:34.155192  4473 consensus_queue.cc:237] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:34.161437  1733 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
I20260709 13:01:34.141845  1488 catalog_manager.cc:5697] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 4 to 5, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 5 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:34.183437  2553 raft_consensus.cc:1275] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:34.196337  4539 consensus_queue.cc:1048] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:34.223156  4530 ts_tablet_manager.cc:1929] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.8
I20260709 13:01:34.223986  4530 log.cc:1199] T 619fbae81e504a9b9671de42f0e75aea P 5ced62816f8545cd9b63a27e9055e42d: Deleting WAL directory at /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-2-root/wals/619fbae81e504a9b9671de42f0e75aea
I20260709 13:01:34.223670  4526 raft_consensus.cc:2955] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 6d4de2ce0683442498244b9529127f91 (127.0.107.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:34.226562  2552 raft_consensus.cc:2955] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 6d4de2ce0683442498244b9529127f91 (127.0.107.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:34.246697  1477 catalog_manager.cc:5028] TS 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): tablet 619fbae81e504a9b9671de42f0e75aea (table test-workload [id=8a8e3153ff4e476f890a0820215f177a]) successfully deleted
I20260709 13:01:34.247480  4541 raft_consensus.cc:993] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:34.247654  1477 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0500c740c1014c08b4ea992c888446ed with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:34.248114  4541 raft_consensus.cc:1081] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Signalling peer 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:34.249881  4538 raft_consensus.cc:993] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede: : Instructing follower 6d4de2ce0683442498244b9529127f91 to start an election
I20260709 13:01:34.253029  4538 raft_consensus.cc:1081] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 5 LEADER]: Signalling peer 6d4de2ce0683442498244b9529127f91 to start an election
I20260709 13:01:34.251688  1732 raft_consensus.cc:1275] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:34.256021  4443 consensus_queue.cc:1048] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:34.261996  1661 raft_consensus.cc:1275] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:34.269790  4443 consensus_queue.cc:1048] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:01:34.276024  1477 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 0500c740c1014c08b4ea992c888446ed with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 5 but the committed config has opid_index of 6
I20260709 13:01:34.278388  1486 catalog_manager.cc:5697] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: config changed from index 5 to 6, VOTER 6d4de2ce0683442498244b9529127f91 (127.0.107.193) evicted. New cstate: current_term: 4 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:34.285346  1666 raft_consensus.cc:1275] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:34.301538  1486 catalog_manager.cc:5697] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 10 to 11, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 11 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:34.321206  1585 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
 from {username='slave'} at 127.0.0.1:59106
I20260709 13:01:34.322011  1585 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:34.322368  1585 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:34.309320  1733 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:43678
I20260709 13:01:34.327596  1733 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:34.328205  1733 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:34.333261  1585 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:34.350519  1581 tablet_service.cc:1558] Processing DeleteTablet for tablet 0500c740c1014c08b4ea992c888446ed with delete_type TABLET_DATA_TOMBSTONED (TS 6d4de2ce0683442498244b9529127f91 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:59092
I20260709 13:01:34.360530  1737 raft_consensus.cc:1275] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:34.364208  1733 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:34.376684  1733 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:34.384111  4528 consensus_queue.cc:1048] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:01:34.390662  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:34.391319  1584 raft_consensus.cc:3055] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:34.391624  1584 raft_consensus.cc:740] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:34.401430  1584 consensus_queue.cc:260] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:34.402670  1584 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:34.404974  1486 catalog_manager.cc:5697] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 9 to 10, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 10 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:34.437669  1584 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:01:34.441457  1707 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:34.440758  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:34.442667  1667 raft_consensus.cc:3055] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:34.442988  1667 raft_consensus.cc:740] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:34.443598  4492 raft_consensus.cc:2804] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:34.444124  4492 raft_consensus.cc:697] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:34.443838  1667 consensus_queue.cc:260] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:34.445161  4492 consensus_queue.cc:237] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:34.446702  1667 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:34.474787  4548 tablet_replica.cc:333] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:01:34.476215  4548 raft_consensus.cc:2243] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:34.477246  4548 raft_consensus.cc:2272] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:34.480156  1585 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:34.481508  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:34.482151  1733 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:34.482882  1667 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:01:34.483995  1556 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:34.487555  4332 raft_consensus.cc:2804] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:34.487896  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:34.488523  1661 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:34.488024  4332 raft_consensus.cc:697] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:34.494635  1733 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:01:34.495586  4332 consensus_queue.cc:237] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:34.500762  1661 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:01:34.504828  1664 raft_consensus.cc:2955] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 6d4de2ce0683442498244b9529127f91 (127.0.107.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:34.506232  4548 ts_tablet_manager.cc:1916] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:34.515713  1590 raft_consensus.cc:1275] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:34.518959  1489 catalog_manager.cc:5697] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 5 to 6, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 6 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:34.533901  1490 catalog_manager.cc:5697] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 5 to 6, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:34.532115  4473 consensus_queue.cc:1048] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:01:34.560541  1667 raft_consensus.cc:1275] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:34.562278  4445 consensus_queue.cc:1048] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:01:34.565750  1584 raft_consensus.cc:1275] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:01:34.562981  4539 consensus_queue.cc:1048] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:01:34.572753  4473 consensus_queue.cc:1048] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:34.594898  1732 raft_consensus.cc:1275] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:01:34.602195  4473 consensus_queue.cc:1048] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:34.639385  4548 ts_tablet_manager.cc:1929] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 13:01:34.642433  4548 log.cc:1199] T 0500c740c1014c08b4ea992c888446ed P 6d4de2ce0683442498244b9529127f91: Deleting WAL directory at /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-0-root/wals/0500c740c1014c08b4ea992c888446ed
I20260709 13:01:34.661142   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:34.645218  1477 catalog_manager.cc:5028] TS 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): tablet 0500c740c1014c08b4ea992c888446ed (table test-workload [id=8a8e3153ff4e476f890a0820215f177a]) successfully deleted
W20260709 13:01:34.695242  1477 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 50042.9us
I20260709 13:01:34.714668  1585 raft_consensus.cc:1275] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:34.716301  4526 consensus_queue.cc:1048] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:34.929405  1661 raft_consensus.cc:1275] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:34.931062  4539 consensus_queue.cc:1048] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:34.961704  1585 raft_consensus.cc:1275] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:34.963296  4526 consensus_queue.cc:1048] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:35.057766  1737 raft_consensus.cc:1275] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:35.060441  4541 consensus_queue.cc:1048] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:35.091830  1661 raft_consensus.cc:1275] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:35.093396  4541 consensus_queue.cc:1048] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:01:35.153555  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 46572us
W20260709 13:01:35.227135  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 89770.2us
I20260709 13:01:35.763041  1661 consensus_queue.cc:237] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
W20260709 13:01:35.786029  1630 consensus_peers.cc:597] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede -> Peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157): Couldn't send request to peer 7e839e91a1314c2f9a99b25b17c916a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5b8e576fb1634970b28a86f720e85f9a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:35.786412  1737 raft_consensus.cc:1275] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:01:35.788776  1585 raft_consensus.cc:1275] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:01:35.793594  4568 consensus_queue.cc:1048] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:35.795414  4445 consensus_queue.cc:1048] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:35.828684  4474 raft_consensus.cc:2955] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:35.831101  1584 raft_consensus.cc:2955] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:35.850067  1737 raft_consensus.cc:2955] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:35.865115   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:35.866307  1489 catalog_manager.cc:5697] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 reported cstate change: config changed from index -1 to 8, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New cstate: current_term: 10 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:35.907683  1733 consensus_queue.cc:237] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
W20260709 13:01:35.941970  1704 consensus_peers.cc:597] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d -> Peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157): Couldn't send request to peer 7e839e91a1314c2f9a99b25b17c916a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7552d3c613c34834a3a9c7ce844572fd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:35.944832  1661 raft_consensus.cc:1275] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:01:35.946866  4528 consensus_queue.cc:1048] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:35.965412  1584 raft_consensus.cc:1275] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:01:35.967320  4528 consensus_queue.cc:1048] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:01:36.000000  4528 raft_consensus.cc:2955] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:36.016064  1661 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:40572
I20260709 13:01:36.016875  1661 raft_consensus.cc:606] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:36.015327  1667 raft_consensus.cc:2955] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:36.021787  1733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:55694
I20260709 13:01:36.022403  1733 raft_consensus.cc:606] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:36.026567  1590 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3d6305e583540c895021f5a180689f7"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:36.027201  1590 raft_consensus.cc:606] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:36.026917  1584 raft_consensus.cc:2955] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:36.031978  1590 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:36.032552  1590 raft_consensus.cc:606] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Received request to transfer leadership to TS 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:36.036032  1733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:55694
I20260709 13:01:36.036922  1733 raft_consensus.cc:606] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:36.038589   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:36.051288  1733 consensus_queue.cc:237] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:36.059398  1488 catalog_manager.cc:5697] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: config changed from index -1 to 8, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New cstate: current_term: 10 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:36.064453   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:36.083426  4526 raft_consensus.cc:993] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:36.084182  4528 raft_consensus.cc:1081] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:36.099205  4541 raft_consensus.cc:993] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91: : Instructing follower 7e839e91a1314c2f9a99b25b17c916a6 to start an election
I20260709 13:01:36.099722  4541 raft_consensus.cc:1081] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Signalling peer 7e839e91a1314c2f9a99b25b17c916a6 to start an election
I20260709 13:01:36.101575  2553 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0"
dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
 from {username='slave'} at 127.0.0.1:49222
W20260709 13:01:36.102062  1704 consensus_peers.cc:597] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157): Couldn't send request to peer 7e839e91a1314c2f9a99b25b17c916a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6bb113e0e7c440b4911f4c09a86e2591. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:36.102085  2553 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:36.103004  2553 raft_consensus.cc:3060] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:36.106112  1667 raft_consensus.cc:1275] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:36.107856  4580 consensus_queue.cc:1048] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:36.110708  1583 raft_consensus.cc:1275] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:36.117884  1661 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39162
I20260709 13:01:36.118593  1661 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:36.119071  1661 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:36.124939  1661 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:36.128048  1661 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:36.127930  4539 consensus_queue.cc:1048] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:36.134754  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:36.135391  1737 raft_consensus.cc:3055] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:36.135673  1737 raft_consensus.cc:740] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:36.134794  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:36.136584  1584 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:36.138796  1737 consensus_queue.cc:260] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:36.143639  1737 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:36.148584  1584 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 9.
I20260709 13:01:36.137799  2553 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:36.153632  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:36.154243  1585 raft_consensus.cc:3055] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:36.154542  1585 raft_consensus.cc:740] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:36.155824  2553 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 5 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:36.156298  1633 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:36.157407  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:36.158149  1661 raft_consensus.cc:3060] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:36.161156  1585 consensus_queue.cc:260] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:36.163532  1737 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 9.
I20260709 13:01:36.164763  1585 raft_consensus.cc:3060] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:36.165280  4474 raft_consensus.cc:2804] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:36.170866  4474 raft_consensus.cc:697] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 9 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:36.171763  4474 consensus_queue.cc:237] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:36.172243  1661 raft_consensus.cc:2468] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 5.
I20260709 13:01:36.173601  2424 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:01:36.174376  4567 raft_consensus.cc:993] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:36.174530  4443 raft_consensus.cc:2804] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:36.174877  4567 raft_consensus.cc:1081] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Signalling peer 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:36.177899  1585 raft_consensus.cc:2468] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 5.
I20260709 13:01:36.185637  1733 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3d6305e583540c895021f5a180689f7"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:43678
I20260709 13:01:36.186200  1733 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:36.186543  1733 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:36.198513  4526 raft_consensus.cc:2955] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:36.202096  4539 raft_consensus.cc:993] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:36.202672  4582 raft_consensus.cc:1081] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:36.211668  1733 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:36.217644  1667 raft_consensus.cc:2955] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:36.219919  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:36.225104  1733 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:36.225842  1584 raft_consensus.cc:3055] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:36.226297  1584 raft_consensus.cc:740] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:36.224956  1590 raft_consensus.cc:2955] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:36.230137  1664 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39162
I20260709 13:01:36.230895  1664 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:36.231534  1664 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:36.229360  1584 consensus_queue.cc:260] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:36.233062  1584 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:36.225050  4443 raft_consensus.cc:697] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:01:36.231709  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:36.237685  1661 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:36.251262  1584 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
I20260709 13:01:36.253402  1664 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:36.256626  1664 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:36.258044  1661 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
I20260709 13:01:36.235209  4443 consensus_queue.cc:237] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:36.266176  1707 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:36.271878  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:36.272531  1583 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:36.273376  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:36.273933  1737 raft_consensus.cc:3055] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:36.274204  1737 raft_consensus.cc:740] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:36.274995  1737 consensus_queue.cc:260] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:36.276198  1737 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:36.278206  4582 raft_consensus.cc:2804] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:36.278743  4582 raft_consensus.cc:697] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:36.280265  4582 consensus_queue.cc:237] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:36.281203  1583 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 8.
I20260709 13:01:36.282325  1490 catalog_manager.cc:5697] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: config changed from index -1 to 4, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New cstate: current_term: 4 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:36.272750  1489 catalog_manager.cc:5697] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 8 to 9, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 9 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:36.294855  1667 consensus_queue.cc:237] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:36.308516  1737 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 8.
I20260709 13:01:36.310822  1633 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:36.311831  4513 raft_consensus.cc:2804] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:36.312366  4513 raft_consensus.cc:697] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 8 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:36.313290  4513 consensus_queue.cc:237] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:36.377728  1737 raft_consensus.cc:1275] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:01:36.379019  1630 consensus_peers.cc:597] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede -> Peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157): Couldn't send request to peer 7e839e91a1314c2f9a99b25b17c916a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8f63738689324ca9a4caa66b9aee2a78. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:36.374451  1490 catalog_manager.cc:5697] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 6 to 7, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 7 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:36.396087  1590 raft_consensus.cc:1275] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:36.364006  1489 catalog_manager.cc:5697] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 7 to 8, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 8 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:36.402637  4587 consensus_queue.cc:1048] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:36.403569  4474 raft_consensus.cc:993] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede: : Instructing follower 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:36.406148  4445 raft_consensus.cc:1081] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Signalling peer 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:36.412801  4590 ts_tablet_manager.cc:933] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6: Initiating tablet copy from peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:36.418504  1737 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:43686
I20260709 13:01:36.419077  1737 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:36.419409  1737 raft_consensus.cc:3060] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:36.423341  4513 consensus_queue.cc:1048] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:01:36.434576  1737 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:36.437841  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:36.438711  1584 raft_consensus.cc:3060] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:36.439265  1737 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:36.444149  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:36.444789  1661 raft_consensus.cc:3055] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:36.445322  1661 raft_consensus.cc:740] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:36.446091  1661 consensus_queue.cc:260] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:36.444716  4513 raft_consensus.cc:2955] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 5 LEADER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:36.450258  1661 raft_consensus.cc:3060] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:36.451244  1733 raft_consensus.cc:2955] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:36.455672  1489 catalog_manager.cc:5697] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 4 to 5, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:36.456813  4590 tablet_copy_client.cc:323] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:41683
I20260709 13:01:36.460492  1661 raft_consensus.cc:2468] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:01:36.461622  1705 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:36.463948  1677 tablet_copy_service.cc:140] P 5bb87fe07da2414e84ee578c3b176ede: Received BeginTabletCopySession request for tablet 5b8e576fb1634970b28a86f720e85f9a from peer 7e839e91a1314c2f9a99b25b17c916a6 ({username='slave'} at 127.0.0.1:58814)
I20260709 13:01:36.464545  1677 tablet_copy_service.cc:161] P 5bb87fe07da2414e84ee578c3b176ede: Beginning new tablet copy session on tablet 5b8e576fb1634970b28a86f720e85f9a from peer 7e839e91a1314c2f9a99b25b17c916a6 at {username='slave'} at 127.0.0.1:58814: session id = 7e839e91a1314c2f9a99b25b17c916a6-5b8e576fb1634970b28a86f720e85f9a
I20260709 13:01:36.468672  4582 raft_consensus.cc:2804] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:36.469291  4582 raft_consensus.cc:697] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:36.470153  4582 consensus_queue.cc:237] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:36.461355  1584 raft_consensus.cc:2468] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:01:36.503065  1490 catalog_manager.cc:5697] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: config changed from index -1 to 4, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New cstate: current_term: 5 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:36.510109  1677 tablet_copy_source_session.cc:215] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:36.514380  4590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b8e576fb1634970b28a86f720e85f9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.541304  1590 raft_consensus.cc:2955] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:36.562618  4596 ts_tablet_manager.cc:933] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6: Initiating tablet copy from peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:36.563349  4590 tablet_copy_client.cc:806] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:36.563983  4590 tablet_copy_client.cc:670] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:36.569693  1490 catalog_manager.cc:5697] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 2 to 3, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 3 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:36.586731  1583 raft_consensus.cc:1275] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:36.590274  4445 consensus_queue.cc:1048] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:36.597745  4590 tablet_copy_client.cc:538] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:36.619159  4596 tablet_copy_client.cc:323] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:32843
I20260709 13:01:36.625849  1751 tablet_copy_service.cc:140] P 5ced62816f8545cd9b63a27e9055e42d: Received BeginTabletCopySession request for tablet 7552d3c613c34834a3a9c7ce844572fd from peer 7e839e91a1314c2f9a99b25b17c916a6 ({username='slave'} at 127.0.0.1:35672)
I20260709 13:01:36.626432  1751 tablet_copy_service.cc:161] P 5ced62816f8545cd9b63a27e9055e42d: Beginning new tablet copy session on tablet 7552d3c613c34834a3a9c7ce844572fd from peer 7e839e91a1314c2f9a99b25b17c916a6 at {username='slave'} at 127.0.0.1:35672: session id = 7e839e91a1314c2f9a99b25b17c916a6-7552d3c613c34834a3a9c7ce844572fd
I20260709 13:01:36.655109  1751 tablet_copy_source_session.cc:215] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:36.644927  4590 tablet_bootstrap.cc:492] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap starting.
I20260709 13:01:36.671224  4596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7552d3c613c34834a3a9c7ce844572fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.687489  1733 raft_consensus.cc:1275] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:36.716543  4474 consensus_queue.cc:1048] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:36.745764  1590 raft_consensus.cc:1275] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:36.754762  4513 consensus_queue.cc:1048] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:01:36.755301  4601 ts_tablet_manager.cc:933] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6: Initiating tablet copy from peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:36.828521  1585 raft_consensus.cc:1275] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:36.830147  4584 consensus_queue.cc:1048] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:36.831152  4596 tablet_copy_client.cc:806] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:36.831743  4596 tablet_copy_client.cc:670] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:36.835747  1661 raft_consensus.cc:1275] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:36.844337  4601 tablet_copy_client.cc:323] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:32843
W20260709 13:01:36.846455  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 56788.9us
I20260709 13:01:36.841572  4443 consensus_queue.cc:1048] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:36.870069  1583 raft_consensus.cc:1275] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:36.871646  4539 consensus_queue.cc:1048] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:01:36.875862  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 85538.7us
I20260709 13:01:36.892278  4596 tablet_copy_client.cc:538] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:36.901888  1667 raft_consensus.cc:1275] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:36.902921  1751 tablet_copy_service.cc:140] P 5ced62816f8545cd9b63a27e9055e42d: Received BeginTabletCopySession request for tablet 6bb113e0e7c440b4911f4c09a86e2591 from peer 7e839e91a1314c2f9a99b25b17c916a6 ({username='slave'} at 127.0.0.1:35672)
I20260709 13:01:36.903453  1751 tablet_copy_service.cc:161] P 5ced62816f8545cd9b63a27e9055e42d: Beginning new tablet copy session on tablet 6bb113e0e7c440b4911f4c09a86e2591 from peer 7e839e91a1314c2f9a99b25b17c916a6 at {username='slave'} at 127.0.0.1:35672: session id = 7e839e91a1314c2f9a99b25b17c916a6-6bb113e0e7c440b4911f4c09a86e2591
I20260709 13:01:36.918653  1751 tablet_copy_source_session.cc:215] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:36.919005  1733 raft_consensus.cc:1275] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:36.924433  4601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bb113e0e7c440b4911f4c09a86e2591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.951169  4613 ts_tablet_manager.cc:933] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6: Initiating tablet copy from peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:37.001318  1590 raft_consensus.cc:1275] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:36.965826  4613 tablet_copy_client.cc:323] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:41683
W20260709 13:01:37.026629  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 83102.9us
I20260709 13:01:37.038986  4607 consensus_queue.cc:1048] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:01:37.042981  4596 tablet_bootstrap.cc:492] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap starting.
W20260709 13:01:37.049052  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 88485us
I20260709 13:01:37.067610   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:37.053367  1677 tablet_copy_service.cc:140] P 5bb87fe07da2414e84ee578c3b176ede: Received BeginTabletCopySession request for tablet 8f63738689324ca9a4caa66b9aee2a78 from peer 7e839e91a1314c2f9a99b25b17c916a6 ({username='slave'} at 127.0.0.1:58814)
I20260709 13:01:37.088958  1677 tablet_copy_service.cc:161] P 5bb87fe07da2414e84ee578c3b176ede: Beginning new tablet copy session on tablet 8f63738689324ca9a4caa66b9aee2a78 from peer 7e839e91a1314c2f9a99b25b17c916a6 at {username='slave'} at 127.0.0.1:58814: session id = 7e839e91a1314c2f9a99b25b17c916a6-8f63738689324ca9a4caa66b9aee2a78
I20260709 13:01:37.093299  4526 consensus_queue.cc:1048] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:37.095366  4587 consensus_queue.cc:1048] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:37.099655  1661 raft_consensus.cc:1275] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:01:37.186841  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 76014.4us
I20260709 13:01:37.207588  4590 tablet_bootstrap.cc:492] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=1 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:37.208732  4590 tablet_bootstrap.cc:492] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap complete.
I20260709 13:01:37.220837  1677 tablet_copy_source_session.cc:215] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:37.296200  4590 ts_tablet_manager.cc:1403] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6: Time spent bootstrapping tablet: real 0.652s	user 0.048s	sys 0.010s
I20260709 13:01:37.282013  4582 consensus_queue.cc:1048] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:01:37.395465  4613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f63738689324ca9a4caa66b9aee2a78. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:01:37.427788  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 63487.3us
W20260709 13:01:37.418879  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 94577.1us
W20260709 13:01:37.460580  4627 log.cc:927] Time spent T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:01:37.474220  4626 log.cc:927] Time spent T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.088s	user 0.003s	sys 0.000s
W20260709 13:01:37.487849  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 159620us
I20260709 13:01:37.472800  4590 raft_consensus.cc:359] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:37.505527  4590 raft_consensus.cc:740] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Initialized, Role: LEARNER
I20260709 13:01:37.527093  4590 consensus_queue.cc:260] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:37.534525  4601 tablet_copy_client.cc:806] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:37.541545  4601 tablet_copy_client.cc:670] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:37.538825  4590 ts_tablet_manager.cc:1434] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6: Time spent starting tablet: real 0.213s	user 0.007s	sys 0.001s
W20260709 13:01:37.551752  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 62199.3us
I20260709 13:01:37.559075  1677 tablet_copy_service.cc:342] P 5bb87fe07da2414e84ee578c3b176ede: Request end of tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-5b8e576fb1634970b28a86f720e85f9a received from {username='slave'} at 127.0.0.1:58814
I20260709 13:01:37.559646  1677 tablet_copy_service.cc:434] P 5bb87fe07da2414e84ee578c3b176ede: ending tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-5b8e576fb1634970b28a86f720e85f9a on tablet 5b8e576fb1634970b28a86f720e85f9a with peer 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:37.608042  4613 tablet_copy_client.cc:806] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:37.648517  4613 tablet_copy_client.cc:670] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:37.665786  4613 tablet_copy_client.cc:538] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:37.684686  4601 tablet_copy_client.cc:538] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:37.695611  4601 tablet_bootstrap.cc:492] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap starting.
I20260709 13:01:37.742695  4613 tablet_bootstrap.cc:492] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap starting.
I20260709 13:01:37.771572  4596 tablet_bootstrap.cc:492] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:37.780740  4596 tablet_bootstrap.cc:492] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap complete.
I20260709 13:01:37.781793  4596 ts_tablet_manager.cc:1403] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6: Time spent bootstrapping tablet: real 0.739s	user 0.039s	sys 0.006s
I20260709 13:01:37.801502  4596 raft_consensus.cc:359] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:37.803701  4596 raft_consensus.cc:740] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Initialized, Role: LEARNER
I20260709 13:01:37.804894  4596 consensus_queue.cc:260] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:37.828701  4596 ts_tablet_manager.cc:1434] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 13:01:37.804210  4601 tablet_bootstrap.cc:492] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:37.832218  4601 tablet_bootstrap.cc:492] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap complete.
I20260709 13:01:37.833194  4601 ts_tablet_manager.cc:1403] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent bootstrapping tablet: real 0.138s	user 0.029s	sys 0.004s
I20260709 13:01:37.858278  4601 raft_consensus.cc:359] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:37.859179  4601 raft_consensus.cc:740] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Initialized, Role: LEARNER
I20260709 13:01:37.859903  4601 consensus_queue.cc:260] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:37.865466  1751 tablet_copy_service.cc:342] P 5ced62816f8545cd9b63a27e9055e42d: Request end of tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-7552d3c613c34834a3a9c7ce844572fd received from {username='slave'} at 127.0.0.1:35672
I20260709 13:01:37.865993  1751 tablet_copy_service.cc:434] P 5ced62816f8545cd9b63a27e9055e42d: ending tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-7552d3c613c34834a3a9c7ce844572fd on tablet 7552d3c613c34834a3a9c7ce844572fd with peer 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:37.871131  4601 ts_tablet_manager.cc:1434] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.002s
I20260709 13:01:37.886377  1751 tablet_copy_service.cc:342] P 5ced62816f8545cd9b63a27e9055e42d: Request end of tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-6bb113e0e7c440b4911f4c09a86e2591 received from {username='slave'} at 127.0.0.1:35672
I20260709 13:01:37.886885  1751 tablet_copy_service.cc:434] P 5ced62816f8545cd9b63a27e9055e42d: ending tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-6bb113e0e7c440b4911f4c09a86e2591 on tablet 6bb113e0e7c440b4911f4c09a86e2591 with peer 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:37.979339  2553 raft_consensus.cc:1217] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 LEARNER]: Deduplicated request from leader. Original: 10.7->[10.8-10.8]   Dedup: 10.8->[]
I20260709 13:01:37.991034  4613 tablet_bootstrap.cc:492] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:37.992238  4613 tablet_bootstrap.cc:492] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap complete.
I20260709 13:01:38.000329  4613 ts_tablet_manager.cc:1403] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent bootstrapping tablet: real 0.258s	user 0.026s	sys 0.020s
I20260709 13:01:38.016577  4613 raft_consensus.cc:359] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:38.035686  4613 raft_consensus.cc:740] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Initialized, Role: LEARNER
I20260709 13:01:38.036507  4613 consensus_queue.cc:260] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:38.039248  4613 ts_tablet_manager.cc:1434] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 13:01:38.041146  1677 tablet_copy_service.cc:342] P 5bb87fe07da2414e84ee578c3b176ede: Request end of tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-8f63738689324ca9a4caa66b9aee2a78 received from {username='slave'} at 127.0.0.1:58814
I20260709 13:01:38.041564  1677 tablet_copy_service.cc:434] P 5bb87fe07da2414e84ee578c3b176ede: ending tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-8f63738689324ca9a4caa66b9aee2a78 on tablet 8f63738689324ca9a4caa66b9aee2a78 with peer 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:38.054174  2553 raft_consensus.cc:1217] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 LEARNER]: Deduplicated request from leader. Original: 10.7->[10.8-10.8]   Dedup: 10.8->[]
I20260709 13:01:38.240775  2553 raft_consensus.cc:1217] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 13:01:38.345417  2553 raft_consensus.cc:1217] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 LEARNER]: Deduplicated request from leader. Original: 5.3->[5.4-5.4]   Dedup: 5.4->[]
I20260709 13:01:38.441771  4631 raft_consensus.cc:1064] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede: attempting to promote NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 to VOTER
I20260709 13:01:38.444679  4631 consensus_queue.cc:237] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:38.472054  2553 raft_consensus.cc:1275] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 LEARNER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:38.475275  4587 consensus_queue.cc:1048] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:38.502941   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:38.525352  1733 raft_consensus.cc:1275] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:38.541127  4474 consensus_queue.cc:1048] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:38.569897  1585 raft_consensus.cc:1275] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:38.603087  4587 consensus_queue.cc:1048] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:38.620703  4630 raft_consensus.cc:1064] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d: attempting to promote NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 to VOTER
I20260709 13:01:38.623586  4630 consensus_queue.cc:237] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:38.650619  4650 raft_consensus.cc:2955] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
W20260709 13:01:38.655773  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 45154.5us
W20260709 13:01:38.665899  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 71674.3us
I20260709 13:01:38.666445  1733 raft_consensus.cc:2955] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:38.696702  1733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:55694
I20260709 13:01:38.697933  1733 raft_consensus.cc:606] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:38.705919  1488 catalog_manager.cc:5697] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: config changed from index 8 to 9, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
W20260709 13:01:38.758684  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 91568.8us
W20260709 13:01:38.793941  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 72009.1us
I20260709 13:01:38.798403  1661 raft_consensus.cc:1275] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:38.834786  2553 raft_consensus.cc:2955] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:38.841595  2552 raft_consensus.cc:1275] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 LEARNER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:01:38.844559  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 132433us
I20260709 13:01:38.830515  4630 consensus_queue.cc:1048] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
W20260709 13:01:38.913038  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 64371.5us
I20260709 13:01:38.944876  1585 raft_consensus.cc:1275] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:38.949411  4587 raft_consensus.cc:1064] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede: attempting to promote NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 to VOTER
I20260709 13:01:38.955443  4587 consensus_queue.cc:237] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 2, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:38.983502  4662 raft_consensus.cc:993] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:38.985427  4654 raft_consensus.cc:1081] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:38.992952  1664 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39162
W20260709 13:01:38.992995  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 114520us
I20260709 13:01:38.993808  1664 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:38.994189  1664 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:39.042497  1664 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:39.048609  1739 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
mode: GRACEFUL
new_leader_uuid: "6d4de2ce0683442498244b9529127f91"
 from {username='slave'} at 127.0.0.1:55694
I20260709 13:01:39.050252  1739 raft_consensus.cc:606] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Received request to transfer leadership to TS 6d4de2ce0683442498244b9529127f91
I20260709 13:01:39.053658  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:39.054491  1733 raft_consensus.cc:3055] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:39.054852  1733 raft_consensus.cc:740] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:39.069631  1664 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:39.085095  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:01:39.085685  2552 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:39.038763  4663 consensus_queue.cc:1048] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
W20260709 13:01:39.135926  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 61689.1us
I20260709 13:01:39.165918  4677 consensus_queue.cc:1048] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:01:39.223577  4672 raft_consensus.cc:1064] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d: attempting to promote NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 to VOTER
I20260709 13:01:39.226706  4672 consensus_queue.cc:237] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:39.231885  1733 consensus_queue.cc:260] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:39.279356  1733 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:39.247452  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 172120us
W20260709 13:01:39.256251  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 165523us
W20260709 13:01:39.257735  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 187212us
W20260709 13:01:39.248762  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 159065us
I20260709 13:01:39.297537  1733 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 8.
I20260709 13:01:39.271183  2552 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 8.
W20260709 13:01:39.273435  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 213502us
I20260709 13:01:39.302567  2553 raft_consensus.cc:1240] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:39.311080  1584 raft_consensus.cc:2955] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:39.321715  1583 raft_consensus.cc:1275] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:39.331887  1739 raft_consensus.cc:1275] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:01:39.364549  4679 log.cc:927] Time spent T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.143s	user 0.003s	sys 0.000s
I20260709 13:01:39.364485  4686 consensus_queue.cc:1048] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:39.370656  4654 raft_consensus.cc:993] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d: : Instructing follower 6d4de2ce0683442498244b9529127f91 to start an election
I20260709 13:01:39.371308  4607 raft_consensus.cc:1081] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Signalling peer 6d4de2ce0683442498244b9529127f91 to start an election
I20260709 13:01:39.386956  4587 consensus_queue.cc:1048] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:39.413061  1586 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
 from {username='slave'} at 127.0.0.1:59112
I20260709 13:01:39.413717  1586 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:39.414187  1586 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:39.416839  1587 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:39.417523  1587 raft_consensus.cc:606] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:39.416895  4654 raft_consensus.cc:2955] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:39.426394  1633 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:39.445343  4687 raft_consensus.cc:2804] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:39.446020  4687 raft_consensus.cc:697] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 8 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:39.449671  2552 raft_consensus.cc:2955] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:39.468015  2554 raft_consensus.cc:1275] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 LEARNER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:39.474512  4687 consensus_queue.cc:237] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:39.486876  2554 raft_consensus.cc:1275] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 LEARNER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:39.496459  1664 raft_consensus.cc:2955] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:39.492476  1586 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:39.513202  1586 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:39.512737  1489 catalog_manager.cc:5697] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: config changed from index 8 to 9, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:39.514355  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: true dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:01:39.521369  2552 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:39.521739  1667 raft_consensus.cc:1275] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:39.574630  4680 raft_consensus.cc:993] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:39.575276  4680 raft_consensus.cc:1081] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Signalling peer 5ced62816f8545cd9b63a27e9055e42d to start an election
W20260709 13:01:39.576208  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 73775.7us
I20260709 13:01:39.594377  2552 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:01:39.596844  1585 raft_consensus.cc:1275] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:39.500054  4681 consensus_queue.cc:1048] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.099s
I20260709 13:01:39.610116  1555 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:01:39.611531  4656 raft_consensus.cc:2804] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:39.612215  4656 raft_consensus.cc:697] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:39.613847  4656 consensus_queue.cc:237] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:01:39.622148  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 92666.3us
W20260709 13:01:39.643496  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 74078.5us
I20260709 13:01:39.669531  1585 raft_consensus.cc:2955] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:39.678224  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:39.678869  1733 raft_consensus.cc:3055] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:39.679139  1733 raft_consensus.cc:740] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:39.679976  1733 consensus_queue.cc:260] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:39.681525  1737 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:43678
I20260709 13:01:39.682139  1737 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:39.682579  1737 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:39.691184  1733 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:39.713492  1733 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:01:39.724574  1737 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:39.736922  1737 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:39.742594  4689 raft_consensus.cc:2955] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index 4 to 5, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:39.757755  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:39.760123  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:39.760931  1664 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:39.761111  1591 raft_consensus.cc:3055] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:39.762015  1591 raft_consensus.cc:740] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:39.763787  1591 consensus_queue.cc:260] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:39.765311  1591 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:39.777529  1591 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
W20260709 13:01:39.779649  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 46686.1us
I20260709 13:01:39.781529  1707 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:39.785236  4474 consensus_queue.cc:1048] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:39.798188  1664 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:01:39.809340  4668 consensus_queue.cc:1048] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:39.815583  4685 consensus_queue.cc:1048] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:39.795915  4660 raft_consensus.cc:2804] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:39.818048  4660 raft_consensus.cc:697] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:39.819018  4660 consensus_queue.cc:237] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:39.820210  1488 catalog_manager.cc:5697] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 6 to 7, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:39.829531  1665 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
mode: GRACEFUL
new_leader_uuid: "6d4de2ce0683442498244b9529127f91"
 from {username='slave'} at 127.0.0.1:40572
I20260709 13:01:39.830227  1665 raft_consensus.cc:606] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Received request to transfer leadership to TS 6d4de2ce0683442498244b9529127f91
I20260709 13:01:39.832033  1732 raft_consensus.cc:2955] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 4 to 5, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:39.869896  1661 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
mode: GRACEFUL
new_leader_uuid: "6d4de2ce0683442498244b9529127f91"
 from {username='slave'} at 127.0.0.1:40572
I20260709 13:01:39.870643  1661 raft_consensus.cc:606] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 7 LEADER]: Received request to transfer leadership to TS 6d4de2ce0683442498244b9529127f91
I20260709 13:01:39.875897   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:39.878770   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:39.885597  4668 raft_consensus.cc:2955] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:39.892369  2552 raft_consensus.cc:2955] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 4 to 5, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:39.923350  1585 raft_consensus.cc:2955] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:39.950021  1738 raft_consensus.cc:1275] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:39.967483  1585 raft_consensus.cc:2955] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 4 to 5, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:39.974192  2554 raft_consensus.cc:2955] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:40.013715  1490 catalog_manager.cc:5697] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: config changed from index 4 to 5, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:40.015709  1490 catalog_manager.cc:5697] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 7 to 8, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 8 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:40.022141  2554 raft_consensus.cc:1275] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:01:40.029884  4651 consensus_queue.cc:1048] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:40.035914  4658 consensus_queue.cc:1048] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:40.063182  1489 catalog_manager.cc:5697] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: config changed from index 4 to 5, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:40.069093  1739 consensus_queue.cc:237] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:40.079147  1665 consensus_queue.cc:237] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:40.082948  2552 raft_consensus.cc:1275] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:40.085042  4668 consensus_queue.cc:1048] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:01:40.111579  2552 raft_consensus.cc:1275] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:40.113057  4696 consensus_queue.cc:1048] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:40.112249  4685 raft_consensus.cc:2955] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 10 LEADER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER 6d4de2ce0683442498244b9529127f91 (127.0.107.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:40.113725  1661 raft_consensus.cc:2955] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:40.120096  2552 raft_consensus.cc:2955] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER 6d4de2ce0683442498244b9529127f91 (127.0.107.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:40.161803  1477 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7552d3c613c34834a3a9c7ce844572fd with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:40.179129  1739 raft_consensus.cc:1275] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:01:40.181052  4683 consensus_queue.cc:1048] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:40.191198  1585 raft_consensus.cc:1275] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:40.253422  4631 raft_consensus.cc:2955] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:40.263623  1488 catalog_manager.cc:5697] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: config changed from index 9 to 10, VOTER 6d4de2ce0683442498244b9529127f91 (127.0.107.193) evicted. New cstate: current_term: 10 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:40.270313  1585 raft_consensus.cc:1275] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:01:40.281392  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 58808us
I20260709 13:01:40.287304  4677 consensus_queue.cc:1048] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:40.290514  4650 raft_consensus.cc:993] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede: : Instructing follower 6d4de2ce0683442498244b9529127f91 to start an election
I20260709 13:01:40.291121  4650 raft_consensus.cc:1081] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Signalling peer 6d4de2ce0683442498244b9529127f91 to start an election
I20260709 13:01:40.296416  1581 tablet_service.cc:1558] Processing DeleteTablet for tablet 7552d3c613c34834a3a9c7ce844572fd with delete_type TABLET_DATA_TOMBSTONED (TS 6d4de2ce0683442498244b9529127f91 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:59092
I20260709 13:01:40.298954  1489 catalog_manager.cc:5697] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 5 to 6, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 6 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:40.327767  1661 raft_consensus.cc:1275] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:40.332253  2552 raft_consensus.cc:2955] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:40.333801  1667 raft_consensus.cc:1275] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:40.346321  2554 raft_consensus.cc:1275] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:40.399875  4660 consensus_queue.cc:1048] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:01:40.330422  4696 consensus_queue.cc:1048] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 13:01:40.423622  4684 consensus_queue.cc:1048] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:40.429631  1661 consensus_queue.cc:237] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:40.415854  4687 consensus_queue.cc:1048] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:01:40.439647  4717 tablet_replica.cc:333] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:01:40.443254  1739 consensus_queue.cc:237] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:40.445263  4717 raft_consensus.cc:2243] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:40.472028  4717 raft_consensus.cc:2272] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:40.466005  1583 raft_consensus.cc:1275] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:40.445848  1475 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5b8e576fb1634970b28a86f720e85f9a with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:01:40.505827  1475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 60084.9us
W20260709 13:01:40.475068  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 127308us
I20260709 13:01:40.478744  1661 raft_consensus.cc:2955] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER 6d4de2ce0683442498244b9529127f91 (127.0.107.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:40.495908  2552 raft_consensus.cc:1275] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:01:40.604126  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 107915us
I20260709 13:01:40.608631  2552 raft_consensus.cc:1275] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:40.615952  1489 catalog_manager.cc:5697] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: config changed from index 9 to 10, VOTER 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) evicted. New cstate: current_term: 10 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:40.621234  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 113324us
W20260709 13:01:40.626586  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 125596us
W20260709 13:01:40.626441  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 99752.7us
I20260709 13:01:40.639353  1738 raft_consensus.cc:1275] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:40.637528  4717 ts_tablet_manager.cc:1916] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:40.669163  1585 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
 from {username='slave'} at 127.0.0.1:59106
I20260709 13:01:40.670065  1585 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:40.670536  1585 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:40.710537  1585 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:40.719900  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 77901.8us
I20260709 13:01:40.679893  4715 consensus_queue.cc:1048] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
W20260709 13:01:40.719161  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 80367.5us
I20260709 13:01:40.781396  1585 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:40.783892  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 100191us
W20260709 13:01:40.786595  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 72532.4us
I20260709 13:01:40.782490  1587 raft_consensus.cc:2955] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:40.769572  4669 consensus_queue.cc:1048] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:01:40.778492  4651 raft_consensus.cc:993] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede: : Instructing follower 6d4de2ce0683442498244b9529127f91 to start an election
I20260709 13:01:40.821200  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:40.822088  1737 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:40.795327  4689 consensus_queue.cc:1048] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:01:40.843928  1725 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b8e576fb1634970b28a86f720e85f9a with delete_type TABLET_DATA_TOMBSTONED (TS 5ced62816f8545cd9b63a27e9055e42d not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:43674
I20260709 13:01:40.857059  4651 raft_consensus.cc:1081] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 7 LEADER]: Signalling peer 6d4de2ce0683442498244b9529127f91 to start an election
I20260709 13:01:40.857167  4717 ts_tablet_manager.cc:1929] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.9
I20260709 13:01:40.858047  4717 log.cc:1199] T 7552d3c613c34834a3a9c7ce844572fd P 6d4de2ce0683442498244b9529127f91: Deleting WAL directory at /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-0-root/wals/7552d3c613c34834a3a9c7ce844572fd
I20260709 13:01:40.848726  1737 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:01:40.870231  1586 raft_consensus.cc:1240] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:40.871907  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:40.872504  1667 raft_consensus.cc:3055] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:40.872771  1667 raft_consensus.cc:740] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:40.873581  1667 consensus_queue.cc:260] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:40.874480  1667 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:40.897336  4660 raft_consensus.cc:2955] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
W20260709 13:01:40.902456  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 54598us
W20260709 13:01:40.951993  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 321601us
I20260709 13:01:40.984647  1667 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
W20260709 13:01:41.005550  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 90345.5us
I20260709 13:01:41.006419  1558 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:40.879870   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:40.984895  1477 catalog_manager.cc:5028] TS 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): tablet 7552d3c613c34834a3a9c7ce844572fd (table test-workload [id=8a8e3153ff4e476f890a0820215f177a]) successfully deleted
W20260709 13:01:41.040026  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 117785us
I20260709 13:01:41.033572  4683 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:41.073602  1590 raft_consensus.cc:2955] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:41.077443  4739 tablet_replica.cc:333] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:01:41.078673  4739 raft_consensus.cc:2243] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:41.062770  4683 raft_consensus.cc:697] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:41.089638  4683 consensus_queue.cc:237] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:41.094002  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.098820  4715 raft_consensus.cc:2955] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 5 to 6, VOTER 6d4de2ce0683442498244b9529127f91 (127.0.107.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
W20260709 13:01:41.105582  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 86223.2us
W20260709 13:01:41.109017  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 67653us
I20260709 13:01:41.128593  4739 raft_consensus.cc:2272] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.131980  4739 ts_tablet_manager.cc:1916] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:41.137657  1477 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6bb113e0e7c440b4911f4c09a86e2591 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:41.140630  2554 raft_consensus.cc:2955] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, VOTER 6d4de2ce0683442498244b9529127f91 (127.0.107.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:41.142704  4668 consensus_queue.cc:1048] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:41.165628  1475 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8f63738689324ca9a4caa66b9aee2a78 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:41.176869  1586 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
 from {username='slave'} at 127.0.0.1:59106
I20260709 13:01:41.178056  1586 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:41.178485  1586 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:41.186260  1486 catalog_manager.cc:5697] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: config changed from index 5 to 6, VOTER 6d4de2ce0683442498244b9529127f91 (127.0.107.193) evicted. New cstate: current_term: 5 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:41.217994  1581 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f63738689324ca9a4caa66b9aee2a78 with delete_type TABLET_DATA_TOMBSTONED (TS 6d4de2ce0683442498244b9529127f91 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:59092
I20260709 13:01:41.219004  4717 tablet_replica.cc:333] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:01:41.220117  4717 raft_consensus.cc:2243] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:41.219683  1489 catalog_manager.cc:5697] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 10 to 11, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:41.220942  4717 raft_consensus.cc:2272] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.224668  4717 ts_tablet_manager.cc:1916] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:41.186579  1488 catalog_manager.cc:5697] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: config changed from index 5 to 6, VOTER 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) evicted. New cstate: current_term: 4 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:41.293546  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 64072.5us
I20260709 13:01:41.228181  1738 raft_consensus.cc:2955] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, VOTER 6d4de2ce0683442498244b9529127f91 (127.0.107.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
W20260709 13:01:41.312837  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 64449.9us
W20260709 13:01:41.313118  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 82474.7us
I20260709 13:01:41.360867  1650 tablet_service.cc:1558] Processing DeleteTablet for tablet 6bb113e0e7c440b4911f4c09a86e2591 with delete_type TABLET_DATA_TOMBSTONED (TS 5bb87fe07da2414e84ee578c3b176ede not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:39130
I20260709 13:01:41.387217  2550 raft_consensus.cc:2955] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:41.394495  4750 tablet_replica.cc:333] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:01:41.395882  4750 raft_consensus.cc:2243] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:41.403076  4750 raft_consensus.cc:2272] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.405273  1586 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:41.409821  1590 raft_consensus.cc:1240] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:41.413861  1586 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:41.415678  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:41.408404  4750 ts_tablet_manager.cc:1916] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:41.422010  1733 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:41.429697  1733 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:01:41.430855  1558 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:41.431757  4683 raft_consensus.cc:2804] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:41.432296  4683 raft_consensus.cc:697] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:41.433393  4683 consensus_queue.cc:237] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:41.440030  4688 consensus_queue.cc:1059] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:41.441217  4513 raft_consensus.cc:3055] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:41.441597  4513 raft_consensus.cc:740] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:41.442313  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:41.442386  4513 consensus_queue.cc:260] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:41.443691  4513 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:41.468784  1486 catalog_manager.cc:5697] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 7 to 8, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:41.486743  4739 ts_tablet_manager.cc:1929] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.9
I20260709 13:01:41.501857  4739 log.cc:1199] T 5b8e576fb1634970b28a86f720e85f9a P 5ced62816f8545cd9b63a27e9055e42d: Deleting WAL directory at /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-2-root/wals/5b8e576fb1634970b28a86f720e85f9a
I20260709 13:01:41.512879  1667 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:01:41.535630  4717 ts_tablet_manager.cc:1929] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.5
I20260709 13:01:41.536322  4717 log.cc:1199] T 8f63738689324ca9a4caa66b9aee2a78 P 6d4de2ce0683442498244b9529127f91: Deleting WAL directory at /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-0-root/wals/8f63738689324ca9a4caa66b9aee2a78
I20260709 13:01:41.540189  4750 ts_tablet_manager.cc:1929] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 13:01:41.540830  4750 log.cc:1199] T 6bb113e0e7c440b4911f4c09a86e2591 P 5bb87fe07da2414e84ee578c3b176ede: Deleting WAL directory at /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-1-root/wals/6bb113e0e7c440b4911f4c09a86e2591
I20260709 13:01:41.713301  1477 catalog_manager.cc:5028] TS 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): tablet 5b8e576fb1634970b28a86f720e85f9a (table test-workload [id=8a8e3153ff4e476f890a0820215f177a]) successfully deleted
I20260709 13:01:42.402212  4726 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:42.402891  4726 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:42.408730  1666 raft_consensus.cc:1275] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:42.415808  1663 raft_consensus.cc:1275] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:01:42.455801  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 75560.8us
I20260709 13:01:42.466041   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:01:42.477275  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 90221.8us
W20260709 13:01:42.476148  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 53531.5us
W20260709 13:01:42.510124  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 88385.6us
I20260709 13:01:42.527550  4759 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
W20260709 13:01:42.578771  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 118668us
I20260709 13:01:42.571192  4736 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:42.568487  4759 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:42.582512  4726 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:42.586457  4760 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:42.622936  4760 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:42.606117  4696 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.636178  4760 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:42.626260  4696 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:42.644127  4696 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:42.654383  4668 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:42.655108  4668 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:42.659031  4674 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:42.586172  4736 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:42.609616  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:42.661962  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:42.666116  4668 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:42.668292  4736 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:42.566635  1477 catalog_manager.cc:5028] TS 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): tablet 8f63738689324ca9a4caa66b9aee2a78 (table test-workload [id=8a8e3153ff4e476f890a0820215f177a]) successfully deleted
I20260709 13:01:42.603710  1475 catalog_manager.cc:5028] TS 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): tablet 6bb113e0e7c440b4911f4c09a86e2591 (table test-workload [id=8a8e3153ff4e476f890a0820215f177a]) successfully deleted
W20260709 13:01:42.669091  1477 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 102461us
W20260709 13:01:42.669457  1475 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 65770.2us
I20260709 13:01:42.606201  4759 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:42.676878  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:42.683563  4759 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:42.684655  4759 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:42.687094  4759 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:42.693756  4759 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:42.694427  4759 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:42.666812  4674 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:42.696907  4759 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:42.698164  4513 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:42.698725  4513 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:42.700690  4513 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:42.701097  4687 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:42.701745  4687 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:42.703859  4687 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:42.704142  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:42.705271  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:42.706643  4674 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:42.707419  2426 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:42.708847  4729 raft_consensus.cc:2749] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:42.723577  4768 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:01:42.724027  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 154105us
I20260709 13:01:42.724270  4768 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:42.727206  4768 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:42.729015  4770 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:42.729543  4770 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:42.733747  4770 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:42.734421  4769 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:42.735306  4769 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:42.735800  4760 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:42.736379  4760 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:42.738288  4769 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:42.738999  4760 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:42.742218  4757 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:42.742733  4757 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:42.745028  4757 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:42.745108  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:01:42.746567  1688 debug-util.cc:398] Leaking SignalData structure 0x7b08002dd0c0 after lost signal to thread 434
W20260709 13:01:42.747784  1688 debug-util.cc:398] Leaking SignalData structure 0x7b080027d560 after lost signal to thread 1524
I20260709 13:01:42.753325  4768 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:01:42.754103  1688 debug-util.cc:398] Leaking SignalData structure 0x7b08001fcb80 after lost signal to thread 1616
I20260709 13:01:42.754041  4768 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:01:42.755473  1688 debug-util.cc:398] Leaking SignalData structure 0x7b08002dd0e0 after lost signal to thread 1691
I20260709 13:01:42.755632  4757 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:42.756207  4757 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:42.756958  4685 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:42.757587  4685 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:42.756747  1688 debug-util.cc:398] Leaking SignalData structure 0x7b08001aa480 after lost signal to thread 1765
W20260709 13:01:42.762830  1688 debug-util.cc:398] Leaking SignalData structure 0x7b080035eda0 after lost signal to thread 2594
I20260709 13:01:42.766359  4683 consensus_queue.cc:1048] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:42.766989  4736 consensus_queue.cc:1048] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:42.768676  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:42.765646  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:42.770279  1738 raft_consensus.cc:1275] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:42.771354  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:42.772707  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:42.756619  4768 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:42.777392  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:01:42.756995  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 170001us
I20260709 13:01:42.779245  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:42.779572  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:42.780869  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:42.784826  4757 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:42.785944  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:42.789809  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:42.792145  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:42.792905  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:42.797987  4762 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:42.799067  4762 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:42.805984  4762 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:42.807466  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:42.808368  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:42.808724  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:42.809182  1738 raft_consensus.cc:1275] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:42.775815  4685 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:42.839257  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:42.841106  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:42.842619  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:42.843194  4685 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:42.843789  4685 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:42.844168  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:42.846014  4685 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:42.847921  1738 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:01:42.860299  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:42.864279  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:42.863967  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:42.877892  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:42.879278  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:42.872200  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:42.882225  1705 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:42.883670  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:42.897117  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:42.901795  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:42.904083  4757 raft_consensus.cc:2749] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:42.904691  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:42.911026  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:42.912317  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:42.914868  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:42.922219  1741 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 11.
I20260709 13:01:42.926355  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:42.928263  4762 consensus_queue.cc:1048] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:42.949707  1707 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:42.951709  4769 raft_consensus.cc:2749] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:42.953007  1707 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:42.954250  4769 raft_consensus.cc:2749] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:42.955181  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:42.957389  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:42.966590  1707 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:42.967371  4769 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:42.967804  1707 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:42.968526  4769 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:42.971699  1556 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:42.972811  1707 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:42.973179  4683 raft_consensus.cc:2749] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:42.974306  1707 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:42.975066  4769 raft_consensus.cc:2749] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:42.975080  4685 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:42.978407  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:42.990685  1558 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:42.992167  4767 raft_consensus.cc:2749] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:42.992560  4736 consensus_queue.cc:1048] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:43.002389  1558 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:43.004732  1558 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:43.006711  1558 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:43.005358  4736 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:43.007256  4762 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:43.008914  4762 raft_consensus.cc:2804] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:43.009295  4762 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:43.009652  4762 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:43.015973  1556 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:43.017097  4736 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:43.020716  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 43620us
I20260709 13:01:43.028419  1633 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:43.037312  4688 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:43.037760  4688 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:43.038136  4688 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:43.052091  4688 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:43.054297  4688 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:43.061250  1633 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:43.062855  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:43.063277  4651 raft_consensus.cc:2749] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:43.066244  1633 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:43.068516  1667 raft_consensus.cc:1240] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:43.074872  4688 raft_consensus.cc:2749] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:42.977029  1707 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:43.083302  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:43.089277  4769 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:43.091795  1633 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:43.092926  4762 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:43.094651  4650 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:01:43.090281  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 113291us
I20260709 13:01:43.095834  1707 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:43.117637  1707 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:43.126296  4762 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:43.127053  4769 raft_consensus.cc:2749] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:43.131546  1707 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:43.132035  4757 raft_consensus.cc:2749] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:43.132733  4760 raft_consensus.cc:2749] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:43.134256  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:43.136284  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:43.133293  4683 consensus_queue.cc:1059] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:01:43.163100  1735 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:55694
I20260709 13:01:43.163738  1735 raft_consensus.cc:606] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:43.169787  1667 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:40572
I20260709 13:01:43.170275  1667 raft_consensus.cc:606] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 7 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:43.171025  4683 raft_consensus.cc:3055] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:43.171459  4683 raft_consensus.cc:740] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:43.172300  4683 consensus_queue.cc:260] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:43.173069  1666 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
mode: GRACEFUL
new_leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
 from {username='slave'} at 127.0.0.1:40572
I20260709 13:01:43.173657  1666 raft_consensus.cc:606] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 5 LEADER]: Received request to transfer leadership to TS 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:43.173879  4683 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:43.177428  1735 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:55694
I20260709 13:01:43.177953  1735 raft_consensus.cc:606] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:43.188944  1556 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:43.181998  1737 consensus_queue.cc:237] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:43.201316  4736 raft_consensus.cc:2749] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:43.219810  1587 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:43.222121  1587 raft_consensus.cc:606] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:43.222540  1587 raft_consensus.cc:614] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:43.232965  1587 raft_consensus.cc:1275] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:43.234735  4761 consensus_queue.cc:1048] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:01:43.242175  1704 consensus_peers.cc:597] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d -> Peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157): Couldn't send request to peer 7e839e91a1314c2f9a99b25b17c916a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2782217725024e159b9536d03808a3ea. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:43.243001  1667 raft_consensus.cc:1275] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:43.249208  4766 consensus_queue.cc:1048] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:43.252420   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:43.254984   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:43.281236  4766 raft_consensus.cc:2955] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:43.301448  1586 raft_consensus.cc:1240] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:43.301309  1667 raft_consensus.cc:2955] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:43.304630  4651 consensus_queue.cc:1059] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:43.305989  4768 raft_consensus.cc:993] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:43.306877  4768 raft_consensus.cc:1081] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:43.310410  1666 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39162
I20260709 13:01:43.311002  1666 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:43.311403  1666 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:43.305976  4651 raft_consensus.cc:3055] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:43.314776  4651 raft_consensus.cc:740] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:43.315791  4651 consensus_queue.cc:260] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:43.317662  4651 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:43.318768  4768 raft_consensus.cc:993] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:43.319710  4765 raft_consensus.cc:1081] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:43.322037  1661 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39162
I20260709 13:01:43.322608  1661 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:43.323009  1661 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:43.330263  1666 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:43.335129  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:43.335794  1586 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:43.336496  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:43.337756  1734 raft_consensus.cc:3055] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:43.338061  1734 raft_consensus.cc:740] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:43.339043  1734 consensus_queue.cc:260] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:43.340968  1734 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:43.349800  1586 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 7.
I20260709 13:01:43.355499  1661 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:43.364231  1486 catalog_manager.cc:5697] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: config changed from index -1 to 4, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New cstate: current_term: 4 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:43.376498  1666 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:43.378342  1661 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:43.373126  1633 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:43.385686  1734 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 7.
I20260709 13:01:43.385272  1590 consensus_queue.cc:237] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:43.400970  4687 raft_consensus.cc:2804] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:43.402004  4687 raft_consensus.cc:697] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 7 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:43.402932  4687 consensus_queue.cc:237] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:43.413208  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:43.413858  1587 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:43.416519  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:43.417527  1735 raft_consensus.cc:3055] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:43.417941  1735 raft_consensus.cc:740] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:43.418766  1735 consensus_queue.cc:260] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:43.429507  1587 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 7.
I20260709 13:01:43.420845  1735 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:43.433573  1633 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:43.436499  4513 raft_consensus.cc:2804] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:43.445667  1583 raft_consensus.cc:2955] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
W20260709 13:01:43.498986  1555 consensus_peers.cc:597] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 -> Peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157): Couldn't send request to peer 7e839e91a1314c2f9a99b25b17c916a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ae1310c9ee464797a39b786c1d932941. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:43.505323  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 68430us
I20260709 13:01:43.507416  1734 raft_consensus.cc:1275] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:43.509099  4683 consensus_queue.cc:1048] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:43.509596  1666 raft_consensus.cc:1275] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:43.511907  4683 consensus_queue.cc:1048] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:43.539068  4513 raft_consensus.cc:697] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 7 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:43.513057  1735 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 7.
I20260709 13:01:43.559161  4513 consensus_queue.cc:237] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:43.597613  4736 raft_consensus.cc:2955] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Committing config change with OpId 6.4: config changed from index -1 to 4, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:43.608062  4650 raft_consensus.cc:993] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede: : Instructing follower 7e839e91a1314c2f9a99b25b17c916a6 to start an election
I20260709 13:01:43.608829  4650 raft_consensus.cc:1081] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 5 LEADER]: Signalling peer 7e839e91a1314c2f9a99b25b17c916a6 to start an election
I20260709 13:01:43.611260  2552 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78"
dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
 from {username='slave'} at 127.0.0.1:49218
I20260709 13:01:43.612167  2552 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:43.612543  2552 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:43.626565  1667 raft_consensus.cc:2955] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Committing config change with OpId 6.4: config changed from index -1 to 4, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:43.632702  1735 raft_consensus.cc:2955] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Committing config change with OpId 6.4: config changed from index -1 to 4, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:43.638682  1488 catalog_manager.cc:5697] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 6 to 7, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 7 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:43.640302  1488 catalog_manager.cc:5697] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 6 to 7, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 7 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:43.662216  2552 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:43.667920  2552 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 6 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:43.668985  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:43.670019  1734 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:43.670388  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:43.670996  1666 raft_consensus.cc:3055] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:43.671290  1666 raft_consensus.cc:740] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:43.673291  1666 consensus_queue.cc:260] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:43.676508  1666 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:43.680662  1734 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 6.
I20260709 13:01:43.681830  2426 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:01:43.696507  1666 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 6.
I20260709 13:01:43.697479  1586 consensus_queue.cc:237] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:43.699643  1490 catalog_manager.cc:5697] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: config changed from index -1 to 4, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New cstate: current_term: 6 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:43.692024  4729 raft_consensus.cc:2804] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:43.731657  4729 raft_consensus.cc:697] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:01:43.775142  4729 consensus_queue.cc:237] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:01:43.821928  1555 consensus_peers.cc:597] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 -> Peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157): Couldn't send request to peer 7e839e91a1314c2f9a99b25b17c916a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c9831da869404fb79a22d3887701ca69. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:43.882872  1735 raft_consensus.cc:1275] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:01:43.889504  1661 raft_consensus.cc:1275] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:01:43.893288  4800 consensus_queue.cc:1048] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:43.913856  4683 consensus_queue.cc:1048] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:43.934559  4803 ts_tablet_manager.cc:933] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6: Initiating tablet copy from peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:43.925519  1486 catalog_manager.cc:5697] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 5 to 6, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 6 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:43.953284  1737 raft_consensus.cc:1275] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:43.993585  4800 raft_consensus.cc:2955] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:44.001796  4803 tablet_copy_client.cc:323] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:32843
I20260709 13:01:44.003746  4651 consensus_queue.cc:1048] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:44.007301  1751 tablet_copy_service.cc:140] P 5ced62816f8545cd9b63a27e9055e42d: Received BeginTabletCopySession request for tablet 2782217725024e159b9536d03808a3ea from peer 7e839e91a1314c2f9a99b25b17c916a6 ({username='slave'} at 127.0.0.1:35672)
I20260709 13:01:44.007930  1751 tablet_copy_service.cc:161] P 5ced62816f8545cd9b63a27e9055e42d: Beginning new tablet copy session on tablet 2782217725024e159b9536d03808a3ea from peer 7e839e91a1314c2f9a99b25b17c916a6 at {username='slave'} at 127.0.0.1:35672: session id = 7e839e91a1314c2f9a99b25b17c916a6-2782217725024e159b9536d03808a3ea
I20260709 13:01:44.012137  1734 raft_consensus.cc:2955] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:44.049275  1587 raft_consensus.cc:1275] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:44.068007  1751 tablet_copy_source_session.cc:215] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:44.068933  1667 raft_consensus.cc:2955] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:44.126116  1586 raft_consensus.cc:1275] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:44.155825  4803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2782217725024e159b9536d03808a3ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.186117  4808 ts_tablet_manager.cc:933] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6: Initiating tablet copy from peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:01:44.203192  4808 tablet_copy_client.cc:323] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:33325
I20260709 13:01:44.302634   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:44.332024  1601 tablet_copy_service.cc:140] P 6d4de2ce0683442498244b9529127f91: Received BeginTabletCopySession request for tablet ae1310c9ee464797a39b786c1d932941 from peer 7e839e91a1314c2f9a99b25b17c916a6 ({username='slave'} at 127.0.0.1:46836)
I20260709 13:01:44.333348  1601 tablet_copy_service.cc:161] P 6d4de2ce0683442498244b9529127f91: Beginning new tablet copy session on tablet ae1310c9ee464797a39b786c1d932941 from peer 7e839e91a1314c2f9a99b25b17c916a6 at {username='slave'} at 127.0.0.1:46836: session id = 7e839e91a1314c2f9a99b25b17c916a6-ae1310c9ee464797a39b786c1d932941
I20260709 13:01:44.366163  1661 raft_consensus.cc:1275] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:44.373302  4798 consensus_queue.cc:1048] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:01:44.370499  1486 catalog_manager.cc:5697] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 reported cstate change: config changed from index -1 to 6, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New cstate: current_term: 7 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:44.403234  1666 consensus_queue.cc:237] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:44.428242  4651 consensus_queue.cc:1048] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:01:44.475255  1601 tablet_copy_source_session.cc:215] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:44.527837  1736 raft_consensus.cc:1275] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:44.549206  4808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae1310c9ee464797a39b786c1d932941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.562131  4729 consensus_queue.cc:1048] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:01:44.612577  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 313958us
I20260709 13:01:44.639025  4651 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.640376  4651 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:44.643587  4651 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:44.645251  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 90837.5us
I20260709 13:01:44.644908  4815 consensus_queue.cc:1048] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:01:44.662783  4818 ts_tablet_manager.cc:933] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6: Initiating tablet copy from peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
W20260709 13:01:44.666234  4820 log.cc:927] Time spent T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.068s	user 0.004s	sys 0.000s
W20260709 13:01:44.680696  1630 consensus_peers.cc:597] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede -> Peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157): Couldn't send request to peer 7e839e91a1314c2f9a99b25b17c916a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b37805060ac444b6b6e9e7da8164233c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:44.738929  4765 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:44.740044  4765 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:44.748416  4765 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:01:44.745287  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 52036.9us
I20260709 13:01:44.776613  1737 raft_consensus.cc:1275] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:44.778035  4818 tablet_copy_client.cc:323] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:33325
I20260709 13:01:44.780915  4803 tablet_copy_client.cc:806] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:44.782152  4803 tablet_copy_client.cc:670] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:44.782367  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:44.783442  1583 raft_consensus.cc:2393] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 8: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
W20260709 13:01:44.785211  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 122662us
I20260709 13:01:44.816689  1590 raft_consensus.cc:1275] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:44.820340  1601 tablet_copy_service.cc:140] P 6d4de2ce0683442498244b9529127f91: Received BeginTabletCopySession request for tablet c9831da869404fb79a22d3887701ca69 from peer 7e839e91a1314c2f9a99b25b17c916a6 ({username='slave'} at 127.0.0.1:46836)
I20260709 13:01:44.821436  1601 tablet_copy_service.cc:161] P 6d4de2ce0683442498244b9529127f91: Beginning new tablet copy session on tablet c9831da869404fb79a22d3887701ca69 from peer 7e839e91a1314c2f9a99b25b17c916a6 at {username='slave'} at 127.0.0.1:46836: session id = 7e839e91a1314c2f9a99b25b17c916a6-c9831da869404fb79a22d3887701ca69
I20260709 13:01:44.833820  4803 tablet_copy_client.cc:538] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:44.837841  4765 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:44.848472  4765 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:44.851750  4765 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:44.841488  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:44.852666  1741 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 7.
I20260709 13:01:44.837340  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:44.856140  1583 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 8.
I20260709 13:01:44.868835  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:44.869707  1587 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12.
I20260709 13:01:44.888584  1601 tablet_copy_source_session.cc:215] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:44.919279  1707 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:44.923542  4822 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:44.923990  4822 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:44.924357  4822 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:44.936364  4818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9831da869404fb79a22d3887701ca69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.955480  4788 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.958142  4788 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:44.962993  4788 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:44.992940  4696 consensus_queue.cc:1048] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:45.009325  1633 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:45.011622  4815 raft_consensus.cc:2804] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:45.012341  4815 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.012944  4815 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:45.025563  4808 tablet_copy_client.cc:806] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:45.026367  4808 tablet_copy_client.cc:670] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:45.033403  4822 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:45.057170  4808 tablet_copy_client.cc:538] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:45.065186  4803 tablet_bootstrap.cc:492] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap starting.
I20260709 13:01:45.072575  4683 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:45.073577  4683 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:45.077054  4683 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:45.081393  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:45.095937  4822 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:45.098364  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:45.100697  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:45.101197  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:45.101790  1661 raft_consensus.cc:2393] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 12: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:01:45.104282  4815 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:45.105759  1665 raft_consensus.cc:2368] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 8. Current term is 9.
I20260709 13:01:45.107017  4815 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:45.111135  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:45.114570  4818 tablet_copy_client.cc:806] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:45.115216  4818 tablet_copy_client.cc:670] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:45.118436  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:45.122656  4818 tablet_copy_client.cc:538] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:45.137821  1558 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:45.175772  4762 raft_consensus.cc:2749] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:45.139290  4808 tablet_bootstrap.cc:492] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap starting.
I20260709 13:01:45.151865  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:45.145046  1741 raft_consensus.cc:1275] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:45.168316  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:45.187000  1735 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 12.
I20260709 13:01:45.195482  4818 tablet_bootstrap.cc:492] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap starting.
I20260709 13:01:45.217344  1583 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12.
I20260709 13:01:45.231009  1707 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:45.232081  4765 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:45.232652  4765 raft_consensus.cc:697] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 12 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:45.233011  4815 consensus_queue.cc:1048] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:45.233744  4765 consensus_queue.cc:237] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:45.266932  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:45.267602  1583 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:45.267633  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:45.272019  1741 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:01:45.313688  1583 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 9.
I20260709 13:01:45.333772  1705 leader_election.cc:400] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Vote denied by peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683) with higher term. Message: Invalid argument: T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 8. Current term is 9.
I20260709 13:01:45.334148  1705 leader_election.cc:403] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:01:45.336354  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 69102.1us
W20260709 13:01:45.404412  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 89932.5us
I20260709 13:01:45.415163  1633 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:01:45.416563  4841 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.417867  4819 consensus_queue.cc:1048] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:01:45.425916  4841 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:45.418196  4650 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:45.426903  4650 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.427305  4650 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:45.428121  4841 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:45.423427  4815 raft_consensus.cc:2955] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:45.446612  4837 ts_tablet_manager.cc:933] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6: Initiating tablet copy from peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:45.471488  1633 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:45.465309  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:45.497411  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:45.482856  4788 raft_consensus.cc:2804] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:01:45.543287  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 59781.6us
I20260709 13:01:45.550423  4650 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:45.610895  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 53443.5us
W20260709 13:01:45.613622  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 57435.9us
I20260709 13:01:45.542441  4788 raft_consensus.cc:697] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 9 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:45.617985  4837 tablet_copy_client.cc:323] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:41683
I20260709 13:01:45.658463  4815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:58806 (request call id 4) took 1379 ms. Trace:
I20260709 13:01:45.736886  4650 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:45.762809  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 150296us
W20260709 13:01:45.773986  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 70546.7us
I20260709 13:01:45.778754  4788 consensus_queue.cc:237] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:45.795192  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 318350us
I20260709 13:01:45.804461  1486 catalog_manager.cc:5697] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 11 to 12, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 12 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:45.832264  1741 consensus_meta.cc:287] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.530s	user 0.012s	sys 0.003s
I20260709 13:01:45.682291  4815 rpcz_store.cc:276] 0709 13:01:44.277709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.283121 (+  5412us) service_pool.cc:224] Handling call
0709 13:01:44.420665 (+137544us) log.cc:844] Serialized 506 byte log entry
0709 13:01:44.610046 (+189381us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b180020ffe0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7dea23f3 00007f1b7dea47c1 00007f1b7dea4779 00007f1b7dea4709 00007f1b7dea46d1 00007f1b7dea39cd 000000000038f354 000000000038f199 00007f1b7de8583a
0709 13:01:44.653672 (+ 43626us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b180020ffe0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7dea23f3 00007f1b7dea47c1 00007f1b7dea4779 00007f1b7dea4709 00007f1b7dea46d1 00007f1b7dea39cd 000000000038f354 000000000038f199 00007f1b7de8583a
0709 13:01:45.656956 (+1003284us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":305,"mutex_wait_us":195,"raft.queue_time_us":707,"raft.run_cpu_time_us":2719,"raft.run_wall_time_us":24334,"spinlock_wait_cycles":8755968,"thread_start_us":167846,"threads_started":1,"wal-append.queue_time_us":202029}
I20260709 13:01:45.854034  1741 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 9.
I20260709 13:01:45.859982  4765 raft_consensus.cc:2749] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683) with higher term. Message: Invalid argument: T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 8. Current term is 9.
W20260709 13:01:45.877053  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 98164.5us
I20260709 13:01:45.906309  1707 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:01:45.948122  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 87483.1us
I20260709 13:01:45.950121  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:45.950877  1583 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:45.977283  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 91219us
I20260709 13:01:46.002213  1741 raft_consensus.cc:2955] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:46.005467  1677 tablet_copy_service.cc:140] P 5bb87fe07da2414e84ee578c3b176ede: Received BeginTabletCopySession request for tablet b37805060ac444b6b6e9e7da8164233c from peer 7e839e91a1314c2f9a99b25b17c916a6 ({username='slave'} at 127.0.0.1:58814)
I20260709 13:01:46.006160  1677 tablet_copy_service.cc:161] P 5bb87fe07da2414e84ee578c3b176ede: Beginning new tablet copy session on tablet b37805060ac444b6b6e9e7da8164233c from peer 7e839e91a1314c2f9a99b25b17c916a6 at {username='slave'} at 127.0.0.1:58814: session id = 7e839e91a1314c2f9a99b25b17c916a6-b37805060ac444b6b6e9e7da8164233c
I20260709 13:01:46.018580  1583 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 13.
I20260709 13:01:46.020501  1590 raft_consensus.cc:1240] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:46.056532  4822 consensus_queue.cc:1059] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:01:46.064476  4847 raft_consensus.cc:3055] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:46.064939  4847 raft_consensus.cc:740] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:46.067339  4847 consensus_queue.cc:260] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:46.068830  4847 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:46.088315  4765 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:46.089017  4765 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:46.101328  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:46.102594  1677 tablet_copy_source_session.cc:215] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:46.106849  4803 tablet_bootstrap.cc:492] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=1 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:46.108098  4803 tablet_bootstrap.cc:492] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap complete.
I20260709 13:01:46.111501  4837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b37805060ac444b6b6e9e7da8164233c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:46.108982  4803 ts_tablet_manager.cc:1403] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6: Time spent bootstrapping tablet: real 1.079s	user 0.044s	sys 0.007s
I20260709 13:01:46.185920  4865 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:46.186713  4865 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:46.188023  4765 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:01:46.191259  4740 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:46.192029  4740 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:46.192806  4808 log.cc:927] Time spent T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:01:46.199579  4808 tablet_bootstrap.cc:492] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:46.200690  4808 tablet_bootstrap.cc:492] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap complete.
I20260709 13:01:46.204345  4866 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:46.204703  4872 raft_consensus.cc:2749] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:46.201581  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:46.205009  4866 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:46.206059  1734 raft_consensus.cc:2410] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:01:46.206270  4865 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:46.207144  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:46.207607  4866 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:46.210500  4740 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:46.210657  4808 ts_tablet_manager.cc:1403] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent bootstrapping tablet: real 1.072s	user 0.045s	sys 0.025s
I20260709 13:01:46.263489  1705 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:46.260227  4803 raft_consensus.cc:359] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:46.259160  1592 raft_consensus.cc:2955] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:01:46.271585  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:46.278666  4848 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:46.283859   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:46.287662  4872 raft_consensus.cc:2749] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:46.293797  4808 raft_consensus.cc:359] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:46.294952  4808 raft_consensus.cc:740] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Initialized, Role: LEARNER
I20260709 13:01:46.267405  4803 raft_consensus.cc:740] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Initialized, Role: LEARNER
I20260709 13:01:46.297814  4803 consensus_queue.cc:260] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:46.300624  4803 ts_tablet_manager.cc:1434] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6: Time spent starting tablet: real 0.178s	user 0.015s	sys 0.008s
I20260709 13:01:46.303889  1490 catalog_manager.cc:5697] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: config changed from index -1 to 4, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New cstate: current_term: 4 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:46.280248  4848 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:46.310210  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:46.319561  1490 catalog_manager.cc:5697] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:46.326200  1633 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:46.327154  4651 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:46.327713  4651 raft_consensus.cc:697] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 13 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:46.328866  4651 consensus_queue.cc:237] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:46.337116  4848 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:46.345306  4818 tablet_bootstrap.cc:492] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:46.347637  4818 tablet_bootstrap.cc:492] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap complete.
I20260709 13:01:46.358776  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:46.359360  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:46.364596  4818 ts_tablet_manager.cc:1403] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent bootstrapping tablet: real 1.169s	user 0.052s	sys 0.022s
I20260709 13:01:46.372689  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:46.375108  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:46.375550  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:46.296578  4808 consensus_queue.cc:260] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:46.390933  1667 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:40572
I20260709 13:01:46.392139  1667 raft_consensus.cc:606] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:46.406386  1751 tablet_copy_service.cc:342] P 5ced62816f8545cd9b63a27e9055e42d: Request end of tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-2782217725024e159b9536d03808a3ea received from {username='slave'} at 127.0.0.1:35672
I20260709 13:01:46.406986  1751 tablet_copy_service.cc:434] P 5ced62816f8545cd9b63a27e9055e42d: ending tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-2782217725024e159b9536d03808a3ea on tablet 2782217725024e159b9536d03808a3ea with peer 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:46.410408  4808 ts_tablet_manager.cc:1434] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent starting tablet: real 0.188s	user 0.007s	sys 0.004s
I20260709 13:01:46.415695  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:46.436348  1601 tablet_copy_service.cc:342] P 6d4de2ce0683442498244b9529127f91: Request end of tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-ae1310c9ee464797a39b786c1d932941 received from {username='slave'} at 127.0.0.1:46836
I20260709 13:01:46.444291  1586 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:46.444635  1601 tablet_copy_service.cc:434] P 6d4de2ce0683442498244b9529127f91: ending tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-ae1310c9ee464797a39b786c1d932941 on tablet ae1310c9ee464797a39b786c1d932941 with peer 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:46.445068  1586 raft_consensus.cc:606] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:46.486080  1667 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:40572
I20260709 13:01:46.486733  1667 raft_consensus.cc:606] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 4 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:46.484777  4837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:49218 (request call id 128) took 1238 ms. Trace:
I20260709 13:01:46.517409  4837 rpcz_store.cc:276] 0709 13:01:45.246038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.246182 (+   144us) service_pool.cc:224] Handling call
0709 13:01:45.447070 (+200888us) ts_tablet_manager.cc:934] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6: Initiating tablet copy from peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
0709 13:01:46.110079 (+663009us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:01:46.291942 (+181863us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:46.292201 (+   259us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:01:46.483964 (+191763us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:01:46.484263 (+   299us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:46.484618 (+   355us) ts_tablet_manager.cc:989] Replica registered.
0709 13:01:46.484683 (+    65us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":103020,"tablet-copy.queue_time_us":90102,"thread_start_us":119841,"threads_started":2}
I20260709 13:01:46.519384  4837 tablet_copy_client.cc:806] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:46.520119  4837 tablet_copy_client.cc:670] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:46.538959  1586 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:46.540393  1586 raft_consensus.cc:606] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
W20260709 13:01:46.548933  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 160229us
I20260709 13:01:46.554530  1558 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:46.563588  1558 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:46.570794  1558 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:46.581590  4839 raft_consensus.cc:2749] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:46.569761  4762 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:46.583623  4866 raft_consensus.cc:2749] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:46.586874  1558 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:46.590159  1663 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:40572
I20260709 13:01:46.595839  4837 tablet_copy_client.cc:538] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:46.592706  1663 raft_consensus.cc:606] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:46.589237  4683 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:46.591490  4818 raft_consensus.cc:359] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:46.633313   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:46.635437   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:46.624321  4818 raft_consensus.cc:740] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Initialized, Role: LEARNER
I20260709 13:01:46.650023  2554 raft_consensus.cc:1217] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 13:01:46.650701  4884 raft_consensus.cc:993] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:46.651310  4869 raft_consensus.cc:1081] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:46.653468  4818 consensus_queue.cc:260] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:46.656549  4818 ts_tablet_manager.cc:1434] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent starting tablet: real 0.291s	user 0.008s	sys 0.000s
I20260709 13:01:46.660997  1734 raft_consensus.cc:1275] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:46.662756  1587 raft_consensus.cc:1275] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:46.663689  1601 tablet_copy_service.cc:342] P 6d4de2ce0683442498244b9529127f91: Request end of tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-c9831da869404fb79a22d3887701ca69 received from {username='slave'} at 127.0.0.1:46836
I20260709 13:01:46.664142  1601 tablet_copy_service.cc:434] P 6d4de2ce0683442498244b9529127f91: ending tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-c9831da869404fb79a22d3887701ca69 on tablet c9831da869404fb79a22d3887701ca69 with peer 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:46.666514  1665 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39146
I20260709 13:01:46.667074  1665 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:46.667419  1665 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:46.667328  4856 consensus_queue.cc:1048] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:46.675746  4513 consensus_queue.cc:1048] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:46.681305  1665 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:46.698554  4837 tablet_bootstrap.cc:492] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap starting.
I20260709 13:01:46.703305  1665 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:46.705690  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:46.718586  1732 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:46.720765  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:46.721844  1587 raft_consensus.cc:3055] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:46.722307  1587 raft_consensus.cc:740] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:46.723248  1587 consensus_queue.cc:260] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:46.709678  4865 raft_consensus.cc:993] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:46.724849  1587 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:46.725637  4866 raft_consensus.cc:1081] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:46.731979  1667 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39146
I20260709 13:01:46.732800  1667 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:46.733394  1667 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:46.735212  1486 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55154 (request call id 298) took 1251 ms. Trace:
I20260709 13:01:46.735906  1486 rpcz_store.cc:276] 0709 13:01:45.484168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.490576 (+  6408us) service_pool.cc:224] Handling call
0709 13:01:46.735111 (+1244535us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:46.045423 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:46.046252 (+   829us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:46.046286 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:01:46.046324 (+    38us) tablet.cc:662] Decoding operations
0709 13:01:46.053821 (+  7497us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:46.056826 (+  3005us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:46.061620 (+  4794us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:01:46.068673 (+  7053us) tablet.cc:701] Row locks acquired
0709 13:01:46.068694 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:01:46.068847 (+   153us) write_op.cc:270] Start()
0709 13:01:46.068974 (+   127us) write_op.cc:276] Timestamp: P: 1783602106068792 usec, L: 0
0709 13:01:46.068998 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:01:46.070240 (+  1242us) log.cc:844] Serialized 541 byte log entry
0709 13:01:46.644885 (+574645us) spinlock_profiling.cc:243] Waited 4.4 ms on lock 0x7b54001197a0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f0d343 00007f1b80f10d75 00007f1b80f10d09 00007f1b80f10c99 00007f1b80f10c61 00007f1b80f0ff5d 000000000038f354 000000000038f199 00007f1b7dea2475 00007f1b7dea47c1
0709 13:01:46.645287 (+   402us) op_driver.cc:464] REPLICATION: finished
0709 13:01:46.715477 (+ 70190us) write_op.cc:301] APPLY: starting
0709 13:01:46.715573 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:46.715685 (+   112us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:46.715708 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:46.716002 (+   294us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:46.716176 (+   174us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:01:46.716225 (+    49us) write_op.cc:312] APPLY: finished
0709 13:01:46.716431 (+   206us) log.cc:844] Serialized 23 byte log entry
0709 13:01:46.726239 (+  9808us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:46.726319 (+    80us) write_op.cc:454] Released schema lock
0709 13:01:46.726364 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:46.727337 (+   973us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:46.727370 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":69925,"apply.run_cpu_time_us":1729,"apply.run_wall_time_us":11812,"num_ops":1,"prepare.queue_time_us":199090,"prepare.run_cpu_time_us":7127,"prepare.run_wall_time_us":113015,"raft.queue_time_us":292851,"raft.run_cpu_time_us":8260,"raft.run_wall_time_us":80653,"replication_time_us":576127,"spinlock_wait_cycles":10229120,"thread_start_us":471084,"threads_started":4,"wal-append.queue_time_us":336069}]]}
I20260709 13:01:46.745282  1732 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 9.
I20260709 13:01:46.775156  1633 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:46.776190  4856 raft_consensus.cc:2804] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:46.776691  4856 raft_consensus.cc:697] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 9 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:46.777611  4856 consensus_queue.cc:237] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:46.814316  1587 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 9.
I20260709 13:01:46.817849  1667 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:46.830106  2554 raft_consensus.cc:1217] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 LEARNER]: Deduplicated request from leader. Original: 7.5->[7.6-7.6]   Dedup: 7.6->[]
I20260709 13:01:46.848474  1490 catalog_manager.cc:5697] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 12 to 13, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 13 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:46.852420  1490 catalog_manager.cc:5697] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 8 to 9, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 9 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:46.858745  2554 raft_consensus.cc:1217] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 LEARNER]: Deduplicated request from leader. Original: 6.3->[6.4-6.4]   Dedup: 6.4->[]
I20260709 13:01:46.869604  1667 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:46.895431  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:46.898020  1587 raft_consensus.cc:3055] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:46.898391  1587 raft_consensus.cc:740] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:46.903677  1590 raft_consensus.cc:1275] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:46.924294  1587 consensus_queue.cc:260] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:46.927189  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:46.927883  1734 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:46.961997  1587 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:46.987568  4854 raft_consensus.cc:993] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede: : Instructing follower 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:46.988139  4854 raft_consensus.cc:1081] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 LEADER]: Signalling peer 5ced62816f8545cd9b63a27e9055e42d to start an election
W20260709 13:01:47.005568  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 76891.3us
I20260709 13:01:47.031931  1587 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 8.
W20260709 13:01:47.070114  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 61766.9us
I20260709 13:01:47.071614  4895 consensus_queue.cc:1048] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:47.075506  1633 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:47.118669  1733 raft_consensus.cc:1275] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:01:47.119120  1733 pending_rounds.cc:85] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 7
I20260709 13:01:47.119421  1733 pending_rounds.cc:107] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:01:47.119774  1733 raft_consensus.cc:2889] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:47.124459  4856 raft_consensus.cc:993] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede: : Instructing follower 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:47.125607  1732 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:43686
I20260709 13:01:47.126461  1732 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:47.126968  1732 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:47.125015  4856 raft_consensus.cc:1081] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Signalling peer 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:47.134256  4788 raft_consensus.cc:2804] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:47.135295  4788 raft_consensus.cc:697] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 8 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:47.185154  4788 consensus_queue.cc:237] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:47.191324  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 95358.9us
I20260709 13:01:47.194203  1734 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 8.
I20260709 13:01:47.184188  1732 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:47.233223  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 110726us
I20260709 13:01:47.233765  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:47.234527  1587 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:47.241856  1732 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:47.248750  1734 raft_consensus.cc:1275] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:47.271551  1587 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
I20260709 13:01:47.274972  1707 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:47.279428  1736 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:43686
I20260709 13:01:47.279978  1736 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:47.280369  1736 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:47.286199  4872 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:47.296548  4872 raft_consensus.cc:697] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 10 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:47.296933  4864 raft_consensus.cc:1064] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d: attempting to promote NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 to VOTER
I20260709 13:01:47.297748  4872 consensus_queue.cc:237] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:47.309662  4865 raft_consensus.cc:1064] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91: attempting to promote NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 to VOTER
I20260709 13:01:47.313294  4864 consensus_queue.cc:237] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:47.315297  4865 consensus_queue.cc:237] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:47.322300  1486 catalog_manager.cc:5697] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 7 to 8, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 8 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:47.333447  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:47.334086  1663 raft_consensus.cc:3055] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:47.334385  1663 raft_consensus.cc:740] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:47.335150  1663 consensus_queue.cc:260] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:47.336194  1663 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:47.362708  4901 raft_consensus.cc:993] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede: : Instructing follower 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:47.366441  4856 raft_consensus.cc:1081] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 4 LEADER]: Signalling peer 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:47.369990  1663 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
W20260709 13:01:47.479810  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 110738us
I20260709 13:01:47.503364  1736 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:47.439401  4901 consensus_queue.cc:1048] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:01:47.513381  4788 consensus_queue.cc:1048] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:47.549373  1736 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:01:47.565936  4904 log.cc:927] Time spent T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.084s	user 0.000s	sys 0.002s
I20260709 13:01:47.573293  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:47.574304  1592 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:47.645756  1587 raft_consensus.cc:1275] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:47.654497  1734 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:43686
I20260709 13:01:47.655505  1734 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:47.656080  1734 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:47.658145   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:47.692934  1733 raft_consensus.cc:1240] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:47.722848  1592 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
W20260709 13:01:47.736979  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 182579us
I20260709 13:01:47.751004  1734 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:47.762899  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 117191us
I20260709 13:01:47.771838  4513 consensus_queue.cc:1048] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:47.772946  1734 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:47.791543  2552 raft_consensus.cc:1275] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 LEARNER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:47.805331  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:47.805966  1665 raft_consensus.cc:3055] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:47.806253  1665 raft_consensus.cc:740] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
W20260709 13:01:47.814770  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 93116.1us
I20260709 13:01:47.806901  1665 consensus_queue.cc:260] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:47.817512  1665 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:47.826700  1586 raft_consensus.cc:1240] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 6. Current term is 7. Ops: []
W20260709 13:01:47.849170  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.864765  1734 raft_consensus.cc:1240] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:47.873993  4859 raft_consensus.cc:1064] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91: attempting to promote NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 to VOTER
I20260709 13:01:47.878511  1488 catalog_manager.cc:5697] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 9 to 10, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 10 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:47.880753  2554 raft_consensus.cc:1275] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 LEARNER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:01:47.905017  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.897758  1586 raft_consensus.cc:1275] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:47.911710  1665 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
W20260709 13:01:47.914425  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 76262.5us
I20260709 13:01:47.927974  4837 tablet_bootstrap.cc:492] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:01:47.934533  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 226938us
I20260709 13:01:47.954883  1707 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:47.955909  4925 raft_consensus.cc:2804] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:47.957460  1662 raft_consensus.cc:1275] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:01:47.959326  1736 raft_consensus.cc:1275] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:01:47.969040  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 189485us
I20260709 13:01:47.970255  4865 consensus_queue.cc:1048] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:47.941648  4837 tablet_bootstrap.cc:492] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap complete.
I20260709 13:01:47.880825  4859 consensus_queue.cc:237] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 2, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:47.974148  4837 ts_tablet_manager.cc:1403] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6: Time spent bootstrapping tablet: real 1.276s	user 0.037s	sys 0.056s
I20260709 13:01:47.978094  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:47.978823  1587 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:47.997300  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.003383  1591 raft_consensus.cc:1275] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:48.003963  1584 raft_consensus.cc:1275] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:01:48.024572  1587 raft_consensus.cc:2468] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5.
I20260709 13:01:48.041744  1741 raft_consensus.cc:1275] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:47.974862  4925 raft_consensus.cc:697] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:48.060421  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:01:48.061820  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 261303us
I20260709 13:01:48.062163  1665 raft_consensus.cc:1275] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:48.065280  1665 raft_consensus.cc:1275] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:01:48.100641  4847 consensus_queue.cc:1048] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:01:48.080173  4904 log.cc:927] Time spent T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:01:48.109103  4513 consensus_queue.cc:1048] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:48.046388  4907 consensus_queue.cc:1048] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 13:01:48.032806  4837 raft_consensus.cc:359] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:48.055572  4765 consensus_queue.cc:1048] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:01:48.058643  4651 consensus_queue.cc:1059] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:01:48.138572  4911 consensus_queue.cc:1048] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:48.127012  4837 raft_consensus.cc:740] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Initialized, Role: LEARNER
I20260709 13:01:48.165745  4837 consensus_queue.cc:260] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:48.184703  4837 ts_tablet_manager.cc:1434] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6: Time spent starting tablet: real 0.210s	user 0.002s	sys 0.006s
I20260709 13:01:48.188239  1666 raft_consensus.cc:3055] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:48.189021  1666 raft_consensus.cc:740] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:48.211637  1666 consensus_queue.cc:260] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:48.213656  1666 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:48.265928  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 162375us
I20260709 13:01:48.320261  1707 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:48.333729  2552 raft_consensus.cc:1275] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 LEARNER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:01:48.336853  1666 raft_consensus.cc:2468] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5.
I20260709 13:01:48.238857  4925 consensus_queue.cc:237] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:48.344157  4651 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:01:48.322503  4847 consensus_queue.cc:1048] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 13:01:48.378353  4765 raft_consensus.cc:2804] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:48.422730  1677 tablet_copy_service.cc:342] P 5bb87fe07da2414e84ee578c3b176ede: Request end of tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-b37805060ac444b6b6e9e7da8164233c received from {username='slave'} at 127.0.0.1:58814
I20260709 13:01:48.423337  1677 tablet_copy_service.cc:434] P 5bb87fe07da2414e84ee578c3b176ede: ending tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-b37805060ac444b6b6e9e7da8164233c on tablet b37805060ac444b6b6e9e7da8164233c with peer 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:48.428906  4765 raft_consensus.cc:697] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 5 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:48.430194  4765 consensus_queue.cc:237] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:48.428828  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 93392us
W20260709 13:01:48.432111  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 93934.9us
I20260709 13:01:48.432245  4740 consensus_queue.cc:1048] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:01:48.443162  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 333621us
I20260709 13:01:48.446460  1663 raft_consensus.cc:1275] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:01:48.475065  4942 log.cc:927] Time spent T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
W20260709 13:01:48.495267  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 440506us
I20260709 13:01:48.467514  4907 consensus_queue.cc:1048] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:01:48.525952  1736 raft_consensus.cc:1275] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:01:48.562651  1733 raft_consensus.cc:2955] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
W20260709 13:01:48.610697  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 138145us
I20260709 13:01:48.641498  4936 consensus_queue.cc:1048] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:01:48.624399  1662 raft_consensus.cc:2955] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:48.654572  4867 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:48.655442  4867 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:48.633908  4921 consensus_queue.cc:1048] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:01:48.657807  4914 consensus_queue.cc:1048] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:01:48.670310  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 84707.9us
I20260709 13:01:48.688135  2553 raft_consensus.cc:2955] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:48.690049  2550 raft_consensus.cc:1217] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 13:01:48.709429  4867 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:48.701455  4859 raft_consensus.cc:2955] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:48.739015  1488 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55154 (request call id 302) took 1017 ms. Trace:
I20260709 13:01:48.739619  1488 rpcz_store.cc:276] 0709 13:01:47.721791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.722111 (+   320us) service_pool.cc:224] Handling call
0709 13:01:48.738921 (+1016810us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:48.106815 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:48.142353 (+ 35538us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:48.142405 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:01:48.142466 (+    61us) tablet.cc:662] Decoding operations
0709 13:01:48.142834 (+   368us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:48.142916 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:48.142950 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:01:48.143174 (+   224us) tablet.cc:701] Row locks acquired
0709 13:01:48.143196 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:01:48.143367 (+   171us) write_op.cc:270] Start()
0709 13:01:48.143496 (+   129us) write_op.cc:276] Timestamp: P: 1783602108143303 usec, L: 0
0709 13:01:48.143522 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:01:48.144296 (+   774us) log.cc:844] Serialized 541 byte log entry
0709 13:01:48.476160 (+331864us) op_driver.cc:464] REPLICATION: finished
0709 13:01:48.625546 (+149386us) write_op.cc:301] APPLY: starting
0709 13:01:48.635273 (+  9727us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:48.666733 (+ 31460us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:48.710893 (+ 44160us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:48.711340 (+   447us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:48.711658 (+   318us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:01:48.711749 (+    91us) write_op.cc:312] APPLY: finished
0709 13:01:48.712065 (+   316us) log.cc:844] Serialized 23 byte log entry
0709 13:01:48.714556 (+  2491us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:48.714682 (+   126us) write_op.cc:454] Released schema lock
0709 13:01:48.714735 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:48.715493 (+   758us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:48.716389 (+   896us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":26816,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":131176,"apply.run_cpu_time_us":3327,"apply.run_wall_time_us":99838,"num_ops":1,"prepare.queue_time_us":177360,"prepare.run_cpu_time_us":4038,"prepare.run_wall_time_us":142164,"replication_time_us":324749,"thread_start_us":155076,"threads_started":2}]]}
I20260709 13:01:48.745271  1585 raft_consensus.cc:1275] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:01:48.760679  4961 log.cc:927] Time spent T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:01:48.787360  4650 consensus_queue.cc:1048] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:01:48.814406  4846 consensus_queue.cc:1048] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:01:48.825349  4937 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:48.826177  4937 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:48.840587  4895 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:48.841501  4895 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:48.844996  4895 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:48.889665  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 49634.6us
I20260709 13:01:48.892683  4901 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:48.893971  4947 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:48.893568  4901 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:48.894708  4947 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:48.901072  4947 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:48.919148  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 73120.6us
I20260709 13:01:48.939671  4901 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:49.109366  4939 raft_consensus.cc:2955] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:49.215246  4765 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:49.243952  4765 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:49.252012  4765 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:49.380086  4937 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:49.388020  4895 raft_consensus.cc:1064] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede: attempting to promote NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 to VOTER
I20260709 13:01:49.393644  4863 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.394268  4863 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:49.396739  4863 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:49.422235  4895 consensus_queue.cc:237] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:49.733989  4934 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:49.734839  4934 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:49.789052  4934 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:49.790220  4765 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:49.790802  4765 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:49.791930  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:49.792896  4765 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:49.790256  4934 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:49.794135  4934 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:49.796283  4934 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:49.808440  4918 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:49.808725  4859 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:49.809278  4859 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:49.811390  4859 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:49.812191  4918 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:49.823494  4918 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:49.841012  4859 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:49.841678  4859 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:49.845340  4937 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:49.845466  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:49.845988  4937 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:49.846855  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:49.847012  4918 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.848062  4937 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:49.847754  4918 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:49.850917  4918 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:49.851405  4918 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:49.854751  4918 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:49.857350  4918 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:49.859227  4918 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:49.861385  4976 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:49.860802  4918 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:49.869467  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:49.869201  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:49.872570  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:49.881668  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:49.882620  1739 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:01:49.866178  4859 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:49.862303  4976 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:49.898046  4918 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:49.899224  4976 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:01:49.911317  1667 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.927s	user 0.001s	sys 0.018s
W20260709 13:01:49.911746  1667 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.001s	sys 0.018s
I20260709 13:01:49.912609  4977 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:49.913242  4977 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:49.917625  4963 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:49.918223  4963 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:49.921043  4963 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:49.918244  4859 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:49.922670  4859 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:49.923110  4918 raft_consensus.cc:2955] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Committing config change with OpId 6.5: config changed from index 4 to 5, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:49.924921  4859 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:49.946957  4895 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:49.947661  4895 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:49.949460  4977 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:49.950186  4895 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:49.951414  4976 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:49.952036  4976 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:49.954725  4976 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:49.957877  1558 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:49.958899  4869 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:49.959985  4869 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:49.960673  4869 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:49.964293  1663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58814 (request call id 342) took 1072 ms. Trace:
I20260709 13:01:49.964776  1663 rpcz_store.cc:276] 0709 13:01:48.891722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.963145 (+1071423us) service_pool.cc:224] Handling call
0709 13:01:49.963539 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:49.963731 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:49.963937 (+   206us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:49.964002 (+    65us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:49.964045 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.964118 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.964234 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:49.971029  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:49.974650  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:49.975178  4895 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:49.975808  4895 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:49.977946  4895 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:49.977677  4869 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:49.978574  4895 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:49.979069  4895 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:49.981737  4895 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:49.983158  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:50.004365  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:50.004601  4729 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:50.005298  4729 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:50.009249  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:50.009578  4729 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:50.013727  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:50.014633  1587 raft_consensus.cc:2410] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:01:50.015858  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:50.016739  1589 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 4.
I20260709 13:01:50.017146  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:50.017426  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:50.020462  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:50.021899  4907 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:50.022666  4907 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:50.031670  4907 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:50.028964  1587 raft_consensus.cc:1240] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:50.032015  1666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 2273) took 1101 ms. Trace:
I20260709 13:01:50.027460  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:50.032967  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:50.034461  1586 raft_consensus.cc:1275] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:50.036013  1666 rpcz_store.cc:276] 0709 13:01:48.930260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.031203 (+1100943us) service_pool.cc:224] Handling call
0709 13:01:50.031493 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:50.031669 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:50.031698 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:50.031744 (+    46us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:50.031778 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.031837 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.031951 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:50.041350  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 44558.2us
I20260709 13:01:50.041985  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:50.043732  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:50.045776  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:50.046355  1663 raft_consensus.cc:2468] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:01:50.046986  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:50.048233  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:50.048583  4956 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:50.049384  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:50.049232  4956 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:50.050328  1586 raft_consensus.cc:2955] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:50.051646  4956 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:50.056058  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:50.058285  1489 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55138 (request call id 312) took 1633 ms. Trace:
I20260709 13:01:50.059029  1489 rpcz_store.cc:276] 0709 13:01:48.424980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.426087 (+  1107us) service_pool.cc:224] Handling call
0709 13:01:50.058098 (+1632011us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":172013,"reported_tablets":3}
I20260709 13:01:50.061147  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:50.062255  4729 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:50.062908  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:50.063891  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:50.064618  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:50.070230  4729 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:50.066027  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:50.071552  1665 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:01:50.066067  1662 raft_consensus.cc:2955] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index 4 to 5, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:50.072736  4729 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:50.073443  4895 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:50.087196  4895 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:50.089799  4895 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:49.512457   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:50.074220  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:50.074877  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:50.082737  1556 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:50.094507  4966 raft_consensus.cc:2749] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:50.096428  2550 raft_consensus.cc:1275] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 LEARNER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:50.104377  2548 raft_consensus.cc:2955] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:50.110210  1556 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:50.111194  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:50.112665  4966 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:50.114673  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:50.100715  1488 catalog_manager.cc:5697] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 6 to 7, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 7 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:50.118101  1556 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:50.117185  2550 raft_consensus.cc:2955] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index 4 to 5, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:50.117681  1488 catalog_manager.cc:5697] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 4 to 5, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 5 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:50.125375  4937 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:50.125926  4937 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:50.126817  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:50.127962  4937 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:50.124806  4966 raft_consensus.cc:2749] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:50.131657  4947 consensus_queue.cc:1048] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:50.132962  4966 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:50.116294  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:50.141908  1556 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:50.151964  1556 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:50.153460  1556 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:50.155515  1556 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:50.157872  4976 raft_consensus.cc:2749] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:50.159018  4936 raft_consensus.cc:2804] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:50.159490  4936 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.159869  4936 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:50.154057  4937 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:50.165501  4965 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:50.166528  4965 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:50.141018  1488 catalog_manager.cc:5697] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: config changed from index 6 to 7, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:50.176613  4980 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:50.177388  4980 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:50.181535  4980 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:50.183902  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:50.184531  1556 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:50.184944  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:50.186180  1556 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:50.139169  4966 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:50.218420  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 114601us
I20260709 13:01:50.284621  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:01:50.239727  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 53605.9us
I20260709 13:01:50.285454  1590 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 13.
I20260709 13:01:50.187253  4937 raft_consensus.cc:2749] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:50.195303  1584 raft_consensus.cc:2410] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:01:50.293582  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:50.303922  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:50.305529  1584 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:01:50.307613  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:50.271867  4765 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:50.311892  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:50.314322  1734 raft_consensus.cc:1275] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:50.314818  1591 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
W20260709 13:01:50.317282  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.313462  4925 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:50.317860  4925 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:50.291383  4907 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:50.319866  4907 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:50.320317  4907 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:50.297365  4866 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:50.322283  4866 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:50.315656  4934 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:50.325341  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:50.327962  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:50.327380  1733 raft_consensus.cc:2955] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index 4 to 5, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:50.330397  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:50.331238  2554 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
W20260709 13:01:50.332993  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 320397us
I20260709 13:01:50.342785  1704 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:01:50.348755  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 63645us
I20260709 13:01:50.311394  4921 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:50.369243  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:50.369974  1592 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:01:50.330265  4925 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:50.343364  4986 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:50.352294  4872 raft_consensus.cc:2804] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:50.351500  4859 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:50.354357  4981 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:50.336665  4765 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:50.343058  4934 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:50.441294  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 88021.7us
I20260709 13:01:50.414892  4872 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:50.418264  4976 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
W20260709 13:01:50.430455  1762 debug-util.cc:398] Leaking SignalData structure 0x7b08001dd8c0 after lost signal to thread 434
W20260709 13:01:50.449098  1762 debug-util.cc:398] Leaking SignalData structure 0x7b0800378b80 after lost signal to thread 1524
W20260709 13:01:50.450724  1762 debug-util.cc:398] Leaking SignalData structure 0x7b08002a1b20 after lost signal to thread 1616
W20260709 13:01:50.452322  1762 debug-util.cc:398] Leaking SignalData structure 0x7b0800318bc0 after lost signal to thread 1691
I20260709 13:01:50.429268  4884 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:50.395740  4921 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:50.458197  1762 debug-util.cc:398] Leaking SignalData structure 0x7b080039bba0 after lost signal to thread 1765
W20260709 13:01:50.474597  1762 debug-util.cc:398] Leaking SignalData structure 0x7b08000b7a20 after lost signal to thread 1766
W20260709 13:01:50.476274  1762 debug-util.cc:398] Leaking SignalData structure 0x7b08002cd240 after lost signal to thread 2594
I20260709 13:01:50.477726  2426 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:50.482159  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:01:50.482416  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 128448us
I20260709 13:01:50.448849  4872 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:50.438025  4914 consensus_queue.cc:1048] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:01:50.500195  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:50.461304  4869 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:50.523413  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:50.524257  4994 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:50.525276  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:50.460209  4895 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:50.526607  4895 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:50.461484  4976 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:50.434935  4981 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:50.419600  4986 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:50.525030  4994 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:50.469353  4991 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:50.441342  4859 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:50.526067  1738 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:01:50.530853  4976 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:50.536262  4981 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:50.529043  4895 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:50.589228  4965 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:50.589928  5003 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:50.590462  4994 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:50.591460  4990 log.cc:927] Time spent T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:01:50.553597  4866 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:50.594223  4907 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:50.599743  4993 log.cc:927] Time spent T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:01:50.601275  4934 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:50.603345  4859 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:50.605533  1584 raft_consensus.cc:1240] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:50.544991  4966 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:50.551357  4991 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:50.603377  4907 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:50.604562  4936 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:50.610183  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 206266us
I20260709 13:01:50.611980  1707 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:50.588732  4921 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:50.472512  4884 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:50.625927  5003 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:50.626739  5003 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:50.634981  1558 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:50.633352  1707 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:50.649552  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:50.650780  4884 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:50.663170  1707 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:50.669921  4964 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:50.677601  4995 log.cc:927] Time spent T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:01:50.669333  4914 raft_consensus.cc:2804] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:50.669885  4863 raft_consensus.cc:2804] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:50.619330  4991 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:50.648248  4986 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:50.666250  4963 raft_consensus.cc:2749] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:50.624811  4895 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:50.656196  4934 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:01:50.719525  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 82296.3us
W20260709 13:01:50.710181  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 249433us
I20260709 13:01:50.723994  4991 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:50.716504  4863 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:50.726465  4863 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:50.731437  4895 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:50.735482  4895 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:50.724623  4991 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:50.741379  4991 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:01:50.745868  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 262709us
I20260709 13:01:50.686014  4981 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:50.754109  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:50.751317  1558 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:50.759107  1558 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:50.716183  4914 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:50.710625  4765 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:50.865635  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:01:50.886431  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.897708  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:50.805742  4991 consensus_queue.cc:1059] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:50.719444  4934 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:50.902002  5017 raft_consensus.cc:3055] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:50.902081  4934 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:50.902616  5017 raft_consensus.cc:740] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:50.904210  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:50.804875  4914 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:50.806320  4981 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:50.766398  4907 raft_consensus.cc:2749] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:50.861722  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:50.822065  4936 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:50.818789  5003 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:50.828734  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:50.804311  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:50.888821  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:50.886045  2426 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:50.802742  1586 raft_consensus.cc:1275] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:50.809486  4963 raft_consensus.cc:2749] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:50.817997  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:50.920704  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:50.844074  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:50.829425  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:50.890422  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:50.920725  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:50.923710  1664 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
W20260709 13:01:50.750838  4918 consensus_meta.cc:287] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.821s	user 0.014s	sys 0.000s
I20260709 13:01:50.930161  2426 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:50.903867  5017 consensus_queue.cc:260] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:50.909360  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:50.932296  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:50.933797  5017 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:50.934705  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:50.935215  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:50.937748  4984 raft_consensus.cc:2749] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:50.937935  2426 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:50.930207  5003 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:50.916103  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:50.914690  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:01:50.811126  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 49625us
I20260709 13:01:50.917028  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:50.919376  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:50.926573  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:50.927287  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:50.943917  1666 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:01:50.927551  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:50.927819  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:50.940100  4997 raft_consensus.cc:2749] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:50.915428  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:50.945750  1586 raft_consensus.cc:2393] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 8: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:01:50.950133  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:50.950793  1659 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:50.890965  4872 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:50.945470  1661 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:01:50.954622  1558 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:50.955278  4863 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:50.956326  4936 raft_consensus.cc:2749] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:50.957441  1558 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:50.959035  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:50.959638  1661 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:01:50.961673  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:50.962848  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:50.963444  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:50.963469  1707 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:50.968107  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:50.968323  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:50.968899  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:50.970463  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:50.971833  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:50.972398  1663 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:50.973263  1659 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:01:50.973711  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:50.976697  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:50.978477  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:50.955287  4872 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:50.993005  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:50.993937  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:50.995362  1556 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:50.995488  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:01:50.996475  2554 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:50.997287  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:51.003785  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:51.001528  1556 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:51.004267  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:51.003259  4964 raft_consensus.cc:2804] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:50.958951  4981 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:51.008476  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:50.979069  4907 raft_consensus.cc:2804] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:51.010561  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:50.988204  4991 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:51.005765  1556 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:51.024058  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:51.025789  1589 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:51.026621  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:51.006274  4964 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:51.027400  1633 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:51.013055  2424 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:51.058804  1586 raft_consensus.cc:1240] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:01:51.008461  4884 raft_consensus.cc:2804] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:51.060213  5001 raft_consensus.cc:2804] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:51.066493  5012 consensus_queue.cc:1059] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:01:51.067217  4863 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:51.067814  4869 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:51.007346  4947 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:51.014662  4907 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:51.086956  1556 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:51.027447  5018 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:51.069444  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 43819.4us
I20260709 13:01:51.069913  1663 raft_consensus.cc:2468] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
W20260709 13:01:51.096064  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 88022.7us
I20260709 13:01:51.098553  5001 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:51.070132  5008 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:51.100647  1589 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
W20260709 13:01:51.102320  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 75003.7us
W20260709 13:01:51.109746  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.098368  4884 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:51.071170  4964 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:51.100736  4996 raft_consensus.cc:2749] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:01:51.133494  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 93394.8us
I20260709 13:01:51.070286  4991 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:51.163585  4991 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:51.104935  4869 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:51.143402  1558 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:51.155128  1633 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:51.149807  4884 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:51.141481  5018 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:51.130899  4907 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:51.158160  5021 log.cc:927] Time spent T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.098s	user 0.004s	sys 0.000s
I20260709 13:01:51.178682  4977 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:51.141836  5001 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:51.169699  4869 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:51.143772  5005 raft_consensus.cc:2804] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:51.179692  1558 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:51.180440  1556 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:51.182402  1633 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:51.156685  5008 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:51.192263  1663 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:40572
I20260709 13:01:51.192750  1558 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:51.202426  1663 raft_consensus.cc:606] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 7 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:51.191223  5005 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:51.200109  4895 raft_consensus.cc:2749] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:01:51.195852  5022 log.cc:927] Time spent T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.174s	user 0.003s	sys 0.000s
I20260709 13:01:51.174719  4991 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:51.210420  1556 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:51.154224  4914 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:51.213372  1633 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:51.209318  4977 raft_consensus.cc:2749] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:51.223548  4869 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:51.261240  1661 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:40572
I20260709 13:01:51.206216  4939 raft_consensus.cc:3055] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:51.262015  4939 raft_consensus.cc:740] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:51.262099  1661 raft_consensus.cc:606] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 8 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:51.262966  4869 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:51.226677  4914 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:51.263397  5017 raft_consensus.cc:2749] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:51.230985  5008 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:51.231707  5018 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:51.209484  4963 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:51.264587  4963 raft_consensus.cc:697] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:51.266180  4963 consensus_queue.cc:237] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:51.220362  4934 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:51.271272  4934 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:51.204730  5005 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:51.273406  4907 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:51.239053  4966 raft_consensus.cc:2749] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:51.239379  1556 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:51.242192  1558 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:51.207134  4918 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:51.249904  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:51.256058  1667 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:01:51.285926  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:51.257870  4964 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:51.259658  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 46376.8us
I20260709 13:01:51.131630  4947 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:51.296553  4978 raft_consensus.cc:2749] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:51.298100  4947 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:51.298671  1707 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:51.288206  1587 raft_consensus.cc:1240] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:51.289124  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:51.300284  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:51.300613  4765 consensus_queue.cc:1059] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:51.301590  4872 raft_consensus.cc:2804] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:51.302109  4872 raft_consensus.cc:697] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 10 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:51.302577  4914 raft_consensus.cc:3055] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:51.302966  4914 raft_consensus.cc:740] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:51.304008  1667 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
mode: GRACEFUL
new_leader_uuid: "6d4de2ce0683442498244b9529127f91"
 from {username='slave'} at 127.0.0.1:40572
I20260709 13:01:51.303787  4914 consensus_queue.cc:260] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:51.304560  1667 raft_consensus.cc:606] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Received request to transfer leadership to TS 6d4de2ce0683442498244b9529127f91
I20260709 13:01:51.306344  1585 raft_consensus.cc:1240] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:51.302979  4872 consensus_queue.cc:237] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:51.291023  4981 raft_consensus.cc:2804] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:51.275667  5001 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:51.312269  5001 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:51.291304  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:51.313647  1661 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:51.313498  4988 consensus_queue.cc:1048] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:51.295993  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:51.290441  2554 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:01:51.315941  1591 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:51.316339  4986 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:51.318018  4989 raft_consensus.cc:993] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede: : Instructing follower 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:51.321553  2540 raft_consensus.cc:1240] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:51.321733  4907 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:51.323309  1704 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:01:51.323782  4964 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:51.325984  1556 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:51.328529  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:51.353377  1661 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:01:51.330164  4981 raft_consensus.cc:697] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:51.330255  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:51.356393  1665 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:51.356952  4981 consensus_queue.cc:237] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:51.363837  1488 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55154 (request call id 303) took 2575 ms. Trace:
I20260709 13:01:51.317917  1738 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:55694
I20260709 13:01:51.364889  1738 raft_consensus.cc:606] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 10 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:51.367350  4859 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:51.367928  4859 raft_consensus.cc:697] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:01:51.336118  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 46000.4us
I20260709 13:01:51.304965  4914 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:51.341179  4989 raft_consensus.cc:1081] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 7 LEADER]: Signalling peer 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:51.344345  4991 consensus_queue.cc:1059] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:51.263441  4939 consensus_queue.cc:260] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:51.364305  5001 raft_consensus.cc:2804] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:51.367093  4884 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:51.339296  1591 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 14.
I20260709 13:01:51.371364  1665 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:01:51.334187  1633 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:51.378863  1556 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:51.378180  1490 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51168 (request call id 129) took 1580 ms. Trace:
I20260709 13:01:51.385978  1489 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55138 (request call id 313) took 1086 ms. Trace:
I20260709 13:01:51.378795  1488 rpcz_store.cc:276] 0709 13:01:48.788586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.789187 (+   601us) service_pool.cc:224] Handling call
0709 13:01:51.363740 (+2574553us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:50.460072 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:50.606962 (+146890us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:50.606995 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:01:50.607011 (+    16us) tablet.cc:662] Decoding operations
0709 13:01:50.607614 (+   603us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:50.607677 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:50.607705 (+    28us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:01:50.608016 (+   311us) tablet.cc:701] Row locks acquired
0709 13:01:50.608038 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:01:50.608182 (+   144us) write_op.cc:270] Start()
0709 13:01:50.608300 (+   118us) write_op.cc:276] Timestamp: P: 1783602110608131 usec, L: 0
0709 13:01:50.608325 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:01:50.652443 (+ 44118us) log.cc:844] Serialized 1375 byte log entry
0709 13:01:51.229379 (+576936us) op_driver.cc:464] REPLICATION: finished
0709 13:01:51.341528 (+112149us) write_op.cc:301] APPLY: starting
0709 13:01:51.341616 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:51.341757 (+   141us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:51.341881 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:51.342676 (+   795us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:51.342857 (+   181us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:01:51.342898 (+    41us) write_op.cc:312] APPLY: finished
0709 13:01:51.343121 (+   223us) log.cc:844] Serialized 35 byte log entry
0709 13:01:51.353265 (+ 10144us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:51.353359 (+    94us) write_op.cc:454] Released schema lock
0709 13:01:51.353399 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:51.353787 (+   388us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:51.377413 (+ 23626us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1175400,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":111896,"apply.run_cpu_time_us":2336,"apply.run_wall_time_us":12263,"num_ops":3,"prepare.queue_time_us":144543,"prepare.run_cpu_time_us":17147,"prepare.run_wall_time_us":485329,"raft.queue_time_us":135925,"replication_time_us":620898,"spinlock_wait_cycles":4459904,"thread_start_us":468732,"threads_started":4,"wal-append.queue_time_us":340328}]]}
I20260709 13:01:51.401433  4895 raft_consensus.cc:3055] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:51.405995  1490 rpcz_store.cc:276] 0709 13:01:49.797661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.008196 (+210535us) service_pool.cc:224] Handling call
0709 13:01:51.378092 (+1369896us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93806,"reported_tablets":3}
I20260709 13:01:51.407012  4895 raft_consensus.cc:740] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:51.407328  4939 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:51.408008  4963 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:51.407928  4895 consensus_queue.cc:260] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:51.408586  4963 raft_consensus.cc:697] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:51.409636  4895 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:51.409571  4963 consensus_queue.cc:237] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:51.410631  4991 raft_consensus.cc:2749] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:51.368851  4859 consensus_queue.cc:237] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:51.406266  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 72151.7us
I20260709 13:01:51.418651  1633 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:51.422407  1556 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:51.423405  1665 raft_consensus.cc:1275] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:51.406723  1489 rpcz_store.cc:276] 0709 13:01:50.299356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.299561 (+   205us) service_pool.cc:224] Handling call
0709 13:01:50.378568 (+ 79007us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b540020fe90. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7de6ab71 00007f1b7de6b0b2 00007f1b86de4a89 00007f1b86d7cda6 00007f1b86d4e088 00007f1b86e4c37e 00007f1b8530d2a4 00007f1b8530d232 00007f1b8530d161 00007f1b8530d0dc
0709 13:01:51.385886 (+1007318us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":4,"spinlock_wait_cycles":48820736}
I20260709 13:01:51.426584  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:51.427127  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:51.427768  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:51.429507  1665 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
mode: GRACEFUL
new_leader_uuid: "6d4de2ce0683442498244b9529127f91"
 from {username='slave'} at 127.0.0.1:40572
I20260709 13:01:51.430105  1665 raft_consensus.cc:606] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 7 LEADER]: Received request to transfer leadership to TS 6d4de2ce0683442498244b9529127f91
I20260709 13:01:51.432199  4884 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:51.432855  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 53545.7us
I20260709 13:01:51.428126  4869 raft_consensus.cc:2804] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:51.433840  4869 raft_consensus.cc:697] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:51.420595  4991 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:51.442200  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:51.435300  4869 consensus_queue.cc:237] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:51.439832  1486 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55132 (request call id 303) took 1373 ms. Trace:
I20260709 13:01:51.446703   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:51.451370  1486 rpcz_store.cc:276] 0709 13:01:50.066308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.066443 (+   135us) service_pool.cc:224] Handling call
0709 13:01:50.088103 (+ 21660us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b5400119254. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef9090 00007f1b80f97f3a 00007f1b86d4e1cc 00007f1b86e4c37e 00007f1b8530d2a4 00007f1b8530d232 00007f1b8530d161 00007f1b8530d0dc 00007f1b8530c392 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:01:51.439755 (+1351652us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13526,"reported_tablets":4,"spinlock_wait_cycles":45389184}
I20260709 13:01:51.453334   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:51.451649  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:51.420722  5005 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:51.459899  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:51.421835  5001 raft_consensus.cc:697] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 9 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:51.440673  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:51.469503  1665 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:51.469376  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:51.472054  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:51.472843  5005 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:51.475351  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:51.476440  1740 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:51.479915  5001 consensus_queue.cc:237] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:01:51.484658  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.461710  1661 raft_consensus.cc:1240] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:51.491750  1486 catalog_manager.cc:5697] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: config changed from index 4 to 5, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:51.489946  1659 raft_consensus.cc:2955] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:51.502210  1740 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:01:51.502682  1707 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:51.509841  1663 raft_consensus.cc:1240] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:51.520238  1665 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:01:51.521956  1556 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:51.529672  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:51.536064  4884 raft_consensus.cc:2804] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:51.536706  4884 raft_consensus.cc:697] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:51.503019  4872 consensus_queue.cc:1059] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:01:51.554515  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:51.559957  1659 raft_consensus.cc:1240] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:51.537943  4864 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:51.548389  4765 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:51.554083  5012 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:51.559825  4863 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:51.558231  4914 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:51.580173  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:51.580910  4914 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:51.582545  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:51.583333  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:51.583603  4914 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:51.558495  4980 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:51.584254  4980 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:51.584710  1666 raft_consensus.cc:1240] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:51.580327  4863 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:51.586140  1658 raft_consensus.cc:1240] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:51.586346  4980 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:51.564002  4921 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:51.587044  5000 consensus_queue.cc:1059] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 13:01:51.587380  4921 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:51.587822  4863 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:51.589233  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:51.590533  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:51.594162  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:51.607683  1587 raft_consensus.cc:1240] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:51.606433  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:51.610790  1585 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:51.591820  4925 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:51.622084  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:51.603013  4921 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:51.625635  1558 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
W20260709 13:01:51.623622  1705 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.787s (SENT)
I20260709 13:01:51.609349  4980 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:51.639556  4980 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:51.640617  4963 raft_consensus.cc:2804] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:51.641185  4963 raft_consensus.cc:697] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:51.642015  4980 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:51.590098  4765 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:51.644464  4765 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:51.576422  4884 consensus_queue.cc:237] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:51.631531  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:51.589962  4864 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:51.649116  4864 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:51.626965  4925 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:51.652208  4925 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:51.619697  5012 raft_consensus.cc:697] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 14 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:51.667889  5012 consensus_queue.cc:237] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:51.642032  4963 consensus_queue.cc:237] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:51.671340  1488 catalog_manager.cc:5697] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: config changed from index 4 to 5, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
W20260709 13:01:51.664052  5028 log.cc:927] Time spent T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:01:51.674410  1665 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:01:51.682219  4939 raft_consensus.cc:3055] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:51.683630  1585 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
I20260709 13:01:51.690812  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:51.712039  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:51.745285  1586 raft_consensus.cc:1240] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:51.751364  1592 raft_consensus.cc:1240] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:51.689461  4939 raft_consensus.cc:740] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:51.754081  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:51.760106  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:51.731714  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:51.853524  1589 raft_consensus.cc:1240] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:51.869459  1738 raft_consensus.cc:1240] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:51.870404  1740 raft_consensus.cc:1240] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:51.877027  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:51.880995  4939 consensus_queue.cc:260] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:51.882213  4939 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:51.882783  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:51.860775  5001 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:51.888738  5001 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:51.889721  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:51.890616  1736 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:43686
I20260709 13:01:51.891219  1736 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:51.891562  1736 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:51.892616  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:51.901582  1736 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:51.911442  4914 raft_consensus.cc:3055] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:51.911926  4914 raft_consensus.cc:740] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:51.919196  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:51.923821  1661 raft_consensus.cc:1275] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:51.928610  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:51.928208  1736 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:51.909399  5001 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:51.942533  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:51.942703  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:51.943495  1585 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:01:51.944278  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:51.948383  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:51.950361  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:51.951103  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:51.952298  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:51.957144  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:51.960258  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:51.912732  4914 consensus_queue.cc:260] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:51.970517  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.974120  1733 raft_consensus.cc:1275] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:01:51.975121  1733 pending_rounds.cc:85] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 3
I20260709 13:01:51.975450  1733 pending_rounds.cc:107] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:01:51.976130  1733 raft_consensus.cc:2889] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:51.965376  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:51.983090  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:51.984026  1591 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:51.958052  5030 consensus_queue.cc:1048] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:01:51.990383  1707 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:01:51.990315  5035 log.cc:927] Time spent T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.081s	user 0.002s	sys 0.000s
I20260709 13:01:52.006862  1740 raft_consensus.cc:1275] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:52.008980  1707 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:51.994479  1736 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:52.005121  1583 raft_consensus.cc:1240] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:52.020403  1558 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:51.988020  4914 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:52.078213  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 69296.1us
I20260709 13:01:52.108803  1592 raft_consensus.cc:1240] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:52.111280  1736 raft_consensus.cc:1275] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:01:52.078424  4863 raft_consensus.cc:2804] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:52.026448  1591 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:01:52.089916  1664 raft_consensus.cc:1275] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:01:52.090147  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 466568us
I20260709 13:01:52.094554  5000 raft_consensus.cc:2804] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:01:52.094709  5042 log.cc:927] Time spent T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:01:52.095208  4981 raft_consensus.cc:2749] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:01:52.094712  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 74481.5us
I20260709 13:01:52.114135  4863 raft_consensus.cc:697] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:52.140610  1707 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:51.995816  5038 consensus_queue.cc:1059] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.127s
I20260709 13:01:52.151741  5000 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
W20260709 13:01:52.161799  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:52.131485  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:52.169116  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.170395  4863 consensus_queue.cc:237] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:52.164309  5011 consensus_queue.cc:1048] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:01:52.173658  5000 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:52.167219  4921 raft_consensus.cc:2749] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:52.176107  5038 raft_consensus.cc:3055] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:52.176545  5038 raft_consensus.cc:740] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:52.177408  5038 consensus_queue.cc:260] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:52.178705  5038 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:52.182370  1667 raft_consensus.cc:1275] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:01:52.183166  1665 raft_consensus.cc:1275] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:52.184806  1664 raft_consensus.cc:1275] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:01:52.168257  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 243573us
I20260709 13:01:52.189484  1633 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:52.198822  1705 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:52.205410  4895 raft_consensus.cc:2749] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:52.175820  4921 consensus_queue.cc:1048] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
W20260709 13:01:52.220741  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.197294  5020 consensus_queue.cc:1048] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:01:52.230446  4765 raft_consensus.cc:993] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:52.230978  4765 raft_consensus.cc:1081] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 10 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:52.228400  5037 raft_consensus.cc:2749] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:52.240017  1705 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:52.240440  5030 consensus_queue.cc:1048] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:52.241004  4939 raft_consensus.cc:2749] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:52.242702  5030 consensus_queue.cc:1048] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:52.244347  4978 consensus_queue.cc:1048] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:52.244333  1705 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:52.249207  4977 consensus_queue.cc:1048] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:52.250857  5000 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:52.254081  1707 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:52.255105  1738 raft_consensus.cc:1275] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:52.257288  5036 raft_consensus.cc:2804] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:52.257009  5037 consensus_queue.cc:1059] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:52.258543  5037 consensus_queue.cc:1243] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer 6d4de2ce0683442498244b9529127f91 log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:52.259095  5037 raft_consensus.cc:3055] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:52.259409  5037 raft_consensus.cc:740] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:52.260275  5037 consensus_queue.cc:260] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:52.265246  1736 raft_consensus.cc:1275] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:01:52.267853  5000 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:52.268067  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:01:52.272805  5009 consensus_queue.cc:1048] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:52.274559  4977 consensus_queue.cc:1048] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:01:52.305778  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 116371us
I20260709 13:01:52.306629  1633 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:52.307900  1633 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:52.308677  1659 raft_consensus.cc:3055] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:52.309149  1667 raft_consensus.cc:1275] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:01:52.309365  1659 raft_consensus.cc:740] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
W20260709 13:01:52.318598  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 74324.2us
I20260709 13:01:52.319430  1705 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:52.322480  1633 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:52.323691  1592 raft_consensus.cc:1275] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:01:52.310189  1659 consensus_queue.cc:260] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:52.330214  1659 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:52.320854  1486 catalog_manager.cc:5697] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 10 to 11, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:52.349992  1592 raft_consensus.cc:1275] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:52.355796  1705 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:52.321794  4989 raft_consensus.cc:2749] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:52.344455  1486 catalog_manager.cc:5697] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 7 to 8, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:52.364934  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:52.368104  1592 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:52.329432  5036 raft_consensus.cc:697] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:52.347066  4996 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:52.376416  1486 catalog_manager.cc:5697] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 5 to 6, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:52.346283  4872 raft_consensus.cc:2749] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:52.361056  5037 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:52.390758  1705 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:52.392022  1592 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5.
I20260709 13:01:52.379912  1486 catalog_manager.cc:5697] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 7 to 8, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:52.394579  1486 catalog_manager.cc:5697] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 5 to 6, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:52.396307  1486 catalog_manager.cc:5697] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 5 to 6, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:52.396858  1659 raft_consensus.cc:1275] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:52.398569  1486 catalog_manager.cc:5697] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 7 to 8, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:52.369227  4934 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:52.346841  4977 consensus_queue.cc:1048] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:01:52.403735  1705 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:52.409524  4863 consensus_queue.cc:1048] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:01:52.409797  4864 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:52.423240  4921 raft_consensus.cc:2749] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:52.424525  4977 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:52.430394  5036 consensus_queue.cc:237] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:52.433372  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:52.458482  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 99700.7us
I20260709 13:01:52.444679  4991 raft_consensus.cc:2749] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:52.446624  4977 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:52.503597  4977 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:52.509850   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:52.512512  2553 raft_consensus.cc:1275] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:52.525875  5059 consensus_queue.cc:1048] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:01:52.543439  5064 consensus_queue.cc:1048] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:52.549533  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:01:52.551067  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 167036us
I20260709 13:01:52.597218  4964 consensus_queue.cc:1048] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:01:52.601526  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 279111us
I20260709 13:01:52.602393  1633 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:01:52.600346  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 47646.2us
I20260709 13:01:52.527420  5038 consensus_queue.cc:1048] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:01:52.636845  4939 raft_consensus.cc:2749] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:01:52.655231  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 52928.8us
W20260709 13:01:52.661580  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 57627.7us
I20260709 13:01:52.669603  5038 consensus_queue.cc:1048] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:52.670509  4996 consensus_queue.cc:1059] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:52.670863  4991 consensus_queue.cc:1059] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:52.672312  4991 raft_consensus.cc:3055] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:52.672746  4895 raft_consensus.cc:3055] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:52.673250  5020 raft_consensus.cc:993] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede: : Instructing follower 6d4de2ce0683442498244b9529127f91 to start an election
I20260709 13:01:52.673364  4895 raft_consensus.cc:740] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:52.673838  5020 raft_consensus.cc:1081] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Signalling peer 6d4de2ce0683442498244b9529127f91 to start an election
I20260709 13:01:52.674506  4895 consensus_queue.cc:260] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:52.675748  4895 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:52.672705  4991 raft_consensus.cc:740] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:52.678272  1705 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:52.680707  1735 raft_consensus.cc:1240] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 14 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:52.684679  1734 raft_consensus.cc:1240] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 10 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 9. Current term is 10. Ops: []
W20260709 13:01:52.686017  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 49498.7us
I20260709 13:01:52.684772  4939 raft_consensus.cc:2749] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:01:52.711656  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 47330.7us
I20260709 13:01:52.721776  5058 raft_consensus.cc:2749] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:52.722298  1740 raft_consensus.cc:1240] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:52.730614  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:52.721489  1735 raft_consensus.cc:1275] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:52.760931  1735 raft_consensus.cc:1240] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 6. Current term is 7. Ops: []
W20260709 13:01:52.762445  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 48812.8us
W20260709 13:01:52.765115  1633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.773949  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:52.777673  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:52.778321  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:52.779697  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:52.781311  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:52.783506  1659 raft_consensus.cc:3055] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:52.783970  1659 raft_consensus.cc:740] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:52.785190  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:52.789989  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:01:52.835249  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.856256  1664 raft_consensus.cc:3055] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:52.858245  1660 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39162
I20260709 13:01:52.858908  1660 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:01:52.859138  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 73486.2us
I20260709 13:01:52.840847  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:52.856632  1664 raft_consensus.cc:740] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:52.785269  1659 consensus_queue.cc:260] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:52.843108  1658 raft_consensus.cc:1275] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:52.859263  1660 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:52.861765  1659 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:52.863093  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:01:52.840402  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 81319.1us
W20260709 13:01:52.851936  5035 log.cc:927] Time spent T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:01:52.861502  1664 consensus_queue.cc:260] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:52.895047  1664 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:52.901163  1591 raft_consensus.cc:1275] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:01:52.733409  4991 consensus_queue.cc:260] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:52.921653  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 56043us
I20260709 13:01:52.879081  5005 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:52.878819  4996 consensus_queue.cc:1059] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
W20260709 13:01:52.972433  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 98272.4us
I20260709 13:01:53.043793  1633 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:52.968662  1659 raft_consensus.cc:1275] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:01:53.070340  5067 log.cc:927] Time spent T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:01:53.073956  5080 log.cc:927] Time spent T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.140s	user 0.000s	sys 0.002s
W20260709 13:01:53.093573  5019 log.cc:927] Time spent T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da: Append to log took a long time: real 0.176s	user 0.001s	sys 0.001s
I20260709 13:01:53.122123  1664 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:01:52.953315  5005 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:53.124258  1660 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:53.173341  1658 raft_consensus.cc:1240] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 10. Current term is 11. Ops: []
W20260709 13:01:53.180774  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 137698us
I20260709 13:01:53.185708  1633 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:01:53.243643  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 61584.7us
I20260709 13:01:53.244892  1633 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:53.252394  1558 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:53.257125  1660 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:53.265282  5050 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:53.266294  5050 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
W20260709 13:01:53.271780  5073 log.cc:927] Time spent T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.301s	user 0.000s	sys 0.002s
I20260709 13:01:53.276569  5005 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:53.278159  5085 log.cc:927] Time spent T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.374s	user 0.001s	sys 0.000s
W20260709 13:01:53.254596  5037 consensus_meta.cc:287] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.853s	user 0.009s	sys 0.006s
W20260709 13:01:53.288830  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:53.291697  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 234087us
W20260709 13:01:53.294914  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 47547.8us
I20260709 13:01:53.296873  1736 raft_consensus.cc:1275] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:01:53.258605  4907 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:53.318692  1633 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:53.266973  5050 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:53.296512  5005 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:53.295661  5009 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:53.329891  4907 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:53.365043  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:53.365715  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.329602  4996 raft_consensus.cc:2749] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:53.370536  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:01:53.371455  2553 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:53.373423  5076 log.cc:927] Time spent T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.340s	user 0.000s	sys 0.002s
W20260709 13:01:53.381839  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 52937.3us
I20260709 13:01:53.360598  5009 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:53.399225  5009 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:53.401930  5086 log.cc:927] Time spent T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:01:53.407575  4907 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:53.411237  5050 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:53.403733  4895 consensus_meta.cc:287] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.728s	user 0.011s	sys 0.000s
I20260709 13:01:53.421530  1666 raft_consensus.cc:1275] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:01:53.430951  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:53.431480  1585 raft_consensus.cc:1240] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:53.431375  2553 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 11.
I20260709 13:01:53.450932  1589 raft_consensus.cc:1240] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5. Ops: [4.5-4.5]
W20260709 13:01:53.453879  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:53.454979  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:53.455438  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.463037  1705 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:53.434671  1630 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:01:53.471009  1586 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
 from {username='slave'} at 127.0.0.1:59106
I20260709 13:01:53.471886  1586 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:53.472373  1586 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:53.593833  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 333189us
W20260709 13:01:53.495857  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 61287.5us
W20260709 13:01:53.595757  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 132838us
I20260709 13:01:53.598960  1705 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:53.606338  1705 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:53.473469  4864 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:53.611043  1705 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:53.612809  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:53.620290  1735 raft_consensus.cc:3055] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:53.620625  1735 raft_consensus.cc:740] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:53.612614  1586 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:01:53.620568  1633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.622372  1590 raft_consensus.cc:1240] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:53.624390  1658 raft_consensus.cc:1275] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:53.487015  5012 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:53.473565  4966 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:53.589505  5097 raft_consensus.cc:2749] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:53.594609  5037 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:53.639433  4966 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:53.641741  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:53.600651  5000 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:53.482846  4869 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:53.638264  1735 consensus_queue.cc:260] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:53.619442  4980 raft_consensus.cc:2749] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:53.638525  1586 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:53.618505  4939 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:53.676316  1735 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:53.646024  4765 raft_consensus.cc:2749] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:53.689752  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 78778.6us
I20260709 13:01:53.632350  4864 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:53.710758  5103 log.cc:927] Time spent T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:01:53.712069  5107 raft_consensus.cc:2804] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:53.693454  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:53.695755  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:53.715687  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:01:53.717731  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 81831.5us
I20260709 13:01:53.717732  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:53.712210  4864 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:01:53.721333  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 104985us
I20260709 13:01:53.725823  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:53.691943  1705 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:53.637880  5012 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:53.718492  1633 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:53.726498  1664 raft_consensus.cc:3055] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:53.779402  1664 raft_consensus.cc:740] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:53.726881  1735 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 11.
W20260709 13:01:53.772524  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 46478.1us
I20260709 13:01:53.686069  5049 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:53.661439  5037 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:01:53.781279  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 62746.6us
W20260709 13:01:53.785145  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 93288.7us
I20260709 13:01:53.786240  1664 consensus_queue.cc:260] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:53.729300  5107 raft_consensus.cc:697] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 11 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:53.677901  4869 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:53.783556  5059 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.788455  4863 raft_consensus.cc:2749] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:53.793695  4864 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.815992  4966 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:53.728834  4996 consensus_queue.cc:1059] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:01:53.814451  5059 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:53.822305  5060 consensus_queue.cc:1048] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.191s
I20260709 13:01:53.823527  4869 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:53.824095  5078 log.cc:927] Time spent T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:01:53.824980  5059 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:53.825721  5101 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:53.826783  5094 raft_consensus.cc:2749] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:53.831068  5107 consensus_queue.cc:237] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:53.797117  5089 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:53.834980  5012 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:53.835276  5089 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:53.836834  4863 consensus_queue.cc:1048] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:01:53.837926  5108 log.cc:927] Time spent T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:01:53.791363  5049 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:53.816269  4864 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:53.819303  1705 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:01:53.851998  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 133585us
I20260709 13:01:53.850159  4859 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
W20260709 13:01:53.883674  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.851375  4863 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:53.887614  5000 consensus_queue.cc:1048] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:53.890580  1666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 2328) took 1024 ms. Trace:
I20260709 13:01:53.906546  1666 rpcz_store.cc:276] 0709 13:01:52.866192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.929349 (+ 63157us) service_pool.cc:224] Handling call
0709 13:01:52.929726 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:53.421988 (+492262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:53.890243 (+468255us) spinlock_profiling.cc:243] Waited 491 ms on lock 0x7b540044d754. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:01:53.890493 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1130135808}
I20260709 13:01:53.895468  4991 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:53.898468  5049 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:53.901947  4864 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:53.912509  5037 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:53.886276  5089 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:53.924544  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:01:53.925382  2554 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:53.944593  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 145176us
W20260709 13:01:53.944418  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 138646us
I20260709 13:01:53.952420  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:53.955555  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:01:53.957885  5118 log.cc:927] Time spent T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:01:53.958199  5038 consensus_queue.cc:1048] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:53.958662  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:53.962059  1667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 2320) took 1118 ms. Trace:
I20260709 13:01:53.962462  1667 rpcz_store.cc:276] 0709 13:01:52.844008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.844234 (+   226us) service_pool.cc:224] Handling call
0709 13:01:52.844543 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:52.844914 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:52.844956 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:52.851198 (+  6242us) log.cc:844] Serialized 26 byte log entry
0709 13:01:52.897447 (+ 46249us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:53.474273 (+576826us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b18002d73c0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7de84e07 00007f1b86cdfab9 00007f1b7dea169b 00007f1b7de9f93f 00007f1b7de9f455 00007f1b849873c7 00007f1b80f999a7 00007f1b80fa90bf 00007f1b80fa9038
0709 13:01:53.641335 (+167062us) log.cc:844] Serialized 14 byte log entry
0709 13:01:53.657996 (+ 16661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:53.658113 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:53.913331 (+255218us) spinlock_profiling.cc:243] Waited 8.35 ms on lock 0x7b18002d73c0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7dea23f3 00007f1b7dea47c1 00007f1b7dea4779 00007f1b7dea4709 00007f1b7dea46d1 00007f1b7dea39cd 000000000038f354 000000000038f199 00007f1b7de8583a
0709 13:01:53.961767 (+ 48436us) raft_consensus.cc:1685] finished
0709 13:01:53.961790 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:53.961947 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26266,"prepare.queue_time_us":62736,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":4077,"raft.queue_time_us":18004,"raft.run_cpu_time_us":377,"raft.run_wall_time_us":30097,"spinlock_wait_cycles":24549888,"thread_start_us":204177,"threads_started":2,"wal-append.queue_time_us":30914}
I20260709 13:01:53.965281  5037 consensus_queue.cc:1048] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:53.908322  4859 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:53.950207  5012 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:01:53.969264  5012 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:53.969455  4864 consensus_queue.cc:1048] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:01:53.975594  5110 log.cc:927] Time spent T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
I20260709 13:01:53.978048  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:53.979861  5003 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:53.980780  5003 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:53.968928  4859 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:53.984058  5003 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:53.985932  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:53.987095  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:53.987259  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:53.990723  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:53.992970  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:53.994362  1666 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:01:54.002552  2554 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:01:54.010378  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:54.018972  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:01:54.023224  1633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.993374  5123 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:54.030817  1586 raft_consensus.cc:1275] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:54.041268  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:54.040145  1662 raft_consensus.cc:1275] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:54.023548  1555 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:01:54.030742  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:54.048298  1667 raft_consensus.cc:2468] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
I20260709 13:01:54.032620  5094 consensus_queue.cc:1059] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:01:54.033695  5088 log.cc:927] Time spent T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 1.077s	user 0.002s	sys 0.006s
I20260709 13:01:54.066552  5101 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:54.067342  5101 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:54.062203  5123 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:54.069144  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:54.020658  5012 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:01:54.090209  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 58474.9us
I20260709 13:01:54.100178  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:54.025357  5038 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:54.035449  4936 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:01:54.103819  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:54.105157  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:54.064070  4963 raft_consensus.cc:2804] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:54.106390  4991 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:54.114341  1705 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:54.117365  1591 raft_consensus.cc:1240] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:54.082540  5049 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:54.151154  1592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2403) took 1260 ms. Trace:
I20260709 13:01:54.161935  5020 raft_consensus.cc:3055] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:54.162487  5020 raft_consensus.cc:740] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:54.151747  1592 rpcz_store.cc:276] 0709 13:01:52.869391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.869511 (+   120us) service_pool.cc:224] Handling call
0709 13:01:52.869834 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:52.903692 (+ 33858us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:52.903724 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:52.904311 (+   587us) log.cc:844] Serialized 26 byte log entry
0709 13:01:52.955483 (+ 51172us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:52.955599 (+   116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.955811 (+   212us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:54.032341 (+1076530us) spinlock_profiling.cc:243] Waited 98.1 ms on lock 0x7b4400022b4c. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7ddc8c85 00007f1b7ddc96a2 00007f1b80b3b1db 00007f1b80b36aaf 00007f1b80b2a86e 00007f1b80b29bb6 00007f1b80b297d8 00007f1b80b33221 00007f1b80b331d9 00007f1b80b33169
0709 13:01:54.116800 (+ 84459us) raft_consensus.cc:1685] finished
0709 13:01:54.116839 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:54.130048 (+ 13209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":150278,"raft.queue_time_us":33712,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":14972,"spinlock_wait_cycles":225627904,"thread_start_us":50688,"threads_started":1,"wal-append.queue_time_us":51183}
I20260709 13:01:54.163345  5020 consensus_queue.cc:260] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:54.164562  5020 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:54.167272  1633 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:01:54.167323  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 95621.9us
I20260709 13:01:54.111196  4925 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:54.173673  5068 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:01:54.130155  4765 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.151465  5000 raft_consensus.cc:2804] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:54.176071  5101 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:54.111683  5012 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.116493  5037 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:54.197382  5068 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:54.187671  5097 raft_consensus.cc:2749] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:54.114250  5038 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:54.131660  4936 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:54.200434  5000 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:01:54.219101  4963 raft_consensus.cc:697] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:54.227897  5068 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:54.192545  4991 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:01:54.262305  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 111320us
I20260709 13:01:54.270501  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:54.191660  4925 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:54.231467  5123 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:54.200304  4765 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:54.299468  5114 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:54.300096  5114 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:54.215646  5012 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:54.257341  5000 raft_consensus.cc:3060] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:54.311637  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 129650us
I20260709 13:01:54.193421  5049 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:54.217590  5037 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:54.293735  5122 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.417553  1736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3025) took 2026 ms. Trace:
I20260709 13:01:54.317831  4914 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:54.418123  1736 rpcz_store.cc:276] 0709 13:01:52.363922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.364155 (+   233us) service_pool.cc:224] Handling call
0709 13:01:52.364464 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:53.297385 (+932921us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:54.389630 (+1092245us) spinlock_profiling.cc:243] Waited 932 ms on lock 0x7b540001de54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:01:54.389852 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2143199616}
I20260709 13:01:54.329187  4869 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.328890  4872 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:54.339763  5012 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:54.464391  5012 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:54.468791  5038 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:54.469585  5038 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:54.470183  5038 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:54.471204  5061 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:54.471894  5116 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:54.472097  5061 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:54.436738  4914 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:54.513989  5139 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:54.515105  5139 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:54.460660  4869 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:54.490372  5123 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:54.443542  5122 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:01:54.458781  4872 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:54.537693  5038 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:54.467514  5012 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:54.472690  5116 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:54.459055  4963 consensus_queue.cc:237] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:01:54.553872  5128 log.cc:927] Time spent T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:01:54.542425  4936 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:01:54.570509  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 123054us
I20260709 13:01:54.584496  5141 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
W20260709 13:01:54.586640  5129 log.cc:927] Time spent T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.261s	user 0.001s	sys 0.001s
I20260709 13:01:54.587546  5109 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:54.588326  5037 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:01:54.591063  5127 log.cc:927] Time spent T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:01:54.585587  5141 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:54.584697  4765 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:54.539811  5123 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:54.590910  5037 consensus_queue.cc:1048] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:54.559933  5122 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:54.569736  5094 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:54.588284  4869 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:54.575095  4925 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:54.758764  4872 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:54.671415  4914 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:01:54.760571  5130 log.cc:927] Time spent T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
W20260709 13:01:54.774510  5134 log.cc:927] Time spent T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:01:54.588382  5109 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:01:54.810973  5125 log.cc:927] Time spent T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:01:54.814083  5061 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:54.822383  5012 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:54.781031  5123 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:54.673585  5094 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:54.820533  5116 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:54.828877  5094 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:54.835268  5139 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:54.867960  5109 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:54.841709  5141 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:01:54.872037  5020 consensus_meta.cc:287] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.707s	user 0.014s	sys 0.000s
W20260709 13:01:54.875324  5000 consensus_meta.cc:287] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.538s	user 0.009s	sys 0.005s
I20260709 13:01:54.875911  5000 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:01:54.966125  1556 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.003s	sys 0.002s
W20260709 13:01:54.967324  1556 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.004s	sys 0.002s
W20260709 13:01:54.967816  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 634471us
W20260709 13:01:54.972069  1584 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.018s	sys 0.015s
W20260709 13:01:54.972640  1584 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.018s	sys 0.015s
I20260709 13:01:54.982215  5158 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:54.984519  1555 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.006s	sys 0.005s
W20260709 13:01:54.985198  1555 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.007s	sys 0.005s
W20260709 13:01:54.996285  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 413714us
I20260709 13:01:54.998208  1707 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:55.003109  1658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 2338) took 1049 ms. Trace:
W20260709 13:01:55.006596  1706 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.820s	user 0.001s	sys 0.017s
W20260709 13:01:55.007341  1706 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.001s	sys 0.017s
I20260709 13:01:55.008141  1662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 2321) took 2163 ms. Trace:
I20260709 13:01:55.008706  1662 rpcz_store.cc:276] 0709 13:01:52.844436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.845436 (+  1000us) service_pool.cc:224] Handling call
0709 13:01:52.845814 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:54.047377 (+1201563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.007516 (+960139us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54001e0354. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:01:55.007890 (+   374us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2745677568}
I20260709 13:01:55.006569  1707 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:55.003603  1658 rpcz_store.cc:276] 0709 13:01:53.953742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.957889 (+  4147us) service_pool.cc:224] Handling call
0709 13:01:53.958251 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:53.998216 (+ 39965us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:53.998263 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:53.998865 (+   602us) log.cc:844] Serialized 26 byte log entry
0709 13:01:54.095229 (+ 96364us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:54.095304 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:54.095396 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:54.157289 (+ 61893us) spinlock_profiling.cc:243] Waited 4.02 ms on lock 0x7b48001bc258. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b85eb8aa1 00007f1b85eafb37 00007f1b85eaf9ca 00007f1b85fa726f 00007f1b85fa6f37 00007f1b85fbb55c 00007f1b85fbb508 00007f1b85fbb488 00007f1b85fbb443 00007f1b85fba6ec 00007f1b84ee4a96
0709 13:01:55.002197 (+844908us) raft_consensus.cc:1685] finished
0709 13:01:55.002239 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:55.002899 (+   660us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39507,"raft.queue_time_us":40759,"raft.run_cpu_time_us":2696,"raft.run_wall_time_us":148243,"spinlock_wait_cycles":9236864,"thread_start_us":95980,"threads_started":1,"wal-append.queue_time_us":310940}
I20260709 13:01:55.019373  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:55.021989  1583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 1916) took 1384 ms. Trace:
W20260709 13:01:55.031829  2424 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.026s	sys 0.074s
W20260709 13:01:55.049782  2424 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.026s	sys 0.078s
I20260709 13:01:55.050168  4765 raft_consensus.cc:2749] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:55.050433  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 729552us
I20260709 13:01:55.052117  2424 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:55.056348  1583 rpcz_store.cc:276] 0709 13:01:53.637232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.637381 (+   149us) service_pool.cc:224] Handling call
0709 13:01:53.637805 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:53.819933 (+182128us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:53.819981 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:53.820036 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:53.820069 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.021426 (+1201357us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b54003912d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:01:55.021507 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:55.021755 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":418203520}
I20260709 13:01:55.059566  4765 raft_consensus.cc:2749] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:55.021041  1733 raft_consensus.cc:2393] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 9: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:01:55.058301  2424 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:55.061475  4895 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:55.062527  4895 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:55.064654  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:55.065891  1736 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:01:55.066239  4895 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:55.067065  4895 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:01:55.067754  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:55.067907  4895 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:55.068785  1733 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:01:55.071633  4895 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:55.082211  4984 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:55.082538  5000 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:55.058555  4872 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:55.045642  1707 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:01:55.090886  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 101894us
W20260709 13:01:55.089582  1705 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.779s	user 0.006s	sys 0.006s
I20260709 13:01:54.983578  5158 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:55.108074  1705 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.007s	sys 0.006s
I20260709 13:01:55.112030  4872 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:55.115731  4872 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:55.116690  5039 raft_consensus.cc:2749] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:55.150424  5159 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:55.155021  1591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 1906) took 1714 ms. Trace:
I20260709 13:01:55.155761  4907 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:55.156139  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:55.159698  5005 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:55.083354  4984 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:55.155650  1591 rpcz_store.cc:276] 0709 13:01:53.428882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.429013 (+   131us) service_pool.cc:224] Handling call
0709 13:01:54.117194 (+688181us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:54.117792 (+   598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.107682 (+989890us) spinlock_profiling.cc:243] Waited 667 ms on lock 0x7b54003a1450. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8e8ad 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:01:55.143381 (+ 35699us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1535000960}
I20260709 13:01:55.128048  5136 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:55.165397  4986 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:55.165611  5145 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
W20260709 13:01:55.160765  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 129623us
I20260709 13:01:55.168087  5139 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.172122  5139 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:55.174299  5155 raft_consensus.cc:2749] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:55.175132  5114 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:55.175683  5123 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:55.176520  5123 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:55.151551  5159 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:55.188858  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:55.196738  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:55.199617  5153 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:55.199779  1735 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:01:55.174930  5139 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:55.202577  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 65119.8us
I20260709 13:01:55.200546  5153 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:01:55.210189  2423 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.843s	user 0.003s	sys 0.028s
W20260709 13:01:55.210672  2423 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.901s	user 0.003s	sys 0.029s
I20260709 13:01:55.162715  5146 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:55.156849  4907 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:55.160679  5005 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:55.168205  5083 raft_consensus.cc:2955] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:55.216223  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:55.216877  5136 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:55.219514  1591 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 4.
I20260709 13:01:55.209403  5123 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:55.229102  5036 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:01:55.230686  2425 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.005s	sys 0.022s
I20260709 13:01:55.235452  5058 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:55.236600  5061 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:55.237591  5061 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:55.217370  5146 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:01:55.239342  2425 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.006s	sys 0.022s
I20260709 13:01:55.242033  5094 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:55.242710  5049 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:55.242964  5160 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:01:55.242909  5094 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:55.249048  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:55.251992  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:55.252094  5098 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:55.252293  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:55.235491  5001 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:55.247519  1556 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:55.232857  5036 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:55.253113  5098 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:55.243965  5160 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:55.225942  5145 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:55.318409  5065 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:55.310705  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:55.319104  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:55.319794  1736 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:01:55.316184  1488 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55138 (request call id 316) took 2774 ms. Trace:
I20260709 13:01:55.327864  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:55.322822  4907 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:55.323447  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 55369.1us
I20260709 13:01:55.275756  5094 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:55.259575  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:55.323372  1488 rpcz_store.cc:276] 0709 13:01:52.542037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.542204 (+   167us) service_pool.cc:224] Handling call
0709 13:01:55.315885 (+2773681us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":722300,"reported_tablets":1}
W20260709 13:01:55.307313  5059 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.903s	user 0.023s	sys 0.024s
I20260709 13:01:55.333227  1661 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:01:55.335301  5136 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:55.335683  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:55.336220  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:55.339926  5159 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:55.271939  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:55.271268  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:55.342140  1663 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
I20260709 13:01:55.345013  5104 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:55.345920  5005 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:55.343184  1665 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:01:55.265443  5161 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:55.340394  5133 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:01:55.341517  5059 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.044s	user 0.023s	sys 0.027s
I20260709 13:01:55.350859  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:01:55.347177  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 125608us
I20260709 13:01:55.332067  5153 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:55.350786  2426 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:01:55.361867  4991 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:55.350692  5092 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:55.364552  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:55.365411  1663 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:01:55.365996  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:55.350894  5102 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:55.369855  5106 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:55.345867  5104 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:55.373428  5116 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:55.374125  5116 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:55.319892  5065 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:55.373173  1660 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:01:55.394915  5145 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:55.257934  5058 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:55.401557  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:01:55.404464  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 53981.9us
I20260709 13:01:55.363480  5163 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:55.372378  5005 raft_consensus.cc:2804] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:55.363061  5092 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:55.406198  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:55.352421  5001 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:55.370631  5106 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:55.427649  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:55.430269  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:55.430892  1734 raft_consensus.cc:2410] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:01:55.430162  5142 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:55.383817  5133 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:55.407423  5156 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:55.416533  5005 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:55.415467  5061 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:55.494038  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:55.461323  2426 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:01:55.490120  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 52846.7us
I20260709 13:01:55.369891  5102 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:55.458916  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:55.432374  5142 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:55.501322  1662 raft_consensus.cc:2410] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
W20260709 13:01:55.507980  5132 log.cc:927] Time spent T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 1.231s	user 0.006s	sys 0.018s
I20260709 13:01:55.508891  5154 raft_consensus.cc:2804] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:55.461541  5005 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:55.512995  5050 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:55.513200  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:55.513749  5160 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:55.509392  5154 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
W20260709 13:01:55.513937  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 55811.9us
I20260709 13:01:55.514038  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:55.516397  1661 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:01:55.497991  4984 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:55.520349  2553 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 4.
I20260709 13:01:55.500270  5156 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:55.505968  5158 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:55.530191  1733 raft_consensus.cc:1240] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:55.508023  5098 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:55.521878  5154 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:55.416905  5161 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:55.540320  5145 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:55.493888  5163 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:55.540452  1741 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:01:55.544539  1665 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:01:55.546901  5121 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:55.536077  5116 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:55.574329  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:55.570288  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:55.569708  1659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 2343) took 1278 ms. Trace:
I20260709 13:01:55.560669  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:55.544277  4991 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:55.543771  5145 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:55.561474  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:55.577067  1659 rpcz_store.cc:276] 0709 13:01:54.236853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.237400 (+   547us) service_pool.cc:224] Handling call
0709 13:01:54.237947 (+   547us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:55.338550 (+1100603us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:55.338592 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:55.338652 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:55.338684 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.495427 (+156743us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540040e7d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:01:55.495472 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:55.515490 (+ 20018us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2530143488}
I20260709 13:01:55.581673  5036 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:55.539121  5160 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
W20260709 13:01:55.584034  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 64327.9us
I20260709 13:01:55.561126  5107 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:55.569986  5124 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:55.601794  5095 raft_consensus.cc:2749] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:55.613603  5160 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:55.616164  5160 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:55.616753  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:55.617995  5001 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:55.570073  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:55.618464  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:55.619377  1666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 2340) took 1500 ms. Trace:
I20260709 13:01:55.619760  1666 rpcz_store.cc:276] 0709 13:01:54.029561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.046270 (+ 16709us) service_pool.cc:224] Handling call
0709 13:01:54.046745 (+   475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:54.069266 (+ 22521us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:54.069299 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:54.069780 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 13:01:54.103411 (+ 33631us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:54.103452 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:54.103530 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:55.357657 (+1254127us) spinlock_profiling.cc:243] Waited 6.57 ms on lock 0x7b4400022b4c. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7ddc8c85 00007f1b7ddc96a2 00007f1b80b3b1db 00007f1b80b36aaf 00007f1b80b2a86e 00007f1b80b29bb6 00007f1b80b297d8 00007f1b80b33221 00007f1b80b331d9 00007f1b80b33169
0709 13:01:55.510292 (+152635us) raft_consensus.cc:1685] finished
0709 13:01:55.510310 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:55.529482 (+ 19172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27371,"raft.queue_time_us":52901,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":7057,"spinlock_wait_cycles":15101696,"thread_start_us":33199,"threads_started":1,"wal-append.queue_time_us":56846}
I20260709 13:01:55.560926  5126 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:55.587030  5106 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:55.627535  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.634452  5126 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:55.630792  5165 log.cc:927] Time spent T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 13:01:55.645990  5156 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:55.593876  5050 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:55.631042  5158 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:55.653923  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:55.635465  5160 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:55.658129  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:55.646469  5124 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:55.652664  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:55.656126  5057 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:55.673454  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:55.629678  4991 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:55.671226  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:55.678323  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:55.635541  5121 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:55.675269  1733 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:01:55.644459  5107 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:55.665477  5163 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:55.688760  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:55.670564  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:55.690282  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:55.693683  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:55.697803  5091 consensus_queue.cc:1059] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:01:55.698727  5057 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:55.699978  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:55.685045  5158 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:55.702473  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:55.703153  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:55.703758  5005 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:55.683449  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:55.716456  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:55.692783  1737 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 7.
I20260709 13:01:55.710300  1591 raft_consensus.cc:2393] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 in current term 5: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:01:55.685541  5161 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:55.682910  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:55.726336  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:55.718415  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:55.693033  5142 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:55.682387  2540 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:01:55.736689  2537 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 8.
I20260709 13:01:55.718422  5126 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:55.736918  1667 raft_consensus.cc:2468] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:01:55.735795  1586 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 4.
I20260709 13:01:55.707904  5160 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:55.712491  5065 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:55.755218  5121 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:55.560636  2550 raft_consensus.cc:2955] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:55.752681  1740 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:01:55.764447  2552 raft_consensus.cc:1275] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:55.774490  5050 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:55.775187  1664 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:55.776752  5057 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:55.777500  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:55.778234  1667 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
I20260709 13:01:55.778791  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:55.779016  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:55.779628  1667 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
I20260709 13:01:55.779942  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:01:55.780174  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:55.787321  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:55.749686  5092 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:01:55.791771  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:55.796060  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:55.794684  1660 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:01:55.792104  1584 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 6.
I20260709 13:01:55.802421  5160 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:55.805948  5158 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:55.805539  5154 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:55.806298  5146 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:55.806872  2554 raft_consensus.cc:1240] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:55.808526  1734 raft_consensus.cc:1240] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:55.791769  5145 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:55.820900  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:55.820329  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:55.840426  5102 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:55.843792  5133 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:55.855013  5169 log.cc:927] Time spent T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.128s	user 0.003s	sys 0.000s
I20260709 13:01:55.861873  1667 raft_consensus.cc:2468] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:01:55.866865  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:55.877035  5124 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:55.877277  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:55.880329  5058 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:55.880407  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:55.881103  5135 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.881649  5135 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:55.884086  5135 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:55.884452  2426 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:55.886186  5095 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:55.887799  5104 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:55.888172  5154 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 5 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:55.875183  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:55.892529  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:55.896471  2426 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:55.901484  1489 catalog_manager.cc:5697] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 9 to 10, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 10 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:55.904269  5001 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.905017  5001 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:55.908245  5001 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:55.909423  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:55.921406  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:55.926333  1587 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:55.926376  1664 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:01:55.929409  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:55.916735  4991 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:55.936280  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:55.939201  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:55.921972  5039 raft_consensus.cc:2804] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:01:55.938072  1664 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39146 (request call id 2956) took 2215 ms (client timeout 2070 ms). Trace:
I20260709 13:01:55.928319  5123 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:55.948632  1664 rpcz_store.cc:269] 0709 13:01:53.712056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.724737 (+ 12681us) service_pool.cc:224] Handling call
0709 13:01:55.774385 (+2049648us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b580016bed0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80eeb0aa 00007f1b80f6d447 00007f1b80f85fe7 00007f1b80f877de 00007f1b80f9327c 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c
0709 13:01:55.927274 (+152889us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4009225984}
I20260709 13:01:55.942785  2515 raft_consensus.cc:1240] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:55.961861  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:55.944568  5012 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.945420  5039 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:55.963003  5038 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.942948  5107 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:55.969761  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:55.974145  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:55.956426  5158 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:55.975072  5039 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:55.957055  5123 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:55.998737  2426 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:55.985146  5005 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:56.009330  5095 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.009920  5095 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:56.011196  1586 raft_consensus.cc:1240] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:01:56.012192  5095 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:56.012390  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:56.012979  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:56.013926  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:56.014170  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:56.014585  1663 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 14.
I20260709 13:01:56.014752  1660 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:01:56.015422  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:56.015599  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.022066  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:56.025511  1658 raft_consensus.cc:2410] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:01:56.028482  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:56.024298  1630 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:01:56.003785  5104 raft_consensus.cc:2749] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:56.032227  1666 raft_consensus.cc:1275] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:56.029405  1732 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 11.
I20260709 13:01:56.040706  2426 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:01:56.033599  1587 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 5.
I20260709 13:01:56.031539  5116 raft_consensus.cc:3055] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:55.990262  5126 consensus_queue.cc:1048] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
W20260709 13:01:56.034556  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 106884us
I20260709 13:01:56.052467  2426 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:01:56.055763  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 222522us
I20260709 13:01:56.048779  5116 raft_consensus.cc:740] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:01:56.058175  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.058954  1590 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 11.
I20260709 13:01:56.059192  5116 consensus_queue.cc:260] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:55.993520  5038 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:55.986326  5012 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:56.004627  5158 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:56.054504  5107 raft_consensus.cc:2804] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:56.067883  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.060043  5154 raft_consensus.cc:2804] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:56.070508  1489 catalog_manager.cc:5697] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 8 to 9, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 9 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:56.057472  5095 raft_consensus.cc:2804] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:56.082809  5116 raft_consensus.cc:3060] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:56.085001  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:56.085283  5124 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:56.085726  5001 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:56.086155  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:56.086779  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:56.093886  1590 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 4.
I20260709 13:01:56.097517  5154 raft_consensus.cc:697] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:01:56.097580  1489 catalog_manager.cc:5697] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 13 to 14, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 14 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:56.118335  1737 raft_consensus.cc:2393] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 in current term 5: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:01:56.123843  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:56.095587  5107 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:56.131594  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:56.133369  1665 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 9.
I20260709 13:01:56.134773  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:56.134568  1489 catalog_manager.cc:5697] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 7 to 8, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 8 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:56.136097  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:56.099215  5095 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:56.137274  1663 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 7.
I20260709 13:01:56.144387  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:56.144651  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:56.133406  1556 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:56.146554  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.137642  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:56.138185  5107 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:56.157433  1489 catalog_manager.cc:5697] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 6 to 7, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 7 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:56.125739  5115 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:56.163069  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.177174  1590 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
I20260709 13:01:56.163460  5126 raft_consensus.cc:2804] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:56.164719  1556 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:56.171423  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:56.141149  5095 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:56.177343  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.164327  1486 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55132 (request call id 304) took 3943 ms. Trace:
I20260709 13:01:56.146855  5061 consensus_queue.cc:1048] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:01:56.197400  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.140798  5124 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:56.175978  5123 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:56.207734  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.184542  5126 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:01:56.217051  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.158331  5001 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:56.219954  2425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:56.222849  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 311684us
I20260709 13:01:56.220527  5126 raft_consensus.cc:3060] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:56.222944  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.223460  4991 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:01:56.239158  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.243592  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:56.245288  4991 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:56.247768  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:01:56.237138  5083 consensus_meta.cc:287] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.963s	user 0.015s	sys 0.002s
I20260709 13:01:56.242833  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:56.250197  5060 raft_consensus.cc:2804] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:56.250640  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.254307  1583 raft_consensus.cc:1240] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:56.254647  4991 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:56.257508  5001 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:56.194494  1486 rpcz_store.cc:276] 0709 13:01:52.221315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.228171 (+  6856us) service_pool.cc:224] Handling call
0709 13:01:52.281670 (+ 53499us) spinlock_profiling.cc:243] Waited 22.4 ms on lock 0x7b540020fe90. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7de6b640 00007f1b86d42b76 00007f1b86e4cc3e 00007f1b8530d2a4 00007f1b8530d232 00007f1b8530d161 00007f1b8530d0dc 00007f1b8530c392 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:01:56.164075 (+3882405us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:52.675844 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:52.676452 (+   608us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:52.676497 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:01:52.676513 (+    16us) tablet.cc:662] Decoding operations
0709 13:01:52.677435 (+   922us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:52.677539 (+   104us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:52.677570 (+    31us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:01:52.678103 (+   533us) tablet.cc:701] Row locks acquired
0709 13:01:52.678122 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:01:52.678252 (+   130us) write_op.cc:270] Start()
0709 13:01:52.678366 (+   114us) write_op.cc:276] Timestamp: P: 1783602112678206 usec, L: 0
0709 13:01:52.678386 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:01:52.684980 (+  6594us) log.cc:844] Serialized 2870 byte log entry
0709 13:01:53.667130 (+982150us) op_driver.cc:464] REPLICATION: finished
0709 13:01:53.919369 (+252239us) write_op.cc:301] APPLY: starting
0709 13:01:53.919483 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:53.919810 (+   327us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:53.920024 (+   214us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:53.979411 (+ 59387us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:53.979795 (+   384us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:01:53.979891 (+    96us) write_op.cc:312] APPLY: finished
0709 13:01:53.980423 (+   532us) log.cc:844] Serialized 59 byte log entry
0709 13:01:53.998336 (+ 17913us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:54.022784 (+ 24448us) write_op.cc:454] Released schema lock
0709 13:01:54.048987 (+ 26203us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:54.109258 (+ 60271us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:54.109291 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":176073,"reported_tablets":13,"spinlock_wait_cycles":51623296,"child_traces":[["op",{"apply.queue_time_us":237359,"apply.run_cpu_time_us":4809,"apply.run_wall_time_us":170662,"num_ops":7,"prepare.queue_time_us":270009,"prepare.run_cpu_time_us":4096,"prepare.run_wall_time_us":9639,"replication_time_us":969846,"thread_start_us":217457,"threads_started":2}]]}
I20260709 13:01:56.260546  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:56.261315  2523 raft_consensus.cc:2468] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:01:56.261561  5124 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:56.265112  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.268224  1633 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:56.231775  5123 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:56.269502  5123 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:56.270087  5020 consensus_queue.cc:1059] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:56.271250  5020 raft_consensus.cc:2749] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:56.271601  5123 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:56.219375  5115 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:56.272744  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:56.273902  5115 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:56.274588  5038 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:56.253515  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.268525  1589 consensus_queue.cc:237] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:56.276808  2424 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:56.241039  5154 consensus_queue.cc:237] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:56.250660  5060 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:56.284344  5060 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:56.298066  5012 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:56.305770  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:56.310247  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:01:56.310869  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 149056us
I20260709 13:01:56.300884  5158 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:56.319383  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:56.286406  5061 raft_consensus.cc:476] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Not starting pre-election -- already a leader
I20260709 13:01:56.321135  1633 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:56.325804  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:56.327096  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:56.327423  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:56.327471  5063 raft_consensus.cc:2804] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:56.328042  5063 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:56.328419  5063 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:56.331812  1592 consensus_queue.cc:237] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:56.342290  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:56.343642  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:56.342458  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:56.355242  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:01:56.368461  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 44252.6us
I20260709 13:01:56.370510  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:56.372105  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:56.319802  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:56.373315  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:56.374432  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:56.370537  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:56.373980  1732 raft_consensus.cc:1240] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:56.337642  5065 raft_consensus.cc:2804] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:56.381440  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:56.383055  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:56.384531  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:56.387358  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.394320  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:56.378167  5065 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:56.423863  5065 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:56.501358  1705 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:56.516806  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.517469  5149 raft_consensus.cc:2804] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:56.517863  5149 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:56.518227  5149 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:56.503000  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.502823  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:56.503186  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:56.525046  1734 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 9.
I20260709 13:01:56.524684  1737 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 6.
I20260709 13:01:56.524644  5126 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:56.504302  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:56.506909  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:56.526305  5095 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:56.527365  1588 raft_consensus.cc:1240] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:56.527521  2543 raft_consensus.cc:2393] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 12: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:01:56.507133  5063 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:56.529886  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 151837us
I20260709 13:01:56.530915  5063 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:56.509377  5083 raft_consensus.cc:3055] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:56.512135  5039 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:56.531756  5083 raft_consensus.cc:740] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:56.531451  5126 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:56.532922  5083 consensus_queue.cc:260] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:56.534605  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:56.535017  5083 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:56.535425  1587 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:56.516126  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:56.544719  1588 raft_consensus.cc:1240] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:56.549671  5039 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:56.387529  1704 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:56.514395  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.505929  5107 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:56.559324  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:01:56.560669  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 284007us
I20260709 13:01:56.559324  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.565663  1588 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5.
I20260709 13:01:56.553256  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.555143  5116 consensus_queue.cc:1059] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:01:56.566447  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 401819us
I20260709 13:01:56.531117  1705 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:56.579639  2543 raft_consensus.cc:1275] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:01:56.580551  1583 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:01:56.580830  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:56.580580  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:56.554838  5060 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:56.582095  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:56.582405  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:56.576473  5177 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:56.583462  5116 raft_consensus.cc:3055] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:56.583777  5177 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:56.584856  5116 raft_consensus.cc:740] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:01:56.585922  5116 consensus_queue.cc:260] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:56.583842  5060 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:56.587420  5116 raft_consensus.cc:3060] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:56.588274  5177 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:01:56.589051  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 58125.5us
I20260709 13:01:56.590638  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.590680  2424 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:56.595079  2424 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:01:56.596515  1705 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:56.603358  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:56.605152  1587 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 7.
I20260709 13:01:56.605372  2424 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:56.606729  2426 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:01:56.607245  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:01:56.607576  5092 raft_consensus.cc:2804] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:56.608106  5092 raft_consensus.cc:697] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:01:56.609531  1584 raft_consensus.cc:1240] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 6. Current term is 7. Ops: []
W20260709 13:01:56.609841  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 231470us
I20260709 13:01:56.621474  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:56.624380  1588 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:01:56.638953  1707 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:56.641453  2424 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:01:56.642916  1558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.596319  5001 raft_consensus.cc:2749] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:56.648020  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:56.601902  5039 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:56.651144  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:56.638489  1556 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:56.601477  5175 raft_consensus.cc:2804] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:56.659495  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:56.603219  5154 raft_consensus.cc:2804] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:01:56.658931  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 54256.9us
I20260709 13:01:56.665982  1707 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:01:56.671799  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 126822us
W20260709 13:01:56.676472  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 44795.2us
W20260709 13:01:56.664960  1558 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:32843 timed out after 1.739s (SENT) [suppressed 5 similar messages]
I20260709 13:01:56.651340  5104 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:56.678490  1556 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:56.648337  5184 raft_consensus.cc:2749] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:56.665261  5154 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:56.664844  5175 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:56.644066  5060 consensus_queue.cc:1048] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:01:56.677493  5061 raft_consensus.cc:2804] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:01:56.697218  1633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.680770  5126 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:01:56.703385  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 44126.6us
I20260709 13:01:56.685245  5012 raft_consensus.cc:2749] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:56.688272  5124 raft_consensus.cc:2804] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:56.692880  5154 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:56.701968  5061 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:56.722961  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:56.692044  5175 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:56.707548  5126 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:56.726375  5063 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:56.734783  5180 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:56.740366  2515 raft_consensus.cc:1240] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:56.727375  5061 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:56.746181  5186 log.cc:927] Time spent T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:01:56.717240  5124 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
W20260709 13:01:56.780722  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 98745.4us
I20260709 13:01:56.690011  5149 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:56.680626  5092 consensus_queue.cc:237] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:56.760210  5158 consensus_queue.cc:1048] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:56.760905  5107 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:01:56.764134  5185 log.cc:927] Time spent T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:01:56.767153  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.767949  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.768661  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.769464  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.771524  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.773520  1707 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:56.773762  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.774399  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.775527  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.752784  5180 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:56.792327  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.778126  5063 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:56.778541  5095 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 12 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:56.753463  5126 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:56.783232  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 118287us
I20260709 13:01:56.795277  1704 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 6d4de2ce0683442498244b9529127f91
W20260709 13:01:56.784476  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 81990.2us
I20260709 13:01:56.787312  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.790762  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.794158  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:01:56.784117  5124 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:56.800019  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.800788  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.804733  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.805401  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.805979  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.803632  1707 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:56.796166  5177 raft_consensus.cc:2804] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:56.807359  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.809355  5177 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:56.809729  5063 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:56.809909  5177 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:56.796353  5176 raft_consensus.cc:2749] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:56.794155  5180 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:56.830454  5063 consensus_queue.cc:1059] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:56.835929  5012 raft_consensus.cc:2749] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:56.835625  5038 consensus_queue.cc:1059] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:56.837142  5038 raft_consensus.cc:3055] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:56.837544  5038 raft_consensus.cc:740] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:56.838630  5065 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:56.838781  5038 consensus_queue.cc:260] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:56.840605  5012 consensus_queue.cc:1059] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:56.842856  5197 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:56.843442  5197 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:56.844067  5104 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:56.845814  5149 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:56.845858  5197 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:56.850059  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.844067  5175 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:56.852627  5060 consensus_queue.cc:1048] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:56.863502  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.864303  1707 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:56.871006  5065 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:56.871703  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:56.872329  1662 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:56.872036  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:56.835600  5126 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:56.876508  5202 raft_consensus.cc:2749] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:56.856299  5175 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:56.876674  5176 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:56.889323  5176 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:56.891702  5176 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:56.888156  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.892581  1592 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 8.
I20260709 13:01:56.897421  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:56.905750  5176 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:56.911168  1633 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:56.923472  5124 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:56.925619  1558 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:56.926342  5135 raft_consensus.cc:3055] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:56.926744  5135 raft_consensus.cc:740] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:56.926780  5060 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:56.927736  5135 consensus_queue.cc:260] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:01:56.929342  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.933933  5038 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:56.935421  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.914986  1707 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:56.908473  5176 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:56.946807  1662 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 10.
I20260709 13:01:56.928936  5135 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:56.947032  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 139030us
I20260709 13:01:56.949362  2424 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:01:56.959381  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:01:56.961639  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 53275.3us
I20260709 13:01:56.958878  5198 consensus_queue.cc:1059] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:01:56.914285  2523 raft_consensus.cc:2468] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:01:56.952648  5012 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:56.970587  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:56.991683  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:56.991998  1660 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:01:56.992309  1666 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:01:56.976379  5158 raft_consensus.cc:2955] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index 5 to 6, VOTER 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:56.956176  5104 raft_consensus.cc:2804] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:56.993153  5104 raft_consensus.cc:697] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:01:56.992901  2523 raft_consensus.cc:2955] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, VOTER 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:56.994206  5104 consensus_queue.cc:237] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:56.904444  5154 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:56.997363  2543 raft_consensus.cc:1240] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:56.899237  5061 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:56.999060  5063 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:56.999660  1633 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:56.999620  5063 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:57.000279  5176 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:56.982206  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:56.952541  5083 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:57.001273  5107 raft_consensus.cc:2749] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:57.002274  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:57.004297  1633 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:56.991447  1555 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:01:57.005501  4991 raft_consensus.cc:2749] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:57.005493  1558 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:57.006579  5154 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 8 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:57.006860  5063 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:57.009104  5176 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:01:57.000075  5061 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:57.009706  5176 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:56.987394  5180 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:57.011528  5198 raft_consensus.cc:3055] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:57.011904  5198 raft_consensus.cc:740] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:57.012310  5060 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:57.012815  5198 consensus_queue.cc:260] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:57.014281  5115 raft_consensus.cc:2804] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:57.014297  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:57.014976  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:57.016297  1667 raft_consensus.cc:1275] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:01:57.016776  5177 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:57.016324  1586 raft_consensus.cc:1275] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:01:57.017702  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.020656  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:57.020932  5177 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:57.025463  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:01:57.024013  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 66979.9us
I20260709 13:01:57.030277  1705 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:57.030927  1633 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:57.041332  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:57.042960  1633 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:57.046227  4991 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:57.047053  5177 raft_consensus.cc:2749] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:57.025568  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:01:57.048190  1705 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:57.050875  1705 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:57.044354  1633 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:57.052925  1633 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:57.054344  1633 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:57.056602  1666 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:01:57.021049  5124 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:57.011868  5180 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:57.030138  5176 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:57.029371  5115 raft_consensus.cc:697] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:57.038022  5083 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:57.065536  5107 raft_consensus.cc:2749] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:57.055285  5163 raft_consensus.cc:2804] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:57.076227  5163 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:57.076637  5163 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:57.062337  5012 raft_consensus.cc:2749] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:57.079587  2537 raft_consensus.cc:1240] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 LEADER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:57.082799   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:57.058073  5063 raft_consensus.cc:2804] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:57.084573  5063 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:01:57.072613  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 67205.7us
I20260709 13:01:57.085110  5063 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:57.060317  5116 consensus_queue.cc:1048] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:01:57.075124  5115 consensus_queue.cc:237] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:57.058094  5197 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:57.090973  5197 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:57.091421  5197 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:57.059300  4991 raft_consensus.cc:2804] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:57.093501  4991 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.093899  4991 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:57.094615  5198 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:57.103322  5038 consensus_queue.cc:1059] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:57.104241  5038 consensus_queue.cc:1243] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer 7e839e91a1314c2f9a99b25b17c916a6 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:01:57.104765  5177 raft_consensus.cc:3055] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:57.118875  1705 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:57.121434  5154 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:57.122027  5154 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:57.123199  1558 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:57.060529  5060 consensus_queue.cc:1059] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:01:57.127866  5012 raft_consensus.cc:2749] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:57.128219  5154 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:57.128355  5005 raft_consensus.cc:2749] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:57.137049  2543 raft_consensus.cc:1240] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 LEADER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:57.138382  1558 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:57.139446  5124 raft_consensus.cc:2749] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:57.130512  5126 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:57.140636  5005 raft_consensus.cc:3055] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:57.141157  5005 raft_consensus.cc:740] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:57.141996  5005 consensus_queue.cc:260] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:57.112497  5177 raft_consensus.cc:740] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:57.118125  5180 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:57.140014  5012 consensus_queue.cc:1059] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:57.144742  2424 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:57.144794  1705 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:01:57.143260  5005 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:57.150854  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:57.150919  5012 consensus_queue.cc:1243] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer 7e839e91a1314c2f9a99b25b17c916a6 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:01:57.153198  5206 raft_consensus.cc:2804] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:57.153645  5206 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:57.154008  5206 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:57.158190  1705 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:01:57.147006  5154 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:57.138829  5197 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:57.149762  5180 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:57.161823  5012 raft_consensus.cc:2804] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:57.162290  5001 raft_consensus.cc:3055] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:57.162559  5012 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:57.162714  5001 raft_consensus.cc:740] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:57.163105  5012 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:57.163741  5001 consensus_queue.cc:260] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:57.165035  5001 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:57.168059  5063 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:57.171271  5180 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:57.172214  5206 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:57.175853  5063 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:57.178858  5177 consensus_queue.cc:260] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:57.186305  1705 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:01:57.148325  5163 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:57.177263  5012 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:57.190121  5163 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:57.189878  4991 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:57.190716  5012 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:57.191920  4991 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:57.204355  5012 raft_consensus.cc:2804] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:57.209882  5012 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:57.210382  5012 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:57.217744  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 163429us
I20260709 13:01:57.204780  5177 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:57.220294  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:57.204718  5206 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:57.222121  1662 raft_consensus.cc:2410] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:01:57.224409  1558 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:57.230847  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:57.231638  1664 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5.
I20260709 13:01:57.232559  1660 raft_consensus.cc:1240] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:57.233670  5126 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:57.234338  5209 log.cc:927] Time spent T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:01:57.234579  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:57.235390  5198 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:57.235641  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:57.235929  5198 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:57.235390  1667 raft_consensus.cc:2393] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 10: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:01:57.238201  5198 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:57.240010  1558 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:57.240788  5126 raft_consensus.cc:2749] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:57.246306  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.259045  1558 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:57.262763  5197 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:57.264245  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:57.262619  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:57.280429  5158 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:59092 (request call id 80) took 1106 ms. Trace:
I20260709 13:01:57.281322  5158 rpcz_store.cc:276] 0709 13:01:56.151821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.153142 (+  1321us) service_pool.cc:224] Handling call
0709 13:01:56.267118 (+113976us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b2c00000658. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7f888a11 00007f1b7f897a0a 00007f1b7f897693 00007f1b7f897631 00007f1b80fca902 00007f1b80fca6dd 00007f1b80f95f3f 00007f1b80f956b3 00007f1b80f8d9fa 00007f1b85f554c9 00007f1b7f4d1c54
0709 13:01:56.326875 (+ 59757us) log.cc:844] Serialized 501 byte log entry
0709 13:01:56.763435 (+436560us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b4400022b4c. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7ddc8c85 00007f1b7ddc96a2 00007f1b80b3b1db 00007f1b80b36aaf 00007f1b80b2a86e 00007f1b80b29bb6 00007f1b80b297d8 00007f1b80b33221 00007f1b80b331d9 00007f1b80b33169
0709 13:01:57.256497 (+493062us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9568,"raft.run_cpu_time_us":1124,"raft.run_wall_time_us":1136,"spinlock_wait_cycles":8584832,"thread_start_us":167077,"threads_started":1,"wal-append.queue_time_us":282422}
I20260709 13:01:57.285696  1477 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ae1310c9ee464797a39b786c1d932941 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:57.286975  5001 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:57.287401  1586 raft_consensus.cc:1275] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:57.287591  5001 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:57.289539  5116 consensus_queue.cc:1048] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:57.290365  5001 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:57.276903  5012 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:57.300364  5012 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:01:57.303066  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 44102.5us
I20260709 13:01:57.303980  5210 raft_consensus.cc:2804] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:57.305552  5210 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:57.306128  5210 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:57.309962  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:01:57.310016  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 115625us
I20260709 13:01:57.310774  1733 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:57.312041  1558 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:57.317221  1558 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:57.319659  1558 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:57.329517  1558 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:57.327433  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:57.345528  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:57.336081  1558 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:57.352726  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:57.355168  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:57.363744  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:57.364427  1736 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:57.334728  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:57.363590  5163 raft_consensus.cc:2749] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:57.369683  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:57.373865  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:57.342412  5012 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:57.327486  5158 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:57.335438  5124 raft_consensus.cc:2749] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:57.342660  5115 raft_consensus.cc:2749] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:57.390787  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 54768.3us
I20260709 13:01:57.391796  1558 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:57.383036  1556 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:57.392565  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:57.399848  1737 raft_consensus.cc:1275] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:57.369056  5001 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:57.417742  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:57.418655  1659 raft_consensus.cc:2393] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 8: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:01:57.419358  1556 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:57.423309  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:57.421452  1707 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:57.424487  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:57.390324  5213 raft_consensus.cc:2749] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:57.390554  5158 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:57.435392  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:57.399473  5012 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:57.431262  1707 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:57.432796  1735 raft_consensus.cc:2393] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 8: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:01:57.417906  5178 raft_consensus.cc:2804] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:57.438745  1707 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:57.420308  5005 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:57.436969  5197 raft_consensus.cc:2749] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:57.448339  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:57.448372  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:57.449431  1740 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:01:57.449618  2426 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:57.439642  5158 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:57.419179  5001 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:57.443771  5038 raft_consensus.cc:2804] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:01:57.465865  1558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.441898  5178 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:57.468039  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:57.449193  5180 raft_consensus.cc:2804] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:57.448518  5124 raft_consensus.cc:2749] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:01:57.472079  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 52767.5us
I20260709 13:01:57.488967  1734 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 7.
W20260709 13:01:57.477208  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.466341  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:57.461627  5065 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:57.469070  5038 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.504597  1660 raft_consensus.cc:1240] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:57.490613  5178 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:57.490922  5180 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:57.461946  5092 consensus_queue.cc:1048] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:01:57.513986  1661 raft_consensus.cc:1275] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:57.508469  5038 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:57.521234  1556 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:57.524235  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:57.522964  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:57.521970  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:57.526973  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:57.527558  1659 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:57.530778  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:57.531016  4869 consensus_queue.cc:1048] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:57.531489  1739 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:01:57.532697  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:57.533162  4869 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:57.535286  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:57.541531  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:57.545420  1732 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 10.
I20260709 13:01:57.546619  1736 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 8.
I20260709 13:01:57.547430  1741 raft_consensus.cc:1240] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:57.542039  5001 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:57.550961  1733 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 12.
I20260709 13:01:57.559501  1659 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
I20260709 13:01:57.559525  2426 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:57.563889  5012 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:01:57.565665  5223 log.cc:927] Time spent T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:01:57.566694  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:57.579734  1490 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51168 (request call id 131) took 4388 ms. Trace:
I20260709 13:01:57.580188  1490 rpcz_store.cc:276] 0709 13:01:53.242290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.251468 (+  9178us) service_pool.cc:224] Handling call
0709 13:01:57.579503 (+4328035us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8329,"reported_tablets":1}
W20260709 13:01:57.582145  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 54295.7us
I20260709 13:01:57.583305  1486 catalog_manager.cc:5697] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 10 to 11, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:57.584872  1489 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55154 (request call id 304) took 4806 ms. Trace:
I20260709 13:01:57.586280  1737 raft_consensus.cc:1275] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:57.516860  5180 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:57.586467  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 58845.5us
I20260709 13:01:57.598765  5116 raft_consensus.cc:2804] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:57.599532  5116 raft_consensus.cc:697] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:01:57.602291  5065 consensus_queue.cc:1048] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:57.681753  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:57.687078  1734 raft_consensus.cc:1275] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:57.586265  1489 rpcz_store.cc:276] 0709 13:01:52.778859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.779079 (+   220us) service_pool.cc:224] Handling call
0709 13:01:57.584811 (+4805732us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:56.732469 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:56.747797 (+ 15328us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:56.747850 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:01:56.747871 (+    21us) tablet.cc:662] Decoding operations
0709 13:01:56.748762 (+   891us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:56.748853 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:56.748888 (+    35us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:01:56.759893 (+ 11005us) tablet.cc:701] Row locks acquired
0709 13:01:56.759962 (+    69us) write_op.cc:260] PREPARE: finished
0709 13:01:56.760148 (+   186us) write_op.cc:270] Start()
0709 13:01:56.760319 (+   171us) write_op.cc:276] Timestamp: P: 1783602116760068 usec, L: 0
0709 13:01:56.760363 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 13:01:56.808832 (+ 48469us) log.cc:844] Serialized 2085 byte log entry
0709 13:01:56.922483 (+113651us) spinlock_profiling.cc:243] Waited 21.9 ms on lock 0x7b5400119254. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8ae28 00007f1b849c5581 00007f1b849c4d58 00007f1b849c99f1 00007f1b849c99a9 00007f1b849c9939 00007f1b849c9901 00007f1b849c8b2d 000000000038f354 000000000038f199
0709 13:01:57.142711 (+220228us) spinlock_profiling.cc:243] Waited 5.11 ms on lock 0x7b54001190a8. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b8734b9e1 00007f1b8734a64c 00007f1b849c63bb 00007f1b849c871a 00007f1b849c86a8 00007f1b849c8628 00007f1b849c85e3 00007f1b849c77fc 00007f1b86dfa626 00007f1b86df4dd8 00007f1b80f9b310
0709 13:01:57.142925 (+   214us) op_driver.cc:464] REPLICATION: finished
0709 13:01:57.443207 (+300282us) write_op.cc:301] APPLY: starting
0709 13:01:57.458657 (+ 15450us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:57.498741 (+ 40084us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:57.507504 (+  8763us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:57.557180 (+ 49676us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:57.557744 (+   564us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:01:57.557830 (+    86us) write_op.cc:312] APPLY: finished
0709 13:01:57.558243 (+   413us) log.cc:844] Serialized 47 byte log entry
0709 13:01:57.558462 (+   219us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:57.558567 (+   105us) write_op.cc:454] Released schema lock
0709 13:01:57.558676 (+   109us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:57.559119 (+   443us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:57.559145 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":606549,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":269787,"apply.run_cpu_time_us":4182,"apply.run_wall_time_us":134483,"num_ops":5,"prepare.queue_time_us":398588,"prepare.run_cpu_time_us":19840,"prepare.run_wall_time_us":221009,"raft.queue_time_us":198735,"raft.run_cpu_time_us":63993,"raft.run_wall_time_us":264235,"replication_time_us":341034,"spinlock_wait_cycles":62133248,"thread_start_us":486028,"threads_started":4,"wal-append.queue_time_us":79865}]]}
W20260709 13:01:57.691601  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 170467us
I20260709 13:01:57.692415  1556 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:57.693380  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:57.693760  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:57.694123  1591 raft_consensus.cc:2393] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 8: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:01:57.705935  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:57.709614  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:57.710311  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:57.710461  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:57.711933  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:57.717399  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:57.719290  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:57.720712  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:57.721215  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:57.722050  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:57.715483  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:57.658381  5104 consensus_queue.cc:1048] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:01:57.729398  1589 raft_consensus.cc:1240] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:57.728271  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:57.730176  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:57.731949  1589 raft_consensus.cc:1240] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:57.733621  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:57.708088  5124 raft_consensus.cc:2804] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:57.741863  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:57.720829  2523 raft_consensus.cc:1275] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:57.741989  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:57.746316  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:57.745097  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:57.758586  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:57.777781  1666 raft_consensus.cc:1240] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:57.793900  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:57.690900  5116 consensus_queue.cc:237] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:57.805954  5210 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:57.808377  5210 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:57.774209  5124 raft_consensus.cc:697] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:57.810048  5124 consensus_queue.cc:237] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:57.815356  5038 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:57.819326  5092 consensus_queue.cc:1048] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:01:57.820789  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 45072.4us
I20260709 13:01:57.823760  1705 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:57.809160  1586 raft_consensus.cc:2393] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 7: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:01:57.825030  1705 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:57.827795  1707 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:57.840431  5197 raft_consensus.cc:2804] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:57.845347  1705 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:57.852156  1737 consensus_queue.cc:237] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:57.855705  1734 raft_consensus.cc:1240] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:57.856698  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:57.857786  1740 raft_consensus.cc:1240] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:57.857937  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:57.858603  1734 raft_consensus.cc:2468] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 3.
I20260709 13:01:57.858860  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:57.859336  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:57.860098  1740 raft_consensus.cc:1240] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:57.860814  1738 raft_consensus.cc:1240] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:57.862210  1739 raft_consensus.cc:1240] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:57.862900  5206 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:57.863838  5038 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:57.864459  5178 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:57.865599  1583 raft_consensus.cc:1240] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:57.866689  5178 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:57.868852  5228 consensus_queue.cc:1048] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:57.869330  5001 raft_consensus.cc:2749] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:57.872267  5233 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.872897  5233 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:57.875198  5233 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:57.878104  1735 raft_consensus.cc:1240] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:57.879477  5158 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:57.840958  5197 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.885782  5197 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:57.891011  5180 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:57.892202  1585 raft_consensus.cc:2393] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 11: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:01:57.896678  1740 raft_consensus.cc:1240] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:57.897905  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:57.906613  1666 raft_consensus.cc:2468] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 3.
I20260709 13:01:57.846383  1707 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:01:57.909397  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 63078.4us
I20260709 13:01:57.910732  1707 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:01:57.899576  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 62461.9us
I20260709 13:01:57.915196  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:57.917546  1705 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:57.921240  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:57.921981  1735 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 8.
I20260709 13:01:57.925747  2424 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:01:57.927501  1705 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:01:57.923825  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 90522.3us
I20260709 13:01:57.933825  1707 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:57.935698  1707 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:57.912138  5202 raft_consensus.cc:2749] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:01:57.948478  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 224702us
I20260709 13:01:57.920145  4991 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:01:57.964232  1558 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:57.965037  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:57.965644  1738 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:57.951375  1705 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:57.929711  5038 raft_consensus.cc:2749] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:57.936785  5206 raft_consensus.cc:2749] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:57.940196  5012 raft_consensus.cc:2749] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:57.968585  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 62677us
I20260709 13:01:57.974481  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:57.953133  5198 raft_consensus.cc:2749] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:57.978582  1739 raft_consensus.cc:2393] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 10: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:01:57.979610  1734 raft_consensus.cc:1240] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:57.990134  4869 raft_consensus.cc:2804] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:57.990686  4869 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:57.991079  4869 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:58.001658  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 48082.9us
I20260709 13:01:58.002561  1558 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:58.003903  1558 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:58.004528  5115 raft_consensus.cc:2749] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:58.005330  5210 raft_consensus.cc:2749] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:58.007241  1667 raft_consensus.cc:1240] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:58.013952  5180 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:58.017798  1558 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:57.970845  5158 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:58.019462  5178 raft_consensus.cc:2804] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:58.019889  5178 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:58.020180  1585 raft_consensus.cc:1240] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:01:58.020408  5178 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:57.969460  4991 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:58.021858  1659 raft_consensus.cc:3060] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:58.023033  4991 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:57.985846  5154 raft_consensus.cc:2804] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:58.024719  5154 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.025120  5154 raft_consensus.cc:3060] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:58.025374  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:58.027199  1558 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:58.028878  5210 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:58.029162  1659 raft_consensus.cc:1275] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:57.970587  5176 raft_consensus.cc:2749] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:58.032377  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:58.034621  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:58.035827  4869 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:58.037135  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:58.040756  1661 raft_consensus.cc:1240] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:58.041983  1740 raft_consensus.cc:1240] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:58.042541  5236 consensus_queue.cc:1059] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:58.043572  5225 raft_consensus.cc:3055] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:58.043949  5225 raft_consensus.cc:740] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:58.044087  5236 consensus_queue.cc:1059] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:58.045269  5210 raft_consensus.cc:3055] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:58.045665  5210 raft_consensus.cc:740] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:58.046002  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:58.046495  5210 consensus_queue.cc:260] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:58.047621  5197 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:01:58.048992  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.050987  1584 raft_consensus.cc:1240] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:58.051328  5210 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:58.054575  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:58.055454  1586 raft_consensus.cc:2393] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 8: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:01:58.061753  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:58.053454  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:58.062476  1590 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:58.067834  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 144137us
W20260709 13:01:58.071272  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 101333us
I20260709 13:01:58.106592  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:58.113255  5228 consensus_queue.cc:1059] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:58.117429  5213 raft_consensus.cc:3055] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:58.117985  5213 raft_consensus.cc:740] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:58.070113  1633 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:58.119120  5213 consensus_queue.cc:260] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:01:58.123422  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 56582.5us
I20260709 13:01:58.069132  1585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:58.125048  1585 raft_consensus.cc:606] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:58.130240  1738 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:01:58.131278  1732 raft_consensus.cc:1240] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:58.044828  5225 consensus_queue.cc:260] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:58.101465  5202 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:58.125573  1664 raft_consensus.cc:2955] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, VOTER 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:58.103202  5060 consensus_queue.cc:1059] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:01:58.066411  5236 consensus_queue.cc:1059] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:01:58.125051  4869 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:58.148749  5245 raft_consensus.cc:2804] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:58.149253  5245 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:58.149626  5245 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:58.151109  5064 consensus_queue.cc:1048] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
W20260709 13:01:58.162047  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.170204  5064 consensus_queue.cc:1059] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:58.170958  5206 consensus_queue.cc:1059] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:58.171571  5228 raft_consensus.cc:3055] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:01:58.183058  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 44952.9us
I20260709 13:01:58.181185  1705 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:01:58.172001  5228 raft_consensus.cc:740] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:58.139036  5227 consensus_queue.cc:1059] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
W20260709 13:01:58.202921  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 65459.3us
W20260709 13:01:58.205271  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 135218us
W20260709 13:01:58.225925  5244 log.cc:927] Time spent T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:01:58.229557  2543 raft_consensus.cc:1275] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:58.231272  5005 raft_consensus.cc:993] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:58.231833  5005 raft_consensus.cc:1081] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Signalling peer 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:58.179991  5213 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:58.234737  5197 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:58.173513  5178 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:58.237502  1661 raft_consensus.cc:1275] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:01:58.238965  1661 pending_rounds.cc:85] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 10
I20260709 13:01:58.239116  1590 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
I20260709 13:01:58.217393  1558 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
W20260709 13:01:58.204913  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 269307us
I20260709 13:01:58.246440  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:58.246654  1707 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:58.244567  1633 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:58.221329  5198 raft_consensus.cc:3055] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:58.239248  1661 pending_rounds.cc:107] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:01:58.252615  1661 raft_consensus.cc:2889] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:58.247846  1707 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:58.249375  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:58.253648  4991 raft_consensus.cc:2749] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:58.250308  1740 raft_consensus.cc:1240] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:58.257730  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:58.258940  5038 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:58.251662  1633 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:58.260157  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:58.260769  1737 raft_consensus.cc:2468] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 4.
I20260709 13:01:58.250696  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:58.223980  5203 raft_consensus.cc:2804] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:58.266871  5257 raft_consensus.cc:2804] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:58.267160  5203 raft_consensus.cc:697] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:58.267218  5225 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:58.268222  5203 consensus_queue.cc:237] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:58.271167  1633 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:58.274452  1633 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:58.221657  5163 consensus_queue.cc:1059] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:01:58.251333  5001 raft_consensus.cc:2749] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:58.265379  5206 raft_consensus.cc:2749] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:58.269954  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:01:58.252204  5198 raft_consensus.cc:740] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:58.354167  1707 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:58.302942  4991 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:58.259595  5154 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:58.247334  5012 consensus_queue.cc:1048] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 13:01:58.362004  5154 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 5 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:58.363250  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 88909.2us
I20260709 13:01:58.364094  1633 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:58.365283  1633 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:58.334944  5115 consensus_queue.cc:1059] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:01:58.366981  4991 raft_consensus.cc:2749] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:58.367369  2537 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:58.367642  4991 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:58.368296  4991 raft_consensus.cc:2749] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:58.340847  1741 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:43678
I20260709 13:01:58.370098  1741 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:58.370574  1741 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:58.388644  1633 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:01:58.389525  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 85992.2us
I20260709 13:01:58.393632  1707 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:58.374352  5180 consensus_queue.cc:1059] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:01:58.395855  4991 raft_consensus.cc:2749] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:58.396409  1633 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:58.379185  5012 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:58.350126  5228 consensus_queue.cc:260] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:58.409003  2537 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:01:58.411670  5228 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:58.414099  1633 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:58.403800  5178 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:58.422583  1707 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:58.423835  1633 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:01:58.422379  5241 log.cc:927] Time spent T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:01:58.425808  4991 raft_consensus.cc:2749] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:58.418431  5038 consensus_queue.cc:1059] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:01:58.428085  5230 raft_consensus.cc:3055] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:58.428464  5214 raft_consensus.cc:2749] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:58.429612  5256 raft_consensus.cc:2749] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:58.430019  5262 raft_consensus.cc:2749] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:58.436858  5154 consensus_queue.cc:1048] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:58.439743  4869 raft_consensus.cc:3055] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:58.440177  4869 raft_consensus.cc:740] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:58.428506  5230 raft_consensus.cc:740] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:58.422911  1741 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:58.444880  5230 consensus_queue.cc:260] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:58.442490  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:58.446470  1667 raft_consensus.cc:3060] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:01:58.447146  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 44459.5us
I20260709 13:01:58.447954  1741 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:01:58.451318  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 168712us
I20260709 13:01:58.451654  1633 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:58.445796  5001 raft_consensus.cc:2749] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:58.458202  5176 raft_consensus.cc:3055] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:58.450973  5245 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:58.459275  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:58.459826  1738 raft_consensus.cc:3060] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:58.463613  1733 raft_consensus.cc:1275] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:58.458739  5176 raft_consensus.cc:740] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:58.481212  1558 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:58.456588  1633 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:58.482437  1738 raft_consensus.cc:2468] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 5.
I20260709 13:01:58.483915  5257 raft_consensus.cc:697] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:58.484361  1633 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:58.464412  5253 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:58.440917  4869 consensus_queue.cc:260] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:58.493265  4869 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:58.497924  1665 raft_consensus.cc:1275] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:58.498834  5202 raft_consensus.cc:3055] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:58.499258  5202 raft_consensus.cc:740] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:58.499528  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:58.500146  5202 consensus_queue.cc:260] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:58.484413  5230 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:58.458248  5267 raft_consensus.cc:2749] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:58.513434  1707 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:58.491925  1590 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67b5a70a2de54935b60554301e6de808"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
 from {username='slave'} at 127.0.0.1:47714
W20260709 13:01:58.515898  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.527524  1590 raft_consensus.cc:606] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Received request to transfer leadership to TS 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:01:58.531337  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 47066.6us
I20260709 13:01:58.532415  1633 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:58.533160  1707 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:58.516858  1667 raft_consensus.cc:2468] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 5.
I20260709 13:01:58.523126  5245 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:58.513513  5262 raft_consensus.cc:2749] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:58.525789  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 44693.6us
I20260709 13:01:58.534731  1707 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:58.539048  1558 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:58.536211  2424 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:01:58.538113  1633 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:58.543706  1633 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:58.547997  1558 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:58.528245  5158 raft_consensus.cc:2749] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:58.560295  5124 raft_consensus.cc:3055] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:58.560835  5124 raft_consensus.cc:740] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:58.561895  5124 consensus_queue.cc:260] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:58.536837  5256 raft_consensus.cc:2749] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:58.551303  5245 raft_consensus.cc:2749] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:58.553148  5265 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:58.553773  5176 consensus_queue.cc:260] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:58.536777  5180 raft_consensus.cc:2749] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:58.536509  5203 raft_consensus.cc:2749] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:58.572410  1707 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:58.573012  5001 raft_consensus.cc:2749] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:58.561120  5270 consensus_queue.cc:1048] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:01:58.573362  5224 raft_consensus.cc:3055] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:58.539391  5214 raft_consensus.cc:2749] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:58.545856  5267 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:58.546586  5202 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:58.544525  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:01:58.536564  5233 consensus_queue.cc:1048] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
W20260709 13:01:58.598263  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.594705  5227 raft_consensus.cc:2749] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:58.563387  5124 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:58.607702  5176 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:58.607700  1585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:58.608635  1737 raft_consensus.cc:1240] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:58.610697  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:58.623451  1585 raft_consensus.cc:606] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:58.620075  1735 raft_consensus.cc:1240] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:58.623819  1585 raft_consensus.cc:614] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:58.573632  5263 consensus_queue.cc:1059] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:01:58.604095  5224 raft_consensus.cc:740] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:58.603914  5038 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:58.567286  5257 consensus_queue.cc:237] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:58.633517  5246 raft_consensus.cc:2804] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:01:58.645766  5272 log.cc:927] Time spent T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:01:58.647567  1738 raft_consensus.cc:1275] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:58.658097  5263 raft_consensus.cc:3055] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:58.658669  5263 raft_consensus.cc:740] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:58.661216  5197 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:58.661770  5197 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:58.664551  5197 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:58.611347  5225 consensus_queue.cc:1059] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:01:58.686657  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:58.687300  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:58.687749  1585 raft_consensus.cc:2393] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 10: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:01:58.687935  1584 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:58.656780  5253 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:58.692304  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:01:58.666307  5269 log.cc:927] Time spent T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:01:58.669421  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:58.670074  5203 raft_consensus.cc:2955] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:58.626981  5258 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:58.689051  1589 raft_consensus.cc:1240] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 10. Current term is 11. Ops: []
W20260709 13:01:58.691468  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 147819us
I20260709 13:01:58.726217  1633 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:58.692498  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:58.727228  1586 raft_consensus.cc:3055] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:01:58.727977  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 54140.9us
I20260709 13:01:58.729200  1589 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:58.727540  1586 raft_consensus.cc:740] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:58.730466  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:58.732580  1583 raft_consensus.cc:1275] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:58.729764  1589 raft_consensus.cc:606] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:58.685341  5246 raft_consensus.cc:697] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:01:58.738389  1633 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:58.739686  1633 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:58.740841  1633 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:58.733570  1586 consensus_queue.cc:260] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:58.746443  1586 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:58.738373  5267 raft_consensus.cc:2749] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:58.753485  1558 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:58.756742  5060 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:58.757313  5217 consensus_queue.cc:1048] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:58.744266  5245 raft_consensus.cc:2749] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:58.774699  1589 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:01:58.788823  1589 raft_consensus.cc:606] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:58.734498  5210 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.777180  1704 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:58.780031  5197 consensus_queue.cc:1048] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:58.781549  5224 consensus_queue.cc:260] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:58.728947  5258 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:58.812764  1586 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
I20260709 13:01:58.750808  5263 consensus_queue.cc:260] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:58.795260  1633 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:58.816290  1707 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:58.824626  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:58.825879  5245 raft_consensus.cc:2804] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:58.784821  5246 consensus_queue.cc:237] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:58.827632  5001 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:58.828198  5001 raft_consensus.cc:697] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:58.800431  5210 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:58.829739  1587 raft_consensus.cc:1240] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:58.829257  5202 consensus_queue.cc:1059] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:58.830015  1583 raft_consensus.cc:1240] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:58.830688  5202 raft_consensus.cc:3055] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:58.831045  5202 raft_consensus.cc:740] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:58.831950  5202 consensus_queue.cc:260] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:58.834084  1705 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:58.834728  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:58.836050  5180 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:58.836966  1587 raft_consensus.cc:1240] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:58.837608  5263 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:58.841166  5012 consensus_queue.cc:1175] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6d4de2ce0683442498244b9529127f91" responder_term: 11 status { last_received { term: 10 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:01:58.842983  1587 raft_consensus.cc:1275] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:58.845609  5258 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:58.845785  5228 consensus_queue.cc:1059] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:01:58.847858  5266 consensus_queue.cc:1048] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:58.848312  5224 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:58.849212  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:58.849833  5245 raft_consensus.cc:697] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
W20260709 13:01:58.850152  1633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.850800  5245 consensus_queue.cc:237] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:58.851496  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:58.851750  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:58.802282  5198 consensus_queue.cc:260] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:58.853330  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:58.853729  5198 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:58.853336  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:58.744096  5214 raft_consensus.cc:2749] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:58.855441  1659 raft_consensus.cc:2393] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 12: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:01:58.856627  1661 raft_consensus.cc:1240] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:58.857470  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:58.857673  1633 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:58.726269  5253 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:58.786118  2537 raft_consensus.cc:2955] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:58.858103  1662 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:58.750505  5262 raft_consensus.cc:2749] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:58.857767  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:58.861310  5253 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:58.854357  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:58.862051  1660 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:58.811298  5256 consensus_queue.cc:1059] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:58.863842   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:58.864848  5256 raft_consensus.cc:3055] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:58.872061  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:58.872459  5256 raft_consensus.cc:740] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:58.873435  5256 consensus_queue.cc:260] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:58.872851  2523 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:01:58.874811  5256 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:58.875864  1555 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:01:58.876668  5163 raft_consensus.cc:2804] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:58.877022  5163 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.877415  5163 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:58.885515  5227 raft_consensus.cc:993] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:58.886059  5227 raft_consensus.cc:1081] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:01:58.888710  5126 raft_consensus.cc:993] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91: : Instructing follower 7e839e91a1314c2f9a99b25b17c916a6 to start an election
I20260709 13:01:58.888268  5163 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:58.889737  5126 raft_consensus.cc:1081] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Signalling peer 7e839e91a1314c2f9a99b25b17c916a6 to start an election
I20260709 13:01:58.890619  5163 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:58.891002  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:01:58.893476  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 116463us
I20260709 13:01:58.872459  1584 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:01:58.898747  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:58.899379  1738 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:58.899288  1707 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:01:58.893534  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:01:58.905471  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 47894.8us
I20260709 13:01:58.908246  1633 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:01:58.829205  5001 consensus_queue.cc:237] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:58.921480  5262 raft_consensus.cc:2749] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:58.922967  5262 raft_consensus.cc:2804] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:58.923539  5262 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:58.924023  5262 raft_consensus.cc:3060] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:58.928308  1658 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39146
I20260709 13:01:58.929044  1658 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:58.929523  1658 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:58.933317  1633 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:58.934737  1633 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:58.903148  5253 raft_consensus.cc:2749] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:58.950979  1738 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:01:58.941874  1662 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
I20260709 13:01:58.965770  1586 raft_consensus.cc:1240] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:58.970675  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:01:58.971604  2553 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:58.959426  1558 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:58.866760  5210 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:58.926894  5266 raft_consensus.cc:2804] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:01:58.991639  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 262976us
I20260709 13:01:58.940124  5202 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:58.943184  5267 raft_consensus.cc:2749] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:58.945545  5214 raft_consensus.cc:2749] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:59.008344  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 71797.7us
I20260709 13:01:59.018559  1633 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:01:58.971340  2523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67b5a70a2de54935b60554301e6de808"
dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
 from {username='slave'} at 127.0.0.1:49222
I20260709 13:01:59.027678  1583 raft_consensus.cc:2955] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:58.991880  5257 raft_consensus.cc:2804] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:59.034636  5253 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:59.047700  1660 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
W20260709 13:01:59.086756  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.087217  2553 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:01:59.069507  5257 raft_consensus.cc:697] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:59.069041  5253 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:59.094002  5259 raft_consensus.cc:3055] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:59.093912  5257 consensus_queue.cc:237] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:59.095604  5253 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:59.094446  5259 raft_consensus.cc:740] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:59.069564  5267 raft_consensus.cc:2804] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:59.096415  5267 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:59.052353  4991 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:59.097289  4991 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:59.096820  5259 consensus_queue.cc:260] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:59.099324  5259 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:59.067868  5180 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:59.052096  2523 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:59.100497  2523 raft_consensus.cc:3060] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:59.096815  5267 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:59.099431  4991 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:59.109525  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:01:59.114089  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.116153  1658 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:59.124153  1658 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:01:59.124989  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 106516us
I20260709 13:01:59.126873  1633 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:59.090229  5266 raft_consensus.cc:697] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:01:59.114012  5203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:43674 (request call id 78) took 1498 ms. Trace:
I20260709 13:01:59.128803  5267 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:59.114012  2523 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:59.135540  5267 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:59.136386  2523 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 5 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:59.132201  5203 rpcz_store.cc:276] 0709 13:01:57.615254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.619682 (+  4428us) service_pool.cc:224] Handling call
0709 13:01:57.841746 (+222064us) spinlock_profiling.cc:243] Waited 4.8 ms on lock 0x7b5400409d20. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f06ec4 00007f1b80f8a8d7 00007f1b80f9603c 00007f1b80f956b3 00007f1b80f8d9fa 00007f1b85f554c9 00007f1b7f4d1c54 00007f1b7f4d1be2 00007f1b7f4d1b11 00007f1b7f4d1a8c
0709 13:01:57.854725 (+ 12979us) log.cc:844] Serialized 501 byte log entry
0709 13:01:58.150737 (+296012us) spinlock_profiling.cc:243] Waited 3.66 ms on lock 0x7b180030ea40. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7de1cc0a 00007f1b8755c219 00007f1b7dea4a40 00007f1b7de9f4e4 00007f1b7de9f455 00007f1b80ee8b0b 00007f1b80f6db63 00007f1b80f95752 00007f1b80f8d9fa
0709 13:01:59.113898 (+963161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83932,"raft.queue_time_us":112174,"raft.run_cpu_time_us":1602,"raft.run_wall_time_us":67668,"spinlock_wait_cycles":19453184,"thread_start_us":209418,"threads_started":1,"wal-append.queue_time_us":279480}
I20260709 13:01:59.140388  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:59.140380  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:59.142033  1738 raft_consensus.cc:3060] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:59.140852  5266 consensus_queue.cc:237] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:59.132174  4991 raft_consensus.cc:2749] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:59.144176  1586 raft_consensus.cc:3055] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:59.144546  1586 raft_consensus.cc:740] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:59.145306  1586 consensus_queue.cc:260] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:59.146545  1586 raft_consensus.cc:3060] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:59.148769  5262 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:59.173123  1738 raft_consensus.cc:2468] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 5.
I20260709 13:01:59.174686  2426 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:01:59.176057  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 44975.1us
I20260709 13:01:59.177066  1586 raft_consensus.cc:2468] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 5.
I20260709 13:01:59.183234  1633 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:59.183199  5289 consensus_queue.cc:1059] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:59.184653  1705 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:59.185912  5286 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:59.186139  5289 raft_consensus.cc:3055] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:59.186520  5289 raft_consensus.cc:740] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:59.187362  5289 consensus_queue.cc:260] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:59.188603  5289 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:59.195775  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:59.198941  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:59.199527  1583 raft_consensus.cc:3055] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:59.199821  1583 raft_consensus.cc:740] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:59.200659  1583 consensus_queue.cc:260] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:59.201615  1583 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:59.204157  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:59.204727  1738 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:59.208679  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:59.215400  1705 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:59.221243  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:59.179544  5233 raft_consensus.cc:2804] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:59.222225  1586 raft_consensus.cc:2393] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 8: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:01:59.219964  5266 raft_consensus.cc:2749] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:59.212001  4991 consensus_queue.cc:1059] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:01:59.245051  5228 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:59.245652  5228 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:59.248400  5228 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:59.241456  5262 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:59.226641  5233 raft_consensus.cc:697] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:01:59.244390  5163 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:59.251257  5163 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:59.251502  5233 consensus_queue.cc:237] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:59.254065  5163 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:59.256572  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:59.249791  1477 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2782217725024e159b9536d03808a3ea with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:59.265185  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:59.282652  1583 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 6.
I20260709 13:01:59.283552  1738 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 6.
I20260709 13:01:59.286248  1734 raft_consensus.cc:1240] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:59.225499  5290 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:59.290489  1739 raft_consensus.cc:1275] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:59.249691  5005 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:59.295953  1737 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 8.
I20260709 13:01:59.334268  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:59.334841  1633 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:59.295603  5005 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:59.336011  5262 raft_consensus.cc:3055] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:59.334429  5259 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.339653  1556 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:59.290234  5280 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:59.353545  5217 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.380475  5259 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:59.380975  5217 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:59.382287  5238 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:59.383003  5259 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:59.382815  5238 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:59.383131  5217 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:59.368014  1740 raft_consensus.cc:1275] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:59.377277  5262 raft_consensus.cc:740] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:59.384557  5262 consensus_queue.cc:260] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:59.385867  5262 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:59.386360  5238 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:59.387656  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:59.388281  1583 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 7.
I20260709 13:01:59.389321  2426 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:01:59.389544  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:01:59.369982  5198 consensus_meta.cc:287] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.516s	user 0.005s	sys 0.006s
I20260709 13:01:59.380100  5295 raft_consensus.cc:2749] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:59.392258  1633 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:59.391191  1740 raft_consensus.cc:2393] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 in current term 7: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:01:59.391664  4991 consensus_queue.cc:1059] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
W20260709 13:01:59.395663  5294 log.cc:927] Time spent T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:01:59.398727  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:59.405731  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:59.406510  1662 raft_consensus.cc:2393] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 7: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:01:59.407480  1732 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:01:59.414675  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:59.417622  1666 raft_consensus.cc:1275] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:59.390506  5064 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:59.422230  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:59.431121  5005 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:59.433406  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:59.434095  1662 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:01:59.434026  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:59.435448  5292 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:59.435842  1664 raft_consensus.cc:1240] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:59.436259  5292 raft_consensus.cc:697] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:59.394058  5277 raft_consensus.cc:2804] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:59.437326  5277 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:59.437769  5277 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:59.437500  5292 consensus_queue.cc:237] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:59.391321  5280 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:59.419341  5001 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:59.442440  5001 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:59.443336  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:01:59.444173  2537 raft_consensus.cc:2368] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 8. Current term is 9.
I20260709 13:01:59.444620  5001 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:59.400302  5286 consensus_queue.cc:1059] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:01:59.445961  5286 raft_consensus.cc:3055] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:59.417126  5236 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.446403  5286 raft_consensus.cc:740] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:59.446905  5236 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:59.447487  5286 consensus_queue.cc:260] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:59.449990  1630 leader_election.cc:400] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Vote denied by peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157) with higher term. Message: Invalid argument: T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 8. Current term is 9.
I20260709 13:01:59.450330  1630 leader_election.cc:403] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:59.451061  5267 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:01:59.446084  5280 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:01:59.392179  5238 consensus_queue.cc:1048] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:01:59.466315  1556 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:59.467645  5217 raft_consensus.cc:2804] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:59.468107  5217 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.468447  5217 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:59.471964  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:59.473896  5259 consensus_queue.cc:1059] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:59.475159  5177 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:59.475602  5259 raft_consensus.cc:3055] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:59.476004  5259 raft_consensus.cc:740] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:01:59.475728  5177 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:59.476327  5277 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:59.489370  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:59.490097  1664 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:01:59.393440  5289 consensus_queue.cc:1059] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.099s
I20260709 13:01:59.448861  5286 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:59.497221  1556 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:59.502609  1666 raft_consensus.cc:1275] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:59.507225  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:01:59.505961  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 94632.9us
I20260709 13:01:59.508744  1633 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:01:59.511337  5245 raft_consensus.cc:3055] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:59.511804  5245 raft_consensus.cc:740] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:59.512521  5245 consensus_queue.cc:260] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:59.513604  5245 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:59.529448  5298 log.cc:927] Time spent T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:01:59.476963  5259 consensus_queue.cc:260] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:59.531639  5259 raft_consensus.cc:3060] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:59.535081  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.521957  5116 consensus_queue.cc:1048] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:01:59.507807  5236 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:59.507001  5257 raft_consensus.cc:2804] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:59.539809  1633 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:01:59.554832  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:59.555498  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:59.554189  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:59.557921  1633 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:59.553534  1705 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:59.559324  1660 raft_consensus.cc:1275] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:01:59.564219  1740 raft_consensus.cc:2368] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 8. Current term is 9.
I20260709 13:01:59.538225  5295 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:59.550109  5257 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.561188  5280 raft_consensus.cc:2804] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:59.564941  5290 raft_consensus.cc:2749] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:59.577878  5206 consensus_queue.cc:1048] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:59.587870  1633 leader_election.cc:400] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 8. Current term is 9.
I20260709 13:01:59.566898  5292 raft_consensus.cc:2749] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:59.591444  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:59.592424  1660 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:01:59.571170  5177 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:59.597856  2537 raft_consensus.cc:1275] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:59.571885  5257 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:59.591112  5280 raft_consensus.cc:697] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 8 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:59.566567  5291 consensus_queue.cc:1048] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:01:59.611547  5227 consensus_queue.cc:1048] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:59.591617  5295 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:59.612931  5295 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:59.615178  5295 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:59.623025  1705 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:01:59.626044  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:59.626715  1583 raft_consensus.cc:2468] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 7.
I20260709 13:01:59.626799  1586 raft_consensus.cc:1240] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:59.611603  5280 consensus_queue.cc:237] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:59.632807  1633 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:01:59.637499  5217 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:59.639696  5217 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:59.630718   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:59.636648  5001 raft_consensus.cc:2804] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:59.648520  5001 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:01:59.649765  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:59.650609  1736 raft_consensus.cc:2393] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 7: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:01:59.636240  1488 catalog_manager.cc:5697] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 10 to 11, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 11 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:59.652032  1486 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55132 (request call id 305) took 2960 ms. Trace:
I20260709 13:01:59.653039  1488 catalog_manager.cc:5697] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: config changed from index 4 to 5, term changed from 4 to 5, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to <none>, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 5 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:01:59.654500  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:59.648978  5001 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:59.678547  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 45890.3us
I20260709 13:01:59.683020  1667 raft_consensus.cc:1275] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:01:59.652436  1486 rpcz_store.cc:276] 0709 13:01:56.701404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.710471 (+  9067us) service_pool.cc:224] Handling call
0709 13:01:59.651966 (+2941495us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:58.005675 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:58.006313 (+   638us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:58.006352 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:01:58.006371 (+    19us) tablet.cc:662] Decoding operations
0709 13:01:58.006725 (+   354us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:58.006800 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:58.006836 (+    36us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:01:58.007017 (+   181us) tablet.cc:701] Row locks acquired
0709 13:01:58.007037 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:01:58.007177 (+   140us) write_op.cc:270] Start()
0709 13:01:58.007300 (+   123us) write_op.cc:276] Timestamp: P: 1783602118007132 usec, L: 0
0709 13:01:58.007325 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:01:58.008013 (+   688us) log.cc:844] Serialized 536 byte log entry
0709 13:01:58.038165 (+ 30152us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b54001197a0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef9090 00007f1b80f066b8 00007f1b80f062fa 00007f1b80f8a965 00007f1b80f8ae09 00007f1b849c5581 00007f1b849c4d58 00007f1b849c99f1 00007f1b849c99a9 00007f1b849c9939 00007f1b849c9901
0709 13:01:58.218579 (+180414us) op_driver.cc:464] REPLICATION: finished
0709 13:01:58.528270 (+309691us) write_op.cc:301] APPLY: starting
0709 13:01:58.533055 (+  4785us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:58.543264 (+ 10209us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:58.545203 (+  1939us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:58.611926 (+ 66723us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:58.622885 (+ 10959us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:01:58.626231 (+  3346us) write_op.cc:312] APPLY: finished
0709 13:01:58.672068 (+ 45837us) log.cc:844] Serialized 23 byte log entry
0709 13:01:58.672266 (+   198us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:58.672351 (+    85us) write_op.cc:454] Released schema lock
0709 13:01:58.672389 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:58.672758 (+   369us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:58.672784 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9530,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":284473,"apply.run_cpu_time_us":2725,"apply.run_wall_time_us":166291,"num_ops":1,"prepare.queue_time_us":329641,"prepare.run_cpu_time_us":5211,"prepare.run_wall_time_us":32765,"replication_time_us":172331,"spinlock_wait_cycles":37203328,"thread_start_us":385004,"threads_started":2}]]}
I20260709 13:01:59.680800  5267 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157) with higher term. Message: Invalid argument: T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 8. Current term is 9.
I20260709 13:01:59.684284  5286 raft_consensus.cc:2804] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:59.718575  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:59.684038  5295 consensus_queue.cc:1059] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:01:59.693392  5177 consensus_queue.cc:1048] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:01:59.733068  4991 raft_consensus.cc:3055] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:59.733597  4991 raft_consensus.cc:740] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:01:59.710625  5286 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:01:59.741886  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 445915us
I20260709 13:01:59.752347  5277 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:59.725199  5038 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.752265  5001 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:59.764490  1586 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 7.
I20260709 13:01:59.766389  1558 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:59.769796  1558 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:59.745873  5286 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:59.772643  2426 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:01:59.771140  5260 raft_consensus.cc:2749] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:59.770798  5217 consensus_queue.cc:1048] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:01:59.782249  2523 raft_consensus.cc:1275] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:01:59.789987  1741 raft_consensus.cc:1275] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:01:59.791029  5310 log.cc:927] Time spent T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.061s	user 0.003s	sys 0.000s
I20260709 13:01:59.792750  5060 raft_consensus.cc:2804] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:59.793094  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:59.765544  5038 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:59.796161  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:59.742472  5257 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:59.797781  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:01:59.837451  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 64866.3us
I20260709 13:01:59.837958  1585 raft_consensus.cc:2393] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 6: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:01:59.801568  1584 raft_consensus.cc:1275] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:01:59.756431  5177 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:01:59.842877  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:59.827208  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:01:59.830392  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:59.831380  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:59.797387  1590 raft_consensus.cc:1275] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:01:59.797344  5307 log.cc:927] Time spent T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.067s	user 0.002s	sys 0.000s
I20260709 13:01:59.835723  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:59.843730  1732 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:59.845556  1586 raft_consensus.cc:2393] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 6: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:01:59.845814  1741 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:01:59.851724  1734 raft_consensus.cc:1275] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:59.852386  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:01:59.852564  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:01:59.853139  1737 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:01:59.853155  1738 raft_consensus.cc:2393] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 in current term 7: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:01:59.825954  5126 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.849243  5238 raft_consensus.cc:2804] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:59.858347  5238 raft_consensus.cc:697] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:01:59.859356  5238 consensus_queue.cc:237] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:59.862635  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:01:59.833405  5060 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:59.869838  1732 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:01:59.871367  1587 raft_consensus.cc:2368] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 7. Current term is 8.
I20260709 13:01:59.837064  5295 consensus_queue.cc:1048] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:01:59.853134  5001 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:01:59.869846  5060 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:59.847800  5177 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:59.899019  1588 raft_consensus.cc:1275] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:59.902582  4991 consensus_queue.cc:260] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:59.871305  5202 consensus_queue.cc:1048] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:01:59.918675  1667 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:01:59.924522  1707 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:01:59.926409  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:01:59.869642  5126 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:01:59.934114  5266 raft_consensus.cc:2749] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:59.934269  5260 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.937590  1558 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:01:59.956010  1558 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:01:59.939422  5260 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:00.015439  5260 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:59.957484  5230 consensus_queue.cc:1048] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:59.949618  5305 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:01:59.959930  1586 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:01:59.960512  5126 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:01:59.962764  5224 raft_consensus.cc:993] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:59.930051  5290 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.952304  5206 consensus_queue.cc:1048] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.058s
W20260709 13:02:00.026386  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 70466.3us
I20260709 13:01:59.965951  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:01:59.952152  5270 raft_consensus.cc:2749] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:59.972839  1590 raft_consensus.cc:1275] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:59.973091  1705 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
W20260709 13:02:00.031143  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 58142.2us
I20260709 13:02:00.031320  5224 raft_consensus.cc:1081] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Signalling peer 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:01:59.939874  5064 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.929486  5217 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.032472  5064 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:00.032699  5217 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:00.034641  5064 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:00.034927  5266 raft_consensus.cc:2804] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:59.952098  5001 consensus_queue.cc:1048] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:02:00.025925  5305 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:00.036891  1734 raft_consensus.cc:1275] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:59.998179  5203 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.038807  5305 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:00.038415  5203 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:01:59.998519  5198 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.040688  5198 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:00.034644  5217 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:00.027832  1664 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:02:00.041152  5203 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:00.006211  5252 consensus_queue.cc:1048] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:01:59.965235  4991 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:00.045720  5198 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:00.009243  5236 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.047084  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:00.047466  5236 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:00.049847  5236 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:00.051502  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:00.054492  5280 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:00.055100  5280 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:00.060743  5177 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:00.061841  5257 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:00.064924  5280 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:00.064944  5126 raft_consensus.cc:2804] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:00.086421  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:00.028240  1558 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
W20260709 13:02:00.138257  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 110151us
I20260709 13:02:00.140586  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:00.141023  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:00.141232  1736 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:02:00.142619  1707 leader_election.cc:400] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 7. Current term is 8.
I20260709 13:02:00.143039  1707 leader_election.cc:403] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:00.144045  1741 raft_consensus.cc:2393] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 12: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:00.029654  5290 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:00.127096  5126 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.179009  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:00.147768  5291 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.216675  1734 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 15.
I20260709 13:02:00.146751  5227 raft_consensus.cc:2804] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:00.219794  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:00.222074  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:00.246335  1585 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5.
I20260709 13:02:00.229985  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:00.240754  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:00.247622  1658 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:00.243256  1707 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:00.245716  1589 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
W20260709 13:02:00.241636  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 45870us
I20260709 13:02:00.249907  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:00.155449  5177 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:02:00.161487  5126 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:00.155794  5038 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:00.259320  5001 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:00.262400  5227 raft_consensus.cc:697] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:00.253355  5291 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:00.329593  5306 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.314013  5202 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.332326  5001 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:00.412132  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 73282.2us
I20260709 13:02:00.391069  5266 raft_consensus.cc:697] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:00.382211  5295 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:00.417402  5295 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:00.417634  5266 consensus_queue.cc:237] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:00.420181  5295 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:00.405993  5001 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:00.432915  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 424274us
I20260709 13:02:00.436203  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:00.436919  1662 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:02:00.437835  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:00.438432  1664 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:00.441613  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:00.442467  1659 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:02:00.443670  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:00.444484  1663 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:02:00.455247  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:00.456467  1667 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
W20260709 13:02:00.454002  5060 consensus_meta.cc:287] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.530s	user 0.012s	sys 0.000s
I20260709 13:02:00.383550  5306 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:00.383037  5238 consensus_queue.cc:1048] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:02:00.404379  5202 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:00.489140  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 314217us
I20260709 13:02:00.478292  5277 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:00.500501  1658 raft_consensus.cc:1275] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:00.527144  1664 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
W20260709 13:02:00.547437  5318 log.cc:927] Time spent T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
W20260709 13:02:00.549455  5323 log.cc:927] Time spent T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
W20260709 13:02:00.553759  5321 log.cc:927] Time spent T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:02:00.553907  5290 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:00.556892  5291 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:00.565426  5202 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:00.567564  5325 raft_consensus.cc:2955] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:02:00.572506  5280 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:00.573194  5280 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:00.575217  5280 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:00.575784  5001 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:00.478523  5060 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:00.582831  5177 raft_consensus.cc:2749] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 7. Current term is 8.
I20260709 13:02:00.496531  5064 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.584029  5295 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:00.478179  5227 consensus_queue.cc:237] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:00.543933  5305 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:00.636581  5286 consensus_meta.cc:287] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.815s	user 0.010s	sys 0.002s
I20260709 13:02:00.637235  5286 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:00.638293  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:00.639853  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:00.640486  1587 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 12.
W20260709 13:02:00.641713  5326 log.cc:927] Time spent T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:02:00.641985  1556 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:00.645418  5259 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:00.620008  5038 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.646541  1556 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:00.636667  5338 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.544572  5277 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:00.652307  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 110576us
I20260709 13:02:00.614193  5290 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.645893  5259 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.653808  1556 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:00.612902  5064 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:00.662132  5259 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:00.665691  5306 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:00.681195  1737 raft_consensus.cc:1275] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:00.667702  5060 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:00.671326  5001 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:00.651939  5038 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:00.653678  5005 raft_consensus.cc:2804] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:00.677723  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:00.678061  1707 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:00.679724  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:00.701663  1667 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
I20260709 13:02:00.684182  1556 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:00.646872  5305 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:00.686717  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:00.700939  1660 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 14.
I20260709 13:02:00.710036  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:00.639449  5286 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:00.716447  5340 consensus_queue.cc:1048] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:00.718001  5340 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.718376  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:02:00.721524  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 43539.2us
I20260709 13:02:00.722286  1707 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:00.722926  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:00.723462  1707 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:00.725347  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:00.723493  1663 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:02:00.714931  1585 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
I20260709 13:02:00.709523  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:00.678463  5290 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:00.631744  5295 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:00.731456  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:00.731689  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:00.731865  1737 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:43678
I20260709 13:02:00.737107  1732 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:02:00.733268  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:00.702422  5213 raft_consensus.cc:2804] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:00.680292  5245 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:00.788200  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 55725.9us
I20260709 13:02:00.742172  1737 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:00.736403  5206 raft_consensus.cc:2804] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:00.773310  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:00.798601  1738 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:02:00.773490  5202 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:00.705510  5005 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:00.782073  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 54975.1us
I20260709 13:02:00.782299  5305 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:00.782147  5064 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:00.658536  5338 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:00.789805  1663 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
I20260709 13:02:00.790391  1592 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:02:00.743469  1658 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:00.803252  1741 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:02:00.789410  1737 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:00.801277  1707 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:00.736701  5060 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.808367  5064 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:00.809742  5064 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:00.811872  5064 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:00.805472  5344 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.803282  5245 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:00.821660  5344 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:00.823705  5245 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:00.823953  5344 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:00.823949  5290 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:00.826550  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:00.827114  5295 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:00.827270  2523 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:00.802657  5206 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.828125  5206 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:00.798902  5329 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:00.829821  5329 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.830224  5329 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:00.831940  5177 raft_consensus.cc:2804] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:00.832399  5177 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.832767  5177 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:00.806363  5202 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:00.834861  5338 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:00.835031  5202 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:00.836072  1583 raft_consensus.cc:2393] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 15: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:00.837170  1704 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:00.840543  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:00.737514  5198 raft_consensus.cc:2804] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:00.736639  5001 raft_consensus.cc:2749] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:00.865329  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:00.847400  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:00.812870  5064 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.879940  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:00.848313  5245 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.881645  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:00.901981  1589 raft_consensus.cc:2393] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 10: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:00.883188  5291 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.886008  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:00.903226  1739 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 15.
I20260709 13:02:00.864902  5337 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.886417  5202 raft_consensus.cc:2804] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:00.852370  1741 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:02:00.736572  5327 consensus_queue.cc:1048] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.132s
I20260709 13:02:00.718495  5340 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:00.890514  1738 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:02:00.897001  5333 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:00.891451  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 207355us
I20260709 13:02:00.889735  1737 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:00.803040  5005 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:00.895493  1740 raft_consensus.cc:2393] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 10: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:00.896484  1586 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:02:00.931196  5350 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.869818  1705 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:00.931784  5350 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:00.933154  5340 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:00.934031  5350 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:00.806876  5213 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.934747  5213 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:00.887631  1633 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:00.913329  5202 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:00.937371  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 49822.7us
I20260709 13:02:00.899158  1558 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:00.880340  5198 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.877357  2553 raft_consensus.cc:2955] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
W20260709 13:02:00.911780  5126 consensus_meta.cc:287] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.614s	user 0.008s	sys 0.003s
I20260709 13:02:00.915164  5245 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:00.884792  5259 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:00.838248  5060 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:00.940390  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 70692us
I20260709 13:02:00.942305  5340 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:00.956326  1732 raft_consensus.cc:1240] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:00.956112  1705 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:00.940369  1558 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:00.951869  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:00.957294  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:00.959681  1741 raft_consensus.cc:1240] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:00.960709  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:00.961442  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:00.962280  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:00.902124  5064 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:00.960597  1707 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:00.966203  1741 raft_consensus.cc:1275] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:00.970702  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:00.980258  1633 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:00.937399  5202 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:00.984302  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:00.947996  5198 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:00.987681  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:00.913704  5291 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:00.943567  5344 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.990041  1588 raft_consensus.cc:2393] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 10: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:00.990129  1667 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
I20260709 13:02:00.951305  5338 raft_consensus.cc:2804] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:00.987032  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:00.951033  5290 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:00.993563  1737 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:00.993700  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:00.997388  1659 raft_consensus.cc:2393] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 12: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:00.998594  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:00.998888  1741 raft_consensus.cc:2393] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 9: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:00.958302  5340 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:01.017091  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:01.017969  1739 raft_consensus.cc:2393] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 8: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:00.988631  5203 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:01.022059  1558 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:00.981799  5349 raft_consensus.cc:2804] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:02:01.026403  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 65870.6us
I20260709 13:02:01.021524  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:01.025214  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:00.994868  5267 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:01.035763  1741 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 11.
I20260709 13:02:00.955075  5126 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:01.038208  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:00.997238  5305 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.042354  1587 raft_consensus.cc:1240] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:00.996620  5338 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.040185  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:00.917156  5337 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:01.025326  5266 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:00.988332  5350 consensus_queue.cc:1048] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:02:01.063845  1660 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:02:01.000581  5290 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.094771  5290 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:00.944101  5333 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:01.025264  5340 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:01.097996  1738 raft_consensus.cc:2393] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 7: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:01.099045  5333 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:01.077546  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 55569.8us
I20260709 13:02:01.100090  1558 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:01.027768  5214 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.100868  5214 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:01.031996  5260 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.106403  1558 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:01.039034  5267 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:01.067124  5312 log.cc:927] Time spent T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:02:00.844470  5257 raft_consensus.cc:2955] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:02:01.052472  5203 raft_consensus.cc:697] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 10 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:01.000293  5344 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:01.093554  5266 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.067497  5338 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:01.122745  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:01.069254  5349 raft_consensus.cc:697] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:01.123685  1663 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:02:01.154214  5361 consensus_queue.cc:1059] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:02:01.155241  5373 raft_consensus.cc:2804] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:01.155897  5373 raft_consensus.cc:697] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:01.156842  5373 consensus_queue.cc:237] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:01.158921  5355 log.cc:927] Time spent T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.121s	user 0.002s	sys 0.000s
I20260709 13:02:01.110787  5236 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:01.126435  5267 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:01.071699  5305 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:01.152844  5266 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:01.122818  5300 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:01.143153  5280 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.155236  5361 raft_consensus.cc:3055] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:02:01.207465  5321 log.cc:927] Time spent T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:02:01.121735  5260 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:01.241972  5260 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:01.175845  5236 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.150543  4991 consensus_queue.cc:1048] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
I20260709 13:02:01.244562  5236 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:01.245903  5060 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:01.246208  5361 raft_consensus.cc:740] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:01.239133  5177 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:01.247155  5361 consensus_queue.cc:260] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:01.248320  5177 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:01.130511  5329 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:01.249600  5351 log.cc:927] Time spent T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:02:01.251253  5214 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:01.240082  5126 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:01.249164  1740 raft_consensus.cc:2368] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 11. Current term is 12.
I20260709 13:02:01.239497  5005 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:01.251307  5329 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:01.269001  1659 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:02:01.248353  5361 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:01.225158  5230 raft_consensus.cc:2804] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:01.290542  5206 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:01.294509  5005 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:01.266971  5126 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:01.349496  5224 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
W20260709 13:02:01.354871  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 315727us
I20260709 13:02:01.358652  1633 leader_election.cc:400] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 11. Current term is 12.
I20260709 13:02:01.359149  1633 leader_election.cc:403] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:01.361506  1583 raft_consensus.cc:1240] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:01.365796  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:01.366360  1585 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:01.363494  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:01.368584  1589 raft_consensus.cc:2468] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
I20260709 13:02:01.370090  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:01.371023  1589 raft_consensus.cc:2393] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 13: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:01.283180  5259 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:01.287029  5245 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:01.302119  5230 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.382031  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:01.382618  1588 raft_consensus.cc:3055] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:01.382943  1588 raft_consensus.cc:740] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:01.365341  1584 raft_consensus.cc:2955] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:02:01.380292  1733 raft_consensus.cc:2368] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 5. Current term is 6.
I20260709 13:02:01.320757  5038 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:01.385099  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:01.395080  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:01.396165  1739 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:01.391026  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:01.398286  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:01.395097  1707 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:01.399571  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:01.395324  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:01.269694  5280 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:01.389402  5357 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.402196  1737 raft_consensus.cc:2393] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 12: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:01.391067  1633 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:01.400836  1740 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:02:01.402909  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:01.397495  1590 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
I20260709 13:02:01.405455  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:01.390033  1588 consensus_queue.cc:260] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:01.401638  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:01.406850  1588 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:01.408870  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:01.409183  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:01.410471  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:01.254312  5300 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:01.410763  1740 raft_consensus.cc:2468] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 3.
I20260709 13:02:01.387101  5230 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:01.416502  1666 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:01.381479  5064 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:01.426201  1558 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:01.401134  5245 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:02:01.370913  5126 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:01.439180  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:01.441591  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:01.442690  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.444010  1660 raft_consensus.cc:2468] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
I20260709 13:02:01.464461  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:01.412905  5306 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:01.306382  5203 consensus_queue.cc:237] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:01.389071  5224 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:01.415227  5012 raft_consensus.cc:2804] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:01.503090  1558 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:01.501849  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:01.435433  5291 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:01.508457  1735 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 9.
W20260709 13:02:01.516986  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 106123us
I20260709 13:02:01.522833  5217 raft_consensus.cc:2804] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:01.523707  5217 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.524199  5217 raft_consensus.cc:3060] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:01.528000  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:01.509753  5286 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:01.414423  5357 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:01.469022  5177 consensus_queue.cc:1059] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:02:01.485306  5306 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.568593  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:01.505818  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:01.598206  1737 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 12.
W20260709 13:02:01.511042  5346 log.cc:927] Time spent T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:02:01.503615  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:02:01.598016  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 77099.7us
I20260709 13:02:01.599927  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:01.602123  1587 raft_consensus.cc:2368] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 8. Current term is 9.
I20260709 13:02:01.602228  1633 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:01.357438  5349 consensus_queue.cc:237] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:01.497413  5012 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.605384  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:01.609452  2553 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 8.
I20260709 13:02:01.611806  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:01.620633  1630 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:01.621045  1590 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 5.
I20260709 13:02:01.622864  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:01.618566  5012 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:01.546676  5344 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:01.632048  1741 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:01.632119  1588 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
I20260709 13:02:01.637928  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:01.639176  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.613706  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:01.616134  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 204813us
I20260709 13:02:01.603590  5306 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:01.608479  5337 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:01.596125  5286 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:01.652652  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 134908us
W20260709 13:02:01.675220  5213 consensus_meta.cc:287] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.740s	user 0.014s	sys 0.010s
W20260709 13:02:01.688210  5356 log.cc:927] Time spent T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.419s	user 0.002s	sys 0.000s
W20260709 13:02:01.706333  5353 log.cc:927] Time spent T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.334s	user 0.001s	sys 0.000s
I20260709 13:02:01.689570  5376 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:01.709656  5365 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:01.705406  5370 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:01.690032  5206 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:01.704655  5345 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:01.703358  5341 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:01.665452  5177 raft_consensus.cc:3055] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:01.709470  5383 raft_consensus.cc:2804] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:01.714473  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:02.009056  5202 consensus_meta.cc:287] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 1.012s	user 0.010s	sys 0.007s
I20260709 13:02:01.693799  1707 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:01.687333  5214 raft_consensus.cc:2804] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:01.702597  5362 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:01.793565  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 174124us
I20260709 13:02:01.732762  5001 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:01.763511  5365 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:01.997529  1741 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:02:01.997958  5370 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:01.994596  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:02:02.051573  5361 consensus_meta.cc:287] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.751s	user 0.014s	sys 0.008s
I20260709 13:02:02.009712  5224 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:01.724464  5277 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:02.006034  5384 log.cc:927] Time spent T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.221s	user 0.000s	sys 0.008s
I20260709 13:02:02.007550  5126 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:01.726923  5213 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:02.008682  5377 log.cc:927] Time spent T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.333s	user 0.000s	sys 0.008s
W20260709 13:02:01.997521  1666 consensus_meta.cc:287] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.575s	user 0.028s	sys 0.032s
I20260709 13:02:02.087428  1666 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
I20260709 13:02:02.088596  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:02.089344  1666 raft_consensus.cc:2393] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 10: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:01.742097  5376 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:02.001066  5300 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:02.003657  1739 consensus_meta.cc:287] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.604s	user 0.001s	sys 0.014s
W20260709 13:02:02.000056  1586 consensus_meta.cc:287] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.557s	user 0.007s	sys 0.014s
W20260709 13:02:02.003238  5290 consensus_meta.cc:287] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.908s	user 0.012s	sys 0.008s
W20260709 13:02:02.049678  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 52077.2us
W20260709 13:02:02.015082  5257 consensus_meta.cc:287] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.774s	user 0.010s	sys 0.018s
W20260709 13:02:02.017536  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:02.017735  5338 consensus_meta.cc:287] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.832s	user 0.003s	sys 0.013s
I20260709 13:02:02.023957  1732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3156) took 1265 ms. Trace:
W20260709 13:02:02.086344  5266 consensus_meta.cc:287] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.838s	user 0.018s	sys 0.001s
I20260709 13:02:02.059998  5202 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:02.019716  5306 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:02.025046  1663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 2449) took 1065 ms. Trace:
W20260709 13:02:02.019768  1585 consensus_meta.cc:287] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.653s	user 0.017s	sys 0.021s
I20260709 13:02:02.114848  1585 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12.
I20260709 13:02:01.676272  5038 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
W20260709 13:02:02.053768  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 433182us
I20260709 13:02:02.077579  5380 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:02.053798  1662 raft_consensus.cc:2468] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:02:02.051651  5177 raft_consensus.cc:740] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
W20260709 13:02:02.060104  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 366386us
I20260709 13:02:02.054450  5341 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:02.055855  5383 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.011482  5233 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:02.144485  5233 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:02.073726  5001 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:02.044642  5236 consensus_meta.cc:287] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.800s	user 0.013s	sys 0.009s
I20260709 13:02:02.011924  5286 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:02.078876  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:02:02.029510  5325 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.832s	user 0.004s	sys 0.009s
W20260709 13:02:02.039986  5340 consensus_meta.cc:287] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.942s	user 0.016s	sys 0.001s
I20260709 13:02:02.088271  5387 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.151429  5387 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:02.152581  5365 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:02.153227  5375 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:02.061035  5382 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.153970  5375 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:02.154423  5382 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:02.156289  5387 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:02.061121  5362 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.157318  5362 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:02.040931  5280 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:02.159225  5287 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:02.160337  5370 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:02.150583  5352 log.cc:927] Time spent T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 1.207s	user 0.006s	sys 0.008s
I20260709 13:02:02.160166  5287 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:02.145958  5383 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:02.165776  5325 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.968s	user 0.005s	sys 0.009s
I20260709 13:02:02.166917  5177 consensus_queue.cc:260] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:02.098798  1586 raft_consensus.cc:2468] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 7.
I20260709 13:02:02.099962  1556 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:02.032429  1733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43686 (request call id 2122) took 1016 ms. Trace:
I20260709 13:02:02.110100  1736 raft_consensus.cc:2393] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 10: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:02.051855  5345 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:02.113267  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:02.106269  5361 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:02.103624  5338 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:02.103590  1732 rpcz_store.cc:276] 0709 13:02:00.758076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.758267 (+   191us) service_pool.cc:224] Handling call
0709 13:02:00.758678 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:00.957065 (+198387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.023532 (+1066467us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b5400144954. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:02.023750 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":453719808}
I20260709 13:02:02.114512  1663 rpcz_store.cc:276] 0709 13:02:00.959973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.961127 (+  1154us) service_pool.cc:224] Handling call
0709 13:02:02.024779 (+1063652us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b540019c654. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:02.024924 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":371584000}
I20260709 13:02:02.135650  1707 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:02.168772  5177 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:02.098492  1739 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
W20260709 13:02:02.104555  5198 consensus_meta.cc:287] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 1.106s	user 0.010s	sys 0.021s
I20260709 13:02:02.100406  5290 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:02.137723  5038 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:02.139118  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:02.143325  5394 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:02.057798  5214 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.150566  5233 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:02.242836  5214 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:02.244421  5233 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:02.094264  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:02.245779  5382 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:02.246871  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:02.102542  5230 consensus_meta.cc:287] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.670s	user 0.019s	sys 0.019s
I20260709 13:02:02.028770  5012 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:02.017613  5217 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:02.228482  5267 consensus_meta.cc:287] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.985s	user 0.024s	sys 0.006s
I20260709 13:02:02.106642  5266 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:02.214957  5001 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:02.005275  5357 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:02.219985  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 120102us
I20260709 13:02:02.245056  5233 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:02.223287  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:02.224900  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 89301.5us
I20260709 13:02:02.284448  1707 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:02.112699  5202 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:02.194907  5370 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:02.195639  1733 rpcz_store.cc:276] 0709 13:02:01.016530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.016781 (+   251us) service_pool.cc:224] Handling call
0709 13:02:02.030130 (+1013349us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b5400184054. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:02.032349 (+  2219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":829517696}
I20260709 13:02:02.231997  1662 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:02:02.240227  5374 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:02.241439  5394 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:02.168991  5375 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:02.148339  5245 consensus_meta.cc:287] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.679s	user 0.018s	sys 0.002s
I20260709 13:02:02.214500  5365 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:02.195235  2553 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:02:02.271495  5267 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:02.349880  1661 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12.
I20260709 13:02:02.355722  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:02.269544  1633 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:02.222820  5372 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:02.357251  5372 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:02.358430  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:02.359007  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:02.233470  5373 raft_consensus.cc:2804] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:02.361836  5373 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:02.097203  5386 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:02.279564  1556 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:02.362593  5373 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:02.363334  5386 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:02.277666  1658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 2444) took 1591 ms. Trace:
I20260709 13:02:02.274269  5387 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:02.366150  5005 raft_consensus.cc:2804] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:02.367246  5005 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.367707  1667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 2451) took 1407 ms. Trace:
I20260709 13:02:02.367058  5387 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:02.195219  5236 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:02.368165  1667 rpcz_store.cc:276] 0709 13:02:00.960608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.962079 (+  1471us) service_pool.cc:224] Handling call
0709 13:02:02.367501 (+1405422us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b540041d7d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:02.367634 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62613248}
I20260709 13:02:02.299072  5038 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:02.195659  5340 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:02.301692  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:02:02.272410  5353 log.cc:927] Time spent T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:02:02.254387  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:02.262189  5280 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:02.372962  5280 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:02.374042  5038 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:02.375185  5345 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:02.374953  5038 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:02.319237  5306 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:02.376361  5280 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:02.366263  1658 rpcz_store.cc:276] 0709 13:02:00.686268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.686406 (+   138us) service_pool.cc:224] Handling call
0709 13:02:02.277426 (+1591020us) spinlock_profiling.cc:243] Waited 26.4 ms on lock 0x7b540019d7d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:02.277576 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60741888}
I20260709 13:02:02.378222  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:02.333891  5374 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:02.379305  1658 raft_consensus.cc:2410] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:02:02.379218  1665 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 15.
I20260709 13:02:02.380412  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:02.381644  1665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39146 (request call id 3114) took 1362 ms. Trace:
I20260709 13:02:02.382328  5340 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:02.382861  5233 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:02.230134  5361 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:02.384110  5267 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:02.385208  5038 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:02.386467  5361 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:02.386750  5236 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:02.234169  5198 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:02.315668  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:02.388319  1734 raft_consensus.cc:1240] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:02:02.389794  5387 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:02.328819  5370 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:02.391530  1738 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43686 (request call id 2117) took 1422 ms (client timeout 1799 ms). Trace:
I20260709 13:02:02.392262  1658 raft_consensus.cc:2468] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 4.
W20260709 13:02:02.392189  1738 rpcz_store.cc:269] 0709 13:02:00.969510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.970413 (+   903us) service_pool.cc:224] Handling call
0709 13:02:02.391281 (+1420868us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54002233d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:02.391423 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":262446976}
I20260709 13:02:02.333891  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:02.194628  5286 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:02.337870  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:02.309314  1707 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:02.355854  5245 raft_consensus.cc:2749] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 11. Current term is 12.
W20260709 13:02:02.363826  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 84374.5us
I20260709 13:02:02.399616  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:02.399724  1556 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:02.400244  2552 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:02:02.118427  5380 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.404698  5380 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:02.405900  5341 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:02.408995  5373 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:02.412364  1704 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:02.414333  5217 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:02.414659  5202 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:02.415102  5341 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:02.372822  5290 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:02.366721  5368 log.cc:927] Time spent T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 1.096s	user 0.006s	sys 0.000s
I20260709 13:02:02.415624  5202 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:02.400525  1558 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:02.415871  5341 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:02.417634  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:02.417786  5266 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:02.418335  1740 raft_consensus.cc:1275] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:02.367899  5005 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:02.420796  5213 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:02.412444  5373 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:02.234036  5331 raft_consensus.cc:2804] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:02.369520  5338 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:02.371006  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:02.434782  1663 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12.
I20260709 13:02:02.435039  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:02.435891  1733 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:02:02.436101  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:02.437783  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:02.437963  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:02.424796  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:02.438583  1664 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12.
I20260709 13:02:02.256102  5257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:59092 (request call id 79) took 6098 ms. Trace:
I20260709 13:02:02.439978  5370 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:02.441521  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:02.442382  1658 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:02.383646  5372 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:02.390102  5198 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:02.255472  5230 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:02.395242  5394 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:02.323601  5248 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:02.446625  5248 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:02.315780  5012 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:02.424554  5236 raft_consensus.cc:2749] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:02.449626  1590 raft_consensus.cc:2393] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 11: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:02.435851  5305 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:02.450150  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:02.436196  5266 raft_consensus.cc:2804] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:02.451112  2554 raft_consensus.cc:1813] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Handling vote request from an unknown peer 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:02.451478  5266 raft_consensus.cc:697] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 12 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:02.451804  2554 raft_consensus.cc:2410] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:02:02.396731  5365 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:02.452827  5266 consensus_queue.cc:237] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:02.439213  5257 rpcz_store.cc:276] 0709 13:01:56.151481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.151983 (+   502us) service_pool.cc:224] Handling call
0709 13:01:56.252323 (+100340us) spinlock_profiling.cc:243] Waited 5.12 ms on lock 0x7b2c00000658. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7f888a11 00007f1b7f897a0a 00007f1b7f897693 00007f1b7f897631 00007f1b80fca902 00007f1b80fca6dd 00007f1b80f95f3f 00007f1b80f956b3 00007f1b80f8d9fa 00007f1b85f554c9 00007f1b7f4d1c54
0709 13:01:56.310791 (+ 58468us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b18000c69c0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80fca73d 00007f1b80f95f3f 00007f1b80f956b3 00007f1b80f8d9fa 00007f1b85f554c9 00007f1b7f4d1c54 00007f1b7f4d1be2 00007f1b7f4d1b11 00007f1b7f4d1a8c 00007f1b7f4d0d42
0709 13:01:56.335115 (+ 24324us) log.cc:844] Serialized 501 byte log entry
0709 13:01:56.584851 (+249736us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b540004fea0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f08142 00007f1b80ee8eaa 00007f1b80eefd53 00007f1b80eefcd9 00007f1b80eefc69 00007f1b80eefc31 00007f1b80eeedfd 000000000038f354 000000000038f199 00007f1b7dea2475
0709 13:02:02.235550 (+5650699us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15275,"raft.queue_time_us":3702,"raft.run_cpu_time_us":2084,"raft.run_wall_time_us":18431,"spinlock_wait_cycles":24583552,"thread_start_us":237153,"threads_started":1,"wal-append.queue_time_us":296920,"wal-append.run_cpu_time_us":3048,"wal-append.run_wall_time_us":1200370}
I20260709 13:02:02.455597  1477 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c9831da869404fb79a22d3887701ca69 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:02.456049  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:02.449821  5286 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:02.457839  2424 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:02.462105  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:02.463691  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:02.464268  5393 raft_consensus.cc:2749] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:02.464617  1660 raft_consensus.cc:2393] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 12: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
W20260709 13:02:02.465520  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 196098us
I20260709 13:02:02.385633  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:02.316825  5376 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:02.401716  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 59443.5us
I20260709 13:02:02.475442  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:02.476022  1737 raft_consensus.cc:3060] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:02:02.475680  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:02.369556  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:02.344547  5383 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:02.402071  1738 raft_consensus.cc:2955] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:02:02.482551  1558 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:02.484124  2537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49238 (request call id 390) took 1873 ms. Trace:
I20260709 13:02:02.484424  5372 raft_consensus.cc:2804] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:02.484964  5372 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:02.485543  5372 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:02.486384  5230 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:02.487507  5383 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:02.488566  5340 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:02.488972  5305 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:02.489821  1666 raft_consensus.cc:2368] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 9. Current term is 10.
I20260709 13:02:02.489538  5340 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:02.490342  5376 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:02.489976  5305 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:02.491019  5376 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:02.493371  5305 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:02.494596  5248 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:02:02.479480  5365 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:02.496474  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:02.498000  1659 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
I20260709 13:02:02.499517  5328 raft_consensus.cc:2804] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:02.500144  5328 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:02.500665  5328 raft_consensus.cc:3060] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:02.501461  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:02.501964  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:02.503346  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:02.504217  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:02.504177  2515 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 6.
I20260709 13:02:02.504959  1666 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 6.
I20260709 13:02:02.505614  5376 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:02.505924  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:02.505697  2424 leader_election.cc:400] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683) with higher term. Message: Invalid argument: T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 9. Current term is 10.
I20260709 13:02:02.506907  2424 leader_election.cc:403] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:02.499203  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:02.507910  1659 raft_consensus.cc:2393] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 12: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:02.426573  2553 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
I20260709 13:02:02.427625  1662 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:02:02.506040  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:02.509153  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:02.509572  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.509629  1662 raft_consensus.cc:1813] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Handling vote request from an unknown peer 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:02.510318  1662 raft_consensus.cc:2410] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:02:02.509768  1630 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:02.427515  5331 raft_consensus.cc:697] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:02.428437  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:02.513306  1735 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:02.429447  5202 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:02.432065  5217 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:02.426378  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:02.438349  1663 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:02:02.382066  1665 rpcz_store.cc:276] 0709 13:02:01.019694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.028143 (+  8449us) service_pool.cc:224] Handling call
0709 13:02:02.381459 (+1353316us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54001e0354. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:02.381589 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3066561920}
I20260709 13:02:02.527395  1736 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:02:02.528215  1659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 2460) took 1117 ms. Trace:
I20260709 13:02:02.528404  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:02.529196  1736 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 11
W20260709 13:02:02.450415  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 141184us
I20260709 13:02:02.304960  5357 raft_consensus.cc:2804] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:02.466631  1633 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:02.462281  5374 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:02.470429  5341 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:02.472528  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:02.473325  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:02.580615  1739 raft_consensus.cc:2393] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 10: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:02.473567  1658 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:02:02.403484  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:02.478222  1733 raft_consensus.cc:2393] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 16: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:02.440912  5287 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:02.479423  5213 consensus_queue.cc:1048] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:02.585644  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:02.510849  1737 raft_consensus.cc:2468] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
W20260709 13:02:02.602952  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 201649us
I20260709 13:02:02.511709  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:02.514729  2424 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:02.517815  1667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 2461) took 1107 ms. Trace:
I20260709 13:02:02.607271  1667 rpcz_store.cc:276] 0709 13:02:01.410633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.516951 (+1106318us) service_pool.cc:224] Handling call
0709 13:02:02.517277 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.517489 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.517516 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:02.517562 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:02.517594 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.517654 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.517761 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:02.518834  1661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 2462) took 1107 ms. Trace:
I20260709 13:02:02.512116  1704 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:02.523023  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:02.484704  2537 rpcz_store.cc:276] 0709 13:02:00.610458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.617332 (+  6874us) service_pool.cc:224] Handling call
0709 13:02:01.154253 (+536921us) spinlock_profiling.cc:243] Waited 4.12 ms on lock 0x7b58001c3b98. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7de6ab71 00007f1b7de6aeee 0000000000375939 00007f1b85ede1e0 00007f1b85fa70c4 00007f1b85fa7131 00007f1b85f68fc0 00007f1b85f53929 00007f1b85f533d2 00007f1b7f4cabd4
0709 13:02:01.154434 (+   181us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.484879 (+330445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:01.488394 (+  3515us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:01.497557 (+  9163us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:01.507230 (+  9673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.483750 (+976520us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b540077fe54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:02.483837 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.484011 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":670929024}
W20260709 13:02:02.534543  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.534919  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:02.614771  1586 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
I20260709 13:02:02.615886  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:02.535185  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:02.617337  1589 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:02.535799  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:02.536507  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:02.540246  1735 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:02:02.528664  1659 rpcz_store.cc:276] 0709 13:02:01.410383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.513476 (+1103093us) service_pool.cc:224] Handling call
0709 13:02:02.527709 (+ 14233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.527900 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.527925 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:02.527963 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:02.527995 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.528048 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.528146 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:02.542253  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:02.608923  1661 rpcz_store.cc:276] 0709 13:02:01.410894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.527689 (+116795us) service_pool.cc:224] Handling call
0709 13:02:02.518460 (+990771us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b540030b454. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:02.518580 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1888052608}
I20260709 13:02:02.618666  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:02.541716  5365 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:02.541894  5280 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:02.528898  5331 consensus_queue.cc:237] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:02.547847  5340 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:02.513283  5383 raft_consensus.cc:2804] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:02.548903  5373 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.557466  5217 raft_consensus.cc:697] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:02.558228  5126 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:02.543079  5357 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.480530  5267 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:02.559444  1663 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:02:02.520249  5236 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:02.520416  5364 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:02.564213  5343 raft_consensus.cc:2749] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683) with higher term. Message: Invalid argument: T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 9. Current term is 10.
I20260709 13:02:02.565675  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:02.566677  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:02.659046  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:02.568984  1664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 2457) took 1159 ms. Trace:
I20260709 13:02:01.398940   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:02:02.570264  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 103759us
I20260709 13:02:02.570380  1489 catalog_manager.cc:5697] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 4 to 5, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:02.662165  1633 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:02.663405  1633 leader_election.cc:400] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 8. Current term is 9.
I20260709 13:02:02.662403  1489 catalog_manager.cc:5697] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 9 to 10, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 10 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:02.663677  1633 leader_election.cc:403] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:02.571288  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:02.574718  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:02.575176  1734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35672 (request call id 362) took 1272 ms. Trace:
I20260709 13:02:02.583750  1666 raft_consensus.cc:1240] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:02.584146  1736 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:02:02.602367  5214 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:02.671279  1734 rpcz_store.cc:276] 0709 13:02:01.303211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.303686 (+   475us) service_pool.cc:224] Handling call
0709 13:02:01.304160 (+   474us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:02.388726 (+1084566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.574838 (+186112us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540001ed54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:02.575097 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2492627328}
I20260709 13:02:02.519764  1741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43678 (request call id 3166) took 1126 ms. Trace:
W20260709 13:02:02.611660  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 96989.1us
I20260709 13:02:02.675446  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:02.612987  5252 raft_consensus.cc:2804] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:02.618259  1583 raft_consensus.cc:2393] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 9: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:02.681301  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:02.681489  5214 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:02.682165  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:02.682548  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:02.682832  1583 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:02.683825  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:02.683964  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:02.684986  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:02.685868  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:02.389739  5386 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:02.616954  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:02.691597  1586 raft_consensus.cc:2393] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 16: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:02.681342  5252 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:02.692564  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:02.622790  1488 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55138 (request call id 317) took 5704 ms. Trace:
I20260709 13:02:02.675453  1741 rpcz_store.cc:276] 0709 13:02:01.393338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.399343 (+  6005us) service_pool.cc:224] Handling call
0709 13:02:02.519581 (+1120238us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b540001e354. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:02.519694 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":533149056}
I20260709 13:02:02.625191  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:02.625773  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 113753us
I20260709 13:02:02.627832  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:02.694772  5341 consensus_queue.cc:1059] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:02.696115  5341 raft_consensus.cc:3055] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:02.615618  5305 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.697450  5305 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:02.700453  5295 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:02.667778  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:02.665966  5236 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:02.701324  5295 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:02.702263  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:02.702999  1590 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:02.703994  5236 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:02.659773  1664 rpcz_store.cc:276] 0709 13:02:01.409375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.410271 (+   896us) service_pool.cc:224] Handling call
0709 13:02:02.568806 (+1158535us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b540012ff54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:02.568921 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2305576192}
I20260709 13:02:02.675554  5394 raft_consensus.cc:2749] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 8. Current term is 9.
I20260709 13:02:02.684942  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:02.705467  5337 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:02.705745  5386 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:02.706130  5394 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:02.664863  1489 catalog_manager.cc:5697] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 6 to 7, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 7 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:02.706348  5337 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:02.692967  5252 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:02.706938  5394 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:02.710147  5337 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:02.711184  1633 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:02.712076  5337 raft_consensus.cc:2804] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:02.712567  5337 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.713068  5337 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:02.707847  1489 catalog_manager.cc:5697] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: config changed from index 5 to 6, VOTER 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) evicted. New cstate: current_term: 6 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:02:02.715245  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:02.715564  1633 leader_election.cc:400] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 5. Current term is 6.
I20260709 13:02:02.715873  1633 leader_election.cc:403] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:02.649672  5357 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:02.721812  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:02.674374  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:02.603755  1556 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:02:02.723829  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 120147us
I20260709 13:02:02.724375  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:02.724786  1556 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:02.667655  1558 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:02.678403  1705 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:02.670603  5340 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:02.697903  1666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 2458) took 1288 ms. Trace:
I20260709 13:02:02.726133  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:02.704710  5295 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:02.631318  5266 raft_consensus.cc:2804] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:02.628902  5383 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:02.718555  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 88011.1us
I20260709 13:02:02.720768  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:02.674080  1737 raft_consensus.cc:1240] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:02:02.726414  1666 rpcz_store.cc:276] 0709 13:02:01.409907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.513370 (+1103463us) service_pool.cc:224] Handling call
0709 13:02:02.583575 (+ 70205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.671430 (+ 87855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.697588 (+ 26158us) spinlock_profiling.cc:243] Waited 61.1 ms on lock 0x7b54002b25d0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8e8ad 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:02.697830 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":140479872}
I20260709 13:02:02.728056  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:02.740761  1741 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 4.
I20260709 13:02:02.729491  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:02:02.742136  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 74596.5us
I20260709 13:02:02.742995  1739 raft_consensus.cc:2368] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 15. Current term is 16.
I20260709 13:02:02.733335  1489 catalog_manager.cc:5697] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 11 to 12, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 12 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:02.737385  1734 raft_consensus.cc:2368] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 12. Current term is 13.
I20260709 13:02:02.739838  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:02.627274  5280 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:02.700794  5305 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:02.743709  1558 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:02.696807  5341 raft_consensus.cc:740] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:02.745951  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:02.755692  1590 raft_consensus.cc:2468] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:02.756790  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:02.633831  5365 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:02.758874  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 80553.3us
I20260709 13:02:02.763098  1558 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:02.760226  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:02.745204  1489 catalog_manager.cc:5697] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 5 to 6, leader changed from 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:02:02.647578  5373 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:02.693506  1488 rpcz_store.cc:276] 0709 13:01:56.918731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.918899 (+   168us) service_pool.cc:224] Handling call
0709 13:01:56.963766 (+ 44867us) spinlock_profiling.cc:243] Waited 29.4 ms on lock 0x7b5400119254. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef9090 00007f1b80f97f3a 00007f1b86d4e1cc 00007f1b86e4c37e 00007f1b8530d2a4 00007f1b8530d232 00007f1b8530d161 00007f1b8530d0dc 00007f1b8530c392 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:02.622720 (+5658954us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:59.765807 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:59.784825 (+ 19018us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:59.784868 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:01:59.784889 (+    21us) tablet.cc:662] Decoding operations
0709 13:01:59.785381 (+   492us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:59.785469 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:59.785502 (+    33us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:01:59.785845 (+   343us) tablet.cc:701] Row locks acquired
0709 13:01:59.785867 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:01:59.786263 (+   396us) write_op.cc:270] Start()
0709 13:01:59.786388 (+   125us) write_op.cc:276] Timestamp: P: 1783602119786216 usec, L: 0
0709 13:01:59.786420 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:01:59.787094 (+   674us) log.cc:844] Serialized 948 byte log entry
0709 13:02:00.633472 (+846378us) op_driver.cc:464] REPLICATION: finished
0709 13:02:00.818012 (+184540us) write_op.cc:301] APPLY: starting
0709 13:02:00.818121 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:00.818272 (+   151us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:00.818417 (+   145us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:00.819143 (+   726us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:00.819368 (+   225us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:02:00.819432 (+    64us) write_op.cc:312] APPLY: finished
0709 13:02:00.819670 (+   238us) log.cc:844] Serialized 29 byte log entry
0709 13:02:00.820228 (+   558us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:00.820351 (+   123us) write_op.cc:454] Released schema lock
0709 13:02:00.820407 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:00.820839 (+   432us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:00.820866 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":281001,"reported_tablets":14,"spinlock_wait_cycles":67565952,"child_traces":[["op",{"apply.queue_time_us":182358,"apply.run_cpu_time_us":2809,"apply.run_wall_time_us":2809,"num_ops":2,"prepare.queue_time_us":73921,"prepare.run_cpu_time_us":37886,"prepare.run_wall_time_us":124382,"raft.queue_time_us":603891,"raft.run_cpu_time_us":27378,"raft.run_wall_time_us":153652,"replication_time_us":831101,"thread_start_us":690630,"threads_started":4,"wal-append.queue_time_us":165989,"wal-append.run_cpu_time_us":144513,"wal-append.run_wall_time_us":2047631}]]}
I20260709 13:02:02.776449  1558 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:02.650712  5126 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:02.777099  1705 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:02.778838  1633 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:02.738828  5236 raft_consensus.cc:2749] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:02.784509  1705 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:02.785634  1705 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:02.782047  5257 raft_consensus.cc:2804] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:02.657150  5267 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:02.747272  5383 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:02.749336  5213 raft_consensus.cc:2804] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:02.706588  5386 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:02.746176  5295 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 5. Current term is 6.
I20260709 13:02:02.788379  1705 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:02.755450  5064 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:02.676596  5364 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:02.678139  5372 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:02.758397  5266 raft_consensus.cc:697] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 10 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:02.807175  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:02.869621  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 81337.8us
I20260709 13:02:02.712977  5380 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:02.878732  1705 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:02.767897  5038 raft_consensus.cc:2764] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:02:02.881414  1733 raft_consensus.cc:2393] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 12: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:02.869799  5012 raft_consensus.cc:2764] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:02:02.882134  5202 raft_consensus.cc:2804] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:02.882884  5202 raft_consensus.cc:697] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
W20260709 13:02:02.868783  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 134458us
I20260709 13:02:02.826640  5370 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:02.858407  5064 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:02.857911  5257 raft_consensus.cc:697] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:02.883893  1556 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:02.814039  1584 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:02:02.817816  1585 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:02.905983  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:02.910705  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:02.911389  1663 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:02:02.902631  1586 raft_consensus.cc:2393] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 6: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
W20260709 13:02:02.834066  5395 log.cc:927] Time spent T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:02:02.835117  1633 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:02.781859  5286 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:02.807403  5177 consensus_meta.cc:287] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.580s	user 0.012s	sys 0.002s
I20260709 13:02:02.803714  5358 raft_consensus.cc:2804] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:02.804029  5290 raft_consensus.cc:2804] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:02:02.815225  5362 consensus_meta.cc:287] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.657s	user 0.010s	sys 0.005s
I20260709 13:02:02.803406  5360 raft_consensus.cc:2749] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:02.918473  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:02.929430  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 94416.3us
I20260709 13:02:02.998011  1633 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:02.880846  5380 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:02.870697  5404 log.cc:927] Time spent T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 13:02:02.853583  5394 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:02.944847  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 168479us
I20260709 13:02:02.918342  5295 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:02.950855  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:02.973654  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:02:02.974498  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 198552us
I20260709 13:02:03.023972  1659 raft_consensus.cc:3060] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:02.768831  5217 consensus_queue.cc:237] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:02.898131  5342 raft_consensus.cc:2804] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:02.893887  5064 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:02.896021  5373 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:03.005800  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:02.973781  5358 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.010106  1633 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:03.005851  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:02.948962  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:02.884383  5364 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:02.920015  5372 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:03.017360  1663 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:02:02.935143  5370 raft_consensus.cc:2749] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:03.029801  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:03.035558  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:03.038568  1666 raft_consensus.cc:2393] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 11: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:02.889954  5365 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:03.051891  1661 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:03.001785  5287 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:02.996052  5286 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
W20260709 13:02:03.055256  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 45298us
I20260709 13:02:03.087239  1633 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:02.874001  5266 consensus_queue.cc:237] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:03.001256  5336 raft_consensus.cc:2804] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:02.996618  5290 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:02.898779  5257 consensus_queue.cc:237] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:02.884245  5202 consensus_queue.cc:237] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:02.928027  5012 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:03.120456  5012 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:03.098723  5286 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:03.122603  5012 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:02.928447  5038 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:03.014302  5214 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:03.084156  1658 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:02:03.123247  5038 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:03.123951  5286 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:03.069926  5005 consensus_meta.cc:287] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.651s	user 0.013s	sys 0.000s
I20260709 13:02:03.098438  5365 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:03.125463  5038 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:03.124800  5005 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:03.105633  5259 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:03.126623  5259 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:03.127892  5005 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:02.902359  5341 consensus_queue.cc:260] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:03.059324  5373 raft_consensus.cc:2804] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:03.128717  5259 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:03.005968  5362 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:03.054636  5342 raft_consensus.cc:697] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:03.058903  5394 raft_consensus.cc:2749] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:03.108105  1659 raft_consensus.cc:2468] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:02:03.050238  5295 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:03.129236  5373 raft_consensus.cc:697] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:03.056000  5358 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:03.183281  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:03.129612  1592 raft_consensus.cc:2368] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 5. Current term is 6.
I20260709 13:02:03.133490  5336 raft_consensus.cc:697] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:02.924723  1589 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:02:03.186435  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:03.187032  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:03.187901  1589 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 7.
I20260709 13:02:03.104871  5290 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:03.090691  5287 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:03.138600  5386 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:03.153038  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:03.206851  1658 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:03.207528  1591 raft_consensus.cc:2393] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 12: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:03.169756  5005 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:03.079107  5405 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:03.163738  1585 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:03.164031  1556 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:03.125705  5280 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:03.189065  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:03.259794  1589 raft_consensus.cc:2368] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 15. Current term is 16.
I20260709 13:02:03.197901  5267 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:03.199117  5373 consensus_queue.cc:237] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:03.068589  1663 raft_consensus.cc:1275] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:02:03.270896  1663 pending_rounds.cc:85] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 6
I20260709 13:02:03.271750  1663 pending_rounds.cc:107] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 8.7
W20260709 13:02:03.261229  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 97293.7us
I20260709 13:02:03.273095  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:03.234216  5328 consensus_meta.cc:287] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6: Time spent flushing consensus metadata: real 0.728s	user 0.010s	sys 0.005s
I20260709 13:02:03.262460  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:03.282866  1663 raft_consensus.cc:2889] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:03.283789  1735 raft_consensus.cc:2393] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 8: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:03.204274  5064 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:03.319252  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:03.246320  5126 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:03.307238  1658 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:02:03.337808  5126 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:03.338694  5126 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:03.342113  5287 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:03.342275  5126 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:03.348006  5252 consensus_meta.cc:287] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent flushing consensus metadata: real 0.640s	user 0.011s	sys 0.000s
I20260709 13:02:03.350169  5336 consensus_queue.cc:237] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:03.354122  5403 log.cc:927] Time spent T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
W20260709 13:02:03.355818  5401 log.cc:927] Time spent T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:02:03.264627  5410 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:03.362646  1661 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16.
I20260709 13:02:03.263836  5407 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:03.368520  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:03.348558  5252 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:03.371143  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 321092us
I20260709 13:02:03.373020  1707 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:03.260462  5005 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:03.374075  1660 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.026s	sys 0.029s
W20260709 13:02:03.378458  1660 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.026s	sys 0.030s
I20260709 13:02:03.378221  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:03.379168  1707 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:02:03.370160  5213 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.004s	sys 0.032s
I20260709 13:02:03.380614  5213 raft_consensus.cc:697] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:03.381598  5213 consensus_queue.cc:237] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:03.388041  5252 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:02:03.394534  5295 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:03.264027  5405 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:03.396415  1707 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:03.330230  5383 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:03.398000  1665 raft_consensus.cc:1240] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:03.399065  5383 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:03.400919  5064 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:03.403381  5337 consensus_meta.cc:287] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.690s	user 0.009s	sys 0.005s
I20260709 13:02:03.403894  5337 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:03.405158  1666 raft_consensus.cc:1240] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:03.412340  1589 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 6.
I20260709 13:02:03.412899  1707 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:03.396739  5405 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:03.424525  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:03.421149  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.380128  1660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3122) took 1765 ms. Trace:
I20260709 13:02:03.320353  5328 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:03.433780  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:03.449352  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:03.379673  4991 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:03.420306  5345 raft_consensus.cc:2749] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:03.428675  5012 raft_consensus.cc:2804] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:03.428201  5380 raft_consensus.cc:2804] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:03.464221  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:03.368309  5410 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:03.478637  5410 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:03.466962  1489 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.013s	sys 0.014s
I20260709 13:02:03.365469  5342 consensus_queue.cc:237] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:03.483417  1489 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.014s	sys 0.014s
I20260709 13:02:03.473807  1584 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 6.
I20260709 13:02:03.485270  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:03.486964  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:03.469559  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 378691us
I20260709 13:02:03.488253  1633 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:03.489460  5394 raft_consensus.cc:2749] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:03.491535  1633 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:03.493626  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:03.465433  5380 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:03.468842  5012 raft_consensus.cc:697] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:03.497051  5394 raft_consensus.cc:2749] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:03.495436  5362 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:03.519542  1633 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:03.513860  5380 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:03.527992  5417 consensus_queue.cc:1059] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:03.521493  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:03.557308  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 282440us
I20260709 13:02:03.552829  1633 leader_election.cc:400] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 election: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 15. Current term is 16.
I20260709 13:02:03.566195  1633 leader_election.cc:403] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:02:03.567975  1633 leader_election.cc:400] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 election: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 12. Current term is 13.
I20260709 13:02:03.530493  5394 raft_consensus.cc:2764] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:02:03.568495  1633 leader_election.cc:403] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:02:03.557890  5337 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:03.571316  1633 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:03.564289  5005 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:03.573889  1556 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:03.575138  1707 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:03.530920  5328 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 5 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:03.573601  1633 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:03.709993  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 64143.8us
I20260709 13:02:03.569180  5383 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 15. Current term is 16.
W20260709 13:02:03.744323  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 170760us
I20260709 13:02:03.746177  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:03.746927  1658 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:03.751585  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:03.760512  1658 raft_consensus.cc:2468] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
W20260709 13:02:03.764086  1705 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.913s (SENT) [suppressed 3 similar messages]
I20260709 13:02:03.764492  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:03.572335  5417 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:03.765352  1658 raft_consensus.cc:2368] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 5. Current term is 6.
I20260709 13:02:03.765863  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:03.769826  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:03.770879  1663 raft_consensus.cc:2393] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 16: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:03.579912  5295 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:03.688601  5345 raft_consensus.cc:2804] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:03.741698  5287 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:03.689301  5213 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:03.780956  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:03.753692  5394 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.784435  1659 raft_consensus.cc:2393] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 12: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
W20260709 13:02:03.777006  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 203295us
I20260709 13:02:03.763906  5415 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.785931  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:03.764990  5386 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:03.761883  5266 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.572561  5012 consensus_queue.cc:237] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:03.805444  5414 log.cc:927] Time spent T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.301s	user 0.001s	sys 0.000s
W20260709 13:02:03.809585  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 45527.7us
I20260709 13:02:03.787784  5336 raft_consensus.cc:2804] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:03.779831  5345 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:03.813743  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:03.816594  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:03.803382  5394 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:03.822443  5336 raft_consensus.cc:697] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:03.823506  5336 consensus_queue.cc:237] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:03.824412  5394 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:03.825636  1659 raft_consensus.cc:1275] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:03.825785  5431 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.826356  5431 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:03.818608  1633 connection.cc:256] RPC call timeout handler was delayed by -1.0468787099999872s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20240000000000002s for a response
I20260709 13:02:03.838013  5429 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:03.838688  5429 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:03.840377  5431 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:03.841090  1705 leader_election.cc:400] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Vote denied by peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683) with higher term. Message: Invalid argument: T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 5. Current term is 6.
I20260709 13:02:03.841434  1705 leader_election.cc:403] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:03.798353  5213 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:03.843709  5429 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:03.822063  5345 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:03.852173  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:03.855572  1658 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 3.
W20260709 13:02:03.838006  5418 log.cc:927] Time spent T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.308s	user 0.000s	sys 0.001s
I20260709 13:02:03.807899  5415 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:03.871821  5415 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:03.872431  5341 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:03.878557  5430 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:03.879065  5267 raft_consensus.cc:3055] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:02:03.879458  5357 consensus_meta.cc:287] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 1.132s	user 0.009s	sys 0.004s
I20260709 13:02:03.879686  5267 raft_consensus.cc:740] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:03.880012  5357 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:03.881588  1732 raft_consensus.cc:2393] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 10: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:03.880820  5267 consensus_queue.cc:260] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:03.882700  5267 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:03.883522  5357 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:03.884768  5290 consensus_meta.cc:287] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.654s	user 0.008s	sys 0.004s
I20260709 13:02:03.885262  5290 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:03.887521  1662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 2459) took 2477 ms. Trace:
I20260709 13:02:03.887923  1662 rpcz_store.cc:276] 0709 13:02:01.410164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.514136 (+1103972us) service_pool.cc:224] Handling call
0709 13:02:02.514430 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.856824 (+342394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.856876 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:02.856942 (+    66us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:02.856991 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.887299 (+1030308us) spinlock_profiling.cc:243] Waited 342 ms on lock 0x7b5400044554. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:03.887347 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:03.887464 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":786801920}
I20260709 13:02:03.892805  2426 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:03.893996  2426 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:03.858518  1705 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:03.866766  5332 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 6
W20260709 13:02:03.867573  5340 consensus_meta.cc:287] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 1.123s	user 0.010s	sys 0.005s
I20260709 13:02:03.869702  5213 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:03.900321  1705 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:03.902406  2426 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:03.903374  1592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2560) took 1269 ms. Trace:
I20260709 13:02:03.907881  2426 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:03.815544  5266 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:03.911336  5327 raft_consensus.cc:2749] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:03.909807  5340 raft_consensus.cc:2749] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:03.913182  5266 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:03.904158  5252 raft_consensus.cc:2749] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:03.910095  5328 raft_consensus.cc:2749] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:03.914592  1667 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:03.907137  1592 rpcz_store.cc:276] 0709 13:02:02.623204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.625669 (+  2465us) service_pool.cc:224] Handling call
0709 13:02:03.892372 (+1266703us) spinlock_profiling.cc:243] Waited 434 ms on lock 0x7b54000bb3d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:03.892489 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":997743488}
I20260709 13:02:03.904520  5238 raft_consensus.cc:2749] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:03.879158  5430 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:03.926733  5417 raft_consensus.cc:2749] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 12. Current term is 13.
I20260709 13:02:03.928200  5430 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:03.898483  5290 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:03.933265  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:03.937117  5415 raft_consensus.cc:2749] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:03.932561  5345 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:03.946404  1733 raft_consensus.cc:1240] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 6. Current term is 7. Ops: []
W20260709 13:02:03.879161  5358 consensus_meta.cc:287] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.663s	user 0.006s	sys 0.006s
I20260709 13:02:03.960173  2552 raft_consensus.cc:1240] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:03.904868  5357 raft_consensus.cc:2749] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:03.964965  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:03.968824  1667 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
W20260709 13:02:03.987171  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 77799.9us
I20260709 13:02:03.978097  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:03.970808  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
W20260709 13:02:03.986868  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 157691us
I20260709 13:02:03.951043  5345 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:03.971194  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:03.985247  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:04.011395  1707 leader_election.cc:400] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 5. Current term is 6.
I20260709 13:02:04.014225  1707 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:04.017874  1737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3191) took 1001 ms. Trace:
I20260709 13:02:04.020512  1555 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:04.023917  1633 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:04.018325  1737 rpcz_store.cc:276] 0709 13:02:03.016656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.017191 (+   535us) service_pool.cc:224] Handling call
0709 13:02:03.037018 (+ 19827us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.121529 (+ 84511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:03.121558 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:03.121598 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:03.121629 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.017627 (+895998us) spinlock_profiling.cc:243] Waited 84.3 ms on lock 0x7b5400255dd4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:04.017690 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:04.017812 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":193925504}
I20260709 13:02:04.027328  1633 leader_election.cc:400] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 15. Current term is 16.
I20260709 13:02:04.028584  1633 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:03.960235  5358 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:03.984643  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:04.036979  1587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2552) took 1501 ms. Trace:
I20260709 13:02:04.037570  1587 rpcz_store.cc:276] 0709 13:02:02.535688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.535796 (+   108us) service_pool.cc:224] Handling call
0709 13:02:02.536046 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.884105 (+348059us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.884148 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:02.884216 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:02.884251 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.036654 (+1152403us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b54003b47d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:04.036718 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:04.036896 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":799903104}
I20260709 13:02:04.039743  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:04.044776  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:04.046850  5394 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:04.047132  5415 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:04.047401  5394 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:04.047959  5394 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:04.029271  5336 raft_consensus.cc:2749] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:04.040601  5358 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:04.041222  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:04.060885  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:04.062076  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:04.063117  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:04.063795  5380 consensus_meta.cc:287] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.504s	user 0.010s	sys 0.000s
I20260709 13:02:04.064247  5380 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:04.066519  5380 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:04.019243  5012 consensus_queue.cc:1059] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:02:04.068537  5012 raft_consensus.cc:3055] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:04.068888  5012 raft_consensus.cc:740] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:04.069761  5012 consensus_queue.cc:260] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:04.071120  5012 raft_consensus.cc:3060] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:04.041733  2515 raft_consensus.cc:1275] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:04.088688  5431 consensus_queue.cc:1048] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:04.074535  5266 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:04.092538  5332 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683) with higher term. Message: Invalid argument: T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 5. Current term is 6.
I20260709 13:02:04.093478  1666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3138) took 1118 ms. Trace:
I20260709 13:02:04.094077  1666 rpcz_store.cc:276] 0709 13:02:02.975054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.077752 (+102698us) service_pool.cc:224] Handling call
0709 13:02:03.087182 (+  9430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.405627 (+318445us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.093141 (+687514us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b540044e154. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:04.093393 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":730721152}
I20260709 13:02:04.096149  5252 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:04.096803  5252 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:04.098133  1588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46836 (request call id 401) took 1537 ms. Trace:
I20260709 13:02:04.099295  5252 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:04.098613  1588 rpcz_store.cc:276] 0709 13:02:02.561070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.561574 (+   504us) service_pool.cc:224] Handling call
0709 13:02:02.561976 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.704857 (+142881us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:02.803923 (+ 99066us) log.cc:844] Serialized 14 byte log entry
0709 13:02:03.524808 (+720885us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:03.524878 (+    70us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:03.524920 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.097844 (+572924us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b5400431554. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:04.097921 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:04.098073 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17289,"prepare.queue_time_us":166029,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":50133,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"spinlock_wait_cycles":328060288,"thread_start_us":800765,"threads_started":3,"wal-append.queue_time_us":666147}
I20260709 13:02:04.046065  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:04.055773  1633 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:04.104692  1587 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 8.
W20260709 13:02:04.105309  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 49676.6us
I20260709 13:02:04.106702  1633 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:04.054916  1556 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:04.062726  5386 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:04.077396  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:04.108660  1662 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:02:04.063664  1592 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 8.
I20260709 13:02:04.041581  1664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3129) took 1132 ms. Trace:
I20260709 13:02:04.084059  5417 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.113286  5417 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:04.086289  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:04.114385  1659 raft_consensus.cc:2393] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 12: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:04.086814  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:04.115459  5417 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:04.116221  1663 raft_consensus.cc:1275] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:02:04.086071  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:04.119079  1667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39146 (request call id 3134) took 1168 ms. Trace:
I20260709 13:02:04.119681  1667 rpcz_store.cc:276] 0709 13:02:02.950327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.950520 (+   193us) service_pool.cc:224] Handling call
0709 13:02:04.118900 (+1168380us) spinlock_profiling.cc:243] Waited 891 ms on lock 0x7b540019d7d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:04.119025 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2049068416}
I20260709 13:02:04.110493  1664 rpcz_store.cc:276] 0709 13:02:02.908916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.909113 (+   197us) service_pool.cc:224] Handling call
0709 13:02:02.909474 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.919189 (+  9715us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.919221 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:02.919267 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:02.919298 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.041273 (+1121975us) spinlock_profiling.cc:243] Waited 9.48 ms on lock 0x7b5400001ed4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:04.041340 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:04.041503 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21799296}
I20260709 13:02:04.112211  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:04.112345  4991 raft_consensus.cc:2749] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:04.113615  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:04.125224  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:04.090565  5266 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:04.126740  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:04.127676  5266 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:04.128000  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:04.120312  5362 consensus_queue.cc:1048] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:02:03.428571  1660 rpcz_store.cc:276] 0709 13:02:01.615146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.567298 (+952152us) service_pool.cc:224] Handling call
0709 13:02:02.567762 (+   464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:02.568533 (+   771us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.568567 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:02.569159 (+   592us) log.cc:844] Serialized 26 byte log entry
0709 13:02:02.804084 (+234925us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:03.379060 (+574976us) log.cc:844] Serialized 14 byte log entry
0709 13:02:03.379478 (+   418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.379767 (+   289us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:03.379889 (+   122us) raft_consensus.cc:1685] finished
0709 13:02:03.379909 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:03.380070 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":30772,"raft.run_cpu_time_us":362,"raft.run_wall_time_us":19427,"thread_start_us":756487,"threads_started":2,"wal-append.queue_time_us":485006}
W20260709 13:02:04.129685  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 74825.9us
I20260709 13:02:04.130009  5362 raft_consensus.cc:2804] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:04.130632  5362 raft_consensus.cc:697] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:04.130597  1556 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:04.132213  5407 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:04.132807  5407 raft_consensus.cc:697] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 16 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:02:04.133925  5424 log.cc:927] Time spent T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.329s	user 0.001s	sys 0.000s
I20260709 13:02:04.134088  5407 consensus_queue.cc:237] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:04.065017  5354 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:04.135469  5362 consensus_queue.cc:237] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:04.136307  5354 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:04.137741  1732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43678 (request call id 3188) took 1667 ms. Trace:
I20260709 13:02:04.138540  5354 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:04.139825  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:04.141408  1736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43686 (request call id 2148) took 1411 ms. Trace:
I20260709 13:02:04.142402  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:04.143241  1592 raft_consensus.cc:2468] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 3.
I20260709 13:02:04.147267  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:04.111974  5267 raft_consensus.cc:2749] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:04.141983  1736 rpcz_store.cc:276] 0709 13:02:02.730331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.739559 (+  9228us) service_pool.cc:224] Handling call
0709 13:02:04.141050 (+1401491us) spinlock_profiling.cc:243] Waited 994 ms on lock 0x7b54001f6b54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:04.141233 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2285404032}
I20260709 13:02:04.159699  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:04.160288  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:04.123188  1633 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:04.138170  1732 rpcz_store.cc:276] 0709 13:02:02.470665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.511463 (+ 40798us) service_pool.cc:224] Handling call
0709 13:02:04.137468 (+1626005us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400223dd4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:04.137657 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2937573632}
I20260709 13:02:04.162402  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:04.163132  1660 raft_consensus.cc:3060] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:04.151307  1707 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:04.154279  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:04.166064  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:04.167232  1592 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
I20260709 13:02:04.168661  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:04.169189  1707 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:04.106721  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:04.177033  1586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2564) took 1524 ms. Trace:
I20260709 13:02:04.178876  1586 rpcz_store.cc:276] 0709 13:02:02.652671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.692275 (+ 39604us) service_pool.cc:224] Handling call
0709 13:02:04.176710 (+1484435us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b54003a0f54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:04.176948 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":480877824}
I20260709 13:02:04.180503  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:04.178014  1583 raft_consensus.cc:1240] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:04.183146  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:04.184018  1588 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:04.185482  1707 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:04.186826  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:04.187897  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:04.188426  1586 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 7.
W20260709 13:02:04.190125  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 78519us
I20260709 13:02:04.190419  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:04.191169  1587 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
I20260709 13:02:04.192113  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:04.192775  1587 raft_consensus.cc:2393] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 10: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:04.189908  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:04.193560  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:04.194561  1586 raft_consensus.cc:1275] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:04.195143  1586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2565) took 1540 ms. Trace:
I20260709 13:02:04.195341  1705 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:04.196720  1586 rpcz_store.cc:276] 0709 13:02:02.654735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.194015 (+1539280us) service_pool.cc:224] Handling call
0709 13:02:04.194283 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.194927 (+   644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.195085 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:04.200817  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:04.201699  1592 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
I20260709 13:02:04.204298  1592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2567) took 1537 ms. Trace:
I20260709 13:02:04.195154  1587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2566) took 1536 ms. Trace:
I20260709 13:02:04.120729  5415 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:04.208796  1633 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:04.219129  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:04.219391  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:04.220017  1664 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:02:04.220676  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:04.220955  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:04.221398  1662 raft_consensus.cc:2376] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12. Re-sending same reply.
I20260709 13:02:04.221678  1663 raft_consensus.cc:2393] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 10: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:04.222306  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:04.223212  1667 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:04.210312  1707 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:04.212466  1705 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:04.209625  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:04.228804  5386 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:04.229909  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:04.230345  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:04.230942  1661 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:04.233361  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:04.233796  2543 raft_consensus.cc:1240] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:04.234341  1659 raft_consensus.cc:2393] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 13: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:04.235217  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:04.235334  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:04.235989  2543 raft_consensus.cc:2468] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 6.
I20260709 13:02:04.236352  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:04.236732  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:04.236938  1659 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:04.204700  1592 rpcz_store.cc:276] 0709 13:02:02.666990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.202706 (+1535716us) service_pool.cc:224] Handling call
0709 13:02:04.203552 (+   846us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.203786 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:04.203816 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:04.203861 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:04.203906 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.204059 (+   153us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:04.204225 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:04.170513  5416 raft_consensus.cc:2749] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:04.240895  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:04.256057  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:04.256752  1592 raft_consensus.cc:2368] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 5. Current term is 6.
I20260709 13:02:04.211892  1587 rpcz_store.cc:276] 0709 13:02:02.658929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.194426 (+1535497us) service_pool.cc:224] Handling call
0709 13:02:04.194674 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.194904 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:04.194929 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:04.194969 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:04.194999 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.195044 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:04.195115 (+    71us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:04.257555  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:04.258183  1587 raft_consensus.cc:2368] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 7. Current term is 8.
I20260709 13:02:04.258880  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:04.260303  1588 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:02:04.261372  1586 raft_consensus.cc:1240] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:04.262625  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:04.263229  1588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2013) took 1259 ms. Trace:
I20260709 13:02:04.263559  1732 raft_consensus.cc:2393] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 11: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:04.264142  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:04.265676  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:04.263592  1588 rpcz_store.cc:276] 0709 13:02:03.003372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.262501 (+1259129us) service_pool.cc:224] Handling call
0709 13:02:04.262792 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.262944 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:04.262968 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:04.263008 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:04.263036 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.263082 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:04.263181 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:04.267766  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:04.269387  1661 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 13.
I20260709 13:02:04.270112  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:04.271202  1661 raft_consensus.cc:1275] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:04.250025  1660 raft_consensus.cc:2468] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 5.
I20260709 13:02:04.178220  5267 raft_consensus.cc:2749] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:02:04.252981  1585 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2562) took 1618 ms (client timeout 1614 ms). Trace:
I20260709 13:02:04.238807  1630 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:04.273538  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:04.253564  1584 raft_consensus.cc:1240] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:04.274940  1591 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 2005) took 2628 ms (client timeout 2024 ms). Trace:
W20260709 13:02:04.298449  1591 rpcz_store.cc:269] 0709 13:02:01.611675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.613460 (+  1785us) service_pool.cc:224] Handling call
0709 13:02:04.239534 (+2626074us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b54003926d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:04.239913 (+   379us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3600553856}
I20260709 13:02:04.301478  1588 raft_consensus.cc:1275] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:04.295054  1592 raft_consensus.cc:1275] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:04.296260  1659 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
I20260709 13:02:04.304949  1659 raft_consensus.cc:1240] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:04.236912  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:04.272413  1585 rpcz_store.cc:269] 0709 13:02:02.634283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.658816 (+ 24533us) service_pool.cc:224] Handling call
0709 13:02:04.252797 (+1593981us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b5400031bd4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:04.252911 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":363200256}
W20260709 13:02:04.310350  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 71664us
I20260709 13:02:04.311204  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:04.311753  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 99408.5us
I20260709 13:02:04.206708  5248 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:04.286849  2424 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:02:04.311393  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 101212us
I20260709 13:02:04.312251  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:04.216436  5198 raft_consensus.cc:2804] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:04.315274  5434 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:04.311041  5410 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:04.339205  5410 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:04.294406  5332 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:04.315706  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 62744.4us
I20260709 13:02:04.320412  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:04.346807  2552 raft_consensus.cc:2393] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 7: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:02:04.346670  1705 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:04.320922  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:04.347254  1658 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
I20260709 13:02:04.308650  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:04.321256  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:04.348688  1659 raft_consensus.cc:2393] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 16: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:04.348927  1739 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 8.
I20260709 13:02:04.324018  1734 raft_consensus.cc:1275] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:04.350551  1633 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:04.314419  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:04.325119  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:04.310525  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:04.325508  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:04.329813  1732 raft_consensus.cc:1240] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:04.331228  1556 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:04.351994  1737 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:04.358780  1633 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:04.334684  1707 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:04.365768  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:04.369413  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:04.370457  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:04.370640  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:04.371448  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:04.367671  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:04.274312  5266 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:04.308238  5331 raft_consensus.cc:2749] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:04.327134  5425 log.cc:927] Time spent T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.489s	user 0.004s	sys 0.000s
I20260709 13:02:04.377871  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:04.386202  1707 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:04.384151  1737 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 13.
I20260709 13:02:04.366858  4991 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.377490  1558 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:04.334381  5198 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:04.376911  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:04.331388  5364 consensus_queue.cc:1059] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:02:04.413301  5442 raft_consensus.cc:2804] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:04.388105  5441 consensus_queue.cc:1059] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:02:04.332023  5064 consensus_queue.cc:1048] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:02:04.319579  2543 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 11.
I20260709 13:02:04.388974  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:04.326640  5438 raft_consensus.cc:2804] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:04.329978  5290 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:04.338598  5434 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:04.418402  1665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3120) took 2803 ms. Trace:
I20260709 13:02:04.392143  1584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46836 (request call id 409) took 1800 ms. Trace:
I20260709 13:02:04.360540  5267 raft_consensus.cc:2749] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:04.392222  5394 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:04.393187  5258 raft_consensus.cc:2804] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:04.413322  5005 raft_consensus.cc:2749] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:04.394013  5431 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:04.399057  5358 raft_consensus.cc:2804] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:04.464546  1661 raft_consensus.cc:1240] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:04.400352  1667 raft_consensus.cc:1275] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:02:04.465689  2426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.332829  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:04.470463  1583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46836 (request call id 406) took 1904 ms. Trace:
I20260709 13:02:04.470933  1583 rpcz_store.cc:276] 0709 13:02:02.565608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.706362 (+140754us) service_pool.cc:224] Handling call
0709 13:02:04.177715 (+1471353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.181891 (+  4176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.470166 (+288275us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54003a0f50. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8e8ad 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:04.470355 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3382856960}
I20260709 13:02:04.334574  5360 consensus_queue.cc:1048] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:02:04.333243  5370 raft_consensus.cc:2804] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:04.401371  5266 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:04.403877  1705 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:04.486642  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 82909.1us
I20260709 13:02:04.487103  1732 raft_consensus.cc:1275] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:02:04.487609  1705 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:04.380003  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:04.405382  1739 raft_consensus.cc:2393] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 12: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:04.325886  5287 raft_consensus.cc:2804] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:04.238461  5415 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:04.310545  5362 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:04.406519  1737 raft_consensus.cc:1275] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 13:02:04.504907  1737 pending_rounds.cc:85] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 5
I20260709 13:02:04.505223  1737 pending_rounds.cc:107] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 13:02:04.505477  1737 raft_consensus.cc:2889] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:04.387063  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 55910.8us
I20260709 13:02:04.501579  5206 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.507623  5206 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:04.384693  5417 raft_consensus.cc:2804] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:04.509289  5417 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.410351  5386 consensus_queue.cc:1059] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:02:04.509670  5417 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:04.414903  1735 raft_consensus.cc:2393] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 7: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:04.418804  1665 rpcz_store.cc:276] 0709 13:02:01.614549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.527765 (+913216us) service_pool.cc:224] Handling call
0709 13:02:02.528095 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.398477 (+870382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.418187 (+1019710us) spinlock_profiling.cc:243] Waited 870 ms on lock 0x7b540044d254. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:04.418350 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1999986944}
I20260709 13:02:04.419152  1584 rpcz_store.cc:276] 0709 13:02:02.591536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.560995 (+969459us) service_pool.cc:224] Handling call
0709 13:02:04.253392 (+692397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.275906 (+ 22514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.391927 (+116021us) spinlock_profiling.cc:243] Waited 692 ms on lock 0x7b5400031bd0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8e8ad 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:04.392075 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1591188224}
I20260709 13:02:04.393303  5410 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:04.346130  5248 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:04.502501  5177 consensus_queue.cc:1048] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:02:04.512795  5248 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:04.411360  4991 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:04.483850  5258 raft_consensus.cc:697] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:04.514847  4991 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:04.419821  1589 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 2020) took 1269 ms (client timeout 1608 ms). Trace:
I20260709 13:02:04.514353  5258 consensus_queue.cc:237] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:04.515419  4991 raft_consensus.cc:3055] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:04.480968  1558 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:04.481901  2426 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:04.413946  5442 raft_consensus.cc:697] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 9 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:04.517719  5442 consensus_queue.cc:237] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:04.492525  5287 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:04.519183  5287 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:04.429308  5329 consensus_queue.cc:1048] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:02:04.483369  5370 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:04.520246  5370 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:04.521273  5341 raft_consensus.cc:2749] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:04.522981  5341 consensus_queue.cc:1059] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:04.523420  1586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2009) took 1521 ms. Trace:
I20260709 13:02:04.429208  5438 raft_consensus.cc:697] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:04.524333  5362 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:04.524856  5438 consensus_queue.cc:237] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:04.525950  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:04.526551  5362 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:04.527482  5434 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:04.480084  1590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46836 (request call id 408) took 1913 ms. Trace:
I20260709 13:02:04.528085  1590 rpcz_store.cc:276] 0709 13:02:02.566190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.775076 (+208886us) service_pool.cc:224] Handling call
0709 13:02:03.269016 (+493940us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.269671 (+   655us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:03.269738 (+    67us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:03.269842 (+   104us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:03.269938 (+    96us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.270055 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:04.479669 (+1209614us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b54003cfd50. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8e8ad 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:04.479950 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1134953728}
I20260709 13:02:04.528810  5441 raft_consensus.cc:3055] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:04.428097  5345 consensus_queue.cc:1048] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 13:02:04.529230  5441 raft_consensus.cc:740] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:04.493446  5376 raft_consensus.cc:2804] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:04.530257  5376 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:04.530081  5441 consensus_queue.cc:260] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:04.515470  1589 rpcz_store.cc:269] 0709 13:02:03.150151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.272704 (+122553us) service_pool.cc:224] Handling call
0709 13:02:04.419639 (+1146935us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b54002b1954. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:04.419757 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":317792000}
I20260709 13:02:04.532671  5206 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:04.533183  5266 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:04.480924  5267 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.495738  1741 raft_consensus.cc:1275] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:04.534062  5267 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:04.468145  5358 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:04.427983  5416 consensus_queue.cc:1048] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:02:04.530655  5376 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:04.414181  5198 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:04.461982  5332 raft_consensus.cc:2749] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:04.515959  4991 raft_consensus.cc:740] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:04.524048  1586 rpcz_store.cc:276] 0709 13:02:03.002188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.227889 (+1225701us) service_pool.cc:224] Handling call
0709 13:02:04.261210 (+ 33321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.291527 (+ 30317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.523202 (+231675us) spinlock_profiling.cc:243] Waited 33 ms on lock 0x7b5400031450. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8e8ad 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:04.523356 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75903744}
I20260709 13:02:04.462555  5394 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:04.503337  5429 raft_consensus.cc:2804] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:04.539155  1705 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:04.543622  1630 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:04.558094  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:04.538044  5358 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:04.563673  5266 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.564325  5266 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:04.552191  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 46459us
I20260709 13:02:04.566464  1705 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:04.567297  5206 raft_consensus.cc:2749] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:04.568933  1705 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:04.569753  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 62603.3us
I20260709 13:02:04.570528  1556 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:02:04.587898  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 106998us
I20260709 13:02:04.589777  1558 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:04.593883  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:04.595000  2515 raft_consensus.cc:2410] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:02:04.598624  5342 raft_consensus.cc:3055] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:04.599439  5342 raft_consensus.cc:740] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:04.613570  5327 raft_consensus.cc:3055] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:04.614141  5327 raft_consensus.cc:740] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:04.615242  5327 consensus_queue.cc:260] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:04.550287  5429 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.622987  5429 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:04.636049  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 46421.7us
I20260709 13:02:04.636509  5405 raft_consensus.cc:2749] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:04.636870  5005 consensus_queue.cc:1048] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:04.637787  5362 raft_consensus.cc:2749] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:04.638332  5410 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.638494  5362 consensus_queue.cc:1048] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:04.638851  5410 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:04.636911  5213 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:04.640093  5405 consensus_queue.cc:1048] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:04.640986  5410 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:04.645902  1741 raft_consensus.cc:1275] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:04.616966  5327 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:04.648299  1741 raft_consensus.cc:1275] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:02:04.651607  1734 raft_consensus.cc:1275] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:04.652215  5266 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:04.600955  5342 consensus_queue.cc:260] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:04.654341  5342 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:04.654366  5126 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:04.655489  5126 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:04.657277  5213 consensus_queue.cc:1048] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:04.658591  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:04.658892  5405 consensus_queue.cc:1048] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:04.658032  5126 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:04.662163  5405 consensus_queue.cc:1048] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:02:04.670995  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 102095us
I20260709 13:02:04.671880  1705 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:04.570108  5394 raft_consensus.cc:2804] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:04.569895  5332 raft_consensus.cc:2749] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:02:04.706079  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 278789us
I20260709 13:02:04.709156  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:04.709946  1589 raft_consensus.cc:2393] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 8: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:04.710090  1705 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:04.712037  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:04.714318  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:04.714567  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:04.699328  5431 raft_consensus.cc:2804] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:04.727768  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:04.736194  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 217928us
I20260709 13:02:04.696163  5267 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:04.698818  5177 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:04.769465  2426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.773875  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:04.761547  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 191114us
I20260709 13:02:04.773921  1555 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:04.775122  1556 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:04.698248  5394 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:04.699322  5126 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.709309  5354 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
W20260709 13:02:04.754619  5423 log.cc:927] Time spent T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:02:04.759383  5345 raft_consensus.cc:2804] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:04.788564  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:04.794334  1555 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:04.773838  5427 log.cc:927] Time spent T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:02:04.796031  1556 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:04.810395  1555 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:04.813450  2424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.754280  5380 consensus_queue.cc:1048] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:02:04.822665  1738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3175) took 2403 ms. Trace:
I20260709 13:02:04.824369  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:04.825004  1588 raft_consensus.cc:2468] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5.
I20260709 13:02:04.786995  5394 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:04.823278  1738 rpcz_store.cc:276] 0709 13:02:02.401264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.401489 (+   225us) service_pool.cc:224] Handling call
0709 13:02:02.401768 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.401957 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:02.507935 (+105978us) log.cc:844] Serialized 14 byte log entry
0709 13:02:03.849478 (+1341543us) spinlock_profiling.cc:243] Waited 5.01 ms on lock 0x7b180029a220. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7dea2522 00007f1b7dea47c1 00007f1b7dea4779 00007f1b7dea4709 00007f1b7dea46d1 00007f1b7dea39cd 000000000038f354 000000000038f199 00007f1b7de8583a
0709 13:02:04.389856 (+540378us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b180029a220. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7de84e07 00007f1b86cdfab9 00007f1b7dea169b 00007f1b7de9f93f 00007f1b7de9f455 00007f1b849873c7 00007f1b80f999a7 00007f1b80fa90bf 00007f1b80fa9038
0709 13:02:04.589509 (+199653us) log.cc:844] Serialized 14 byte log entry
0709 13:02:04.804456 (+214947us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:04.804540 (+    84us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:04.804603 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.804703 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:04.804869 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65543,"prepare.queue_time_us":1950467,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":3344,"raft.queue_time_us":52330,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":20329,"spinlock_wait_cycles":14712960,"thread_start_us":622185,"threads_started":3,"wal-append.queue_time_us":293587,"wal-append.run_cpu_time_us":1710,"wal-append.run_wall_time_us":1073705}
I20260709 13:02:04.792208  5331 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:04.825659  5291 raft_consensus.cc:2804] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:04.841676  1740 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:02:04.773391  5328 consensus_queue.cc:1059] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:02:04.792277  5460 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:04.821439  5329 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:04.819298  5345 raft_consensus.cc:697] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 11 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:04.837316  5064 raft_consensus.cc:2749] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:04.789026  5354 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:04.833937  5236 raft_consensus.cc:2749] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:04.852731  1555 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:04.789337  5126 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:04.843715  5364 raft_consensus.cc:2749] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:04.867455  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:04.886255  1662 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:02:04.887272  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:04.888396  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:04.870911  1666 raft_consensus.cc:1275] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:04.890265  1666 raft_consensus.cc:1275] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:04.891463  1666 raft_consensus.cc:1275] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:04.891611  1588 raft_consensus.cc:1240] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:04.871872  1660 raft_consensus.cc:1275] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:02:04.874758  5446 log.cc:927] Time spent T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:02:04.859018  5411 consensus_queue.cc:1059] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:02:04.881951  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:04.882696  1663 raft_consensus.cc:1275] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:04.893573  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:04.908008  1588 raft_consensus.cc:2393] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 12: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:04.894263  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:04.908880  1662 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:02:04.850739  5462 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.903066  1666 raft_consensus.cc:1275] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:02:04.926846  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 74235.1us
I20260709 13:02:04.927201  1666 raft_consensus.cc:1275] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:04.859426  5415 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:04.842973  5331 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:04.940809  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 79217.4us
I20260709 13:02:04.881704  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:04.944933  1707 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:02:04.950649  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 85316.7us
I20260709 13:02:04.994557  1556 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:04.996045  1556 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:04.997025  1740 raft_consensus.cc:1275] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:04.993630  1555 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:04.936775  5405 raft_consensus.cc:2749] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:05.012498  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 67688.9us
I20260709 13:02:04.938037  5462 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:04.966945  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:04.994102  5468 log.cc:927] Time spent T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
W20260709 13:02:05.022615  2423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.966713  5336 consensus_queue.cc:1059] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:02:05.012141  5373 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:05.020917  5258 raft_consensus.cc:2749] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:05.021823  5329 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:05.034986  5012 raft_consensus.cc:2804] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:02:05.054965  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 58986.7us
W20260709 13:02:05.056111  2426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.056183  1588 raft_consensus.cc:1275] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:04.992412  5345 consensus_queue.cc:237] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:05.060370  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 57260.6us
I20260709 13:02:05.049475  5373 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:05.083734  5462 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:05.087345  1666 raft_consensus.cc:1275] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:02:05.089692  5238 consensus_queue.cc:1048] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:05.095306  5429 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:05.100628  5287 consensus_meta.cc:287] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.581s	user 0.010s	sys 0.000s
I20260709 13:02:05.100759  5462 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:05.101135  5457 log.cc:927] Time spent T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
W20260709 13:02:05.103569  5417 consensus_meta.cc:287] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.593s	user 0.011s	sys 0.000s
W20260709 13:02:05.107861  5358 consensus_meta.cc:287] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.547s	user 0.005s	sys 0.005s
I20260709 13:02:05.108378  5354 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:05.130640  1741 raft_consensus.cc:1240] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:02:05.113665  5126 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:05.114099  5373 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:05.114499  5458 log.cc:927] Time spent T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
W20260709 13:02:05.116397  5459 log.cc:927] Time spent T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
W20260709 13:02:05.116734  5465 log.cc:927] Time spent T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
W20260709 13:02:05.117045  5470 log.cc:927] Time spent T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:02:05.043903  5405 consensus_queue.cc:1048] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:02:05.053577  5012 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:05.133194  5331 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:05.152251  5461 consensus_queue.cc:1048] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:05.152792  5012 raft_consensus.cc:3060] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:05.153919  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:05.064072  5448 log.cc:927] Time spent T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.220s	user 0.000s	sys 0.002s
I20260709 13:02:05.157351  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:05.119204  4991 consensus_queue.cc:260] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:05.120572  5370 consensus_meta.cc:287] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.600s	user 0.009s	sys 0.000s
I20260709 13:02:05.164050  5370 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:05.166491  5370 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:05.121660  5198 consensus_meta.cc:287] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.571s	user 0.010s	sys 0.000s
I20260709 13:02:05.167452  5198 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:05.157253  5376 consensus_meta.cc:287] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.607s	user 0.007s	sys 0.004s
I20260709 13:02:05.169274  1667 raft_consensus.cc:1240] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:05.130652  5287 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:05.169461  5376 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:05.149595  5238 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.138252  5358 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:05.133049  5291 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:05.149899  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 82361.3us
W20260709 13:02:05.173882  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 111741us
W20260709 13:02:05.198280  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 134033us
I20260709 13:02:05.131933  5417 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:05.131326  5462 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:05.199556  5291 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:05.263778  2424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.204157  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:05.132508  5394 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:05.301538  2426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.203218  5431 raft_consensus.cc:697] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 13 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:05.307108  1660 raft_consensus.cc:1240] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:05.310151  5376 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:05.309445  1733 raft_consensus.cc:1240] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:05.313977  1664 raft_consensus.cc:1240] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
W20260709 13:02:05.314592  1705 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.005s	sys 0.009s
W20260709 13:02:05.314934  1705 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.005s	sys 0.009s
I20260709 13:02:05.318454  5430 consensus_queue.cc:1048] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:05.318802  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:05.320200  5429 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:05.325444  1736 raft_consensus.cc:1240] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:05.325002  5431 consensus_queue.cc:237] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:05.308483  5213 consensus_queue.cc:1048] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:02:05.328984  5287 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:05.334183  5373 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:05.312533  5238 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:05.336707  5012 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:05.339634  5373 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:05.337158  5417 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:05.341698  5012 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:05.341575  5291 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:05.332070  5198 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:05.343562  5394 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:05.432173  1735 raft_consensus.cc:1240] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 13 LEADER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:05.429510  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:05.429257  1736 raft_consensus.cc:1240] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:05.429510  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:05.451124  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:05.452378  1739 raft_consensus.cc:2393] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 7: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:05.408320  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:05.432556  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:05.407179  1586 raft_consensus.cc:1275] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:02:05.384692  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 165867us
I20260709 13:02:05.403607  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:05.458086  5291 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:05.458335  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:05.466691  5475 consensus_queue.cc:1048] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:05.467378  5267 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.383708  1555 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:05.469013  5267 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:05.471412  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 88345.9us
I20260709 13:02:05.452800  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:05.474351  5474 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:05.404723  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:05.473875  5411 consensus_queue.cc:1048] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:02:05.476629  1590 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:05.347625  5238 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:05.382861  1557 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.002s	sys 0.013s
W20260709 13:02:05.488982  1557 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.003s	sys 0.014s
I20260709 13:02:05.431157  1733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3210) took 1106 ms. Trace:
I20260709 13:02:05.493103  1733 rpcz_store.cc:276] 0709 13:02:04.324619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.398523 (+ 73904us) service_pool.cc:224] Handling call
0709 13:02:04.398812 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:05.315247 (+916435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.430584 (+115337us) spinlock_profiling.cc:243] Waited 843 ms on lock 0x7b54000e6854. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:05.430928 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1938992512}
I20260709 13:02:05.405885  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:05.487007  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:02:05.422762  1633 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.019s	user 0.047s	sys 0.065s
I20260709 13:02:05.547448  1732 raft_consensus.cc:1275] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:02:05.547544  1633 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.144s	user 0.049s	sys 0.066s
W20260709 13:02:05.565409  2423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.465946  1556 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:05.582307  5213 consensus_queue.cc:1048] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:02:05.583042  1739 raft_consensus.cc:1240] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:05.579180  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:05.589985  1588 raft_consensus.cc:3060] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:05.590385  5177 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.591219  5177 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:05.573738  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
W20260709 13:02:05.575162  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 1.19503e+06us
I20260709 13:02:05.585005  1739 raft_consensus.cc:1275] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:05.580760  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:05.616730  5456 raft_consensus.cc:3055] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:05.627604  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:02:05.627209  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 123749us
W20260709 13:02:05.628921  5489 log.cc:927] Time spent T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:02:05.653824  5267 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:05.652683  5484 log.cc:927] Time spent T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:02:05.663736  5461 consensus_queue.cc:1059] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:05.666025  5411 raft_consensus.cc:3055] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:05.666476  5411 raft_consensus.cc:740] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:05.666736  1732 raft_consensus.cc:1240] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:05.667582  5411 consensus_queue.cc:260] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:05.671705  1588 raft_consensus.cc:2468] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
W20260709 13:02:05.637770  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 171999us
I20260709 13:02:05.674300  1741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3221) took 1024 ms. Trace:
I20260709 13:02:05.677845  5411 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:05.689852  5487 log.cc:927] Time spent T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:02:05.636790  5336 raft_consensus.cc:2749] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:05.677484  5460 raft_consensus.cc:3055] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:05.622212  5456 raft_consensus.cc:740] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:05.694206  1741 rpcz_store.cc:276] 0709 13:02:04.649829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.649955 (+   126us) service_pool.cc:224] Handling call
0709 13:02:04.650278 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:05.131114 (+480836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.673642 (+542528us) spinlock_profiling.cc:243] Waited 480 ms on lock 0x7b540001de54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:05.674086 (+   444us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1104097024}
I20260709 13:02:05.703454  1590 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
I20260709 13:02:05.693357  5461 consensus_queue.cc:1048] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:02:05.718524  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:05.720265  5198 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.721731  5471 consensus_queue.cc:1048] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:05.722119  1707 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:05.724643  5471 raft_consensus.cc:2749] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:05.725400  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:05.727299  5198 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:05.728152  5441 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:05.732211  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:05.733047  1584 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 8.
I20260709 13:02:05.707106  5460 raft_consensus.cc:740] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:05.734645  1555 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:05.735617  5460 consensus_queue.cc:260] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:05.738085  5213 raft_consensus.cc:2749] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:05.743526  1588 raft_consensus.cc:1240] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:05.773686  1707 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:05.784451  1556 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:05.803036  5341 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:05.803895  5341 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:05.808470  5341 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:05.812600  5471 raft_consensus.cc:2749] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:02:05.827440  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 113112us
W20260709 13:02:05.828424  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 60709us
I20260709 13:02:05.815662  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:05.830888  2426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.833204  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:05.826797  1732 raft_consensus.cc:1275] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:05.830121  5236 raft_consensus.cc:2804] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:05.834605  5236 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:05.835515  5236 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:05.796905  5213 consensus_queue.cc:1059] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:02:05.842406  5267 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.843267  5267 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:05.845304  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 110780us
I20260709 13:02:05.845950  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:05.846971  5267 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:05.847599  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:05.848564  1738 raft_consensus.cc:2393] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 9: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:05.849189  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:05.849344  1732 raft_consensus.cc:1240] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 10. Current term is 11. Ops: []
W20260709 13:02:05.861651  1633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.867429  5336 consensus_queue.cc:1048] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:05.797013  5177 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:05.905680  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:05.912062  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 143232us
I20260709 13:02:05.867830  5198 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:05.914256  1590 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 6.
I20260709 13:02:05.919836  5410 consensus_queue.cc:1059] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:02:05.909794  5267 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.908247  5327 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:05.920639  2548 raft_consensus.cc:1275] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:02:05.953893  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 106491us
I20260709 13:02:05.971590  1707 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:05.377868   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:05.997975  1658 raft_consensus.cc:1275] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:06.025655  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:06.026656  1588 raft_consensus.cc:1240] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:06.027352  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:05.920719  5373 consensus_queue.cc:1048] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.099s
W20260709 13:02:06.014808  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 76686.4us
I20260709 13:02:05.996102  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:06.052953  1736 raft_consensus.cc:1275] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:06.053779  1732 raft_consensus.cc:1240] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 11 LEADER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:05.989199  5252 consensus_queue.cc:1059] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.137s
I20260709 13:02:06.056572  5252 raft_consensus.cc:3055] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:06.006665  1486 catalog_manager.cc:5697] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: config changed from index 5 to 6, VOTER 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) evicted. New cstate: current_term: 4 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:05.989791  5364 raft_consensus.cc:3055] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:05.989295  5340 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:05.989457  5370 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:05.990654  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:06.014967  5407 consensus_queue.cc:1059] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.111s
I20260709 13:02:06.076043  5461 raft_consensus.cc:3055] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:06.077778  5177 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:06.079527  5252 raft_consensus.cc:740] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:06.087088  2426 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:06.087754  1489 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51168 (request call id 132) took 7457 ms. Trace:
W20260709 13:02:06.008569  5463 log.cc:927] Time spent T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.969s	user 0.013s	sys 0.000s
I20260709 13:02:06.092571  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:06.012444  5358 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:05.982597  5267 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:06.083891  5364 raft_consensus.cc:740] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:06.171465  1665 raft_consensus.cc:2468] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
W20260709 13:02:06.174125  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 226376us
I20260709 13:02:06.089659  5471 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:06.093737  5461 raft_consensus.cc:740] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:06.184369  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:06.204100  1590 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 6.
I20260709 13:02:06.208710  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:06.217265  5177 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:06.016557  5456 consensus_queue.cc:260] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:06.082542  5327 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:06.211541  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:06.198629  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:06.118120  5213 consensus_queue.cc:1048] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.095s
I20260709 13:02:06.179067  5291 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:06.249606  5394 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.250394  5438 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:06.250316  5394 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:06.251065  5438 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:06.208787  5460 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:06.255911  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 140427us
W20260709 13:02:06.266396  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 57743.4us
I20260709 13:02:06.115437  5252 consensus_queue.cc:260] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:06.278254  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 192326us
I20260709 13:02:06.270651  1735 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 8.
I20260709 13:02:06.291168  1664 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:02:06.134371  5370 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:06.250346  5177 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:06.298947  5386 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.299355  1662 raft_consensus.cc:1275] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:06.300410  5386 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:06.301105  4991 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:06.304720  5380 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:06.305665  5462 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:06.305508  5380 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:06.305949  1734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3223) took 1652 ms. Trace:
I20260709 13:02:06.306490  5462 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:06.307255  5462 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:06.307786  5380 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:06.306315  1734 rpcz_store.cc:276] 0709 13:02:04.653289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.653397 (+   108us) service_pool.cc:224] Handling call
0709 13:02:04.653688 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:04.709740 (+ 56052us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:04.709773 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:04.710302 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:02:04.841280 (+130978us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:04.841511 (+   231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.841671 (+   160us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:06.007118 (+1165447us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b4400022b4c. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7ddc8c85 00007f1b7ddc96a2 00007f1b80b3b1db 00007f1b80b36aaf 00007f1b80b2a86e 00007f1b80b29bb6 00007f1b80b297d8 00007f1b80b33221 00007f1b80b331d9 00007f1b80b33169
0709 13:02:06.305440 (+298322us) raft_consensus.cc:1685] finished
0709 13:02:06.305469 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:06.305745 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55638,"raft.queue_time_us":55809,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"spinlock_wait_cycles":6484736,"thread_start_us":130379,"threads_started":1,"wal-append.queue_time_us":287015}
I20260709 13:02:06.254910  5341 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:06.313836  5505 log.cc:927] Time spent T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:02:06.313582  5341 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:06.315567  5493 log.cc:927] Time spent T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.243s	user 0.001s	sys 0.001s
W20260709 13:02:06.318018  5507 log.cc:927] Time spent T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 13:02:06.321821  1584 raft_consensus.cc:2410] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:02:06.321481  5364 consensus_queue.cc:260] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:06.323359  5364 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:06.323541  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 55545.5us
I20260709 13:02:06.326377  5345 consensus_queue.cc:1048] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:06.191658  5340 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:06.337615  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:06.338948  5252 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:06.102455  1489 rpcz_store.cc:276] 0709 13:01:58.630543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.630718 (+   175us) service_pool.cc:224] Handling call
0709 13:02:06.087520 (+7456802us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:03.521728 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:03.799422 (+277694us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:03.799460 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:02:03.799480 (+    20us) tablet.cc:662] Decoding operations
0709 13:02:03.800332 (+   852us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:03.800416 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:03.800446 (+    30us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:02:03.801039 (+   593us) tablet.cc:701] Row locks acquired
0709 13:02:03.801059 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:02:03.801255 (+   196us) write_op.cc:270] Start()
0709 13:02:03.801418 (+   163us) write_op.cc:276] Timestamp: P: 1783602123801193 usec, L: 0
0709 13:02:03.801445 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:02:03.802135 (+   690us) log.cc:844] Serialized 2448 byte log entry
0709 13:02:04.400698 (+598563us) op_driver.cc:464] REPLICATION: finished
0709 13:02:04.700841 (+300143us) write_op.cc:301] APPLY: starting
0709 13:02:04.710463 (+  9622us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:04.773530 (+ 63067us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:04.793976 (+ 20446us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:04.902111 (+108135us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:04.961655 (+ 59544us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:02:04.984668 (+ 23013us) write_op.cc:312] APPLY: finished
0709 13:02:05.021231 (+ 36563us) log.cc:844] Serialized 53 byte log entry
0709 13:02:05.040386 (+ 19155us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:05.043412 (+  3026us) write_op.cc:454] Released schema lock
0709 13:02:05.043471 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:05.058953 (+ 15482us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:05.061518 (+  2565us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":856908,"reported_tablets":8,"spinlock_wait_cycles":1408,"child_traces":[["op",{"apply.queue_time_us":278184,"apply.run_cpu_time_us":4743,"apply.run_wall_time_us":353031,"num_ops":6,"prepare.queue_time_us":721938,"prepare.run_cpu_time_us":27854,"prepare.run_wall_time_us":394928,"raft.queue_time_us":341154,"raft.run_cpu_time_us":13165,"raft.run_wall_time_us":175755,"replication_time_us":599094,"thread_start_us":1116662,"threads_started":4,"wal-append.queue_time_us":186905,"wal-append.run_cpu_time_us":22036,"wal-append.run_wall_time_us":2125984}]]}
W20260709 13:02:06.342671  2426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:06.342989  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 385494us
I20260709 13:02:06.343958  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:06.337632  1707 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:06.304078  5386 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:06.358752  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:06.371090  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:02:06.383641  5508 log.cc:927] Time spent T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:02:06.395547  5471 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:06.396227  5471 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:06.398599  5471 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:06.399204  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 104517us
I20260709 13:02:06.399974  1707 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:06.395609  1737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3227) took 1661 ms. Trace:
I20260709 13:02:06.405501  5438 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:06.406280  5438 raft_consensus.cc:2804] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:06.406926  5438 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.407330  5438 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:06.408232  5267 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:06.409304  5126 consensus_queue.cc:1059] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:02:06.410372  5370 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:06.411046  5370 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.411656  5370 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:06.414031  5515 consensus_queue.cc:1059] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:06.414579  1705 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:06.415041  5177 raft_consensus.cc:2804] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:06.415571  5177 raft_consensus.cc:697] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:06.418509  5327 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:06.369630  5213 consensus_queue.cc:1048] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:02:06.261565  5461 consensus_queue.cc:260] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:06.422277  5461 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:06.422684  5462 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:06.367142  1486 catalog_manager.cc:5697] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 6 to 7, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 7 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:06.296370  5291 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:06.405915  1737 rpcz_store.cc:276] 0709 13:02:04.711854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.712741 (+   887us) service_pool.cc:224] Handling call
0709 13:02:04.727930 (+ 15189us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:04.768781 (+ 40851us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:04.768814 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:04.769295 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 13:02:05.484478 (+715183us) spinlock_profiling.cc:243] Waited 4.13 ms on lock 0x7b18003ab9a0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7de84e07 00007f1b86cdfab9 00007f1b7dea169b 00007f1b7de9f93f 00007f1b7dea1c02 00007f1b80b2920b 00007f1b80b2ed23 00007f1b80b2f0d1 00007f1b80f4aa0f
0709 13:02:05.706570 (+222092us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:05.706621 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.715321 (+  8700us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:06.327563 (+612242us) raft_consensus.cc:1685] finished
0709 13:02:06.327596 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:06.373377 (+ 45781us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62900,"raft.queue_time_us":70454,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":19475,"spinlock_wait_cycles":9509248,"thread_start_us":110355,"threads_started":1,"wal-append.queue_time_us":1011757}
I20260709 13:02:06.429029  5515 raft_consensus.cc:3055] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:06.427719  5340 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:06.414703  5266 raft_consensus.cc:2804] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:06.461629  5012 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.461944  5217 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.462306  5012 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:06.462744  5516 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:06.462545  5217 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:06.463275  5516 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:06.451455  5126 consensus_queue.cc:1243] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer 5ced62816f8545cd9b63a27e9055e42d log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:02:06.465268  1486 catalog_manager.cc:5697] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 6 to 8, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:02:06.466250  5431 raft_consensus.cc:2804] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:06.466854  5431 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:06.467319  5431 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:06.468538  5341 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:02:06.416682  5177 consensus_queue.cc:237] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:06.439504  5474 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.464769  5012 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:06.468137  1486 catalog_manager.cc:5697] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 6 to 7, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 7 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:06.446174  5252 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:06.480266  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 186849us
I20260709 13:02:06.488514  1705 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:06.453293  5515 raft_consensus.cc:740] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:06.494976  5202 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.496315  5202 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:06.492925  5236 consensus_meta.cc:287] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.654s	user 0.010s	sys 0.006s
I20260709 13:02:06.498332  5236 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:06.469266  5405 raft_consensus.cc:3055] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:06.499151  5405 raft_consensus.cc:740] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:06.500123  5474 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:06.500473  5405 consensus_queue.cc:260] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:06.501634  5405 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:06.502460  5474 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:06.503208  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:06.503855  1662 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 6.
I20260709 13:02:06.506028  5456 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:06.507236  5291 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:06.500957  5236 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:06.509461  2426 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:06.511521  5515 consensus_queue.cc:260] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:06.514678  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:06.515462  1665 raft_consensus.cc:2393] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 in current term 7: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:06.514282  1486 catalog_manager.cc:5697] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: config changed from index 5 to 4, term changed from 5 to 6, leader changed from <none> to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from VOTER to NON_VOTER, now has a pending config: VOTER 6d4de2ce0683442498244b9529127f91 (127.0.107.193), VOTER 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194), VOTER 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195), VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 6 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:02:06.470224  5516 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:06.516440  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:06.494097  5012 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:06.517258  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:06.517949  1665 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 7.
I20260709 13:02:06.508194  5266 raft_consensus.cc:697] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 11 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:06.459165  5340 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.525144  2424 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:06.525436  5340 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:06.527597  5341 raft_consensus.cc:2804] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:06.528057  5341 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:06.528429  5341 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:06.527629  5340 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:06.544799  1725 tablet_service.cc:1558] Processing DeleteTablet for tablet ae1310c9ee464797a39b786c1d932941 with delete_type TABLET_DATA_TOMBSTONED (TS 5ced62816f8545cd9b63a27e9055e42d not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:43674
I20260709 13:02:06.512915  5515 raft_consensus.cc:3060] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:06.549165  5474 consensus_queue.cc:1059] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:06.550415  5474 raft_consensus.cc:3055] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:06.551159  5474 raft_consensus.cc:740] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:06.552248  5474 consensus_queue.cc:260] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:06.553588  5474 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:06.550590  5394 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:06.516924  1486 catalog_manager.cc:5697] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:02:06.556996  1633 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:06.570181  5341 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:06.572109  1633 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:06.572860  5394 raft_consensus.cc:2749] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:06.574539  5441 consensus_meta.cc:287] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent flushing consensus metadata: real 0.846s	user 0.015s	sys 0.002s
I20260709 13:02:06.580614  5327 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.580906  1633 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:06.581218  5327 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:06.582513  1633 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:02:06.583494  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 131561us
I20260709 13:02:06.583977  1633 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:06.584986  5521 raft_consensus.cc:2804] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:06.585575  5521 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:06.579257  5340 raft_consensus.cc:2749] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:06.586083  5521 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:06.586689  5340 raft_consensus.cc:2804] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:06.587193  5340 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:06.587630  5340 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:06.585698  5327 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:06.590948  5291 consensus_queue.cc:1048] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:06.591945  5012 consensus_queue.cc:1059] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:06.593585  5358 raft_consensus.cc:3055] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:06.593822  5341 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:06.593990  5358 raft_consensus.cc:740] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:06.595912  5358 consensus_queue.cc:260] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:06.597843  5370 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:06.598407  5358 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:06.520565  5266 consensus_queue.cc:237] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:06.605804  5341 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:06.605836  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 113862us
I20260709 13:02:06.609769  5441 consensus_queue.cc:1048] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:06.611265  5441 consensus_queue.cc:1059] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:06.612658  5456 raft_consensus.cc:3055] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:06.613034  5456 raft_consensus.cc:740] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:06.613986  5456 consensus_queue.cc:260] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:06.615707  5456 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:06.619333  2425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.629843  1590 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 12.
I20260709 13:02:06.658675  1556 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:02:06.662823  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 171590us
W20260709 13:02:06.665038  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 56069.4us
W20260709 13:02:06.666036  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.668468  1662 raft_consensus.cc:1240] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:06.669787  1660 raft_consensus.cc:1240] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:06.670934  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:06.672190  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:06.672986  1663 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
W20260709 13:02:06.682245  5411 consensus_meta.cc:287] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.969s	user 0.014s	sys 0.000s
I20260709 13:02:06.486282  5217 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:06.693044  5394 raft_consensus.cc:2749] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:06.693900  5405 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:06.694160  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:06.694954  1663 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:06.694649  5405 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:06.617442  5202 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:06.689314  5407 raft_consensus.cc:2804] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:06.688853  5291 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.492471  5252 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:06.711623  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:06.710222  2424 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:06.714356  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:06.715090  1662 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:06.714406  5341 raft_consensus.cc:2804] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:06.715731  5341 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.716041  5341 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:06.640661  5340 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:06.720650  1556 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:06.722790  1663 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:02:06.684617  5373 consensus_queue.cc:1048] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:02:06.727324  1665 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
W20260709 13:02:06.729871  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 146046us
I20260709 13:02:06.708262  5407 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:06.724483  5461 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:06.726547  5217 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:06.723506  5291 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:06.749747  5407 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:06.771016  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:06.791608  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:06.774189  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:06.791888  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:06.804577  5329 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:06.804886  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:06.806412  5217 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:06.808233  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:06.809490  1666 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.015s	sys 0.032s
W20260709 13:02:06.809854  1666 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.015s	sys 0.033s
I20260709 13:02:06.813301  1633 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:06.814992  5340 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:06.819511  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:06.805154  1630 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.013s	sys 0.045s
W20260709 13:02:06.823606  1630 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.013s	sys 0.045s
I20260709 13:02:06.809340  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:02:06.827425  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 54578.8us
I20260709 13:02:06.828274  1662 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 7.
I20260709 13:02:06.821065  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:06.836542  5410 consensus_queue.cc:1048] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:06.837255  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:06.839051  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:06.839553  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:06.841485  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 78205.8us
I20260709 13:02:06.842024  5517 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:06.842667  1633 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:06.843108  5517 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:06.844748  5340 raft_consensus.cc:2804] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:06.845232  5340 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:06.845631  5340 raft_consensus.cc:3060] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:06.849393  5526 raft_consensus.cc:2749] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:06.849267  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:06.850248  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:06.850930  1741 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:02:06.852807  5528 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:06.853678  5528 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:06.853863  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:06.854712  1592 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 6.
I20260709 13:02:06.855479  1732 raft_consensus.cc:1240] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:06.855916  5528 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:06.852876  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:06.858057  5291 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:06.858598  5364 consensus_meta.cc:287] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.535s	user 0.014s	sys 0.002s
I20260709 13:02:06.859444  1584 raft_consensus.cc:2410] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:02:06.859968  5252 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:06.792973  5515 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
W20260709 13:02:06.822372  5460 consensus_meta.cc:287] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.537s	user 0.007s	sys 0.003s
I20260709 13:02:06.840211  5530 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.866284  1589 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 7.
I20260709 13:02:06.866811  5530 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:06.867666  5461 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:06.869372  1589 raft_consensus.cc:1240] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:06.869736  5461 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:06.873498  5530 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:06.875367  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:06.876353  1633 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:02:06.879943  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.883268  2426 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:06.861619  1588 raft_consensus.cc:1275] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:02:06.808909  5217 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:06.921298  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:06.922013  1665 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 13.
I20260709 13:02:06.886521  1588 pending_rounds.cc:85] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91: Aborting all ops after (but not including) 6
I20260709 13:02:06.916996  1586 raft_consensus.cc:2468] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 7.
I20260709 13:02:06.932507  2424 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:06.864490  5515 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:06.893360  5530 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:06.873580  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:06.773253  5438 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:06.923470  1588 pending_rounds.cc:107] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:02:06.950937  1588 raft_consensus.cc:2889] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:06.899387  5441 raft_consensus.cc:2749] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:06.937625  5475 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.904s	user 0.006s	sys 0.033s
I20260709 13:02:06.966912  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:06.967760  2543 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
I20260709 13:02:06.873009  5341 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:06.970592  5364 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:06.971318  5364 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:06.972566  5341 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 8 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
W20260709 13:02:06.977497  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 96120.1us
W20260709 13:02:06.980110  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 104032us
I20260709 13:02:06.980965  1633 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:06.981503  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:06.981895  5364 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:06.982297  1663 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:06.982770  1633 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:06.983685  5524 raft_consensus.cc:2804] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:06.984135  1633 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:06.984207  5524 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:06.985071  5524 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:06.985529  5530 raft_consensus.cc:2749] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:06.992376  1556 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:02:06.974718  5475 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.942s	user 0.007s	sys 0.034s
I20260709 13:02:06.998878  1556 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:07.001263  1704 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:07.001591  1556 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:07.002319  5358 raft_consensus.cc:2804] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:07.002766  5358 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.003397  5358 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:06.962273  2540 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:02:07.006728  5364 raft_consensus.cc:2804] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:07.007388  5364 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.007893  5364 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:07.002620  5475 raft_consensus.cc:2804] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:07.009403  5475 raft_consensus.cc:697] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:07.010353  5475 consensus_queue.cc:237] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:06.953042  5405 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:07.016120  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:07.020228  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:07.021934  1660 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
W20260709 13:02:06.834506  4991 consensus_meta.cc:287] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.533s	user 0.014s	sys 0.000s
I20260709 13:02:07.023418  1667 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:02:07.024369  5267 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.025243  5267 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:07.031008  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:07.032300  1664 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:02:07.034698  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:07.035456  1586 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:07.038899  5515 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:07.041004  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:07.071533  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:07.050423  5518 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:07.178284  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:07.184105  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:07.204203  1705 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.003s	sys 0.026s
I20260709 13:02:07.165586  1733 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
W20260709 13:02:07.213148  1705 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.003s	sys 0.026s
W20260709 13:02:07.213676  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 529858us
W20260709 13:02:07.218307  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 234241us
W20260709 13:02:07.218986  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.219403  1663 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 8.
I20260709 13:02:07.177801  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:07.219347  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:07.220988  1664 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 10.
W20260709 13:02:07.068509  5177 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.012s	sys 0.017s
I20260709 13:02:07.235127  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:07.245450  1588 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
W20260709 13:02:07.211586  5266 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.005s	sys 0.023s
I20260709 13:02:07.231340  2424 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:07.273564  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:07.220343  5518 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.298811  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:07.276795  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:07.316241  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 85077us
I20260709 13:02:07.331835  2424 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:07.327802  1588 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
W20260709 13:02:07.244822  5177 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.014s	sys 0.017s
I20260709 13:02:07.282765  5338 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:07.268486  5266 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.006s	sys 0.023s
I20260709 13:02:07.275981  5267 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:07.466507  1737 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.013s	sys 0.011s
W20260709 13:02:07.467532  1737 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.014s	sys 0.011s
I20260709 13:02:07.510033  1658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3180) took 1415 ms. Trace:
I20260709 13:02:07.513638  5338 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:07.334100  5518 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:07.612880  1633 leader_election.cc:400] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 7. Current term is 8.
I20260709 13:02:07.613920  1633 leader_election.cc:403] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:02:07.339339  5456 raft_consensus.cc:2804] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:07.277591  5517 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:07.282287  5373 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:07.510900  1658 rpcz_store.cc:276] 0709 13:02:06.094612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.094807 (+   195us) service_pool.cc:224] Handling call
0709 13:02:06.100130 (+  5323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:06.329919 (+229789us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:06.329962 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:06.428828 (+ 98866us) log.cc:844] Serialized 26 byte log entry
0709 13:02:06.886271 (+457443us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:06.933360 (+ 47089us) log.cc:844] Serialized 14 byte log entry
0709 13:02:06.933671 (+   311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:06.933760 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:07.509615 (+575855us) raft_consensus.cc:1685] finished
0709 13:02:07.509661 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:07.509923 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2620,"prepare.queue_time_us":45535,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":261713,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":39440,"spinlock_wait_cycles":8780544,"thread_start_us":558038,"threads_started":2,"wal-append.queue_time_us":804857}
I20260709 13:02:07.356159  5202 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:07.424665  5441 raft_consensus.cc:2804] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:02:07.465826  5329 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.008s	sys 0.016s
I20260709 13:02:07.679514  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:07.683943  5438 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:07.695820  1479 maintenance_manager.cc:419] P 5b36a7ca64a64fb998a5720e2ed486da: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033346
W20260709 13:02:07.688859  1586 consensus_meta.cc:287] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.653s	user 0.010s	sys 0.011s
I20260709 13:02:07.713542  1586 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 8.
W20260709 13:02:07.673518  5521 consensus_meta.cc:287] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 1.087s	user 0.013s	sys 0.004s
W20260709 13:02:07.708124  5431 consensus_meta.cc:287] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 1.240s	user 0.016s	sys 0.001s
W20260709 13:02:07.707744  5340 consensus_meta.cc:287] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.862s	user 0.016s	sys 0.000s
W20260709 13:02:07.704291  5329 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.010s	sys 0.016s
I20260709 13:02:07.615294  5380 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:07.711576  5475 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.007s	sys 0.040s
I20260709 13:02:07.694011  5456 raft_consensus.cc:697] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:07.711139  5267 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 7. Current term is 8.
I20260709 13:02:07.706991  5441 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:07.788954  5340 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:07.708647  2550 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
W20260709 13:02:07.803428  1584 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.846s	user 0.017s	sys 0.025s
I20260709 13:02:07.761518  5405 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:07.789325  5475 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.007s	sys 0.040s
W20260709 13:02:07.811879  1584 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.017s	sys 0.028s
W20260709 13:02:07.802567  1583 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.980s	user 0.082s	sys 0.228s
I20260709 13:02:07.782620  5329 raft_consensus.cc:697] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:07.753871  5525 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:08.004948  1661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3193) took 1280 ms. Trace:
W20260709 13:02:08.041559  1557 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.003s	sys 0.007s
W20260709 13:02:08.123661  1557 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.003s	sys 0.009s
I20260709 13:02:08.121069  1555 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:02:07.991592  1705 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.004s	sys 0.005s
W20260709 13:02:08.126897  1705 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.884s	user 0.007s	sys 0.007s
W20260709 13:02:08.127717  1583 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.306s	user 0.123s	sys 0.267s
W20260709 13:02:08.021442  1664 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.016s	sys 0.041s
W20260709 13:02:08.128548  1664 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.856s	user 0.016s	sys 0.049s
W20260709 13:02:07.991748  1556 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.006s	sys 0.003s
W20260709 13:02:08.129623  1556 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.829s	user 0.010s	sys 0.003s
W20260709 13:02:08.042378  1704 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.802s	user 0.001s	sys 0.009s
W20260709 13:02:08.130293  1704 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.909s	user 0.003s	sys 0.010s
W20260709 13:02:07.876518  1660 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.848s	user 0.019s	sys 0.033s
W20260709 13:02:07.920946  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 553735us
W20260709 13:02:08.131422  1660 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.103s	user 0.025s	sys 0.037s
W20260709 13:02:07.860262  1590 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.000s	user 0.013s	sys 0.048s
I20260709 13:02:07.957376  1667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39146 (request call id 3188) took 1278 ms. Trace:
W20260709 13:02:07.801375  5407 consensus_meta.cc:287] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.998s	user 0.012s	sys 0.002s
W20260709 13:02:08.004951  2554 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.005s	sys 0.003s
W20260709 13:02:08.117636  1707 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.875s	user 0.025s	sys 0.060s
W20260709 13:02:08.044931  1558 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.006s	sys 0.009s
I20260709 13:02:07.940613  1734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3253) took 1146 ms. Trace:
W20260709 13:02:08.176225  2554 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.920s	user 0.005s	sys 0.007s
I20260709 13:02:07.917589  1665 raft_consensus.cc:2393] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 4: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:08.175339  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:08.178435  1735 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 6.
I20260709 13:02:08.051832  1737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3249) took 1298 ms. Trace:
I20260709 13:02:08.132164  1660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3197) took 1107 ms. Trace:
W20260709 13:02:08.176397  1707 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.933s	user 0.028s	sys 0.063s
W20260709 13:02:08.132529  1590 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.272s	user 0.018s	sys 0.053s
I20260709 13:02:08.181000  1737 rpcz_store.cc:276] 0709 13:02:06.753161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.753336 (+   175us) service_pool.cc:224] Handling call
0709 13:02:06.766817 (+ 13481us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:06.770671 (+  3854us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:06.770715 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:06.835690 (+ 64975us) log.cc:844] Serialized 26 byte log entry
0709 13:02:07.468821 (+633131us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:07.469034 (+   213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.469311 (+   277us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:08.051272 (+581961us) raft_consensus.cc:1685] finished
0709 13:02:08.051317 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.051554 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23709,"raft.queue_time_us":601,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":44847,"thread_start_us":525049,"threads_started":1,"wal-append.queue_time_us":1017179}
I20260709 13:02:07.802623  5441 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:08.214128  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 992390us
W20260709 13:02:08.211130  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:08.176801  1558 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.011s	sys 0.014s
I20260709 13:02:08.217579  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:08.133852  1667 rpcz_store.cc:276] 0709 13:02:06.668412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.670593 (+  2181us) service_pool.cc:224] Handling call
0709 13:02:07.946312 (+1275719us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b5400358ed4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:07.946486 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":808876928}
I20260709 13:02:08.177146  1734 rpcz_store.cc:276] 0709 13:02:06.794510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.794682 (+   172us) service_pool.cc:224] Handling call
0709 13:02:06.810029 (+ 15347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:06.810471 (+   442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:06.810500 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:06.810983 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 13:02:07.250765 (+439782us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:07.250812 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.250999 (+   187us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:07.940318 (+689319us) raft_consensus.cc:1685] finished
0709 13:02:07.940349 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:07.940526 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1513,"raft.queue_time_us":14865,"raft.run_cpu_time_us":321,"raft.run_wall_time_us":70187,"thread_start_us":439187,"threads_started":1,"wal-append.queue_time_us":1063260}
I20260709 13:02:08.219544  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:08.185005  2554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49238 (request call id 429) took 1314 ms. Trace:
I20260709 13:02:08.123607  1661 rpcz_store.cc:276] 0709 13:02:06.702083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.702218 (+   135us) service_pool.cc:224] Handling call
0709 13:02:06.717497 (+ 15279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:06.717878 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:06.717907 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:06.718553 (+   646us) log.cc:844] Serialized 26 byte log entry
0709 13:02:07.174300 (+455747us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:07.176573 (+  2273us) log.cc:844] Serialized 14 byte log entry
0709 13:02:07.177789 (+  1216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.178054 (+   265us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:07.981968 (+803914us) raft_consensus.cc:1685] finished
0709 13:02:07.982007 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:07.982211 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":424,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":67,"raft.queue_time_us":5453,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":20699,"spinlock_wait_cycles":4736,"thread_start_us":383674,"threads_started":1,"wal-append.queue_time_us":1075139}
I20260709 13:02:07.760157  5521 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:07.957165  5358 consensus_meta.cc:287] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.953s	user 0.015s	sys 0.001s
W20260709 13:02:08.069675  5533 log.cc:927] Time spent T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.901s	user 0.000s	sys 0.009s
I20260709 13:02:07.941514  5546 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:08.224732  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 962869us
W20260709 13:02:07.991375  5364 consensus_meta.cc:287] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.973s	user 0.011s	sys 0.003s
W20260709 13:02:07.970997  5479 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.005s	sys 0.004s
W20260709 13:02:07.919227  5126 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.945s	user 0.008s	sys 0.053s
I20260709 13:02:07.812402  5373 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:08.075836  5552 log.cc:927] Time spent T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:02:07.987813  5524 consensus_meta.cc:287] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 1.002s	user 0.020s	sys 0.000s
I20260709 13:02:08.089300  5515 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.237826  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:02:07.856562  5520 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.862s	user 0.015s	sys 0.037s
I20260709 13:02:08.230027  5410 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.811707  5338 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:07.993992  2537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49238 (request call id 433) took 1121 ms. Trace:
I20260709 13:02:08.224309  5531 raft_consensus.cc:2804] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:08.042584  5528 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:08.242241  5474 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.219007  5267 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:08.218130  5407 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:08.246436  5358 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:08.306133  5520 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.358s	user 0.027s	sys 0.051s
I20260709 13:02:07.966701  5340 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:08.233451  5012 consensus_queue.cc:1059] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:02:08.237242  1556 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:08.250823  5560 consensus_queue.cc:1048] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:08.254163  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:07.873054  5517 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.228865  2554 rpcz_store.cc:276] 0709 13:02:06.870555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.904364 (+ 33809us) service_pool.cc:224] Handling call
0709 13:02:06.945271 (+ 40907us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:06.963538 (+ 18267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:06.963582 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:07.055374 (+ 91792us) log.cc:844] Serialized 26 byte log entry
0709 13:02:08.177637 (+1122263us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:08.177676 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.177759 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:08.177804 (+    45us) raft_consensus.cc:1685] finished
0709 13:02:08.177818 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.184929 (+  7111us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9116,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":84,"spinlock_wait_cycles":1534208,"thread_start_us":921111,"threads_started":1,"wal-append.queue_time_us":950242}
I20260709 13:02:08.184746  5475 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:07.758915  5202 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:08.182554  1660 rpcz_store.cc:276] 0709 13:02:07.024691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.025203 (+   512us) service_pool.cc:224] Handling call
0709 13:02:07.026008 (+   805us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:07.026854 (+   846us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:07.026895 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:07.027881 (+   986us) log.cc:844] Serialized 26 byte log entry
0709 13:02:08.131905 (+1104024us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:08.131935 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.131986 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:08.132019 (+    33us) raft_consensus.cc:1685] finished
0709 13:02:08.132027 (+     8us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.132115 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":149,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":201,"thread_start_us":1103493,"threads_started":1,"wal-append.queue_time_us":940097}
I20260709 13:02:08.175558  5411 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.789188  5431 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:08.141968  5525 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:07.857218  5405 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:07.813575  5380 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:07.967202  5456 consensus_queue.cc:237] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:08.285959  5126 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.312s	user 0.016s	sys 0.066s
W20260709 13:02:08.298466  1662 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.040s	sys 0.039s
W20260709 13:02:08.357868  1662 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.041s	sys 0.039s
W20260709 13:02:08.330358  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 46816.3us
I20260709 13:02:08.358688  1664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3202) took 1288 ms. Trace:
W20260709 13:02:08.304162  5479 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.004s	user 0.007s	sys 0.023s
I20260709 13:02:08.291675  5551 raft_consensus.cc:2804] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:08.359063  1664 rpcz_store.cc:276] 0709 13:02:07.181305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.271843 (+ 90538us) service_pool.cc:224] Handling call
0709 13:02:07.272397 (+   554us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.272591 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:08.128941 (+856350us) log.cc:844] Serialized 14 byte log entry
0709 13:02:08.358354 (+229413us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:08.358403 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:08.358441 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.358504 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.358635 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23651,"prepare.queue_time_us":45579,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":78161,"thread_start_us":1061324,"threads_started":3,"wal-append.queue_time_us":206743}
I20260709 13:02:08.288204  5555 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:08.346293  5461 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:08.276489  5546 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:08.370424  1590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2623) took 1558 ms. Trace:
I20260709 13:02:08.350354  1587 raft_consensus.cc:1240] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:08.286989  5549 consensus_queue.cc:1059] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:02:08.332967  5338 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
W20260709 13:02:08.326083  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 107148us
I20260709 13:02:08.359886  5012 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:08.304508  5524 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:08.347232  5517 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:08.247466  5518 consensus_meta.cc:287] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.571s	user 0.013s	sys 0.004s
I20260709 13:02:08.312422  5515 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:08.279631  5364 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:08.372834  5340 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.368487  5551 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:08.374178  5405 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:08.374470  5567 log.cc:927] Time spent T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da: Append to log took a long time: real 0.090s	user 0.001s	sys 0.001s
I20260709 13:02:08.423313  1589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2628) took 1616 ms. Trace:
W20260709 13:02:08.418298  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 49800.7us
I20260709 13:02:08.339713  5267 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:08.370817  1590 rpcz_store.cc:276] 0709 13:02:06.805503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.840371 (+ 34868us) service_pool.cc:224] Handling call
0709 13:02:06.840796 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:06.860108 (+ 19312us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:08.220327 (+1360219us) log.cc:844] Serialized 14 byte log entry
0709 13:02:08.355376 (+135049us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:08.355461 (+    85us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:08.362961 (+  7500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.363054 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.363532 (+   478us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1068311,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"thread_start_us":1427043,"threads_started":2}
I20260709 13:02:08.360659  1738 raft_consensus.cc:2368] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for earlier term 7. Current term is 8.
I20260709 13:02:08.344576  5474 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:08.367735  5460 raft_consensus.cc:2804] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:08.335769  5410 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:08.446328  5340 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:08.463637  1705 connection.cc:256] RPC call timeout handler was delayed by -1.1701632779999613s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1647s for a response
I20260709 13:02:08.360850  1732 raft_consensus.cc:1240] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:08.343261  5528 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:08.308326  5329 consensus_queue.cc:237] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:08.350855  5411 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:08.429522  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 192483us
I20260709 13:02:08.352900  5475 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:08.446666  1633 leader_election.cc:400] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 5 pre-election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 5. Current term is 6.
I20260709 13:02:08.427722  5571 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:08.329402  2537 rpcz_store.cc:276] 0709 13:02:06.872015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.877417 (+  5402us) service_pool.cc:224] Handling call
0709 13:02:06.878208 (+   791us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:06.996663 (+118455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:06.996698 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:06.996760 (+    62us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:06.996832 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.993444 (+996612us) spinlock_profiling.cc:243] Waited 99.5 ms on lock 0x7b5400133654. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:07.993515 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:07.993725 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":228838784}
I20260709 13:02:08.405752  5461 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:08.460778  1589 rpcz_store.cc:276] 0709 13:02:06.806840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.870126 (+ 63286us) service_pool.cc:224] Handling call
0709 13:02:06.870445 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:06.977468 (+107023us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:06.977502 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:06.987752 (+ 10250us) log.cc:844] Serialized 26 byte log entry
0709 13:02:07.470006 (+482254us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:07.470098 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.470211 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:08.419708 (+949497us) raft_consensus.cc:1685] finished
0709 13:02:08.419731 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.423221 (+  3490us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":106611,"raft.queue_time_us":108976,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":136,"thread_start_us":445399,"threads_started":1,"wal-append.queue_time_us":999470}
I20260709 13:02:08.438994  5518 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:08.473217  5574 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:08.473296  5515 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:08.475922  5524 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:08.474844  5474 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:08.475922  5546 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:08.478760  5410 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:08.362445  5577 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:08.445516  5551 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:08.511907  1556 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:08.463299  5560 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.470243  5521 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:08.375216  5555 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:08.554840  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:08.578692  2554 raft_consensus.cc:2393] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 9: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:02:08.434267  5012 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:08.580651  5518 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:08.605443  5012 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:08.574440  5407 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:08.575408  5267 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:08.568053  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:08.574899  5380 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:08.608276  5380 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:08.576366  5541 log.cc:927] Time spent T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.687s	user 0.001s	sys 0.002s
I20260709 13:02:08.608786  5380 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:08.610493  5202 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:08.610352  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 98578.8us
I20260709 13:02:08.611101  5380 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:08.611814  5380 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:08.612282  5380 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:08.574569  5373 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:08.613597  5373 raft_consensus.cc:2804] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:08.613983  5373 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:08.614336  5373 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:08.614545  1666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3179) took 2621 ms. Trace:
I20260709 13:02:08.438055  5338 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:08.474540  5568 log.cc:927] Time spent T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:02:08.618666  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:08.619292  5364 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:08.619402  2537 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:02:08.621821  2554 raft_consensus.cc:1240] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:08.478765  5340 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:08.621856  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 192874us
I20260709 13:02:08.615293  1666 rpcz_store.cc:276] 0709 13:02:05.993025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.041606 (+ 48581us) service_pool.cc:224] Handling call
0709 13:02:06.052160 (+ 10554us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:06.810161 (+758001us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:06.810196 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:06.810792 (+   596us) log.cc:844] Serialized 26 byte log entry
0709 13:02:07.212097 (+401305us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:07.212145 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.212206 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:08.429954 (+1217748us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b4400022b4c. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7ddc8c85 00007f1b7ddc96a2 00007f1b80b3b1db 00007f1b80b36aaf 00007f1b80b2a86e 00007f1b80b29bb6 00007f1b80b297d8 00007f1b80b33221 00007f1b80b331d9 00007f1b80b33169
0709 13:02:08.614086 (+184132us) raft_consensus.cc:1685] finished
0709 13:02:08.614115 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.614409 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31078,"raft.queue_time_us":253714,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"spinlock_wait_cycles":28247424,"thread_start_us":1110429,"threads_started":2,"wal-append.queue_time_us":953475}
I20260709 13:02:08.611184  5202 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:08.634073  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 274472us
I20260709 13:02:08.574590  5525 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:08.636142  1558 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:08.574082  5531 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:08.574807  5573 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:08.643916  5521 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.644394  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:08.644599  5521 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:08.647284  5521 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:08.647394  1585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2637) took 1703 ms. Trace:
I20260709 13:02:08.648247  1585 rpcz_store.cc:276] 0709 13:02:06.949532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.668470 (+718938us) service_pool.cc:224] Handling call
0709 13:02:07.676017 (+  7547us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.341957 (+665940us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:08.342000 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:08.342052 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:08.342082 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.647065 (+304983us) spinlock_profiling.cc:243] Waited 653 ms on lock 0x7b54001d2ed4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:08.647120 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.647248 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1502614912}
W20260709 13:02:08.658262  5565 log.cc:927] Time spent T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 13:02:08.659631  1662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3199) took 1597 ms. Trace:
I20260709 13:02:08.642690  5525 raft_consensus.cc:2804] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:08.660108  1662 rpcz_store.cc:276] 0709 13:02:07.062261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.210867 (+148606us) service_pool.cc:224] Handling call
0709 13:02:07.246870 (+ 36003us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:07.321884 (+ 75014us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:07.321932 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:07.424485 (+102553us) log.cc:844] Serialized 26 byte log entry
0709 13:02:08.358416 (+933931us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:08.358449 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.358506 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:08.659357 (+300851us) raft_consensus.cc:1685] finished
0709 13:02:08.659381 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.659569 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":509,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":101091,"thread_start_us":598663,"threads_started":1,"wal-append.queue_time_us":735596}
I20260709 13:02:08.660681  1555 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:08.623936  5358 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:08.562058  5574 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:08.702786  1665 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39146 (request call id 3203) took 1520 ms (client timeout 2000 ms). Trace:
I20260709 13:02:08.551301  5571 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:08.703449  1665 rpcz_store.cc:269] 0709 13:02:07.182081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.183720 (+  1639us) service_pool.cc:224] Handling call
0709 13:02:08.702528 (+1518808us) spinlock_profiling.cc:243] Waited 665 ms on lock 0x7b5400043654. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:08.702697 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1529658752}
W20260709 13:02:08.725698  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 82231.3us
I20260709 13:02:08.641463  5364 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.661451  5531 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:08.707719  1584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2624) took 1902 ms. Trace:
I20260709 13:02:08.729839  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:08.731945  5574 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:08.632321  5441 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:08.732291  1556 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:02:08.779973  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 47766.1us
I20260709 13:02:08.780769  5441 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:08.621485  5560 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:08.781370  5579 raft_consensus.cc:2804] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:08.781956  5579 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:08.726715  5336 raft_consensus.cc:2804] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:08.782428  5579 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:08.782680  5336 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:08.783193  5336 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:08.733525  5461 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:08.735087  5528 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:08.736557  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:08.786715  2548 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 7.
I20260709 13:02:08.737783  1738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43678 (request call id 3267) took 1514 ms. Trace:
I20260709 13:02:08.787768  1738 rpcz_store.cc:276] 0709 13:02:07.223291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.223554 (+   263us) service_pool.cc:224] Handling call
0709 13:02:08.737571 (+1514017us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540001d954. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:08.737697 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2361682816}
I20260709 13:02:08.621945  5577 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:08.791028  1583 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.039s	sys 0.100s
I20260709 13:02:08.758939  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:08.791776  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:08.791977  1585 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:08.760363  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:08.761541  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:08.762480  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 63741.9us
I20260709 13:02:08.632200  5202 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:08.665333  5525 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:08.794677  1666 raft_consensus.cc:1275] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:02:08.755095  1584 rpcz_store.cc:276] 0709 13:02:06.805763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.860844 (+ 55081us) service_pool.cc:224] Handling call
0709 13:02:06.861193 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:06.930567 (+ 69374us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:08.125821 (+1195254us) log.cc:844] Serialized 14 byte log entry
0709 13:02:08.376953 (+251132us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:08.423303 (+ 46350us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:08.423351 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.658883 (+235532us) spinlock_profiling.cc:243] Waited 3.96 ms on lock 0x7b18002c4100. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7de702a6 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419
0709 13:02:08.707411 (+ 48528us) spinlock_profiling.cc:243] Waited 27.7 ms on lock 0x7b54000375d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:08.707472 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.707641 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15238,"prepare.queue_time_us":988237,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":26580,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":50123,"spinlock_wait_cycles":72896256,"thread_start_us":1290924,"threads_started":3,"wal-append.queue_time_us":314328}
I20260709 13:02:08.643364  5573 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:08.765447  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:08.768316  5373 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:08.759598  5516 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:08.775830  5380 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:08.776718  5267 consensus_queue.cc:1059] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:08.778803  5431 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:08.665937  5338 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:08.738062  5555 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:08.734112  5517 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:08.702916  1704 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:08.793298  1660 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
W20260709 13:02:08.793915  1583 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.040s	sys 0.100s
I20260709 13:02:08.796811  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:08.797309  5525 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:08.799165  5202 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:08.791126  1630 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:08.812466  1667 raft_consensus.cc:2393] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 9: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:08.814496  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:08.753203  5340 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:08.752930  5521 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:08.811079  2426 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:02:08.870760  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 59862us
I20260709 13:02:08.838143  5516 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:08.872294  2426 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:08.821236  5573 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:08.822996  5564 log.cc:927] Time spent T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.715s	user 0.003s	sys 0.000s
I20260709 13:02:08.824429  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:08.873723  1666 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:08.783200  5560 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:08.789381  2543 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:08.793576  1707 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 2.244s (SENT) [suppressed 13 similar messages]
W20260709 13:02:08.877832  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 84278.5us
I20260709 13:02:08.831063  1585 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 9.
I20260709 13:02:08.794329  5515 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:08.800614  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:08.764205  5364 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:08.853624  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 150804us
I20260709 13:02:08.859548  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:08.860394  1661 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:08.844596  1583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2620) took 2042 ms. Trace:
I20260709 13:02:08.862511  1662 raft_consensus.cc:2393] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 7: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:02:08.863288  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:08.817947  5441 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:08.885407  1740 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
W20260709 13:02:08.893647  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 104057us
I20260709 13:02:08.898104  1664 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:02:08.884879  1583 rpcz_store.cc:276] 0709 13:02:06.801682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.802237 (+   555us) service_pool.cc:224] Handling call
0709 13:02:06.821429 (+ 19192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:06.821689 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:08.128168 (+1306479us) log.cc:844] Serialized 14 byte log entry
0709 13:02:08.844031 (+715863us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:08.844089 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:08.844142 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.844360 (+   218us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.844521 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1106314,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":71,"thread_start_us":1894861,"threads_started":2}
I20260709 13:02:08.919627  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:08.920684  1658 raft_consensus.cc:2393] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 8: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:08.845861  5380 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:08.922982  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:08.861316  5358 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.857700  5574 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:08.864854  5012 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.870278  5431 raft_consensus.cc:2804] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:08.885931  5561 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:02:08.933882  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 139777us
I20260709 13:02:08.941144  5569 raft_consensus.cc:2804] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:08.941629  5569 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.942019  5569 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:08.942984  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:08.943591  1667 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:08.945588  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:08.946390  1664 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:02:08.947641  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:08.948604  1556 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:08.952934  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:08.953330  2537 raft_consensus.cc:2393] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 7: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:02:08.953644  1741 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:08.953205  5012 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:08.919389  5573 raft_consensus.cc:2804] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:08.881911  5515 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:08.972419  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:08.973132  1740 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 7.
I20260709 13:02:08.975210  5582 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:08.976025  5582 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:08.979002  5582 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:08.967191  1666 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 14.
I20260709 13:02:08.929641  5456 raft_consensus.cc:2804] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:08.933892  5431 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.895394  5521 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:08.899063  5340 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:09.010685  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 110605us
I20260709 13:02:08.921484  5441 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:09.006639  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:08.967494  5573 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:09.022503  5573 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:08.929711  5380 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:08.932976  5358 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:09.015304  1633 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:09.005203  5456 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:09.013450  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:09.015362  1734 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
W20260709 13:02:09.016665  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 144451us
W20260709 13:02:09.006979  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 58471.5us
I20260709 13:02:08.932483  5574 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:09.009295  5431 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:09.043421  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 144091us
I20260709 13:02:09.048693  1667 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 11.
I20260709 13:02:09.003754  5267 consensus_queue.cc:1059] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:02:09.050468  2424 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:02:09.051685  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 46966.7us
I20260709 13:02:09.052731  1633 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:08.968544  5551 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:09.055835  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:09.033937  5373 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:09.035526  5456 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:09.068511  2426 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:09.078622  5580 raft_consensus.cc:3060] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:09.079185  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:09.080139  5479 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:09.080309  5597 raft_consensus.cc:2804] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:09.080896  5597 raft_consensus.cc:697] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:09.080751  5479 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:09.081482  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:09.082195  1734 raft_consensus.cc:2393] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 8: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:09.083007  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:09.083384  1633 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:09.083716  1735 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:09.085856  5524 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:09.083067  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:09.083058  5479 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:09.084934  1633 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:09.059178  5582 raft_consensus.cc:2804] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:09.081935  5597 consensus_queue.cc:237] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:09.100986  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 50620us
I20260709 13:02:09.085956  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:09.112604  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:09.111339  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:09.086413  5595 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:09.071995  5252 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:09.117455  1740 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:02:09.114512  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:09.130198  1664 raft_consensus.cc:1275] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:09.088081  5571 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:09.101806  5582 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:09.102674  5524 raft_consensus.cc:2749] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:09.110409  5518 raft_consensus.cc:2804] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:09.076419  5177 consensus_queue.cc:1059] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:02:09.167791  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:09.168287  5177 raft_consensus.cc:3055] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:09.168826  5177 raft_consensus.cc:740] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:09.169035  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:09.174408  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:09.175222  1663 raft_consensus.cc:2410] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:02:09.175971  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:09.144728  1667 raft_consensus.cc:1240] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:09.143288  5582 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:09.137406  5252 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:09.179204  1667 raft_consensus.cc:1240] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:02:09.145730  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:09.180281  5252 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:09.182328  5551 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:09.127648  5479 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.148757  5534 tablet_replica.cc:333] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:02:09.167215  5441 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:09.151454  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:09.152776  5126 raft_consensus.cc:3055] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:09.153759  5515 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:09.154081  5380 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:09.154995  5340 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:09.161368  5569 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:09.164112  5460 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:09.165284  1738 raft_consensus.cc:3055] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:09.170634  5516 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:09.177405  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:09.169942  5531 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:09.180029  5570 raft_consensus.cc:3055] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:09.138422  5577 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:09.183604  1666 raft_consensus.cc:1240] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:09.204571  5479 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:09.225315  2548 raft_consensus.cc:1240] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:09.225571  5479 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:09.225703  5358 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:09.226770  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:09.229794  5534 raft_consensus.cc:2243] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:09.230505  2543 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:09.230619  5411 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:09.230924  5534 raft_consensus.cc:2272] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:09.170353  1737 raft_consensus.cc:1240] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:09.110339  5012 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:09.188535  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 155831us
I20260709 13:02:09.242590  1556 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:09.149425  5608 raft_consensus.cc:2804] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:09.202191  1741 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 9.
I20260709 13:02:09.202097  1665 raft_consensus.cc:2410] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:02:09.132783  5595 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:09.214457  1663 raft_consensus.cc:1275] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:09.205900  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:09.169924  5177 consensus_queue.cc:260] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:09.217024  1738 raft_consensus.cc:740] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:09.206504  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:09.205276  5126 raft_consensus.cc:740] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:09.244532  1558 leader_election.cc:400] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for earlier term 7. Current term is 8.
I20260709 13:02:09.218473  5460 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:09.247287  1734 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:02:09.221804  5570 raft_consensus.cc:740] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:09.269264  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:09.269236  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:09.270488  1662 raft_consensus.cc:2393] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 9: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:09.216428  5336 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:09.275470  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 161855us
I20260709 13:02:09.277801  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:09.278735  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:09.296442  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:09.322156  1663 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:09.323815  5551 consensus_queue.cc:1048] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:09.324322  5592 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:09.325234  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 82719.2us
I20260709 13:02:09.362746  1556 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:09.325161  5126 consensus_queue.cc:260] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:09.326061  5584 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:02:09.326555  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 73990.9us
I20260709 13:02:09.327659  5431 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:09.330866  5525 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:09.246084  5456 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:09.278486  5531 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:09.251821  5521 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:09.335639  5595 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:09.336869  1662 raft_consensus.cc:1240] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:09.338444  5579 consensus_meta.cc:287] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.555s	user 0.008s	sys 0.006s
I20260709 13:02:09.271277  5608 raft_consensus.cc:697] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:09.343093  5336 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:09.359185  1735 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 14.
I20260709 13:02:09.357197  5518 raft_consensus.cc:697] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 12 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:09.376253  1556 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:09.384872  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:09.411283  5456 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:09.433290  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:09.434103  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 345980us
I20260709 13:02:09.412639  5610 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:09.415064  5460 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:09.415719  5525 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:09.417834  5431 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:09.419567  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:09.446345  2550 raft_consensus.cc:2368] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for earlier term 7. Current term is 8.
I20260709 13:02:09.446403  5534 ts_tablet_manager.cc:1916] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:09.430757  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:09.450385  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:09.451196  2554 raft_consensus.cc:2468] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:02:09.450284  5608 consensus_queue.cc:237] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:09.409617  5592 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:09.458498  5580 raft_consensus.cc:2749] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:09.430698  5217 raft_consensus.cc:2804] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:09.461483  5217 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.461959  5217 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:09.364871  5567 log.cc:927] Time spent T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:02:09.364348  1558 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:09.464865  5592 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:09.429666  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 53510.5us
I20260709 13:02:09.429293  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:09.466632  5460 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:09.468365  1662 raft_consensus.cc:2410] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:02:09.435036  2426 leader_election.cc:336] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Timed out: RequestConsensusVote RPC to 127.0.107.195:32843 timed out after 1.596s (SENT)
I20260709 13:02:09.469336  2426 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:09.468986  5518 consensus_queue.cc:237] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:09.472606  5617 raft_consensus.cc:2749] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:09.420807  5573 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:09.473702  1659 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 7.
I20260709 13:02:09.427088  5579 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:09.429623  1663 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 14.
I20260709 13:02:09.461992  5569 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:09.478372  5579 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:09.438232  1661 consensus_meta.cc:287] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.539s	user 0.010s	sys 0.000s
W20260709 13:02:09.467228  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 102937us
I20260709 13:02:09.480195  1661 raft_consensus.cc:2468] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:02:09.481323  1667 raft_consensus.cc:1240] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:09.427598  5570 consensus_queue.cc:260] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:09.481029  1558 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:09.365505  5584 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.468298  5460 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:09.420280  5582 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:09.476300  2426 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:09.491772  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:09.491255  1556 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:09.494115  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:09.498538  1732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3264) took 2452 ms. Trace:
I20260709 13:02:09.501865  5525 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:09.504230  1558 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:09.507609  1732 rpcz_store.cc:276] 0709 13:02:07.046115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.046461 (+   346us) service_pool.cc:224] Handling call
0709 13:02:07.180482 (+134021us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.486472 (+1305990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.498211 (+1011739us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400143054. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:09.498436 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2713457024}
I20260709 13:02:09.507688  1556 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:09.507467  1658 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:09.493146  5584 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:09.514514  1558 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:09.515767  5605 raft_consensus.cc:2804] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:09.517611  5580 raft_consensus.cc:2749] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:09.519496  5217 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:09.522918  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:09.524369  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:09.528491  1666 raft_consensus.cc:1240] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:09.531611  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:09.530457  5528 raft_consensus.cc:3055] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:09.493570  5460 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:09.561582  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 53975.7us
I20260709 13:02:09.553198  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:09.543962  1664 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 13.
I20260709 13:02:09.554837  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:09.555238  1587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2634) took 2746 ms. Trace:
W20260709 13:02:09.557451  5587 log.cc:927] Time spent T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.604s	user 0.002s	sys 0.002s
I20260709 13:02:09.531127  5605 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.559849  5126 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:09.529619  5582 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:09.565210  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:09.563750  1587 rpcz_store.cc:276] 0709 13:02:06.808504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.287387 (+478883us) service_pool.cc:224] Handling call
0709 13:02:07.288099 (+   712us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.375439 (+1087340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.554939 (+1179500us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54002ecf54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:09.555131 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2437374208}
I20260709 13:02:09.570904  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:09.572252  1733 raft_consensus.cc:2393] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 in current term 10: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:09.570967  5460 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:09.570180  5605 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:09.582198  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:09.583479  1633 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:09.513363  5579 raft_consensus.cc:2804] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:09.513147  5570 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:09.590372  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:09.594403  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:09.595698  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:09.596298  1664 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
I20260709 13:02:09.597422  1658 raft_consensus.cc:2410] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:02:09.598361  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:09.600257  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:09.601053  1664 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:09.602490  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:09.550397  5528 raft_consensus.cc:740] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:09.605741  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:09.607321  1660 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:09.606405  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 91936.8us
I20260709 13:02:09.608608  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:09.608088  1558 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:09.608847  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:02:09.610908  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.611456  1733 raft_consensus.cc:2393] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 in current term 7: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:09.620258  5586 raft_consensus.cc:2804] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:09.622604  1633 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:09.590793  5579 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:09.604488  5582 raft_consensus.cc:2764] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:02:09.626416  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:09.625013  1633 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:09.631815  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:09.629009  5525 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:09.650557  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.607513  5213 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:09.629557  5579 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:09.654896  5517 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.658850  5528 consensus_queue.cc:260] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:09.665824  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:09.651413  1558 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:09.630050  5586 raft_consensus.cc:697] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:09.646528  5518 raft_consensus.cc:2749] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:09.671940  1658 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:09.673027  5589 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.007s	sys 0.016s
I20260709 13:02:09.651636  5577 raft_consensus.cc:2749] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:09.674232  1633 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:09.666703  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:09.677523  5578 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.681442  5561 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:09.681241  5517 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:09.682554  5338 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:09.685356  5528 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:09.693725  5582 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:09.687126  5589 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.008s	sys 0.016s
I20260709 13:02:09.699636  1633 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:09.693766  1589 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:02:09.703429  1589 raft_consensus.cc:606] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:09.703675  5364 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:09.691596  5578 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:09.706270  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:09.706972  1732 raft_consensus.cc:2368] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for earlier term 7. Current term is 8.
I20260709 13:02:09.707628  5578 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:09.709537  5475 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:09.710661  5581 log.cc:927] Time spent T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.763s	user 0.004s	sys 0.000s
I20260709 13:02:09.711090  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:09.711537  5586 consensus_queue.cc:237] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:09.714558  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:09.692070  5561 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:09.719399  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:09.724882  2554 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:09.719947  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:09.719187  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:09.719154  5340 raft_consensus.cc:2749] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:09.691708  5338 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:09.726171  1736 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:02:09.728520  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:09.729172  1732 raft_consensus.cc:2393] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 8: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:09.729995  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:09.733740  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:09.741370  1732 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:09.742084  1704 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:02:09.744818  1705 leader_election.cc:336] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.519s (SENT)
I20260709 13:02:09.745622  1705 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:09.750823  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:09.751098  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:09.757295  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:09.761720  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:09.691481  5460 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:09.770287  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:09.771126  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:09.775897  1585 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:09.771809  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:09.776532  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:09.777631  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:09.733960  5338 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:09.772361  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:09.785761  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:09.780292  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:09.780916  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:09.782117  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:09.783479  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:09.759161  5598 raft_consensus.cc:2749] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:09.748227  5213 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:09.793596  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:09.763077  5358 raft_consensus.cc:2804] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:09.795802  1592 raft_consensus.cc:2393] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 8: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:09.741993  5560 consensus_queue.cc:1059] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:02:09.801972  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:09.808316  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:09.805563  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.805120  2424 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:02:09.813009  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.778914  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:09.819716  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:09.827910  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:09.829667  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:09.809130  1738 consensus_queue.cc:260] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:09.831446  1738 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:09.832504  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:09.833702  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:09.834409  1584 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 4.
I20260709 13:02:09.835738  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:09.761492  5431 consensus_queue.cc:1059] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:02:09.836525  1583 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 7.
I20260709 13:02:09.827767  5608 raft_consensus.cc:2804] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:09.842002  5460 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:09.851630  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:09.918561  1661 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:09.919839  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:09.861200  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:09.865731  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:09.867437  5517 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:09.888075  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:09.907187  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:09.927986  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:09.928319  2543 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:02:09.929323  1661 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:02:09.810391  5213 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:09.932367  5584 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:09.933516  5213 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:09.934940  5584 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:09.935513  1587 raft_consensus.cc:2393] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 13: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:09.937228  5610 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:09.938954  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 79480.7us
I20260709 13:02:09.939116  5431 consensus_queue.cc:1059] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:09.940706  5431 consensus_queue.cc:1059] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:02:09.945268  5380 consensus_queue.cc:1059] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:09.942598  1705 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:09.948702  5380 raft_consensus.cc:3055] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:09.912410  5585 raft_consensus.cc:3055] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:09.911922  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:09.942395  5589 consensus_queue.cc:1059] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:02:09.942690  5266 consensus_queue.cc:1048] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:02:09.842654  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:09.953399  5266 raft_consensus.cc:3055] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:09.953914  5266 raft_consensus.cc:740] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:09.839574  1585 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:09.954116  5574 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:09.947417  5431 raft_consensus.cc:3055] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:09.956665  1633 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:09.950045  1666 raft_consensus.cc:2468] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:02:09.837941  5358 raft_consensus.cc:697] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:09.867739  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:09.910939  1660 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
I20260709 13:02:09.949172  5380 raft_consensus.cc:740] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:09.949770  5585 raft_consensus.cc:740] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:09.913031  5608 raft_consensus.cc:697] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:09.969112  1588 raft_consensus.cc:1813] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Handling vote request from an unknown peer 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:09.967914  1589 raft_consensus.cc:1240] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:09.990484  1586 raft_consensus.cc:2393] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 10: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:09.969906  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:09.991514  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:09.992244  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:09.968623  1633 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:09.983779  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:09.974084  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:09.996114  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:09.996485  1592 raft_consensus.cc:2468] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 4.
I20260709 13:02:09.974929  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:09.973995  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:09.997550  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:09.997750  1733 raft_consensus.cc:1813] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Handling vote request from an unknown peer 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:09.998476  1733 raft_consensus.cc:2393] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 10: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:09.999979  1583 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:10.001943  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:10.002573  1588 raft_consensus.cc:2410] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:02:10.002980  1660 raft_consensus.cc:2410] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:09.976425  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:10.005748  1556 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:09.965071  1732 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:02:10.007318  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:10.008229  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:10.009882  1738 raft_consensus.cc:1275] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:02:10.011627  5380 consensus_queue.cc:260] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:10.011693  5608 consensus_queue.cc:237] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:10.013137  5380 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:10.015043  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:10.016049  2540 raft_consensus.cc:2393] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 7: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:02:10.017621  1659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58814 (request call id 513) took 1075 ms. Trace:
I20260709 13:02:10.018139  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:09.838403  5598 consensus_queue.cc:1048] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.130s
I20260709 13:02:10.018975  1704 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:10.010530  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:10.007992  1736 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 12.
I20260709 13:02:10.025290  1633 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:10.028790  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:10.018042  1659 rpcz_store.cc:276] 0709 13:02:08.941909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.947273 (+  5364us) service_pool.cc:224] Handling call
0709 13:02:10.017473 (+1070200us) spinlock_profiling.cc:243] Waited 525 ms on lock 0x7b54000a82d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:10.017565 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1208231680}
I20260709 13:02:10.031473  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:10.032541  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:10.032985  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:02:10.034037  1631 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:58814 dropped due to backpressure: service queue is full with 50 items [suppressed 1 similar messages]
I20260709 13:02:10.032629  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:10.034830  1586 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:10.034878  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:10.037711  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:10.038512  1585 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:10.040747  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:10.048914  1659 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:02:10.053575  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:10.055505  1737 raft_consensus.cc:2393] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 4: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:09.982190  5431 raft_consensus.cc:740] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:09.990298  5340 raft_consensus.cc:2764] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:02:10.065124  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:10.008383  5589 raft_consensus.cc:2749] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:10.066386  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:10.028502  5577 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:10.040465  5518 raft_consensus.cc:2804] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:10.073021  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:10.085593  1736 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 7.
W20260709 13:02:10.036098  5556 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:02:10.037259  5213 raft_consensus.cc:2804] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:10.099529  1738 raft_consensus.cc:2410] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:02:10.036093  5605 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:10.079644  5577 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:09.975709  5266 consensus_queue.cc:260] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:10.133749  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.105414  5518 raft_consensus.cc:697] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 4 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:10.115772  5213 raft_consensus.cc:697] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:10.215584  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:10.217657  1732 raft_consensus.cc:2393] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 7: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:10.230500  1585 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 9.
I20260709 13:02:10.235705  1586 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
W20260709 13:02:10.240792  1658 consensus_meta.cc:287] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.554s	user 0.005s	sys 0.005s
I20260709 13:02:10.257511  1658 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:10.262660  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:10.142263  5577 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:10.291496  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:10.292001  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:10.292232  1663 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
W20260709 13:02:10.288548  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 269432us
I20260709 13:02:10.122838  5358 consensus_queue.cc:237] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:10.289925  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:10.318265  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:10.302979  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:10.298525  1707 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:02:10.303081  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 360527us
I20260709 13:02:10.323627  1705 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:10.305925  1704 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:02:10.326938  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.328008  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:10.330004  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:10.303721  5579 consensus_meta.cc:287] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.617s	user 0.010s	sys 0.004s
I20260709 13:02:10.334301  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:10.334689  1704 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:10.117779  5585 consensus_queue.cc:260] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:10.340337  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:10.341209  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:10.347502  1586 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:10.331655  2548 raft_consensus.cc:2368] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 7. Current term is 8.
I20260709 13:02:10.325192  2543 raft_consensus.cc:1240] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 LEADER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:10.325064  5266 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:10.344453  1737 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 6.
I20260709 13:02:10.034387  1631 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:58814 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 2547)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39146 (request call id 3223)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 2548)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39146 (request call id 3246)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39146 (request call id 3247)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 2562)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39146 (request call id 3230)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39146 (request call id 3234)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 2557)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39146 (request call id 3228)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39146 (request call id 3245)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 2558)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 2563)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39146 (request call id 3226)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39146 (request call id 3240)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58814 (request call id 522)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39146 (request call id 3237)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39146 (request call id 3241)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 2551)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 2564)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 2546)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 2525)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58814 (request call id 521)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 2531)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 2534)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 2535)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 2536)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 2537)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 2539)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3224)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3225)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3227)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3229)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3231)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3232)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3235)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3236)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3238)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3242)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3243)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58814 (request call id 523)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58814 (request call id 524)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58814 (request call id 525)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58814 (request call id 526)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58814 (request call id 527)
I20260709 13:02:10.153347  5431 consensus_queue.cc:260] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:10.358505  1633 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:10.313463  1661 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
I20260709 13:02:10.378857  1633 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:10.379845  1633 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:10.374378  5517 consensus_queue.cc:1059] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:02:10.382289  5517 raft_consensus.cc:3055] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:10.382709  5517 raft_consensus.cc:740] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:10.383535  5510 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:10.383728  5517 consensus_queue.cc:260] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:10.384133  5510 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:10.360594  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:10.385495  1732 raft_consensus.cc:2393] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 7: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:10.331430  5213 consensus_queue.cc:237] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:10.386279  5620 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:10.388450  5528 raft_consensus.cc:2749] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:10.389505  5582 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:10.391407  1633 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:10.365849  5605 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 8 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:10.352006  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:10.370675  1558 leader_election.cc:400] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for earlier term 7. Current term is 8.
I20260709 13:02:10.397588  5431 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:10.410106  1558 leader_election.cc:403] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:02:10.409730  1633 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:02:10.417603  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 47116.3us
I20260709 13:02:10.418440  1633 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:10.419094  1558 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:10.424582  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:10.339529  5579 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:10.391515  5585 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:10.446341  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:10.450187  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:10.451224  5603 raft_consensus.cc:2804] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:10.421455  5582 raft_consensus.cc:2749] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:10.452158  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:10.536855  1662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 2552) took 1071 ms. Trace:
I20260709 13:02:10.537431  1662 rpcz_store.cc:276] 0709 13:02:09.465748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.451908 (+986160us) service_pool.cc:224] Handling call
0709 13:02:10.536773 (+ 84865us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:10.453991  5338 consensus_meta.cc:287] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.655s	user 0.011s	sys 0.000s
I20260709 13:02:10.459141  5340 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:10.421555  5460 raft_consensus.cc:2749] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for earlier term 7. Current term is 8.
I20260709 13:02:10.465793  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:10.467420  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:02:10.471207  5570 consensus_meta.cc:287] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.865s	user 0.014s	sys 0.000s
I20260709 13:02:10.466696  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:10.469839  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:10.464975  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:10.587777  1658 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12.
I20260709 13:02:10.421649  5528 raft_consensus.cc:2749] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:10.474009  5534 ts_tablet_manager.cc:1929] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.5
I20260709 13:02:10.376140  5518 consensus_queue.cc:237] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:10.477159  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:10.445832  5637 raft_consensus.cc:2804] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:10.481220  5632 raft_consensus.cc:2804] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:10.483465  5217 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:10.484143  5510 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:10.468997  1667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 2514) took 1318 ms. Trace:
W20260709 13:02:10.485767  5634 log.cc:927] Time spent T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:02:10.390453  5517 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:10.451529  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
W20260709 13:02:10.480243  5561 consensus_meta.cc:287] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.746s	user 0.009s	sys 0.000s
I20260709 13:02:10.540201  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:10.547194  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:10.632773  1662 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:10.633531  1662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 2562) took 1056 ms. Trace:
I20260709 13:02:10.634037  1662 rpcz_store.cc:276] 0709 13:02:09.576751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.546779 (+970028us) service_pool.cc:224] Handling call
0709 13:02:10.633447 (+ 86668us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:10.635396  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:10.636234  1662 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:02:10.535943  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:10.588434  1658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 2547) took 1136 ms. Trace:
I20260709 13:02:10.496299  5635 raft_consensus.cc:2804] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:10.646672  5635 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.647156  5635 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:10.494926  5603 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.649346  5603 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:10.590155  1659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 2548) took 1137 ms. Trace:
I20260709 13:02:10.536509  5599 raft_consensus.cc:2749] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:10.618465  1664 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:10.624577  1667 rpcz_store.cc:276] 0709 13:02:09.150992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.179978 (+ 28986us) service_pool.cc:224] Handling call
0709 13:02:09.481049 (+301071us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.481792 (+   743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.468759 (+986967us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b54002701d0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8e8ad 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:10.468927 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":691650944}
W20260709 13:02:10.609701  5525 consensus_meta.cc:287] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.944s	user 0.011s	sys 0.003s
I20260709 13:02:10.630991  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:10.623283  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 288684us
I20260709 13:02:10.664256  1665 raft_consensus.cc:2393] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 9: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:10.637281  1658 rpcz_store.cc:276] 0709 13:02:09.452067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.464640 (+1012573us) service_pool.cc:224] Handling call
0709 13:02:10.588355 (+123715us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:10.603542  5515 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:10.607134  5637 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.587986  5636 raft_consensus.cc:2749] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:10.617559  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:10.639545  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:10.687230  1662 raft_consensus.cc:2376] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4. Re-sending same reply.
I20260709 13:02:10.688011  1662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 2557) took 1113 ms. Trace:
I20260709 13:02:10.688345  1662 rpcz_store.cc:276] 0709 13:02:09.574510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.639210 (+1064700us) service_pool.cc:224] Handling call
0709 13:02:10.687932 (+ 48722us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:10.635871  5561 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:10.635146  5380 consensus_meta.cc:287] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.622s	user 0.009s	sys 0.003s
W20260709 13:02:10.644423  1583 consensus_meta.cc:287] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.644s	user 0.008s	sys 0.000s
I20260709 13:02:10.645885  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:10.653285  1659 rpcz_store.cc:276] 0709 13:02:09.452380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.466417 (+1014037us) service_pool.cc:224] Handling call
0709 13:02:10.590069 (+123652us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:10.658702  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:10.695147  1667 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:02:10.581254  5338 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:10.698284  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:10.698617  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:10.699527  1658 raft_consensus.cc:2410] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:10.696944  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:10.700605  1667 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:10.689683  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:10.703449  1583 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 8.
I20260709 13:02:10.704936  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:10.630792  5632 raft_consensus.cc:697] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:10.632452  5534 log.cc:1199] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d: Deleting WAL directory at /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-2-root/wals/ae1310c9ee464797a39b786c1d932941
I20260709 13:02:10.708458  5338 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:10.708988  1590 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:10.711887  1592 raft_consensus.cc:2393] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 11: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:10.710875  5561 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:10.668048  5525 raft_consensus.cc:2749] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:10.715047  1733 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 8.
I20260709 13:02:10.717432  1658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 2558) took 1142 ms. Trace:
I20260709 13:02:10.728663  1658 rpcz_store.cc:276] 0709 13:02:09.574968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.665444 (+1090476us) service_pool.cc:224] Handling call
0709 13:02:10.717328 (+ 51884us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:10.719525  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:10.722821  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 303764us
I20260709 13:02:10.712580  1662 raft_consensus.cc:2410] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:02:10.730291  1662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 2563) took 1148 ms. Trace:
I20260709 13:02:10.730969  1662 rpcz_store.cc:276] 0709 13:02:09.582119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.689307 (+1107188us) service_pool.cc:224] Handling call
0709 13:02:10.730221 (+ 40914us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:10.731722  1667 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:02:10.732088  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:10.732925  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:10.726799  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 403254us
I20260709 13:02:10.727664  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:10.705827  1665 raft_consensus.cc:2468] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:02:10.734613  1705 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:10.737893  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:10.741453  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:10.743561  1658 raft_consensus.cc:2393] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 in current term 7: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:10.744415  1662 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 16.
I20260709 13:02:10.745105  1662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 2551) took 1283 ms. Trace:
I20260709 13:02:10.745519  1662 rpcz_store.cc:276] 0709 13:02:09.465314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.737527 (+1272213us) service_pool.cc:224] Handling call
0709 13:02:10.745016 (+  7489us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:10.743476  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 79110.1us
W20260709 13:02:10.747581  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 329205us
I20260709 13:02:10.748013  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:10.748980  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.748919  1633 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:10.702309  5637 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:10.702735  2515 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:02:10.694970  5515 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:10.750111  1558 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:10.750907  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:10.754060  1633 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:10.754308  1665 raft_consensus.cc:2393] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 9: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:10.759047  1665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 2564) took 1176 ms. Trace:
I20260709 13:02:10.759198  1662 raft_consensus.cc:1240] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:10.755168  1705 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:10.733125  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:10.756539  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:10.761412  1633 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:10.759455  1665 rpcz_store.cc:276] 0709 13:02:09.582808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.735045 (+1152237us) service_pool.cc:224] Handling call
0709 13:02:10.758983 (+ 23938us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:10.762167  1667 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:10.762319  1658 raft_consensus.cc:1813] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Handling vote request from an unknown peer 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:02:10.743947  5560 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.906s	user 0.019s	sys 0.015s
I20260709 13:02:10.761662  1558 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:02:10.758404  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.762873  1658 raft_consensus.cc:2368] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 7. Current term is 8.
I20260709 13:02:10.765277  1658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 2546) took 1314 ms. Trace:
I20260709 13:02:10.766216  1658 rpcz_store.cc:276] 0709 13:02:09.451759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.746929 (+1295170us) service_pool.cc:224] Handling call
0709 13:02:10.765205 (+ 18276us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:10.764832  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.751160  5582 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:10.774940  1658 raft_consensus.cc:1275] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:10.775550  1658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 2531) took 1435 ms. Trace:
I20260709 13:02:10.776255  1658 rpcz_store.cc:276] 0709 13:02:09.339714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.774445 (+1434731us) service_pool.cc:224] Handling call
0709 13:02:10.774698 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:10.775330 (+   632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.775501 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:10.763339  1662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 2525) took 1494 ms. Trace:
I20260709 13:02:10.771314  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:10.763141  1633 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:10.777594  1586 raft_consensus.cc:1813] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Handling vote request from an unknown peer 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:10.778209  1586 raft_consensus.cc:2368] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 7. Current term is 8.
I20260709 13:02:10.778584  1662 rpcz_store.cc:276] 0709 13:02:09.268510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.755336 (+1486826us) service_pool.cc:224] Handling call
0709 13:02:10.759022 (+  3686us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:10.763066 (+  4044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.763282 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:10.780177  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:10.780670  1665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58814 (request call id 521) took 1502 ms. Trace:
W20260709 13:02:10.769989  5560 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.020s	sys 0.016s
I20260709 13:02:10.778947  1633 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:10.758230  5643 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:10.764837  5570 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:10.782896  1665 rpcz_store.cc:276] 0709 13:02:09.278291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.762641 (+1484350us) service_pool.cc:224] Handling call
0709 13:02:10.780133 (+ 17492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:10.780330 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:10.780367 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:10.780410 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:10.780446 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.780499 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:10.780585 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:10.783519  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:10.761303  5525 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:10.791364  5534 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43674 (request call id 79) took 4308 ms. Trace:
I20260709 13:02:10.793291  5642 raft_consensus.cc:2749] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:02:10.794719  5641 log.cc:927] Time spent T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:02:10.791903  5534 rpcz_store.cc:276] 0709 13:02:06.544222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.544461 (+   239us) service_pool.cc:224] Handling call
0709 13:02:07.331199 (+786738us) ts_tablet_manager.cc:1151] Deleting tablet ae1310c9ee464797a39b786c1d932941
0709 13:02:07.450399 (+119200us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:02:09.148442 (+1698043us) spinlock_profiling.cc:243] Waited 798 ms on lock 0x7b5400222ed4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f97ff9 00007f1b85fa5482 00007f1b85fd62d0 00007f1b85fbc83d 00007f1b85fbc7e9 00007f1b85fbc779 00007f1b85fbc741 00007f1b85fbb96d 000000000038f354 000000000038f199
0709 13:02:09.809775 (+661333us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:10.473874 (+664099us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:10.791264 (+317390us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1836532992,"tablet-delete.queue_time_us":688320,"thread_start_us":376708,"threads_started":1}
I20260709 13:02:10.807659  5577 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:10.808493  2537 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:02:10.808991  1659 raft_consensus.cc:2393] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 8: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
W20260709 13:02:10.786325  1558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.788117  1586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2652) took 1038 ms. Trace:
I20260709 13:02:10.772652  5460 raft_consensus.cc:2804] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:10.808686  1658 raft_consensus.cc:2393] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 8: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:10.810292  5460 raft_consensus.cc:697] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:10.811226  5460 consensus_queue.cc:237] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:10.812844  5646 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:10.813452  5646 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.813884  5646 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:10.817404  5648 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:10.817958  5648 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:10.820413  5648 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:10.822703  5620 raft_consensus.cc:2749] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:10.777333  5566 consensus_queue.cc:1048] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
W20260709 13:02:10.825480  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 70386.5us
I20260709 13:02:10.826361  1705 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:10.827636  1705 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:10.809566  1586 rpcz_store.cc:276] 0709 13:02:09.749735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.755129 (+1005394us) service_pool.cc:224] Handling call
0709 13:02:10.788047 (+ 32918us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:10.831871  1660 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
W20260709 13:02:10.826562  5631 log.cc:927] Time spent T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.541s	user 0.007s	sys 0.000s
I20260709 13:02:10.828802  1705 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:10.773149  5528 raft_consensus.cc:2749] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:10.770536  5579 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:10.833859  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 54996.8us
I20260709 13:02:10.830483  1555 leader_election.cc:400] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Vote denied by peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157) with higher term. Message: Invalid argument: T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for earlier term 7. Current term is 8.
I20260709 13:02:10.837555  1555 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:10.838852  1705 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:10.837877  5642 raft_consensus.cc:2804] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:10.839905  5650 raft_consensus.cc:2804] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:10.840260  5642 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:10.840471  5650 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.840746  5642 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:10.846714  1633 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:10.850268  1633 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:10.852125  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.820993  5648 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:10.857554  1664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 2543) took 1407 ms. Trace:
I20260709 13:02:10.858143  1664 rpcz_store.cc:276] 0709 13:02:09.449885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.604022 (+154137us) service_pool.cc:224] Handling call
0709 13:02:10.857312 (+1253290us) spinlock_profiling.cc:243] Waited 971 ms on lock 0x7b54002fbf54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:10.857468 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2233503616}
I20260709 13:02:10.788805  5643 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:10.847527  1667 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:02:10.847420  1705 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:10.831667  5570 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.862965  1667 raft_consensus.cc:1240] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:10.863147  5652 raft_consensus.cc:2749] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:10.840963  5650 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:10.839201  5620 raft_consensus.cc:2749] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:10.835909  5380 raft_consensus.cc:2749] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:10.864151  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:10.869792  1586 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 4.
I20260709 13:02:10.865742  1667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 2536) took 1524 ms. Trace:
I20260709 13:02:10.870674  1667 rpcz_store.cc:276] 0709 13:02:09.341336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.862457 (+1521121us) service_pool.cc:224] Handling call
0709 13:02:10.862789 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:10.865423 (+  2634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.865658 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:10.872001  1667 raft_consensus.cc:1240] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:10.872573  1667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 2537) took 1531 ms. Trace:
I20260709 13:02:10.874708  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:10.876166  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:10.877750  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:10.879995  2426 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:10.842556  5651 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:10.860088  5598 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:10.872902  1667 rpcz_store.cc:276] 0709 13:02:09.341662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.871515 (+1529853us) service_pool.cc:224] Handling call
0709 13:02:10.871819 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:10.872356 (+   537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.872521 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:10.883442  1664 raft_consensus.cc:1240] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:02:10.884174  1707 leader_election.cc:400] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 7. Current term is 8.
I20260709 13:02:10.884646  1707 leader_election.cc:403] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:10.885046  2426 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:10.885632  1664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 2535) took 1544 ms. Trace:
I20260709 13:02:10.864246  5528 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:10.888617  1665 raft_consensus.cc:1240] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 4 LEADER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:10.864828  5643 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:10.869329  5431 raft_consensus.cc:2749] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:10.890779  5510 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:10.893698  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 46366.9us
I20260709 13:02:10.887535  1664 rpcz_store.cc:276] 0709 13:02:09.340974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.859254 (+1518280us) service_pool.cc:224] Handling call
0709 13:02:10.882116 (+ 22862us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:10.883964 (+  1848us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.885550 (+  1586us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:10.930951  1705 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:10.899150  1584 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 9.
I20260709 13:02:10.868201  5648 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:10.913893  5577 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:10.918787  5605 raft_consensus.cc:2804] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:10.844506  5632 consensus_queue.cc:237] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:10.867601  5570 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:10.936684  1705 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:10.945390  1705 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:10.946841  1705 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:10.938963  5636 consensus_queue.cc:1059] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:02:10.949038  1589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2647) took 1205 ms. Trace:
I20260709 13:02:10.949532  1589 rpcz_store.cc:276] 0709 13:02:09.743352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.743496 (+   144us) service_pool.cc:224] Handling call
0709 13:02:09.762698 (+ 19202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.990582 (+227884us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.948777 (+958195us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b54003b42d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:10.948967 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":446738688}
I20260709 13:02:10.951004  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:10.954360  5627 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:10.954840  5627 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.955193  5627 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:10.938830  1592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 2072) took 1097 ms. Trace:
W20260709 13:02:10.946875  1591 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2629) took 4139 ms (client timeout 2244 ms). Trace:
I20260709 13:02:10.958287  1705 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
W20260709 13:02:10.931150  1707 raft_consensus.cc:2686] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:02:10.883088  5598 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:10.959100  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 77272.8us
W20260709 13:02:10.958514  1591 rpcz_store.cc:269] 0709 13:02:06.807102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.807899 (+   797us) service_pool.cc:224] Handling call
0709 13:02:10.946594 (+4138695us) spinlock_profiling.cc:243] Waited 3.96 s on lock 0x7b54003cf354. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:10.946756 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9114748672}
I20260709 13:02:10.959661  1588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 2055) took 1193 ms. Trace:
I20260709 13:02:10.960373  1589 raft_consensus.cc:2393] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 in current term 7: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:10.956676  1592 rpcz_store.cc:276] 0709 13:02:09.841064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.032716 (+191652us) service_pool.cc:224] Handling call
0709 13:02:10.938597 (+905881us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b54003b38d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:10.938761 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1559224704}
I20260709 13:02:10.969659  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:10.970728  1592 raft_consensus.cc:2393] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 in current term 12: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
W20260709 13:02:10.971207  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 120975us
I20260709 13:02:10.967805  1588 rpcz_store.cc:276] 0709 13:02:09.748556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.750225 (+  1669us) service_pool.cc:224] Handling call
0709 13:02:10.937069 (+1186844us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b5400437bd4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:10.941794 (+  4725us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":410905856}
I20260709 13:02:10.937583  5651 raft_consensus.cc:2749] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:10.985920  2426 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:10.978981  1591 raft_consensus.cc:1240] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 12. Current term is 13. Ops: []
W20260709 13:02:10.981572  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:10.987905  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.984586  1585 raft_consensus.cc:1240] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:10.934214  5605 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
W20260709 13:02:10.988397  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:10.998991  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.998828  1588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:02:10.999745  1588 raft_consensus.cc:606] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:10.988631  1585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2664) took 1129 ms. Trace:
I20260709 13:02:10.975016  5431 raft_consensus.cc:2804] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:10.990972  5528 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:10.991541  5573 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:10.992429  2548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49218 (request call id 212) took 1328 ms. Trace:
I20260709 13:02:10.993062  1661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 2556) took 1419 ms. Trace:
I20260709 13:02:10.956686  5582 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:10.997999  1591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2659) took 1204 ms. Trace:
I20260709 13:02:10.975208  5560 raft_consensus.cc:2749] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:10.971004  5598 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:11.012475  1661 rpcz_store.cc:276] 0709 13:02:09.574164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.995784 (+421620us) service_pool.cc:224] Handling call
0709 13:02:10.992879 (+997095us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b540024fed4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:10.993000 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":305415040}
I20260709 13:02:10.996829  5638 raft_consensus.cc:2804] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:11.015190  1591 rpcz_store.cc:276] 0709 13:02:09.793835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.974973 (+1181138us) service_pool.cc:224] Handling call
0709 13:02:10.978821 (+  3848us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:10.997634 (+ 18813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.997919 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.000850  1585 rpcz_store.cc:276] 0709 13:02:09.859543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.983852 (+1124309us) service_pool.cc:224] Handling call
0709 13:02:10.984321 (+   469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:10.988368 (+  4047us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.988570 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.024085  1661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3227) took 1209 ms. Trace:
I20260709 13:02:11.019593  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:11.003911  5605 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:11.027457  1732 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:10.997852  5577 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:11.000187  5639 raft_consensus.cc:2749] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:11.027185  1661 rpcz_store.cc:276] 0709 13:02:09.814676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.023328 (+1208652us) service_pool.cc:224] Handling call
0709 13:02:11.023618 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.023786 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.023813 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.023852 (+    39us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:11.023883 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.023934 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.024032 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.015084  5636 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:11.027863  1734 raft_consensus.cc:1275] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:11.009841  5518 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:11.031800  1705 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:11.034883  1591 raft_consensus.cc:1240] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:11.034935  1588 raft_consensus.cc:1240] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:11.017329  5648 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:11.059001  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:11.059727  1736 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:02:11.009719  5637 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:11.055091  1588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2668) took 1121 ms. Trace:
I20260709 13:02:11.055241  1591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2666) took 1143 ms. Trace:
I20260709 13:02:11.055734  1661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3229) took 1240 ms. Trace:
I20260709 13:02:11.023092  5431 raft_consensus.cc:697] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:11.002336  5603 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:11.049763  1705 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:11.026647  5638 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:11.064172  1661 rpcz_store.cc:276] 0709 13:02:09.814964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.049256 (+1234292us) service_pool.cc:224] Handling call
0709 13:02:11.049570 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.049832 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.054168 (+  4336us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.054223 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:11.054260 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.054318 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.055665 (+  1347us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.063289  1591 rpcz_store.cc:276] 0709 13:02:09.911659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.028770 (+1117111us) service_pool.cc:224] Handling call
0709 13:02:11.034684 (+  5914us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.054987 (+ 20303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.055181 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.063230  1588 rpcz_store.cc:276] 0709 13:02:09.933281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.031204 (+1097923us) service_pool.cc:224] Handling call
0709 13:02:11.034753 (+  3549us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.054823 (+ 20070us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.055032 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:11.118999  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 69310.5us
I20260709 13:02:11.023188  5635 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:11.124310  1583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2670) took 1190 ms. Trace:
W20260709 13:02:11.125355  2426 leader_election.cc:336] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Timed out: RequestConsensusVote RPC to 127.0.107.195:32843 timed out after 1.501s (SENT)
I20260709 13:02:11.054606  5560 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:11.118717  5202 consensus_queue.cc:1059] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:02:11.101508  5636 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:11.121121  5638 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:11.016399  5528 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:11.130292  1591 raft_consensus.cc:1240] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:11.130568  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:11.012255  2548 rpcz_store.cc:276] 0709 13:02:09.663701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.665098 (+  1397us) service_pool.cc:224] Handling call
0709 13:02:10.992176 (+1327078us) spinlock_profiling.cc:243] Waited 546 ms on lock 0x7b54005da7d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:10.992338 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1255761280}
I20260709 13:02:11.128360  1732 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 8.
I20260709 13:02:11.134471  1633 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:11.146093  1633 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:11.127936  2426 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:11.127643  1583 rpcz_store.cc:276] 0709 13:02:09.933838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.063439 (+1129601us) service_pool.cc:224] Handling call
0709 13:02:11.123831 (+ 60392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.123994 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.124018 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.124058 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:11.124089 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.124149 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.124242 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.150290  1591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2671) took 1216 ms. Trace:
I20260709 13:02:11.150759  1591 rpcz_store.cc:276] 0709 13:02:09.934140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.129768 (+1195628us) service_pool.cc:224] Handling call
0709 13:02:11.130114 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.143153 (+ 13039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.150210 (+  7057us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.048481  5577 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:11.152074  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:11.153000  1741 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:11.126756  5589 raft_consensus.cc:2804] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:11.164300  5589 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:11.164789  5589 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:11.133409  5592 raft_consensus.cc:3055] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:11.165228  5592 raft_consensus.cc:740] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:11.118014  5588 consensus_queue.cc:1059] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.155s
I20260709 13:02:11.151661  5639 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:11.151479  5648 raft_consensus.cc:2804] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:11.153508  5582 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:11.152705  5599 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.133881  5651 consensus_queue.cc:1059] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:02:11.161383  5431 consensus_queue.cc:237] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:11.235491  1738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43686 (request call id 2189) took 1255 ms. Trace:
I20260709 13:02:11.056125  5518 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:11.245352  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.162616  5528 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:11.236527  1590 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2656) took 1449 ms (client timeout 1666 ms). Trace:
W20260709 13:02:11.250989  1590 rpcz_store.cc:269] 0709 13:02:09.787539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.800005 (+ 12466us) service_pool.cc:224] Handling call
0709 13:02:11.236209 (+1436204us) spinlock_profiling.cc:243] Waited 880 ms on lock 0x7b54002ede54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:11.236449 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2023822208}
I20260709 13:02:11.251991  5380 raft_consensus.cc:3055] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:11.252597  5380 raft_consensus.cc:740] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
W20260709 13:02:11.234514  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 77449.3us
I20260709 13:02:11.242889  1666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3225) took 1428 ms. Trace:
I20260709 13:02:11.236886  1587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2653) took 1486 ms. Trace:
I20260709 13:02:11.203605  1741 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:02:11.253021  1590 raft_consensus.cc:1240] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:11.257932  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:11.243382  1738 rpcz_store.cc:276] 0709 13:02:09.980214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.031792 (+ 51578us) service_pool.cc:224] Handling call
0709 13:02:11.235276 (+1203484us) spinlock_profiling.cc:243] Waited 24.5 ms on lock 0x7b5400277c54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:11.235419 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56306432}
I20260709 13:02:11.256055  1666 rpcz_store.cc:276] 0709 13:02:09.814369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.981327 (+1166958us) service_pool.cc:224] Handling call
0709 13:02:10.981642 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:10.982011 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:11.030568 (+ 48557us) log.cc:844] Serialized 14 byte log entry
0709 13:02:11.242410 (+211842us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.242518 (+   108us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:11.242570 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.242666 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.242825 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21105,"prepare.queue_time_us":191145,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":48,"raft.queue_time_us":114,"thread_start_us":232884,"threads_started":2}
I20260709 13:02:11.260250  1558 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:11.261547  5586 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:11.262090  5586 raft_consensus.cc:697] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:11.263190  5586 consensus_queue.cc:237] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:11.256217  1587 rpcz_store.cc:276] 0709 13:02:09.749964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.835315 (+ 85351us) service_pool.cc:224] Handling call
0709 13:02:11.236699 (+1401384us) spinlock_profiling.cc:243] Waited 9.33 ms on lock 0x7b54003926d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:11.236829 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21450624}
I20260709 13:02:11.266175  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:11.267277  1587 raft_consensus.cc:1240] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:11.267467  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:11.268144  1738 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:11.253939  5380 consensus_queue.cc:260] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:11.270210  5380 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:11.268093  1587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2074) took 1322 ms. Trace:
I20260709 13:02:11.270952  1587 rpcz_store.cc:276] 0709 13:02:09.945556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.266552 (+1320996us) service_pool.cc:224] Handling call
0709 13:02:11.267013 (+   461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.267795 (+   782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.268025 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.273065  1587 raft_consensus.cc:1240] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:11.277603  1587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2078) took 1330 ms. Trace:
I20260709 13:02:11.275038  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:02:11.278290  5645 log.cc:927] Time spent T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.560s	user 0.004s	sys 0.000s
I20260709 13:02:11.278891  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:11.282505  1633 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:11.283622  5528 raft_consensus.cc:2804] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:11.284622  5528 raft_consensus.cc:697] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 9 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:11.285825  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:11.285737  5528 consensus_queue.cc:237] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:11.286919  1663 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39146 (request call id 3247) took 1321 ms (client timeout 1734 ms). Trace:
W20260709 13:02:11.287442  1663 rpcz_store.cc:269] 0709 13:02:09.966076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.285481 (+1319405us) service_pool.cc:224] Handling call
0709 13:02:11.286846 (+  1365us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.289484  1663 raft_consensus.cc:1240] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:11.290022  1660 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39146 (request call id 3223) took 1476 ms (client timeout 1858 ms). Trace:
W20260709 13:02:11.290457  1660 rpcz_store.cc:269] 0709 13:02:09.813977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.465552 (+651575us) service_pool.cc:224] Handling call
0709 13:02:11.289855 (+824303us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b5400242a54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:11.289963 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":549953280}
W20260709 13:02:11.292135  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:11.293831  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.294143  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:11.294827  1737 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 9.
I20260709 13:02:11.297134  1584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 2063) took 1504 ms. Trace:
I20260709 13:02:11.292744  1660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3236) took 1425 ms. Trace:
I20260709 13:02:11.297535  1584 rpcz_store.cc:276] 0709 13:02:09.794616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.857443 (+ 62827us) service_pool.cc:224] Handling call
0709 13:02:11.296933 (+1439490us) spinlock_profiling.cc:243] Waited 808 ms on lock 0x7b54001d2ed4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:11.297052 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1859185920}
I20260709 13:02:11.298961  1584 raft_consensus.cc:1240] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 7. Current term is 9. Ops: []
I20260709 13:02:11.298090  1660 rpcz_store.cc:276] 0709 13:02:09.911048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.291712 (+1380664us) service_pool.cc:224] Handling call
0709 13:02:11.292098 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.292368 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.292408 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.292468 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:11.292515 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.292586 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.292693 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.299753  1584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2079) took 1352 ms. Trace:
I20260709 13:02:11.300405  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:11.301594  1660 raft_consensus.cc:2393] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 8: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:11.303036  1589 raft_consensus.cc:1240] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:11.303133  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:11.304216  1660 raft_consensus.cc:2393] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 7: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:11.306073  1633 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:11.201521  5648 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:11.308929  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:11.235387  5599 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:11.231863  5642 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:11.315125  5599 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:11.258210  1590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2674) took 1322 ms. Trace:
I20260709 13:02:11.315505  5642 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:11.315685  1555 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:11.231137  5635 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:11.315919  1590 rpcz_store.cc:276] 0709 13:02:09.935711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.252266 (+1316555us) service_pool.cc:224] Handling call
0709 13:02:11.252763 (+   497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.257406 (+  4643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.257806 (+   400us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.209175  5589 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:11.317442  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:11.318800  5589 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:11.204332  5603 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:11.313133  5648 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:11.233796  5577 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:11.318862  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:11.188834  5510 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:11.300499  1584 rpcz_store.cc:276] 0709 13:02:09.947311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.298442 (+1351131us) service_pool.cc:224] Handling call
0709 13:02:11.298790 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.299531 (+   741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.299704 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.322503  1633 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:11.321306  1555 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:11.330513  1555 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:11.311702  1587 rpcz_store.cc:276] 0709 13:02:09.946941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.272502 (+1325561us) service_pool.cc:224] Handling call
0709 13:02:11.272892 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.277347 (+  4455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.277548 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.242326  5639 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.335664  1633 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:11.337905  1630 leader_election.cc:400] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Vote denied by peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157) with higher term. Message: Invalid argument: T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 7. Current term is 8.
I20260709 13:02:11.338367  1630 leader_election.cc:403] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:02:11.337919  1587 raft_consensus.cc:1275] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:02:11.290660  1663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3235) took 1455 ms. Trace:
I20260709 13:02:11.340523  1663 rpcz_store.cc:276] 0709 13:02:09.835079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.288494 (+1453415us) service_pool.cc:224] Handling call
0709 13:02:11.289240 (+   746us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.289952 (+   712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.290170 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.341104  1633 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:11.346657  1587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2081) took 1231 ms. Trace:
I20260709 13:02:11.320747  2515 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:11.348554  1584 raft_consensus.cc:1240] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:11.347314  1587 rpcz_store.cc:276] 0709 13:02:10.115780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.332795 (+1217015us) service_pool.cc:224] Handling call
0709 13:02:11.333316 (+   521us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.339398 (+  6082us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.346578 (+  7180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.337127  5582 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:11.350804  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:11.337296  5475 raft_consensus.cc:2804] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:11.337007  5577 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:11.347445  5546 raft_consensus.cc:2804] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:11.352557  1584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2676) took 1396 ms. Trace:
I20260709 13:02:11.354099  1584 rpcz_store.cc:276] 0709 13:02:09.955942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.329712 (+1373770us) service_pool.cc:224] Handling call
0709 13:02:11.348347 (+ 18635us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.349030 (+   683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.352134 (+  3104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.318919  5338 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:11.330116  5340 raft_consensus.cc:2749] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:11.188987  5650 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:11.366669  1584 raft_consensus.cc:1275] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:02:11.364252  1738 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:02:11.374779  1558 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:11.180191  5627 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:11.361636  5475 raft_consensus.cc:697] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:11.404518  5549 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.325600  5646 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:11.422669  1738 raft_consensus.cc:1275] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:02:11.394930  5338 raft_consensus.cc:2804] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:11.429194  5655 raft_consensus.cc:2804] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:11.429901  5338 raft_consensus.cc:697] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:11.430658  1664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3224) took 1616 ms. Trace:
I20260709 13:02:11.431113  1664 rpcz_store.cc:276] 0709 13:02:09.814196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.931692 (+1117496us) service_pool.cc:224] Handling call
0709 13:02:10.977916 (+ 46224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:10.978166 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:11.129166 (+151000us) log.cc:844] Serialized 14 byte log entry
0709 13:02:11.430309 (+301143us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.430363 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:11.430410 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.430474 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.430598 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65139,"prepare.queue_time_us":176308,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"thread_start_us":361668,"threads_started":2}
I20260709 13:02:11.433945  1661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3231) took 1618 ms. Trace:
I20260709 13:02:11.432937  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:11.433650  5577 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:11.434736  1664 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:11.416635  1586 raft_consensus.cc:2368] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 7. Current term is 8.
I20260709 13:02:11.441712  5627 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:11.441959  5475 consensus_queue.cc:237] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:11.443146  5518 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:11.443302  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:02:11.417173  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 76142.6us
W20260709 13:02:11.433665  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 111746us
I20260709 13:02:11.444574  1633 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:11.434487  1661 rpcz_store.cc:276] 0709 13:02:09.815394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.118358 (+1302964us) service_pool.cc:224] Handling call
0709 13:02:11.118737 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.157046 (+ 38309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.157124 (+    78us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.157188 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:11.157250 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.433692 (+276442us) spinlock_profiling.cc:243] Waited 38 ms on lock 0x7b54002fc454. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:11.433745 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.433890 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87437568}
I20260709 13:02:11.359340  5570 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:11.434973  5638 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:11.436554  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:11.401160  5585 consensus_meta.cc:287] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.905s	user 0.014s	sys 0.000s
I20260709 13:02:11.410324  1736 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:02:11.431135  5338 consensus_queue.cc:237] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:11.347579  5639 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:11.446874  1630 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:11.447044  1661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3242) took 1496 ms. Trace:
I20260709 13:02:11.457175  1661 rpcz_store.cc:276] 0709 13:02:09.950379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.446067 (+1495688us) service_pool.cc:224] Handling call
0709 13:02:11.446357 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.446535 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.446557 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.446605 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:11.446634 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.446683 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.446975 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.458611  5639 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:11.459156  1661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3243) took 1508 ms. Trace:
I20260709 13:02:11.459503  1661 rpcz_store.cc:276] 0709 13:02:09.950686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.458328 (+1507642us) service_pool.cc:224] Handling call
0709 13:02:11.458657 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.458850 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.458876 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.458918 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:11.458952 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.459004 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.459105 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.458619  5546 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.448097  1633 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:11.460958  5546 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:11.462502  1633 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:11.461351  1661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58814 (request call id 523) took 1508 ms. Trace:
I20260709 13:02:11.463222  1661 rpcz_store.cc:276] 0709 13:02:09.952250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.460336 (+1508086us) service_pool.cc:224] Handling call
0709 13:02:11.460606 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.460779 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.460806 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.460846 (+    40us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:11.460876 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.460924 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.461029 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.465212  1661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58814 (request call id 524) took 1512 ms. Trace:
I20260709 13:02:11.465613  1661 rpcz_store.cc:276] 0709 13:02:09.952552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.464356 (+1511804us) service_pool.cc:224] Handling call
0709 13:02:11.464606 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.464825 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.464851 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.464892 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:11.464934 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.465014 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.465163 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.467629  5460 consensus_queue.cc:1048] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:11.468408  5518 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:11.467710  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:11.469362  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 349591us
I20260709 13:02:11.470129  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:11.470324  1633 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:11.470438  1705 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:11.478129  1705 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:11.479795  1662 raft_consensus.cc:2393] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 13: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:11.480505  1739 raft_consensus.cc:1240] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:11.446987  5655 raft_consensus.cc:697] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 8 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:11.406456  1556 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:11.486011  5340 raft_consensus.cc:2749] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:11.489591  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 83252.5us
I20260709 13:02:11.488044  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:11.494266  1556 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:11.481670  5643 consensus_meta.cc:287] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.540s	user 0.014s	sys 0.000s
I20260709 13:02:11.489171  5655 consensus_queue.cc:237] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:11.497407  5585 raft_consensus.cc:2804] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:11.467821  5528 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:11.456707  5592 consensus_queue.cc:260] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:11.502424  1705 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:11.498096  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:11.486902  5663 raft_consensus.cc:2764] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:02:11.469060  5518 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:11.448756  5549 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:11.512930  1586 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 8.
W20260709 13:02:11.514647  1733 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43686 (request call id 2188) took 1534 ms (client timeout 1581 ms). Trace:
W20260709 13:02:11.545512  1733 rpcz_store.cc:269] 0709 13:02:09.979895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.017884 (+ 37989us) service_pool.cc:224] Handling call
0709 13:02:11.514422 (+1496538us) spinlock_profiling.cc:243] Waited 688 ms on lock 0x7b54000ff0d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:11.514579 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1583169920}
I20260709 13:02:11.546295  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:11.510613  1740 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:02:11.515749  1665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 2534) took 2175 ms. Trace:
I20260709 13:02:11.549474  1665 rpcz_store.cc:276] 0709 13:02:09.340656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.845060 (+1504404us) service_pool.cc:224] Handling call
0709 13:02:10.864630 (+ 19570us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:10.917794 (+ 53164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.515488 (+597694us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b5400043654. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:11.515683 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54589824}
I20260709 13:02:11.550926  5603 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.551082  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:11.551523  5603 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:11.492573  5573 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:11.554651  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 52332.8us
I20260709 13:02:11.555593  1705 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:11.495631  5584 raft_consensus.cc:2804] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:11.570475  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:11.515642  1556 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:11.560145  1592 raft_consensus.cc:1240] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:11.575461  1705 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:11.552781  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:11.576763  1592 raft_consensus.cc:1240] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:11.495802  5340 raft_consensus.cc:2749] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:11.564173  1664 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:02:11.563920  2426 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:11.588155  1705 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:11.589047  1591 raft_consensus.cc:1240] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 6. Current term is 7. Ops: []
W20260709 13:02:11.569276  5598 consensus_meta.cc:287] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.522s	user 0.011s	sys 0.000s
I20260709 13:02:11.553597  5460 raft_consensus.cc:2804] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:11.601585  1584 raft_consensus.cc:1275] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:11.601415  1705 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:11.608796  1660 raft_consensus.cc:2393] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 11: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:11.610790  1666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3232) took 1794 ms. Trace:
I20260709 13:02:11.580168  5632 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:11.573585  5592 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:11.557355  5585 raft_consensus.cc:697] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:11.574156  5584 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:11.512987  5643 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:11.578301  5510 consensus_queue.cc:1048] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:02:11.556927  5518 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:11.553479  5573 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:11.671147  1590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2675) took 1715 ms. Trace:
I20260709 13:02:11.612149  1666 rpcz_store.cc:276] 0709 13:02:09.816393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.260802 (+1444409us) service_pool.cc:224] Handling call
0709 13:02:11.274229 (+ 13427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.330947 (+ 56718us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.330996 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.331058 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:11.331106 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.610552 (+279446us) spinlock_profiling.cc:243] Waited 56.4 ms on lock 0x7b5400001ed4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:11.610596 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.610717 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129778432}
I20260709 13:02:11.681417  1590 rpcz_store.cc:276] 0709 13:02:09.955626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.316863 (+1361237us) service_pool.cc:224] Handling call
0709 13:02:11.317257 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:11.317485 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.317511 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:11.318040 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:02:11.594433 (+276393us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:11.594479 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.594552 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:11.670840 (+ 76288us) raft_consensus.cc:1685] finished
0709 13:02:11.670862 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.671053 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":275846,"threads_started":1,"wal-append.queue_time_us":334666}
W20260709 13:02:11.683077  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.610898  1740 raft_consensus.cc:1240] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:11.686981  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:11.642947  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 172703us
I20260709 13:02:11.670284  5549 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:11.688823  5177 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:11.664276  5515 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:11.660660  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 64253.4us
I20260709 13:02:11.617784  1664 raft_consensus.cc:1275] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:11.692930  1664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58814 (request call id 527) took 1739 ms. Trace:
I20260709 13:02:11.634418  1583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2673) took 1699 ms. Trace:
I20260709 13:02:11.693601  1664 rpcz_store.cc:276] 0709 13:02:09.953436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.580771 (+1627335us) service_pool.cc:224] Handling call
0709 13:02:11.610748 (+ 29977us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.692678 (+ 81930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.692868 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.599228  5202 raft_consensus.cc:2749] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:11.594360  5586 raft_consensus.cc:2749] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:11.648097  1667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 2539) took 2199 ms. Trace:
I20260709 13:02:11.695766  1705 leader_election.cc:400] T ae1310c9ee464797a39b786c1d932941 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Vote denied by peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683) with higher term. Message: Invalid argument: T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 7. Current term is 8.
I20260709 13:02:11.693660  1583 rpcz_store.cc:276] 0709 13:02:09.935301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.156577 (+1221276us) service_pool.cc:224] Handling call
0709 13:02:11.160359 (+  3782us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.160558 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:11.367584 (+207026us) log.cc:844] Serialized 14 byte log entry
0709 13:02:11.633901 (+266317us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.634001 (+   100us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:11.634067 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.634167 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.634342 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":246041,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":18479,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":2155,"thread_start_us":472495,"threads_started":2}
W20260709 13:02:11.612834  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 358172us
W20260709 13:02:11.611295  1659 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39146 (request call id 3226) took 1796 ms (client timeout 2062 ms). Trace:
I20260709 13:02:11.687109  5573 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:11.600050  5663 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:11.612047  5460 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.599414  5636 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:11.605547  5627 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:11.596771  5617 raft_consensus.cc:2804] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:11.730722  1737 raft_consensus.cc:1240] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:11.733232  1705 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
W20260709 13:02:11.711362  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 211857us
I20260709 13:02:11.724411  1667 rpcz_store.cc:276] 0709 13:02:09.448500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.883640 (+1435140us) service_pool.cc:224] Handling call
0709 13:02:10.997724 (+114084us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:10.998079 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:10.998116 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:10.998155 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:10.998187 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.998249 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.647843 (+649594us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b540024fed0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8e8ad 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:11.648014 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5920,"raft.queue_time_us":11363,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":10434,"spinlock_wait_cycles":261383040}
W20260709 13:02:11.725790  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.736044  2424 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:02:11.725854  1659 rpcz_store.cc:269] 0709 13:02:09.814524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.702886 (+888362us) service_pool.cc:224] Handling call
0709 13:02:11.611111 (+908225us) spinlock_profiling.cc:243] Waited 74.4 ms on lock 0x7b540040e7d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:11.611242 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171033344}
I20260709 13:02:11.662004  5570 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:11.673069  5646 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:11.686986  5638 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:11.643069  2543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49238 (request call id 447) took 1620 ms. Trace:
I20260709 13:02:11.695981  5584 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:11.653995  5662 raft_consensus.cc:2749] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:11.657653  5650 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:11.728325  5460 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:11.608496  5598 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:11.733000  5617 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.776414  1659 raft_consensus.cc:1240] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:02:11.730877  5627 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:11.784719  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 269146us
I20260709 13:02:11.806809  1556 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:11.808293  1556 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:11.755522  5620 raft_consensus.cc:2749] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:11.771328  5202 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.775686  5663 raft_consensus.cc:2764] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:02:11.810775  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 84242.5us
I20260709 13:02:11.810539  5636 consensus_queue.cc:1059] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:11.811278  5650 raft_consensus.cc:2804] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:11.812821  1556 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:11.833176  1556 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:11.833045  1738 raft_consensus.cc:1240] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:11.812992  5638 consensus_queue.cc:1059] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:11.813798  5635 consensus_queue.cc:1059] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:11.817402  5585 consensus_queue.cc:237] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:11.834659  5549 raft_consensus.cc:2804] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:11.835172  5549 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:11.835618  5549 raft_consensus.cc:3060] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:11.728423  5431 consensus_queue.cc:1048] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:02:11.838769  2515 raft_consensus.cc:1275] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:02:11.839380  5636 raft_consensus.cc:3055] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:11.839803  5636 raft_consensus.cc:740] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:11.840700  5636 consensus_queue.cc:260] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:11.842069  5636 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:11.843340  5338 raft_consensus.cc:2749] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:11.778112  5603 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:11.853017  5603 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.856339  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:11.858855  1664 raft_consensus.cc:1240] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:11.860908  5643 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:11.830515  1659 raft_consensus.cc:1240] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:02:11.865248  1664 raft_consensus.cc:1275] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:02:11.807212  5617 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:11.807457  5627 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:11.862566  5515 raft_consensus.cc:2749] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:11.841264  5599 consensus_queue.cc:1059] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:02:11.880589  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 239390us
I20260709 13:02:11.740404  5675 consensus_queue.cc:1059] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 13:02:11.894091  5675 consensus_queue.cc:1243] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer 6d4de2ce0683442498244b9529127f91 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:02:11.894798  5675 consensus_queue.cc:1048] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:11.801667  5589 consensus_queue.cc:1059] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 13:02:11.831918  5202 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:11.841987  5662 consensus_queue.cc:1059] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:11.897328  1663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3238) took 1982 ms. Trace:
I20260709 13:02:11.827688  5586 raft_consensus.cc:2804] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:11.898198  5586 raft_consensus.cc:697] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:11.760120  2543 rpcz_store.cc:276] 0709 13:02:10.015163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.028306 (+ 13143us) service_pool.cc:224] Handling call
0709 13:02:10.075569 (+ 47263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:10.376186 (+300617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.607289 (+1231103us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b5400133654. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:11.635170 (+ 27881us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":489768320}
I20260709 13:02:11.895864  5652 raft_consensus.cc:3055] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:11.897634  1739 raft_consensus.cc:2410] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:02:11.885563  5518 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:11.831703  5650 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:11.897843  1663 rpcz_store.cc:276] 0709 13:02:09.915305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.341873 (+1426568us) service_pool.cc:224] Handling call
0709 13:02:11.342287 (+   414us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:11.412118 (+ 69831us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.412163 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:11.464579 (+ 52416us) log.cc:844] Serialized 52 byte log entry
0709 13:02:11.753643 (+289064us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:11.753780 (+   137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.753899 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:11.897049 (+143150us) raft_consensus.cc:1685] finished
0709 13:02:11.897073 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.897261 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":74277,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":21686,"thread_start_us":252049,"threads_started":1,"wal-append.queue_time_us":313102}
W20260709 13:02:11.917209  5380 consensus_meta.cc:287] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.646s	user 0.017s	sys 0.003s
I20260709 13:02:11.918576  5358 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:11.951470  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 259399us
W20260709 13:02:11.952178  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 259295us
I20260709 13:02:11.925486  5549 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:11.953595  1633 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:11.912521  5652 raft_consensus.cc:740] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:11.930014  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:11.930792  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:11.963303  1590 raft_consensus.cc:2368] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 7. Current term is 8.
I20260709 13:02:11.931418  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:11.932026  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:11.934530  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:11.937201  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:02:11.954041  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 194419us
W20260709 13:02:11.955291  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.958979  1659 raft_consensus.cc:1275] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:02:11.987320  2424 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:11.975375  1739 raft_consensus.cc:2393] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 11: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:11.947379  5650 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:11.986649  2515 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:11.993407  5202 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:11.995337  5266 raft_consensus.cc:3055] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:11.995872  5266 raft_consensus.cc:740] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:11.997615  5646 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.998284  5646 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:11.963590  5177 raft_consensus.cc:3055] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:12.002063  5177 raft_consensus.cc:740] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:12.002266  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:12.002976  5177 consensus_queue.cc:260] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:12.003572  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:12.004115  5177 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:10.892711  1477 catalog_manager.cc:5028] TS 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): tablet ae1310c9ee464797a39b786c1d932941 (table test-workload [id=8a8e3153ff4e476f890a0820215f177a]) successfully deleted
W20260709 13:02:12.006008  1477 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 1.1444e+06us
I20260709 13:02:11.971660  5358 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:12.008402  5675 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.008960  5675 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:12.011272  5675 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:12.004796  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:12.013702  1734 raft_consensus.cc:2393] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 13: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:12.014003  5549 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:12.014824  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:12.015575  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:12.017604  5546 consensus_meta.cc:287] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.555s	user 0.017s	sys 0.000s
I20260709 13:02:12.016841  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:12.018996  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:12.020105  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:12.018059  5546 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:12.022011  5637 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:12.022676  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:12.023423  1732 raft_consensus.cc:2368] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for earlier term 8. Current term is 9.
I20260709 13:02:12.017359  5646 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:12.019567  5652 consensus_queue.cc:260] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:12.029038  1734 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:02:12.032389  1666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 2566) took 1042 ms. Trace:
I20260709 13:02:12.028280  1741 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:02:11.963699  5655 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.043619  5655 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:12.046295  5652 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:12.017638  1735 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 7.
I20260709 13:02:11.959408  5643 raft_consensus.cc:3055] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:12.047469  5643 raft_consensus.cc:740] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:12.048548  1584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46836 (request call id 441) took 1261 ms. Trace:
I20260709 13:02:12.048460  5643 consensus_queue.cc:260] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:12.058099  1660 raft_consensus.cc:1240] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:12.022104  5546 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:12.064138  5671 log.cc:927] Time spent T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.242s	user 0.000s	sys 0.002s
I20260709 13:02:11.996891  5266 consensus_queue.cc:260] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:12.034068  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:12.034816  5596 raft_consensus.cc:2749] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:12.110303  1588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2672) took 2175 ms. Trace:
W20260709 13:02:12.036432  5605 consensus_meta.cc:287] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6: Time spent flushing consensus metadata: real 0.982s	user 0.014s	sys 0.007s
I20260709 13:02:11.970888  5570 raft_consensus.cc:2804] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:11.987006  5586 consensus_queue.cc:237] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:12.038901  5598 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:11.948942  5603 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:12.064116  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:12.049113  1584 rpcz_store.cc:276] 0709 13:02:10.787286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.398354 (+611068us) service_pool.cc:224] Handling call
0709 13:02:11.423320 (+ 24966us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.609164 (+185844us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.048242 (+439078us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b5400031bd4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:12.048470 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":409187712}
I20260709 13:02:12.070616  1662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39146 (request call id 3249) took 1302 ms. Trace:
W20260709 13:02:12.028165  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 185210us
I20260709 13:02:12.094365  5643 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:12.146679  1633 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:12.100528  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:12.110875  1588 rpcz_store.cc:276] 0709 13:02:09.934472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.135473 (+1201001us) service_pool.cc:224] Handling call
0709 13:02:11.135887 (+   414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:11.136141 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.136167 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:11.136641 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 13:02:11.587466 (+450825us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:11.587512 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.587584 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:12.063448 (+475864us) spinlock_profiling.cc:243] Waited 39.7 ms on lock 0x7b4400022b4c. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7ddc8c85 00007f1b7ddc96a2 00007f1b80b3b1db 00007f1b80b36aaf 00007f1b80b2a86e 00007f1b80b29bb6 00007f1b80b297d8 00007f1b80b33221 00007f1b80b331d9 00007f1b80b33169
0709 13:02:12.094584 (+ 31136us) raft_consensus.cc:1685] finished
0709 13:02:12.094611 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.110201 (+ 15590us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91351808,"thread_start_us":450384,"threads_started":1,"wal-append.queue_time_us":628636}
W20260709 13:02:12.036809  5577 consensus_meta.cc:287] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.601s	user 0.011s	sys 0.007s
I20260709 13:02:12.032976  1666 rpcz_store.cc:276] 0709 13:02:10.989935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.698474 (+708539us) service_pool.cc:224] Handling call
0709 13:02:11.698960 (+   486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.699266 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:11.728536 (+ 29270us) log.cc:844] Serialized 14 byte log entry
0709 13:02:12.031945 (+303409us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:12.032012 (+    67us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:12.032073 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.032159 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.032321 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":31095,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":6052,"raft.queue_time_us":797,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":92,"thread_start_us":302350,"threads_started":1}
W20260709 13:02:12.150542  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 309727us
I20260709 13:02:12.141618  1662 rpcz_store.cc:276] 0709 13:02:10.768263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.779900 (+ 11637us) service_pool.cc:224] Handling call
0709 13:02:12.070392 (+1290492us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b540019aad4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:12.070553 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1589542784}
I20260709 13:02:12.145532  1556 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:12.149175  1737 raft_consensus.cc:1240] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:12.149144  1739 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:12.152506  1737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43686 (request call id 2201) took 1015 ms. Trace:
I20260709 13:02:12.118294  1661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58814 (request call id 525) took 2165 ms. Trace:
W20260709 13:02:12.030869  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 43660.1us
I20260709 13:02:12.153901  1589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2665) took 2256 ms. Trace:
I20260709 13:02:12.153599  1661 rpcz_store.cc:276] 0709 13:02:09.952833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.466670 (+1513837us) service_pool.cc:224] Handling call
0709 13:02:11.467052 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.577823 (+110771us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.578023 (+   200us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.578089 (+    66us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:11.578141 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.118019 (+539878us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b540041c8d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:12.118065 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.118213 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":254143744}
I20260709 13:02:12.154501  1589 rpcz_store.cc:276] 0709 13:02:09.897601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.987540 (+1089939us) service_pool.cc:224] Handling call
0709 13:02:11.302819 (+315279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.303488 (+   669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.153707 (+850219us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b54001d2ed0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8e8ad 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:12.153838 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":724270336}
W20260709 13:02:12.117625  1735 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35672 (request call id 412) took 2512 ms (client timeout 1501 ms). Trace:
I20260709 13:02:12.156129  1587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2677) took 1787 ms. Trace:
I20260709 13:02:12.156543  1587 rpcz_store.cc:276] 0709 13:02:10.368639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.350229 (+981590us) service_pool.cc:224] Handling call
0709 13:02:11.357162 (+  6933us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.368997 (+ 11835us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.369030 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.369114 (+    84us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:11.369148 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.155916 (+786768us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b54003b47d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:12.155962 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.156073 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26740480}
I20260709 13:02:12.152860  1737 rpcz_store.cc:276] 0709 13:02:11.137177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.116683 (+979506us) service_pool.cc:224] Handling call
0709 13:02:12.145973 (+ 29290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:12.152247 (+  6274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.152449 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:12.160948  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:12.162941  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:12.163832  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:12.166704  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:12.168442  1663 raft_consensus.cc:1275] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:02:12.171604  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:12.170954  1633 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:12.173323  1741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43678 (request call id 3324) took 1019 ms. Trace:
I20260709 13:02:12.173745  1741 rpcz_store.cc:276] 0709 13:02:11.132321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.257435 (+125114us) service_pool.cc:224] Handling call
0709 13:02:12.151482 (+894047us) spinlock_profiling.cc:243] Waited 705 ms on lock 0x7b540001cf54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:12.151591 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1621831936}
I20260709 13:02:12.162536  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:12.155740  1735 rpcz_store.cc:269] 0709 13:02:09.586521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.593469 (+  6948us) service_pool.cc:224] Handling call
0709 13:02:12.098258 (+2504789us) spinlock_profiling.cc:243] Waited 2.4 s on lock 0x7b5400143554. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:12.098534 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5515600256}
I20260709 13:02:12.177634  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:12.164758  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:12.178799  1660 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:12.117400  5570 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:12.176451  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:12.176394  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:12.186604  1735 raft_consensus.cc:1240] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:12.173867  5518 raft_consensus.cc:2749] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:12.149479  2550 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:12.199118  1556 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:02:12.201277  5673 log.cc:927] Time spent T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.399s	user 0.004s	sys 0.000s
I20260709 13:02:12.175051  5577 raft_consensus.cc:2749] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157) with higher term. Message: Invalid argument: T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 7. Current term is 8.
I20260709 13:02:12.202217  5431 raft_consensus.cc:3055] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:12.214208  5431 raft_consensus.cc:740] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:12.215287  5431 consensus_queue.cc:260] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:12.216725  5431 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:12.193595  1666 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 14.
I20260709 13:02:12.218760  1630 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:12.151223  5266 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:12.220156  1630 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:12.186349  5646 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:12.222167  5646 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:12.194353  5510 consensus_queue.cc:1048] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:02:12.224339  5510 consensus_queue.cc:1048] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:12.221098  5340 raft_consensus.cc:2749] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:12.138927  5605 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:12.229329  2548 raft_consensus.cc:1240] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 4. Current term is 5. Ops: []
W20260709 13:02:12.231832  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.205848  1556 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:12.240567  1739 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 8.
I20260709 13:02:12.241573  1734 raft_consensus.cc:1240] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:12.237246  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 59974.5us
I20260709 13:02:12.244993  1660 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:02:12.179286  5566 raft_consensus.cc:2804] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:12.186650  5570 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:12.262446  1705 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:12.233336  5126 raft_consensus.cc:2804] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:12.245959  5574 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.203790  5639 consensus_queue.cc:1048] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.059s
W20260709 13:02:12.294098  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 133430us
I20260709 13:02:12.294469  5202 consensus_queue.cc:1048] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:02:12.305280  1705 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:12.257692  5549 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:12.299975  1660 raft_consensus.cc:1275] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:02:12.301215  1587 raft_consensus.cc:1240] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:12.316949  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:12.299516  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 111843us
I20260709 13:02:12.265002  5605 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 5 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:12.252786  5380 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:12.303894  5574 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:12.274873  5620 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.301435  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:12.331517  2426 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:02:12.359156  5584 consensus_meta.cc:287] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.552s	user 0.013s	sys 0.007s
I20260709 13:02:12.359453  5358 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:12.359632  5574 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:12.326840  5686 consensus_queue.cc:1059] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
W20260709 13:02:12.361735  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.362141  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:12.362916  1663 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
I20260709 13:02:12.364070  2515 raft_consensus.cc:2468] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:02:12.359681  5584 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:12.365598  5648 consensus_meta.cc:287] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 1.028s	user 0.012s	sys 0.009s
I20260709 13:02:12.366034  5648 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:12.368512  5648 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:12.331184  5636 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.368106  5584 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:12.353232  5380 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:12.300693  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:12.259883  5589 consensus_queue.cc:1059] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 13:02:12.370930  1589 raft_consensus.cc:1240] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:12.371807  1658 raft_consensus.cc:1240] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 6. Current term is 7. Ops: []
W20260709 13:02:12.377020  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 45580.5us
W20260709 13:02:12.409452  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 130603us
I20260709 13:02:12.325917  5573 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:12.280102  5663 consensus_queue.cc:1059] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.080s
W20260709 13:02:12.393268  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 116333us
I20260709 13:02:12.330605  5635 raft_consensus.cc:2804] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:12.426056  5603 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:12.421137  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:12.348346  5638 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:12.346763  5655 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:12.421283  1555 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:12.416539  5648 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.421378  2426 leader_election.cc:400] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 7. Current term is 8.
I20260709 13:02:12.459340  2426 leader_election.cc:403] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:02:12.370549  5546 consensus_queue.cc:1048] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:02:12.436458  1658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58814 (request call id 526) took 2483 ms. Trace:
I20260709 13:02:12.432301  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:12.433570  1736 raft_consensus.cc:1275] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:02:12.447717  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.428894  1558 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:12.449525  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:12.464138  1739 raft_consensus.cc:2376] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 8. Re-sending same reply.
I20260709 13:02:12.462416  1658 rpcz_store.cc:276] 0709 13:02:09.953139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.577588 (+1624449us) service_pool.cc:224] Handling call
0709 13:02:11.586854 (+  9266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:12.373969 (+787115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.436216 (+ 62247us) spinlock_profiling.cc:243] Waited 785 ms on lock 0x7b540030aa54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:12.436397 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1804670336}
I20260709 13:02:12.465581  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:12.417459  5340 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.466859  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:12.467363  1739 raft_consensus.cc:2376] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9. Re-sending same reply.
I20260709 13:02:12.419960  5605 raft_consensus.cc:2804] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:12.467372  1661 raft_consensus.cc:1275] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:12.469542  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:12.423926  5635 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.452713  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:12.450140  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:12.458602  1662 raft_consensus.cc:1275] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:12.483223  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:02:12.473134  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.439308  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:12.430896  2548 raft_consensus.cc:1275] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:12.474077  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:12.480665  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:12.373123  5620 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:12.369395  5636 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:12.423774  5573 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:12.471658  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:12.554121  1733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3335) took 1046 ms. Trace:
I20260709 13:02:12.557854  1732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3326) took 1425 ms. Trace:
W20260709 13:02:12.543386  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.605366  1732 rpcz_store.cc:276] 0709 13:02:11.132906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.023951 (+891045us) service_pool.cc:224] Handling call
0709 13:02:12.024421 (+   470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:12.024965 (+   544us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:12.025000 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:12.032924 (+  7924us) log.cc:844] Serialized 26 byte log entry
0709 13:02:12.242357 (+209433us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:12.242396 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.242461 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:12.557592 (+315131us) raft_consensus.cc:1685] finished
0709 13:02:12.557619 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.557778 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32067,"raft.queue_time_us":5696,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":7769,"spinlock_wait_cycles":1209216,"thread_start_us":159823,"threads_started":1,"wal-append.queue_time_us":437733}
I20260709 13:02:12.489648  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:12.611833  1667 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:02:12.509045  1633 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
W20260709 13:02:12.500226  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:12.613433  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 104510us
I20260709 13:02:12.517357  1663 raft_consensus.cc:1275] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:12.533320  1739 raft_consensus.cc:1275] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:12.600301  1733 rpcz_store.cc:276] 0709 13:02:11.507522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.222134 (+714612us) service_pool.cc:224] Handling call
0709 13:02:12.222512 (+   378us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:12.246036 (+ 23524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:12.246066 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:12.253494 (+  7428us) log.cc:844] Serialized 52 byte log entry
0709 13:02:12.396718 (+143224us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:12.396787 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.396886 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:12.553868 (+156982us) raft_consensus.cc:1685] finished
0709 13:02:12.553891 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.554057 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53250,"raft.queue_time_us":30143,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":134,"thread_start_us":90687,"threads_started":1,"wal-append.queue_time_us":231108}
W20260709 13:02:12.483809  5460 consensus_meta.cc:287] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.665s	user 0.014s	sys 0.006s
I20260709 13:02:12.460032  5638 raft_consensus.cc:697] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 9 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:12.468355  5639 raft_consensus.cc:2749] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 7. Current term is 8.
W20260709 13:02:12.545835  5695 log.cc:927] Time spent T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:02:12.544281  5689 log.cc:927] Time spent T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.239s	user 0.000s	sys 0.000s
I20260709 13:02:12.549916  2552 raft_consensus.cc:1240] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:12.638701  1633 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:02:12.635010  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 213771us
W20260709 13:02:12.663450  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 202546us
I20260709 13:02:12.641234  2424 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:12.552068  5699 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:12.639982  1661 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:12.540462  5555 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.475760  5566 raft_consensus.cc:697] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:12.548393  5584 raft_consensus.cc:2804] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:12.548339  5637 raft_consensus.cc:3055] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:12.486301  5635 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:12.501842  5655 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:12.542171  5696 consensus_queue.cc:1059] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.131s
W20260709 13:02:12.667799  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 238985us
I20260709 13:02:12.593883  5126 raft_consensus.cc:697] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:12.471284  5648 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:12.637320  5646 consensus_queue.cc:1048] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:02:12.487898  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:12.535794  5685 consensus_queue.cc:1048] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.131s
I20260709 13:02:12.631718  5605 raft_consensus.cc:697] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:12.675076  2550 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:02:12.627527  5652 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:12.625489  5266 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:12.670625  2426 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:12.624300  5380 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:12.484870  5663 consensus_queue.cc:1243] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer 5bb87fe07da2414e84ee578c3b176ede log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:02:12.548138  5706 consensus_queue.cc:1059] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.122s
I20260709 13:02:12.501796  5340 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:12.637534  5518 consensus_queue.cc:1048] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:02:12.729441  5573 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:12.730002  5573 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:12.730394  5518 raft_consensus.cc:2749] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:12.638918  2543 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
I20260709 13:02:12.730531  5573 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:12.738204  5706 raft_consensus.cc:3055] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:12.738830  5706 raft_consensus.cc:740] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:12.739971  5706 consensus_queue.cc:260] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:12.676173  5642 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.860s	user 0.000s	sys 0.029s
W20260709 13:02:12.742066  5642 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.001s	sys 0.029s
I20260709 13:02:12.669673  5713 consensus_queue.cc:1048] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:02:12.684886  5639 raft_consensus.cc:2749] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:12.685977  5637 raft_consensus.cc:740] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:12.718086  1661 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
W20260709 13:02:12.719079  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 48567.8us
I20260709 13:02:12.744426  1558 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:12.710469  5627 consensus_meta.cc:287] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.816s	user 0.010s	sys 0.008s
I20260709 13:02:12.676432  5555 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:12.721571  5596 consensus_queue.cc:1059] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:02:12.727736  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:12.755834  2523 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:02:12.661818  5460 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:12.719400  5515 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:12.713384  5699 raft_consensus.cc:697] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:12.759157  5460 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:12.760265  1585 raft_consensus.cc:1240] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:02:12.759831  5699 consensus_queue.cc:237] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:12.762641  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:12.693619  5655 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:12.764443  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 139101us
I20260709 13:02:12.765653  5655 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:12.765978  1633 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:12.775828  5716 log.cc:927] Time spent T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:02:12.789232  5126 consensus_queue.cc:237] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:12.766601  5566 consensus_queue.cc:237] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:12.793835  5648 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:12.794762  5637 consensus_queue.cc:260] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:12.795291  5549 raft_consensus.cc:2749] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:12.796031  5637 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:12.724450  5266 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:12.798202  5266 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:12.798637  1741 raft_consensus.cc:3055] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:12.799010  1741 raft_consensus.cc:740] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:12.799713  1741 consensus_queue.cc:260] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:12.720330  5638 consensus_queue.cc:237] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:12.806301  1732 raft_consensus.cc:1275] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:12.807219  5555 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:12.719877  5584 raft_consensus.cc:697] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:12.810050  1659 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:12.813510  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:02:12.814926  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 70626.4us
I20260709 13:02:12.815737  1558 leader_election.cc:400] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for earlier term 8. Current term is 9.
I20260709 13:02:12.816026  1558 leader_election.cc:403] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:02:12.751789  5714 consensus_queue.cc:1059] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:02:12.808560  5584 consensus_queue.cc:237] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:12.828914  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:12.829181  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 75562.2us
I20260709 13:02:12.830119  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:12.835700  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 65899.5us
I20260709 13:02:12.836239  1589 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 8.
I20260709 13:02:12.836552  1630 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:12.837617  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 71719.9us
I20260709 13:02:12.830355  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:12.830642  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:12.840257  1584 raft_consensus.cc:2393] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 7: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:12.831277  1583 raft_consensus.cc:1275] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:12.831549  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:12.832007  1586 raft_consensus.cc:1240] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:12.837527  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:12.833555  1704 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:12.845750  1665 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 8.
I20260709 13:02:12.844787  1589 raft_consensus.cc:2376] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 9. Re-sending same reply.
I20260709 13:02:12.854832  5652 raft_consensus.cc:697] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 8 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:12.856000  5652 consensus_queue.cc:237] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:12.849956  1585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
W20260709 13:02:12.784910  5617 consensus_meta.cc:287] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent flushing consensus metadata: real 0.894s	user 0.005s	sys 0.014s
I20260709 13:02:12.865103  1704 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:12.863327  1585 raft_consensus.cc:606] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:12.872367  1592 raft_consensus.cc:1275] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:12.884148  1591 raft_consensus.cc:1275] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:02:12.851591  5650 consensus_meta.cc:287] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.820s	user 0.014s	sys 0.005s
I20260709 13:02:12.753036  5573 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:12.828943  5596 raft_consensus.cc:3055] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:12.829008  2540 raft_consensus.cc:1240] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:12.923481  1661 raft_consensus.cc:1240] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:12.851361  5706 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:12.865367  5643 consensus_meta.cc:287] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.717s	user 0.011s	sys 0.000s
I20260709 13:02:12.829450  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:12.881973  5460 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:12.885954  5642 raft_consensus.cc:2804] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:02:12.908442  5592 consensus_meta.cc:287] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 1.208s	user 0.016s	sys 0.012s
I20260709 13:02:12.935539  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:12.753823  5627 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:12.881770  5266 consensus_queue.cc:1048] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
W20260709 13:02:12.946596  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 110121us
I20260709 13:02:12.892124  5358 raft_consensus.cc:2804] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:12.904521  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:12.863279  5663 consensus_queue.cc:1059] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
W20260709 13:02:12.955129  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 139521us
I20260709 13:02:12.829356  5515 consensus_queue.cc:1059] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 13:02:12.961654  1662 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:12.883416  5696 consensus_queue.cc:1059] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:02:12.888294  5718 raft_consensus.cc:2749] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:12.894780  5570 consensus_meta.cc:287] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.622s	user 0.013s	sys 0.000s
I20260709 13:02:12.894218  5596 raft_consensus.cc:740] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:12.946240  5648 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.832522  5691 consensus_queue.cc:1059] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.113s
I20260709 13:02:13.022198  1558 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:13.073628  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 51559.3us
W20260709 13:02:13.029619  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:13.031217  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:13.075848  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:13.076678  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.063125  5639 raft_consensus.cc:3055] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:13.080320  5639 raft_consensus.cc:740] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:13.081597  5639 consensus_queue.cc:260] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:13.083585  5639 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:13.063571  5646 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.085954  5646 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:13.085767  5596 consensus_queue.cc:260] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:13.087924  5596 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:13.032621  5574 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.064718  5570 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:13.091511  5574 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:13.092403  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.093767  5574 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:13.089434  5663 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:13.096895  5720 log.cc:927] Time spent T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:02:13.097498  5663 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:13.043761  5685 consensus_queue.cc:1059] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:02:13.100278  5663 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:13.043141  5340 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:13.101167  1658 raft_consensus.cc:1240] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:13.104640  5627 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:13.036520  5515 raft_consensus.cc:3055] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:13.105293  5515 raft_consensus.cc:740] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:13.106371  5515 consensus_queue.cc:260] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:13.105022  5722 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:13.107872  5515 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:13.108119  5722 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:13.037097  1665 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58814 (request call id 529) took 1536 ms (client timeout 1945 ms). Trace:
I20260709 13:02:12.954414  5655 raft_consensus.cc:2749] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:13.040462  1740 raft_consensus.cc:1240] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 16. Current term is 17. Ops: []
W20260709 13:02:13.113255  1665 rpcz_store.cc:269] 0709 13:02:11.500435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.552438 (+ 52003us) service_pool.cc:224] Handling call
0709 13:02:12.966766 (+1414328us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54000a82d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:13.037011 (+ 70245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2803303168}
I20260709 13:02:12.886175  5617 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:12.962687  5549 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.963572  5620 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:12.966895  5610 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:12.959331  5338 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:12.970849  5358 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.920871  5650 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:13.052278  1662 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:02:13.145903  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:13.146528  1662 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:13.057534  5693 raft_consensus.cc:993] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
W20260709 13:02:13.032455  5717 log.cc:927] Time spent T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:02:13.067098  1556 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:13.153699  1633 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:13.021126  5636 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:13.030879  1738 raft_consensus.cc:1275] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:13.063966  5723 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.123335  1740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3325) took 1990 ms. Trace:
I20260709 13:02:13.125564  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:13.125775  1659 raft_consensus.cc:2468] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:02:13.034024  5642 raft_consensus.cc:697] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 9 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:13.168655  1740 rpcz_store.cc:276] 0709 13:02:11.132615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.687166 (+554551us) service_pool.cc:224] Handling call
0709 13:02:11.687754 (+   588us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:13.113829 (+1426075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.114430 (+   601us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54004394d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:13.123261 (+  8831us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3110430976}
I20260709 13:02:13.176595  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:13.171240  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:13.142513  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:13.147518  1664 raft_consensus.cc:1240] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:02:12.887490  5605 consensus_queue.cc:237] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:13.152315  5714 raft_consensus.cc:3055] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:13.144662  5358 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:13.151738  5549 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:13.172042  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 91474.4us
I20260709 13:02:13.124442  5718 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.177248  1732 raft_consensus.cc:1813] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Handling vote request from an unknown peer 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:13.133127  1663 raft_consensus.cc:1240] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:13.173677  1705 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
W20260709 13:02:13.180299  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 113311us
I20260709 13:02:13.134042  5655 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:13.186326  1556 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:13.187074  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:13.187527  1732 raft_consensus.cc:2393] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 11: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:13.078117  5648 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:13.154806  5380 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.248056  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:13.248695  1734 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:13.137948  5722 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:13.123584  5687 consensus_queue.cc:1048] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:02:13.153110  5570 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:13.246897  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 63868us
I20260709 13:02:13.248734  1663 raft_consensus.cc:2393] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 7: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:13.173041  5266 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.175123  5574 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.175575  5620 raft_consensus.cc:2749] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:13.259642  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 73391.6us
I20260709 13:02:13.262929  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:13.187250  5714 raft_consensus.cc:740] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:13.184629  5691 raft_consensus.cc:1081] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:02:13.189118  2537 raft_consensus.cc:1240] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:13.256410  5380 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:13.175417  5340 consensus_queue.cc:1048] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 13:02:13.285845  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:13.289373  5719 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.148850  5338 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:13.259601  5655 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:13.314678  5338 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:13.302512  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:13.315619  5655 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:13.316144  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:13.317378  5510 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.176453  5723 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:13.320013  5723 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:13.255949  5652 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:13.320680  5652 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:13.298403  5722 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.323770  5646 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:13.256243  5637 raft_consensus.cc:2804] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:13.324426  5637 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:13.324836  5637 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:13.297446  5574 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:13.326000  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:13.323519  5722 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:13.259882  5663 consensus_queue.cc:1059] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:02:13.327296  5663 raft_consensus.cc:3055] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:13.312115  1734 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
I20260709 13:02:13.317924  5510 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:13.328049  1663 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
I20260709 13:02:13.179700  5707 consensus_queue.cc:1059] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.131s
W20260709 13:02:13.310768  5717 log.cc:927] Time spent T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:02:13.294536  5586 raft_consensus.cc:2749] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:13.284291  1705 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:13.399276  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 127821us
I20260709 13:02:13.369401  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:13.376101  1633 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:13.327690  5663 raft_consensus.cc:740] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:13.257337  5699 consensus_queue.cc:1059] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
W20260709 13:02:13.410728  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 126622us
I20260709 13:02:13.404217  1556 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:13.416074  1738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3328) took 2282 ms. Trace:
I20260709 13:02:13.417802  1738 rpcz_store.cc:276] 0709 13:02:11.133527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.047019 (+913492us) service_pool.cc:224] Handling call
0709 13:02:12.047380 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:13.154655 (+1107275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.415818 (+261163us) spinlock_profiling.cc:243] Waited 935 ms on lock 0x7b54002233d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:13.416009 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2150801152}
I20260709 13:02:13.296066  5266 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:13.415525  5627 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:13.246224  5718 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:13.397653  5698 raft_consensus.cc:2804] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:13.397933  5652 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:13.415737  5723 raft_consensus.cc:2804] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:13.456491  1662 raft_consensus.cc:1275] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:13.439184  5646 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:13.443336  1556 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:13.446846  5700 raft_consensus.cc:2804] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:13.439574  5431 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.457367  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:13.472018  1738 raft_consensus.cc:2393] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 12: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
W20260709 13:02:13.439713  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 181436us
I20260709 13:02:13.336758  5719 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:13.460131  5648 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:13.399748  5642 consensus_queue.cc:237] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:13.481226  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 66190.3us
I20260709 13:02:13.442472  5709 consensus_queue.cc:1048] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.355s
I20260709 13:02:13.457062  5723 raft_consensus.cc:697] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
W20260709 13:02:13.482241  1707 leader_election.cc:336] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.666s (SENT)
I20260709 13:02:13.470363  5700 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:13.468358  5617 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:13.472491  5650 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:13.463438  5711 raft_consensus.cc:2749] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:13.500259  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:13.477933  5574 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:13.467972  5589 consensus_queue.cc:1048] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:02:13.430332  5714 consensus_queue.cc:260] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:13.521931  5728 log.cc:927] Time spent T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 13:02:13.475790  5431 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:13.501205  5700 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:13.457103  5663 consensus_queue.cc:260] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:13.484362  5722 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:13.510860  5549 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:13.467993  5646 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:13.553483  5723 consensus_queue.cc:237] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:13.556387  5732 log.cc:927] Time spent T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.160s	user 0.002s	sys 0.000s
I20260709 13:02:13.556672  2540 raft_consensus.cc:1240] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 4. Current term is 5. Ops: []
W20260709 13:02:13.558339  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.507460  1738 raft_consensus.cc:2393] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 9: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:13.506217  5738 raft_consensus.cc:2804] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:13.583835  1736 raft_consensus.cc:1275] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:02:13.594873  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 134739us
W20260709 13:02:13.597071  5735 log.cc:927] Time spent T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.142s	user 0.002s	sys 0.002s
W20260709 13:02:13.618934  5635 consensus_meta.cc:287] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.925s	user 0.009s	sys 0.002s
I20260709 13:02:13.619438  5635 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:13.594993  5460 consensus_meta.cc:287] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.638s	user 0.011s	sys 0.000s
I20260709 13:02:13.621486  5460 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:13.600113  5555 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.622627  5555 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:13.624402  5731 log.cc:927] Time spent T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.369s	user 0.002s	sys 0.000s
I20260709 13:02:13.612445  5663 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:13.626096  5592 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:13.626613  5592 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:13.626829  5638 consensus_queue.cc:1059] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:13.614501  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:13.615731  5692 raft_consensus.cc:3055] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:13.625459  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:13.629669  5692 raft_consensus.cc:740] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:13.630143  1665 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
I20260709 13:02:13.631002  5719 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:13.630757  5692 consensus_queue.cc:260] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:13.631659  1705 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:13.632149  5692 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:13.615126  5737 raft_consensus.cc:3055] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:13.602620  5510 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:13.633014  5737 raft_consensus.cc:740] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:13.612504  5681 raft_consensus.cc:3055] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:13.634277  5737 consensus_queue.cc:260] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:13.623091  5431 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:13.636400  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:13.652990  5737 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:13.654718  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:13.655391  5636 raft_consensus.cc:2804] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:13.655840  5636 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:13.656255  5636 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:13.649598  5738 raft_consensus.cc:697] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:13.657631  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:13.659937  2550 raft_consensus.cc:2393] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 8: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:13.628895  5592 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:13.669764  5741 log.cc:927] Time spent T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.055s	user 0.000s	sys 0.002s
I20260709 13:02:13.673355  5555 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:13.674590  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:13.680259  1741 raft_consensus.cc:3060] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:13.682281  5718 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:13.689926  1486 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55154 (request call id 305) took 12973 ms (client timeout 15000 ms). Trace:
I20260709 13:02:13.695004  1650 tablet_service.cc:1558] Processing DeleteTablet for tablet 2782217725024e159b9536d03808a3ea with delete_type TABLET_DATA_TOMBSTONED (TS 5bb87fe07da2414e84ee578c3b176ede not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:39130
I20260709 13:02:13.634199  5662 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:13.702193  1735 raft_consensus.cc:1240] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:13.635668  5646 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:13.690474  1486 rpcz_store.cc:269] 0709 13:02:00.716571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.718750 (+  2179us) service_pool.cc:224] Handling call
0709 13:02:00.880032 (+161282us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b5400119254. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef9090 00007f1b80f97f3a 00007f1b86d4e1cc 00007f1b86e4c37e 00007f1b8530d2a4 00007f1b8530d232 00007f1b8530d161 00007f1b8530d0dc 00007f1b8530c392 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:13.689816 (+12809784us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:07.526629 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:07.527866 (+  1237us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:07.527950 (+    84us) write_op.cc:435] Acquired schema lock
0709 13:02:07.527977 (+    27us) tablet.cc:662] Decoding operations
0709 13:02:07.761285 (+233308us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:07.781557 (+ 20272us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:07.781873 (+   316us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:02:07.794767 (+ 12894us) tablet.cc:701] Row locks acquired
0709 13:02:07.794837 (+    70us) write_op.cc:260] PREPARE: finished
0709 13:02:07.795382 (+   545us) write_op.cc:270] Start()
0709 13:02:07.795664 (+   282us) write_op.cc:276] Timestamp: P: 1783602127795250 usec, L: 0
0709 13:02:07.795723 (+    59us) op_driver.cc:348] REPLICATION: starting
0709 13:02:07.932659 (+136936us) log.cc:844] Serialized 2781 byte log entry
0709 13:02:08.773392 (+840733us) op_driver.cc:464] REPLICATION: finished
0709 13:02:09.114847 (+341455us) write_op.cc:301] APPLY: starting
0709 13:02:09.114962 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:09.115957 (+   995us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:09.116085 (+   128us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:09.148736 (+ 32651us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:09.149015 (+   279us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:02:09.183999 (+ 34984us) write_op.cc:312] APPLY: finished
0709 13:02:09.251254 (+ 67255us) log.cc:844] Serialized 53 byte log entry
0709 13:02:09.265427 (+ 14173us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:09.265571 (+   144us) write_op.cc:454] Released schema lock
0709 13:02:09.265635 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:09.266136 (+   501us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:09.266171 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1955580,"reported_tablets":21,"spinlock_wait_cycles":36318592,"child_traces":[["op",{"apply.queue_time_us":341125,"apply.run_cpu_time_us":4576,"apply.run_wall_time_us":151269,"num_ops":6,"prepare.queue_time_us":833926,"prepare.run_cpu_time_us":20075,"prepare.run_wall_time_us":590003,"raft.queue_time_us":297016,"raft.run_cpu_time_us":24470,"raft.run_wall_time_us":225846,"replication_time_us":977485,"thread_start_us":940853,"threads_started":4,"wal-append.queue_time_us":174929,"wal-append.run_cpu_time_us":30854,"wal-append.run_wall_time_us":2349166}]]}
W20260709 13:02:13.688831  5610 consensus_meta.cc:287] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.539s	user 0.010s	sys 0.000s
I20260709 13:02:13.635675  5681 raft_consensus.cc:740] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:13.767141  5681 consensus_queue.cc:260] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:13.783180  1741 raft_consensus.cc:1275] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:13.783987  1741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43686 (request call id 2206) took 2091 ms. Trace:
I20260709 13:02:13.784379  1741 rpcz_store.cc:276] 0709 13:02:11.692545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.224574 (+532029us) service_pool.cc:224] Handling call
0709 13:02:12.224869 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:12.798545 (+573676us) spinlock_profiling.cc:243] Waited 49.6 ms on lock 0x7b5400355fa0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f06dc0 00007f1b80f911c0 00007f1b80f92231 00007f1b80f8ed8f 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c
0709 13:02:13.679808 (+881263us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b58003db2d0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80eeb0aa 00007f1b80f6d447 00007f1b80f85fe7 00007f1b80f877de 00007f1b80f91b49 00007f1b80f92416 00007f1b80f8ed8f 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4
0709 13:02:13.783715 (+103907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.783928 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":755700224}
I20260709 13:02:13.658874  5738 consensus_queue.cc:237] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:13.763268  5728 log.cc:927] Time spent T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:02:13.796422  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 319910us
W20260709 13:02:13.798504  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 113642us
I20260709 13:02:13.802454  1556 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:13.807030  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.768719  5592 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:13.826458  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:13.826892  5592 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:13.828480  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:13.811411  1488 catalog_manager.cc:5697] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 7 to 9, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:02:13.796970  5610 raft_consensus.cc:2749] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for earlier term 8. Current term is 9.
I20260709 13:02:13.829643  5610 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:13.830149  5610 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:13.812647  5639 consensus_meta.cc:287] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent flushing consensus metadata: real 0.728s	user 0.006s	sys 0.010s
I20260709 13:02:13.813146  1633 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:02:13.814131  5358 consensus_meta.cc:287] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.563s	user 0.011s	sys 0.001s
I20260709 13:02:13.832453  5358 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:13.814640  5266 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:13.660830  5546 consensus_queue.cc:1059] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.128s
I20260709 13:02:13.820108  5650 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
W20260709 13:02:13.821177  5736 log.cc:927] Time spent T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.114s	user 0.000s	sys 0.003s
I20260709 13:02:13.821499  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:13.821825  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:13.822921  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:13.824043  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:13.824715  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:13.825385  5718 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:13.825838  1584 raft_consensus.cc:1240] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:02:13.765563  5652 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.827786  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:13.764026  5662 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:13.833936  1633 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:13.905229  1592 raft_consensus.cc:2410] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 13:02:13.907580  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 73716.4us
I20260709 13:02:13.908762  1633 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:13.910398  1633 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:02:13.800514  5651 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:02:13.917555  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:13.916757  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:13.918429  1585 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 7.
I20260709 13:02:13.919647  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:13.920451  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:13.924577  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:13.835577  2515 raft_consensus.cc:2410] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 13:02:13.865053  5706 consensus_meta.cc:287] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.915s	user 0.009s	sys 0.002s
W20260709 13:02:13.825853  5742 log.cc:927] Time spent T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
W20260709 13:02:13.853331  5743 log.cc:927] Time spent T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:02:13.832664  5691 raft_consensus.cc:2804] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:02:13.916992  5637 consensus_meta.cc:287] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.586s	user 0.012s	sys 0.001s
I20260709 13:02:13.867635  5627 raft_consensus.cc:2749] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:13.834231  5719 consensus_queue.cc:1048] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:02:13.907888  5749 consensus_queue.cc:1048] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.138s
I20260709 13:02:13.836625  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:13.921350  5650 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:13.936136  1592 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:02:13.856802  5126 raft_consensus.cc:3055] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:13.992300  5126 raft_consensus.cc:740] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:13.993243  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:13.993389  5126 consensus_queue.cc:260] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:13.994575  5126 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:13.994894  1658 raft_consensus.cc:1275] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:13.832481  5646 raft_consensus.cc:2804] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:13.915684  5722 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:13.874342  1488 catalog_manager.cc:5697] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: config changed from index 4 to 5, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 6d4de2ce0683442498244b9529127f91 (127.0.107.193), VOTER 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194), VOTER 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195), VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 6 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:02:13.835033  5635 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:13.939839  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:13.832746  5610 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:13.834347  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:13.929988  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 298388us
I20260709 13:02:13.921317  5648 raft_consensus.cc:2804] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:02:13.927249  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 446633us
I20260709 13:02:13.949797  1587 raft_consensus.cc:2410] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:02:13.957409  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.962440  5380 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:13.964131  5662 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:13.922482  5652 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:13.965617  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.976713  1662 raft_consensus.cc:1275] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:13.934398  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:13.986513  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:13.923415  5718 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:13.973187  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:13.934134  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:14.037742  1588 raft_consensus.cc:2393] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 9: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:13.951718  5723 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:13.956602  5637 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:13.992383  1592 raft_consensus.cc:606] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:13.997280  5646 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:14.000579  1488 catalog_manager.cc:5697] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:14.015834  1558 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:14.014038  1591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46836 (request call id 451) took 1058 ms. Trace:
I20260709 13:02:14.012009  1705 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:13.971858  5691 raft_consensus.cc:697] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:14.026124  5650 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:14.027021  5719 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:13.993258  2537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49238 (request call id 455) took 1720 ms. Trace:
I20260709 13:02:13.997308  5592 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:14.041250  1662 raft_consensus.cc:1275] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:14.039794  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:02:14.045533  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.991428  5701 consensus_queue.cc:1059] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:02:14.054299  1488 catalog_manager.cc:5697] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 6 to 7, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:02:14.058610  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:14.059652  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:14.069176  1733 raft_consensus.cc:2410] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:14.059581  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:13.972442  5700 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:14.043062  1591 rpcz_store.cc:276] 0709 13:02:12.955305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.955447 (+   142us) service_pool.cc:224] Handling call
0709 13:02:12.966355 (+ 10908us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:13.078364 (+112009us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:13.078415 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:13.090679 (+ 12264us) log.cc:844] Serialized 52 byte log entry
0709 13:02:13.361158 (+270479us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:13.361228 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.361315 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:14.013788 (+652473us) raft_consensus.cc:1685] finished
0709 13:02:14.013825 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:14.013972 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":163479,"raft.queue_time_us":97814,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":11488,"thread_start_us":217294,"threads_started":1,"wal-append.queue_time_us":318070}
W20260709 13:02:14.065685  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 53798.2us
I20260709 13:02:14.065601  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:14.073231  1740 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 7.
I20260709 13:02:14.070108  1734 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 7.
I20260709 13:02:14.031505  5648 raft_consensus.cc:697] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:14.048782  5646 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:14.066169  2548 raft_consensus.cc:2393] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 5: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
W20260709 13:02:14.085175  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.056304  5380 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.050765  5627 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.060340  1658 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39146
I20260709 13:02:14.067165  5266 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:14.052094  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 141771us
I20260709 13:02:14.067517  5650 raft_consensus.cc:2804] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:14.065339  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:14.065327  5635 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:14.083683  5662 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:14.100060  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:14.100601  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:14.124383  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.109186  1658 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:14.078681  5555 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:14.152583  5750 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.153695  5750 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:14.107951  5761 consensus_queue.cc:1048] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:02:14.141144  1658 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:14.067461  5719 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:14.081991  5749 consensus_queue.cc:1048] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:02:14.079509  5723 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:14.140350  5760 tablet_replica.cc:333] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
W20260709 13:02:14.185384  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 92806.1us
W20260709 13:02:14.149612  5692 consensus_meta.cc:287] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.517s	user 0.013s	sys 0.000s
I20260709 13:02:14.137025  5650 raft_consensus.cc:697] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:14.134421  5617 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:14.149920  5737 raft_consensus.cc:993] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
W20260709 13:02:14.173681  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 157962us
I20260709 13:02:14.098001  5380 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:14.108860  5627 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:14.193352  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 150638us
I20260709 13:02:14.143807  5555 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.066515  2537 rpcz_store.cc:276] 0709 13:02:12.273269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.275031 (+  1762us) service_pool.cc:224] Handling call
0709 13:02:12.300895 (+ 25864us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:13.310612 (+1009717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.992953 (+682341us) spinlock_profiling.cc:243] Waited 871 ms on lock 0x7b5400344ed4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:13.993189 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2002518784}
I20260709 13:02:14.108726  5266 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:14.223462  1633 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:14.139603  5635 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:14.187191  5202 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:14.143525  5662 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:14.226542  5636 consensus_meta.cc:287] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.570s	user 0.011s	sys 0.003s
W20260709 13:02:14.249312  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.250372  1658 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:14.139528  5691 consensus_queue.cc:237] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:14.260093  5358 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:14.233090  5617 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:14.238541  5555 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:14.261758  5652 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:14.262006  5380 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:14.262704  5637 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:14.263496  5266 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:14.263952  5719 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:14.224056  5723 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:14.546607  5592 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:14.264642  5202 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:14.267238  5635 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:14.192451  5648 consensus_queue.cc:237] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:14.267804  1735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35672 (request call id 425) took 1844 ms. Trace:
I20260709 13:02:14.528709  1630 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:14.343294  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:14.469592  1707 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.924s (SENT) [suppressed 24 similar messages]
I20260709 13:02:14.295665  5692 consensus_queue.cc:1059] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.306s
I20260709 13:02:14.482165  1586 raft_consensus.cc:1275] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:02:14.345402  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:14.533067  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 309634us
I20260709 13:02:14.343214  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:14.534158  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 304216us
W20260709 13:02:14.478354  1587 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 2086) took 1667 ms (client timeout 1993 ms). Trace:
W20260709 13:02:14.307727  5751 log.cc:927] Time spent T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:02:14.566520  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:14.349406  5650 consensus_queue.cc:237] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:14.568769  1658 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:14.495337  5584 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.011s	sys 0.010s
I20260709 13:02:14.259042  5515 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:14.467501  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:14.428920  5700 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:14.363178  5662 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:14.623320  5763 log.cc:927] Time spent T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:02:14.364184  5475 raft_consensus.cc:1081] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:02:14.363471  5627 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:14.350332  5713 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:14.354549  5681 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:14.294293  5750 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:14.409344  5753 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:14.351943  5769 raft_consensus.cc:2749] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:14.406348  5722 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:14.361639  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:14.349915  5765 consensus_queue.cc:1048] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.253s
I20260709 13:02:14.542757  5718 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:14.451725  5699 raft_consensus.cc:3055] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:14.541538  5638 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:14.265137  5697 raft_consensus.cc:3055] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:14.729866  5697 raft_consensus.cc:740] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:14.364530  5701 consensus_queue.cc:1048] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.232s
W20260709 13:02:14.532006  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 300425us
I20260709 13:02:14.295892  5636 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:14.465222  5646 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:14.615842  2426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:14.641687  1587 rpcz_store.cc:269] 0709 13:02:12.811036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.813271 (+  2235us) service_pool.cc:224] Handling call
0709 13:02:14.478013 (+1664742us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54003cf354. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:14.478256 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2608837376}
I20260709 13:02:14.642627  1558 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:14.642093  1633 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:14.594085  5790 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:14.643043  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 114472us
I20260709 13:02:14.735564  5790 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:14.736157  5723 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:14.635766  1586 pending_rounds.cc:85] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91: Aborting all ops after (but not including) 4
I20260709 13:02:14.736824  1586 pending_rounds.cc:107] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:02:14.645320  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:14.635775  1735 rpcz_store.cc:276] 0709 13:02:12.423195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.423715 (+   520us) service_pool.cc:224] Handling call
0709 13:02:12.446623 (+ 22908us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:13.702728 (+1256105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.267534 (+564806us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54002247d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:14.267728 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2885968640}
W20260709 13:02:14.738595  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 96589.3us
I20260709 13:02:14.737172  2553 raft_consensus.cc:1813] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Handling vote request from an unknown peer 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:14.740412  2553 raft_consensus.cc:2410] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:02:14.737185  1586 raft_consensus.cc:2889] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:14.647284  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.655665  1664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58814 (request call id 538) took 1732 ms. Trace:
I20260709 13:02:14.656384  1736 raft_consensus.cc:1275] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:14.475486  5698 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:14.606179  5652 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:14.644232  5584 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.015s	sys 0.020s
I20260709 13:02:14.744402  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:14.744453  5698 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:14.745720  5773 consensus_queue.cc:1059] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:14.746829  1737 raft_consensus.cc:2393] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 in current term 11: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:14.643241  5719 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.623312  5266 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:14.749547  5714 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:14.744717  5652 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:14.749439  5266 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:14.675663  1659 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.011s	sys 0.010s
I20260709 13:02:14.644981  5781 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:14.751754  5652 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:14.624058  5592 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:14.752252  5781 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:14.754171  5592 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:14.754570  5646 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:14.754798  5791 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.682942  5713 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:14.755564  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:14.756204  2515 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:14.757140  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:14.757498  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:14.754588  5781 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:14.678478  5784 raft_consensus.cc:2749] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:14.653599  5515 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:14.712934  2548 raft_consensus.cc:1813] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Handling vote request from an unknown peer 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:14.759923  2548 raft_consensus.cc:2410] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:02:14.727339  5202 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:14.729548  5638 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:14.290127  5610 consensus_queue.cc:1059] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.336s
I20260709 13:02:14.742993  1664 rpcz_store.cc:276] 0709 13:02:12.923260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.924375 (+  1115us) service_pool.cc:224] Handling call
0709 13:02:13.147282 (+222907us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:13.178329 (+ 31047us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.655469 (+1477140us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b540044d250. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8e8ad 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:14.655606 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":423589632}
I20260709 13:02:14.761133  2552 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
W20260709 13:02:14.668428  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 302709us
I20260709 13:02:14.763383  5549 raft_consensus.cc:3055] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:14.763437  5696 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.763978  5549 raft_consensus.cc:740] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:14.764972  1741 raft_consensus.cc:2393] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 11: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
W20260709 13:02:14.765575  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.658811  2540 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:14.766206  5636 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:14.767524  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:14.755328  5791 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:14.718477  1667 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
W20260709 13:02:14.768821  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.744509  1633 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:02:14.763126  1659 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.012s	sys 0.010s
W20260709 13:02:14.681070  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 211498us
I20260709 13:02:14.731148  5699 raft_consensus.cc:740] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:14.777530  1630 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:14.686167  5753 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:14.797596  5789 log.cc:927] Time spent T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:02:14.741509  5722 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:14.804282  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:14.764307  5696 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:14.769385  5723 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:14.806474  1583 raft_consensus.cc:1813] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Handling vote request from an unknown peer 5bb87fe07da2414e84ee578c3b176ede
W20260709 13:02:14.806375  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 61955.6us
I20260709 13:02:14.776677  5475 consensus_queue.cc:1048] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:02:14.806296  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:02:14.785352  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.821514  1661 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:14.749392  5719 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:14.817481  1583 raft_consensus.cc:2410] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:02:14.817818  1633 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:14.806447  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 163886us
I20260709 13:02:14.823925  5791 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:14.830945  1633 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:14.824770  5790 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:14.809689  5573 raft_consensus.cc:2749] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:14.816236  5793 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:14.826172  5699 consensus_queue.cc:260] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:14.764914  5549 consensus_queue.cc:260] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:14.811466  5586 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:14.841809  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:14.835664  1633 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:14.835753  1663 raft_consensus.cc:1275] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:14.846489  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:14.847239  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:02:14.836103  1707 connection.cc:256] RPC call timeout handler was delayed by -1.0444649550000236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22160000000000002s for a response
I20260709 13:02:14.811107  5761 raft_consensus.cc:3055] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:14.855484  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:14.856309  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:14.852489  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.858282  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:14.858520  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:14.861155  1661 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:02:14.837533  5718 raft_consensus.cc:2749] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:14.857208  1663 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 7.
I20260709 13:02:14.865227  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:14.847846  5784 raft_consensus.cc:2804] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:14.867710  1735 raft_consensus.cc:2410] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:14.873162  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:14.873760  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:14.854471  5636 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.858704  5699 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:14.870256  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:14.829803  5723 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:14.867157  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:14.860050  5202 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.859908  5549 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:14.859616  5586 raft_consensus.cc:697] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:14.860194  5617 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:14.854282  5761 raft_consensus.cc:740] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:14.864187  5700 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.866811  5780 consensus_queue.cc:1059] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:02:14.865483  5573 raft_consensus.cc:2749] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:14.851297  5701 consensus_queue.cc:1048] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:02:14.863631  5738 consensus_queue.cc:1048] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:02:14.930560  1585 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 14.
I20260709 13:02:14.893569  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:14.886813  1658 raft_consensus.cc:1275] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:14.946414  1587 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:02:14.912462  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:14.870833  5784 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.226377  1667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39146 (request call id 3290) took 1240 ms. Trace:
I20260709 13:02:15.238248  1667 rpcz_store.cc:276] 0709 13:02:13.985941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.986278 (+   337us) service_pool.cc:224] Handling call
0709 13:02:15.226190 (+1239912us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b54002e6dd4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:15.226316 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1531339520}
I20260709 13:02:15.240024  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:15.242050  1667 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39146
I20260709 13:02:15.242852  1667 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:15.243304  1667 raft_consensus.cc:3060] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:14.875272  5627 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.252485  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:14.875191  5592 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:15.253661  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:15.254060  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:15.254544  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:15.254977  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:14.926285  5794 log.cc:927] Time spent T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:02:15.263427  1633 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:14.881053  5765 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.216377  5475 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:15.273030  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.133141  5722 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:15.225940  5662 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:14.910173  5638 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:15.225179  5696 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:15.054612  5718 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:14.909305  2540 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:15.245868  5617 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:15.226630  5781 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:15.240149  5784 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:14.884994  5636 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:15.283890  1667 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:15.270179  5627 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:15.263720  5646 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:14.958029  5555 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:14.895112  5202 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:15.281255  5573 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:15.336423  1667 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:14.957629  5692 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:15.295229  5800 log.cc:927] Time spent T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:02:15.309856  2550 raft_consensus.cc:1240] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:02:15.271416  5592 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:15.231491  5700 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:15.324623  5617 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:15.315351  5662 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:15.279042  5765 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:15.306484  5719 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:15.281266  5475 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:15.329325  2540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49238 (request call id 467) took 1036 ms. Trace:
I20260709 13:02:15.346525  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:15.332202  5797 log.cc:927] Time spent T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.449s	user 0.001s	sys 0.001s
I20260709 13:02:15.315014  5722 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:15.392498  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:15.396364  1667 raft_consensus.cc:2468] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
W20260709 13:02:15.397040  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 116561us
I20260709 13:02:15.366926  5723 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:15.332795  5781 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:15.403340  1633 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:15.403563  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:15.310365  5586 consensus_queue.cc:237] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:15.403002  1734 raft_consensus.cc:2393] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 17: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:15.400595  1735 raft_consensus.cc:2410] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:02:15.401707  1707 leader_election.cc:336] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.524s (SENT)
I20260709 13:02:15.308211  5761 consensus_queue.cc:260] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:15.330226  5718 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:15.342813  5646 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:15.408541  1707 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:15.409291  2553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49218 (request call id 229) took 1080 ms. Trace:
I20260709 13:02:15.410104  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:15.414989  2550 raft_consensus.cc:3060] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:15.411438  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:15.414191  2553 rpcz_store.cc:276] 0709 13:02:14.329293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.329502 (+   209us) service_pool.cc:224] Handling call
0709 13:02:15.404804 (+1075302us) spinlock_profiling.cc:243] Waited 94.6 ms on lock 0x7b54001bbf54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:15.409226 (+  4422us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217474816}
I20260709 13:02:15.379616  5651 consensus_queue.cc:1059] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:02:15.421116  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:15.421146  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:02:15.424623  1707 leader_election.cc:336] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.544s (SENT)
I20260709 13:02:15.425299  1707 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:15.425899  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:15.426337  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:15.397148  5692 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:15.428104  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:15.428673  1667 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:15.429394  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:15.430689  1667 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:15.431617  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:15.431799  1633 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:15.432281  5700 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:15.433233  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:15.432749  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:02:15.434029  1707 leader_election.cc:336] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.668s (SENT)
I20260709 13:02:15.438126  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:15.435124  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:15.443121  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:15.443876  1592 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:15.435395  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:15.446727  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:15.447012  2550 raft_consensus.cc:2468] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 7.
I20260709 13:02:15.449888  1739 raft_consensus.cc:1813] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Handling vote request from an unknown peer 5bb87fe07da2414e84ee578c3b176ede
W20260709 13:02:15.451838  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.452047  1739 raft_consensus.cc:2410] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:02:15.453461  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:15.453649  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:15.454699  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:15.457520  1667 raft_consensus.cc:2393] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 8: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:15.429544  5380 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:15.395476  2540 rpcz_store.cc:276] 0709 13:02:14.293188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.294888 (+  1700us) service_pool.cc:224] Handling call
0709 13:02:14.467242 (+172354us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b58001c3b98. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7de6ab71 00007f1b7de6aa22 00007f1b86d83c09 00007f1b85eddee0 00007f1b85fa70ab 00007f1b85fa7131 00007f1b85f550a0 00007f1b85f54984 00007f1b7f4cf6d4 00007f1b7f4cf662
0709 13:02:15.325830 (+858588us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46838528}
I20260709 13:02:15.468726  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:15.458853  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:15.471626  1661 raft_consensus.cc:1240] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:15.472585  1661 raft_consensus.cc:1240] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:15.433385  5809 raft_consensus.cc:2749] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:15.475958  1734 raft_consensus.cc:2393] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 14: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
W20260709 13:02:15.476502  5681 consensus_meta.cc:287] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.794s	user 0.007s	sys 0.003s
I20260709 13:02:15.478247  5475 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:15.457190  5638 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:15.485060  5638 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:15.457161  5810 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:15.487408  5638 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:15.487600  5699 consensus_meta.cc:287] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.599s	user 0.010s	sys 0.002s
I20260709 13:02:15.482125  5781 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:15.488724  5781 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:15.478528  5812 consensus_queue.cc:1048] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:02:15.489727  5805 log.cc:927] Time spent T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
W20260709 13:02:15.482215  5698 consensus_meta.cc:287] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.737s	user 0.002s	sys 0.010s
I20260709 13:02:15.492861  5698 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:15.493822  5617 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:15.494117  5765 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:15.484299  2515 consensus_meta.cc:287] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6: Time spent flushing consensus metadata: real 0.728s	user 0.009s	sys 0.003s
I20260709 13:02:15.495327  2515 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
I20260709 13:02:15.496191  5698 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:15.481052  5646 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:15.463905  5806 log.cc:927] Time spent T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.103s	user 0.002s	sys 0.000s
I20260709 13:02:15.515544  1584 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:02:15.481686  5627 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:15.483474  5592 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:15.483616  5714 consensus_meta.cc:287] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.733s	user 0.012s	sys 0.002s
I20260709 13:02:15.498883  1588 raft_consensus.cc:2410] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:02:15.459151  1592 raft_consensus.cc:2393] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 8: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:15.462677  5722 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:15.516716  1556 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:02:15.526669  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.529183  1590 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 12.
W20260709 13:02:15.532884  5807 log.cc:927] Time spent T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 13:02:15.522425  5811 consensus_queue.cc:1048] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:02:15.482496  5662 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:15.484445  5636 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:15.522370  5549 consensus_meta.cc:287] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.627s	user 0.007s	sys 0.006s
I20260709 13:02:15.526790  5698 consensus_queue.cc:1048] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:02:15.524027  5793 consensus_meta.cc:287] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.670s	user 0.009s	sys 0.004s
I20260709 13:02:15.544643  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:15.522243  5700 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:15.551153  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 119431us
I20260709 13:02:15.538870  5475 raft_consensus.cc:2804] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:15.560456  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:15.562956  1633 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:15.564656  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:15.582643  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:15.583551  1587 raft_consensus.cc:2376] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 14. Re-sending same reply.
W20260709 13:02:15.588354  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.559722  5793 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:15.561877  5700 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:15.573868  5723 raft_consensus.cc:2804] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:16.373633  5723 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:16.374699  2424 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:15.873983  1592 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:02:15.589247  5817 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:16.121052  1661 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.007s	sys 0.006s
W20260709 13:02:16.383698  1661 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.010s	sys 0.009s
I20260709 13:02:15.565487  5475 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:16.308218  5820 log.cc:927] Time spent T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
W20260709 13:02:15.867749  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:15.644465  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.006016  5699 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:16.379999  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 817076us
I20260709 13:02:16.006078  5814 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:16.401257  1633 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:16.400722  5699 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:16.401489  5814 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:16.404326  5699 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:15.611797  5784 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:16.383390  5817 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:15.875862  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:16.414875  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:15.755431  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.405015  5814 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:16.189643  5801 log.cc:927] Time spent T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.984s	user 0.005s	sys 0.000s
I20260709 13:02:15.950771  5812 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:16.348501  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2691) took 1498 ms. Trace:
I20260709 13:02:16.064982  5813 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:16.085695  5718 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:16.385658  5475 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:16.419840  5812 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:16.374452  5723 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:16.412400  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:15.873662  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 135983us
I20260709 13:02:16.415009  5821 raft_consensus.cc:2804] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:16.424499  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:16.430593  1592 raft_consensus.cc:2376] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9. Re-sending same reply.
I20260709 13:02:16.432934  5821 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.442524  5821 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:16.435724  5810 consensus_meta.cc:287] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.949s	user 0.014s	sys 0.000s
I20260709 13:02:16.448195  5760 raft_consensus.cc:2243] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:16.434420  5812 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:16.426203  5814 raft_consensus.cc:2749] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:16.424103  5813 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:16.457903  5784 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:16.452502  5810 raft_consensus.cc:2749] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:16.480472  5813 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:16.492095  5817 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:16.417649  1558 rpcz_store.cc:276] 0709 13:02:14.849710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.348424 (+1498714us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:02:16.543870  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:16.544940  1558 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:59112 dropped due to backpressure: service queue is full with 50 items
I20260709 13:02:16.545897  1592 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:02:16.552356  1661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 2598) took 1297 ms. Trace:
I20260709 13:02:16.553709  1665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3300) took 1752 ms. Trace:
I20260709 13:02:16.557634  1667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3310) took 1747 ms. Trace:
I20260709 13:02:16.558163  1667 rpcz_store.cc:276] 0709 13:02:14.810411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.471091 (+660680us) service_pool.cc:224] Handling call
0709 13:02:15.471487 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:15.517632 (+ 46145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:15.517660 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:15.528677 (+ 11017us) log.cc:844] Serialized 26 byte log entry
0709 13:02:15.950187 (+421510us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:15.950250 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:15.950354 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:16.556852 (+606498us) raft_consensus.cc:1685] finished
0709 13:02:16.556998 (+   146us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:16.557414 (+   416us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1319,"spinlock_wait_cycles":8903040,"thread_start_us":382787,"threads_started":1,"wal-append.queue_time_us":919709}
I20260709 13:02:16.563531  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:16.553763  1662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3311) took 1005 ms. Trace:
W20260709 13:02:16.575498  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.578174  5710 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
W20260709 13:02:16.579203  1583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 2103) took 2754 ms (client timeout 1958 ms). Trace:
I20260709 13:02:16.582504  1586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2108) took 2755 ms. Trace:
I20260709 13:02:16.552981  1661 rpcz_store.cc:276] 0709 13:02:15.254830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.473025 (+218195us) service_pool.cc:224] Handling call
0709 13:02:15.498939 (+ 25914us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:15.517450 (+ 18511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:15.517483 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:15.518246 (+   763us) log.cc:844] Serialized 26 byte log entry
0709 13:02:16.384742 (+866496us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:16.384794 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.384877 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:16.551683 (+166806us) raft_consensus.cc:1685] finished
0709 13:02:16.551730 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:16.552079 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28823,"raft.queue_time_us":18518,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":4579,"thread_start_us":833560,"threads_started":1,"wal-append.queue_time_us":918666}
I20260709 13:02:16.591709  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:16.594532  1740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35672 (request call id 433) took 2026 ms. Trace:
W20260709 13:02:16.596747  1741 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43686 (request call id 2231) took 2538 ms (client timeout 2489 ms). Trace:
I20260709 13:02:16.598959  1739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43686 (request call id 2236) took 1729 ms. Trace:
W20260709 13:02:16.600677  2552 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49238 (request call id 468) took 2269 ms (client timeout 1673 ms). Trace:
I20260709 13:02:16.545420  1558 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:59112 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2722)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 2120)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2715)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2721)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 2122)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2726)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2720)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 2118)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2707)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2719)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2723)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2713)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 2114)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2716)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 2121)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2733)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2727)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2738)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2739)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2737)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2734)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2735)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2736)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2728)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 2117)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2729)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2730)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2731)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2724)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 2116)
Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:47714 (request call id 46)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2687)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2689)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2695)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2697)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2698)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2699)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2701)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2704)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2706)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2708)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2709)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2115)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2119)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2123)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2124)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2732)
I20260709 13:02:16.471617  5760 raft_consensus.cc:2272] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:16.554327  1665 rpcz_store.cc:276] 0709 13:02:14.800905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.801555 (+   650us) service_pool.cc:224] Handling call
0709 13:02:14.801893 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:14.809944 (+  8051us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:14.809974 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:14.814193 (+  4219us) log.cc:844] Serialized 26 byte log entry
0709 13:02:14.852978 (+ 38785us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:14.853035 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.853143 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:16.188795 (+1335652us) spinlock_profiling.cc:243] Waited 8.02 ms on lock 0x7b4400022b4c. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7ddc8c85 00007f1b7ddc96a2 00007f1b80b3b1db 00007f1b80b36aaf 00007f1b80b2a86e 00007f1b80b29bb6 00007f1b80b297d8 00007f1b80b33221 00007f1b80b331d9 00007f1b80b33169
0709 13:02:16.444691 (+255896us) raft_consensus.cc:1685] finished
0709 13:02:16.444844 (+   153us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:16.553384 (+108540us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7631,"raft.queue_time_us":9021,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":7120,"spinlock_wait_cycles":18444160,"thread_start_us":26987,"threads_started":1,"wal-append.queue_time_us":69911}
I20260709 13:02:16.620934  1739 rpcz_store.cc:276] 0709 13:02:14.869277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.430299 (+561022us) service_pool.cc:224] Handling call
0709 13:02:16.598390 (+1168091us) spinlock_profiling.cc:243] Waited 3.73 ms on lock 0x7b5400143f54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:16.598688 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8579328}
W20260709 13:02:16.618125  1583 rpcz_store.cc:269] 0709 13:02:13.824966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.828217 (+  3251us) service_pool.cc:224] Handling call
0709 13:02:16.578529 (+2750312us) spinlock_profiling.cc:243] Waited 977 ms on lock 0x7b5400437bd4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:16.578883 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2247800192}
I20260709 13:02:16.618445  1586 rpcz_store.cc:276] 0709 13:02:13.827236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.953880 (+126644us) service_pool.cc:224] Handling call
0709 13:02:14.481541 (+527661us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:14.741674 (+260133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.581753 (+1840079us) spinlock_profiling.cc:243] Waited 523 ms on lock 0x7b54003cf350. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8e8ad 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:16.582128 (+   375us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1202682624}
I20260709 13:02:16.620250  1740 rpcz_store.cc:276] 0709 13:02:14.570033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.570765 (+   732us) service_pool.cc:224] Handling call
0709 13:02:14.613344 (+ 42579us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:14.821527 (+208183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:14.821566 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:14.821604 (+    38us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:14.821633 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.593767 (+1772134us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b54001f7054. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:16.593872 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:16.594183 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":478210304}
W20260709 13:02:16.621340  2552 rpcz_store.cc:269] 0709 13:02:14.331449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.331712 (+   263us) service_pool.cc:224] Handling call
0709 13:02:14.756963 (+425251us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b58001c3b98. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7de6ab71 00007f1b7de6aa22 00007f1b86d83c09 00007f1b85eddee0 00007f1b85fa70ab 00007f1b85fa7131 00007f1b85f550a0 00007f1b85f54984 00007f1b7f4cf6d4 00007f1b7f4cf662
0709 13:02:16.600185 (+1843222us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b540051c554. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:16.600429 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10194048}
W20260709 13:02:16.620384  1741 rpcz_store.cc:269] 0709 13:02:14.058212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.058346 (+   134us) service_pool.cc:224] Handling call
0709 13:02:16.595913 (+2537567us) spinlock_profiling.cc:243] Waited 696 ms on lock 0x7b54001586d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:16.596331 (+   418us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1601116544}
I20260709 13:02:16.616709  5266 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:16.493950  5832 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.635087  1663 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:02:16.637156  1667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58814 (request call id 556) took 1069 ms. Trace:
I20260709 13:02:16.639499  1667 rpcz_store.cc:276] 0709 13:02:15.563542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.562721 (+999179us) service_pool.cc:224] Handling call
0709 13:02:16.632731 (+ 70010us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:16.640195  5710 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:16.640705  5266 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.642844  5738 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.643275  5817 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.643502  5266 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:16.643751  5738 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:16.644273  5817 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:16.645555  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:16.646651  1586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 2120) took 1089 ms. Trace:
I20260709 13:02:16.647010  1586 rpcz_store.cc:276] 0709 13:02:15.557631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.637525 (+1079894us) service_pool.cc:224] Handling call
0709 13:02:16.646565 (+  9040us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:16.647369  5817 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:16.648208  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:16.649546  5706 raft_consensus.cc:3055] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:16.649964  5706 raft_consensus.cc:740] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:16.651510  5706 consensus_queue.cc:260] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:16.641018  1663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39146 (request call id 3315) took 1089 ms. Trace:
I20260709 13:02:16.653767  5635 raft_consensus.cc:3055] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:16.654328  5635 raft_consensus.cc:740] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:16.654439  5821 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:16.654633  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.653451  1663 rpcz_store.cc:276] 0709 13:02:15.549109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.591077 (+1041968us) service_pool.cc:224] Handling call
0709 13:02:16.638514 (+ 47437us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:16.649029  1586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2715) took 1154 ms. Trace:
I20260709 13:02:16.659770  1586 rpcz_store.cc:276] 0709 13:02:15.494669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.647756 (+1153087us) service_pool.cc:224] Handling call
0709 13:02:16.648956 (+  1200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:16.662770  1667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3313) took 1109 ms. Trace:
I20260709 13:02:16.638852  5813 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.665879  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:16.665913  5813 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:16.617065  1662 rpcz_store.cc:276] 0709 13:02:15.547798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.549778 (+  1980us) service_pool.cc:224] Handling call
0709 13:02:15.550487 (+   709us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:15.554932 (+  4445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:15.554961 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:15.555441 (+   480us) log.cc:844] Serialized 52 byte log entry
0709 13:02:15.575200 (+ 19759us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:15.575258 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:15.575373 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:16.553093 (+977720us) raft_consensus.cc:1685] finished
0709 13:02:16.553135 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:16.553555 (+   420us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4016,"raft.queue_time_us":5519,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":108,"thread_start_us":19351,"threads_started":1,"wal-append.queue_time_us":896820}
I20260709 13:02:16.671222  1662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58814 (request call id 557) took 1107 ms. Trace:
I20260709 13:02:16.671695  5700 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:16.673928  5832 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:16.671943  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.664031  1667 rpcz_store.cc:276] 0709 13:02:15.548593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.648601 (+1100008us) service_pool.cc:224] Handling call
0709 13:02:16.651004 (+  2403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:16.654240 (+  3236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:16.654497 (+   257us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:16.655053 (+   556us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:16.655608 (+   555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.656407 (+   799us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:16.657545 (+  1138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:16.649052  5738 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:16.695528  5706 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:16.696027  5828 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:16.696547  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:16.697276  5817 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.696928  5828 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:16.697605  1587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 2122) took 1136 ms. Trace:
I20260709 13:02:16.698050  1587 rpcz_store.cc:276] 0709 13:02:15.560970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.695983 (+1135013us) service_pool.cc:224] Handling call
0709 13:02:16.697547 (+  1564us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:16.694028  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.702500  1732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35672 (request call id 436) took 2073 ms. Trace:
I20260709 13:02:16.699304  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:16.671638  1662 rpcz_store.cc:276] 0709 13:02:15.563884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.669914 (+1106030us) service_pool.cc:224] Handling call
0709 13:02:16.670470 (+   556us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:16.670793 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:16.670827 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:16.670898 (+    71us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:16.670966 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.671019 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:16.671132 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:16.655644  5635 consensus_queue.cc:260] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:16.698053  5817 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:16.702945  1732 rpcz_store.cc:276] 0709 13:02:14.628423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.628619 (+   196us) service_pool.cc:224] Handling call
0709 13:02:14.629051 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:14.665705 (+ 36654us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:02:14.775529 (+109824us) log.cc:844] Serialized 14 byte log entry
0709 13:02:14.810791 (+ 35262us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:14.810871 (+    80us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:14.810931 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.700028 (+1889097us) spinlock_profiling.cc:243] Waited 36.3 ms on lock 0x7b54001f6b54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:16.700123 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:16.701351 (+  1228us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":209721,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":55,"raft.queue_time_us":109,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":4758,"spinlock_wait_cycles":83456768,"thread_start_us":131274,"threads_started":2,"wal-append.queue_time_us":87232,"wal-append.run_cpu_time_us":1583,"wal-append.run_wall_time_us":1085215}
I20260709 13:02:16.708977  1663 raft_consensus.cc:1275] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:16.709280  5475 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:16.677019  5832 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:16.710599  1665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3312) took 1162 ms. Trace:
I20260709 13:02:16.708841  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:16.711076  1665 rpcz_store.cc:276] 0709 13:02:15.548322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.636367 (+1088045us) service_pool.cc:224] Handling call
0709 13:02:16.709737 (+ 73370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:16.710151 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:16.710181 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:16.710258 (+    77us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:16.710298 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.710371 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:16.710503 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:16.701650  5710 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:16.672494  5813 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:16.714736  5821 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 8 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:16.710022  1663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3314) took 1161 ms. Trace:
I20260709 13:02:16.716192  1663 rpcz_store.cc:276] 0709 13:02:15.548842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.663674 (+1114832us) service_pool.cc:224] Handling call
0709 13:02:16.708367 (+ 44693us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:16.709634 (+  1267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.709921 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:16.711814  1583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2720) took 1215 ms. Trace:
I20260709 13:02:16.717857  1583 rpcz_store.cc:276] 0709 13:02:15.496732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.708381 (+1211649us) service_pool.cc:224] Handling call
0709 13:02:16.711744 (+  3363us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:16.720854  5723 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:16.700047  5828 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:16.728642  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:16.729204  1587 raft_consensus.cc:2393] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 10: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:16.729837  1583 raft_consensus.cc:2393] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 14: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:16.728746  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:16.717707  5475 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:16.729983  1667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58814 (request call id 558) took 1165 ms. Trace:
I20260709 13:02:16.736158  1667 rpcz_store.cc:276] 0709 13:02:15.564179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.691954 (+1127775us) service_pool.cc:224] Handling call
0709 13:02:16.728876 (+ 36922us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:16.729515 (+   639us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:16.729560 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:16.729648 (+    88us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:16.729695 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.729772 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:16.729923 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:16.737452  1583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 2118) took 1178 ms. Trace:
I20260709 13:02:16.738183  1583 rpcz_store.cc:276] 0709 13:02:15.556989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.725044 (+1168055us) service_pool.cc:224] Handling call
0709 13:02:16.734786 (+  9742us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:16.733788  5832 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.740067  5817 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:16.740265  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:16.740141  5832 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:16.741323  1662 raft_consensus.cc:2468] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 8.
I20260709 13:02:16.744028  1662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58814 (request call id 560) took 1179 ms. Trace:
I20260709 13:02:16.744046  5832 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:16.748951  5475 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.749912  5475 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:16.750638  5760 ts_tablet_manager.cc:1916] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:16.751832  5785 raft_consensus.cc:3055] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:16.752345  5785 raft_consensus.cc:740] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:16.754824  5785 consensus_queue.cc:260] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:16.758308  5785 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:16.759807  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2695) took 1521 ms. Trace:
I20260709 13:02:16.760320  1558 rpcz_store.cc:276] 0709 13:02:15.238970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.759713 (+1520743us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:02:16.761559  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:16.767449  5692 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:16.769922  5832 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.771075  5832 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:16.772234  1586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2721) took 1240 ms. Trace:
W20260709 13:02:16.774521  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 373402us
I20260709 13:02:16.776036  1633 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:16.772686  1586 rpcz_store.cc:276] 0709 13:02:15.504410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.692509 (+1188099us) service_pool.cc:224] Handling call
0709 13:02:16.737280 (+ 44771us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:16.770900  5697 consensus_queue.cc:260] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:16.778025  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:16.778363  5697 raft_consensus.cc:3060] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:16.778901  1586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2723) took 1233 ms. Trace:
I20260709 13:02:16.779243  1586 rpcz_store.cc:276] 0709 13:02:15.545601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.777610 (+1232009us) service_pool.cc:224] Handling call
0709 13:02:16.778840 (+  1230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:16.780282  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:16.781213  1556 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:16.781546  5692 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.782841  1667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58814 (request call id 559) took 1218 ms. Trace:
I20260709 13:02:16.783222  5692 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:16.783428  1667 rpcz_store.cc:276] 0709 13:02:15.564490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.738596 (+1174106us) service_pool.cc:224] Handling call
0709 13:02:16.781962 (+ 43366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:16.782470 (+   508us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:16.782504 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:16.782570 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:16.782632 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.782683 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:16.782787 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:16.782502  5687 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:16.785315  5687 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.785964  5687 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:16.785897  5817 raft_consensus.cc:2749] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:16.788338  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.744561  1662 rpcz_store.cc:276] 0709 13:02:15.564795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.742526 (+1177731us) service_pool.cc:224] Handling call
0709 13:02:16.743183 (+   657us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:16.743586 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:16.743619 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:16.743695 (+    76us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:16.743743 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.743814 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:16.743954 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:16.784806  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:16.794674  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:02:16.761876  5804 log.cc:927] Time spent T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 1.553s	user 0.006s	sys 0.013s
I20260709 13:02:16.791728  1586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2713) took 1297 ms. Trace:
I20260709 13:02:16.807324  1586 rpcz_store.cc:276] 0709 13:02:15.494068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.779925 (+1285857us) service_pool.cc:224] Handling call
0709 13:02:16.781070 (+  1145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:16.760923  1558 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:59112 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 2114)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2716)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 2121)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2733)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2727)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2738)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2739)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2737)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2734)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2735)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2736)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2752)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2728)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 2117)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2753)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2729)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2750)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2741)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2748)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2740)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2730)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2731)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2742)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2747)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2751)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2743)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2749)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2744)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2745)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2746)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2724)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 2116)
Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:47714 (request call id 46)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2687)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2689)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2697)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2698)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2699)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2701)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2704)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2706)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2708)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2709)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2115)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2119)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2123)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2124)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2732)
I20260709 13:02:16.817466  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:16.796792  5713 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:16.811322  5723 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:16.807202  5832 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:16.816062  5266 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:16.827430  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.835824  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:16.836741  1664 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:16.838843  5202 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:16.849442  1583 raft_consensus.cc:2393] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 8: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:16.850085  1583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2719) took 1353 ms. Trace:
W20260709 13:02:16.849292  1734 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43686 (request call id 2238) took 1976 ms (client timeout 1794 ms). Trace:
I20260709 13:02:16.850768  1630 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:02:16.850950  1734 rpcz_store.cc:269] 0709 13:02:14.872899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.419569 (+546670us) service_pool.cc:224] Handling call
0709 13:02:16.848819 (+1429250us) spinlock_profiling.cc:243] Waited 41.4 ms on lock 0x7b5400277254. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:16.849073 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95233280}
I20260709 13:02:16.851981  1630 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:16.852300  5769 raft_consensus.cc:2804] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:16.852985  5769 raft_consensus.cc:697] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 7 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:16.853271  5813 raft_consensus.cc:2804] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:16.853957  2537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 226) took 2585 ms. Trace:
I20260709 13:02:16.854043  5813 raft_consensus.cc:697] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:16.854592  5769 consensus_queue.cc:237] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:16.855212  5813 consensus_queue.cc:237] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:16.856850  1584 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2685) took 2013 ms (client timeout 1933 ms). Trace:
I20260709 13:02:16.857318  5475 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:16.850495  1583 rpcz_store.cc:276] 0709 13:02:15.496452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.785174 (+1288722us) service_pool.cc:224] Handling call
0709 13:02:16.850009 (+ 64835us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:16.825592  5738 consensus_queue.cc:1048] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:02:16.828675  1667 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:02:16.850808  1660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58814 (request call id 550) took 2081 ms. Trace:
I20260709 13:02:16.863206  1587 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 17.
W20260709 13:02:16.865541  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:16.867344  1707 leader_election.cc:336] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.924s (SENT)
I20260709 13:02:16.867653  2424 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:16.867959  1707 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:16.868005  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:16.868580  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 43936.3us
I20260709 13:02:16.869191  2540 raft_consensus.cc:2393] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 8: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:02:16.869619  5685 raft_consensus.cc:2804] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:16.870294  5685 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:16.870689  5685 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:16.870859  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:16.871469  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:16.872264  5713 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.872284  2540 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 8.
I20260709 13:02:16.872956  5713 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:16.875571  5713 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:16.877279  5692 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:16.877952  5692 raft_consensus.cc:2749] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:16.861766  1558 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:59112 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2716)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 2121)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2733)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2727)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2738)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2739)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2737)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2734)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2735)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2736)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2752)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2728)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 2117)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2753)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2729)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2750)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2741)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2748)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2754)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2740)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2730)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2755)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2757)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2731)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2742)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2747)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2751)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2743)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2749)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2744)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2745)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2746)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2724)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 2116)
Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:47714 (request call id 46)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2687)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2689)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2697)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2698)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2699)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2701)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2704)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2706)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2708)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2709)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2115)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2119)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2123)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2124)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2732)
W20260709 13:02:16.857259  1584 rpcz_store.cc:269] 0709 13:02:14.842967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.859665 (+ 16698us) service_pool.cc:224] Handling call
0709 13:02:16.856491 (+1996826us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b54004376d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:16.856639 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1384914304}
I20260709 13:02:16.884893  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:16.885413  1664 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:02:16.885973  1662 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:02:16.888505  1556 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:16.872632  5687 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:16.863667  1660 rpcz_store.cc:276] 0709 13:02:14.769596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.773385 (+  3789us) service_pool.cc:224] Handling call
0709 13:02:14.773917 (+   532us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:14.774232 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:14.774273 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:14.791310 (+ 17037us) log.cc:844] Serialized 26 byte log entry
0709 13:02:14.874446 (+ 83136us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:14.874481 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.874547 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:16.760737 (+1886190us) spinlock_profiling.cc:243] Waited 4.95 ms on lock 0x7b4400022b4c. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7ddc8c85 00007f1b7ddc96a2 00007f1b80b3b1db 00007f1b80b36aaf 00007f1b80b2a86e 00007f1b80b29bb6 00007f1b80b297d8 00007f1b80b33221 00007f1b80b331d9 00007f1b80b33169
0709 13:02:16.850277 (+ 89540us) raft_consensus.cc:1685] finished
0709 13:02:16.850299 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:16.850641 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11410816,"thread_start_us":33085,"threads_started":1,"wal-append.queue_time_us":235381}
I20260709 13:02:16.891518  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:16.892853  1660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3317) took 1324 ms. Trace:
I20260709 13:02:16.893430  1660 rpcz_store.cc:276] 0709 13:02:15.568736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.891660 (+1322924us) service_pool.cc:224] Handling call
0709 13:02:16.892001 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:16.892495 (+   494us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:16.892528 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:16.892587 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:16.892618 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.892683 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:16.892795 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:16.892848  5687 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:16.897019  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:16.897622  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:16.898241  1734 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 7.
I20260709 13:02:16.895093  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:16.899405  1738 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 5.
I20260709 13:02:16.854506  2537 rpcz_store.cc:276] 0709 13:02:14.268491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.291666 (+ 23175us) service_pool.cc:224] Handling call
0709 13:02:14.361375 (+ 69709us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:14.623832 (+262457us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:02:14.683387 (+ 59555us) log.cc:844] Serialized 14 byte log entry
0709 13:02:15.050745 (+367358us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:15.057898 (+  7153us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:15.189549 (+131651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.853377 (+1663828us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b54007328d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:16.853446 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:16.853681 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":29196,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":2148,"raft.queue_time_us":5201,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":13687,"spinlock_wait_cycles":558509696,"thread_start_us":227377,"threads_started":2,"wal-append.queue_time_us":164494,"wal-append.run_cpu_time_us":9069,"wal-append.run_wall_time_us":1552050}
I20260709 13:02:16.904925  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:16.908825  1584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2716) took 1413 ms. Trace:
I20260709 13:02:16.909215  1584 rpcz_store.cc:276] 0709 13:02:15.494967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.889663 (+1394696us) service_pool.cc:224] Handling call
0709 13:02:16.908749 (+ 19086us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:16.910292  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:16.910974  1584 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:16.911614  1590 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 2107) took 3084 ms (client timeout 1576 ms). Trace:
I20260709 13:02:16.914095  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:16.917918  1667 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:16.913159  1590 rpcz_store.cc:269] 0709 13:02:13.826985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.827544 (+   559us) service_pool.cc:224] Handling call
0709 13:02:16.909487 (+3081943us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b54003b4cd4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:16.910103 (+   616us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3742712576}
I20260709 13:02:16.927080  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:16.928006  1592 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2722) took 1396 ms (client timeout 1673 ms). Trace:
W20260709 13:02:16.928352  1592 rpcz_store.cc:269] 0709 13:02:15.531738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.926653 (+1394915us) service_pool.cc:224] Handling call
0709 13:02:16.927952 (+  1299us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:16.928834  5691 raft_consensus.cc:2804] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:16.929483  5691 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.930011  5691 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:16.930990  1587 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2707) took 1501 ms (client timeout 1948 ms). Trace:
W20260709 13:02:16.931402  1587 rpcz_store.cc:269] 0709 13:02:15.445786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.761173 (+1315387us) service_pool.cc:224] Handling call
0709 13:02:16.930788 (+169615us) spinlock_profiling.cc:243] Waited 82.6 ms on lock 0x7b54000320d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:16.930908 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":190081280}
I20260709 13:02:16.932565  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:16.932672  1556 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:16.933256  5713 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.934305  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:16.934180  5713 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:16.935885  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:16.937847  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:16.939116  1592 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:16.940419  2540 raft_consensus.cc:1240] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:16.940672  5721 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:16.941421  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:16.941762  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:16.960367  1738 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:16.944674  5605 consensus_queue.cc:1059] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:16.945662  5648 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:16.929675  1630 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:16.947270  5699 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:16.951440  5555 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:16.953840  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:02:16.970292  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.971065  5605 raft_consensus.cc:3055] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:16.972399  2537 raft_consensus.cc:1240] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:02:16.973049  2552 raft_consensus.cc:2393] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 8: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:16.991720  5753 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:16.977331  5605 raft_consensus.cc:740] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:16.963896  5699 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:16.994437  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 64169.3us
I20260709 13:02:17.019784  1556 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:02:17.023648  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:17.024730  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:17.001525  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 225728us
I20260709 13:02:17.004386  2515 raft_consensus.cc:1275] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:17.005792  2540 raft_consensus.cc:1240] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:16.997303  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:16.961663  1558 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:59112 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2736)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2752)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2728)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 2117)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2753)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2729)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2750)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2741)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2748)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2754)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2740)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2730)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2755)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2757)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2731)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2742)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2758)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2765)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2747)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2759)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2751)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2760)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2761)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2743)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2749)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2744)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2763)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2745)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2746)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2724)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2762)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 2116)
Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:47714 (request call id 46)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2687)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2689)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2697)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2698)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2699)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2701)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2704)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2706)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2708)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2709)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2115)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2119)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2123)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2124)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2732)
I20260709 13:02:16.972798  5721 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:17.032671  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:17.022439  5699 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:17.036566  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.040872  1666 raft_consensus.cc:1275] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:16.995462  5648 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:17.046023  1663 raft_consensus.cc:1240] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 7 LEADER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:17.053544  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:17.054023  5515 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:17.054324  1592 raft_consensus.cc:3055] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:17.054745  1592 raft_consensus.cc:740] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:17.056233  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:17.056000  1592 consensus_queue.cc:260] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:17.081487  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:17.083307  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:17.084102  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.088171  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:17.089231  1592 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:17.089798  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:17.090629  2537 raft_consensus.cc:2393] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 8: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
W20260709 13:02:17.092188  1591 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2694) took 2217 ms (client timeout 1524 ms). Trace:
W20260709 13:02:17.092661  1591 rpcz_store.cc:269] 0709 13:02:14.874185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.091755 (+2217570us) service_pool.cc:211] Skipping call since client already timed out
0709 13:02:17.091918 (+   163us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:02:17.093804  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:17.096037  5721 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:17.097970  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:17.099593  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:17.057180  2523 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:02:17.107920  1592 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
I20260709 13:02:17.060276  5713 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
W20260709 13:02:17.125742  1478 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.227s	user 0.012s	sys 0.014s
W20260709 13:02:17.047763  1555 connection.cc:256] RPC call timeout handler was delayed by -1.1901095929999883s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1905s for a response
W20260709 13:02:17.126398  1555 connection.cc:256] RPC call timeout handler was delayed by -1.1333710569999766s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21860000000000002s for a response
I20260709 13:02:17.061652  1587 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:17.130054  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:17.131403  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:17.132169  1587 raft_consensus.cc:2393] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 10: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
W20260709 13:02:17.062783  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.065655  5740 raft_consensus.cc:2804] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:17.067050  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:17.134229  2548 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:02:17.134093  1633 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:17.050036  1707 leader_election.cc:336] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.579s (SENT)
W20260709 13:02:17.064863  1589 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 2100) took 3240 ms (client timeout 3207 ms). Trace:
W20260709 13:02:17.135313  1589 rpcz_store.cc:269] 0709 13:02:13.823926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.824480 (+   554us) service_pool.cc:224] Handling call
0709 13:02:17.064391 (+3239911us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54003908d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:17.064646 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3197916416}
W20260709 13:02:17.135972  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 102052us
I20260709 13:02:17.136569  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:17.138219  5573 raft_consensus.cc:2749] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:17.138365  1707 leader_election.cc:336] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.613s (SENT)
I20260709 13:02:17.139642  1707 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:02:17.070397  1588 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2693) took 2213 ms (client timeout 2122 ms). Trace:
I20260709 13:02:17.071511  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:17.141918  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 91269.3us
W20260709 13:02:17.141781  1588 rpcz_store.cc:269] 0709 13:02:14.856934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.239638 (+382704us) service_pool.cc:224] Handling call
0709 13:02:17.069802 (+1830164us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b54003e94d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:17.070140 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":592761600}
I20260709 13:02:17.143142  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:17.071760  1658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3306) took 2263 ms. Trace:
I20260709 13:02:17.143662  5566 consensus_queue.cc:1048] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:17.143821  1658 rpcz_store.cc:276] 0709 13:02:14.807884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.881050 (+ 73166us) service_pool.cc:224] Handling call
0709 13:02:14.881444 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:15.220116 (+338672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.071141 (+1851025us) spinlock_profiling.cc:243] Waited 4.89 ms on lock 0x7b540019e6d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:17.071524 (+   383us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11240192}
I20260709 13:02:17.145522  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:17.145718  1588 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:02:17.146108  1658 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:02:17.072870  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:17.146926  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:17.148038  5740 raft_consensus.cc:697] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:17.149230  5740 consensus_queue.cc:237] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:17.144378  5687 consensus_queue.cc:1059] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:17.133018  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:17.031153  5710 consensus_queue.cc:1048] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:02:17.045660  5793 raft_consensus.cc:2804] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:17.075537  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:17.153522  2540 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5.
I20260709 13:02:17.152877  5793 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.154592  5793 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:17.155433  5840 log.cc:927] Time spent T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.203s	user 0.002s	sys 0.000s
I20260709 13:02:17.076169  5648 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:17.075598  5811 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:17.156471  5811 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:17.158658  5753 raft_consensus.cc:2749] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:17.158653  1587 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
W20260709 13:02:17.159878  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 46492.8us
I20260709 13:02:17.079738  1738 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 8.
I20260709 13:02:17.109673  1659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3291) took 3123 ms. Trace:
I20260709 13:02:17.110145  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:17.110759  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:17.059176  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:17.054059  5761 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:17.122939  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:17.073853  5605 consensus_queue.cc:260] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:17.150624  5687 consensus_queue.cc:1243] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer 5bb87fe07da2414e84ee578c3b176ede log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:02:17.100426  1583 raft_consensus.cc:2468] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 4.
W20260709 13:02:17.170387  1705 leader_election.cc:336] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.508s (SENT)
I20260709 13:02:17.161013  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:17.196933  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:17.198221  1705 leader_election.cc:336] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.518s (SENT)
W20260709 13:02:17.188370  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.199610  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:17.200273  1583 raft_consensus.cc:2376] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 17. Re-sending same reply.
W20260709 13:02:17.202921  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.202112  1659 rpcz_store.cc:276] 0709 13:02:13.986222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.986414 (+   192us) service_pool.cc:224] Handling call
0709 13:02:13.986823 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:14.093729 (+106906us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:14.093781 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:14.094510 (+   729us) log.cc:844] Serialized 26 byte log entry
0709 13:02:14.770050 (+675540us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:14.770091 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.029309 (+2259218us) spinlock_profiling.cc:243] Waited 84.9 ms on lock 0x7b540019aad4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:17.033599 (+  4290us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:17.040423 (+  6824us) raft_consensus.cc:1685] finished
0709 13:02:17.040438 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:17.109493 (+ 69055us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7581,"raft.queue_time_us":35623,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":88,"spinlock_wait_cycles":195285248,"thread_start_us":626790,"threads_started":1,"wal-append.queue_time_us":610898,"wal-append.run_cpu_time_us":1796,"wal-append.run_wall_time_us":1151087}
I20260709 13:02:17.207429  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:17.201246  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:17.208233  2553 raft_consensus.cc:2410] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:02:17.198288  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:17.208756  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:17.196988  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:17.212481  5739 raft_consensus.cc:3055] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:17.214056  5605 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:17.214299  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 75985.7us
I20260709 13:02:17.148680  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:17.218806  1592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 2117) took 1662 ms. Trace:
I20260709 13:02:17.223311  1592 rpcz_store.cc:276] 0709 13:02:15.556519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.041970 (+1485451us) service_pool.cc:224] Handling call
0709 13:02:17.218751 (+176781us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:17.142037  1633 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:17.226883  1704 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:17.228101  5835 raft_consensus.cc:2804] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:02:17.231076  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.224514  1666 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 9.
I20260709 13:02:17.238566  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:17.215989  5635 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:17.228509  5835 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.245616  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:17.224093  2426 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:17.247845  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:17.221952  5739 raft_consensus.cc:740] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:02:17.243176  1707 leader_election.cc:336] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.735s (SENT)
I20260709 13:02:17.250461  1583 raft_consensus.cc:2393] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 8: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:17.251173  1584 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 9.
I20260709 13:02:17.254657  1658 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:02:17.255059  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:17.255872  1707 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:17.257026  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:17.261206  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 44906.7us
I20260709 13:02:17.254665  1589 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12.
I20260709 13:02:17.285218  1667 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 8.
W20260709 13:02:17.280583  1584 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 2121) took 1697 ms (client timeout 2158 ms). Trace:
W20260709 13:02:17.285966  1584 rpcz_store.cc:269] 0709 13:02:15.560509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.909930 (+1349421us) service_pool.cc:224] Handling call
0709 13:02:17.255276 (+345346us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:17.287532  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:17.287984  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:17.288316  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.290570  5753 raft_consensus.cc:2749] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:17.291610  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:17.292898  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:17.293412  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:17.249437  5835 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:17.295096  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:17.287782  1587 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
I20260709 13:02:17.305438  5685 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:17.309435  1592 raft_consensus.cc:2393] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 in current term 13: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:17.312186  1555 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:17.314389  5714 consensus_queue.cc:1048] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:02:17.320629  1590 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:02:17.321154  5718 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:17.322043  1588 raft_consensus.cc:2410] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:02:17.321861  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 180062us
I20260709 13:02:17.309508  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:17.327093  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:17.334945  1589 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 4.
I20260709 13:02:17.330717  1586 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 8.
I20260709 13:02:17.338167  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:17.339097  1588 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 11.
W20260709 13:02:17.340303  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.345731  1555 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:17.349406  5701 raft_consensus.cc:2804] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:17.349886  5701 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.350227  5701 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:17.354107  5709 raft_consensus.cc:2804] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:17.354780  5709 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.355245  5709 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:17.355451  1556 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:17.357946  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:17.358824  5681 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:17.359364  5681 raft_consensus.cc:697] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:17.364238  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:17.365563  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:17.340939  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:17.372653  1586 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 2114) took 1780 ms (client timeout 1993 ms). Trace:
I20260709 13:02:17.373049  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:17.372746  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:17.373467  1586 rpcz_store.cc:269] 0709 13:02:15.555097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.808128 (+1253031us) service_pool.cc:224] Handling call
0709 13:02:17.335551 (+527423us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:17.300441  5721 raft_consensus.cc:2804] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:17.383169  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:17.376153  1588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2724) took 1824 ms. Trace:
I20260709 13:02:17.384409  1588 rpcz_store.cc:276] 0709 13:02:15.551518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.339870 (+1788352us) service_pool.cc:224] Handling call
0709 13:02:17.376067 (+ 36197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:17.378633  2424 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:17.416112  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:17.417732  2424 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:17.419560  2554 raft_consensus.cc:1275] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:02:17.424567  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:17.437970  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:17.420113  2554 pending_rounds.cc:85] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6: Aborting all ops after (but not including) 6
I20260709 13:02:17.445967  1633 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:17.448457  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 210946us
I20260709 13:02:17.451251  1587 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:17.439234  2554 pending_rounds.cc:107] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:02:17.453256  2554 raft_consensus.cc:2889] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:17.453415  5843 log.cc:927] Time spent T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:02:17.454710  1584 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 7.
I20260709 13:02:17.454878  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:17.455655  1592 raft_consensus.cc:2468] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 6.
I20260709 13:02:17.455962  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:17.456569  1584 raft_consensus.cc:1813] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Handling vote request from an unknown peer 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:17.374454  5753 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.457371  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:17.470285  1586 raft_consensus.cc:2410] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:17.458767  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:17.383409  5721 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.473590  1584 raft_consensus.cc:2410] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:02:17.474361  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:17.366149  5691 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:17.476367  1584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 2116) took 1920 ms. Trace:
I20260709 13:02:17.480280  1584 rpcz_store.cc:276] 0709 13:02:15.556044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.455606 (+1899562us) service_pool.cc:224] Handling call
0709 13:02:17.476232 (+ 20626us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:17.477016  1633 raft_consensus.cc:2686] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:02:17.487030  1732 raft_consensus.cc:2393] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 8: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:17.487246  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:02:17.493973  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.478447  5721 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:17.474712  5811 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:17.505039  1663 raft_consensus.cc:1275] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:17.506541  1732 raft_consensus.cc:1240] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 9 LEADER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:17.512939  1591 raft_consensus.cc:2368] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 9. Current term is 10.
I20260709 13:02:17.503153  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:17.456681  1592 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:02:17.519479  1592 raft_consensus.cc:606] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:17.520233  1592 raft_consensus.cc:614] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:17.529090  1738 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 7.
I20260709 13:02:17.344239  1478 maintenance_manager.cc:643] P 5b36a7ca64a64fb998a5720e2ed486da: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 9.583s	user 0.211s	sys 0.108s Metrics: {"bytes_written":30261,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":169241,"dirs.run_cpu_time_us":661,"dirs.run_wall_time_us":292858,"drs_written":1,"lbm_read_time_us":680,"lbm_reads_lt_1ms":4,"lbm_write_time_us":381175,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":11,"lbm_writes_lt_1ms":22,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":246654,"threads_started":2,"update_count":10,"wal-append.queue_time_us":209032}
I20260709 13:02:17.534272  1586 raft_consensus.cc:1240] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:17.477713  5584 consensus_queue.cc:1048] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:02:17.536204  1592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:47714 (request call id 46) took 2663 ms. Trace:
I20260709 13:02:17.539271  1592 rpcz_store.cc:276] 0709 13:02:14.876758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.456506 (+2579748us) service_pool.cc:224] Handling call
0709 13:02:17.521055 (+ 64549us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:17.536751  2550 raft_consensus.cc:1240] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:02:17.457247  5546 consensus_queue.cc:1048] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
W20260709 13:02:17.537775  2423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.532998  1588 raft_consensus.cc:1275] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:17.542186  1586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2689) took 2691 ms. Trace:
I20260709 13:02:17.542656  2554 raft_consensus.cc:1275] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:17.546335  1586 rpcz_store.cc:276] 0709 13:02:14.844122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.478204 (+2634082us) service_pool.cc:224] Handling call
0709 13:02:17.534027 (+ 55823us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:17.534811 (+   784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.535073 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:17.553396  1584 raft_consensus.cc:1240] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:17.554508  1584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2697) took 2285 ms. Trace:
I20260709 13:02:17.554909  1584 rpcz_store.cc:276] 0709 13:02:15.269491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.507127 (+2237636us) service_pool.cc:224] Handling call
0709 13:02:17.543818 (+ 36691us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:17.554082 (+ 10264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.554433 (+   351us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:17.557551  1588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2687) took 2702 ms. Trace:
I20260709 13:02:17.560729  1588 rpcz_store.cc:276] 0709 13:02:14.843548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.477489 (+2633941us) service_pool.cc:224] Handling call
0709 13:02:17.525289 (+ 47800us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:17.545949 (+ 20660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.546164 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:17.471172  5681 consensus_queue.cc:237] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:17.568464  1739 raft_consensus.cc:1275] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:17.560563  5639 raft_consensus.cc:2804] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:17.580992  1658 raft_consensus.cc:1240] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:17.582780  1707 leader_election.cc:336] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.933s (SENT)
I20260709 13:02:17.584929  1741 raft_consensus.cc:1240] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:02:17.589354  1707 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:17.592272  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:02:17.594143  1665 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.004s	sys 0.026s
I20260709 13:02:17.572762  5713 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.538771  5699 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:17.596573  1665 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.005s	sys 0.026s
W20260709 13:02:17.614866  1664 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.082s	sys 0.096s
W20260709 13:02:17.623703  1664 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.082s	sys 0.098s
I20260709 13:02:17.539595  5753 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:17.546445  5777 consensus_queue.cc:1059] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.254s
I20260709 13:02:17.633677  1584 raft_consensus.cc:1240] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:17.640177  1738 raft_consensus.cc:2468] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 4.
I20260709 13:02:17.641700  1588 raft_consensus.cc:1240] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:17.643872  1584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2699) took 2365 ms. Trace:
I20260709 13:02:17.644368  1584 rpcz_store.cc:276] 0709 13:02:15.278864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.555990 (+2277126us) service_pool.cc:224] Handling call
0709 13:02:17.601021 (+ 45031us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:17.634844 (+ 33823us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.643798 (+  8954us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:17.572359  5769 consensus_queue.cc:1048] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:02:17.650110  1586 raft_consensus.cc:1240] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:17.650485  1588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2701) took 2354 ms. Trace:
I20260709 13:02:17.651012  1586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2698) took 2378 ms. Trace:
I20260709 13:02:17.650950  1588 rpcz_store.cc:276] 0709 13:02:15.295808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.561619 (+2265811us) service_pool.cc:224] Handling call
0709 13:02:17.596980 (+ 35361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:17.650221 (+ 53241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.650429 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:17.595855  5833 raft_consensus.cc:2804] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:17.631577  5555 raft_consensus.cc:2749] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:02:17.657234  1488 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55138 (request call id 318) took 11886 ms (client timeout 15000 ms). Trace:
I20260709 13:02:17.679903  1734 raft_consensus.cc:1240] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:17.665217  5685 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:17.673296  1489 catalog_manager.cc:5697] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:02:17.674152  1732 raft_consensus.cc:1240] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 10. Current term is 11. Ops: []
W20260709 13:02:17.674688  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 109121us
I20260709 13:02:17.675124  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:17.674888  5739 consensus_queue.cc:260] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:17.651580  1586 rpcz_store.cc:276] 0709 13:02:15.272454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.557903 (+2285449us) service_pool.cc:224] Handling call
0709 13:02:17.591859 (+ 33956us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:17.650704 (+ 58845us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.650930 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:17.678637  1587 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 9.
W20260709 13:02:17.688650  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 304263us
I20260709 13:02:17.693342  1592 raft_consensus.cc:1240] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:17.696754  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:17.704679  2424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:17.708293  1707 leader_election.cc:336] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.739s (SENT)
I20260709 13:02:17.708712  1588 raft_consensus.cc:1240] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:17.709528  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:17.708109  1479 maintenance_manager.cc:419] P 5b36a7ca64a64fb998a5720e2ed486da: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10289 bytes on disk
I20260709 13:02:17.713058  1707 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:02:17.722131  1707 leader_election.cc:336] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.744s (SENT)
I20260709 13:02:17.723342  1478 maintenance_manager.cc:643] P 5b36a7ca64a64fb998a5720e2ed486da: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":371,"lbm_reads_lt_1ms":4}
W20260709 13:02:17.723766  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.638435  5713 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:17.680135  1488 rpcz_store.cc:269] 0709 13:02:05.685413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.685843 (+   430us) service_pool.cc:224] Handling call
0709 13:02:17.561185 (+11875342us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:14.620397 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:14.728079 (+107682us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:14.728117 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:02:14.728136 (+    19us) tablet.cc:662] Decoding operations
0709 13:02:14.728865 (+   729us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:14.728923 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:14.728950 (+    27us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:02:14.729403 (+   453us) tablet.cc:701] Row locks acquired
0709 13:02:14.729424 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:02:14.729578 (+   154us) write_op.cc:270] Start()
0709 13:02:14.729691 (+   113us) write_op.cc:276] Timestamp: P: 1783602134729531 usec, L: 0
0709 13:02:14.729725 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:02:14.749848 (+ 20123us) log.cc:844] Serialized 1764 byte log entry
0709 13:02:14.958621 (+208773us) op_driver.cc:464] REPLICATION: finished
0709 13:02:15.382483 (+423862us) write_op.cc:301] APPLY: starting
0709 13:02:15.397736 (+ 15253us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:15.442606 (+ 44870us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:15.457497 (+ 14891us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:15.536749 (+ 79252us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:15.537109 (+   360us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:02:15.537191 (+    82us) write_op.cc:312] APPLY: finished
0709 13:02:15.586571 (+ 49380us) log.cc:844] Serialized 41 byte log entry
0709 13:02:15.872554 (+285983us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:15.965069 (+ 92515us) write_op.cc:454] Released schema lock
0709 13:02:15.984872 (+ 19803us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:16.085252 (+100380us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:16.095847 (+ 10595us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":580661,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":407773,"apply.run_cpu_time_us":5784,"apply.run_wall_time_us":662341,"num_ops":4,"prepare.queue_time_us":460693,"prepare.run_cpu_time_us":27219,"prepare.run_wall_time_us":198658,"raft.queue_time_us":131396,"raft.run_cpu_time_us":26520,"raft.run_wall_time_us":357094,"replication_time_us":228700,"thread_start_us":566974,"threads_started":4,"wal-append.queue_time_us":74868,"wal-append.run_cpu_time_us":15928,"wal-append.run_wall_time_us":1790486}]]}
I20260709 13:02:17.727015  5713 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:17.694232  5793 consensus_meta.cc:287] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.534s	user 0.014s	sys 0.002s
I20260709 13:02:17.728022  5793 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:17.730611  5793 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:17.731487  5555 raft_consensus.cc:2749] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:17.731994  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.731808  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:17.732483  2554 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:17.732645  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.691458  5833 raft_consensus.cc:697] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:17.720183  1739 raft_consensus.cc:1240] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:17.733004  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.739097  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:17.718402  2426 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:17.719750  1588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2708) took 2261 ms. Trace:
I20260709 13:02:17.740885  1588 rpcz_store.cc:276] 0709 13:02:15.458643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.679888 (+2221245us) service_pool.cc:224] Handling call
0709 13:02:17.708541 (+ 28653us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:17.717027 (+  8486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.719689 (+  2662us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:17.742189  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:17.743157  1588 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 9.
I20260709 13:02:17.750315  1584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2706) took 2341 ms. Trace:
I20260709 13:02:17.750757  1489 catalog_manager.cc:5697] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:17.754763  2426 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:17.757189  1662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3318) took 1362 ms. Trace:
I20260709 13:02:17.757277  2553 raft_consensus.cc:1275] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:17.758543  5697 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:17.753692   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:17.759673  5753 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:17.761523   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:17.756512  1489 catalog_manager.cc:5697] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 reported cstate change: config changed from index 7 to 8, term changed from 7 to 9, VOTER 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) evicted. New cstate: current_term: 9 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:17.757596  1662 rpcz_store.cc:276] 0709 13:02:16.394474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.892714 (+498240us) service_pool.cc:224] Handling call
0709 13:02:16.920677 (+ 27963us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:17.030488 (+109811us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:17.030520 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:17.040817 (+ 10297us) log.cc:844] Serialized 52 byte log entry
0709 13:02:17.484422 (+443605us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:17.484563 (+   141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.484662 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:17.756907 (+272245us) raft_consensus.cc:1685] finished
0709 13:02:17.756929 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:17.757115 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2925,"raft.queue_time_us":10165,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":8638,"thread_start_us":370672,"threads_started":1,"wal-append.queue_time_us":532622}
I20260709 13:02:17.765849  1489 catalog_manager.cc:5697] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 4 to 5, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:02:17.775343  1489 catalog_manager.cc:5697] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 11 to 12, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:17.754555  1584 rpcz_store.cc:276] 0709 13:02:15.409256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.645330 (+2236074us) service_pool.cc:224] Handling call
0709 13:02:17.711244 (+ 65914us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:17.749975 (+ 38731us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:17.750002 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:17.750042 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:17.750076 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.750134 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:17.750257 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:17.772210  2554 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 9.
I20260709 13:02:17.778267  5710 raft_consensus.cc:2749] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:17.779359  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:17.781823  1630 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:17.782815  5833 consensus_queue.cc:237] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:17.785547  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.785274  1489 catalog_manager.cc:5697] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 5 to 6, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 6 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:02:17.780988  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:17.794314  1585 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
I20260709 13:02:17.757288  2426 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:17.803426  1585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2745) took 1088 ms. Trace:
I20260709 13:02:17.744879  1588 raft_consensus.cc:1275] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:17.788408  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:17.805840  1665 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:02:17.804636  1588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2709) took 2312 ms. Trace:
I20260709 13:02:17.807123  1588 rpcz_store.cc:276] 0709 13:02:15.492120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.744098 (+2251978us) service_pool.cc:224] Handling call
0709 13:02:17.744519 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:17.804305 (+ 59786us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.804570 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:17.815891  5566 consensus_queue.cc:1059] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:17.815608  1489 catalog_manager.cc:5697] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 6 to 7, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 7 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:02:17.817627  1489 catalog_manager.cc:5697] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:17.820670  5739 raft_consensus.cc:3060] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:17.821259  5338 consensus_queue.cc:1048] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
W20260709 13:02:17.809015  5761 consensus_meta.cc:287] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.600s	user 0.012s	sys 0.000s
I20260709 13:02:17.827145  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:17.834533  5710 raft_consensus.cc:2804] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:02:17.835335  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 78109.9us
I20260709 13:02:17.734520  5691 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:17.717741  5648 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:17.829566  1707 leader_election.cc:336] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.948s (SENT)
I20260709 13:02:17.803961  1585 rpcz_store.cc:276] 0709 13:02:16.715224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.258290 (+543066us) service_pool.cc:224] Handling call
0709 13:02:17.803359 (+545069us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:17.812552  5769 raft_consensus.cc:2804] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:17.849188  1707 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:17.845221  1588 raft_consensus.cc:1275] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:17.852360  1661 raft_consensus.cc:2410] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:02:17.858821  1588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2119) took 2301 ms. Trace:
I20260709 13:02:17.859287  1588 rpcz_store.cc:276] 0709 13:02:15.557338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.823584 (+2266246us) service_pool.cc:224] Handling call
0709 13:02:17.841476 (+ 17892us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:17.852149 (+ 10673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.858752 (+  6603us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:17.861232  1591 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2729) took 1516 ms (client timeout 1933 ms). Trace:
W20260709 13:02:17.861708  1591 rpcz_store.cc:269] 0709 13:02:16.344608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.093438 (+748830us) service_pool.cc:224] Handling call
0709 13:02:17.857398 (+763960us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b54004376d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:17.861133 (+  3735us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":937963392}
I20260709 13:02:17.865525  1664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3319) took 1084 ms. Trace:
I20260709 13:02:17.846280  5710 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.820587  1489 catalog_manager.cc:5697] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:17.877516  1665 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:02:17.850188  5718 raft_consensus.cc:2749] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:17.866060  1664 rpcz_store.cc:276] 0709 13:02:16.781039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.900920 (+119881us) service_pool.cc:224] Handling call
0709 13:02:16.920096 (+ 19176us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:17.038828 (+118732us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:17.626083 (+587255us) log.cc:844] Serialized 14 byte log entry
0709 13:02:17.855094 (+229011us) log.cc:844] Serialized 14 byte log entry
0709 13:02:17.865163 (+ 10069us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:17.865217 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:17.865259 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.865323 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:17.865451 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8832,"prepare.queue_time_us":80035,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":14791,"spinlock_wait_cycles":330112,"thread_start_us":759906,"threads_started":2}
I20260709 13:02:17.884650  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:17.859669  5817 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.881908  1489 catalog_manager.cc:5697] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:17.834049  5721 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:17.894378  5721 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 6 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:17.896014  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 47390.8us
I20260709 13:02:17.898026  2426 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:17.893424  1489 catalog_manager.cc:5697] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 14 to 16, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 16 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:17.899624  2426 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:17.902575  2426 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:17.884476  5693 consensus_queue.cc:1059] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:02:17.880633  5753 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:02:17.905242  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 75695.5us
I20260709 13:02:17.885221  5648 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:17.906479  1707 leader_election.cc:336] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 2.073s (SENT)
I20260709 13:02:17.905959  1489 catalog_manager.cc:5697] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 5 to 7, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:17.907683  1707 leader_election.cc:336] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 2.084s (SENT)
I20260709 13:02:17.908054  1707 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:17.908454  1591 raft_consensus.cc:1240] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:17.909276  1489 catalog_manager.cc:5697] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 7 to 9, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:17.910297  5753 raft_consensus.cc:2749] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:17.925421  5817 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:17.926467  5693 raft_consensus.cc:3055] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:17.926941  5693 raft_consensus.cc:740] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:17.925421  5605 raft_consensus.cc:2804] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:17.927810  5605 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:17.928200  5605 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:17.929052  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:17.928223  5693 consensus_queue.cc:260] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:17.929888  1739 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:02:17.931018  5693 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:17.931222  1707 leader_election.cc:336] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 2.122s (SENT)
W20260709 13:02:17.932525  1707 leader_election.cc:336] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 2.144s (SENT)
I20260709 13:02:17.933218  1707 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:17.936290  5753 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:17.938126  5847 log.cc:927] Time spent T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:02:17.866895  5769 raft_consensus.cc:697] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 9 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
W20260709 13:02:17.939736  5835 consensus_meta.cc:287] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.564s	user 0.011s	sys 0.002s
I20260709 13:02:17.939672  5769 consensus_queue.cc:237] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:17.940212  5835 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:17.942636  5835 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:17.943285  5639 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:17.943763  5639 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:17.944024  1661 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39146 (request call id 3316) took 2394 ms (client timeout 2981 ms). Trace:
W20260709 13:02:17.944409  1661 rpcz_store.cc:269] 0709 13:02:15.549571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.635736 (+1086165us) service_pool.cc:224] Handling call
0709 13:02:17.943791 (+1308055us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400043b54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:17.943941 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2725594496}
I20260709 13:02:17.947494  2550 raft_consensus.cc:1240] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:02:17.948518  5699 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:17.883721  5710 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:17.955468  1662 raft_consensus.cc:1240] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:17.955417  1584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2115) took 2395 ms. Trace:
W20260709 13:02:17.964792  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.952193  1489 catalog_manager.cc:5697] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 9 to 11, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:17.956624  1584 rpcz_store.cc:276] 0709 13:02:15.555498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.776913 (+2221415us) service_pool.cc:224] Handling call
0709 13:02:17.777368 (+   455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:17.786843 (+  9475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:17.786878 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:17.787327 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 13:02:17.888067 (+100740us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:17.888125 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.888218 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:17.950909 (+ 62691us) raft_consensus.cc:1685] finished
0709 13:02:17.950940 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:17.951117 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9046,"raft.queue_time_us":10130,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"thread_start_us":100344,"threads_started":1,"wal-append.queue_time_us":153789}
W20260709 13:02:17.954186  5709 consensus_meta.cc:287] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.598s	user 0.011s	sys 0.003s
W20260709 13:02:17.974074  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 71666.3us
I20260709 13:02:17.954190  5721 raft_consensus.cc:2804] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:17.981599  1489 catalog_manager.cc:5697] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 9 to 10, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:17.990969  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:17.991775  1591 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 10.
I20260709 13:02:17.954701  5699 consensus_queue.cc:1059] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:02:17.993988  5699 raft_consensus.cc:3055] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:17.994357  5699 raft_consensus.cc:740] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:17.995594  5699 consensus_queue.cc:260] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:17.997478  1707 leader_election.cc:336] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 2.216s (SENT)
I20260709 13:02:17.998168  1707 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:17.973531  5760 ts_tablet_manager.cc:1929] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 13:02:17.970908  5856 raft_consensus.cc:2804] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:17.993001  1591 raft_consensus.cc:1240] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:18.015058  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 155357us
I20260709 13:02:18.022231  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:18.019433  1489 catalog_manager.cc:5697] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 4 to 6, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:18.023386  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:18.029469  1739 raft_consensus.cc:1240] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:18.030895  2423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.030972  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:18.031872  1741 raft_consensus.cc:2368] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for earlier term 5. Current term is 6.
I20260709 13:02:18.032059  1738 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:02:17.984997  5721 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
W20260709 13:02:18.021308  5701 consensus_meta.cc:287] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.671s	user 0.016s	sys 0.000s
I20260709 13:02:18.044075  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:18.045171  1591 raft_consensus.cc:2393] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 12: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:18.046519  1734 raft_consensus.cc:1275] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:02:18.046947  1734 pending_rounds.cc:85] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 2
I20260709 13:02:18.046648  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:18.047246  1734 pending_rounds.cc:107] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:02:18.047564  1734 raft_consensus.cc:2889] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:18.047736  1591 raft_consensus.cc:2393] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 11: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:18.048957  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:18.049216  5701 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:18.049849  5817 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:18.050236  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:18.050575  1737 raft_consensus.cc:1240] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:18.050997  1591 raft_consensus.cc:2368] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 9. Current term is 10.
I20260709 13:02:18.027817  5835 raft_consensus.cc:2749] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:18.027809  5697 raft_consensus.cc:2749] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:18.053192  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:18.053776  2550 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:18.056289  1589 raft_consensus.cc:2468] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 7.
I20260709 13:02:18.057545  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:18.057726  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:18.058374  1735 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:02:18.058754  1583 raft_consensus.cc:2393] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 in current term 10: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:17.985412  5709 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:18.062708  5709 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:18.063673  1590 raft_consensus.cc:2368] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 11. Current term is 12.
I20260709 13:02:18.065562  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:18.041337  5721 raft_consensus.cc:3060] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:18.066965  1732 raft_consensus.cc:1240] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:18.021994  5821 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.015761  5856 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:18.069046  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:18.069325  5856 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:18.051987  5701 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:18.068887  5821 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:18.073397  2550 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:02:18.074129  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:02:18.089243  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:18.090663  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.100067  1555 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:18.041905  5760 log.cc:1199] T 2782217725024e159b9536d03808a3ea P 5bb87fe07da2414e84ee578c3b176ede: Deleting WAL directory at /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-1-root/wals/2782217725024e159b9536d03808a3ea
I20260709 13:02:18.104501  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:18.106545  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:18.100962  5685 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.109673  1737 raft_consensus.cc:2393] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 8: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:18.110765  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:18.112473  5685 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:18.114786  5685 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:18.122862  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:18.124692  1735 raft_consensus.cc:2393] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 9: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
W20260709 13:02:18.122980  1633 connection.cc:256] RPC call timeout handler was delayed by -2.6282262799999785s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1958s for a response
I20260709 13:02:18.112098  5785 raft_consensus.cc:2804] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:18.128351  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:18.135182  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:18.135710  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:18.136365  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:18.141392  2426 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:18.101243  5605 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:18.152900  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:02:18.130183  5866 log.cc:927] Time spent T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.051s	user 0.000s	sys 0.002s
W20260709 13:02:18.153887  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:18.160861  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.146628  1733 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
W20260709 13:02:18.153803  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.150565  5760 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39130 (request call id 69) took 4456 ms. Trace:
I20260709 13:02:18.163815  5605 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 8 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:18.174266  1737 raft_consensus.cc:2393] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 11: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:18.175657  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:18.176671  1737 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:18.177625  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:18.177840  1707 leader_election.cc:336] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.508s (SENT)
I20260709 13:02:18.182789  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:18.182651  1707 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:02:18.182348  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.184551  1734 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 9.
I20260709 13:02:18.179978  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:18.185896  1733 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:18.153345  5515 raft_consensus.cc:2804] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:18.190799  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:18.193431  1707 leader_election.cc:336] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.518s (SENT)
I20260709 13:02:18.194214  1707 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:18.153790  5785 raft_consensus.cc:697] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:18.193053  5515 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.205420  5515 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:18.211951  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:18.213184  5821 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:18.169070  5685 consensus_queue.cc:1059] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:02:18.214483  5515 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:18.193918  5753 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:18.217454  1585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2124) took 2655 ms. Trace:
I20260709 13:02:18.227629  1585 rpcz_store.cc:276] 0709 13:02:15.561690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.849934 (+2288244us) service_pool.cc:224] Handling call
0709 13:02:17.881567 (+ 31633us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:17.925699 (+ 44132us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:17.925740 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:17.926353 (+   613us) log.cc:844] Serialized 26 byte log entry
0709 13:02:18.016038 (+ 89685us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:18.016081 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.016150 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:18.217075 (+200925us) raft_consensus.cc:1685] finished
0709 13:02:18.217129 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.217306 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16414,"raft.queue_time_us":27965,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":122,"spinlock_wait_cycles":36992,"thread_start_us":89047,"threads_started":1,"wal-append.queue_time_us":191716}
I20260709 13:02:18.218999  1586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2123) took 2657 ms. Trace:
I20260709 13:02:18.230517  1586 rpcz_store.cc:276] 0709 13:02:15.561361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.843304 (+2281943us) service_pool.cc:224] Handling call
0709 13:02:17.868174 (+ 24870us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:17.895562 (+ 27388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:17.895614 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:17.904488 (+  8874us) log.cc:844] Serialized 26 byte log entry
0709 13:02:18.094758 (+190270us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:18.094819 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.094924 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:18.218641 (+123717us) raft_consensus.cc:1685] finished
0709 13:02:18.218671 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.218905 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36153,"raft.queue_time_us":27353,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":285,"spinlock_wait_cycles":1162624,"thread_start_us":189211,"threads_started":1,"wal-append.queue_time_us":174042}
W20260709 13:02:18.233340  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.222587  2426 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:18.224303  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:18.225215  1583 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:18.237252  5785 consensus_queue.cc:237] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:18.238579  5515 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:18.241194  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 47806.2us
W20260709 13:02:18.241958  1707 leader_election.cc:336] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 2.537s (SENT)
I20260709 13:02:18.242316  1707 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:18.244006  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:18.243947  5710 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:18.245676  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:18.245939  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:02:18.247910  1707 leader_election.cc:336] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.559s (SENT)
W20260709 13:02:18.254248  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.254411  1707 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:18.248510  5753 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:18.257270  1739 raft_consensus.cc:2393] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 9: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:18.170158  5760 rpcz_store.cc:276] 0709 13:02:13.693809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.694109 (+   300us) service_pool.cc:224] Handling call
0709 13:02:14.084043 (+389934us) ts_tablet_manager.cc:1151] Deleting tablet 2782217725024e159b9536d03808a3ea
0709 13:02:14.087503 (+  3460us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:02:17.095533 (+3008030us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:17.960784 (+865251us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:18.150438 (+189654us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2218189,"tablet-delete.queue_time_us":371697,"thread_start_us":318002,"threads_started":1}
I20260709 13:02:18.261492  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:18.264302  1585 raft_consensus.cc:2376] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 9. Re-sending same reply.
I20260709 13:02:18.262231  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:18.265858  1737 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:02:18.263633  5821 raft_consensus.cc:2749] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:18.267221  5753 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:18.267705  1586 raft_consensus.cc:2468] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 5.
I20260709 13:02:18.272022  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:18.274684  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:18.271713  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:18.235857  5835 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:18.283613  2426 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:18.282464  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:18.285435  1737 raft_consensus.cc:2393] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 8: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:02:18.275437  5710 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:18.305310  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:18.306123  1738 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 8.
I20260709 13:02:18.309803  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:18.310457  1586 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:18.311547  2426 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:18.283597  2540 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:18.315058  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:18.320072  1737 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:02:18.317589  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:18.320235  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:02:18.323325  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 174104us
I20260709 13:02:18.324034  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:18.324033  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 76164.7us
I20260709 13:02:18.325416  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:18.326025  1585 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 8.
I20260709 13:02:18.326785  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:18.327303  1585 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 8.
I20260709 13:02:18.328099  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:18.335079  1734 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 6.
I20260709 13:02:18.302585  5721 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:18.331779  5710 raft_consensus.cc:2804] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:02:18.344615  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.344601  1592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2704) took 2995 ms. Trace:
I20260709 13:02:18.348690  1592 rpcz_store.cc:276] 0709 13:02:15.348962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.591114 (+2242152us) service_pool.cc:224] Handling call
0709 13:02:17.688182 (+ 97068us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:17.693820 (+  5638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.344353 (+650533us) spinlock_profiling.cc:243] Waited 40.5 ms on lock 0x7b54003cfd50. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8e8ad 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:18.344502 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93247360}
W20260709 13:02:18.349514  1633 connection.cc:256] RPC call timeout handler was delayed by -1.8363009659999534s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3207s for a response
I20260709 13:02:18.333179  5821 raft_consensus.cc:2804] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:18.350373  1475 catalog_manager.cc:5028] TS 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): tablet 2782217725024e159b9536d03808a3ea (table test-workload [id=8a8e3153ff4e476f890a0820215f177a]) successfully deleted
I20260709 13:02:18.345885  5710 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.352065  5721 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:18.356487  1707 leader_election.cc:336] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:59112 dropped due to backpressure: service queue is full with 50 items
W20260709 13:02:18.359684  1633 connection.cc:256] RPC call timeout handler was delayed by -1.2147080749999759s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16490000000000002s for a response
I20260709 13:02:18.361222  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:18.371939  1592 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 11.
W20260709 13:02:18.373044  1633 connection.cc:256] RPC call timeout handler was delayed by -1.1247080750000009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17490000000000003s for a response
W20260709 13:02:18.373660  1633 connection.cc:256] RPC call timeout handler was delayed by -1.0842080749999923s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1794s for a response
I20260709 13:02:18.366076  5710 raft_consensus.cc:3060] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:18.378559  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:18.381289  1592 raft_consensus.cc:3060] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:18.378931  1707 leader_election.cc:336] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.624s (SENT)
I20260709 13:02:18.379956  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:18.383188  1740 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 14.
I20260709 13:02:18.383875  1707 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:18.370786  5821 raft_consensus.cc:697] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:18.391451  1586 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 11.
I20260709 13:02:18.393572  5639 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:18.394654  5817 consensus_queue.cc:1048] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:18.400731  2426 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:18.407222  1584 raft_consensus.cc:2410] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:02:18.411003  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:18.412216  1633 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:18.415485  1588 raft_consensus.cc:1240] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:18.416044  1741 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:02:18.398967  5835 raft_consensus.cc:2749] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:18.418608  5821 consensus_queue.cc:237] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:18.421396  2515 raft_consensus.cc:1240] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:18.410140  5685 raft_consensus.cc:2804] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:18.423588  5685 raft_consensus.cc:697] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:18.424851  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:18.427227  1739 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 7.
I20260709 13:02:18.401252  5718 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:18.424759  5685 consensus_queue.cc:237] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:18.439832  1707 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:18.440557  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:18.435144  1592 raft_consensus.cc:2468] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 7.
I20260709 13:02:18.449054  1740 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:18.450037  2426 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:18.451125  5721 raft_consensus.cc:2804] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:18.451753  5721 raft_consensus.cc:697] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:18.452637  5721 consensus_queue.cc:237] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:18.454226  5879 raft_consensus.cc:2804] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:18.454787  5879 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.455219  5879 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:18.455654  5753 consensus_queue.cc:1059] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:18.456525  1591 raft_consensus.cc:1240] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:18.458968  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.457827  1592 raft_consensus.cc:1240] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:18.415611  5769 raft_consensus.cc:2749] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:18.464390  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 743639us
I20260709 13:02:18.438232  5713 raft_consensus.cc:3055] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:18.492368  5713 raft_consensus.cc:740] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:18.492604  2543 raft_consensus.cc:1240] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:18.495038  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:18.495534  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.495489  5639 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
W20260709 13:02:18.496057  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.461236  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:18.468995  5515 consensus_queue.cc:1059] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:02:18.477241  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 65248.6us
I20260709 13:02:18.434324  5738 raft_consensus.cc:3055] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:18.479094  1588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2732) took 2133 ms. Trace:
I20260709 13:02:18.510058  1588 rpcz_store.cc:276] 0709 13:02:16.345648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.861761 (+1516113us) service_pool.cc:224] Handling call
0709 13:02:18.220349 (+358588us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.417446 (+197097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.478444 (+ 60998us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b54003e94d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:18.478915 (+   471us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b54003e94d0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8e8ad 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:18.479036 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1219987072}
I20260709 13:02:18.479910  1740 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:02:18.480530  5648 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:18.459659  5718 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:18.484351  5856 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:18.518272  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 61043.9us
I20260709 13:02:18.487412  2554 raft_consensus.cc:1240] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:18.478121  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:18.500793  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:18.509423  1633 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:18.499840  1733 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 8.
I20260709 13:02:18.516064  5885 consensus_queue.cc:1048] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:18.520746  1583 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 8.
I20260709 13:02:18.523455  2552 raft_consensus.cc:2393] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 6: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
W20260709 13:02:18.538131  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.543196  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:18.543902  1733 raft_consensus.cc:2393] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 in current term 6: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:18.538816  1556 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:18.546789  2550 raft_consensus.cc:1240] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:18.514058  5738 raft_consensus.cc:740] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:18.544112  2424 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:18.551997  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:18.555892  5856 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 8 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:18.556602  2548 raft_consensus.cc:1240] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 LEADER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:18.558523  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:18.569010  2554 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 8.
I20260709 13:02:18.562357  1660 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:02:18.566665  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 57337.3us
I20260709 13:02:18.572427  1633 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:18.574891  1556 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:18.557262  5769 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:18.583303  1664 raft_consensus.cc:1240] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:02:18.587380  5740 raft_consensus.cc:2749] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:18.568125  5821 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.573984  5865 raft_consensus.cc:2804] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:18.593667  5835 raft_consensus.cc:3055] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:18.594142  5835 raft_consensus.cc:740] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:18.580494  5639 raft_consensus.cc:2749] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:18.558010  5753 consensus_queue.cc:1059] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
W20260709 13:02:18.609613  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 84673.3us
I20260709 13:02:18.610416  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:18.611109  1739 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:18.597599  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:18.622121  1589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46836 (request call id 457) took 1493 ms. Trace:
I20260709 13:02:18.622445  1586 raft_consensus.cc:1275] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:18.622442  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:18.596890  5865 raft_consensus.cc:697] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:18.624184  1735 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:18.622570  1589 rpcz_store.cc:276] 0709 13:02:17.128615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.369309 (+240694us) service_pool.cc:224] Handling call
0709 13:02:18.621788 (+1252479us) spinlock_profiling.cc:243] Waited 639 ms on lock 0x7b54003cf854. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:18.622056 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1470463872}
I20260709 13:02:18.629397  2543 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 13.
I20260709 13:02:18.595017  5835 consensus_queue.cc:260] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:18.597448  5821 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:18.646636  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:18.646922  1558 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:18.624125  2540 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:02:18.651731  5648 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:18.652391  5648 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:18.653983  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:18.654670  1734 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:18.646440  5738 consensus_queue.cc:260] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:18.658428  5718 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:18.658638  5738 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:18.659132  5718 consensus_queue.cc:1048] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:18.607673  5886 consensus_queue.cc:1059] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:02:18.662683  5821 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:18.666090  1734 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 15.
I20260709 13:02:18.630030  5865 consensus_queue.cc:237] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:18.660609  5886 consensus_queue.cc:1048] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:18.682926  1663 raft_consensus.cc:1240] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 9 LEADER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:02:18.683144  1658 raft_consensus.cc:1240] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:18.685156  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:18.691320  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:18.693435  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:18.693996  1663 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 8.
I20260709 13:02:18.695145  1658 raft_consensus.cc:2468] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 4.
I20260709 13:02:18.695640  1661 raft_consensus.cc:1275] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:18.701001  1705 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:18.704881  1663 raft_consensus.cc:1275] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:02:18.706080  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 133750us
I20260709 13:02:18.711385  1666 raft_consensus.cc:1275] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:02:18.714725  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:18.685387  5785 raft_consensus.cc:2749] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:18.716180  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:18.693272  5835 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:18.720927  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 80570.2us
I20260709 13:02:18.718554  1660 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 15.
I20260709 13:02:18.738746  1558 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:18.738473  2424 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:18.740878  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:02:18.722361  5882 log.cc:927] Time spent T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:02:18.752704  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:18.716142  5890 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:18.784793  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 203490us
W20260709 13:02:18.785861  1590 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2746) took 2070 ms (client timeout 2537 ms). Trace:
W20260709 13:02:18.724275  5883 log.cc:927] Time spent T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
W20260709 13:02:18.791548  1590 rpcz_store.cc:269] 0709 13:02:16.715647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.333770 (+618123us) service_pool.cc:224] Handling call
0709 13:02:18.756984 (+1423214us) spinlock_profiling.cc:243] Waited 697 ms on lock 0x7b5400437bd4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:18.785804 (+ 28820us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1603655424}
W20260709 13:02:18.786494  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 61128.6us
I20260709 13:02:18.787328  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:18.729596  5811 raft_consensus.cc:2749] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:18.789676  1665 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 14.
I20260709 13:02:18.792964  1633 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:18.789824  1630 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:18.748685  5821 raft_consensus.cc:2804] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:18.796782  5574 raft_consensus.cc:2804] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:18.797755  5574 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:18.797420  5584 consensus_queue.cc:1059] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:18.798269  5574 raft_consensus.cc:3060] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:18.798713  5584 raft_consensus.cc:3055] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:18.799247  5584 raft_consensus.cc:740] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:18.799664  5897 raft_consensus.cc:2749] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:18.800908  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 106292us
I20260709 13:02:18.794103  5890 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:18.804319  2426 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:18.804121  5710 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:18.791246  5685 consensus_queue.cc:1048] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:02:18.805920  5721 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:18.809469  2426 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:18.810142  5785 consensus_queue.cc:1048] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:02:18.810642  5685 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:18.809175  5777 consensus_queue.cc:1059] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:18.717669  5879 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:18.813143  1705 leader_election.cc:336] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.624s (SENT)
I20260709 13:02:18.813506  1558 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:18.818519  1735 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:02:18.818763  1705 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:18.770463  5753 raft_consensus.cc:3055] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:18.815793  1739 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:02:18.816960  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:18.809293  5821 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.821250  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:18.822147   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:18.824139  2424 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:18.722585  5892 consensus_queue.cc:1059] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.161s
I20260709 13:02:18.826575  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:18.821740  5821 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:18.804942  5890 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:18.830873  1734 raft_consensus.cc:1240] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:18.828593  5685 raft_consensus.cc:2804] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:18.831808  5685 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.832207  5685 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:18.834233  5884 log.cc:927] Time spent T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:02:18.822216  5584 consensus_queue.cc:260] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:18.838939  5584 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:18.842176  1705 leader_election.cc:336] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.689s (SENT)
I20260709 13:02:18.842605  5710 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 6 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:18.844254  1739 raft_consensus.cc:1240] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:18.844347  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:18.845180  1667 raft_consensus.cc:3060] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:02:18.845988  1739 raft_consensus.cc:1275] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:02:18.849313  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.851058  1665 raft_consensus.cc:3055] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:18.851450  1665 raft_consensus.cc:740] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:18.852177  1665 consensus_queue.cc:260] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:18.853443  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.853628  2426 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:18.854772  2426 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:18.855881  2426 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:18.855967  1739 raft_consensus.cc:1275] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:18.842672  1705 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:18.857611  1665 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:18.860836  1662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3353) took 1066 ms. Trace:
I20260709 13:02:18.861740  1662 rpcz_store.cc:276] 0709 13:02:17.798085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.813525 (+ 15440us) service_pool.cc:224] Handling call
0709 13:02:17.842985 (+ 29460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:17.963557 (+120572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.859721 (+896164us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b5400358ed4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:18.860623 (+   902us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":258083712}
I20260709 13:02:18.867833  1739 raft_consensus.cc:1240] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:18.873314  5713 consensus_queue.cc:260] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:18.874887  5713 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:18.877592  5856 raft_consensus.cc:2764] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:02:18.878355  5699 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:18.878860  1739 raft_consensus.cc:1240] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:18.879159  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:18.883682  1667 raft_consensus.cc:2468] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 6.
I20260709 13:02:18.883675  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:18.886046  1589 raft_consensus.cc:3060] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:18.887908  2424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.891628  1735 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 8.
W20260709 13:02:18.893587  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:18.901702  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.823166  5753 raft_consensus.cc:740] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
W20260709 13:02:18.910652  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.939059  1740 raft_consensus.cc:1275] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:18.940807  1558 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:18.888763  2424 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:02:18.941926  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 53280.6us
I20260709 13:02:18.948160  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:18.949579  1735 raft_consensus.cc:1275] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:18.894068  5639 raft_consensus.cc:2804] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:18.951625  1736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35672 (request call id 448) took 1372 ms. Trace:
I20260709 13:02:18.952003  1736 rpcz_store.cc:276] 0709 13:02:17.512318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.512575 (+   257us) service_pool.cc:224] Handling call
0709 13:02:17.558078 (+ 45503us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:17.591882 (+ 33804us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:17.591913 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:17.688964 (+ 97051us) log.cc:844] Serialized 26 byte log entry
0709 13:02:17.950574 (+261610us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:18.128762 (+178188us) log.cc:844] Serialized 14 byte log entry
0709 13:02:18.855328 (+726566us) spinlock_profiling.cc:243] Waited 98.4 ms on lock 0x7b5400408420. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f0a733 00007f1b80f8fdbf 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c
0709 13:02:18.855390 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.855459 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:18.855500 (+    41us) raft_consensus.cc:1685] finished
0709 13:02:18.868087 (+ 12587us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.884505 (+ 16418us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":213883,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":8882,"raft.run_cpu_time_us":582,"raft.run_wall_time_us":89954,"spinlock_wait_cycles":226369792,"thread_start_us":331533,"threads_started":2,"wal-append.queue_time_us":326782}
I20260709 13:02:18.954383  5895 raft_consensus.cc:2749] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:18.955123  5894 raft_consensus.cc:2804] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:18.955575  5894 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.955914  5894 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:18.960952  5879 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:18.962518  2553 raft_consensus.cc:1275] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:18.966114  5895 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:18.967199  5895 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:18.967963  5890 raft_consensus.cc:2749] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:18.969574  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 127423us
W20260709 13:02:18.970666  1705 leader_election.cc:336] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.722s (SENT)
I20260709 13:02:18.971078  1705 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:18.973759  5753 consensus_queue.cc:260] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:18.975018  5753 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:18.975538  5574 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:18.977207  5605 raft_consensus.cc:2804] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:18.980228  5888 raft_consensus.cc:3055] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:18.981182  5888 raft_consensus.cc:740] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:18.982676  5888 consensus_queue.cc:260] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:18.984421  5895 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:18.985481  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:19.006467  1665 raft_consensus.cc:1275] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:02:19.006925  1665 pending_rounds.cc:85] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 9
I20260709 13:02:19.007001  1737 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:19.007221  1665 pending_rounds.cc:107] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:02:19.007692  1665 raft_consensus.cc:2889] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:19.030421  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:19.030100  1589 raft_consensus.cc:2468] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 6.
W20260709 13:02:19.030930  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 435637us
W20260709 13:02:19.032831  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 243066us
I20260709 13:02:19.037627  1736 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 15.
W20260709 13:02:19.044286  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.988976  5574 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:18.868467  5721 raft_consensus.cc:2749] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:02:18.995522  1705 leader_election.cc:336] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.517s (SENT)
I20260709 13:02:19.058466  1705 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:18.983650  5892 raft_consensus.cc:2749] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:18.864711  5785 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:19.072144  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:19.073328  2553 raft_consensus.cc:2393] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 9: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:02:19.030118  5769 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:18.945070  5685 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:19.101614  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.010998  5709 consensus_queue.cc:1048] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:02:19.057839  5777 raft_consensus.cc:2749] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:19.099526  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.030067  5706 consensus_queue.cc:1059] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:02:19.069989  5888 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:19.092929  5890 raft_consensus.cc:2749] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:19.127426  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 237248us
I20260709 13:02:19.133592  1558 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:19.149559  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:02:19.153371  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.160879  1737 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
W20260709 13:02:19.163219  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.163842  5639 raft_consensus.cc:697] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:19.166452  5685 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 16 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:19.119791  5856 consensus_queue.cc:1048] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:02:19.167016  1558 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:19.167665  5687 raft_consensus.cc:2749] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:02:19.171367  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.173285  5902 raft_consensus.cc:2749] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:19.175146  2540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49222 (request call id 519) took 1110 ms. Trace:
I20260709 13:02:19.155843  5584 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.190623  5685 consensus_queue.cc:1048] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:02:19.192931  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 455468us
W20260709 13:02:19.197052  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 201577us
W20260709 13:02:19.210412  1705 leader_election.cc:336] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.589s (SENT)
W20260709 13:02:19.212112  1705 leader_election.cc:336] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.753s (SENT)
I20260709 13:02:19.212687  1705 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:19.201684  5648 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:19.231045  1633 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:02:19.232818  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.245754  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 78843.7us
I20260709 13:02:19.213872  5777 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:02:19.230139  1705 leader_election.cc:336] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.757s (SENT)
I20260709 13:02:19.250564  1705 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:19.230242  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 220013us
I20260709 13:02:19.258239  5885 raft_consensus.cc:2749] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:19.226369  5605 raft_consensus.cc:697] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:19.209183  5584 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:19.261057  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:19.264724  1660 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:02:19.248345  5902 raft_consensus.cc:2749] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:19.254705  5777 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.194640  2540 rpcz_store.cc:276] 0709 13:02:18.064388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.065238 (+   850us) service_pool.cc:224] Handling call
0709 13:02:19.174038 (+1108800us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b540060f754. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:19.174194 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":482465664}
I20260709 13:02:19.256772  5648 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.274284  1558 leader_election.cc:400] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for earlier term 5. Current term is 6.
I20260709 13:02:19.274730  1558 leader_election.cc:403] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:02:19.277455  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 47340.9us
W20260709 13:02:19.287583  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 67597.2us
W20260709 13:02:19.278574  1705 leader_election.cc:336] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.823s (SENT)
I20260709 13:02:19.290961  1705 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:19.187613  5911 consensus_queue.cc:1059] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:02:19.265714  5811 raft_consensus.cc:2804] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:19.225540  5639 consensus_queue.cc:237] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:19.294934  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 115648us
I20260709 13:02:19.272305  5777 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:19.301275  1705 leader_election.cc:336] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.907s (SENT)
I20260709 13:02:19.302434  1705 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:02:19.310875  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 47515.6us
I20260709 13:02:19.299638  5701 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 4 FOLLOWER]: Advancing to term 6
W20260709 13:02:19.315999  1705 leader_election.cc:336] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.909s (SENT)
I20260709 13:02:19.318063  1705 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:19.320477  1660 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 16.
I20260709 13:02:19.319694  1734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3382) took 1009 ms. Trace:
I20260709 13:02:19.328464  5584 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:19.329133  5706 consensus_queue.cc:1048] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:19.319056  5902 raft_consensus.cc:2749] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:02:19.332012  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 50570.8us
I20260709 13:02:19.334167  1633 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:19.318888  5605 consensus_queue.cc:237] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:19.335098  5907 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:19.335520  5907 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:19.335871  5907 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:19.341547  5835 consensus_meta.cc:287] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.598s	user 0.011s	sys 0.002s
I20260709 13:02:19.344868  1556 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:19.320585  5911 consensus_queue.cc:1243] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer 7e839e91a1314c2f9a99b25b17c916a6 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:02:19.327461  1734 rpcz_store.cc:276] 0709 13:02:18.310442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.853465 (+543023us) service_pool.cc:224] Handling call
0709 13:02:18.853765 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.854006 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:18.854332 (+   326us) log.cc:844] Serialized 14 byte log entry
0709 13:02:19.148825 (+294493us) log.cc:844] Serialized 14 byte log entry
0709 13:02:19.319304 (+170479us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:19.319357 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:19.319416 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.319520 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.319636 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35483,"prepare.queue_time_us":5639,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":65,"raft.queue_time_us":131845,"raft.run_cpu_time_us":395,"raft.run_wall_time_us":38985,"spinlock_wait_cycles":35196416,"thread_start_us":345216,"threads_started":2,"wal-append.queue_time_us":317079}
I20260709 13:02:19.315260  5811 raft_consensus.cc:697] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 9 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
W20260709 13:02:19.364715  1707 leader_election.cc:336] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.544s (SENT)
W20260709 13:02:19.365739  1707 leader_election.cc:336] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.589s (SENT)
I20260709 13:02:19.366209  1707 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:19.320713  5901 raft_consensus.cc:2749] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:19.369941  1585 raft_consensus.cc:2410] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:02:19.295706  5648 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:19.372956  1633 leader_election.cc:400] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 9. Current term is 10.
I20260709 13:02:19.373436  1633 leader_election.cc:403] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:02:19.376113  5918 log.cc:927] Time spent T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:02:19.361541  5574 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:19.378352  5574 raft_consensus.cc:697] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:19.378237  5907 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:19.379644  5648 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:19.379721  5574 consensus_queue.cc:237] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:19.380496  5907 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:19.381635  1733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43686 (request call id 2250) took 1274 ms. Trace:
W20260709 13:02:19.383078  5889 log.cc:927] Time spent T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.695s	user 0.005s	sys 0.002s
I20260709 13:02:19.382006  1733 rpcz_store.cc:276] 0709 13:02:18.108690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.563351 (+454661us) service_pool.cc:224] Handling call
0709 13:02:18.563809 (+   458us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:19.029985 (+466176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.030029 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:19.092289 (+ 62260us) log.cc:844] Serialized 52 byte log entry
0709 13:02:19.255376 (+163087us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:19.255435 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.255521 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:19.381372 (+125851us) raft_consensus.cc:1685] finished
0709 13:02:19.381393 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.381553 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":66112,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":8160,"thread_start_us":536689,"threads_started":2,"wal-append.queue_time_us":172676}
W20260709 13:02:19.387771  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 71799.1us
W20260709 13:02:19.388761  1705 leader_election.cc:336] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.943s (SENT)
I20260709 13:02:19.318941  5865 consensus_queue.cc:1048] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
W20260709 13:02:19.352948  5821 consensus_meta.cc:287] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6: Time spent flushing consensus metadata: real 0.521s	user 0.012s	sys 0.000s
I20260709 13:02:19.389266  1705 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:19.321419  5687 consensus_queue.cc:1048] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:02:19.409423  5821 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:19.402647  5925 raft_consensus.cc:2749] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:19.404752  5922 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:02:19.406623  1705 leader_election.cc:336] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.649s (SENT)
I20260709 13:02:19.370112  5902 raft_consensus.cc:2749] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:19.324204  5921 consensus_queue.cc:1059] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
W20260709 13:02:19.417616  1705 leader_election.cc:336] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.700s (SENT)
I20260709 13:02:19.418978  5821 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:19.419205  1705 leader_election.cc:336] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.087s (SENT)
I20260709 13:02:19.419750  1705 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:02:19.416208  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 62074.7us
I20260709 13:02:19.420467  5811 consensus_queue.cc:237] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:19.421960  5902 raft_consensus.cc:2749] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:19.425555  1705 leader_election.cc:336] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.801s (SENT)
I20260709 13:02:19.429009  1734 raft_consensus.cc:3055] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:19.429402  1734 raft_consensus.cc:740] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:19.433173  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:19.434029  1733 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:19.413892  5907 raft_consensus.cc:2749] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 9. Current term is 10.
I20260709 13:02:19.455015  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:19.446367  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:19.458588  1666 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:19.430331  1734 consensus_queue.cc:260] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:19.453359  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:19.460855  1662 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
W20260709 13:02:19.464329  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 107947us
I20260709 13:02:19.361464  5904 consensus_queue.cc:1048] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 13:02:19.470701  1733 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 16.
I20260709 13:02:19.473980  1736 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:19.481844  1734 raft_consensus.cc:3060] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:19.487419  5753 consensus_meta.cc:287] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.512s	user 0.015s	sys 0.000s
I20260709 13:02:19.497377  5785 raft_consensus.cc:3055] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:19.497939  5785 raft_consensus.cc:740] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:19.498788  5785 consensus_queue.cc:260] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:19.500229  5785 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:19.502789  1633 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:19.504112  1633 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:19.505748  5899 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:19.506162  5899 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.506489  5899 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:19.508323  5701 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for earlier term 5. Current term is 6.
I20260709 13:02:19.513295  5769 raft_consensus.cc:2804] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:19.513790  5769 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:19.514231  5769 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:19.514505  5908 log.cc:927] Time spent T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.345s	user 0.000s	sys 0.002s
I20260709 13:02:19.516017  1741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43686 (request call id 2248) took 1414 ms. Trace:
I20260709 13:02:19.520897  1734 raft_consensus.cc:1275] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:19.518639  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:19.526167  1662 raft_consensus.cc:2410] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
W20260709 13:02:19.529479  1707 leader_election.cc:336] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.649s (SENT)
I20260709 13:02:19.528035  5907 consensus_queue.cc:1048] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:02:19.535511  5899 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:19.536396  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:19.537235  2550 raft_consensus.cc:1813] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Handling vote request from an unknown peer 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:19.537873  2550 raft_consensus.cc:2393] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 12: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:19.542781  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:19.516579  1741 rpcz_store.cc:276] 0709 13:02:18.102133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.523010 (+420877us) service_pool.cc:224] Handling call
0709 13:02:18.541503 (+ 18493us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:18.566353 (+ 24850us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:18.566405 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:18.577762 (+ 11357us) log.cc:844] Serialized 26 byte log entry
0709 13:02:19.093145 (+515383us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:19.093192 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.093263 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:19.513772 (+420509us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b4400022b4c. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7ddc8c85 00007f1b7ddc96a2 00007f1b80b3b1db 00007f1b80b36aaf 00007f1b80b2a86e 00007f1b80b29bb6 00007f1b80b297d8 00007f1b80b33221 00007f1b80b331d9 00007f1b80b33169
0709 13:02:19.515556 (+  1784us) raft_consensus.cc:1685] finished
0709 13:02:19.515578 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.515941 (+   363us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2999,"raft.queue_time_us":57845,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":29454,"spinlock_wait_cycles":52836096,"thread_start_us":494495,"threads_started":1,"wal-append.queue_time_us":582120}
I20260709 13:02:19.550474  2426 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:02:19.549961  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 82637us
I20260709 13:02:19.555704  1558 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:19.562055  5924 log.cc:927] Time spent T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.050s	user 0.001s	sys 0.001s
I20260709 13:02:19.563908  1733 raft_consensus.cc:1275] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:02:19.566560  1736 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 9.
I20260709 13:02:19.567446  2426 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:02:19.551208  5894 consensus_meta.cc:287] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.595s	user 0.015s	sys 0.000s
I20260709 13:02:19.570490  5894 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:19.572723  5894 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:19.561954  5605 raft_consensus.cc:2804] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:19.576851  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:19.564491  1733 pending_rounds.cc:85] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 6
I20260709 13:02:19.623654  1733 pending_rounds.cc:107] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:02:19.624140  1733 raft_consensus.cc:2889] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:19.605356  1707 leader_election.cc:336] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.649s (SENT)
I20260709 13:02:19.625305  1707 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:19.607127  5605 raft_consensus.cc:697] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:19.607824  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:19.609051  5886 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:19.613572  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.632314  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.614018  5584 raft_consensus.cc:2749] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:19.580513  5713 raft_consensus.cc:2749] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:19.628543  1664 raft_consensus.cc:1275] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:19.634054  5886 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:19.631513  5914 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.637060  5605 consensus_queue.cc:237] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:19.641551  5687 raft_consensus.cc:3055] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:19.656661  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:19.691175  1586 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:19.662298  1589 raft_consensus.cc:1275] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:19.658560  1555 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:19.564560  5721 consensus_queue.cc:1048] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:02:19.674672  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:19.683221  1583 raft_consensus.cc:1275] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:19.549340  5777 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:19.686380  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 130776us
I20260709 13:02:19.687662  5738 raft_consensus.cc:3055] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:19.682425  5701 consensus_queue.cc:1059] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:02:19.689244  5914 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:19.696609  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:19.697157  1556 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:19.699070  1659 raft_consensus.cc:2393] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 9: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:19.702173  1590 raft_consensus.cc:1275] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:02:19.705292  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 99979.7us
W20260709 13:02:19.707423  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 48980.3us
I20260709 13:02:19.702391  5738 raft_consensus.cc:740] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:19.728384  5901 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:19.729121  5738 consensus_queue.cc:260] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:19.729192  5901 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:19.730542  5738 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:19.731936  5928 raft_consensus.cc:3055] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:19.661940  5915 consensus_queue.cc:1048] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:02:19.732363  5928 raft_consensus.cc:740] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:19.733577  5921 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:19.734064  5921 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.734609  5921 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:19.731972  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:19.716110  1707 leader_election.cc:336] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.700s (SENT)
I20260709 13:02:19.732247  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:19.690861  5687 raft_consensus.cc:740] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:19.743151  1707 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:19.750722  1586 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 9.
I20260709 13:02:19.702069  5888 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:19.754320  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 52631.9us
W20260709 13:02:19.757529  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.761003  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:19.734057  5901 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:19.765892  1558 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:19.771731  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:19.780539  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:19.785391  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:19.749680  5899 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:19.798664  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 82584.5us
W20260709 13:02:19.803453  1707 leader_election.cc:336] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.704s (SENT)
W20260709 13:02:19.804821  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.805424  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.805886  1707 leader_election.cc:336] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.801s (SENT)
W20260709 13:02:19.774001  5903 log.cc:927] Time spent T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.593s	user 0.003s	sys 0.005s
I20260709 13:02:19.806237  1707 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:19.806454  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:19.799633  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:19.814209  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:19.760167  5856 consensus_queue.cc:1048] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:02:19.712435  5584 raft_consensus.cc:2804] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:19.760002  5821 consensus_queue.cc:1048] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:02:19.814208  5888 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:19.843686  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:19.843914  5888 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:19.844519  1661 raft_consensus.cc:2368] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 15. Current term is 16.
I20260709 13:02:19.846757  5888 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:19.849009  5885 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
W20260709 13:02:19.850450  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 84670.7us
W20260709 13:02:19.853117  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 47239.6us
I20260709 13:02:19.810240  5879 raft_consensus.cc:3055] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:19.807140  5911 raft_consensus.cc:2749] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:19.866386  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:19.872792  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.884200  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 195290us
W20260709 13:02:19.890376  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 156983us
I20260709 13:02:19.820752  5890 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:19.900005  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:19.850926  5706 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:02:19.914023  5934 log.cc:927] Time spent T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:02:19.892760  5584 raft_consensus.cc:697] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:19.907651  5888 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:19.917842  5888 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:19.918133  5584 consensus_queue.cc:237] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:19.919289  5886 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:19.919684  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 52217.4us
I20260709 13:02:19.921900  5892 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.923256  5699 consensus_queue.cc:1048] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:19.867712  5885 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.867103  5879 raft_consensus.cc:740] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:19.927775  5706 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.814988  5687 consensus_queue.cc:260] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:19.935863  5928 consensus_queue.cc:260] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:19.950592  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:19.964222  1666 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 9.
I20260709 13:02:19.980075  1558 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:19.967679  5892 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:19.982762  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:19.959112  5906 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.996397  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:19.998106  1666 raft_consensus.cc:2393] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 8: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
W20260709 13:02:20.005529  1707 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 2.008s (SENT) [suppressed 66 similar messages]
W20260709 13:02:20.013103  1707 leader_election.cc:336] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 2.056s (SENT)
W20260709 13:02:20.135095  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.116325  5879 consensus_queue.cc:260] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:20.308261  5921 consensus_meta.cc:287] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.573s	user 0.016s	sys 0.006s
I20260709 13:02:19.997659  5906 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:20.078529  5886 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:20.310643  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.310976  5886 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:20.312225  5946 consensus_queue.cc:1048] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:20.313460  5886 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:20.314042  5886 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:20.314522  5886 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:20.021689  5928 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:20.223758  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:20.316759  2540 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:20.317888  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:20.318971  1705 leader_election.cc:336] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.827s (SENT)
I20260709 13:02:20.225476  5901 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:19.982204  5706 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:20.227991  5769 consensus_meta.cc:287] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.713s	user 0.005s	sys 0.009s
I20260709 13:02:20.319829  5901 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:20.320187  5769 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:20.322125  5769 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:20.322789  1662 raft_consensus.cc:1240] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:20.323033  5901 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:20.323561  5901 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.324064  5901 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:20.324329  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:20.325388  5639 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.325665  2550 raft_consensus.cc:2393] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 8: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:02:20.325960  5639 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:20.228334  5888 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:20.231048  5900 log.cc:927] Time spent T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 1.066s	user 0.009s	sys 0.015s
I20260709 13:02:20.240620  5777 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:20.240878  5914 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:20.247079  5892 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:20.253168  1585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 2140) took 2166 ms. Trace:
I20260709 13:02:20.253412  5890 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.261631  5687 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:20.335155  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:20.299162  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.118587  5911 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
W20260709 13:02:20.222662  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 143747us
W20260709 13:02:20.303318  5738 consensus_meta.cc:287] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.572s	user 0.015s	sys 0.004s
W20260709 13:02:20.305217  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 287043us
W20260709 13:02:20.307283  5933 log.cc:927] Time spent T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.341s	user 0.003s	sys 0.005s
I20260709 13:02:20.308202  5879 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:20.363730  2424 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:20.310643  5906 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:20.327558  1705 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:19.977838  5885 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:19.997474  5941 raft_consensus.cc:2804] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:20.326550  5901 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:20.316949  5886 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:20.333490  1585 rpcz_store.cc:276] 0709 13:02:18.086610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.327883 (+241273us) service_pool.cc:224] Handling call
0709 13:02:20.252885 (+1925002us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54002d5354. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:20.253101 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2394012416}
I20260709 13:02:20.346194  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:20.347957  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:20.331740  5921 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:20.327939  5706 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:20.355669  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 339179us
I20260709 13:02:20.373349  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:20.359614  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:20.361249  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:20.364915  2426 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:20.349428  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:20.378427  5916 raft_consensus.cc:2804] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:20.380295  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:20.380650  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.381012  1661 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 14.
I20260709 13:02:20.383353  5916 raft_consensus.cc:697] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:20.362840  5785 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.386170  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:20.387040  1664 raft_consensus.cc:2368] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 8. Current term is 9.
I20260709 13:02:20.376540  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:20.388574  2550 raft_consensus.cc:2468] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:02:20.384769  5916 consensus_queue.cc:237] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:20.390208  5785 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:20.353888  5890 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:20.392501  5785 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:20.393137  5574 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.393354  5706 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.393682  5574 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:20.393940  5706 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:20.394482  5890 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:20.369830  2540 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 14.
I20260709 13:02:20.396422  5706 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:20.398037  5574 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:20.400169  5941 raft_consensus.cc:697] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:20.401324  5941 consensus_queue.cc:237] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:20.403797  1583 raft_consensus.cc:1275] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:20.417979  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:20.420014  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.370980  5685 raft_consensus.cc:2749] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:20.424226  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 105292us
I20260709 13:02:20.425700  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:20.423247  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:20.426383  1658 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:20.426491  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:20.426646  1667 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:20.427081  1666 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:20.419034  1661 raft_consensus.cc:2468] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:02:20.360637  5942 consensus_queue.cc:1048] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:02:20.429281  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:20.431046  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:20.436793  1665 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:02:20.431427  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:20.386539  5886 raft_consensus.cc:2749] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:20.363976  5911 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:20.464963  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:20.446094  1583 raft_consensus.cc:1275] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:02:20.471467  1705 leader_election.cc:336] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.889s (SENT)
I20260709 13:02:20.502928  1705 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:20.438819  5921 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:20.504863  1661 raft_consensus.cc:2393] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 9: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:20.508987  1667 raft_consensus.cc:2410] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:02:20.428494  5946 consensus_queue.cc:1048] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 13:02:20.431877  5890 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:20.515125  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:20.524245  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.530925  1666 raft_consensus.cc:2410] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:02:20.535472  1658 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 18.
I20260709 13:02:20.540187  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:20.543753  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:20.552731  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 81378.4us
I20260709 13:02:20.440411  5865 consensus_queue.cc:1059] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 13:02:20.542232  5886 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:20.541729  5934 log.cc:927] Time spent T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:02:20.594544  1664 raft_consensus.cc:1240] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:20.435189  5709 consensus_queue.cc:1048] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:02:20.601655  1660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3378) took 1153 ms. Trace:
I20260709 13:02:20.613431  5639 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:20.612454  1660 rpcz_store.cc:276] 0709 13:02:19.448115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.449023 (+   908us) service_pool.cc:224] Handling call
0709 13:02:19.449501 (+   478us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:19.455860 (+  6359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.456079 (+   219us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:19.469614 (+ 13535us) log.cc:844] Serialized 26 byte log entry
0709 13:02:20.251569 (+781955us) spinlock_profiling.cc:243] Waited 28.4 ms on lock 0x7b1800413560. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7de84e07 00007f1b86cdfab9 00007f1b7dea169b 00007f1b7de9f93f 00007f1b7dea1c02 00007f1b80b2920b 00007f1b80b2ed23 00007f1b80b2f0d1 00007f1b80f4aa0f
0709 13:02:20.373445 (+121876us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:20.373485 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.373613 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:20.601186 (+227573us) raft_consensus.cc:1685] finished
0709 13:02:20.601218 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.601566 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6678,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":10940,"spinlock_wait_cycles":65219968,"thread_start_us":121693,"threads_started":1,"wal-append.queue_time_us":935276}
I20260709 13:02:20.602056  5911 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:20.590094  5915 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:20.614933  5915 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:20.616137  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:20.552347  5890 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:20.617859  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:20.618150  5915 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:20.619769  5890 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:20.619988  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:20.621279  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:20.621555  5885 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:20.622339  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:20.623383  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:20.625295  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:20.625535  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:20.626381  1660 raft_consensus.cc:2410] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:02:20.626848  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:20.627174  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:20.627646  1666 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
I20260709 13:02:20.628295  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:20.629421  5906 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:20.629711  5899 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:20.630450  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:20.630559  5899 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:20.631505  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:20.632202  1664 raft_consensus.cc:2393] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 8: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:20.601750  1556 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:20.633437  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:20.633340  5899 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:20.629108  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:20.629978  5906 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:20.635684  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:20.619624  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:20.636592  1666 raft_consensus.cc:2393] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 18: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:20.637133  1662 raft_consensus.cc:2410] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:02:20.637977  1659 raft_consensus.cc:1240] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:20.636516  5906 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:20.610060  5865 raft_consensus.cc:3055] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:20.639503  5865 raft_consensus.cc:740] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:20.640759  5865 consensus_queue.cc:260] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:20.642445  5865 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:20.645730  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:20.646755  1665 raft_consensus.cc:2393] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 15: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:20.648459  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:20.649156  2550 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
I20260709 13:02:20.650905  5885 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.651604  5885 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:20.653383  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 51694us
I20260709 13:02:20.653656  1704 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:20.655337  1556 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:20.655480  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:20.654762  5890 raft_consensus.cc:2804] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:20.657227  5941 raft_consensus.cc:2804] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:20.657858  5941 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.656845  1589 raft_consensus.cc:2393] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 9: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:02:20.658476  5941 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:20.661549  5885 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:20.657855  5709 raft_consensus.cc:2804] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:20.662591  5709 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.663549  5709 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:20.665899  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:20.667145  1583 raft_consensus.cc:2410] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:02:20.667416  1663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3380) took 1218 ms. Trace:
I20260709 13:02:20.667819  1663 rpcz_store.cc:276] 0709 13:02:19.448781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.450037 (+  1256us) service_pool.cc:224] Handling call
0709 13:02:19.450415 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:19.456667 (+  6252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.456713 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:19.476083 (+ 19370us) log.cc:844] Serialized 26 byte log entry
0709 13:02:19.563948 (+ 87865us) spinlock_profiling.cc:243] Waited 6.11 ms on lock 0x7b48001bc258. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b85eb8aa1 00007f1b85eafb37 00007f1b85eaf9ca 00007f1b85fa726f 00007f1b85fa6f37 00007f1b85fbb55c 00007f1b85fbb508 00007f1b85fbb488 00007f1b85fbb443 00007f1b85fba6ec 00007f1b84ee4a96
0709 13:02:20.227733 (+663785us) spinlock_profiling.cc:243] Waited 40.2 ms on lock 0x7b180014b7e0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7de84e07 00007f1b86cdfab9 00007f1b7dea169b 00007f1b7de9f93f 00007f1b7dea1c02 00007f1b80b2920b 00007f1b80b2ed23 00007f1b80b2f0d1 00007f1b80f4aa0f
0709 13:02:20.355678 (+127945us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:20.355717 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.355783 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:20.667202 (+311419us) raft_consensus.cc:1685] finished
0709 13:02:20.667223 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.667356 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5838,"raft.queue_time_us":12175,"raft.run_cpu_time_us":2380,"raft.run_wall_time_us":95570,"spinlock_wait_cycles":106469120,"thread_start_us":127747,"threads_started":1,"wal-append.queue_time_us":1062563}
I20260709 13:02:20.632901  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:20.672930  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:20.675201  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:20.676023  1630 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:20.676291  1660 raft_consensus.cc:2393] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 8: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:20.671515  1664 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
I20260709 13:02:20.678917  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:02:20.709690  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.726378  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:20.727352  1736 raft_consensus.cc:2393] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 9: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
W20260709 13:02:20.730705  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 324208us
I20260709 13:02:20.731689  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:20.732508  2553 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:02:20.733997  1555 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:20.738565  1661 raft_consensus.cc:1275] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:02:20.679606  1556 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:20.742962  1733 raft_consensus.cc:1275] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:02:20.745277  1705 leader_election.cc:336] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.544s (SENT)
I20260709 13:02:20.745791  1705 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:20.746639  1660 raft_consensus.cc:1275] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:02:20.754331  1733 raft_consensus.cc:1240] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:20.658165  5890 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:20.776895  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 97399.2us
I20260709 13:02:20.783457  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:20.784165  1734 raft_consensus.cc:1813] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Handling vote request from an unknown peer 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:20.784652  1734 raft_consensus.cc:2393] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 12: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
W20260709 13:02:20.788082  1705 leader_election.cc:336] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.056s (SENT)
I20260709 13:02:20.788347  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:20.789239  1736 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 9.
I20260709 13:02:20.790161  1705 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:20.787834  5699 raft_consensus.cc:2804] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:20.795194  5699 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.795627  5699 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:20.797206  5701 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:02:20.797622  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.797895  5701 raft_consensus.cc:697] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 18 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:20.798856  5701 consensus_queue.cc:237] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:20.781689  5710 consensus_queue.cc:1048] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:02:20.781893  5639 consensus_queue.cc:1048] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 13:02:20.790228  5890 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:20.740916  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:20.812549  2548 raft_consensus.cc:2393] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 10: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:02:20.781396  5911 raft_consensus.cc:2749] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:20.759761  5885 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.815727  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:20.818399   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:20.762409  5906 raft_consensus.cc:2804] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:02:20.830420  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 94281.6us
I20260709 13:02:20.818418  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:20.838802  1733 raft_consensus.cc:2393] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 12: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:20.834080  1705 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:20.813912  5885 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:20.776717  5930 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:20.841616  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.848075  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:20.848789  1741 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:20.853188  1705 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:20.798848  5886 raft_consensus.cc:2749] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:20.912245  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:20.914753  1736 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 11.
I20260709 13:02:20.919523  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:20.921633  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:20.932061  1590 raft_consensus.cc:2393] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 5: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:20.932157  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:20.933238  1589 raft_consensus.cc:2410] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 13:02:20.933724  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:20.917652  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 60229.5us
I20260709 13:02:20.938431  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:20.940551  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:20.941579  1587 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:20.960713  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:20.961007  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:20.961791  1584 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:02:20.858767  5930 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:20.964320  5930 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:20.966179  5769 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.967129  5769 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:20.970988  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:20.971930  1587 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
W20260709 13:02:20.973783  5962 log.cc:927] Time spent T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:02:20.978510  5955 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.979250  5955 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:20.982388  5955 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:20.960837  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:20.984108  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:20.855031  5906 raft_consensus.cc:697] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 14 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:20.919085  5892 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:20.868258  5952 raft_consensus.cc:2749] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:20.840255  5865 consensus_queue.cc:1048] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.115s
I20260709 13:02:20.918812  5928 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.996253  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:20.918457  5951 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:20.991761  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.006676  1658 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:02:21.005556  1663 raft_consensus.cc:1275] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:02:21.015300  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:20.854321  5709 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:21.016171  1665 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:02:21.018388  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:21.008893  5928 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:21.025388  5885 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:21.061708  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:21.026191  5952 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.076381  1589 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 13.
W20260709 13:02:21.063536  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.068524  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:21.031152  5959 log.cc:927] Time spent T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.234s	user 0.000s	sys 0.002s
I20260709 13:02:21.085059  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:21.086023  1589 raft_consensus.cc:2393] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 12: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:21.085843  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:21.086755  1584 raft_consensus.cc:2410] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:21.088296  1583 raft_consensus.cc:1240] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:02:21.077584  5892 consensus_queue.cc:1059] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:02:21.089435  5952 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:21.090509  5963 log.cc:927] Time spent T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.289s	user 0.001s	sys 0.000s
I20260709 13:02:21.092064  5952 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:21.074463  5946 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.032332  5951 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:21.093261  5710 consensus_queue.cc:1048] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:21.095000  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:21.095093  1741 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 9.
W20260709 13:02:21.082490  5879 consensus_meta.cc:287] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.715s	user 0.013s	sys 0.005s
I20260709 13:02:21.092871  5952 raft_consensus.cc:3055] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:21.109864  5952 raft_consensus.cc:740] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:21.110868  5952 consensus_queue.cc:260] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:21.112905  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:21.113596  1586 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:21.114557  5961 log.cc:927] Time spent T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.320s	user 0.000s	sys 0.002s
I20260709 13:02:21.117807  1587 raft_consensus.cc:1240] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:21.093221  5946 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:21.103682  1583 raft_consensus.cc:2468] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 7.
I20260709 13:02:21.101549  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:21.074393  2548 raft_consensus.cc:1275] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:21.107196  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:21.120054  1584 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 12.
I20260709 13:02:21.121236  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:21.120398  2426 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:21.123929  1588 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:02:21.084884  5769 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:21.129333  5906 consensus_queue.cc:237] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:21.080972  5885 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:21.133231  1586 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
I20260709 13:02:21.131465  5639 raft_consensus.cc:2804] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:21.141929  1591 raft_consensus.cc:1240] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:21.165493  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:21.167840  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 253910us
W20260709 13:02:21.168318  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.170603  1705 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:21.105235  5913 consensus_queue.cc:1048] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
W20260709 13:02:21.179811  1633 connection.cc:256] RPC call timeout handler was delayed by -1.7126759450000009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1501s for a response
W20260709 13:02:21.180387  1633 connection.cc:256] RPC call timeout handler was delayed by -1.7126759450000009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1501s for a response
W20260709 13:02:21.180809  1633 connection.cc:256] RPC call timeout handler was delayed by -1.7081759450000504s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1506s for a response
W20260709 13:02:21.181259  1633 connection.cc:256] RPC call timeout handler was delayed by -1.664075945000036s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1555s for a response
W20260709 13:02:21.181646  1633 connection.cc:256] RPC call timeout handler was delayed by -1.5767759450000085s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1652s for a response
I20260709 13:02:21.182361  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:21.184960  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:21.185820  1591 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:21.188144  1633 connection.cc:256] RPC call timeout handler was delayed by -1.5695759449999969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.166s for a response
W20260709 13:02:21.188661  1633 connection.cc:256] RPC call timeout handler was delayed by -1.5191759450000291s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1716s for a response
W20260709 13:02:21.189038  1633 connection.cc:256] RPC call timeout handler was delayed by -1.4795759450000219s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17600000000000002s for a response
W20260709 13:02:21.189415  1633 connection.cc:256] RPC call timeout handler was delayed by -1.4192759450000381s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
W20260709 13:02:21.189781  1633 connection.cc:256] RPC call timeout handler was delayed by -1.3895759450000469s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18600000000000003s for a response
W20260709 13:02:21.190092  1633 connection.cc:256] RPC call timeout handler was delayed by -1.3580759450000528s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1895s for a response
W20260709 13:02:21.190377  1633 connection.cc:256] RPC call timeout handler was delayed by -1.1087759450000476s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21720000000000003s for a response
W20260709 13:02:21.190750  1633 connection.cc:256] RPC call timeout handler was delayed by -1.101575945000036s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21800000000000003s for a response
I20260709 13:02:21.193662  1556 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:21.191540  1633 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:21.205654  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:21.206777  1586 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:21.159624  5639 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:21.222330  1633 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:21.160830  5687 consensus_queue.cc:1048] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
W20260709 13:02:21.223414  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 52921.6us
I20260709 13:02:21.210947  5584 raft_consensus.cc:2804] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:21.161888  5885 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:21.233651  1705 leader_election.cc:336] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.649s (SENT)
I20260709 13:02:21.213348  5639 raft_consensus.cc:3060] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:21.238884  1705 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:21.212668  5972 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:21.248845  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:21.249495  1586 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 14.
I20260709 13:02:21.249977  1592 raft_consensus.cc:2376] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6. Re-sending same reply.
I20260709 13:02:21.215687  5947 consensus_queue.cc:1048] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:02:21.236251  5584 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.238325  5769 raft_consensus.cc:2749] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:21.228269  5974 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:21.281347  1741 raft_consensus.cc:1275] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:02:21.273609  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:21.279393  1633 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:21.283425  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:21.295146  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:21.278097  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:21.285105  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:21.284027  1663 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:21.298797  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:21.299646  1586 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
I20260709 13:02:21.303082  1633 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:21.283442  1707 leader_election.cc:336] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 2.202s (SENT)
I20260709 13:02:21.263676  5951 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:21.274595  2548 raft_consensus.cc:1275] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:21.271766  5886 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:21.313030  5890 consensus_meta.cc:287] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.502s	user 0.011s	sys 0.000s
I20260709 13:02:21.294466  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:21.341209  5890 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:21.277267  5584 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:21.322530  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:21.266314  5978 raft_consensus.cc:2749] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:02:21.329571  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.333932  5769 raft_consensus.cc:2804] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:21.336416  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:21.316426  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:21.401099  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:21.401535  1590 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:21.401862  1740 raft_consensus.cc:1275] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:21.402693  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:21.376528  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:21.402982  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:21.403636  1741 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:21.378577  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 75597.8us
I20260709 13:02:21.404270  1738 raft_consensus.cc:2393] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 in current term 11: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
W20260709 13:02:21.378829  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 52583.9us
I20260709 13:02:21.317342  5906 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:21.374675  5972 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.395546  1734 raft_consensus.cc:1240] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:02:21.396123  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:21.323844  5980 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:21.374432  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.401538  1658 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 9.
I20260709 13:02:21.403574  1592 raft_consensus.cc:2376] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11. Re-sending same reply.
I20260709 13:02:21.344529  1589 raft_consensus.cc:1217] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 5.7->[7.8-7.8]   Dedup: 7.8->[]
W20260709 13:02:21.380450  5977 log.cc:927] Time spent T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.098s	user 0.004s	sys 0.000s
I20260709 13:02:21.477372  1589 raft_consensus.cc:1240] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:02:21.477327  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:21.394464  1586 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:21.478868  1734 raft_consensus.cc:2410] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 13:02:21.377609  5941 consensus_meta.cc:287] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.718s	user 0.011s	sys 0.003s
I20260709 13:02:21.478948  1735 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
I20260709 13:02:21.414835  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:02:21.464080  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:21.393639  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 51047.4us
I20260709 13:02:21.376617  5709 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:21.479827  1633 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:21.406713  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:21.486034  1732 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:02:21.374894  5899 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:21.480516  1740 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:21.345794  5886 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:21.478708  5979 log.cc:927] Time spent T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
W20260709 13:02:21.404932  5699 consensus_meta.cc:287] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.609s	user 0.009s	sys 0.014s
I20260709 13:02:21.375425  5913 consensus_queue.cc:1048] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.106s
I20260709 13:02:21.402523  5879 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:21.407817  5769 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:21.497345  1633 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:21.478276  5940 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.506126  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:21.507479  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:21.507179  1732 raft_consensus.cc:1275] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:02:21.508147  1592 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:02:21.508846  1741 raft_consensus.cc:2410] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:21.494132  5899 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:21.485334  5972 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:21.511772  5975 raft_consensus.cc:2804] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:21.512218  5975 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:21.512300  1633 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:21.512662  5975 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:21.513520  1633 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:21.517242  5973 raft_consensus.cc:2749] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:21.517971  5973 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:21.505759  5879 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:21.501019  5906 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:21.526307  5940 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:21.528467  5940 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:21.531977  5974 raft_consensus.cc:2749] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:21.532593  5885 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:21.537259  1736 raft_consensus.cc:3060] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:21.505589  5769 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:21.540112  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:21.540691  5890 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:21.562569  1736 raft_consensus.cc:2468] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
I20260709 13:02:21.549134  1663 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:02:21.550661  1558 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:21.551282  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:21.551538  1740 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 18.
I20260709 13:02:21.621477  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:21.621634  1732 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:21.622128  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:21.622460  2424 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:21.622737  1740 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:02:21.623540  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:21.624341  1740 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:02:21.551501  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:21.625368  1741 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:02:21.485963  5941 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:21.498382  5699 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:21.483574  5980 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:21.623575  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 72987.9us
W20260709 13:02:21.549113  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 47391.7us
I20260709 13:02:21.629948  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:21.635203  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:21.636852  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 123407us
I20260709 13:02:21.637831  1633 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:21.645383  1558 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:21.649155  1583 raft_consensus.cc:2368] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 9. Current term is 10.
I20260709 13:02:21.654493  1741 raft_consensus.cc:1275] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:21.626472  5687 raft_consensus.cc:2749] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:21.625300  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:21.656980  1588 raft_consensus.cc:1240] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:21.655644  1592 raft_consensus.cc:2393] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 12: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:21.556880  5709 consensus_queue.cc:1048] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 13:02:21.662304  1741 raft_consensus.cc:1275] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:02:21.663677  1741 raft_consensus.cc:1275] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:02:21.661194  1591 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
I20260709 13:02:21.667691  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:21.641321  5974 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:21.644114  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:21.682979  1587 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
W20260709 13:02:21.683619  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 45910.2us
I20260709 13:02:21.668318  1591 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:21.692356  1633 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:21.685101  5927 raft_consensus.cc:2749] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:21.693840  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:21.694502  1591 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:21.695248  1633 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:21.712996  1633 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:21.663633  5916 raft_consensus.cc:2804] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:02:21.729530  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.670264  2540 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:21.741740  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.657657  5785 consensus_queue.cc:1048] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
W20260709 13:02:21.738766  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 60138.6us
I20260709 13:02:21.694646  5973 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:21.746438  2550 raft_consensus.cc:1275] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:02:21.730819  1633 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:21.749645  5974 raft_consensus.cc:2749] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:21.741014  5916 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.755240  1591 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 9.
W20260709 13:02:21.756356  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 111253us
I20260709 13:02:21.791647  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:21.792428  1558 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:21.793246  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:21.786746  1732 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:02:21.803721  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:21.806445  1558 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:21.750699  5999 raft_consensus.cc:2749] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:21.771950  5989 log.cc:927] Time spent T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:02:21.766115  5639 consensus_meta.cc:287] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent flushing consensus metadata: real 0.511s	user 0.009s	sys 0.000s
I20260709 13:02:21.815006  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:21.825675  1591 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12.
W20260709 13:02:21.795514  5983 log.cc:927] Time spent T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.384s	user 0.001s	sys 0.001s
W20260709 13:02:21.759877  5990 log.cc:927] Time spent T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 13:02:21.826642  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:21.827006  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 96276.3us
I20260709 13:02:21.828017  6000 raft_consensus.cc:2764] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:02:21.766017  5699 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:21.794342  5916 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:21.833264  5992 raft_consensus.cc:2804] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:21.812812  5785 raft_consensus.cc:2804] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:21.834091  5639 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:21.753563  5973 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:21.842136  5996 consensus_queue.cc:1048] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:21.775420  5952 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:21.978513  5584 consensus_meta.cc:287] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.571s	user 0.005s	sys 0.005s
I20260709 13:02:22.019364  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:22.019512  5584 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:22.020306  2543 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:21.876353  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:22.023218  1705 leader_election.cc:336] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.088s (SENT)
I20260709 13:02:21.987386  1586 raft_consensus.cc:1240] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:02:21.908072  1584 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:02:21.871796  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:22.024670  1584 raft_consensus.cc:606] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:22.015403  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:22.025279  1584 raft_consensus.cc:614] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:22.020545  1592 raft_consensus.cc:1240] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:02:21.900718  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:22.026671  1633 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:22.028339  1589 raft_consensus.cc:1275] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:22.029533  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:22.029860  2426 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:22.030229  2515 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:21.997573  1617 heartbeater.cc:646] Failed to heartbeat to 127.0.107.254:37303 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.254:37303 timed out after 15.000s (SENT)
I20260709 13:02:21.971570  5914 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.034372  5914 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:21.865236  5941 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:21.994726  5777 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.032327  5639 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 8 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:21.959514  1707 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:22.023752  1705 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:22.042274  1665 raft_consensus.cc:1275] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:02:21.855888  5967 log.cc:927] Time spent T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.796s	user 0.004s	sys 0.000s
W20260709 13:02:21.876907  5994 log.cc:927] Time spent T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:02:22.054515  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 95128.1us
I20260709 13:02:21.923822  5951 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.007107  5713 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.056569  5911 raft_consensus.cc:2749] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:21.863070  5964 log.cc:927] Time spent T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 1.049s	user 0.003s	sys 0.000s
I20260709 13:02:21.895790  5980 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:22.065056  1707 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:21.973357  5946 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
W20260709 13:02:22.062556  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 440149us
I20260709 13:02:21.970208  2540 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
I20260709 13:02:22.059425  1587 raft_consensus.cc:1240] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:22.054363  5973 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:21.864352  5886 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:21.878074  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:21.954438  5930 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:21.879237  5899 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:22.115271  5999 raft_consensus.cc:2804] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:02:22.061956  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 255576us
I20260709 13:02:21.869341  5972 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:21.873064  5879 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:21.874833  5928 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:22.093729  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 67167.8us
I20260709 13:02:22.110100  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:22.112200  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 47219.7us
I20260709 13:02:22.018738  5785 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.848963  5906 raft_consensus.cc:2749] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:22.053520  5777 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:22.058115  5992 raft_consensus.cc:697] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 8 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:22.189060  5992 consensus_queue.cc:237] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:22.152343  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:22.157326  5919 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:22.158095  1704 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:22.058108  5892 raft_consensus.cc:2749] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:22.117401  5885 raft_consensus.cc:2804] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:22.117933  1556 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:22.156373  5713 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:21.872785  5975 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:22.006699  5738 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:22.182794  1707 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:22.092098  5951 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:22.120862  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:22.069413  5769 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:22.201561  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.212746  1707 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:22.175889  5973 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:22.215519  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 97677.6us
I20260709 13:02:22.184811  5785 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:22.117904  5574 consensus_queue.cc:1048] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.095s
I20260709 13:02:22.176759  5999 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:22.208812  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 452745us
I20260709 13:02:22.222479  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:22.226227  1584 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 10.
I20260709 13:02:22.209432  5972 raft_consensus.cc:2804] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:22.231700  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:22.234129  2540 raft_consensus.cc:1240] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:22.234341  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:22.199065  5947 consensus_queue.cc:1048] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:02:22.240733  1592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46836 (request call id 494) took 1076 ms. Trace:
W20260709 13:02:22.244181  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 47343.2us
I20260709 13:02:22.209760  5584 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:22.249197  1667 raft_consensus.cc:1240] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:22.176522  5930 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:22.280635  1633 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
W20260709 13:02:22.236302  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 180666us
I20260709 13:02:22.265034  1585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46836 (request call id 485) took 1852 ms. Trace:
W20260709 13:02:22.282337  1705 leader_election.cc:336] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.202s (SENT)
I20260709 13:02:22.283231  1705 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:22.282141  1585 rpcz_store.cc:276] 0709 13:02:20.399431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.400584 (+  1153us) service_pool.cc:224] Handling call
0709 13:02:20.400933 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:20.468400 (+ 67467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.468453 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:20.478787 (+ 10334us) log.cc:844] Serialized 26 byte log entry
0709 13:02:20.751762 (+272975us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:20.752368 (+   606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.753050 (+   682us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:21.855036 (+1101986us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b4400022b4c. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7ddc8c85 00007f1b7ddc96a2 00007f1b80b3b1db 00007f1b80b36aaf 00007f1b80b2a86e 00007f1b80b29bb6 00007f1b80b297d8 00007f1b80b33221 00007f1b80b331d9 00007f1b80b33169
0709 13:02:22.224683 (+369647us) raft_consensus.cc:1685] finished
0709 13:02:22.224717 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:22.251197 (+ 26480us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46724,"raft.queue_time_us":60073,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":39029,"spinlock_wait_cycles":29905664,"thread_start_us":67652,"threads_started":1,"wal-append.queue_time_us":359200}
I20260709 13:02:22.228502  5999 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:22.266865  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 54194.3us
I20260709 13:02:22.290346  1707 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:22.271996  2543 raft_consensus.cc:2468] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:02:22.298941  1633 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:22.223639  5892 raft_consensus.cc:2804] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:22.222332  5699 raft_consensus.cc:2804] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:22.301139  1663 raft_consensus.cc:1275] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:02:22.306160  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.307848  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:22.275205  5947 consensus_queue.cc:1243] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer 5ced62816f8545cd9b63a27e9055e42d log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:02:22.308627  1734 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 12.
I20260709 13:02:22.221112  5738 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:22.319134  1732 raft_consensus.cc:1275] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:22.318984  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:22.369004  1587 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 6.
I20260709 13:02:22.270490  5885 raft_consensus.cc:697] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:22.343658  1555 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:22.288622  5972 raft_consensus.cc:697] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 11 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:22.346256  5713 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:22.261636  5928 consensus_queue.cc:1048] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:02:22.227487  5973 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:22.305792  5960 raft_consensus.cc:2804] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:22.301393  5892 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.270161  5941 consensus_queue.cc:1048] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:02:22.316113  5879 raft_consensus.cc:2804] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:02:22.396941  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 54040.4us
I20260709 13:02:22.326395  5699 raft_consensus.cc:697] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:22.406767  5699 consensus_queue.cc:237] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:22.357180  5985 log.cc:927] Time spent T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:02:22.356992  5886 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:22.366776  5980 raft_consensus.cc:2804] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:22.410176  5980 raft_consensus.cc:697] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 11 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:22.411055  5980 consensus_queue.cc:237] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:22.411288  5899 consensus_queue.cc:1059] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:22.388684  5574 raft_consensus.cc:2804] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:22.303306  6000 consensus_queue.cc:1059] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:02:22.394850  5914 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:22.401153  5892 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:22.424525  1586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2161) took 1281 ms. Trace:
I20260709 13:02:22.399415  5960 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:22.426007  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 127190us
I20260709 13:02:22.413359  5899 raft_consensus.cc:3055] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:22.425031  1586 rpcz_store.cc:276] 0709 13:02:21.144002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.024430 (+880428us) service_pool.cc:224] Handling call
0709 13:02:22.024752 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:22.055266 (+ 30514us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:22.055295 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:22.055739 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:02:22.239635 (+183896us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:22.390487 (+150852us) log.cc:844] Serialized 14 byte log entry
0709 13:02:22.396937 (+  6450us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.397020 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:22.424314 (+ 27294us) raft_consensus.cc:1685] finished
0709 13:02:22.424336 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:22.424465 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12918,"raft.queue_time_us":15212,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":6258,"spinlock_wait_cycles":18688,"thread_start_us":333929,"threads_started":2,"wal-append.queue_time_us":299693}
I20260709 13:02:22.401332  6021 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:22.414268  5879 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:22.439949  5886 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.437466  6000 raft_consensus.cc:3055] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:22.441728  1633 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:22.268952  1592 rpcz_store.cc:276] 0709 13:02:21.164031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.031998 (+867967us) service_pool.cc:224] Handling call
0709 13:02:22.032291 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:22.227155 (+194864us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:22.227189 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:22.227236 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:22.227264 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.240427 (+ 13163us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b54003b42d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:22.240491 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:22.240659 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12774,"raft.queue_time_us":32026,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":3462,"spinlock_wait_cycles":417919360}
I20260709 13:02:22.424532  5574 raft_consensus.cc:697] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:22.473892  5574 consensus_queue.cc:237] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:22.476239  5951 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:22.477842  5738 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:22.478507  5885 consensus_queue.cc:237] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:22.420298  6006 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:22.441355  5960 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:22.485159  1633 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
W20260709 13:02:22.483976  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 256218us
W20260709 13:02:22.486873  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 224269us
I20260709 13:02:22.440415  5899 raft_consensus.cc:740] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:22.470803  5879 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:22.499575  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:22.468135  6021 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:22.472005  6000 raft_consensus.cc:740] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:22.516736  1588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2158) took 1374 ms. Trace:
I20260709 13:02:22.514765  2424 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:02:22.500988  6001 log.cc:927] Time spent T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.296s	user 0.001s	sys 0.000s
I20260709 13:02:22.532035  1558 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:22.492159  5992 raft_consensus.cc:2764] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:02:22.507341  5973 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:22.522055  6016 log.cc:927] Time spent T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:02:22.517217  1588 rpcz_store.cc:276] 0709 13:02:21.142572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.006135 (+863563us) service_pool.cc:224] Handling call
0709 13:02:22.045073 (+ 38938us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:22.045357 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:22.347797 (+302440us) log.cc:844] Serialized 14 byte log entry
0709 13:02:22.516394 (+168597us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:22.516446 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:22.516494 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.516561 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:22.516676 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18988,"prepare.queue_time_us":394693,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"raft.queue_time_us":2175,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":122,"thread_start_us":446247,"threads_started":2}
I20260709 13:02:22.512308  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:22.484160  5886 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:22.549912  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
W20260709 13:02:22.554580  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 335024us
W20260709 13:02:22.519207  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 221048us
I20260709 13:02:22.568012  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:22.568881  1588 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 8.
I20260709 13:02:22.579523  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:22.580565  1738 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 7.
I20260709 13:02:22.514159  6021 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:22.591420  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 106342us
I20260709 13:02:22.605825  5886 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:22.606627  5974 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:02:22.546352  5916 consensus_meta.cc:287] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent flushing consensus metadata: real 0.511s	user 0.012s	sys 0.000s
W20260709 13:02:22.597703  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 49576.6us
I20260709 13:02:22.540141  5914 raft_consensus.cc:2749] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:22.610889  2426 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:22.617368  5999 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:22.530555  2515 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:02:22.634992  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:22.593063  1633 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:22.637403  1741 pending_rounds.cc:85] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 8
I20260709 13:02:22.671339  1741 pending_rounds.cc:107] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:02:22.671622  1741 raft_consensus.cc:2889] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:22.635375  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:22.672350  1734 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:22.551115  5769 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:22.675884  1590 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.005s	sys 0.024s
W20260709 13:02:22.676285  1590 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.005s	sys 0.024s
I20260709 13:02:22.661299  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:22.677440  1733 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
W20260709 13:02:22.661581  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 50807.1us
I20260709 13:02:22.549558  5948 raft_consensus.cc:2804] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:22.500653  5972 consensus_queue.cc:237] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:22.669550  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:02:22.636142  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 76359.1us
I20260709 13:02:22.623103  5974 raft_consensus.cc:697] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 9 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:22.589366  6003 consensus_queue.cc:1048] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 13:02:22.708340  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:22.708864  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:22.708683  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:22.717553  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:22.672799  6006 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:22.732867  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.744426  1734 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
W20260709 13:02:22.745199  1583 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.016s	sys 0.040s
W20260709 13:02:22.760486  1583 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.017s	sys 0.040s
I20260709 13:02:22.747210  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:22.746865  1739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3396) took 1351 ms. Trace:
I20260709 13:02:22.761955  1739 rpcz_store.cc:276] 0709 13:02:21.395530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.395682 (+   152us) service_pool.cc:224] Handling call
0709 13:02:21.395976 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:21.657379 (+261403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:21.657413 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:21.662153 (+  4740us) log.cc:844] Serialized 26 byte log entry
0709 13:02:21.788384 (+126231us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:22.237038 (+448654us) log.cc:844] Serialized 14 byte log entry
0709 13:02:22.279771 (+ 42733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.352909 (+ 73138us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b4800120858. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b85eb8aa1 00007f1b85eafb37 00007f1b85eaf9ca 00007f1b85fa726f 00007f1b85fa6f37 00007f1b85fbb55c 00007f1b85fbb508 00007f1b85fbb488 00007f1b85fbb443 00007f1b85fba6ec 00007f1b84ee4a96
0709 13:02:22.377563 (+ 24654us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b54000e6854. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:22.377615 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:22.746575 (+368960us) raft_consensus.cc:1685] finished
0709 13:02:22.746605 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:22.746785 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30427,"prepare.queue_time_us":187768,"prepare.run_cpu_time_us":161,"prepare.run_wall_time_us":159,"raft.queue_time_us":68510,"raft.run_cpu_time_us":2326,"raft.run_wall_time_us":56851,"spinlock_wait_cycles":626632704,"thread_start_us":507842,"threads_started":2,"wal-append.queue_time_us":420613}
W20260709 13:02:22.755121  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 162110us
W20260709 13:02:22.753206  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 47217.7us
I20260709 13:02:22.746464  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:22.596870  5899 consensus_queue.cc:260] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:22.637739  5916 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:22.761277  1583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2155) took 1619 ms. Trace:
I20260709 13:02:22.770920  1583 rpcz_store.cc:276] 0709 13:02:21.141566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.002472 (+860906us) service_pool.cc:224] Handling call
0709 13:02:22.002804 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:22.003033 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:22.214687 (+211654us) log.cc:844] Serialized 14 byte log entry
0709 13:02:22.760904 (+546217us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:22.760965 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:22.761015 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.761111 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:22.761219 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":415187,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":43,"raft.queue_time_us":6467,"thread_start_us":757126,"threads_started":2}
I20260709 13:02:22.737704  5769 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:22.706043  6028 raft_consensus.cc:2804] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:22.748337  5701 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:22.633775  6000 consensus_queue.cc:260] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:22.885116  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 63407.4us
W20260709 13:02:22.861001  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 95557.5us
I20260709 13:02:22.767078  5948 raft_consensus.cc:697] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:02:22.867242  1705 leader_election.cc:336] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.583s (SENT)
I20260709 13:02:22.760202  6029 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:22.925491  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 58333.7us
I20260709 13:02:22.925801  1633 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:02:22.926126  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:22.914562  5952 consensus_meta.cc:287] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.882s	user 0.008s	sys 0.004s
I20260709 13:02:22.866483  6028 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:22.930946  5769 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:22.917698  5930 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:22.908838  5951 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:22.972664  6030 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.895480  5980 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:22.909255  6006 consensus_queue.cc:1059] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 13:02:22.971762  6054 consensus_queue.cc:1048] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:02:22.933579  6029 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:23.008319  5699 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:22.941522  6001 log.cc:927] Time spent T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:02:22.919932  5701 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:22.993690  6000 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:23.020361  6028 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:23.013298  5996 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:23.006244  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 80503.1us
I20260709 13:02:23.047595  1633 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:23.031062  5999 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:23.012372  5952 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:23.039346  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 114522us
I20260709 13:02:22.922487  5974 consensus_queue.cc:237] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:23.012951  5885 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:23.065218  6022 log.cc:927] Time spent T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.333s	user 0.001s	sys 0.000s
I20260709 13:02:23.065338  5885 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:23.067003  1591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46836 (request call id 495) took 1747 ms. Trace:
W20260709 13:02:23.067703  6036 log.cc:927] Time spent T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.191s	user 0.000s	sys 0.000s
I20260709 13:02:23.067797  5885 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:23.068917  6042 log.cc:927] Time spent T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:02:23.070192  1590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2159) took 1927 ms. Trace:
I20260709 13:02:23.067386  1591 rpcz_store.cc:276] 0709 13:02:21.319334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.037334 (+718000us) service_pool.cc:224] Handling call
0709 13:02:22.038096 (+   762us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:22.065309 (+ 27213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:22.065362 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:22.182080 (+116718us) log.cc:844] Serialized 26 byte log entry
0709 13:02:22.389276 (+207196us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:22.389357 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.389478 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:23.066775 (+677297us) raft_consensus.cc:1685] finished
0709 13:02:23.066807 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:23.066941 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18173,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":112,"spinlock_wait_cycles":1792,"thread_start_us":156194,"threads_started":1,"wal-append.queue_time_us":341486}
I20260709 13:02:23.070538  1590 rpcz_store.cc:276] 0709 13:02:21.142904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.007458 (+864554us) service_pool.cc:224] Handling call
0709 13:02:22.007907 (+   449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:22.008197 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:22.008235 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:22.022223 (+ 13988us) log.cc:844] Serialized 26 byte log entry
0709 13:02:22.676629 (+654406us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:22.676690 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.676784 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:23.069992 (+393208us) raft_consensus.cc:1685] finished
0709 13:02:23.070014 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:23.070134 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":653966,"threads_started":1,"wal-append.queue_time_us":856513}
I20260709 13:02:23.072587  5992 raft_consensus.cc:2764] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 13:02:23.075409  6023 log.cc:927] Time spent T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.368s	user 0.001s	sys 0.000s
I20260709 13:02:23.076892  1735 raft_consensus.cc:1275] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:02:23.079244  5995 log.cc:927] Time spent T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.794s	user 0.000s	sys 0.002s
I20260709 13:02:23.080304  5952 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:23.082324  5879 consensus_meta.cc:287] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.564s	user 0.006s	sys 0.006s
I20260709 13:02:23.099951  5879 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:23.054188  2426 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:23.041857  6006 raft_consensus.cc:3055] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:23.029277  5769 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:22.973487  5948 consensus_queue.cc:237] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:23.041549  5699 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:23.057403  6032 log.cc:927] Time spent T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:02:23.060631  1739 raft_consensus.cc:1275] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:23.029714  5951 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:23.137840  5951 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:23.082921  5952 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:23.083377  6027 log.cc:927] Time spent T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.285s	user 0.000s	sys 0.001s
I20260709 13:02:23.049914  1633 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:02:23.139564  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 89740.3us
I20260709 13:02:23.032644  6030 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:23.141412  1633 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:23.086310  1740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3409) took 1592 ms. Trace:
W20260709 13:02:23.120896  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.127367  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:02:23.108599  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 54564.5us
I20260709 13:02:23.144524  1658 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:02:23.032914  5980 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:23.132375  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 432459us
I20260709 13:02:23.142272  1740 rpcz_store.cc:276] 0709 13:02:21.493788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.624946 (+131158us) service_pool.cc:224] Handling call
0709 13:02:21.633261 (+  8315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:21.633723 (+   462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:21.633762 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:21.640971 (+  7209us) log.cc:844] Serialized 26 byte log entry
0709 13:02:21.770052 (+129081us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b4800120858. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b85eb8aa1 00007f1b85eafb37 00007f1b85eaf9ca 00007f1b85fa726f 00007f1b85fa6f37 00007f1b85fbb55c 00007f1b85fbb508 00007f1b85fbb488 00007f1b85fbb443 00007f1b85fba6ec 00007f1b84ee4a96
0709 13:02:21.816216 (+ 46164us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:22.202204 (+385988us) log.cc:844] Serialized 14 byte log entry
0709 13:02:22.202563 (+   359us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.202674 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:22.239285 (+ 36611us) spinlock_profiling.cc:243] Waited 4.5 ms on lock 0x7b1800424d80. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7de1cc0a 00007f1b8755c219 00007f1b84e6358f 00007f1b7dea2571 00007f1b7dea47c1 00007f1b7dea4779 00007f1b7dea4709 00007f1b7dea46d1 00007f1b7dea39cd
0709 13:02:23.078527 (+839242us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b4400022b4c. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7ddc8c85 00007f1b7ddc96a2 00007f1b80b3b1db 00007f1b80b36aaf 00007f1b80b2a86e 00007f1b80b29bb6 00007f1b80b297d8 00007f1b80b33221 00007f1b80b331d9 00007f1b80b33169
0709 13:02:23.086040 (+  7513us) raft_consensus.cc:1685] finished
0709 13:02:23.086071 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:23.086221 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27127,"prepare.queue_time_us":160332,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":3683,"raft.run_cpu_time_us":1669,"raft.run_wall_time_us":140950,"spinlock_wait_cycles":46511744,"thread_start_us":503894,"threads_started":2,"wal-append.queue_time_us":557284}
W20260709 13:02:23.132659  5785 consensus_meta.cc:287] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.885s	user 0.015s	sys 0.001s
I20260709 13:02:23.126144  5821 raft_consensus.cc:2804] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:23.114589  6006 raft_consensus.cc:740] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:23.153575  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:23.156144  2426 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:23.157661  1732 raft_consensus.cc:1275] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:23.158468  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:23.141449  5916 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:02:23.160014  1705 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:23.150478  5992 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:02:23.160557  5892 consensus_meta.cc:287] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.693s	user 0.012s	sys 0.001s
I20260709 13:02:23.156383  5952 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.156795  5821 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:23.160840  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.164168  1739 raft_consensus.cc:1240] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:23.169446  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:23.169521  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:02:23.182461  6047 log.cc:927] Time spent T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:02:23.162212  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:23.186312  1658 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 11.
I20260709 13:02:23.212249  1740 raft_consensus.cc:2468] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 5.
I20260709 13:02:23.210136  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:23.186678  2548 raft_consensus.cc:1240] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:02:23.215588  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:23.201836  5821 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:23.210071  5879 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:23.181742  5885 raft_consensus.cc:2804] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:23.162737  5999 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:23.179265  6059 raft_consensus.cc:2804] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:23.160679  5785 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:23.223954  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:23.169414  5951 consensus_queue.cc:1059] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:02:23.229126  1735 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:02:23.190927  5892 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:23.200987  5952 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:23.202929  6056 consensus_queue.cc:1048] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:02:23.266767  1667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3423) took 1260 ms. Trace:
I20260709 13:02:23.224790  6030 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:23.237257  6060 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:23.237715  6009 log.cc:927] Time spent T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.873s	user 0.000s	sys 0.005s
I20260709 13:02:23.182631  6006 consensus_queue.cc:260] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:23.228647  6059 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:23.250204  6049 log.cc:927] Time spent T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:02:23.219960  6029 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:23.252846  5960 consensus_meta.cc:287] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.752s	user 0.010s	sys 0.005s
I20260709 13:02:23.254235  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:23.252638  5785 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:23.222344  5885 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.267372  1667 rpcz_store.cc:276] 0709 13:02:22.005925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.006052 (+   127us) service_pool.cc:224] Handling call
0709 13:02:22.029354 (+ 23302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:22.273458 (+244104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.266450 (+992992us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b540044d754. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:23.266680 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":504968576}
W20260709 13:02:23.230856  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 74795.3us
I20260709 13:02:23.245038  6000 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:23.284359  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:23.275939  5769 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:23.262127  5701 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:23.299431  1732 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:23.292589  5992 raft_consensus.cc:697] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:23.284873  6030 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:23.290633  1735 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:02:23.304911  2424 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:23.311321  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:23.289390  6059 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:23.299626  5885 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:23.298727  6029 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:23.327571  1555 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:23.307646  5699 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:23.329559  1734 raft_consensus.cc:1240] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 11 LEADER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:23.334436  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:23.334715  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:23.335630  1666 raft_consensus.cc:2410] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:02:23.335803  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:23.336372  1663 raft_consensus.cc:2468] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 5.
I20260709 13:02:23.337153  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:23.337332  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:23.337458  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:23.338135  1658 raft_consensus.cc:2393] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 7: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:23.338559  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:23.339016  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:23.339428  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:23.340425  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:23.294922  5960 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:23.319999  5980 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:23.306449  6000 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:23.367013  6067 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.368451  6065 raft_consensus.cc:2804] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:23.371693  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:23.305349  6060 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:23.345530  5574 consensus_queue.cc:1059] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:02:23.348054  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:23.381870  1732 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:02:23.332563  5701 raft_consensus.cc:2804] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:23.318444  6030 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:23.377264  6021 consensus_meta.cc:287] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.717s	user 0.014s	sys 0.000s
I20260709 13:02:23.392807  1661 raft_consensus.cc:2410] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:02:23.346015  5972 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.401615  1732 raft_consensus.cc:1240] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:23.346572  5992 consensus_queue.cc:237] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:23.406406  6030 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:23.407021  5701 raft_consensus.cc:697] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:23.328675  6029 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:23.409864  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:23.410377  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:23.387266  6067 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:23.417701  5952 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:23.389964  5951 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.418563  5951 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:23.419363  6067 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:23.411243  1705 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:23.423549  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:23.410596  1660 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12.
I20260709 13:02:23.424430  1740 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 5.
I20260709 13:02:23.404520  1732 raft_consensus.cc:1275] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:23.433548  5992 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.434442  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:23.434269  5992 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:23.435689  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:23.409970  6056 raft_consensus.cc:3055] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:23.442263  5992 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:23.443329  5996 raft_consensus.cc:2749] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:23.445143  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:23.408155  5972 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:23.450470  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:23.450736  5960 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:23.464320  1660 raft_consensus.cc:2393] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 10: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:23.450942  6060 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:23.428505  5952 raft_consensus.cc:2804] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:23.470149  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:23.470865  1732 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:23.474052  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:23.408536  6021 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:23.474861  1740 raft_consensus.cc:2393] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 12: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:23.483108  1589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46836 (request call id 493) took 2320 ms. Trace:
I20260709 13:02:23.485956  5899 raft_consensus.cc:3060] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:23.488845  1558 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:02:23.489554  1707 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.174s	user 0.015s	sys 0.015s
W20260709 13:02:23.489897  1707 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.175s	user 0.015s	sys 0.015s
W20260709 13:02:23.490376  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 1.20001e+06us
I20260709 13:02:23.491016  5699 raft_consensus.cc:2804] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:23.491699  5699 raft_consensus.cc:697] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:02:23.498672  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.456239  5892 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:23.483639  1589 rpcz_store.cc:276] 0709 13:02:21.163158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.029019 (+865861us) service_pool.cc:224] Handling call
0709 13:02:22.038115 (+  9096us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:22.316572 (+278457us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:22.593706 (+277134us) log.cc:844] Serialized 14 byte log entry
0709 13:02:22.813359 (+219653us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:22.813426 (+    67us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:22.813488 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.482823 (+669335us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b5400431554. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:23.482892 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:23.483032 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82939,"prepare.queue_time_us":137253,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":58552,"raft.run_cpu_time_us":370,"raft.run_wall_time_us":54452,"spinlock_wait_cycles":639668224,"thread_start_us":440497,"threads_started":2,"wal-append.queue_time_us":540108}
I20260709 13:02:23.445708  6056 raft_consensus.cc:740] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:02:23.507993  1707 connection.cc:256] RPC call timeout handler was delayed by -1.5416285000000016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22240000000000004s for a response
W20260709 13:02:23.529956  1707 connection.cc:256] RPC call timeout handler was delayed by -1.2260429869999712s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21860000000000002s for a response
W20260709 13:02:23.530459  1707 connection.cc:256] RPC call timeout handler was delayed by -1.1221075469999846s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21930000000000002s for a response
I20260709 13:02:23.531416  1707 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:23.471966  5952 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:23.542075  1732 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:02:23.532898  1707 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:23.535507  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:23.546809  1660 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 13.
I20260709 13:02:23.549227  1558 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:23.528719  5996 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:23.557281  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 239233us
I20260709 13:02:23.526435  5980 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:23.579133  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 46329.8us
I20260709 13:02:23.579417  6085 raft_consensus.cc:2804] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:23.582487  1707 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:23.586310  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:23.549116  5952 raft_consensus.cc:3060] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:23.545889  5973 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:23.492801  5699 consensus_queue.cc:237] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:23.605937  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:23.606724  1589 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:23.609510  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 223857us
I20260709 13:02:23.605940  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:23.475988  5701 consensus_queue.cc:237] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:23.584530  6085 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:23.551182  5948 consensus_queue.cc:1048] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:02:23.551127  5960 consensus_queue.cc:1048] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:02:23.606148  6065 raft_consensus.cc:697] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:23.590910  5998 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:23.640326  1589 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 11.
I20260709 13:02:23.653695  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:23.580331  5996 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:23.661348  1660 raft_consensus.cc:2393] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 7: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:23.590835  5980 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:23.625294  5992 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:23.601760  5973 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:23.634531  5998 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.624572  6085 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:23.641135  6000 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:23.678824  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 68052.2us
I20260709 13:02:23.679378  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:23.636829  5886 raft_consensus.cc:2749] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:23.702039  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:23.702821  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 277322us
I20260709 13:02:23.705142  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:23.706179  1740 raft_consensus.cc:2393] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 13: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:23.695983  5885 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:23.667075  6067 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:23.669970  6029 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:23.717382  6021 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:23.718354  5972 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:23.727918  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.632699  6059 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:23.730396  1555 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:23.697880  5998 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:23.590679  6056 consensus_queue.cc:260] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:23.728917  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:23.749285  1740 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 8.
I20260709 13:02:23.721530  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:23.732782  2550 raft_consensus.cc:1240] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:23.751266  5885 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:23.734377  1733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3429) took 1063 ms. Trace:
W20260709 13:02:23.722761  6079 log.cc:927] Time spent T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:02:23.694476  5992 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:23.782068  1705 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:23.784233  1705 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:23.785691  1705 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:23.786654  1705 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:23.787160  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 56843.6us
W20260709 13:02:23.788652  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.751983  1733 rpcz_store.cc:276] 0709 13:02:22.670891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.712348 (+ 41457us) service_pool.cc:224] Handling call
0709 13:02:22.735981 (+ 23633us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:22.739907 (+  3926us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:22.739937 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:22.740386 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 13:02:23.423509 (+683123us) spinlock_profiling.cc:243] Waited 4.16 ms on lock 0x7b1800424e40. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7de84e07 00007f1b86cdfab9 00007f1b7dea169b 00007f1b7de9f93f 00007f1b7dea1c02 00007f1b80b2920b 00007f1b80b2ed23 00007f1b80b2f0d1 00007f1b80f4aa0f
0709 13:02:23.552936 (+129427us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:23.616988 (+ 64052us) log.cc:844] Serialized 14 byte log entry
0709 13:02:23.617308 (+   320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.617379 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:23.723874 (+106495us) raft_consensus.cc:1685] finished
0709 13:02:23.734015 (+ 10141us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:23.734300 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6110,"prepare.queue_time_us":37034,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":3764,"raft.queue_time_us":111009,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":16671,"spinlock_wait_cycles":9577344,"thread_start_us":162702,"threads_started":2,"wal-append.queue_time_us":867778}
I20260709 13:02:23.798250  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:23.798758  1633 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:23.798897  1732 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 13.
I20260709 13:02:23.770520  6029 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:23.785485  6056 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:23.728277  6067 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:23.782332  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:23.794894  5921 raft_consensus.cc:2749] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:23.731498  6065 consensus_queue.cc:237] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:23.792456  5886 raft_consensus.cc:2804] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:23.795177  2548 raft_consensus.cc:1240] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:23.768529  6021 consensus_queue.cc:1059] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:02:23.799454  5885 raft_consensus.cc:2749] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:23.797887  6068 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:23.848563  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 266192us
I20260709 13:02:23.827364  5974 raft_consensus.cc:2804] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:23.807950  5972 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:23.852366  1707 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:23.858798  1707 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:23.829231  5769 consensus_queue.cc:1059] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:02:23.860737  1707 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:23.851959  5974 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:23.835636  6029 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:23.934407  6074 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.860666  6021 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:23.873767  5885 raft_consensus.cc:2749] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:23.846073  5886 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.856985  5972 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:23.909550  5996 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:23.926386  5974 raft_consensus.cc:3060] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:23.851887  6068 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:23.964689  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 178077us
I20260709 13:02:23.925725  5980 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:23.950850  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 146957us
I20260709 13:02:23.957387  5769 raft_consensus.cc:3055] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:23.972656  1633 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:23.958523  5886 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:23.970968  1705 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:02:23.963758  6028 consensus_meta.cc:287] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent flushing consensus metadata: real 0.907s	user 0.014s	sys 0.011s
I20260709 13:02:23.976974  1734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3432) took 1032 ms. Trace:
I20260709 13:02:23.977499  1734 rpcz_store.cc:276] 0709 13:02:22.944142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.944348 (+   206us) service_pool.cc:224] Handling call
0709 13:02:22.976125 (+ 31777us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:23.331930 (+355805us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.976685 (+644755us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b540001ed54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:23.976907 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":812159360}
I20260709 13:02:23.965536  5972 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:23.935547  6074 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:23.963662  5885 raft_consensus.cc:2749] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:23.987412  6091 log.cc:927] Time spent T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:02:23.989323  6066 consensus_queue.cc:1048] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.192s
I20260709 13:02:23.998351  6089 raft_consensus.cc:2804] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:23.972323  5996 raft_consensus.cc:3055] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:23.968468  5973 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:24.008785  6068 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:23.960098  6021 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:23.974004  5769 raft_consensus.cc:740] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
W20260709 13:02:24.024849  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 51930.7us
I20260709 13:02:24.002965  5980 raft_consensus.cc:2804] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:23.983903  6059 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:24.038518  5980 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:24.074676  5980 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:24.029855  5973 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:24.047705  6000 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:24.053122  5899 consensus_meta.cc:287] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.553s	user 0.013s	sys 0.003s
I20260709 13:02:24.060252  6021 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:24.063055  6097 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:24.065011  6067 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:24.031100  1633 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:24.011092  5996 raft_consensus.cc:740] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:24.011795  6089 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.069046  6029 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:24.069666  5992 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:24.070806  5769 consensus_queue.cc:260] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:23.982585  6028 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:24.108914  2553 raft_consensus.cc:1240] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:24.108397  5996 consensus_queue.cc:260] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:24.108301  6067 raft_consensus.cc:2804] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:24.076728  6068 consensus_queue.cc:1059] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:02:24.109931  6067 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:24.110262  5996 raft_consensus.cc:3060] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:24.080899  5821 consensus_meta.cc:287] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6: Time spent flushing consensus metadata: real 0.852s	user 0.017s	sys 0.000s
I20260709 13:02:24.034089  6074 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:24.111652  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 80647.6us
I20260709 13:02:24.112279  6028 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:24.107030  6089 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:24.118866  1633 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:24.120517  5769 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:24.110616  6068 raft_consensus.cc:3055] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:24.121368  6068 raft_consensus.cc:740] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:24.122630  6068 consensus_queue.cc:260] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:24.124305  5899 consensus_queue.cc:1048] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:24.125159  6068 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:24.116169  5821 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:24.110563  6067 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:24.132505  6021 raft_consensus.cc:2804] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:24.090250  6000 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:24.127743  1633 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:24.162034  6066 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:24.133337  6021 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:24.181937  1733 raft_consensus.cc:1240] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:24.182370  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:24.182482  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:24.183350  1736 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 13.
I20260709 13:02:24.125000  5879 raft_consensus.cc:3055] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:24.184594  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:24.162729  6066 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:24.190526  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:24.192868  1732 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
I20260709 13:02:24.202698  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:02:24.209506  1558 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.002s	sys 0.017s
W20260709 13:02:24.210131  1558 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.002s	sys 0.017s
W20260709 13:02:24.214049  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:24.210407  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 657721us
I20260709 13:02:24.184059  6021 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:24.195147  6066 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:24.218534  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.220711  1558 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:24.188731  5879 raft_consensus.cc:740] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:24.235812  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:24.226011  1558 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:24.228964  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:24.243580  1735 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
I20260709 13:02:24.230245  5706 raft_consensus.cc:2804] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:24.232743  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:24.230576  5777 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:24.231446  1734 raft_consensus.cc:1275] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:02:24.255712  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 395077us
I20260709 13:02:24.256970  1558 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:24.259831  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:24.261279  1663 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:24.262224  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:24.262789  1663 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:24.266022  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:24.256561  5952 consensus_meta.cc:287] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.642s	user 0.011s	sys 0.015s
I20260709 13:02:24.269660  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:24.270576  1707 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:24.222168  5992 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:24.271718  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:24.273268  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:24.274590  1707 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:24.275899  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:24.276633  1583 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:24.278514  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:24.283560  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:24.284503  1591 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:24.258239  5921 raft_consensus.cc:2804] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:24.254738  5706 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:24.289892  1707 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:24.295480  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:24.296193  1707 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:24.298223  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:24.299041  1584 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:02:24.258486  6029 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:24.299846  1707 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:24.290469  5892 raft_consensus.cc:2804] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:24.310065  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:24.312098  5892 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.314600  5892 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:24.276134  5952 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:24.319636  5974 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:24.309705  5921 raft_consensus.cc:697] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:24.322155  5921 consensus_queue.cc:237] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:24.325762  5952 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:24.326740  5952 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:24.327736  5952 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:24.310235  5777 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:24.329560  5777 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:24.301190  5885 raft_consensus.cc:2749] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:24.339268  6043 log.cc:927] Time spent T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 1.327s	user 0.002s	sys 0.002s
I20260709 13:02:24.300149  5706 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:24.289700  6098 raft_consensus.cc:2749] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:24.423381  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 333808us
I20260709 13:02:24.290747  5992 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:24.291205  6099 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:24.429672  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:24.444689  1665 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:24.337805  5777 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:24.300709  5699 raft_consensus.cc:2804] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:24.344697  5928 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
W20260709 13:02:24.454761  1630 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.015s	sys 0.049s
W20260709 13:02:24.455327  1630 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.015s	sys 0.049s
W20260709 13:02:24.457233  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:24.457731  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:24.458426  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.458729  1705 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:24.343834  6056 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
W20260709 13:02:24.511525  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.307763  6029 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:24.580566  1583 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
W20260709 13:02:24.639932  1705 leader_election.cc:336] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.680s (SENT)
I20260709 13:02:24.447193  5885 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:24.646556  2554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 254) took 2092 ms. Trace:
W20260709 13:02:24.650882  1555 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.042s	sys 0.070s
W20260709 13:02:24.651382  1555 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.042s	sys 0.070s
I20260709 13:02:24.454247  5639 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.477742  5821 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:24.449342  5952 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:24.309513  5879 consensus_queue.cc:260] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:24.647369  2554 rpcz_store.cc:276] 0709 13:02:22.510247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.510445 (+   198us) service_pool.cc:224] Handling call
0709 13:02:22.521657 (+ 11212us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:22.522045 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:22.522072 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:22.522503 (+   431us) log.cc:844] Serialized 26 byte log entry
0709 13:02:22.707713 (+185210us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:22.707781 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.707902 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:24.338381 (+1630479us) spinlock_profiling.cc:243] Waited 6.6 ms on lock 0x7b4400022b4c. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7ddc8c85 00007f1b7ddc96a2 00007f1b80b3b1db 00007f1b80b36aaf 00007f1b80b2a86e 00007f1b80b29bb6 00007f1b80b297d8 00007f1b80b33221 00007f1b80b331d9 00007f1b80b33169
0709 13:02:24.493314 (+154933us) raft_consensus.cc:1685] finished
0709 13:02:24.493350 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.602182 (+108832us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2446,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"spinlock_wait_cycles":15168896,"thread_start_us":184699,"threads_started":1,"wal-append.queue_time_us":388534}
I20260709 13:02:24.451594  6102 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:24.468320  5777 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:24.655730  1705 leader_election.cc:336] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.778s (SENT)
I20260709 13:02:24.688328  1705 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:24.495061  5699 raft_consensus.cc:697] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:02:24.680538  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.657245  5701 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.658311  6000 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:24.655180  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:24.494755  5928 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:24.669858  5639 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:24.697968  5777 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:24.723284  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 450474us
I20260709 13:02:24.605927  6056 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:24.726550  1665 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 13.
I20260709 13:02:24.725340  1633 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
W20260709 13:02:24.693302  5998 consensus_meta.cc:287] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.935s	user 0.016s	sys 0.001s
W20260709 13:02:24.735029  6085 consensus_meta.cc:287] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 1.024s	user 0.006s	sys 0.015s
I20260709 13:02:24.737614  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:24.660871  6107 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:24.456307  6099 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:24.707216  5879 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:24.664220  5885 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:24.743659  1633 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:24.708673  5974 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:24.729997  5639 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:24.730763  6030 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.893s	user 0.030s	sys 0.027s
I20260709 13:02:24.761624  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:24.771760  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:24.773340  5777 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:24.690614  5952 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:24.779346  6109 consensus_queue.cc:1059] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:02:24.744827  6000 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.746879  6063 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:24.725286  5701 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:24.789464  1664 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 2683) took 1438 ms (client timeout 1680 ms). Trace:
W20260709 13:02:24.776039  6030 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.941s	user 0.031s	sys 0.027s
W20260709 13:02:24.793897  1664 rpcz_store.cc:269] 0709 13:02:23.351041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.771367 (+1420326us) service_pool.cc:224] Handling call
0709 13:02:24.789367 (+ 18000us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:24.742707  6085 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:24.777501  5974 raft_consensus.cc:2804] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:02:24.802891  1741 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.017s	sys 0.071s
W20260709 13:02:24.803578  1741 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.017s	sys 0.072s
W20260709 13:02:24.808228  5980 consensus_meta.cc:287] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.733s	user 0.007s	sys 0.007s
W20260709 13:02:24.810330  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 510537us
I20260709 13:02:24.740913  5998 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:24.788517  6104 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:24.786182  1663 consensus_meta.cc:287] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.523s	user 0.012s	sys 0.001s
I20260709 13:02:24.703893  6102 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:24.814535  1633 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:24.746511  6107 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:24.814318  1591 consensus_meta.cc:287] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.529s	user 0.012s	sys 0.000s
I20260709 13:02:24.851817  1591 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12.
I20260709 13:02:24.808699  5980 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:24.828464  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 49570.4us
I20260709 13:02:24.810782  5974 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:24.824359  1737 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 8.
I20260709 13:02:24.819124  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:24.811443  1707 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:24.822185  1663 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12.
I20260709 13:02:24.863942  1664 raft_consensus.cc:2410] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:02:24.798870  6000 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:24.781791  5699 consensus_queue.cc:237] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:24.874063  2550 raft_consensus.cc:1275] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:24.874187  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:24.827592  6109 raft_consensus.cc:2804] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:02:24.882102  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 226420us
I20260709 13:02:24.882091  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:24.859622  5974 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:24.876761  1663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58814 (request call id 631) took 1161 ms. Trace:
I20260709 13:02:24.914106  1664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58814 (request call id 632) took 1198 ms. Trace:
I20260709 13:02:24.864300  5992 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:24.867406  6112 raft_consensus.cc:3055] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:24.823779  6104 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:24.797873  6063 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:24.883489  6106 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.949172  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:24.915289  1663 rpcz_store.cc:276] 0709 13:02:23.715567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.875710 (+1160143us) service_pool.cc:224] Handling call
0709 13:02:24.876077 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.876314 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.876351 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:24.876411 (+    60us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:24.876466 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.876540 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.876676 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:24.873044  6029 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:24.920207  1555 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:24.937669  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:24.941469  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.944657  1664 rpcz_store.cc:276] 0709 13:02:23.716041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.889337 (+1173296us) service_pool.cc:224] Handling call
0709 13:02:24.889657 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.913489 (+ 23832us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.913567 (+    78us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:24.913669 (+   102us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:24.913722 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.913828 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.914015 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:24.881891  6109 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:24.954809  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:24.966740  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 46634.8us
I20260709 13:02:24.971061  1663 raft_consensus.cc:2468] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 8.
I20260709 13:02:24.945722  6112 raft_consensus.cc:740] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:24.973759  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:24.980239  1663 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 10
W20260709 13:02:24.874212  6094 consensus_queue.cc:1175] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6d4de2ce0683442498244b9529127f91" responder_term: 10 status { last_received { term: 7 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 9. Current term is 10. Ops: [9.7-9.7]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:02:24.930301  6103 log.cc:927] Time spent T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:02:24.934755  6000 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:24.934633  6056 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:25.003445  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:25.012625  1583 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:24.954396  5992 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:24.934124  6107 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:24.931588  5885 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:24.936196  6085 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:25.009824  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:25.032234  2550 raft_consensus.cc:2393] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 8: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:02:25.011217  1664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58814 (request call id 633) took 1294 ms. Trace:
I20260709 13:02:24.926988  6099 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:25.003145  6029 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.968935  5947 raft_consensus.cc:2749] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:24.970830  6109 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:24.971951  5928 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:24.977367  5738 consensus_queue.cc:1048] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:02:25.017360  6000 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:24.980372  6114 raft_consensus.cc:2804] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:25.032954  1664 rpcz_store.cc:276] 0709 13:02:23.716383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.971893 (+1255510us) service_pool.cc:224] Handling call
0709 13:02:25.010715 (+ 38822us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.010902 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:25.010928 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:25.010969 (+    41us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:25.011001 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.011054 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:25.011160 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:25.036005  1583 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 7.
I20260709 13:02:25.015908  6116 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
W20260709 13:02:25.020349  5972 consensus_meta.cc:287] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 1.021s	user 0.009s	sys 0.009s
W20260709 13:02:25.006381  5996 consensus_meta.cc:287] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.895s	user 0.019s	sys 0.006s
I20260709 13:02:25.045047  6085 raft_consensus.cc:2749] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:25.084527  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:25.087935  2550 raft_consensus.cc:2393] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 9: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:02:25.048938  1705 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:25.018050  5992 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:25.025466  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 214123us
I20260709 13:02:25.040105  6120 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:25.043741  6099 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:25.080044  6119 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.095283  1707 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:25.065361  1663 raft_consensus.cc:2468] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:02:25.113595  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:25.114981  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:25.115926  1663 raft_consensus.cc:2410] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:02:25.098227  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:02:25.099970  1633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.077715  6114 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:25.119889  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:25.121685  1663 raft_consensus.cc:2393] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 12: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
W20260709 13:02:25.102444  1705 leader_election.cc:336] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.165s (SENT)
I20260709 13:02:25.094300  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:25.122928  1705 leader_election.cc:336] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.224s (SENT)
I20260709 13:02:25.088035  5701 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:25.097185  5992 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:25.051239  6029 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:25.129670  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:25.139379  2550 raft_consensus.cc:2368] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 8. Current term is 9.
I20260709 13:02:25.131436  1705 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:25.092633  5952 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:25.112339  5769 consensus_meta.cc:287] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.991s	user 0.006s	sys 0.012s
I20260709 13:02:25.140846  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:25.141481  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 117881us
I20260709 13:02:25.141719  1663 raft_consensus.cc:2393] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 11: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:25.079423  6000 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:25.143734  1633 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.535s (SENT) [suppressed 19 similar messages]
I20260709 13:02:25.093655  5972 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:25.151120  1704 leader_election.cc:400] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Vote denied by peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157) with higher term. Message: Invalid argument: T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 8. Current term is 9.
I20260709 13:02:25.151485  1704 leader_election.cc:403] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:02:25.152611  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:25.154305  1663 raft_consensus.cc:3060] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:25.128578  5998 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:25.142684  6066 consensus_meta.cc:287] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.885s	user 0.013s	sys 0.005s
I20260709 13:02:25.133355  5980 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:25.165292  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:25.154037  6124 raft_consensus.cc:2804] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:24.984458  6106 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:25.123625  6120 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:25.124852  6114 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:25.164561  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:25.172236  1583 raft_consensus.cc:2368] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 10. Current term is 11.
I20260709 13:02:25.173146  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:25.174230  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:25.175225  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:25.166461  6126 raft_consensus.cc:2749] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:25.176342  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:25.168627  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:25.169939  6085 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:25.116837  6099 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:25.170571  1585 raft_consensus.cc:1240] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:25.149845  1630 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:25.177775  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:25.167690  1590 raft_consensus.cc:1275] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:02:25.160760  5892 consensus_meta.cc:287] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.845s	user 0.016s	sys 0.001s
I20260709 13:02:25.179422  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:25.181636  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:25.182511  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:25.184031  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:25.185874  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:25.186708  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:25.186897  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:25.188357  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:25.171001  5701 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.167451  5952 raft_consensus.cc:2804] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:25.194757  1592 raft_consensus.cc:1275] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:25.167596  5975 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:25.104354  6116 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:25.184937  6097 consensus_meta.cc:287] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 1.078s	user 0.010s	sys 0.009s
I20260709 13:02:25.202185  1663 raft_consensus.cc:2468] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 6.
I20260709 13:02:25.203244  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:25.205852  6123 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.208370  1663 raft_consensus.cc:2393] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 12: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:25.209110  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:25.210316  6097 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:25.187852  6102 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:25.206835  6123 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:25.228597  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:25.235080  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:25.236268  1663 raft_consensus.cc:2393] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 10: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
W20260709 13:02:25.216349  5886 consensus_meta.cc:287] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 1.204s	user 0.017s	sys 0.003s
I20260709 13:02:25.242815  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:25.244123  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:25.244781  1663 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:25.186223  5892 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:25.260578  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:25.189978  6124 raft_consensus.cc:697] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 13 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:25.122411  6119 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:25.251678  2424 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:25.253706  6073 raft_consensus.cc:2749] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:25.256434  5972 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:25.088388  6112 consensus_queue.cc:260] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:25.263955  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:25.239863  6068 consensus_meta.cc:287] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 1.103s	user 0.018s	sys 0.001s
I20260709 13:02:25.223167  5952 raft_consensus.cc:697] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 12 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:25.169670  6066 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:25.273643  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:25.202198  5701 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:25.287518  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:25.289999  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:25.247074  6104 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:25.291636  1583 raft_consensus.cc:2393] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 12: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:25.291973  1664 raft_consensus.cc:2410] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:02:25.292714  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 142987us
W20260709 13:02:25.295307  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.290904  1592 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 11.
I20260709 13:02:25.296420  1585 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 8.
W20260709 13:02:25.297441  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.270959  5996 raft_consensus.cc:2749] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:25.283617  6021 consensus_meta.cc:287] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 1.025s	user 0.008s	sys 0.007s
W20260709 13:02:25.300122  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 204903us
I20260709 13:02:25.307587  1707 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:25.309564  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:25.180565  6120 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:25.259259  5886 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:25.289243  6097 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:25.317935  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:25.313309  1583 raft_consensus.cc:1275] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:25.315639  5991 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:25.315919  5952 consensus_queue.cc:237] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:25.323004  1663 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:02:25.313308  1707 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:25.336534  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:25.336695  1707 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:25.340689  1663 raft_consensus.cc:2393] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 8: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:25.300853  6068 consensus_queue.cc:1048] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:02:25.344494  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:25.326076  6099 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:25.339282  6089 consensus_meta.cc:287] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 1.191s	user 0.015s	sys 0.004s
I20260709 13:02:25.348543  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:25.348242  1663 raft_consensus.cc:2410] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:02:25.328701  6106 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:25.343751  5972 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:25.311395  6021 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:25.318462  6136 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:25.338290  6063 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:25.365525  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:25.325906  5991 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:25.372321  1663 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:02:25.332690  6097 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:25.373298  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:25.373976  1663 raft_consensus.cc:2393] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 13: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:25.374686  6097 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:25.375231  6097 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:25.375690  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:25.375855  6097 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:25.375905  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:25.357815  5980 raft_consensus.cc:2804] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:25.378198  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:25.384651  1663 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:25.386359  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:25.386929  1583 raft_consensus.cc:2468] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 7.
I20260709 13:02:25.393751  6066 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:25.370200  5972 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:25.383226  5974 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:25.406349  6123 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:25.409765  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:25.411175  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:25.398859  6113 log.cc:927] Time spent T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.245s	user 0.001s	sys 0.001s
I20260709 13:02:25.404745  5972 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:25.401232  5980 raft_consensus.cc:697] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 9 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:25.363104  6089 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:25.412976  6116 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:25.437848  6097 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:25.413507  6137 raft_consensus.cc:2804] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:25.441509  6137 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:25.441955  6137 raft_consensus.cc:3060] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:25.449661  6021 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:25.452330  5886 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:25.434041  5701 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:25.462684  5706 consensus_meta.cc:287] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 1.027s	user 0.011s	sys 0.007s
I20260709 13:02:25.463413  5706 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:25.464759  1589 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12.
I20260709 13:02:25.465901  5980 consensus_queue.cc:237] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:25.428079  6066 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:25.471315  5879 consensus_meta.cc:287] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.722s	user 0.009s	sys 0.007s
I20260709 13:02:25.471602  6066 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:25.473623  6119 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:25.427017  5892 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:25.478888  1735 raft_consensus.cc:1240] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:02:25.483680  2550 raft_consensus.cc:1275] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:02:25.496178  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 243622us
I20260709 13:02:25.497337  6133 consensus_queue.cc:1048] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
W20260709 13:02:25.502316  6067 consensus_meta.cc:287] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 1.369s	user 0.009s	sys 0.008s
I20260709 13:02:25.504823  6067 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:25.452570  5951 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:25.484197  6126 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.512427  1741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3425) took 2874 ms. Trace:
I20260709 13:02:25.513427  1666 raft_consensus.cc:2393] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 6: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:25.514859  6067 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:25.515439  6089 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:25.520318  1741 rpcz_store.cc:276] 0709 13:02:22.636643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.636783 (+   140us) service_pool.cc:224] Handling call
0709 13:02:22.637157 (+   374us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:22.706760 (+ 69603us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:22.706792 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:24.074376 (+1367584us) spinlock_profiling.cc:243] Waited 6.08 ms on lock 0x7b180026cbc0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7de702a6 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7f888a11 00007f1b7f898372 00007f1b80fcaa01 00007f1b80f8f43a
0709 13:02:24.075709 (+  1333us) spinlock_profiling.cc:243] Waited 8.28 ms on lock 0x7b2c00122a68. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7f888a11 00007f1b7f898372 00007f1b80fcaa01 00007f1b80f8f43a 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2
0709 13:02:24.088277 (+ 12568us) log.cc:844] Serialized 52 byte log entry
0709 13:02:24.804505 (+716228us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:24.951426 (+146921us) log.cc:844] Serialized 14 byte log entry
0709 13:02:25.093097 (+141671us) log.cc:844] Serialized 14 byte log entry
0709 13:02:25.175066 (+ 81969us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.175294 (+   228us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:25.510680 (+335386us) raft_consensus.cc:1685] finished
0709 13:02:25.510701 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:25.510881 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50826,"prepare.queue_time_us":257194,"prepare.run_cpu_time_us":123,"prepare.run_wall_time_us":3899,"raft.queue_time_us":175182,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":32072,"spinlock_wait_cycles":43344384,"thread_start_us":1043564,"threads_started":4,"wal-append.queue_time_us":852664}
I20260709 13:02:25.503044  5991 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:25.495446  5992 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:25.535389  5991 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.536067  5991 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:25.530725  5706 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:25.537129  5928 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.540282  5928 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:25.543126  5928 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:25.537372  5992 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:25.550959  6066 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:25.520383  6126 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:25.345728  6124 consensus_queue.cc:237] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:25.560274  1735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43686 (request call id 2300) took 1312 ms. Trace:
I20260709 13:02:25.443948  6114 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:25.560813  1735 rpcz_store.cc:276] 0709 13:02:24.248215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.248379 (+   164us) service_pool.cc:224] Handling call
0709 13:02:24.248757 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:25.479536 (+1230779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.559822 (+ 80286us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54002562d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:25.560180 (+   358us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2828185984}
I20260709 13:02:25.583364  1663 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:02:25.590448  5991 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:25.591904  5974 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:25.590457  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:25.593660  1658 raft_consensus.cc:2393] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 11: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
W20260709 13:02:25.594100  1658 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 2684) took 2242 ms (client timeout 2898 ms). Trace:
W20260709 13:02:25.594452  1658 rpcz_store.cc:269] 0709 13:02:23.351716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.585441 (+2233725us) service_pool.cc:224] Handling call
0709 13:02:25.594039 (+  8598us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:25.594573  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 413191us
I20260709 13:02:25.592157  5972 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:25.600478  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 102327us
I20260709 13:02:25.606575  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:25.607410  1658 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:25.607229  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:25.602056  6085 raft_consensus.cc:2749] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157) with higher term. Message: Invalid argument: T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 8. Current term is 9.
I20260709 13:02:25.624703  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:25.548425  6109 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:25.608355  1663 raft_consensus.cc:2468] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:02:25.628687  1737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43686 (request call id 2288) took 1918 ms. Trace:
I20260709 13:02:25.630124  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:25.629127  1737 rpcz_store.cc:276] 0709 13:02:23.710297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.710577 (+   280us) service_pool.cc:224] Handling call
0709 13:02:25.628527 (+1917950us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400276854. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:25.628629 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2468688640}
W20260709 13:02:25.636714  1659 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 2680) took 2295 ms (client timeout 1778 ms). Trace:
W20260709 13:02:25.637334  1659 rpcz_store.cc:269] 0709 13:02:23.337016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.632659 (+2295643us) service_pool.cc:211] Skipping call since client already timed out
0709 13:02:25.632774 (+   115us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:02:25.641181  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:25.641721  6145 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.638271  1663 raft_consensus.cc:2410] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 for term 11 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:02:25.647754  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:25.640676  1633 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:25.648548  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:25.647809  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:25.649358  1663 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:25.656600  5701 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:25.657276  5701 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:25.658766  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:25.659646  2515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49218 (request call id 258) took 1198 ms. Trace:
I20260709 13:02:25.659767  5701 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:25.660265  2515 rpcz_store.cc:276] 0709 13:02:24.461499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.468806 (+  7307us) service_pool.cc:224] Handling call
0709 13:02:25.658592 (+1189786us) spinlock_profiling.cc:243] Waited 3.52 ms on lock 0x7b58001c3b98. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7de6ab71 00007f1b7de6aa22 00007f1b86d83c09 00007f1b85eddee0 00007f1b85fa70ab 00007f1b85fa7131 00007f1b85f550a0 00007f1b85f54984 00007f1b7f4cf6d4 00007f1b7f4cf662
0709 13:02:25.659576 (+   984us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8094080}
I20260709 13:02:25.664896  1633 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:25.657754  5972 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:25.667801  1633 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:25.670425  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:25.671346  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:25.670779  1659 raft_consensus.cc:1240] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:25.674064  1738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3435) took 2727 ms. Trace:
I20260709 13:02:25.675559  1633 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:25.676165  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:25.678321  1659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 2699) took 1502 ms. Trace:
I20260709 13:02:25.674459  1738 rpcz_store.cc:276] 0709 13:02:22.946710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.066470 (+119760us) service_pool.cc:224] Handling call
0709 13:02:23.082695 (+ 16225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:23.145410 (+ 62715us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:23.145430 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:23.145458 (+    28us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:23.145493 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.673829 (+2528336us) spinlock_profiling.cc:243] Waited 62.5 ms on lock 0x7b540001d454. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:25.673875 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:25.673999 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143806848}
I20260709 13:02:25.678699  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:25.679355  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:25.679541  1591 raft_consensus.cc:1275] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:02:25.653976  6126 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:25.679971  1591 pending_rounds.cc:85] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91: Aborting all ops after (but not including) 9
I20260709 13:02:25.678711  1659 rpcz_store.cc:276] 0709 13:02:24.176208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.651323 (+1475115us) service_pool.cc:224] Handling call
0709 13:02:25.667260 (+ 15937us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.678065 (+ 10805us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.678256 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:25.678321  1633 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:25.686923  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:25.687849  1633 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:25.689255  1633 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:25.690407  1633 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:25.681537  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:25.692559  1587 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:25.692651  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 119350us
I20260709 13:02:25.699863  1707 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:25.684317  1658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58814 (request call id 634) took 1462 ms. Trace:
I20260709 13:02:25.702157  1658 rpcz_store.cc:276] 0709 13:02:24.222531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.676301 (+1453770us) service_pool.cc:224] Handling call
0709 13:02:25.683081 (+  6780us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.683244 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:25.683268 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:25.683998 (+   730us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:25.684036 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.684088 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:25.684261 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:25.704506  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:25.670693  6067 raft_consensus.cc:2749] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:25.682821  1583 raft_consensus.cc:1275] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:25.681845  1591 pending_rounds.cc:107] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:02:25.714226  1591 raft_consensus.cc:2889] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:25.675467  6119 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:25.642483  6145 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:25.684512  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:25.685042  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:25.677388  6136 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:25.705312  6126 raft_consensus.cc:2749] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:25.715358  6139 raft_consensus.cc:2749] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:25.682969  6021 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:25.704336  6063 raft_consensus.cc:2749] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:25.718284  6099 consensus_queue.cc:1048] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:02:25.679586  6129 consensus_queue.cc:1048] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 13:02:25.703805  6066 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.718343  6114 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:25.722749  6128 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.757421  6066 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:25.757932  6128 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:25.720175  5992 raft_consensus.cc:2749] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:25.716387  1659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58814 (request call id 635) took 1458 ms. Trace:
I20260709 13:02:25.759271  1585 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:02:25.759388  1659 rpcz_store.cc:276] 0709 13:02:24.257737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.682180 (+1424443us) service_pool.cc:224] Handling call
0709 13:02:25.715897 (+ 33717us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.716093 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:25.716119 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:25.716160 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:25.716189 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.716240 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:25.716333 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:25.728711  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:25.760807  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.667934  6146 raft_consensus.cc:2749] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:25.779871  1660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58814 (request call id 630) took 2164 ms. Trace:
I20260709 13:02:25.781337  1659 raft_consensus.cc:1240] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 10. Current term is 11. Ops: []
W20260709 13:02:25.724833  6142 log.cc:927] Time spent T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:02:25.780697  1660 rpcz_store.cc:276] 0709 13:02:23.615695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.771100 (+155405us) service_pool.cc:224] Handling call
0709 13:02:23.796049 (+ 24949us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:23.964365 (+168316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:23.964397 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:23.964439 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:23.964473 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.779500 (+1815027us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b540030aa54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:25.779570 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:25.779776 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":386622336}
I20260709 13:02:25.788847  1660 raft_consensus.cc:1240] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:25.787274  1658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58814 (request call id 636) took 1527 ms. Trace:
I20260709 13:02:25.789546  1658 rpcz_store.cc:276] 0709 13:02:24.259736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.703550 (+1443814us) service_pool.cc:224] Handling call
0709 13:02:25.786808 (+ 83258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.786970 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:25.786999 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:25.787038 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:25.787068 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.787120 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:25.787218 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:25.786362  1667 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 2682) took 2436 ms (client timeout 2224 ms). Trace:
W20260709 13:02:25.791258  1667 rpcz_store.cc:269] 0709 13:02:23.350408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.786052 (+2435644us) service_pool.cc:211] Skipping call since client already timed out
0709 13:02:25.786244 (+   192us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:02:25.799394  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:25.799619  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 79275.8us
I20260709 13:02:25.800741  1633 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:25.804350  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:25.805737  6146 raft_consensus.cc:2749] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:25.806397  1660 raft_consensus.cc:1275] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:02:25.806674  6109 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:25.807964  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:25.809473  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:25.809629  1658 raft_consensus.cc:1240] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:25.809998  1584 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:25.812484  1586 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
W20260709 13:02:25.806689  1662 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 2685) took 2448 ms (client timeout 2165 ms). Trace:
W20260709 13:02:25.817279  1662 rpcz_store.cc:269] 0709 13:02:23.358377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.806505 (+2448128us) service_pool.cc:211] Skipping call since client already timed out
0709 13:02:25.806619 (+   114us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:02:25.818629  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:25.804780  1633 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:25.819248  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:25.820218  1587 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 13.
I20260709 13:02:25.820575  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:25.821842  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:25.823904  1585 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:25.828091  1584 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
I20260709 13:02:25.829147  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:25.829360  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:25.817803  6128 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:25.846762  6146 consensus_queue.cc:1048] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:02:25.850569  1662 raft_consensus.cc:1240] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:25.855677  1585 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
I20260709 13:02:25.857579  1584 raft_consensus.cc:1240] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:25.861516  1662 raft_consensus.cc:1275] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:25.861811  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:25.862628  1587 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:25.850714  6145 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:25.867928  6066 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:25.838665  6109 raft_consensus.cc:2804] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:25.868685  6109 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:25.869099  6109 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:25.873493  2548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49238 (request call id 496) took 2386 ms. Trace:
I20260709 13:02:25.873955  6137 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:25.873919  2548 rpcz_store.cc:276] 0709 13:02:23.487020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.487202 (+   182us) service_pool.cc:224] Handling call
0709 13:02:23.487589 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:23.854328 (+366739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.873221 (+2018893us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b54001bbf54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:25.873419 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":640762624}
I20260709 13:02:25.875432  2550 raft_consensus.cc:2393] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 9: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:02:25.876382  6137 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:25.848306  6136 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.877064  6114 consensus_queue.cc:1059] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:25.877208  6136 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:25.878425  6114 raft_consensus.cc:3055] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:25.878809  6114 raft_consensus.cc:740] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:25.889510  1663 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:02:25.894848  1587 raft_consensus.cc:2410] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:02:25.900295  1659 raft_consensus.cc:1240] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:25.890426  6116 raft_consensus.cc:2749] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:25.892349  6146 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.892429  5996 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:25.911773  6131 log.cc:927] Time spent T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.677s	user 0.002s	sys 0.000s
I20260709 13:02:25.916761  1633 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:25.920476  6126 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:25.921940  1659 raft_consensus.cc:1240] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:25.925825  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:25.930145  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:25.928076  1741 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:02:25.928184  1633 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:25.937369  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:25.938320  1740 raft_consensus.cc:2393] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 10: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:25.926397  5972 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:25.941674  1658 raft_consensus.cc:2393] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 14: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:25.941823  5972 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:25.942731  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:25.943805  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:25.943980  5972 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:25.931195  6033 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:25.912444  6114 consensus_queue.cc:260] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:25.947736  6033 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:25.948726  6114 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:25.949491  1663 raft_consensus.cc:1275] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:25.951913  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:25.952044  5992 consensus_queue.cc:1059] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:25.953486  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:25.927436  6067 raft_consensus.cc:2749] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:25.954996  6136 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:25.944936  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:25.946801  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:25.958140  1664 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:25.957701  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:25.959386  1740 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:02:25.957267  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:25.926352  6146 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:25.960803  2553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49222 (request call id 538) took 2259 ms. Trace:
I20260709 13:02:25.962667  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:25.971275  1735 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:25.967226  1663 raft_consensus.cc:1275] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:25.968605  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:25.972092  1740 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:02:25.973841  1663 raft_consensus.cc:1275] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:02:25.974303  1663 pending_rounds.cc:85] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 6
I20260709 13:02:25.974588  1663 pending_rounds.cc:107] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:02:25.974898  1663 raft_consensus.cc:2889] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:25.975272  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:25.976110  1741 raft_consensus.cc:2410] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:02:25.976924  1740 raft_consensus.cc:1275] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:25.978782  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:25.979419  1740 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:02:25.981366  1739 raft_consensus.cc:1240] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:25.917871  6124 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.970286  2553 rpcz_store.cc:276] 0709 13:02:23.700954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.701113 (+   159us) service_pool.cc:224] Handling call
0709 13:02:23.708085 (+  6972us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.109422 (+401337us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.960470 (+1851048us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b540060f754. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:25.960659 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":921271168}
I20260709 13:02:25.983183  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:25.985687  1659 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 13.
I20260709 13:02:25.955049  6129 raft_consensus.cc:2804] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:25.984335  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:25.995765  1590 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:25.996207  1664 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 13.
I20260709 13:02:25.928926  5996 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:26.000146  1658 raft_consensus.cc:1240] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:26.000262  1741 raft_consensus.cc:2368] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for earlier term 12. Current term is 13.
I20260709 13:02:26.004733  1735 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:02:26.018038  1662 raft_consensus.cc:1275] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:02:26.009287  1740 raft_consensus.cc:1275] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:25.931146  6068 consensus_queue.cc:1048] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:02:26.022018  1732 raft_consensus.cc:1240] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:25.985296  5769 raft_consensus.cc:3055] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:26.024159  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:26.033604  6033 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:26.036360  1556 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:26.038221  5960 consensus_queue.cc:1059] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:26.040176  6146 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:26.040270  5996 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:26.040462  1661 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 2676) took 2704 ms (client timeout 2239 ms). Trace:
I20260709 13:02:25.956941  6126 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:26.042040  6109 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:26.024806  5769 raft_consensus.cc:740] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:25.998056  6129 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.058373  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:25.997677  6124 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:26.062779  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:26.101738  1592 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 11.
I20260709 13:02:26.065522  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:26.102542  1585 raft_consensus.cc:2468] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 7.
I20260709 13:02:26.068187  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:26.102739  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:26.072093  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:26.103883  1588 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:26.072389  1590 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:02:26.105306  1590 raft_consensus.cc:606] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
W20260709 13:02:26.083340  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 47054.2us
W20260709 13:02:26.097580  1661 rpcz_store.cc:269] 0709 13:02:23.335778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.338317 (+  2539us) service_pool.cc:224] Handling call
0709 13:02:26.040209 (+2701892us) spinlock_profiling.cc:243] Waited 53.2 ms on lock 0x7b5400242a54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:26.040354 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122401536}
I20260709 13:02:26.098305  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:26.098824  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:26.106578  1658 raft_consensus.cc:3060] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:26.074636  6037 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.112917  1735 raft_consensus.cc:1240] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:02:26.111697  1659 raft_consensus.cc:2410] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:02:26.114979  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:26.106207  1556 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:26.115816  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:26.110224  2426 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:26.120472  1556 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:26.122435  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:26.123307  1735 raft_consensus.cc:3060] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:26.117520  1584 raft_consensus.cc:3060] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:02:26.122648  1556 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:26.094313  6024 raft_consensus.cc:2749] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:26.108462  6129 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:26.156325  1556 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:26.156872  1736 raft_consensus.cc:1275] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:02:26.158402  1556 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:26.159651  2426 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:26.125373  5738 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:26.094089  6030 consensus_queue.cc:1059] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:02:26.163462  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:26.163699  1584 raft_consensus.cc:2468] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 9.
I20260709 13:02:26.168584  1588 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 9.
I20260709 13:02:26.116331  6148 consensus_queue.cc:1059] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.114s
W20260709 13:02:26.222076  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.162083  5930 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:26.169696  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:26.171329  5769 consensus_queue.cc:260] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:26.126327  6037 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:26.349244  6031 raft_consensus.cc:2804] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:26.439117  6037 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:26.441669  2543 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
I20260709 13:02:26.443908  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:26.449164  6148 raft_consensus.cc:3055] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:26.450162  6148 raft_consensus.cc:740] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
W20260709 13:02:26.354085  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 195773us
I20260709 13:02:26.127856  5574 raft_consensus.cc:2749] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:26.459244  1659 raft_consensus.cc:1240] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:26.458930  5574 consensus_queue.cc:1059] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:26.229339  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:26.125646  6128 raft_consensus.cc:2749] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:26.161249  5996 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.463124  5996 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:26.464035  6128 consensus_queue.cc:1059] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:02:26.214471  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 54879.6us
I20260709 13:02:26.472148  2426 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:26.360472  6145 raft_consensus.cc:2804] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:26.473570  6145 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.474180  6145 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:26.474401  6128 consensus_queue.cc:1059] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:26.475400  6108 raft_consensus.cc:993] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:02:26.476090  6108 raft_consensus.cc:3055] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:26.374053  6024 raft_consensus.cc:2764] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:02:26.482272  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:26.484402  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:26.485246  5996 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:26.486444  6126 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:26.487147  6126 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:26.487303  2548 raft_consensus.cc:1275] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:26.404711  1740 raft_consensus.cc:1275] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:26.494835  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:26.495249  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:26.496037  1734 raft_consensus.cc:2393] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 13: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:26.496245  1630 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:26.497416  6127 raft_consensus.cc:2804] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:26.498188  6127 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.499004  6127 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:26.498191  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:26.501223  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:26.466300  6086 raft_consensus.cc:3055] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:26.502173  1740 raft_consensus.cc:2468] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 5.
I20260709 13:02:26.502317  6086 raft_consensus.cc:740] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:02:26.503365  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.503809  6086 consensus_queue.cc:260] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:26.500789  1734 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 9.
I20260709 13:02:26.506053  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:26.506961  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:26.508342  1734 raft_consensus.cc:2410] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:02:26.476723  6108 raft_consensus.cc:740] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:26.513223  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:26.424268  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:26.516002  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:26.516228  6120 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:26.516268  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:26.519919  6086 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:26.520104  6031 raft_consensus.cc:697] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:26.521610  6031 consensus_queue.cc:237] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:26.526567  6140 consensus_queue.cc:1059] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:26.527127  1705 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:26.528744  6140 raft_consensus.cc:3055] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:26.529218  6140 raft_consensus.cc:740] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:26.530718  6140 consensus_queue.cc:260] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:26.541992  1589 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2814) took 2270 ms (client timeout 1743 ms). Trace:
I20260709 13:02:26.432998  5930 raft_consensus.cc:697] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:26.472664  6124 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:26.489179  1666 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 2677) took 3153 ms (client timeout 3074 ms). Trace:
I20260709 13:02:26.489329  5865 raft_consensus.cc:3055] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:26.488513  5777 raft_consensus.cc:3055] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:26.490732  5942 raft_consensus.cc:1081] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:02:26.491858  1667 raft_consensus.cc:1240] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:26.512141  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:26.513878  6108 consensus_queue.cc:260] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:26.403811  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:26.538717  1705 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
W20260709 13:02:26.583922  1589 rpcz_store.cc:269] 0709 13:02:24.271256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.271406 (+   150us) service_pool.cc:224] Handling call
0709 13:02:26.541681 (+2270275us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54003e9ed4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:26.541820 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2741979904}
W20260709 13:02:26.600260  1666 rpcz_store.cc:269] 0709 13:02:23.336099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.336239 (+   140us) service_pool.cc:224] Handling call
0709 13:02:24.937503 (+1601264us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b5800155a98. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7de6ab71 00007f1b7de6aeee 0000000000375939 00007f1b85ede1e0 00007f1b85fa70c4 00007f1b85fa7131 00007f1b85f550a0 00007f1b85f54984 00007f1b7f4cf6d4 00007f1b7f4cf662
0709 13:02:26.488842 (+1551339us) spinlock_profiling.cc:243] Waited 546 ms on lock 0x7b5400242054. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:26.489071 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1259557632}
W20260709 13:02:26.581929  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 110240us
I20260709 13:02:26.609128  1739 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 10.
I20260709 13:02:26.610839  2426 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:26.611923  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:26.612402  2426 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:26.610126  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:26.532161  6000 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:26.541225  6109 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:26.613762  6124 raft_consensus.cc:2804] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:26.601806  5930 consensus_queue.cc:237] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:26.532339  6120 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:26.614790  6140 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:26.616317  5914 raft_consensus.cc:2749] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:26.617599  6108 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:26.614481  6124 raft_consensus.cc:697] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:26.602061  5865 raft_consensus.cc:740] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:26.619091  6124 consensus_queue.cc:237] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:26.619910  5865 consensus_queue.cc:260] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:26.593554  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 164563us
I20260709 13:02:26.621860  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:26.617609  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:26.609759  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 71204.6us
I20260709 13:02:26.585609  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:26.625528  2426 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:26.429327  1735 raft_consensus.cc:2468] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 6.
I20260709 13:02:26.627971  1732 raft_consensus.cc:2393] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 14: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:26.628340  1740 raft_consensus.cc:1240] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:26.410413  1658 raft_consensus.cc:2468] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 9.
I20260709 13:02:26.629984  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:26.630587  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:26.628419  1705 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:26.631199  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:26.631810  1663 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:26.631824  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:26.628722  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:26.632774  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:26.631850  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:26.628551  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:26.633550  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:26.633524  1666 raft_consensus.cc:2410] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:02:26.634078  1735 raft_consensus.cc:2468] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 5.
I20260709 13:02:26.634287  1658 raft_consensus.cc:2393] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 6: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:26.635078  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:26.488463  6126 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:26.637512  1705 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:26.609133  1734 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 9.
W20260709 13:02:26.603170  6159 log.cc:927] Time spent T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.103s	user 0.005s	sys 0.005s
I20260709 13:02:26.646286  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:26.643265  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:26.566880  6006 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:26.649756  1705 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:26.650861  1734 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 9.
I20260709 13:02:26.662941  1633 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:26.601954  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:26.678329  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:26.667179  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:26.668165  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:26.668377  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:02:26.668985  2426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.680706  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:26.672755  1734 raft_consensus.cc:1240] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 8. Current term is 10. Ops: []
I20260709 13:02:26.673768  1633 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:26.460772  5574 consensus_queue.cc:1048] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.179s
I20260709 13:02:26.683488  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:26.684381  1633 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:26.685109  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:26.685832  1660 raft_consensus.cc:2393] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 11: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:26.608294  5777 raft_consensus.cc:740] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:26.683001  6000 raft_consensus.cc:2749] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:26.649422  5916 raft_consensus.cc:2804] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:26.637501  5914 raft_consensus.cc:2804] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:26.693704  1732 raft_consensus.cc:2393] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 13: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:26.695798  5916 raft_consensus.cc:697] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:26.696079  5777 consensus_queue.cc:260] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:26.697485  5777 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:26.698040  5914 raft_consensus.cc:697] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:26.699138  5914 consensus_queue.cc:237] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:26.649192  6107 raft_consensus.cc:2804] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:26.696976  5916 consensus_queue.cc:237] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:26.691305  1633 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:26.707243  6126 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:26.707791  5769 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:26.708525  6107 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:26.678162  5885 raft_consensus.cc:2749] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:26.719818  1707 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:26.721519  1633 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:26.689890  6067 raft_consensus.cc:2804] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:26.692219  6073 raft_consensus.cc:2749] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:26.692466  6068 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:26.683348  6109 consensus_queue.cc:1059] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:02:26.689284  6050 consensus_queue.cc:1048] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:02:26.451683  6148 consensus_queue.cc:260] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:26.730726  6000 raft_consensus.cc:2749] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:26.726996  6107 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:26.730232  5999 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:26.691668  6166 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:26.747030  6029 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:26.768873  1662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3451) took 1565 ms. Trace:
I20260709 13:02:26.753980  6073 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:26.736564  6067 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:26.745939  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:26.776121  1662 rpcz_store.cc:276] 0709 13:02:25.203474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.880360 (+676886us) service_pool.cc:224] Handling call
0709 13:02:25.894746 (+ 14386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:26.018507 (+123761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:26.768571 (+750064us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b5400043654. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:26.768795 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":282701696}
I20260709 13:02:26.769153  2550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49218 (request call id 261) took 1128 ms. Trace:
I20260709 13:02:26.781844  2550 rpcz_store.cc:276] 0709 13:02:25.640759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.640892 (+   133us) service_pool.cc:224] Handling call
0709 13:02:26.768891 (+1127999us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b540078b9d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:26.769048 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":535868288}
I20260709 13:02:26.803841  1738 raft_consensus.cc:1240] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:26.805019  1732 raft_consensus.cc:1275] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:26.756271  6126 consensus_queue.cc:1048] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:02:26.785734  6067 raft_consensus.cc:3060] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:26.777917  6166 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:26.840137  6112 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:26.842690  6145 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:26.844794  6111 log.cc:927] Time spent T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 2.067s	user 0.012s	sys 0.000s
I20260709 13:02:26.845335  6145 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 12 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:26.889640  1490 catalog_manager.cc:5697] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 4 to 5, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:26.895011  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 438774us
W20260709 13:02:26.895041  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 494925us
W20260709 13:02:26.898079  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:26.899104  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.900374  1490 catalog_manager.cc:5697] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:26.903391  1489 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55132 (request call id 306) took 20283 ms (client timeout 15000 ms). Trace:
I20260709 13:02:26.972486  5574 consensus_queue.cc:1048] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:26.975450  5574 consensus_queue.cc:1059] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:26.977957  5738 consensus_queue.cc:1059] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:26.979256  5738 consensus_queue.cc:1048] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:26.980187  5738 consensus_queue.cc:1243] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer 5bb87fe07da2414e84ee578c3b176ede log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:02:26.979434  1490 catalog_manager.cc:5697] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 6 to 9, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 9 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:26.907445  1583 raft_consensus.cc:1275] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:02:26.911099  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:27.010958  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:27.011904  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:26.914055  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 264248us
I20260709 13:02:26.914788  1667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3438) took 1830 ms. Trace:
I20260709 13:02:27.016383  5919 consensus_queue.cc:1048] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:02:26.918262  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 184552us
I20260709 13:02:27.021878  5885 consensus_queue.cc:1048] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:26.918628  1732 raft_consensus.cc:1240] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 5. Current term is 6. Ops: []
W20260709 13:02:26.920466  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 198868us
I20260709 13:02:26.921729  1650 tablet_service.cc:1558] Processing DeleteTablet for tablet c9831da869404fb79a22d3887701ca69 with delete_type TABLET_DATA_TOMBSTONED (TS 5bb87fe07da2414e84ee578c3b176ede not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:39130
I20260709 13:02:27.024359  1667 rpcz_store.cc:276] 0709 13:02:25.084623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.792134 (+707511us) service_pool.cc:224] Handling call
0709 13:02:26.491473 (+699339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:26.608751 (+117278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:26.914211 (+305460us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b5400242050. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8e8ad 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:26.914500 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1584425216}
I20260709 13:02:26.922828  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:26.940649  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:27.027263  1633 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:26.949810  2552 raft_consensus.cc:2393] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 12: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:02:27.032024  2543 raft_consensus.cc:1240] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:02:27.015550  1705 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:26.718429  1558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.038087  1705 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:26.973234  1489 rpcz_store.cc:269] 0709 13:02:06.619844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.620016 (+   172us) service_pool.cc:224] Handling call
0709 13:02:26.902988 (+20282972us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:18.314003 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:18.314660 (+   657us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:18.314721 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:02:18.314735 (+    14us) tablet.cc:662] Decoding operations
0709 13:02:18.419278 (+104543us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:18.419387 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:18.419431 (+    44us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:02:18.421192 (+  1761us) tablet.cc:701] Row locks acquired
0709 13:02:18.421253 (+    61us) write_op.cc:260] PREPARE: finished
0709 13:02:18.421456 (+   203us) write_op.cc:270] Start()
0709 13:02:18.421636 (+   180us) write_op.cc:276] Timestamp: P: 1783602138421376 usec, L: 0
0709 13:02:18.421681 (+    45us) op_driver.cc:348] REPLICATION: starting
0709 13:02:18.422635 (+   954us) log.cc:844] Serialized 6348 byte log entry
0709 13:02:19.281852 (+859217us) op_driver.cc:464] REPLICATION: finished
0709 13:02:19.473595 (+191743us) write_op.cc:301] APPLY: starting
0709 13:02:19.510937 (+ 37342us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:21.518517 (+2007580us) spinlock_profiling.cc:243] Waited 31 ms on lock 0x7b180033f760. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b80cce0ec 00007f1b80cd0af7 00007f1b80cd1fb0 00007f1b849e61bb 00007f1b849e6532 00007f1b84a2db93 00007f1b848dade3 00007f1b848da6ab 00007f1b848dbe77
0709 13:02:21.520638 (+  2121us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:21.520687 (+    49us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:22.413660 (+892973us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:22.519118 (+105458us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 13:02:22.535433 (+ 16315us) write_op.cc:312] APPLY: finished
0709 13:02:22.599272 (+ 63839us) log.cc:844] Serialized 148 byte log entry
0709 13:02:22.874527 (+275255us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:22.931322 (+ 56795us) write_op.cc:454] Released schema lock
0709 13:02:22.952275 (+ 20953us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:23.055060 (+102785us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:23.055102 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":22490,"reported_tablets":31,"spinlock_wait_cycles":3968,"child_traces":[["op",{"apply.queue_time_us":132530,"apply.run_cpu_time_us":86652,"apply.run_wall_time_us":3585384,"cfile_cache_hit":62,"cfile_cache_hit_bytes":64790,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6217,"cfile_init":2,"lbm_read_time_us":1678,"lbm_reads_lt_1ms":12,"num_ops":16,"prepare.queue_time_us":133892,"prepare.run_cpu_time_us":31122,"prepare.run_wall_time_us":260272,"raft.queue_time_us":422780,"raft.run_cpu_time_us":4391,"raft.run_wall_time_us":151091,"replication_time_us":840141,"spinlock_wait_cycles":71202176,"thread_start_us":791472,"threads_started":5,"wal-append.queue_time_us":780157,"wal-append.run_cpu_time_us":40079,"wal-append.run_wall_time_us":2608373}]]}
I20260709 13:02:27.040072  5885 raft_consensus.cc:2749] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:26.993580  5777 consensus_queue.cc:1048] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:26.998333  5865 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:27.007500  5940 raft_consensus.cc:2749] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:27.008301  5930 consensus_queue.cc:1048] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:27.008713  5960 raft_consensus.cc:3055] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:27.041571  5960 raft_consensus.cc:740] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:27.042995  5960 consensus_queue.cc:260] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:27.027797  1587 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:26.986745  5574 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.049611  5574 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:27.008862  5921 raft_consensus.cc:3055] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:27.039395  5980 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:27.051671  5921 raft_consensus.cc:740] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:27.052590  5980 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.020696  1707 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:27.043422  5942 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.044790  5960 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:27.053507  5921 consensus_queue.cc:260] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:27.084131  6169 log.cc:927] Time spent T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
I20260709 13:02:27.084466  5921 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:27.086946  6129 consensus_meta.cc:287] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.949s	user 0.007s	sys 0.006s
I20260709 13:02:27.087781  6129 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:27.091537  2523 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 12.
I20260709 13:02:27.093771  2552 raft_consensus.cc:1240] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 12. Current term is 13. Ops: []
W20260709 13:02:27.097589  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 59714.9us
I20260709 13:02:27.098465  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:27.100204  6170 log.cc:927] Time spent T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
I20260709 13:02:27.105412  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:27.108305  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 162574us
I20260709 13:02:27.097631  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:27.125687  5974 raft_consensus.cc:2749] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:27.126977  6129 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:27.128391  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 107791us
I20260709 13:02:27.128804  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:27.129459  1707 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:27.053510  5980 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:27.131513  1707 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
W20260709 13:02:27.133381  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 43677.2us
I20260709 13:02:27.133447  6124 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:27.134451  6124 raft_consensus.cc:2804] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:27.134984  6124 raft_consensus.cc:697] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:27.135226  5885 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:27.135736  5885 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:27.136160  5885 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:27.147372  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 48328us
W20260709 13:02:27.152606  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 125615us
I20260709 13:02:27.153697  1633 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:27.157249  5942 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:27.160480  5942 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:27.161501  6129 raft_consensus.cc:2804] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:27.162344  6129 raft_consensus.cc:697] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:27.163753  6129 consensus_queue.cc:237] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:27.156837  1633 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
W20260709 13:02:27.176033  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 57475.5us
W20260709 13:02:27.195839  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 77689.2us
I20260709 13:02:27.196671  1587 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 12.
I20260709 13:02:27.198269  1589 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
W20260709 13:02:27.203200  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 46503.3us
I20260709 13:02:27.169544  1490 catalog_manager.cc:5697] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 5 to 6, leader changed from 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 6 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:02:27.136264  6124 consensus_queue.cc:237] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:27.215731  1705 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:27.273161  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:27.230973  6006 raft_consensus.cc:2804] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:27.183079  5777 consensus_queue.cc:1059] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.036s
W20260709 13:02:27.227974  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.272697  1490 catalog_manager.cc:5697] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 8 to 11, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 11 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:27.271924  2426 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:02:27.286804  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 70182.3us
W20260709 13:02:27.236011  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 48566.4us
W20260709 13:02:27.301373  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.275722  6006 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:27.228442  5769 consensus_meta.cc:287] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.501s	user 0.014s	sys 0.002s
I20260709 13:02:27.253257  5980 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:27.273655  6127 consensus_meta.cc:287] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.773s	user 0.020s	sys 0.000s
I20260709 13:02:27.230614  1633 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:27.225003  1558 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:27.224346  1665 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:02:27.236411  6073 raft_consensus.cc:2749] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:27.329335  1659 raft_consensus.cc:1240] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 5. Current term is 6. Ops: []
W20260709 13:02:27.330489  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 58842.6us
I20260709 13:02:27.226593  6166 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:27.353538  1589 raft_consensus.cc:1275] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:02:27.354017  6166 consensus_queue.cc:1059] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:27.355008  6166 raft_consensus.cc:3055] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:27.355355  6166 raft_consensus.cc:740] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:27.356063  6031 consensus_queue.cc:1048] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:27.348268  6073 consensus_queue.cc:1048] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:27.350107  5960 consensus_queue.cc:1048] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:27.317655  6006 raft_consensus.cc:3060] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:27.363163  6073 raft_consensus.cc:2804] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:02:27.363682  6107 consensus_meta.cc:287] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.591s	user 0.011s	sys 0.000s
I20260709 13:02:27.364089  6053 raft_consensus.cc:3055] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:27.226783  6178 consensus_queue.cc:1059] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.190s
I20260709 13:02:27.365319  6125 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.369364  5974 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:27.370352  6050 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:27.371049  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 140640us
I20260709 13:02:27.372552  2553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49222 (request call id 544) took 1264 ms. Trace:
I20260709 13:02:27.331257  5942 consensus_queue.cc:1059] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:02:27.374006  5885 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:27.377414  6120 consensus_meta.cc:287] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.745s	user 0.004s	sys 0.013s
I20260709 13:02:27.334430  1490 catalog_manager.cc:5697] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 6 to 8, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 8 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:27.353968  6086 consensus_meta.cc:287] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.833s	user 0.006s	sys 0.010s
W20260709 13:02:27.391307  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.356464  6166 consensus_queue.cc:260] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:27.372936  5769 raft_consensus.cc:2804] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:27.387996  6053 raft_consensus.cc:740] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:27.420346  5769 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.420871  5769 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:27.421741  6053 consensus_queue.cc:260] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:27.423368  6053 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:27.425311  5960 raft_consensus.cc:2804] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:27.425872  5960 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:27.406440  6107 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:27.372848  6029 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:27.428990  6029 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:27.384596  6127 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:27.430227  6068 raft_consensus.cc:3055] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:27.386332  6073 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.430964  6073 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:27.431540  6127 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:27.431309  6125 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:27.392618  2553 rpcz_store.cc:276] 0709 13:02:26.108019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.108269 (+   250us) service_pool.cc:224] Handling call
0709 13:02:26.125701 (+ 17432us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:26.352685 (+226984us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:26.352832 (+   147us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:26.419461 (+ 66629us) log.cc:844] Serialized 52 byte log entry
0709 13:02:26.949687 (+530226us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:26.949790 (+   103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:26.949926 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:27.372136 (+422210us) raft_consensus.cc:1685] finished
0709 13:02:27.372158 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:27.372349 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33271,"raft.queue_time_us":45204,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":27083,"thread_start_us":379396,"threads_started":1,"wal-append.queue_time_us":799845}
I20260709 13:02:27.432314  6120 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:27.433876  1630 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:27.434599  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:27.435041  1736 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 11.
I20260709 13:02:27.434623  6050 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:27.419876  6166 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:27.438253  6129 raft_consensus.cc:2804] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:27.438932  6129 raft_consensus.cc:697] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 12 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:27.441574  5942 raft_consensus.cc:3055] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:27.442241  5942 raft_consensus.cc:740] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:27.443902  5942 consensus_queue.cc:260] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:27.430653  6068 raft_consensus.cc:740] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:27.446520  6068 consensus_queue.cc:260] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:27.440657  6129 consensus_queue.cc:237] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:27.452536  6148 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:27.453440  6178 raft_consensus.cc:3055] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:27.453881  6178 raft_consensus.cc:740] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:27.454895  6178 consensus_queue.cc:260] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:27.456418  6178 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:27.457828  6190 log.cc:927] Time spent T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:02:27.430609  6054 raft_consensus.cc:2804] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:27.461364  5980 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:27.460666  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:27.462001  6054 raft_consensus.cc:697] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:27.462817  1736 raft_consensus.cc:2393] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 10: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:27.463313  6054 consensus_queue.cc:237] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:27.464210  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:27.370375  6184 tablet_replica.cc:333] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:02:27.419412  5974 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:27.468096  5974 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:27.237850  6067 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:27.477521  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:27.479462  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 254826us
I20260709 13:02:27.484316  6107 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:27.480355  6068 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:27.480680  5960 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:27.497321  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 168461us
I20260709 13:02:27.499747  1707 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:27.462052  5980 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:27.481681  5974 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:27.533607  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 346295us
I20260709 13:02:27.516583  5885 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:27.536623  1707 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:27.537175  1660 raft_consensus.cc:1240] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:27.538261  6112 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.538462  6029 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:27.540246  5980 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:27.521838  5942 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:27.566992  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:27.554075  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:27.579087  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.604475  1705 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:27.553198  6125 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:27.658021  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:27.616712  6181 log.cc:927] Time spent T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:02:27.617069  1558 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:27.660971  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:27.580138  5921 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:27.663805  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.667485  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:27.669126  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:27.669971  1583 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 9.
I20260709 13:02:27.671025  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:27.622315  5769 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:27.675431  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:27.573599  6050 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:27.677691  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:27.527170  5974 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:27.678874  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 142383us
I20260709 13:02:27.680419  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:27.680610  5974 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:27.676694  5769 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:27.681695  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:27.683854  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:27.683845  5885 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.685853  5885 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:27.688112  2554 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 11.
I20260709 13:02:27.688246  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:27.688464  5885 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:27.689067  6173 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.689662  5574 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:27.689719  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
W20260709 13:02:27.692338  2424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.578415  6067 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:27.698792  5980 raft_consensus.cc:2804] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:27.688987  1583 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 11.
I20260709 13:02:27.684614  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:27.702736  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:02:27.705145  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:27.706168  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.692951  1707 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:27.619104  6124 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:27.605630  6112 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:27.616410  6194 raft_consensus.cc:2804] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:27.715734  1587 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 7.
I20260709 13:02:27.573225  6172 raft_consensus.cc:2749] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:27.609885  6029 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.719241  6107 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:27.720414  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:27.712868  5980 raft_consensus.cc:697] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 13 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:27.732210  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:27.673061  5960 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:27.737056  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 132701us
I20260709 13:02:27.722167  5930 raft_consensus.cc:2749] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:27.742997  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:27.729732  6194 raft_consensus.cc:697] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 10 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:27.730865  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:27.753679  5980 consensus_queue.cc:237] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:27.753937  6073 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:27.689735  6173 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:27.745833  1737 raft_consensus.cc:1240] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:27.749794  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 145730us
I20260709 13:02:27.750691  1590 raft_consensus.cc:1275] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:27.752002  1587 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 14.
I20260709 13:02:27.731799  6124 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:27.767627  1705 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:27.732383  5921 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:27.780375  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:27.770850  1707 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:27.783439  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:27.784631  6192 log.cc:927] Time spent T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.063s	user 0.002s	sys 0.000s
I20260709 13:02:27.784860  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:27.785202  6112 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:27.786129  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:27.786895  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:27.787153  1732 raft_consensus.cc:2393] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 10: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:27.787638  1736 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 15.
I20260709 13:02:27.783741  1583 raft_consensus.cc:1240] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:27.781158  1740 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 18.
I20260709 13:02:27.786173  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:27.790391  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:27.740001  6029 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:27.793503  1586 raft_consensus.cc:1240] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 9. Current term is 10. Ops: [8.7-9.8]
I20260709 13:02:27.778946  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:27.798450  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:27.799275  1741 raft_consensus.cc:3060] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:27.801684  6173 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:27.804404  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:27.807639  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:27.808423  1660 raft_consensus.cc:2393] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 9: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:27.794373  1558 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:02:27.810703  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 52874.7us
I20260709 13:02:27.809501  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:27.817485  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:27.817946  1664 raft_consensus.cc:1240] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:27.819800  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:27.818040  1662 raft_consensus.cc:1240] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:27.821190  5960 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:27.821898  6073 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:27.793843  5885 raft_consensus.cc:2749] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:27.826787  5921 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:27.828289  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 51461.8us
I20260709 13:02:27.828524  6029 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:27.829131  1558 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:27.829598  1659 raft_consensus.cc:2368] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for earlier term 12. Current term is 13.
I20260709 13:02:27.830555  1558 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:27.830577  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:27.831122  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:27.831421  1658 raft_consensus.cc:1240] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:27.826586  5713 consensus_queue.cc:1048] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:02:27.832438  5930 raft_consensus.cc:2749] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:27.830657  1665 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 2695) took 3677 ms (client timeout 3233 ms). Trace:
I20260709 13:02:27.796530  6194 consensus_queue.cc:237] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:27.809386  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:27.833647  1738 raft_consensus.cc:2393] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 9: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:27.834132  1735 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 14.
I20260709 13:02:27.837345  1707 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:27.838485  5885 raft_consensus.cc:2749] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:27.841193  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:27.841857  1583 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 12.
I20260709 13:02:27.842760  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:27.843020  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:27.843853  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:27.846980  1590 raft_consensus.cc:1240] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:27.848160  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:27.833128  1665 rpcz_store.cc:269] 0709 13:02:24.153292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.737323 (+584031us) service_pool.cc:224] Handling call
0709 13:02:27.830399 (+3093076us) spinlock_profiling.cc:243] Waited 2.45 s on lock 0x7b540040ddd4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:27.830536 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5623632256}
W20260709 13:02:27.859213  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 91665.9us
W20260709 13:02:27.862188  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.871304  1583 raft_consensus.cc:2393] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 9: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:02:27.868607  1591 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 14.
I20260709 13:02:27.876761  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:27.872740  6173 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:27.877739  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:27.879895  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:27.880300  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:27.875883  1558 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:27.870740  5930 raft_consensus.cc:2804] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:27.890599  1665 raft_consensus.cc:1240] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:27.868799  5574 raft_consensus.cc:2764] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:02:27.883745  1633 leader_election.cc:336] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.535s (SENT)
I20260709 13:02:27.883330  6173 raft_consensus.cc:697] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 10 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
W20260709 13:02:27.894908  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.875186  6124 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:27.896474  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:02:27.893054  2554 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49218 (request call id 267) took 1311 ms (client timeout 1522 ms). Trace:
I20260709 13:02:27.903330  1705 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:27.901705  2554 rpcz_store.cc:269] 0709 13:02:26.582143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.582315 (+   172us) service_pool.cc:224] Handling call
0709 13:02:27.883703 (+1301388us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400812ed4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:27.892960 (+  9257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2445499136}
I20260709 13:02:27.906006  1590 raft_consensus.cc:2393] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 10: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:27.909474  1633 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:27.858729  6006 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:27.910892  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:27.871672  6166 consensus_queue.cc:1048] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:02:27.913983  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:27.922832  1705 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:27.927251  6173 consensus_queue.cc:237] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:27.893386  5930 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:27.929560  5930 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:27.921545  6124 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:27.943316  6124 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:27.945312  1630 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:27.946359  6029 raft_consensus.cc:2804] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:27.946753  6029 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.947235  6029 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:27.953359  1665 raft_consensus.cc:1240] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:27.917683  1737 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:27.958894  1587 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 11.
I20260709 13:02:27.960798  1588 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 6.
I20260709 13:02:27.965683  1741 raft_consensus.cc:2468] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 6.
I20260709 13:02:27.900183  5885 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:27.921743  6107 raft_consensus.cc:2804] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:27.906452  6086 raft_consensus.cc:2804] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:27.973284  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:27.973779  6073 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:27.974467  6073 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:27.975795  6086 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.976275  6086 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:27.977246  6073 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:27.965160  6172 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:27.980403  6172 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:27.983049  6172 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:27.986320  2553 raft_consensus.cc:1275] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:27.987672  6126 raft_consensus.cc:2749] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:27.988328  6202 consensus_queue.cc:1048] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:27.992190  6029 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:27.994768  6178 consensus_meta.cc:287] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.538s	user 0.006s	sys 0.009s
W20260709 13:02:27.995631  6199 log.cc:927] Time spent T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
W20260709 13:02:27.995498  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 124690us
I20260709 13:02:27.997129  6202 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.006656  1558 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:27.997157  6006 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:28.000171  6107 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:28.002571  6068 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:02:28.017494  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 94809.4us
W20260709 13:02:28.035323  1633 leader_election.cc:336] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.628s (SENT)
I20260709 13:02:28.017217  6202 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:28.035902  1633 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:28.039242  1737 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
I20260709 13:02:28.014287  6124 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:28.008213  1665 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39146
I20260709 13:02:28.049355  1665 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:28.049866  1665 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:28.008507  5885 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:28.032711  6107 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:28.054154  1705 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:28.011807  1587 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67b5a70a2de54935b60554301e6de808"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:02:28.046779  5942 raft_consensus.cc:2749] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:28.033396  6178 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:28.064512  1662 raft_consensus.cc:1275] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:28.059190  1587 raft_consensus.cc:606] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:02:28.066730  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:28.069416  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 62933.9us
I20260709 13:02:28.048568  6006 raft_consensus.cc:2749] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:28.070268  1587 raft_consensus.cc:614] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:02:28.072676  6205 log.cc:927] Time spent T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.164s	user 0.004s	sys 0.000s
W20260709 13:02:28.097929  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 62682.4us
W20260709 13:02:28.099218  1633 leader_election.cc:336] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.666s (SENT)
I20260709 13:02:28.099792  1633 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:28.103360  5930 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:28.108759  1588 raft_consensus.cc:1240] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:28.111999  1664 raft_consensus.cc:1240] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 13:02:28.112850  1660 raft_consensus.cc:1240] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:02:28.113884  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:28.114542  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:28.115412  1660 raft_consensus.cc:1275] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:02:28.080189  6124 raft_consensus.cc:2749] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:28.118088  1705 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:02:28.138990  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.139509  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:28.140249  1663 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:02:28.140082  1665 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:28.147132  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:28.152144  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 68478.5us
I20260709 13:02:28.117154  6112 raft_consensus.cc:2749] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:28.162935  1660 raft_consensus.cc:1275] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:28.080881  6178 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:28.117132  5515 consensus_queue.cc:1059] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
W20260709 13:02:28.166203  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 174399us
I20260709 13:02:28.168129  1665 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:28.160522  6210 log.cc:927] Time spent T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:02:28.160795  6194 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:28.176299  1589 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 11.
I20260709 13:02:28.159298  6126 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
W20260709 13:02:28.181022  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:28.182430  6212 log.cc:927] Time spent T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.067s	user 0.002s	sys 0.000s
I20260709 13:02:28.162539  6129 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:28.187163  6209 log.cc:927] Time spent T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:02:28.189272  6028 consensus_queue.cc:1059] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:02:28.190055  6076 consensus_queue.cc:1059] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
W20260709 13:02:28.199653  2424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.205067  6126 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:28.179234  5885 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:28.209052  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 120334us
I20260709 13:02:28.213268  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:28.213922  2543 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:28.218261  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.193495  5515 consensus_queue.cc:1243] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer 5bb87fe07da2414e84ee578c3b176ede log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:02:28.213054  5721 consensus_queue.cc:1048] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:02:28.221390  1556 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:28.201238  6029 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:28.245193  1558 leader_election.cc:400] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for earlier term 12. Current term is 13.
I20260709 13:02:28.245664  1558 leader_election.cc:403] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
W20260709 13:02:28.246248  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 47686.2us
I20260709 13:02:28.248129  6053 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:28.254127  6107 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:28.254185  5960 consensus_queue.cc:1048] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:28.256464  6081 raft_consensus.cc:3055] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:28.209571  6129 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:28.211477  6202 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:28.262964  5930 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:28.284986  5930 raft_consensus.cc:2749] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:28.266841  6148 raft_consensus.cc:3055] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:28.261010  6086 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:28.286331  6148 raft_consensus.cc:740] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:28.288107  6086 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:28.287583  6148 consensus_queue.cc:260] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:28.289527  1591 raft_consensus.cc:2393] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 9: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
W20260709 13:02:28.269757  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.275472  1633 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:28.275866  6202 consensus_queue.cc:1059] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:02:28.292023  1633 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:28.293071  1633 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:28.275158  6074 raft_consensus.cc:3055] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:28.275866  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:28.293805  6006 raft_consensus.cc:3055] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:28.294094  6068 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:02:28.296458  2426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:28.279723  6214 log.cc:927] Time spent T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.069s	user 0.001s	sys 0.001s
I20260709 13:02:28.265430  6129 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:28.279258  6194 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:28.301664  6074 raft_consensus.cc:740] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:28.322638  6006 raft_consensus.cc:740] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:28.274222  5574 consensus_queue.cc:1059] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:02:28.323714  6068 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:28.285632  6081 raft_consensus.cc:740] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:28.321950  6148 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:28.335070  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:28.324790  6126 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:28.352638  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:28.357569  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:28.357975  6074 consensus_queue.cc:260] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:28.359941  6074 raft_consensus.cc:3060] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:28.382553  6184 raft_consensus.cc:2243] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.383885  6184 raft_consensus.cc:2272] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.388482  6053 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for earlier term 12. Current term is 13.
I20260709 13:02:28.348749  6068 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:28.401556  6006 consensus_queue.cc:260] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:28.402865  6006 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:28.345044  6129 raft_consensus.cc:2804] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:28.404206  6129 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:28.404608  6129 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:28.396986  6107 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:28.413854  6107 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:28.414860  6107 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:28.416414  6028 consensus_queue.cc:1059] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:28.392671  6178 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:28.435647  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 92978.2us
W20260709 13:02:28.445842  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 228106us
I20260709 13:02:28.448216  5921 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.451412  6166 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:28.452023  6166 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:28.452816  1740 raft_consensus.cc:1240] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:28.454124  6166 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:28.454291  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:28.455241  1741 raft_consensus.cc:2410] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:02:28.456027  1736 raft_consensus.cc:1240] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:28.457541  5942 raft_consensus.cc:3055] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:28.457926  5942 raft_consensus.cc:740] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:28.458721  5942 consensus_queue.cc:260] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:28.459966  5942 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:28.461076  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:28.418387  6081 consensus_queue.cc:260] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:28.467862  1736 raft_consensus.cc:1275] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:02:28.468292  1736 pending_rounds.cc:85] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 6
W20260709 13:02:28.472688  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 179670us
I20260709 13:02:28.474261  1633 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:28.468544  1736 pending_rounds.cc:107] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:02:28.448817  5921 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:28.476868  1736 raft_consensus.cc:2889] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:28.483991  1558 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:28.486264  1556 leader_election.cc:400] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Vote denied by peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683) with higher term. Message: Invalid argument: T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for earlier term 12. Current term is 13.
W20260709 13:02:28.500639  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 164478us
I20260709 13:02:28.493769  5574 consensus_queue.cc:1059] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:02:28.483165  6086 consensus_queue.cc:1059] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:02:28.509153  5574 raft_consensus.cc:3055] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:28.509598  5574 raft_consensus.cc:740] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:28.509747  5930 raft_consensus.cc:3055] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:28.510236  5930 raft_consensus.cc:740] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:28.510579  5574 consensus_queue.cc:260] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:28.511101  5930 consensus_queue.cc:260] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:28.511961  5574 raft_consensus.cc:3060] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:28.512486  5930 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:28.513478  1741 raft_consensus.cc:1275] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:02:28.500825  6053 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:28.525748  6081 raft_consensus.cc:3060] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:28.534832  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 48745.5us
W20260709 13:02:28.537914  2426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:28.548770  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 64858.6us
I20260709 13:02:28.561691  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:28.562976  1741 raft_consensus.cc:2410] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:02:28.563917  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:28.574528  1740 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:28.524998  6068 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:28.583096  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:28.583832  6230 raft_consensus.cc:2804] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:28.583978  1736 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 10.
I20260709 13:02:28.584663  6230 raft_consensus.cc:697] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:28.585686  6230 consensus_queue.cc:237] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:28.593261  6053 consensus_queue.cc:1048] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:02:28.597580  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.597441  6184 ts_tablet_manager.cc:1916] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:28.566213  5960 consensus_queue.cc:1059] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:02:28.600893  5960 consensus_queue.cc:1243] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer 5bb87fe07da2414e84ee578c3b176ede log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:02:28.570734  6107 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:28.629665  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:28.610239  6126 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.629415  6202 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:28.645124  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:28.646473  1741 raft_consensus.cc:2376] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 9. Re-sending same reply.
W20260709 13:02:28.650120  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 175959us
I20260709 13:02:28.634305  2543 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 12.
I20260709 13:02:28.655248  1741 raft_consensus.cc:1240] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:28.675431  6225 log.cc:927] Time spent T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:02:28.644807  6068 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:28.635021  5960 consensus_queue.cc:1048] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:02:28.652160  6126 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:28.635919  6129 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:28.678989  6129 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:28.679646  6126 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:28.680142  1633 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:28.689536  1737 raft_consensus.cc:1240] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:28.689358  1630 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:02:28.691347  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.656322  6229 consensus_queue.cc:1059] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:02:28.742846  6229 consensus_queue.cc:1243] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer 5bb87fe07da2414e84ee578c3b176ede log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:02:28.743510  5960 raft_consensus.cc:3055] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:28.743887  5960 raft_consensus.cc:740] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:28.744380  1666 raft_consensus.cc:1275] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:28.744903  5960 consensus_queue.cc:260] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:28.695154  6129 raft_consensus.cc:2804] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:28.698215  6068 raft_consensus.cc:2804] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:28.704571  2426 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:28.707326  5721 consensus_queue.cc:1048] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:28.708329  5515 consensus_queue.cc:1048] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:28.715835  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:28.716281  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:28.760819  1741 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:28.717201  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:28.718691  1735 raft_consensus.cc:1275] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:02:28.718991  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:28.719920  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:28.720177  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:28.717234  5921 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:28.728044  6239 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.728721  6233 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:28.733436  6232 log.cc:927] Time spent T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
W20260709 13:02:28.737219  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.740702  6231 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:28.752064  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.757716  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:28.860857  1741 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 12.
W20260709 13:02:28.759482  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 157099us
I20260709 13:02:28.740700  6202 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:28.766372  1732 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:28.861830  6202 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:28.862607  1556 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:28.852125  6240 raft_consensus.cc:2804] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:28.865664  6240 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:28.866266  6240 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:28.866539  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:28.867334  2523 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:02:28.867247  1733 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:28.868669  1558 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:28.874553  6128 consensus_queue.cc:1059] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:28.875841  6128 raft_consensus.cc:2749] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:28.877321  6246 consensus_queue.cc:1048] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:28.879279  5921 raft_consensus.cc:3055] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:28.879689  5921 raft_consensus.cc:740] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:28.766753  1737 raft_consensus.cc:3060] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:28.877482  5574 raft_consensus.cc:2749] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:28.877590  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 173070us
I20260709 13:02:28.884425  6231 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:28.763090  1739 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
I20260709 13:02:28.761883  6129 raft_consensus.cc:697] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:28.889950  6129 consensus_queue.cc:237] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:28.893174  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:28.893908  1658 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
I20260709 13:02:28.897418  5960 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:28.897202  6233 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:28.880455  5921 consensus_queue.cc:260] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:28.900190  5921 raft_consensus.cc:3060] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:28.909621  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:28.851291  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:28.913940  6231 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:28.876958  6128 consensus_queue.cc:1048] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:02:28.916926  1735 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:28.918556  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:28.806020  6239 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:28.920083  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:28.920822  1663 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
I20260709 13:02:28.921629  6233 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:28.930990  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 47261.7us
I20260709 13:02:28.931643  6202 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:28.757750  1740 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 13.
I20260709 13:02:28.878204  1667 raft_consensus.cc:1275] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:28.980607  1733 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 16.
I20260709 13:02:28.981025  1662 raft_consensus.cc:1275] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:28.911463  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:28.932542  5515 consensus_queue.cc:1059] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:28.933260  6054 consensus_queue.cc:1059] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:28.936616  5930 raft_consensus.cc:3055] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:28.935798  1732 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
I20260709 13:02:28.938508  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:28.939759  1661 raft_consensus.cc:1240] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:28.940757  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:28.941498  1659 raft_consensus.cc:1275] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:28.943089  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:28.945724  1665 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
I20260709 13:02:28.936740  6239 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:28.966290  6178 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:29.024887  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:29.025104  6178 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:29.026810  1667 raft_consensus.cc:1275] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:29.027523  6178 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:28.977890  1741 pending_rounds.cc:85] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 9
I20260709 13:02:29.027901  1667 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:29.028137  1741 pending_rounds.cc:107] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:02:29.028410  1741 raft_consensus.cc:2889] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:28.836019  2554 raft_consensus.cc:1275] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:02:28.978688  1737 raft_consensus.cc:2468] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 6.
I20260709 13:02:28.763605  6068 raft_consensus.cc:697] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 12 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
W20260709 13:02:29.023490  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 54496.1us
I20260709 13:02:29.023849  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:29.024344  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:29.030403  2426 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:29.023541  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:29.041605  1665 raft_consensus.cc:2393] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 14: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:29.045347  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:29.046096  1663 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:29.047125  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:29.048071  1661 raft_consensus.cc:2410] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 14 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:02:29.038929  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:29.057768  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 193558us
I20260709 13:02:29.031085  6112 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.019483  5930 raft_consensus.cc:740] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:29.063616  1664 raft_consensus.cc:2393] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 11: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:29.024917  6202 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:29.060451  1556 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:29.066377  1658 raft_consensus.cc:1275] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:02:29.067780  1658 pending_rounds.cc:85] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 7
I20260709 13:02:29.068130  1658 pending_rounds.cc:107] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:02:29.068387  1658 raft_consensus.cc:2889] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:29.085269  5916 raft_consensus.cc:2804] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:29.085955  5916 raft_consensus.cc:697] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:29.085558  5930 consensus_queue.cc:260] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:29.086925  5916 consensus_queue.cc:237] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:29.090246  6068 consensus_queue.cc:237] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:29.093135  1659 raft_consensus.cc:1240] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 10. Current term is 11. Ops: [8.9-10.10]
I20260709 13:02:29.093636  1660 raft_consensus.cc:1240] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:29.094040  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:29.094408  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.098290  1663 raft_consensus.cc:1240] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:29.087337  5930 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:29.100421  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 79840.9us
I20260709 13:02:29.102843  5942 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.071050  6229 raft_consensus.cc:2804] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:02:29.100430  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.114112  5942 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:29.115273  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:29.116225  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:29.126430  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:29.126848  1589 raft_consensus.cc:2376] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 11. Re-sending same reply.
I20260709 13:02:29.116281  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:29.117182  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:29.125061  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.127959  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:29.149734  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 281160us
I20260709 13:02:29.129122  1658 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:02:29.189764  1735 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 15.
W20260709 13:02:29.147542  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 45146.7us
I20260709 13:02:29.192246  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:29.195309  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:29.195662  1662 raft_consensus.cc:2393] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 9: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:29.195700  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:29.126784  6229 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.074299  6112 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:29.220360  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:29.223192  1589 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 13.
I20260709 13:02:29.206938  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:29.227160  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:29.225447  1586 raft_consensus.cc:2376] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 6. Re-sending same reply.
I20260709 13:02:29.196794  6178 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.230916  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:29.236822  1588 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
I20260709 13:02:29.238628  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:29.251498  1589 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:29.250419  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:29.218209  6229 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:29.259531  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.254596  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:29.261647  1633 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:02:29.278844  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 67273.3us
W20260709 13:02:29.282262  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 177463us
I20260709 13:02:29.253645  6184 ts_tablet_manager.cc:1929] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.7
I20260709 13:02:29.307865  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:29.252647  6240 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:29.318799  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:29.318931  1592 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:02:29.319087  1589 raft_consensus.cc:1275] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:29.313727  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:29.314702  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:29.320170  1592 raft_consensus.cc:606] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:29.313493  5515 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:29.334899  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 73340.2us
I20260709 13:02:29.298167  6250 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.345399  1667 raft_consensus.cc:1275] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:29.278738  6178 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:29.334161  5515 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:29.306056  6129 raft_consensus.cc:2764] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:02:29.364837  6178 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:29.373009  6178 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:29.373773  6178 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:29.266086  6249 consensus_queue.cc:1059] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:02:29.349467  1584 raft_consensus.cc:2410] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 13:02:29.353489  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.348031  1633 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:29.379843  5942 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:29.381610  6129 raft_consensus.cc:2749] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:29.382520  6129 consensus_queue.cc:1059] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:29.384495  6129 raft_consensus.cc:3055] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:29.356602  2553 raft_consensus.cc:1240] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:29.298012  5574 consensus_queue.cc:1059] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:02:29.386286  5574 raft_consensus.cc:3055] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:29.361122  6112 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:29.362380  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:29.384976  6129 raft_consensus.cc:740] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:29.388119  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:29.388048  6129 consensus_queue.cc:260] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:29.389583  6129 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:29.370783  5515 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:29.386559  1633 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:29.376869  6178 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:29.391515  6112 raft_consensus.cc:2749] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:29.391947  1633 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:29.386664  5574 raft_consensus.cc:740] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:29.392845  6239 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:29.393571  6239 raft_consensus.cc:697] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 14 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:29.393743  5574 consensus_queue.cc:260] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:29.394847  6240 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:29.394687  6239 consensus_queue.cc:237] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:29.395838  5574 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:29.399613  1740 raft_consensus.cc:1275] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:02:29.390112  1737 raft_consensus.cc:1240] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 13:02:29.402215  1737 raft_consensus.cc:1240] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
W20260709 13:02:29.407388  6255 log.cc:927] Time spent T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.217s	user 0.002s	sys 0.000s
I20260709 13:02:29.407337  1633 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:29.412915  6233 raft_consensus.cc:2749] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:29.414932  1738 raft_consensus.cc:1240] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:29.415256  1633 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:29.421271  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:29.423413  1733 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:02:29.400991  1740 raft_consensus.cc:1240] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:02:29.425875  6233 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:29.427042  6251 log.cc:927] Time spent T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.280s	user 0.001s	sys 0.001s
I20260709 13:02:29.431994  6006 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.432633  6006 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:29.434079  6129 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:29.434893  6006 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:29.435315  6129 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:29.439329  6129 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:29.445106  1556 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:29.373639  6257 log.cc:927] Time spent T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.104s	user 0.000s	sys 0.004s
I20260709 13:02:29.452142  5574 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.452612  2543 raft_consensus.cc:1275] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:02:29.453197  1586 raft_consensus.cc:1275] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:02:29.418563  6219 log.cc:927] Time spent T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:02:29.455922  6166 raft_consensus.cc:2749] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:29.474027  5574 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:29.349375  6184 log.cc:1199] T c9831da869404fb79a22d3887701ca69 P 5bb87fe07da2414e84ee578c3b176ede: Deleting WAL directory at /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-1-root/wals/c9831da869404fb79a22d3887701ca69
I20260709 13:02:29.483973  1586 raft_consensus.cc:1275] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:29.386889  2523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49222 (request call id 560) took 1112 ms. Trace:
I20260709 13:02:29.480150  1589 raft_consensus.cc:1275] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:29.340147  6246 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.454321  1556 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:29.491715  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:29.493705  1583 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
I20260709 13:02:29.497993  1592 raft_consensus.cc:1240] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 11. Current term is 12. Ops: [11.10-11.10]
W20260709 13:02:29.499089  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 44854.7us
I20260709 13:02:29.477272  5721 raft_consensus.cc:3055] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:29.504287  5721 raft_consensus.cc:740] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:29.505306  5721 consensus_queue.cc:260] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:29.506541  5721 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:29.507234  6053 raft_consensus.cc:2804] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:29.507813  6053 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.508431  6053 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:29.486887  2523 rpcz_store.cc:276] 0709 13:02:28.274025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.275579 (+  1554us) service_pool.cc:224] Handling call
0709 13:02:29.386699 (+1111120us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b540056f254. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:29.386819 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":859164928}
I20260709 13:02:29.511003  1555 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:29.512249  6128 raft_consensus.cc:2804] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:29.512816  6128 raft_consensus.cc:697] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:29.514016  6128 consensus_queue.cc:237] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:29.507817  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.517784  6129 consensus_queue.cc:1048] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:29.488929  5574 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:29.526871  1584 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:02:29.527665  1584 raft_consensus.cc:606] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:29.528075  1584 raft_consensus.cc:614] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:29.484149  6074 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.537317  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:29.356370  6250 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:29.486819  6166 consensus_queue.cc:1059] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:02:29.561501  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:29.529788  6068 consensus_queue.cc:1048] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:02:29.531388  6246 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:29.578161  1585 raft_consensus.cc:3055] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:29.578603  1585 raft_consensus.cc:740] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:29.579391  1585 consensus_queue.cc:260] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:29.580431  1585 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:29.580163  6053 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:29.581476   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:29.583269  5914 raft_consensus.cc:3055] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:29.583881  5914 raft_consensus.cc:740] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:29.565894  5942 raft_consensus.cc:3055] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:29.589578  5942 raft_consensus.cc:740] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:29.590231  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:29.591331  1591 raft_consensus.cc:2393] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 11: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:29.590641  5942 consensus_queue.cc:260] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:29.596506  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:29.578918  6229 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:29.601577  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 257829us
I20260709 13:02:29.532861  6074 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:29.596429  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:29.609012  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:29.599321  1584 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:29.607324  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:29.610878  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:29.611320  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.614351  1583 raft_consensus.cc:2393] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 14: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:29.615144  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:29.615943  1587 raft_consensus.cc:2393] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 11: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:29.617640  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:29.566560  6184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39130 (request call id 70) took 2648 ms. Trace:
I20260709 13:02:29.600095  6240 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.608287  6086 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.622251  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:29.625015  1590 raft_consensus.cc:2393] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 10: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:29.610245  5942 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:29.625765  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:29.644038  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:29.652084  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:29.653223  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 220458us
I20260709 13:02:29.654032  1633 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:29.659052  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:29.660044  1663 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:02:29.663645  1664 raft_consensus.cc:1240] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:29.664191  6229 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:29.666220  6053 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:29.666522  6246 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:29.667667  6233 raft_consensus.cc:2749] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:29.643893  6240 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:29.623334  6184 rpcz_store.cc:276] 0709 13:02:26.912430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.921280 (+  8850us) service_pool.cc:224] Handling call
0709 13:02:27.369510 (+448230us) ts_tablet_manager.cc:1151] Deleting tablet c9831da869404fb79a22d3887701ca69
0709 13:02:27.369617 (+   107us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:02:28.712635 (+1343018us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:29.253508 (+540873us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:29.560651 (+307143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":873250,"tablet-delete.queue_time_us":344030,"thread_start_us":165637,"threads_started":1}
I20260709 13:02:29.664294  6074 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:29.656786  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:29.675072  1662 raft_consensus.cc:2410] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 11 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:02:29.676523  1633 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:29.677663  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:29.678226  1663 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:29.646768  6086 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:29.676020  1556 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:29.683974  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:29.684748  1658 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:29.685487  6112 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:29.686416  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:29.687619  5574 raft_consensus.cc:2804] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:29.690476  1666 raft_consensus.cc:2410] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:29.682009  6086 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:29.691715  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:29.690268  5574 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.694708  5574 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:29.620337  5914 consensus_queue.cc:260] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:29.698318  5914 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:29.698392  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:29.706595  1585 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
I20260709 13:02:29.702051  2543 raft_consensus.cc:1275] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:29.709848  1591 raft_consensus.cc:1275] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:29.672984  6239 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:29.716326  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:29.717202  2424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:29.718327  2424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.720536  1666 raft_consensus.cc:1240] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:29.721794  1583 raft_consensus.cc:2410] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:02:29.730238  1633 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:29.702559  6081 consensus_queue.cc:1175] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5bb87fe07da2414e84ee578c3b176ede" responder_term: 8 status { last_received { term: 8 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 8 index: 8 } }
I20260709 13:02:29.732190  6250 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:29.714097  5921 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:02:29.724694  6178 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.734809  6178 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:29.737651  6273 consensus_queue.cc:1048] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:29.739300  6240 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:29.720027  6166 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.740357  1663 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:02:29.740226  6166 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:29.741125  6129 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:29.741340  6273 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:29.741772  6129 raft_consensus.cc:697] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 11 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:29.743083  6129 consensus_queue.cc:237] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:29.743532  1633 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:29.744686  6272 raft_consensus.cc:2749] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:29.746619  1633 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:29.749464  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:29.750348  1586 raft_consensus.cc:2410] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:02:29.751350  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:29.752393  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:29.750173  1633 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:29.753563  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:29.754293  6112 raft_consensus.cc:2804] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:29.754799  6112 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.754896  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:29.755303  6112 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:29.755949  6266 log.cc:927] Time spent T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.430s	user 0.001s	sys 0.001s
I20260709 13:02:29.756158  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:29.757900  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:29.753778  5574 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:29.722417  6261 log.cc:927] Time spent T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.396s	user 0.004s	sys 0.000s
I20260709 13:02:29.761718  5574 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:29.724463  5930 consensus_meta.cc:287] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.603s	user 0.013s	sys 0.000s
I20260709 13:02:29.768478  1658 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:02:29.769270  1586 raft_consensus.cc:2393] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 6: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:29.769488  1587 raft_consensus.cc:2393] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 11: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:29.772241  1584 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
I20260709 13:02:29.774349  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:29.778993  1662 raft_consensus.cc:1240] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:29.763715  1633 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:29.773626  1556 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:29.782627  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:29.761315  1707 leader_election.cc:336] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.516s (SENT)
I20260709 13:02:29.788723  1707 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:29.787114  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:29.789830  1587 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 14.
I20260709 13:02:29.790534  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:29.791666  1741 raft_consensus.cc:1240] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:29.790580  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:29.792435  1558 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:29.792649  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:29.792919  1584 raft_consensus.cc:2410] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:02:29.794193  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:29.794198  1584 raft_consensus.cc:1240] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:29.794998  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:29.795816  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:29.796003  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:29.796573  1735 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:29.795775  1584 raft_consensus.cc:1275] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:29.798018  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:29.798686  1733 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:02:29.799121  6053 raft_consensus.cc:2804] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:29.800951  1583 raft_consensus.cc:1275] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:29.801230  6107 raft_consensus.cc:2749] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:29.801981  6253 log.cc:927] Time spent T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.476s	user 0.003s	sys 0.000s
I20260709 13:02:29.802167  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:29.802446  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:29.802923  1660 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:29.805696  6264 log.cc:927] Time spent T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.477s	user 0.000s	sys 0.002s
I20260709 13:02:29.807161  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:29.807834  1586 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
W20260709 13:02:29.809437  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 48156.4us
I20260709 13:02:29.817392  6107 consensus_queue.cc:1048] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:29.818317  6166 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:29.818423  6265 consensus_queue.cc:1048] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:29.787420  6086 consensus_queue.cc:1059] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
W20260709 13:02:29.823325  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 59968.8us
I20260709 13:02:29.796456  1738 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 14.
I20260709 13:02:29.830274  6006 raft_consensus.cc:2749] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:29.825039  1633 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:29.833737  1633 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:29.834403  6006 raft_consensus.cc:2804] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:29.835065  6006 raft_consensus.cc:697] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
W20260709 13:02:29.836800  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.836233  6006 consensus_queue.cc:237] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:29.837505  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:29.844072  1735 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:02:29.845280  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:29.846437  1662 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:02:29.848937  1660 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:02:29.848173   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:29.856438  1738 raft_consensus.cc:1240] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:29.720858  6239 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:29.869191  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:29.867280  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 74921us
I20260709 13:02:29.872640  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:29.871773  1558 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:29.847404  6272 raft_consensus.cc:2749] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:29.854022  6053 raft_consensus.cc:697] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:29.886437  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:29.877651  5574 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:29.906703  1734 raft_consensus.cc:2468] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 6.
I20260709 13:02:29.889068  6202 consensus_queue.cc:1048] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:02:29.859622  6068 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:29.910470  6068 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.910924  6068 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:29.898941  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:29.913635  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:29.913650  1740 raft_consensus.cc:2468] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 6.
I20260709 13:02:29.914398  1735 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:29.879980  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:29.915789  1556 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:29.733764  1475 catalog_manager.cc:5028] TS 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): tablet c9831da869404fb79a22d3887701ca69 (table test-workload [id=8a8e3153ff4e476f890a0820215f177a]) successfully deleted
W20260709 13:02:29.919230  1475 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 192442us
I20260709 13:02:29.920713  1556 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:29.929533  1556 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:29.891227  6262 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:29.934162  1738 raft_consensus.cc:1275] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:02:29.943475  6107 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.881992  6246 raft_consensus.cc:2749] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:29.956157  1737 raft_consensus.cc:1240] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:29.954200  1591 raft_consensus.cc:1275] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:02:29.933142  5574 raft_consensus.cc:2804] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:02:29.956403  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 81158.4us
I20260709 13:02:29.990468  1558 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:29.934581  6229 raft_consensus.cc:2804] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:29.982637  1735 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 11.
I20260709 13:02:29.994910  2426 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:29.951719  6086 raft_consensus.cc:2804] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:02:29.995968  6275 log.cc:927] Time spent T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.069s	user 0.002s	sys 0.000s
I20260709 13:02:29.927666  6250 consensus_queue.cc:1059] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
W20260709 13:02:30.037750  2425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.950966  6053 consensus_queue.cc:237] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:29.993978  6246 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.951292  6107 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:29.993021  6229 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.009004  1558 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:30.001534  6054 raft_consensus.cc:2749] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:30.033293  6239 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:30.006592  6245 raft_consensus.cc:2749] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:30.102417  6128 raft_consensus.cc:3055] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:29.961046  6262 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:30.102994  6128 raft_consensus.cc:740] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:30.104856  6262 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:30.069640  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.052845  6028 consensus_queue.cc:1048] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:02:30.060385  6246 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:30.107611  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 291570us
W20260709 13:02:30.108537  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.085585  6178 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:30.087607  6112 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:30.100044  5960 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:30.101146  6250 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:30.059964  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 203896us
I20260709 13:02:30.109062  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:30.165195  1665 raft_consensus.cc:2393] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 in current term 11: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:30.111194  1586 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 11.
W20260709 13:02:30.136915  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:30.150449  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.064284  6229 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:30.170516  1633 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:30.108341  1707 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:02:30.188889  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 80593.2us
I20260709 13:02:30.198472  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:30.200470  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:30.202024  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:30.198563  1705 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.973s (SENT) [suppressed 36 similar messages]
I20260709 13:02:30.169580  6178 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.210810  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:30.215969  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:30.217813  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:30.219687  1738 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
I20260709 13:02:30.222317  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:30.193549  6273 raft_consensus.cc:2804] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:30.222239  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:30.233347  1589 raft_consensus.cc:2376] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 14. Re-sending same reply.
I20260709 13:02:30.218770  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:30.211650  1590 raft_consensus.cc:2376] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 11. Re-sending same reply.
W20260709 13:02:30.239106  2424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.247512  1737 raft_consensus.cc:2393] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 11: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:30.247357  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:02:30.250406  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 241475us
W20260709 13:02:30.244045  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 197571us
I20260709 13:02:30.205261  1707 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:30.258124  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:30.191810  6250 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:30.106799  6128 consensus_queue.cc:260] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:30.273422  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:30.319523  1732 raft_consensus.cc:1275] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:02:30.325112  1735 raft_consensus.cc:1275] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:02:30.331908  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:30.332711  1739 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
I20260709 13:02:30.333621  6166 raft_consensus.cc:3055] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:30.260373  6273 raft_consensus.cc:697] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:30.213449  6178 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:30.344425  1633 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:02:30.338364  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 123988us
I20260709 13:02:30.350669  1591 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 9.
W20260709 13:02:30.376868  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.334075  6166 raft_consensus.cc:740] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:02:30.390592  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 46216.9us
I20260709 13:02:30.392867  2554 raft_consensus.cc:1275] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:02:30.393572  1734 raft_consensus.cc:1275] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:30.386448  1705 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:30.399909  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:30.337249  5574 raft_consensus.cc:697] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:30.406857  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:30.389391  6006 raft_consensus.cc:2749] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:30.393566  6128 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:30.338157  6282 raft_consensus.cc:2804] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:30.361274  6129 consensus_queue.cc:1048] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:02:30.348889  6286 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.350073  6287 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.438766  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:30.440271  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:30.419799  1633 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
W20260709 13:02:30.419695  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 214500us
I20260709 13:02:30.424032  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:30.426491  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:30.445838  1587 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
I20260709 13:02:30.429895  1588 raft_consensus.cc:1240] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:30.433869  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:30.435998  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:30.407764  5960 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:30.441895  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:30.417951  6107 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:30.459050  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:30.430876  6282 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.463157  6239 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:30.463747  6239 raft_consensus.cc:697] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 16 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:30.464888  6239 consensus_queue.cc:237] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:30.468916  6107 raft_consensus.cc:2749] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:30.435030  6273 consensus_queue.cc:237] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:30.469570  6246 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:30.469729  6107 raft_consensus.cc:2749] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:30.470533  6107 consensus_queue.cc:1048] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:30.471032  6178 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:30.437816  6291 consensus_queue.cc:1048] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:02:30.457384  6296 consensus_queue.cc:1048] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:02:30.458104  5960 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:30.473628  6293 log.cc:927] Time spent T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:02:30.474279  6250 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:30.503533  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 108498us
I20260709 13:02:30.507839  1665 raft_consensus.cc:1240] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:30.536464  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:30.541255  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:30.550057  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 104311us
I20260709 13:02:30.456395  6112 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:30.551807  2425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:30.564471  1707 leader_election.cc:336] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.676s (SENT)
I20260709 13:02:30.565268  1707 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:30.451023  6053 consensus_queue.cc:1048] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.101s
W20260709 13:02:30.567531  6284 log.cc:927] Time spent T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 13:02:30.573886  6303 raft_consensus.cc:2749] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:30.574286  6068 consensus_meta.cc:287] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.661s	user 0.012s	sys 0.000s
I20260709 13:02:30.574702  6068 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:30.579558  6281 log.cc:927] Time spent T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.262s	user 0.001s	sys 0.000s
I20260709 13:02:30.580379  6303 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.589425  6296 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
W20260709 13:02:30.475603  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 89251.1us
I20260709 13:02:30.449955  6287 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:30.590082  6296 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:30.592468  6296 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:30.583457  6250 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.593912  6250 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:30.594529  5574 consensus_queue.cc:237] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:30.596097  6250 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:30.592787  6287 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:30.508071  6166 consensus_queue.cc:260] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:30.598644  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:30.598915  6166 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:30.599850  1665 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 14.
I20260709 13:02:30.600494  6287 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.602311  6287 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:30.551808  5960 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:30.604063  6292 consensus_queue.cc:1175] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5bb87fe07da2414e84ee578c3b176ede" responder_term: 19 status { last_received { term: 18 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 18. Current term is 19. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:02:30.606441  6287 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:30.607671  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:30.610844  1705 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:30.611745  6296 raft_consensus.cc:2764] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:02:30.612448  6305 consensus_queue.cc:1048] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:30.612811  6296 consensus_queue.cc:1048] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:02:30.614383  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.620590  1556 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:30.623333  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:30.475457  6282 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:30.625881  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 206147us
I20260709 13:02:30.640010  1633 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:30.630117  1705 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:30.641147  6296 raft_consensus.cc:2749] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:30.443264  6286 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:30.642184  1705 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
W20260709 13:02:30.634395  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 180102us
I20260709 13:02:30.581038  6303 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:30.627377  6299 consensus_queue.cc:1048] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:02:30.649276  1663 raft_consensus.cc:2468] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:02:30.640667  5930 raft_consensus.cc:2804] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:30.652786  1633 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
W20260709 13:02:30.652827  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:30.651540  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 400019us
I20260709 13:02:30.639637  6068 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:30.633219  6305 consensus_queue.cc:1059] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:02:30.653374  5930 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.641639  6178 consensus_queue.cc:1048] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:02:30.661772  5930 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:30.666268  1490 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51168 (request call id 133) took 17565 ms (client timeout 15000 ms). Trace:
I20260709 13:02:30.670770  6229 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:30.672070  1585 raft_consensus.cc:2393] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 11: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:30.656932  6296 raft_consensus.cc:2804] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:30.660531  6306 raft_consensus.cc:2804] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:30.682197  2553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 287) took 1161 ms. Trace:
I20260709 13:02:30.687839  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:30.703778  1586 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 11.
W20260709 13:02:30.688525  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:30.696184  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 54066.6us
I20260709 13:02:30.698280  6292 consensus_queue.cc:1059] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:30.699122  1558 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:30.701300  2553 rpcz_store.cc:276] 0709 13:02:29.520503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.530676 (+ 10173us) service_pool.cc:224] Handling call
0709 13:02:29.531069 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:29.623008 (+ 91939us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:29.623183 (+   175us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:29.812622 (+189439us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b1800036640. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7de702a6 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7f888a11 00007f1b7f898372 00007f1b80fcaa01 00007f1b80f8f43a
0709 13:02:29.813550 (+   928us) spinlock_profiling.cc:243] Waited 3.15 ms on lock 0x7b2c00022158. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7f888a11 00007f1b7f898372 00007f1b80fcaa01 00007f1b80f8f43a 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2
0709 13:02:29.814130 (+   580us) log.cc:844] Serialized 26 byte log entry
0709 13:02:30.262287 (+448157us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:30.262504 (+   217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:30.681804 (+419300us) spinlock_profiling.cc:243] Waited 91 ms on lock 0x7b540077fe54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:30.681867 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:30.681926 (+    59us) raft_consensus.cc:1685] finished
0709 13:02:30.681951 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:30.682125 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2332,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":2339,"spinlock_wait_cycles":250464128,"thread_start_us":434044,"threads_started":1,"wal-append.queue_time_us":580166}
I20260709 13:02:30.713351  5942 raft_consensus.cc:3055] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:30.713841  5942 raft_consensus.cc:740] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:30.714852  5942 consensus_queue.cc:260] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:30.716321  5942 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:30.666744  1490 rpcz_store.cc:269] 0709 13:02:13.101348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.109664 (+  8316us) service_pool.cc:224] Handling call
0709 13:02:30.666174 (+17556510us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:27.674826 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:27.675524 (+   698us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:27.675581 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:02:27.675600 (+    19us) tablet.cc:662] Decoding operations
0709 13:02:27.676556 (+   956us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:27.676653 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:27.676678 (+    25us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:02:27.742288 (+ 65610us) tablet.cc:701] Row locks acquired
0709 13:02:27.763209 (+ 20921us) write_op.cc:260] PREPARE: finished
0709 13:02:27.789474 (+ 26265us) write_op.cc:270] Start()
0709 13:02:27.858614 (+ 69140us) write_op.cc:276] Timestamp: P: 1783602147776344 usec, L: 0
0709 13:02:27.873052 (+ 14438us) op_driver.cc:348] REPLICATION: starting
0709 13:02:27.923288 (+ 50236us) log.cc:844] Serialized 2448 byte log entry
0709 13:02:28.447643 (+524355us) op_driver.cc:464] REPLICATION: finished
0709 13:02:28.662326 (+214683us) write_op.cc:301] APPLY: starting
0709 13:02:28.669032 (+  6706us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:28.949173 (+280141us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:28.949385 (+   212us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:28.975717 (+ 26332us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:28.976010 (+   293us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:02:28.976208 (+   198us) write_op.cc:312] APPLY: finished
0709 13:02:28.976555 (+   347us) log.cc:844] Serialized 65 byte log entry
0709 13:02:29.029532 (+ 52977us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:29.038665 (+  9133us) write_op.cc:454] Released schema lock
0709 13:02:29.057920 (+ 19255us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:29.067706 (+  9786us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:29.070493 (+  2787us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":508338,"reported_tablets":14,"spinlock_wait_cycles":1792,"child_traces":[["op",{"apply.queue_time_us":196744,"apply.run_cpu_time_us":22146,"apply.run_wall_time_us":414000,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29207,"num_ops":6,"prepare.queue_time_us":250236,"prepare.run_cpu_time_us":26693,"prepare.run_wall_time_us":412154,"raft.queue_time_us":255995,"raft.run_cpu_time_us":38748,"raft.run_wall_time_us":113517,"replication_time_us":574394,"thread_start_us":452123,"threads_started":4,"wal-append.queue_time_us":164466,"wal-append.run_cpu_time_us":37764,"wal-append.run_wall_time_us":1887475}]]}
I20260709 13:02:30.723033  6302 raft_consensus.cc:2749] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:30.723991  6229 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:30.726033  6306 raft_consensus.cc:697] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:30.727274  6306 consensus_queue.cc:237] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:30.727962  1558 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:02:30.729501  1707 leader_election.cc:336] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.777s (SENT)
I20260709 13:02:30.729975  1707 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:02:30.733181  6280 log.cc:927] Time spent T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.468s	user 0.003s	sys 0.001s
I20260709 13:02:30.740664  1558 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:30.678110  6304 raft_consensus.cc:2804] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:30.677261  6296 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:30.746423  6296 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:30.748032  6286 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:30.745597  1558 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:30.745870  6299 raft_consensus.cc:2749] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:30.761978  2426 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:30.763335  2426 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede
W20260709 13:02:30.766455  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 113741us
I20260709 13:02:30.768882  2426 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:30.768838  1633 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:30.753427  5574 raft_consensus.cc:2749] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:30.772176  1707 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:30.772485  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 65115.3us
I20260709 13:02:30.774017  1705 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:30.761237  6229 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:30.776021  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:30.776351  1707 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:30.761909  6292 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.778242  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:30.764406  6304 raft_consensus.cc:697] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 15 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:30.766835  6262 raft_consensus.cc:2804] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:30.793633  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:30.789973  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:30.789480  1658 raft_consensus.cc:2393] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 9: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:30.790695  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:30.781675  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:30.768546  6166 raft_consensus.cc:2804] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:30.773386  5515 raft_consensus.cc:2804] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:30.819882  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:30.840304  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 64026.3us
I20260709 13:02:30.824859  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:30.821902  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:30.842995  1737 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
W20260709 13:02:30.823375  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 49202.5us
I20260709 13:02:30.845630  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:30.846542  1664 raft_consensus.cc:2376] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10. Re-sending same reply.
I20260709 13:02:30.847848  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:30.848846  1660 raft_consensus.cc:2393] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 14: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:30.770841  6081 consensus_queue.cc:1048] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 13:02:30.800405  6178 raft_consensus.cc:3055] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:02:30.795125  6308 log.cc:927] Time spent T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:02:30.859957  1662 raft_consensus.cc:2393] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 11: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:30.863691  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:30.777686  6272 raft_consensus.cc:2804] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:30.778772  6299 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:30.777381  6229 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.775665  6289 raft_consensus.cc:2804] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:30.867599  1735 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:30.864334  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:30.869612  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:30.838469  6166 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.837661  6262 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:30.879573  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:30.882679  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:30.883023  1738 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
W20260709 13:02:30.862291  6086 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.007s	sys 0.010s
I20260709 13:02:30.883889  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:30.884543  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:30.885195  1585 raft_consensus.cc:2468] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 6.
I20260709 13:02:30.879700  6289 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:30.878508  5930 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:30.869001  6107 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:30.888700  6107 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.893255  6107 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:30.889600  6303 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:30.898208  6313 log.cc:927] Time spent T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:02:30.898458  6303 consensus_queue.cc:1048] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:30.899590  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:30.891750  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:30.886920  6289 raft_consensus.cc:3060] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:30.901206  1738 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:02:30.863371  5515 raft_consensus.cc:697] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:30.902288  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:30.903342  5515 consensus_queue.cc:237] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:30.904181  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:30.904831  1738 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:30.869251  6305 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.884716  1736 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 5.
W20260709 13:02:30.892307  6086 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.007s	sys 0.010s
I20260709 13:02:30.905606  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:30.906802  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:30.931087  1740 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:02:30.934100  1739 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:30.920337  1735 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 11.
I20260709 13:02:30.862429  6178 raft_consensus.cc:740] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:30.931263  1584 raft_consensus.cc:2393] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 10: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:30.941903  6304 consensus_queue.cc:237] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:30.943971  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:30.944923  1584 raft_consensus.cc:2376] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10. Re-sending same reply.
I20260709 13:02:30.946277  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:30.947037  1584 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:30.918182  1583 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 19.
I20260709 13:02:30.871129  6272 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.874564  6229 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:30.837857  6292 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:30.868920  6311 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:30.883206  6166 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:30.918327  6262 raft_consensus.cc:3060] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:31.031317   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:31.032305  6289 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:31.034679  6289 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:31.010056  6319 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:31.035669  6319 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:31.021495  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 250699us
I20260709 13:02:30.874802  6265 consensus_queue.cc:1048] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.097s
I20260709 13:02:31.041247  2426 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:30.953882  6086 raft_consensus.cc:697] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:31.048600  1584 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 11.
I20260709 13:02:30.965631  6317 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.970124  6272 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:31.058172  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 196232us
W20260709 13:02:31.047981  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 184062us
I20260709 13:02:31.026566  6233 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.038362  6319 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:31.087236  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:31.088332  1584 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:02:31.069639  1705 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:30.955514  6299 consensus_queue.cc:1059] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.102s
I20260709 13:02:31.098732  5914 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.099381  5914 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:31.069613  1707 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:31.059480  6263 raft_consensus.cc:2804] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:31.102335  1633 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:30.956811  6305 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:31.114025  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:31.115693  1584 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:31.122737  1633 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:31.124644  1633 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:31.110934  6263 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:31.090566  6233 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:31.153829  5914 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:31.166639  1584 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 14.
I20260709 13:02:31.169032  6107 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:31.171375  6107 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:31.172164  6107 raft_consensus.cc:2804] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:31.172544  6107 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:31.109526  6319 consensus_queue.cc:1048] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:02:31.178891  6319 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:31.179502  6319 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:31.181265  6239 raft_consensus.cc:2804] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:31.181838  6239 raft_consensus.cc:697] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 14 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:31.183398  6239 consensus_queue.cc:237] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:31.186942  6305 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:31.188361  6324 consensus_queue.cc:1048] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:31.197113  6292 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:31.198405  6315 log.cc:927] Time spent T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:02:31.084808  6317 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:31.202355  6317 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:31.141397  6286 raft_consensus.cc:2749] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:31.136629  6306 raft_consensus.cc:2749] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:31.154979  6086 consensus_queue.cc:237] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:31.206228  6296 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:31.209650  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 85160.4us
I20260709 13:02:31.210467  1633 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:02:31.219185  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 149642us
I20260709 13:02:31.243724  1739 raft_consensus.cc:1275] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:02:31.266089  1738 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:02:31.268697  1707 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:31.172946  6107 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:31.157156  6263 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:31.267746  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:31.274685  6324 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.277804  1584 raft_consensus.cc:2410] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:02:31.279094  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 68704.2us
I20260709 13:02:31.279841  1633 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:31.167286  6265 raft_consensus.cc:2749] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:02:31.236897  5942 consensus_meta.cc:287] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.520s	user 0.000s	sys 0.014s
I20260709 13:02:31.211963  6306 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.283284  6327 raft_consensus.cc:2804] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:31.300673  1633 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:31.276703  6305 consensus_queue.cc:1048] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:02:31.291066  6296 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:31.295732  6265 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:31.295967  6286 raft_consensus.cc:2804] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:31.310760  1633 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:31.311251  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:31.312649  1739 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 9.
I20260709 13:02:31.321008  2426 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:31.322129  5721 raft_consensus.cc:2804] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:31.322549  5721 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.322932  5721 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:31.338538  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:31.280963  6324 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:31.335001  6304 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:31.347350  6328 raft_consensus.cc:2749] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:31.347859  6331 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.339032  6286 raft_consensus.cc:697] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:31.372795  6331 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:31.373493  6286 consensus_queue.cc:237] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:31.375257  6331 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:31.349567  5721 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:31.366765  6239 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:31.389853  6287 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.295092  6306 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:31.370286  6326 log.cc:927] Time spent T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:02:31.368024  6342 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.406240  1586 raft_consensus.cc:1240] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 13:02:31.411592  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 100915us
I20260709 13:02:31.412114  1558 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:31.418552  1633 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:31.383139  6319 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:31.421094  1633 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:31.313027  6265 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:31.429652  5960 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:31.419049  6342 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:31.433522  1558 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:31.394286  6302 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.416628  6291 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.393684  6239 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:31.444314  1558 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:31.445011  1633 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:31.419864  6327 raft_consensus.cc:697] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 11 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:31.410630  6287 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:31.419983  6333 raft_consensus.cc:2749] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:31.439915  6282 consensus_meta.cc:287] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.786s	user 0.010s	sys 0.003s
I20260709 13:02:31.460218  1558 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:31.444307  5960 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:31.469607  1558 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:31.468437  1633 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:31.448810  5942 raft_consensus.cc:2804] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:31.471542  1589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2260) took 1036 ms. Trace:
I20260709 13:02:31.448195  6202 raft_consensus.cc:2804] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:31.473837  1589 rpcz_store.cc:276] 0709 13:02:30.435500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.460290 (+ 24790us) service_pool.cc:224] Handling call
0709 13:02:30.517141 (+ 56851us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:30.517350 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:30.627422 (+110072us) log.cc:844] Serialized 14 byte log entry
0709 13:02:30.950525 (+323103us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b18004a7a60. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7de84e07 00007f1b86cdfab9 00007f1b7dea169b 00007f1b7de9f93f 00007f1b7dea1c02 00007f1b80b2920b 00007f1b80b2ed23 00007f1b80b2f23a 00007f1b80f99a2a
0709 13:02:31.470702 (+520177us) log.cc:844] Serialized 14 byte log entry
0709 13:02:31.470977 (+   275us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:31.471062 (+    85us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:31.471115 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:31.471298 (+   183us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:31.471462 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":365972,"prepare.queue_time_us":109982,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":369420,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":124,"spinlock_wait_cycles":5526912,"thread_start_us":149822,"threads_started":2,"wal-append.queue_time_us":505556}
I20260709 13:02:31.452098  6086 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:31.458067  6304 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:31.484061  1633 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:31.485054  1633 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:31.486390  1707 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:31.489251  1707 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:31.471068  6317 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:31.492314  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:31.505225  1734 raft_consensus.cc:2468] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:02:31.487232  6328 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:31.493757  6312 raft_consensus.cc:2804] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:31.511873  1734 raft_consensus.cc:1275] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:31.481508  6245 raft_consensus.cc:2804] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:31.493930  1583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 2256) took 1070 ms. Trace:
I20260709 13:02:31.494753  6319 raft_consensus.cc:2804] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:31.497403  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:31.487272  6006 raft_consensus.cc:2804] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:31.490868  6292 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:31.498416  6107 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:31.499827  5930 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:31.475605  5942 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.493633  6334 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:31.473744  6246 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:31.449429  6302 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:31.507488  1737 raft_consensus.cc:1240] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:31.476426  6202 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.493893  6301 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:31.513744  6328 raft_consensus.cc:697] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 11 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:31.559204  6334 raft_consensus.cc:697] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 10 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:31.559667  1486 catalog_manager.cc:5697] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 6 to 9, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 9 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:02:31.560231  6334 consensus_queue.cc:237] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:31.561101  6202 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:31.515829  1583 rpcz_store.cc:276] 0709 13:02:30.423095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.423697 (+   602us) service_pool.cc:224] Handling call
0709 13:02:31.493693 (+1069996us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b54000320d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:31.493827 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":723944704}
W20260709 13:02:31.534688  6297 log.cc:927] Time spent T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 1.073s	user 0.000s	sys 0.005s
I20260709 13:02:31.538558  6262 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:31.564741  2553 raft_consensus.cc:1240] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:31.539458  6272 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:31.552665  5942 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:31.533383  6229 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:31.517652  6312 raft_consensus.cc:697] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 14 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:31.474103  6298 consensus_queue.cc:1048] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:02:31.472949  6282 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:31.518370  6319 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:31.551787  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 65876.6us
I20260709 13:02:31.558868  6301 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.560038  6328 consensus_queue.cc:237] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:31.560732  6302 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:31.562288  1486 catalog_manager.cc:5697] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:02:31.566402  1587 raft_consensus.cc:1240] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:31.521699  6006 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.451215  6291 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:31.570624  1666 raft_consensus.cc:2393] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 11: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:31.489161  6086 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:31.555830  6356 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.573189  6272 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:31.599664  6272 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:31.600073  6324 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:31.600237  6272 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:31.600744  6086 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:31.601459  6356 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:31.602264  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:31.573050  6312 consensus_queue.cc:237] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:31.573570  5930 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:31.567310  5721 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:31.577922  6353 log.cc:927] Time spent T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:02:31.576864  2554 raft_consensus.cc:1240] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:31.584504  6301 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:31.579854  6229 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:31.542285  5960 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:31.544402  6292 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:31.591840  1486 catalog_manager.cc:5697] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 11 to 14, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 14 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:02:31.608106  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:31.645627  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:31.647061  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:31.584796  6319 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:31.639045  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:31.618654  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:31.594871  6006 raft_consensus.cc:3060] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:31.643728  1486 catalog_manager.cc:5697] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 3 to 5, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:31.648967  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:31.665129  1583 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15.
I20260709 13:02:31.656266  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:31.668009  1737 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:02:31.660044  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:31.614033  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:31.591566  6350 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:31.663697  1486 catalog_manager.cc:5697] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:02:31.666461  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:31.615828  6233 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:31.547406  6349 consensus_queue.cc:1059] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.109s
I20260709 13:02:31.611442  6351 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:31.635346  6317 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.628770  6239 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:31.615296  6262 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:31.676254  1486 catalog_manager.cc:5697] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 4 to 7, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 7 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
W20260709 13:02:31.680948  1705 leader_election.cc:336] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.588s (SENT)
I20260709 13:02:31.705602  1705 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:31.707502  6296 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:31.678488  1583 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:02:31.614197  6355 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:31.636386  5921 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:31.637778  6263 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:31.721342  5921 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:31.723552  6263 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:31.616858  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:31.678411  1707 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:31.683413  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:31.726025  1741 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:02:31.680796  1558 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:31.613736  6356 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:31.689567  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 78249.2us
I20260709 13:02:31.730636  6291 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:31.710140  6166 consensus_meta.cc:287] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.664s	user 0.014s	sys 0.000s
I20260709 13:02:31.732811  6166 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:31.733522  5921 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:31.734093  6292 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:31.734345  6355 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:31.698119  6351 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:31.738299  1584 raft_consensus.cc:1240] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:02:31.740288  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:31.679531  6245 raft_consensus.cc:697] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:31.532859  6327 consensus_queue.cc:237] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:31.693153  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:31.612434  6129 consensus_queue.cc:1048] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:02:31.695822  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:31.696976  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:31.754702  1738 raft_consensus.cc:2393] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 15: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:31.630028  6273 consensus_queue.cc:1059] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:02:31.613423  5930 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:31.757015  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 63383.2us
I20260709 13:02:31.711033  1486 catalog_manager.cc:5697] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 6 to 7, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 7 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:02:31.743539  1584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46836 (request call id 563) took 1068 ms. Trace:
I20260709 13:02:31.754446  1740 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 15.
W20260709 13:02:31.744640  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 66617.3us
I20260709 13:02:31.758620  1737 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 15.
W20260709 13:02:31.748503  1705 leader_election.cc:336] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.655s (SENT)
I20260709 13:02:31.761406  1705 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:31.753279  1583 raft_consensus.cc:2393] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 19: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
W20260709 13:02:31.755973  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 170870us
I20260709 13:02:31.763212  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:31.764091  1583 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 16.
I20260709 13:02:31.766360  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:31.757956  1584 rpcz_store.cc:276] 0709 13:02:30.675152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.302981 (+627829us) service_pool.cc:224] Handling call
0709 13:02:31.308630 (+  5649us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:31.738743 (+430113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:31.740982 (+  2239us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b5400437bd4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:31.743455 (+  2473us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":987539328}
W20260709 13:02:31.785972  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 105256us
I20260709 13:02:31.787143  1583 raft_consensus.cc:2393] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 9: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:31.711650  6331 raft_consensus.cc:3055] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:31.792398  1662 raft_consensus.cc:1275] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:31.793668  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:31.796586  1633 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:31.784706  1486 catalog_manager.cc:5697] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:31.796669  1705 leader_election.cc:336] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.699s (SENT)
I20260709 13:02:31.799929  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
W20260709 13:02:31.802505  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 74913.7us
I20260709 13:02:31.802744  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:31.803367  1556 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:31.803691  1663 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 8.
I20260709 13:02:31.808949  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:31.813444  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:31.809096  6355 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:31.809610  6334 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:31.790233  6350 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.789572  6351 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:31.822767  6350 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:31.809350  6291 consensus_queue.cc:1048] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:02:31.757366  6349 raft_consensus.cc:2749] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:31.829265  1705 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:31.829530  1662 raft_consensus.cc:2393] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 11: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:31.832888  1739 raft_consensus.cc:1275] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:31.842113  1705 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:31.842914  1739 raft_consensus.cc:1275] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:02:31.704680  6317 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:31.826138  1486 catalog_manager.cc:5697] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:02:31.837891  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:31.846169  1733 raft_consensus.cc:2393] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 11: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:31.833472  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:31.789811  6166 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:31.846383  1741 raft_consensus.cc:1275] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:31.846510  1705 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:31.878818  1738 raft_consensus.cc:1275] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:02:31.876047  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 46722.9us
I20260709 13:02:31.876842  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:31.794279  6331 raft_consensus.cc:740] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:31.806749  6356 raft_consensus.cc:2804] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:31.875746  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:31.888711  1658 raft_consensus.cc:1240] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 14 LEADER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:02:31.867766  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:31.848405  1486 catalog_manager.cc:5697] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:31.890028  1658 raft_consensus.cc:1240] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:02:31.891100  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:31.887532  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:31.881865  6086 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.891752  1665 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:02:31.833673  6229 consensus_queue.cc:1059] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:02:31.901468  1658 raft_consensus.cc:1240] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:02:31.902364  1739 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:31.902603  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:31.897703  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:31.898023  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:31.826421  6239 raft_consensus.cc:2804] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:31.827385  6292 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.898744  1583 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:31.898492  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:31.883569  1558 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:31.825992  6364 raft_consensus.cc:2804] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:31.970568  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:31.909230  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:31.910724  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:31.910692  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:31.873431  6322 raft_consensus.cc:2749] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:31.911176  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:31.973812  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:31.972127  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 72079.7us
I20260709 13:02:31.966128  1486 catalog_manager.cc:5697] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:31.912058  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:31.910892  1588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2846) took 2452 ms. Trace:
I20260709 13:02:31.972216  1662 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
I20260709 13:02:31.979907  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:31.811931  6273 consensus_queue.cc:1048] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 13:02:31.913260  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:31.982241  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:31.982867  1663 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:31.983167  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:31.984275  1658 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:02:31.978319  1588 rpcz_store.cc:276] 0709 13:02:29.449635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.450071 (+   436us) service_pool.cc:224] Handling call
0709 13:02:29.907718 (+457647us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:30.447041 (+539323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:30.820425 (+373384us) spinlock_profiling.cc:243] Waited 522 ms on lock 0x7b54002ee354. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:31.902383 (+1081958us) spinlock_profiling.cc:243] Waited 457 ms on lock 0x7b54002ee350. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8e8ad 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:31.902509 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2252129280}
I20260709 13:02:31.979609  1486 catalog_manager.cc:5697] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 10 to 13, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 13 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:31.889818  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:31.988572  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 105145us
I20260709 13:02:31.975803  1633 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:31.990336  1707 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:31.834764  6286 consensus_queue.cc:1048] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:02:31.993155  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:31.901480  6349 raft_consensus.cc:2749] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:31.878161  6348 raft_consensus.cc:2749] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:31.901880  6233 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.994112  1707 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:31.907212  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:31.998659  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:31.999634  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:31.970633  6364 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:32.046236  6364 raft_consensus.cc:3060] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:32.044807  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:31.897686  6351 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:32.049259  6359 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:32.049813  6351 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:32.050007  6359 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:31.906654  6112 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.897946  6312 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.006518  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:31.910847  6086 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:31.873507  6006 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:31.971791  6245 consensus_queue.cc:237] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:31.924373  6350 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:32.016547  1707 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:31.987143  1486 catalog_manager.cc:5697] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 9 to 11, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 11 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:02:32.018442  1583 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:31.971534  6304 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:31.909576  6239 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:32.021023  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:32.022253  6290 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.023152  6344 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.025473  6368 raft_consensus.cc:3055] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:32.155100  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:32.026156  6309 raft_consensus.cc:2804] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:32.027159  6363 log.cc:927] Time spent T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 13:02:32.027230  6317 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:32.000365  6303 raft_consensus.cc:2804] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:32.014346  6328 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:32.189775  6303 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.190048  6328 raft_consensus.cc:697] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 19 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:32.190272  6303 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:32.191246  6328 consensus_queue.cc:237] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:32.029657  6331 consensus_queue.cc:260] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:32.030978  6322 raft_consensus.cc:2804] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:32.192976  6322 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:32.193509  6322 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:32.031159  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:32.034209  5942 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:32.196041  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:32.197022  5942 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:32.036705  6360 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.198113  6360 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:32.199028  6263 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:32.199560  6367 log.cc:927] Time spent T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 13:02:32.199632  6263 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:32.200469  6360 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:32.037848  2553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 295) took 1069 ms. Trace:
I20260709 13:02:32.201826  2553 rpcz_store.cc:276] 0709 13:02:30.968469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.019727 (+ 51258us) service_pool.cc:224] Handling call
0709 13:02:31.037588 (+ 17861us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:31.565149 (+527561us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.037366 (+472217us) spinlock_profiling.cc:243] Waited 527 ms on lock 0x7b540077fe54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:32.037556 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1211892992}
I20260709 13:02:32.038858  1592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 2257) took 1614 ms. Trace:
I20260709 13:02:31.976552  6301 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:32.079161  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:32.203029  1592 rpcz_store.cc:276] 0709 13:02:30.424937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.425206 (+   269us) service_pool.cc:224] Handling call
0709 13:02:32.038670 (+1613464us) spinlock_profiling.cc:243] Waited 942 ms on lock 0x7b54003d63d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:32.038803 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2165996416}
I20260709 13:02:32.080333  1739 raft_consensus.cc:1275] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:32.065006  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:32.066184  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:32.062139  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:32.072629  1663 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:02:32.058569  1738 raft_consensus.cc:3055] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:31.889727  6356 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.117960  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:32.121416  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 104935us
I20260709 13:02:32.122686  1486 catalog_manager.cc:5697] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:32.126302  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:32.145494  1633 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:31.991648  6292 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:32.052882  6359 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:32.155068  6368 raft_consensus.cc:740] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
W20260709 13:02:32.081409  6370 log.cc:927] Time spent T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:02:31.912218  6202 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:32.248450  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:32.157542  1658 raft_consensus.cc:1240] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:02:32.062796  6351 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:32.159832  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:32.071826  6107 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:32.080430  6287 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:32.079183  5930 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:32.060199  6246 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:32.151196  6239 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:32.186112  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:32.280735  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 107245us
I20260709 13:02:32.142707  6349 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:32.227303  1486 catalog_manager.cc:5697] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:32.229915  1588 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
I20260709 13:02:32.232796  1738 raft_consensus.cc:740] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:32.293555  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:32.157490  6290 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:32.118508  6369 log.cc:927] Time spent T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.260s	user 0.004s	sys 0.000s
I20260709 13:02:32.243676  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:32.207739  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:32.313872  1739 raft_consensus.cc:2393] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 9: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:32.240734  1734 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:02:32.115581  6233 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:32.159874  6309 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.248450  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:32.151167  6273 consensus_queue.cc:1048] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 13:02:32.262428  1741 raft_consensus.cc:2393] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 8: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:32.291000  6246 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:32.128173  6112 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:32.187471  5515 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.341655  5515 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:32.342631  6086 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:32.344691  6006 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:32.128242  6312 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:32.346110  1659 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
I20260709 13:02:32.346405  6290 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:32.347268  6312 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:32.234205  6356 raft_consensus.cc:3060] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:32.348241  6202 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:32.287673  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:32.352509  6263 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:32.237172  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 390777us
I20260709 13:02:32.160430  6344 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:32.355824  6344 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:32.356412  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:32.295338  1667 raft_consensus.cc:1240] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:02:32.157686  6129 consensus_queue.cc:1048] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.112s
I20260709 13:02:32.130504  6318 consensus_queue.cc:1048] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.137s
I20260709 13:02:32.249431  5942 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:32.315963  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:32.317117  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:32.249825  6317 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:32.304690  1486 catalog_manager.cc:5697] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 7 to 8, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:32.391852  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:32.169245  6350 consensus_queue.cc:1048] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.134s
I20260709 13:02:32.151661  6304 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:32.272012  6286 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.400828  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:32.241731  6299 consensus_queue.cc:1059] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:02:32.327854  1739 raft_consensus.cc:1240] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:02:32.329484  1734 raft_consensus.cc:3055] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:32.330161  1741 raft_consensus.cc:1275] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:32.405010  1734 raft_consensus.cc:740] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:32.303838  6349 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.267876  6351 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:32.326546  6309 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:32.336028  1586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2883) took 1448 ms. Trace:
I20260709 13:02:32.436699  1586 rpcz_store.cc:276] 0709 13:02:30.887868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.422270 (+534402us) service_pool.cc:224] Handling call
0709 13:02:31.422561 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:31.447041 (+ 24480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:31.447064 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:31.447993 (+   929us) log.cc:844] Serialized 26 byte log entry
0709 13:02:31.674553 (+226560us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:31.674604 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:31.674686 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:32.335529 (+660843us) raft_consensus.cc:1685] finished
0709 13:02:32.335678 (+   149us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:32.335934 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22899,"raft.queue_time_us":19320,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":5697,"thread_start_us":200869,"threads_started":1,"wal-append.queue_time_us":208975}
I20260709 13:02:32.439348  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:32.337057  6358 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.337754  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:32.340364  6334 consensus_meta.cc:287] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.523s	user 0.011s	sys 0.000s
W20260709 13:02:32.364398  6319 consensus_meta.cc:287] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.693s	user 0.014s	sys 0.000s
I20260709 13:02:32.380054  1583 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
I20260709 13:02:32.332458  6368 consensus_queue.cc:260] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:32.380065  1660 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:02:32.323848  6107 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.306051  6376 raft_consensus.cc:2749] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:32.322511  6240 consensus_queue.cc:1059] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:02:32.384980  1705 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:32.387305  1663 raft_consensus.cc:1240] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:32.390589  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:32.392388  1486 catalog_manager.cc:5697] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:32.473619  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 88772us
I20260709 13:02:32.388504  1558 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:02:32.474507  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 86087.3us
I20260709 13:02:32.398360  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:32.476107  1588 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 9.
I20260709 13:02:32.264206  1590 raft_consensus.cc:2393] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 12: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:32.390767  1630 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:32.401607  2552 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 9.
I20260709 13:02:32.408629  1661 raft_consensus.cc:1275] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:32.414973  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:32.387974  5515 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:32.450634  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:32.479805  1741 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:32.447721  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:32.480806  1705 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:32.400085  6202 consensus_queue.cc:1059] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:02:32.416831  6349 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:32.395588  6303 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:32.478243  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 87558.6us
I20260709 13:02:32.478904  1585 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
I20260709 13:02:32.475353  1558 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:32.402609  5942 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:32.485297  1588 raft_consensus.cc:1240] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:02:32.486847  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:32.445065  6299 consensus_queue.cc:1243] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer 6d4de2ce0683442498244b9529127f91 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:02:32.488811  1705 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:32.490872  1486 catalog_manager.cc:5697] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 8 to 9, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 9 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:02:32.493396  1663 raft_consensus.cc:1275] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:32.494897  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:32.463617  1592 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 11.
I20260709 13:02:32.396045  6364 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:32.532234  6006 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.534507  6006 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:32.536371  6006 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:32.446511  1734 consensus_queue.cc:260] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:32.402936  6317 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:32.459431  6334 raft_consensus.cc:2749] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:32.816784  6349 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:32.588589  6368 raft_consensus.cc:3060] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:32.748257  6374 log.cc:927] Time spent T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:02:32.579833  1588 raft_consensus.cc:1275] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:02:32.951606  1588 pending_rounds.cc:85] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91: Aborting all ops after (but not including) 5
I20260709 13:02:32.951928  1588 pending_rounds.cc:107] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:02:32.952214  1588 raft_consensus.cc:2889] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:32.767108  6322 consensus_meta.cc:287] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.573s	user 0.005s	sys 0.006s
I20260709 13:02:32.835868  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:32.786557  6356 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:32.731297  6178 consensus_queue.cc:260] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:32.453246  6358 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:32.799624  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:02:32.724596  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 249313us
I20260709 13:02:32.964392  1558 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:32.747171  6373 raft_consensus.cc:2749] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:32.732481  6377 raft_consensus.cc:2804] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:32.781898  6390 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:32.788923  6304 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:32.812211  2552 raft_consensus.cc:1240] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:32.974128  6298 raft_consensus.cc:2749] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:32.669018  6233 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:32.793577  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:32.974992  1662 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:02:32.975927  6265 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:32.788071  6303 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:32.577764  1486 catalog_manager.cc:5697] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 6 to 9, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:32.981396  6390 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:32.982694  1486 catalog_manager.cc:5697] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:32.475101  6107 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:32.986961  1486 catalog_manager.cc:5697] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 7 to 10, leader changed from 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:32.974992  6373 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.486783  6361 raft_consensus.cc:2804] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:32.988821  1486 catalog_manager.cc:5697] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 8 to 12, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:32.989526  6361 raft_consensus.cc:697] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:32.990425  1486 catalog_manager.cc:5697] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:32.990778  6361 consensus_queue.cc:237] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:32.992128  6356 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:32.991890  1486 catalog_manager.cc:5697] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:02:32.994184  6317 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:32.412082  6286 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:32.969189  6334 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:32.995473  6334 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:32.996887  1662 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 10.
I20260709 13:02:32.997849  6286 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:32.453752  6351 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:32.999583  6349 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:33.000976  6351 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:32.988621  6373 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:32.486537  6344 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:32.836455  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:32.579035  1739 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 9.
W20260709 13:02:32.587699  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 442278us
W20260709 13:02:32.816380  6239 consensus_meta.cc:287] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.524s	user 0.000s	sys 0.008s
I20260709 13:02:33.004927  1660 raft_consensus.cc:2393] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 in current term 11: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:32.820150  1630 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:33.005061  6239 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:33.005951  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 185880us
I20260709 13:02:32.818568  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:33.007562  6239 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:32.705644  6292 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:33.008396  2543 raft_consensus.cc:2410] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:02:32.796813  6112 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:32.789026  6384 log.cc:927] Time spent T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:02:33.009553  6112 consensus_queue.cc:1059] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:32.818122  5515 raft_consensus.cc:3055] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:02:32.949434  6311 consensus_queue.cc:1175] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5bb87fe07da2414e84ee578c3b176ede" responder_term: 13 status { last_received { term: 10 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 12. Current term is 13. Ops: [12.8-12.8]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:02:32.464825  6319 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:33.010741  1664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 2781) took 1114 ms. Trace:
I20260709 13:02:33.011248  1664 rpcz_store.cc:276] 0709 13:02:31.896199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.185494 (+289295us) service_pool.cc:224] Handling call
0709 13:02:32.185992 (+   498us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:32.186463 (+   471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:32.186504 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:32.201611 (+ 15107us) log.cc:844] Serialized 26 byte log entry
0709 13:02:32.390497 (+188886us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:32.390559 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.390660 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:33.010522 (+619862us) raft_consensus.cc:1685] finished
0709 13:02:33.010546 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:33.010685 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1720,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":23964,"thread_start_us":122406,"threads_started":1,"wal-append.queue_time_us":245475}
W20260709 13:02:32.940426  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 451675us
I20260709 13:02:32.963093  6322 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:33.014482  1705 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:33.015341  6303 raft_consensus.cc:2749] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:33.015709  1705 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:33.016296  6322 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:33.014812  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:33.018059  1705 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:33.019666  6303 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:33.019934  1705 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:32.953850  1659 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 8.
I20260709 13:02:33.020974  6303 raft_consensus.cc:2804] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:33.021507  6239 raft_consensus.cc:2804] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:33.021725  6303 raft_consensus.cc:697] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 9 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:32.954784  1588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2269) took 1123 ms. Trace:
I20260709 13:02:32.990830  6358 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:33.022571  1588 rpcz_store.cc:276] 0709 13:02:31.831427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.579100 (+747673us) service_pool.cc:224] Handling call
0709 13:02:32.579420 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:32.952779 (+373359us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.954704 (+  1925us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:33.024039  1739 raft_consensus.cc:1240] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:33.024622  1588 raft_consensus.cc:1275] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:02:33.025487  1588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2270) took 1193 ms. Trace:
I20260709 13:02:32.970541  1558 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:32.479542  6312 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:32.968041  6377 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.987779  6342 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:33.001878  1666 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
W20260709 13:02:32.766736  6375 log.cc:927] Time spent T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.305s	user 0.001s	sys 0.000s
I20260709 13:02:32.786067  5942 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:32.914726  1741 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 10.
I20260709 13:02:33.038434  6358 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:33.010520  5515 raft_consensus.cc:740] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:33.022930  6303 consensus_queue.cc:237] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:33.040948  5515 consensus_queue.cc:260] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:33.042613  5515 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:32.786892  6240 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:33.045063  6240 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:33.046900  6357 log.cc:927] Time spent T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 1.357s	user 0.009s	sys 0.003s
I20260709 13:02:33.050076  1584 raft_consensus.cc:1240] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:33.050859  6334 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:33.009009  1486 catalog_manager.cc:5697] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:33.012923  6319 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:33.013650  1737 raft_consensus.cc:2393] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 10: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:32.988952  6107 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:33.025900  6388 log.cc:927] Time spent T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
I20260709 13:02:33.026611  6178 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:33.029323  1588 rpcz_store.cc:276] 0709 13:02:31.832069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.023820 (+1191751us) service_pool.cc:224] Handling call
0709 13:02:33.024319 (+   499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:33.025037 (+   718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.025424 (+   387us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:32.585620  6364 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:33.054471  1588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2276) took 1209 ms. Trace:
I20260709 13:02:33.054772  6306 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:33.054834  1588 rpcz_store.cc:276] 0709 13:02:31.845145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.053600 (+1208455us) service_pool.cc:224] Handling call
0709 13:02:33.053931 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:33.054115 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:33.054142 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:33.054191 (+    49us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:33.054226 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.054300 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:33.054405 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:33.056018  6240 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:33.056147  6272 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:33.057245  1588 raft_consensus.cc:1275] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:32.939822  6299 raft_consensus.cc:2749] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:02:33.033391  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 62948.4us
I20260709 13:02:33.058627  1587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2264) took 2621 ms. Trace:
W20260709 13:02:33.032279  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.931802  6333 consensus_queue.cc:1059] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:02:33.035785  6377 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:33.059425  1558 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:33.061106  6364 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:33.062629  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:33.062863  1558 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:33.063656  6364 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:33.064023  6364 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.064570  6364 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:33.064841  6246 consensus_meta.cc:287] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.703s	user 0.000s	sys 0.011s
W20260709 13:02:33.065919  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.067991  6107 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:33.068524  6107 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:33.070327  6390 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:33.070629  1705 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:33.070878  6107 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:33.050931  1584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2275) took 1206 ms. Trace:
I20260709 13:02:33.073060  1584 rpcz_store.cc:276] 0709 13:02:31.844307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.049399 (+1205092us) service_pool.cc:224] Handling call
0709 13:02:33.049834 (+   435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:33.050636 (+   802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.050863 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:33.074481  6239 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:33.075014  6239 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:33.074944  1584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2278) took 1173 ms. Trace:
I20260709 13:02:33.075616  1584 rpcz_store.cc:276] 0709 13:02:31.901699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.074030 (+1172331us) service_pool.cc:224] Handling call
0709 13:02:33.074392 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:33.074612 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:33.074637 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:33.074681 (+    44us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:33.074715 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.074767 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:33.074885 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:33.016888  6322 raft_consensus.cc:2804] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:33.052294  1486 catalog_manager.cc:5697] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:33.077158  1584 raft_consensus.cc:1240] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:02:33.077271  6322 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:33.077831  6322 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:33.077768  1630 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:33.078313  1558 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:33.079128  5574 raft_consensus.cc:2749] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:33.059056  1587 rpcz_store.cc:276] 0709 13:02:30.437590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.798389 (+360799us) service_pool.cc:224] Handling call
0709 13:02:30.798798 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:31.589774 (+790976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.058311 (+1468537us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b54003926d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:33.058472 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1764254464}
I20260709 13:02:33.079298  6272 raft_consensus.cc:2749] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:33.080709  1587 raft_consensus.cc:1240] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:33.057993  1588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2277) took 1183 ms. Trace:
I20260709 13:02:33.077307  6107 raft_consensus.cc:2804] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:33.081355  1587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2903) took 1070 ms. Trace:
I20260709 13:02:33.081614  1588 rpcz_store.cc:276] 0709 13:02:31.874958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.056039 (+1181081us) service_pool.cc:224] Handling call
0709 13:02:33.056331 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:33.057743 (+  1412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.057939 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:33.082028  1587 rpcz_store.cc:276] 0709 13:02:32.011278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.080236 (+1068958us) service_pool.cc:224] Handling call
0709 13:02:33.080539 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:33.081124 (+   585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.081302 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:33.083765  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:33.084554  1587 raft_consensus.cc:1275] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:33.084998  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:33.085454  6166 raft_consensus.cc:3055] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:33.085629  1661 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:02:33.085770  1486 catalog_manager.cc:5697] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 7 to 10, leader changed from 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:33.087543  1486 catalog_manager.cc:5697] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 7 to 10, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:33.081889  6107 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:33.089223  6107 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:32.912467  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:33.091405  1663 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:02:32.947846  1734 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:33.095687  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:33.096561  1663 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
W20260709 13:02:33.097795  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 368129us
I20260709 13:02:33.101989  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:33.102627  1587 raft_consensus.cc:1275] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:02:33.105803  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:33.111411  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:33.112380  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.111320  1591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2897) took 1459 ms. Trace:
I20260709 13:02:33.115053  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:33.115974  1741 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:02:33.117548  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:33.118225  1741 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:02:33.119184  1662 raft_consensus.cc:1240] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:33.077808  1584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2902) took 1066 ms. Trace:
I20260709 13:02:33.121210  1584 rpcz_store.cc:276] 0709 13:02:32.010991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.076543 (+1065552us) service_pool.cc:224] Handling call
0709 13:02:33.076921 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:33.077558 (+   637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.077760 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:33.122331  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:33.122455  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:33.115592  1591 rpcz_store.cc:276] 0709 13:02:31.653409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.487871 (+834462us) service_pool.cc:224] Handling call
0709 13:02:32.488385 (+   514us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:32.488689 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:32.905501 (+416812us) log.cc:844] Serialized 14 byte log entry
0709 13:02:33.110967 (+205466us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:33.111025 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:33.111069 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.111140 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:33.111260 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":283194,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"thread_start_us":529284,"threads_started":2}
W20260709 13:02:33.124382  1707 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.035s	sys 0.079s
I20260709 13:02:33.126161  1735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35672 (request call id 550) took 1809 ms. Trace:
I20260709 13:02:33.127043  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:33.123144  2424 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:33.018472  6373 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:33.127839  1733 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.013s	sys 0.035s
I20260709 13:02:33.128568  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:33.143262  1741 raft_consensus.cc:3060] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:33.085881  6166 raft_consensus.cc:740] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:33.132391  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:33.139804  1735 rpcz_store.cc:276] 0709 13:02:31.300525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.300670 (+   145us) service_pool.cc:224] Handling call
0709 13:02:31.301130 (+   460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:31.459629 (+158499us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:31.459677 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:31.484410 (+ 24733us) log.cc:844] Serialized 26 byte log entry
0709 13:02:31.663277 (+178867us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:31.663311 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:31.663374 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:33.045989 (+1382615us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b4400022b4c. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7ddc8c85 00007f1b7ddc96a2 00007f1b80b3b1db 00007f1b80b36aaf 00007f1b80b2a86e 00007f1b80b29bb6 00007f1b80b297d8 00007f1b80b33221 00007f1b80b331d9 00007f1b80b33169
0709 13:02:33.100505 (+ 54516us) raft_consensus.cc:1685] finished
0709 13:02:33.100535 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:33.109701 (+  9166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":39157,"raft.run_cpu_time_us":60,"raft.run_wall_time_us":60,"spinlock_wait_cycles":5073280,"thread_start_us":299254,"threads_started":2,"wal-append.queue_time_us":181910}
I20260709 13:02:33.143301  1587 raft_consensus.cc:2393] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 7: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:33.144827  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:33.145068  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:33.146373  2424 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:02:33.146845  1733 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.015s	sys 0.036s
I20260709 13:02:33.148057  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:33.150880  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:33.155905  1587 raft_consensus.cc:2393] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 8: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:33.156399  6263 raft_consensus.cc:2804] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:33.149607  6128 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.157003  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:33.157800  1737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43678 (request call id 3543) took 1028 ms. Trace:
I20260709 13:02:33.157943  1587 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
I20260709 13:02:33.152115  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:33.158217  1737 rpcz_store.cc:276] 0709 13:02:32.128903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.248171 (+119268us) service_pool.cc:224] Handling call
0709 13:02:33.157606 (+909435us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b5400276d54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:33.157740 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1755431296}
I20260709 13:02:33.159030  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:33.159401  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:33.159941  1737 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:33.160252  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:33.137364  6298 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:33.161070  6298 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:33.161787  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:33.162359  1740 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 14.
I20260709 13:02:33.163532  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:33.163863  6298 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:33.165359  6358 consensus_queue.cc:1048] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:33.166890  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:33.168015  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:33.169380  1585 raft_consensus.cc:1240] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:33.173808  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:33.173658  6166 consensus_queue.cc:260] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:33.174845  6166 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:33.174700  2426 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:33.175077  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:33.175742  5721 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:33.176106  2426 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:33.176326  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:33.152051  6074 raft_consensus.cc:2749] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:33.153139  1705 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:33.153836  6386 consensus_queue.cc:1059] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:02:33.153873  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:33.124594  6360 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:33.154984  1633 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:33.157624  6128 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:33.165663  1590 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2887) took 1556 ms (client timeout 1582 ms). Trace:
I20260709 13:02:33.154567  6382 consensus_queue.cc:1048] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:02:33.187949  1661 raft_consensus.cc:1275] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:33.178782  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:33.189600  1662 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:33.179005  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:33.154032  2423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:33.148689  1707 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.036s	sys 0.079s
I20260709 13:02:33.179180  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:33.179692  1591 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 14.
W20260709 13:02:33.187489  1590 rpcz_store.cc:269] 0709 13:02:31.608985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.618398 (+  9413us) service_pool.cc:224] Handling call
0709 13:02:33.165461 (+1547063us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b54003b3dd4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:33.165604 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1405062016}
I20260709 13:02:33.195091  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:33.180168  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:33.180526  1659 raft_consensus.cc:1240] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:02:33.180365  2424 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:33.180843  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:33.092963  6246 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:33.183739  1633 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:33.076745  6364 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:33.236229  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:33.199714  1664 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
I20260709 13:02:33.237097  1735 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 12.
W20260709 13:02:33.241606  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 61317.2us
I20260709 13:02:33.246397  1741 raft_consensus.cc:2468] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:02:33.201992  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:33.202725  1556 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:33.252556  1590 raft_consensus.cc:2410] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 13:02:33.240056  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 45162.4us
W20260709 13:02:33.255977  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 53342us
I20260709 13:02:33.256717  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:33.258419  1556 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:33.260699  1556 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:33.262595  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:33.265884  1590 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:33.271204  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:33.271817  1707 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:33.272223  1667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 2774) took 1379 ms. Trace:
I20260709 13:02:33.272918  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:33.272576  1667 rpcz_store.cc:276] 0709 13:02:31.893215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.057139 (+163924us) service_pool.cc:224] Handling call
0709 13:02:32.058033 (+   894us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:32.357239 (+299206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.271957 (+914718us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b54002b25d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:33.272161 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":545071488}
I20260709 13:02:33.273702  1591 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 9.
I20260709 13:02:33.274253  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:33.275743  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:33.278687  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:33.178139  6386 raft_consensus.cc:3055] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:33.283753  1662 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
I20260709 13:02:33.149252  6304 consensus_queue.cc:1048] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.099s
I20260709 13:02:33.201820  6306 raft_consensus.cc:2749] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:33.157064  6263 raft_consensus.cc:697] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:33.188020  6349 raft_consensus.cc:2749] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:33.200950  6395 raft_consensus.cc:2804] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:33.287218  1707 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:33.281123  6358 raft_consensus.cc:2804] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:33.285485  1737 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:02:33.325920  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:33.326354  1707 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:33.289845  1663 raft_consensus.cc:2468] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
I20260709 13:02:33.235368  6356 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:33.270951  6390 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:33.270555  6292 raft_consensus.cc:2804] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:33.202325  6360 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:33.337387  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:33.320816  1735 raft_consensus.cc:1240] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 9 LEADER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:33.290081  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:33.272325  6351 raft_consensus.cc:2749] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:33.250572  6086 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:33.287575  6006 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:33.285869  6342 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:33.351439  6342 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:33.321655  6395 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.354190  6395 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:33.354875  6342 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:33.359231  1586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2890) took 1748 ms. Trace:
I20260709 13:02:33.359668  1586 rpcz_store.cc:276] 0709 13:02:31.610718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.462100 (+851382us) service_pool.cc:224] Handling call
0709 13:02:32.504512 (+ 42412us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:32.766429 (+261917us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:32.766461 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:32.808466 (+ 42005us) log.cc:844] Serialized 52 byte log entry
0709 13:02:33.111832 (+303366us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:33.111869 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.111933 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:33.358970 (+247037us) raft_consensus.cc:1685] finished
0709 13:02:33.358992 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:33.359168 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":254271,"raft.queue_time_us":261167,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"thread_start_us":302933,"threads_started":1,"wal-append.queue_time_us":471999}
I20260709 13:02:33.361383  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:33.362275  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:33.290669  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:33.362957  1741 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 13.
I20260709 13:02:33.363271  2543 raft_consensus.cc:2393] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 7: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:02:33.288425  6394 raft_consensus.cc:2749] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:33.363940  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:33.364063  1658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 2771) took 1472 ms. Trace:
I20260709 13:02:33.366098  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:33.366914  1589 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
I20260709 13:02:33.367969  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:33.368619  1589 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:33.370088  6246 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:33.336145  6292 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:33.370625  6360 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:33.370734  1733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43686 (request call id 2376) took 1357 ms. Trace:
I20260709 13:02:33.371510  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:33.373057  1591 raft_consensus.cc:1240] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:33.374374  1591 raft_consensus.cc:1275] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:02:33.374588  6107 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:33.327807  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 67199.3us
I20260709 13:02:33.309583  6344 raft_consensus.cc:2804] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:33.371026  6292 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:33.375432  1591 raft_consensus.cc:1240] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:33.326172  6358 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:33.339205  6303 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:33.380990  1736 raft_consensus.cc:2410] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:02:33.344559  6390 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:33.380815  6377 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:33.364514  1658 rpcz_store.cc:276] 0709 13:02:31.891795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.994282 (+102487us) service_pool.cc:224] Handling call
0709 13:02:31.994615 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:32.250513 (+255898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.363835 (+1113322us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b540041d2d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:33.364009 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":367959936}
I20260709 13:02:33.381490  6006 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:33.382805  1737 raft_consensus.cc:1275] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:33.383055  6282 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:33.371345  1733 rpcz_store.cc:276] 0709 13:02:32.013718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.014179 (+   461us) service_pool.cc:224] Handling call
0709 13:02:32.014498 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:32.354701 (+340203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:32.354734 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:32.355207 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 13:02:32.532232 (+177025us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:33.149584 (+617352us) log.cc:844] Serialized 14 byte log entry
0709 13:02:33.149816 (+   232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.370205 (+220389us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b5400157cd4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:33.370268 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:33.370328 (+    60us) raft_consensus.cc:1685] finished
0709 13:02:33.370485 (+   157us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:33.370660 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":797418,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":5645,"raft.queue_time_us":1279,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"spinlock_wait_cycles":839478528,"thread_start_us":686698,"threads_started":2,"wal-append.queue_time_us":416979}
I20260709 13:02:33.362411  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:33.384070  1739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35672 (request call id 562) took 1001 ms. Trace:
I20260709 13:02:33.385428  1583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 2892) took 1774 ms. Trace:
I20260709 13:02:33.385849  1558 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:02:33.437455  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 51691.4us
I20260709 13:02:33.386566  6331 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:33.388062  1738 consensus_queue.cc:260] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:33.385852  6263 consensus_queue.cc:237] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:33.450016  1588 raft_consensus.cc:1240] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:33.284183  6386 raft_consensus.cc:740] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:33.390726  6301 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:33.454442  6377 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:33.456876  6390 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:33.449285  6361 raft_consensus.cc:2804] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:33.458030  6361 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.458422  6361 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:33.459080  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:33.460393  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:33.393464  1666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39146 (request call id 3550) took 1130 ms. Trace:
I20260709 13:02:33.461236  1666 rpcz_store.cc:276] 0709 13:02:32.263234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.319815 (+ 56581us) service_pool.cc:224] Handling call
0709 13:02:33.393283 (+1073468us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b5400359654. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:33.393383 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1281368448}
W20260709 13:02:33.461670  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.428038  6344 raft_consensus.cc:697] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:33.323302  5574 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:33.394707  1592 raft_consensus.cc:1240] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:02:33.325094  2426 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede
W20260709 13:02:33.469662  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 144681us
I20260709 13:02:33.472080  2426 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:33.403049  1741 raft_consensus.cc:2393] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 14: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:33.405556  1556 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:33.406353  1589 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
I20260709 13:02:33.347390  6299 raft_consensus.cc:2804] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:33.423511  1740 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
W20260709 13:02:33.419235  6309 consensus_meta.cc:287] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.955s	user 0.004s	sys 0.009s
I20260709 13:02:33.479027  1734 raft_consensus.cc:1275] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:02:33.479660  1734 pending_rounds.cc:85] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 7
I20260709 13:02:33.480093  1734 pending_rounds.cc:107] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:02:33.480496  1734 raft_consensus.cc:2889] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:33.427794  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 244261us
I20260709 13:02:33.403883  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:33.434651  1739 rpcz_store.cc:276] 0709 13:02:32.382426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.007984 (+625558us) service_pool.cc:224] Handling call
0709 13:02:33.008392 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:33.024591 (+ 16199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.383830 (+359239us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b54000c4c54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:33.384005 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35571072}
I20260709 13:02:33.483431  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:33.438458  1558 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:02:33.484407  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 46078.8us
I20260709 13:02:33.485471  1558 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:33.398313  6349 consensus_queue.cc:1059] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:02:33.425145  6358 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:33.435655  1583 rpcz_store.cc:276] 0709 13:02:31.611248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.467231 (+855983us) service_pool.cc:224] Handling call
0709 13:02:32.467769 (+   538us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:32.468275 (+   506us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:32.468316 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:32.481705 (+ 13389us) log.cc:844] Serialized 52 byte log entry
0709 13:02:33.092689 (+610984us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:33.110737 (+ 18048us) log.cc:844] Serialized 14 byte log entry
0709 13:02:33.122420 (+ 11683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.122508 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:33.385204 (+262696us) raft_consensus.cc:1685] finished
0709 13:02:33.385226 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:33.385369 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":200767,"prepare.queue_time_us":31269,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":20072,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":19102,"spinlock_wait_cycles":9589504,"thread_start_us":383874,"threads_started":1,"wal-append.queue_time_us":711268}
I20260709 13:02:33.284436  6319 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:33.450685  1738 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:33.452571  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:33.342865  6356 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:33.426131  6334 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:33.395903  6399 log.cc:927] Time spent T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:02:33.465799  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 134804us
I20260709 13:02:33.399771  6086 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:33.461001  1733 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
W20260709 13:02:33.476616  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 71138us
I20260709 13:02:33.526998  1707 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:33.425462  6239 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:33.551065  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:33.551764  6239 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:33.552407  6305 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:33.552862  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:33.553164  6006 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:33.503134  6317 raft_consensus.cc:2804] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:33.454744  6128 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:33.486716  1558 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:33.489521  1734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3539) took 1437 ms. Trace:
I20260709 13:02:33.554649  1734 rpcz_store.cc:276] 0709 13:02:32.052133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.322870 (+270737us) service_pool.cc:224] Handling call
0709 13:02:32.323484 (+   614us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:33.489254 (+1165770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.489461 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:33.503381  1583 raft_consensus.cc:1275] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:33.512660  6273 raft_consensus.cc:3055] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:33.516129  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:33.559235  6273 raft_consensus.cc:740] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:33.517442  6319 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:33.560281  6273 consensus_queue.cc:260] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:33.561498  6319 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:33.523559  2424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.523448  6377 raft_consensus.cc:2749] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:33.562053  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 75403.1us
I20260709 13:02:33.562664  6377 raft_consensus.cc:2804] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:33.563037  6377 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.483569  6301 raft_consensus.cc:2749] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:33.561509  6273 raft_consensus.cc:3060] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:33.479894  6240 raft_consensus.cc:2804] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:33.529376  1556 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:33.563992  6240 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:33.564558  6240 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:33.481914  1633 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:33.461752  6386 consensus_queue.cc:260] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:33.565653  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 83870.7us
I20260709 13:02:33.566370  6386 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:33.566663  1633 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:33.567785  1633 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:33.568681  1588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2283) took 1381 ms. Trace:
I20260709 13:02:33.569383  6128 raft_consensus.cc:2749] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:33.569149  1588 rpcz_store.cc:276] 0709 13:02:32.187282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.084538 (+897256us) service_pool.cc:224] Handling call
0709 13:02:33.084838 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:33.451983 (+367145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.568443 (+116460us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b54001d24d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:33.568618 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":839367424}
I20260709 13:02:33.563138  1558 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:33.571465  6291 raft_consensus.cc:2804] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:33.572010  6291 raft_consensus.cc:697] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:33.504210  5721 consensus_queue.cc:1048] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:02:33.527549  6334 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:33.536036  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.580862  1738 raft_consensus.cc:1275] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:02:33.586357  1738 pending_rounds.cc:85] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 5
I20260709 13:02:33.483779  6309 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:33.537739  6395 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:33.541543  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:33.590852  1741 raft_consensus.cc:2393] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 10: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:33.542083  6107 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:33.542500  2523 raft_consensus.cc:2393] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 7: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:02:33.542897  6344 consensus_queue.cc:237] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:33.544080  1736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43686 (request call id 2377) took 1530 ms. Trace:
I20260709 13:02:33.544929  5914 consensus_queue.cc:1059] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:33.548069  1590 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 17.
I20260709 13:02:33.549461  2554 raft_consensus.cc:1240] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:33.553536  2550 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 14.
I20260709 13:02:33.451704  6322 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:33.554034  6317 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.476042  6299 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.563493  6377 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:33.573057  1732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3541) took 1444 ms. Trace:
I20260709 13:02:33.568787  1633 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:33.572826  6291 consensus_queue.cc:237] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:33.573969  1558 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:33.484458  6289 raft_consensus.cc:2804] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:33.587091  1738 pending_rounds.cc:107] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:02:33.615521  1738 raft_consensus.cc:2889] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:33.588047  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:33.577675  6286 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:33.598349  1736 rpcz_store.cc:276] 0709 13:02:32.014031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.044539 (+ 30508us) service_pool.cc:224] Handling call
0709 13:02:33.543827 (+1499288us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b5400276854. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:33.543992 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3061356928}
I20260709 13:02:33.601284  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:33.590602  6068 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:33.585222  6006 raft_consensus.cc:2749] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:33.604199  1587 raft_consensus.cc:1240] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:33.625314  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:33.612299  1705 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:33.614226  1741 raft_consensus.cc:1275] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:02:33.626963  1741 pending_rounds.cc:85] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 7
I20260709 13:02:33.627262  1741 pending_rounds.cc:107] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:02:33.627192  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:33.627631  1741 raft_consensus.cc:2889] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:33.607275  1732 rpcz_store.cc:276] 0709 13:02:32.128425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.353092 (+224667us) service_pool.cc:224] Handling call
0709 13:02:32.353555 (+   463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:32.993821 (+640266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:32.993869 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:32.994604 (+   735us) log.cc:844] Serialized 26 byte log entry
0709 13:02:33.402608 (+408004us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:33.402668 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.572681 (+170013us) spinlock_profiling.cc:243] Waited 639 ms on lock 0x7b540001d454. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:33.572728 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:33.572776 (+    48us) raft_consensus.cc:1685] finished
0709 13:02:33.572789 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:33.573001 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9339,"raft.run_cpu_time_us":1088,"raft.run_wall_time_us":1088,"spinlock_wait_cycles":1470822272,"thread_start_us":407519,"threads_started":1,"wal-append.queue_time_us":356644}
I20260709 13:02:33.602645  6054 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:33.615685  1733 raft_consensus.cc:1240] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 13:02:33.619179  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 45272.6us
I20260709 13:02:33.589002  5921 consensus_queue.cc:1048] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:02:33.623440  1738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3535) took 1631 ms. Trace:
I20260709 13:02:33.623828  1736 raft_consensus.cc:1275] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:02:33.614899  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:33.609341  6317 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:33.637571  1705 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:33.615706  6239 raft_consensus.cc:2804] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:33.638342  1707 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:33.641959  1555 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:33.608908  6299 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:33.629667  1633 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:33.636493  1738 rpcz_store.cc:276] 0709 13:02:31.992029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.992657 (+   628us) service_pool.cc:224] Handling call
0709 13:02:32.058307 (+ 65650us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:33.387738 (+1329431us) spinlock_profiling.cc:243] Waited 583 ms on lock 0x7b540040cf20. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f0d06f 00007f1b80f85f60 00007f1b80f877de 00007f1b80f91b49 00007f1b80f92416 00007f1b80f8ed8f 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62
0709 13:02:33.623211 (+235473us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.623386 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1339946752}
I20260709 13:02:33.643726  1738 raft_consensus.cc:1240] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:33.617581  6286 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.646307  1707 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:33.621833  6301 raft_consensus.cc:2804] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:33.649740  1707 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:33.650166  1658 raft_consensus.cc:1275] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:33.647857  6324 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:33.651808  6349 raft_consensus.cc:2749] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:33.653932  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:33.641042  6239 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.687251  6239 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:33.654559  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:33.688205  6311 raft_consensus.cc:2804] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:33.654688  6390 raft_consensus.cc:3060] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:33.651118  1705 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:33.654750  6286 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:33.703424  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:33.704577  2552 raft_consensus.cc:2368] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 9. Current term is 10.
I20260709 13:02:33.655874  6112 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:33.705379  6112 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:33.705526  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:33.705705  6301 raft_consensus.cc:697] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:33.706321  1666 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:33.706768  6301 consensus_queue.cc:237] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:33.707489  1630 leader_election.cc:400] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 election: Vote denied by peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157) with higher term. Message: Invalid argument: T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 9. Current term is 10.
I20260709 13:02:33.707820  1630 leader_election.cc:403] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:02:33.705837  6112 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:33.710237  6349 raft_consensus.cc:2749] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:33.705560  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 54502.4us
I20260709 13:02:33.648465  6411 consensus_queue.cc:1048] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:02:33.722118  1585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2268) took 1891 ms. Trace:
I20260709 13:02:33.621726  6068 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:33.723455  6356 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:33.723628  6068 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:33.725037  6286 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:33.628288  6407 consensus_queue.cc:1048] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:02:33.726552  6296 consensus_queue.cc:1048] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:33.727543  6333 raft_consensus.cc:3055] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:33.662878  6086 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:33.740657  6239 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:33.743189  6239 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:33.745214   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:33.747871  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:02:33.669701  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 91341.8us
I20260709 13:02:33.670662  6240 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:33.749186  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:33.750201  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:33.750649  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:33.751231  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:33.751339  1732 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:02:33.752079  1735 raft_consensus.cc:2393] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 16: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:33.753135  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:33.755002  2543 raft_consensus.cc:1240] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:33.671964  6395 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:33.756217  1734 raft_consensus.cc:1240] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:33.756371  1732 raft_consensus.cc:1240] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:33.672354  6309 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:33.621706  6406 consensus_queue.cc:1048] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:02:33.628477  6289 raft_consensus.cc:697] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
W20260709 13:02:33.674314  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.675127  6361 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:33.640962  6054 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:33.642870  6282 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:33.765265  6386 consensus_queue.cc:1059] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:33.760794  6406 consensus_queue.cc:1243] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer 6d4de2ce0683442498244b9529127f91 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:02:33.765311  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:33.766705  1737 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:33.689137  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:33.694245  6166 consensus_meta.cc:287] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.519s	user 0.014s	sys 0.001s
I20260709 13:02:33.695511  6322 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:33.697139  6358 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:33.771523  6361 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:33.772015  6358 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:33.772122  6361 consensus_queue.cc:1048] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:33.771350  1556 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:33.773962  6386 raft_consensus.cc:3055] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:33.773612  6289 consensus_queue.cc:237] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:33.774344  6386 raft_consensus.cc:740] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:33.697837  6292 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:33.698351  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 48689.2us
I20260709 13:02:33.776608  1707 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:33.688723  6311 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.777562  6311 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:33.700634  6265 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.647785  5574 raft_consensus.cc:2804] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:33.722661  1585 rpcz_store.cc:276] 0709 13:02:31.831055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.496189 (+665134us) service_pool.cc:224] Handling call
0709 13:02:33.169199 (+673010us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:33.169757 (+   558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.721849 (+552092us) spinlock_profiling.cc:243] Waited 377 ms on lock 0x7b54003b3dd0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8e8ad 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:33.722023 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":867974528}
I20260709 13:02:33.725868  1705 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:33.666877  6334 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:33.784617  6265 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:33.785466  6406 consensus_queue.cc:1048] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:33.787494  6265 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:33.787629  6406 consensus_queue.cc:1059] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:33.788354  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:33.790135  1707 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:33.790261  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:33.727921  6333 raft_consensus.cc:740] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:33.736984  6286 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:33.736793  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:33.797363  1707 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:33.738989  6112 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:33.810827  6112 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:33.811466  6112 raft_consensus.cc:3055] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:33.757326  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:33.811698  6348 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:33.812040  6286 consensus_queue.cc:1059] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:33.812563  1734 raft_consensus.cc:2393] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 9: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:33.813160  6006 raft_consensus.cc:3055] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:33.813551  6006 raft_consensus.cc:740] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:33.763521  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:33.761684  1735 raft_consensus.cc:1275] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:33.775254  6386 consensus_queue.cc:260] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:33.779816  6128 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.812664  6348 raft_consensus.cc:697] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 17 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:33.782888  1556 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:33.784493  6166 raft_consensus.cc:2804] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:33.788785  6331 raft_consensus.cc:2804] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:33.732833  1661 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
I20260709 13:02:33.791893  1739 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:33.751503  6240 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:33.788416  5574 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:33.799579  6333 consensus_queue.cc:260] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:33.808214  6364 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:33.801136  6068 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:33.738734  6407 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:33.782415  6322 raft_consensus.cc:2749] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:33.759024  1738 raft_consensus.cc:1275] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:33.781383  1732 raft_consensus.cc:1240] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:02:33.851045  6331 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:33.850720  5574 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:33.919162  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:33.828876  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:02:33.782755  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 57167.1us
I20260709 13:02:33.830139  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:33.945950  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:33.947425  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:33.831108  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:33.833457  1587 raft_consensus.cc:1240] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:02:33.833544  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:33.833863  1666 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 10.
I20260709 13:02:33.948558  1583 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 14.
W20260709 13:02:33.838446  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 56561.5us
I20260709 13:02:33.951951  1583 raft_consensus.cc:1275] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:33.952621  1556 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:33.847685  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:33.954056  1588 raft_consensus.cc:2393] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 11: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:33.846012  1558 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:33.850505  1589 raft_consensus.cc:1240] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:33.811867  6112 raft_consensus.cc:740] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:33.855464  1586 raft_consensus.cc:1240] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:33.817392  1737 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
W20260709 13:02:33.967100  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 121210us
I20260709 13:02:33.827127  6334 raft_consensus.cc:2804] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:33.850245  6309 raft_consensus.cc:2804] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:02:33.942564  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.834367  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:33.950197  1740 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:33.983129  1660 raft_consensus.cc:1240] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:33.958458  1556 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:33.968112  1735 raft_consensus.cc:1240] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:33.838900  6166 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.976706  1705 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:33.975920  1739 raft_consensus.cc:2410] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:02:33.986578  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:33.988231  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:33.988998  1739 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:33.920370  6386 raft_consensus.cc:3060] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:33.828828  6265 consensus_queue.cc:1048] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.138s
I20260709 13:02:33.856594  6355 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:34.003893  1558 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:33.972085  6364 raft_consensus.cc:2804] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:33.918946  6331 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:33.838007  6128 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:33.848758  6328 consensus_queue.cc:1059] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.132s
I20260709 13:02:34.052253  6328 raft_consensus.cc:3055] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:34.052660  6328 raft_consensus.cc:740] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:33.984561  6356 consensus_queue.cc:1059] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:02:34.053529  6328 consensus_queue.cc:260] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:34.054138  6356 raft_consensus.cc:3055] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:34.054529  6356 raft_consensus.cc:740] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:34.054831  6328 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:34.055317  6356 consensus_queue.cc:260] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:34.056516  6356 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:34.009871  6360 consensus_queue.cc:1048] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:02:34.008651  6344 consensus_queue.cc:1059] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:02:33.955827  6273 raft_consensus.cc:2749] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157) with higher term. Message: Invalid argument: T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 9. Current term is 10.
I20260709 13:02:33.960065  6333 raft_consensus.cc:3060] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:34.016289  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 57895.8us
I20260709 13:02:34.010756  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:33.854206  6406 consensus_queue.cc:1048] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.152s
I20260709 13:02:33.980206  6319 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.981119  6309 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.855634  6377 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:34.027423  1558 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:33.972692  6290 raft_consensus.cc:2749] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:34.065954  6290 raft_consensus.cc:2749] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:34.066576  1558 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:34.067790  1558 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:34.039886  6317 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:33.984800  6298 consensus_queue.cc:1048] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:02:34.022251  6411 raft_consensus.cc:2749] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:33.956534  6407 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:34.001564  6166 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:34.051302  6128 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:34.058172  6282 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:34.007237  6334 raft_consensus.cc:697] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 10 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:34.023756  6364 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:34.069211  1556 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:34.068965  1739 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:02:34.102759  1590 raft_consensus.cc:1240] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:02:34.104061  1739 raft_consensus.cc:1275] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:02:34.071290  1558 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:34.024860  1740 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:02:34.028932  6303 raft_consensus.cc:2804] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:34.071856  6290 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:34.014307  6239 consensus_queue.cc:1059] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 13:02:34.028980  6358 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:34.109841  1707 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:34.129335  1707 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:34.110612  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:34.113700  1585 raft_consensus.cc:1240] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:34.026568  6351 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:34.065184  6309 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:34.085466  6302 raft_consensus.cc:2804] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:02:34.125553  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 63935.8us
I20260709 13:02:33.956032  6006 consensus_queue.cc:260] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:34.099944  6305 consensus_meta.cc:287] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.547s	user 0.007s	sys 0.008s
I20260709 13:02:34.115242  6364 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:34.139859  6407 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:34.008270  6112 consensus_queue.cc:260] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:34.065090  6319 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:34.115013  6303 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:34.141599  6292 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:34.117506  6411 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:34.142315  6086 raft_consensus.cc:2764] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:02:34.077754  5574 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:34.028004  6355 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:34.158380  6302 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:34.161895  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.137603  6334 consensus_queue.cc:237] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:34.166972  6265 consensus_queue.cc:1048] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:34.137638  6377 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:34.177934  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 249715us
I20260709 13:02:34.183233  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:34.172106  6305 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:34.171269  6412 raft_consensus.cc:2749] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:34.188804  6006 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:34.191455  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.078305  6348 consensus_queue.cc:237] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:34.186880  6303 raft_consensus.cc:3060] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:34.200940  1633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.199285  1737 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:34.220320  1741 raft_consensus.cc:1240] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 11. Current term is 12. Ops: [11.6-11.6]
W20260709 13:02:34.246253  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.156957  6351 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:34.201804  6299 consensus_meta.cc:287] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.512s	user 0.007s	sys 0.003s
I20260709 13:02:34.201275  6112 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:34.198642  6302 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:34.216899  6423 log.cc:927] Time spent T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
W20260709 13:02:34.243517  6390 consensus_meta.cc:287] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.533s	user 0.011s	sys 0.000s
I20260709 13:02:34.255307  6311 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:34.289515  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 281653us
I20260709 13:02:34.293404  6412 consensus_queue.cc:1048] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:34.295926  1705 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:34.296013  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:34.297434  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:34.298671  6412 raft_consensus.cc:2804] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:34.299305  6412 raft_consensus.cc:697] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 10 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:34.298833  1734 raft_consensus.cc:1240] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:34.300381  6412 consensus_queue.cc:237] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:34.305886  6305 consensus_queue.cc:1059] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:34.307150  6305 raft_consensus.cc:3055] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:34.307560  6305 raft_consensus.cc:740] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:34.308521  6305 consensus_queue.cc:260] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:34.309587  6305 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:34.315711  6166 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:34.333778  5574 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:34.259003  6068 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:34.340065  1736 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.012s	sys 0.043s
I20260709 13:02:34.321604  6390 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:34.406261  1736 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.012s	sys 0.044s
I20260709 13:02:34.386716  6296 raft_consensus.cc:2804] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:34.403041  1737 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 15.
I20260709 13:02:34.264542  6299 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:34.337095  6394 consensus_queue.cc:1048] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 13:02:34.423614  1591 raft_consensus.cc:2368] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 10. Current term is 11.
W20260709 13:02:34.424616  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:34.429929  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.437566  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:34.442044  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:02:34.408677  6324 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.017s	sys 0.063s
I20260709 13:02:34.464389  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:02:34.416436  6426 log.cc:927] Time spent T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 13:02:34.464231  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:34.467525  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:34.471254  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:34.464969  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:34.472610  1733 raft_consensus.cc:1240] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:02:34.471316  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:34.414597  6317 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:34.474921  1658 raft_consensus.cc:1275] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:34.477979  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:34.418573  6311 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:34.478817  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:34.422389  6431 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.425750  6373 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
W20260709 13:02:34.513316  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 377452us
I20260709 13:02:34.515021  1707 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:34.516888  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:34.520979  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:34.522545  1663 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:02:34.523666  1707 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:34.550892  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 231973us
W20260709 13:02:34.469779  6324 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.018s	sys 0.063s
I20260709 13:02:34.570124  1667 raft_consensus.cc:1275] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:02:34.519006  6355 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:34.526566  6319 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:34.516737  6273 consensus_queue.cc:1059] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.096s
I20260709 13:02:34.515316  6431 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:34.622989  6420 log.cc:927] Time spent T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
W20260709 13:02:34.649627  6437 log.cc:927] Time spent T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:02:34.651516  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:34.652168  1736 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:34.667675  6425 log.cc:927] Time spent T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.711s	user 0.004s	sys 0.000s
I20260709 13:02:34.672230  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:34.673277  6166 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:34.673888  1732 raft_consensus.cc:1240] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:02:34.675688  6299 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:34.676115  6356 consensus_meta.cc:287] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.619s	user 0.010s	sys 0.001s
I20260709 13:02:34.515571  6364 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:34.519553  6373 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:34.681262  1663 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 15.
I20260709 13:02:34.679989  1740 raft_consensus.cc:1240] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:34.704739  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:34.707368  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:34.708176  1587 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:34.710412  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:02:34.712045  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.713600  1584 raft_consensus.cc:1240] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 14. Current term is 15. Ops: []
W20260709 13:02:34.714157  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 213853us
W20260709 13:02:34.676447  6328 consensus_meta.cc:287] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.621s	user 0.011s	sys 0.001s
I20260709 13:02:34.717595  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:34.718026  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:34.638391  6351 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:34.723884  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:34.677994  6263 raft_consensus.cc:3055] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:34.729194  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:34.736516  1738 raft_consensus.cc:2393] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 12: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:34.729856  1589 pending_rounds.cc:85] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91: Aborting all ops after (but not including) 4
I20260709 13:02:34.737550  1589 pending_rounds.cc:107] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:02:34.737847  1589 raft_consensus.cc:2889] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:34.729059  1665 raft_consensus.cc:1275] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:02:34.738921  1665 pending_rounds.cc:85] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 9
I20260709 13:02:34.738713  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:34.739264  1665 pending_rounds.cc:107] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:02:34.739553  1665 raft_consensus.cc:2889] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:34.732149  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:34.732585  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:34.740463  1666 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:34.733975  1586 raft_consensus.cc:1240] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:02:34.689010  6411 raft_consensus.cc:697] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:34.689477  6406 raft_consensus.cc:3055] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:34.683348  6054 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:34.734534  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:34.736238  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:02:34.748658  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:34.720474  6331 consensus_meta.cc:287] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.663s	user 0.011s	sys 0.000s
I20260709 13:02:34.777738  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:34.731931  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:34.768932  1584 raft_consensus.cc:1275] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:02:34.785434  6312 raft_consensus.cc:3055] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:34.786108  6312 raft_consensus.cc:740] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:34.787330  6431 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:34.789175  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:34.724236  6301 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.717268  6435 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:34.792704  1558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.769624  6406 raft_consensus.cc:740] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:34.748690  1591 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 11.
I20260709 13:02:34.771890  1587 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 11.
I20260709 13:02:34.623522  6303 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:34.800877  1586 raft_consensus.cc:1240] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:34.735235  6263 raft_consensus.cc:740] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
W20260709 13:02:34.802762  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 234731us
I20260709 13:02:34.805277  1666 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:02:34.716670  6407 consensus_queue.cc:1059] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 13:02:34.797904  6429 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:34.792584  6420 log.cc:927] Time spent T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:02:34.818286  1590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46836 (request call id 580) took 1183 ms. Trace:
I20260709 13:02:34.818923  1590 rpcz_store.cc:276] 0709 13:02:33.634535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.634895 (+   360us) service_pool.cc:224] Handling call
0709 13:02:33.639961 (+  5066us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:34.103273 (+463312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.817772 (+714499us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b54003e94d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:34.818167 (+   395us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1063784704}
I20260709 13:02:34.741845  6328 consensus_queue.cc:1048] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:02:34.794461  6086 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.830266  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:34.811494  6360 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.838023  1584 raft_consensus.cc:2393] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 in current term 15: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:34.793711  6331 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:34.844283  1556 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:34.798870  6301 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:34.832669  6407 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:34.846372  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 143739us
I20260709 13:02:34.798717  6435 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:34.826202  6429 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:34.840719  6086 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:34.866840  6435 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:34.867594  6429 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:34.867671  6355 consensus_queue.cc:1048] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:02:34.868158  6302 consensus_meta.cc:287] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.536s	user 0.005s	sys 0.006s
I20260709 13:02:34.868635  6302 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:34.869699  5921 consensus_queue.cc:1048] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:34.865015  1736 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 10.
I20260709 13:02:34.854660  1633 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:34.845470  6411 consensus_queue.cc:237] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:34.864645  1663 raft_consensus.cc:1275] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:02:34.875869  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:34.877033  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:34.839062  6406 consensus_queue.cc:260] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:34.874191  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:34.878153  6406 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:34.878587  1659 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:02:34.879171  6373 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:34.879828  6407 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:34.882331  6407 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:34.884123  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:34.884281  1660 raft_consensus.cc:1240] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:34.884760  2548 raft_consensus.cc:2468] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 7.
I20260709 13:02:34.844280  6360 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:34.887799  1584 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:02:34.888397  1584 raft_consensus.cc:606] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:34.890653  1734 raft_consensus.cc:1240] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:34.892452  1630 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:34.898792  6331 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:34.853638  6377 raft_consensus.cc:2749] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:34.868877  6263 consensus_queue.cc:260] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:34.900517  6263 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:34.912276  6429 raft_consensus.cc:2749] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:02:34.914002  6309 consensus_meta.cc:287] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.736s	user 0.008s	sys 0.004s
I20260709 13:02:34.914400  6309 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:34.916443  1592 raft_consensus.cc:2393] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 10: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
W20260709 13:02:34.911617  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 57003.3us
I20260709 13:02:34.919764  1633 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:34.919314  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:02:34.854554  6333 consensus_meta.cc:287] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.795s	user 0.013s	sys 0.000s
I20260709 13:02:34.922207  1660 raft_consensus.cc:2393] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 10: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:34.937733  6303 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:34.952864  1633 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:34.954496  1633 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:02:34.893177  6006 consensus_meta.cc:287] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.637s	user 0.006s	sys 0.005s
W20260709 13:02:34.956465  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 128619us
I20260709 13:02:34.958896  1662 raft_consensus.cc:2410] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:02:34.958307  2424 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:34.959815  1633 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:34.962827  1633 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:34.950712  6435 raft_consensus.cc:2804] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:34.974212  6006 raft_consensus.cc:2749] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:34.974975  1633 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:34.975499  1585 raft_consensus.cc:1240] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:34.904656  6312 consensus_queue.cc:260] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:34.920424  6447 consensus_queue.cc:1175] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6d4de2ce0683442498244b9529127f91" responder_term: 9 status { last_received { term: 9 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 9 index: 10 } }
I20260709 13:02:34.981858  6006 raft_consensus.cc:2749] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:34.983798  6296 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:35.015465  6296 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:35.015843  6302 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:34.985502  6348 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:34.985762  1733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43686 (request call id 2387) took 1628 ms. Trace:
I20260709 13:02:35.017382  1733 rpcz_store.cc:276] 0709 13:02:33.357766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.635496 (+277730us) service_pool.cc:224] Handling call
0709 13:02:33.635754 (+   258us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:34.476194 (+840440us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.985496 (+509302us) spinlock_profiling.cc:243] Waited 836 ms on lock 0x7b540001e354. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:34.985702 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1923264768}
I20260709 13:02:35.017515  6348 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:34.986172  1592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 2921) took 1155 ms. Trace:
I20260709 13:02:35.019443  1592 rpcz_store.cc:276] 0709 13:02:33.830784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.830886 (+   102us) service_pool.cc:224] Handling call
0709 13:02:34.985945 (+1155059us) spinlock_profiling.cc:243] Waited 967 ms on lock 0x7b54002b70d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:34.986117 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2223697152}
W20260709 13:02:34.964407  6112 consensus_meta.cc:287] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.676s	user 0.010s	sys 0.002s
I20260709 13:02:34.960595  6239 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:34.963800  6429 raft_consensus.cc:2749] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:35.010345  6457 log.cc:927] Time spent T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:02:35.030393  6239 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:35.036608  6348 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:34.962107  6454 raft_consensus.cc:2764] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:02:34.963215  6407 raft_consensus.cc:2764] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:02:34.987193  6305 consensus_queue.cc:1059] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:02:34.977555  6412 raft_consensus.cc:2749] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:35.007730  6334 raft_consensus.cc:3055] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:34.963608  6054 consensus_queue.cc:1059] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:02:34.972519  5515 consensus_queue.cc:1059] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:02:34.972471  6445 raft_consensus.cc:2804] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:34.986395  6390 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:35.007813  6458 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.009414  6443 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.962365  6394 consensus_queue.cc:1048] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:02:35.011852  1660 raft_consensus.cc:1275] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:35.012501  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:34.978212  6435 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.048920  6334 raft_consensus.cc:740] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:34.989599  1633 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:35.070838  1734 raft_consensus.cc:1275] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:35.055676  2426 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:35.100566  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:35.014925  6312 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:35.065995  1733 raft_consensus.cc:1240] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:02:35.098877  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
W20260709 13:02:35.100950  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 45390.7us
I20260709 13:02:35.106675  2553 raft_consensus.cc:2393] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 7: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:02:35.049559  6166 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:35.118475  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 129017us
I20260709 13:02:35.104712  5515 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:35.120702  6454 raft_consensus.cc:2764] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:02:35.120934  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:35.064615  6380 raft_consensus.cc:3055] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:35.064627  6445 raft_consensus.cc:697] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:35.130103  1584 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:02:35.063082  6435 raft_consensus.cc:3060] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:35.058827  6412 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:35.131680  1584 raft_consensus.cc:606] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:35.153532  1584 raft_consensus.cc:614] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:35.151259  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:35.153760  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:35.138617  6239 consensus_queue.cc:1059] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:35.141804  6296 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:35.135869  6454 consensus_queue.cc:1048] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:02:35.159922  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:35.160336  2424 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:35.160717  1738 raft_consensus.cc:2410] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:02:35.160414  1558 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:35.054318  6458 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:35.130342  6380 raft_consensus.cc:740] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:35.165596  6411 raft_consensus.cc:2749] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:35.149220  1633 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:35.149914  1556 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:35.167994  1556 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:35.150569  1734 raft_consensus.cc:1275] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:35.137884  6407 consensus_queue.cc:1059] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:35.173148  5574 raft_consensus.cc:2749] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:35.174050  2550 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 14.
I20260709 13:02:35.154852  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:35.155269  1740 raft_consensus.cc:1275] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:02:35.044620  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 521079us
I20260709 13:02:35.153059  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:35.176175  1733 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 19.
I20260709 13:02:35.158829  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:35.146358  6445 consensus_queue.cc:237] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:35.166764  1558 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:35.169883  1556 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:35.190702  1739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43686 (request call id 2408) took 1350 ms. Trace:
I20260709 13:02:35.063692  6443 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:35.177848  6377 raft_consensus.cc:2804] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:35.178417  6455 consensus_queue.cc:1048] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:35.178812  6458 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:35.179199  1735 raft_consensus.cc:2410] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:02:35.158360  5515 consensus_queue.cc:1048] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:02:35.179512  6348 raft_consensus.cc:3055] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:35.180558  6309 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:35.183797  6301 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:35.184751  6296 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:35.186182  1741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43686 (request call id 2388) took 1828 ms. Trace:
I20260709 13:02:35.156914  6328 consensus_queue.cc:1059] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:02:35.195060  1558 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:35.203470  6348 raft_consensus.cc:740] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:35.193719  6447 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:35.191566  1739 rpcz_store.cc:276] 0709 13:02:33.839806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.131726 (+291920us) service_pool.cc:224] Handling call
0709 13:02:34.132267 (+   541us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.132681 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:34.512410 (+379729us) log.cc:844] Serialized 14 byte log entry
0709 13:02:34.513140 (+   730us) log.cc:844] Serialized 14 byte log entry
0709 13:02:34.899421 (+386281us) spinlock_profiling.cc:243] Waited 6.97 ms on lock 0x7b180045cb80. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7dea2522 00007f1b7dea47c1 00007f1b7dea4779 00007f1b7dea4709 00007f1b7dea46d1 00007f1b7dea39cd 000000000038f354 000000000038f199 00007f1b7de8583a
0709 13:02:34.965201 (+ 65780us) spinlock_profiling.cc:243] Waited 4.69 ms on lock 0x7b180045cb80. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7de1cc0a 00007f1b8755c219 00007f1b7dea4a40 00007f1b7de9f4e4 00007f1b7de9f455 00007f1b80f87060 00007f1b80f99716 00007f1b80faa287 00007f1b80faa208
0709 13:02:35.190317 (+225116us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:35.190422 (+   105us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:35.190466 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.190533 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.190649 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":491218,"prepare.queue_time_us":128325,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":5662,"raft.queue_time_us":472592,"raft.run_cpu_time_us":344,"raft.run_wall_time_us":57614,"spinlock_wait_cycles":26811392,"thread_start_us":479613,"threads_started":2}
W20260709 13:02:35.194264  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 45265.1us
I20260709 13:02:35.211870  1707 leader_election.cc:400] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 10. Current term is 11.
I20260709 13:02:35.202265  6239 raft_consensus.cc:2749] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:35.203035  1556 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:35.196067  5574 raft_consensus.cc:2804] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:35.153458  6166 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:35.157774  6412 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:35.198122  6358 raft_consensus.cc:2749] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:35.214015  1633 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:35.207522  6377 raft_consensus.cc:697] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:35.227726  5574 raft_consensus.cc:697] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:35.205825  1741 rpcz_store.cc:276] 0709 13:02:33.358207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.636862 (+278655us) service_pool.cc:224] Handling call
0709 13:02:33.668507 (+ 31645us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:34.256676 (+588169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.185932 (+929256us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b54001f7554. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:35.186120 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1268202752}
I20260709 13:02:35.198282  6286 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:35.217057  1558 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:35.203783  5515 consensus_queue.cc:1243] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer 5bb87fe07da2414e84ee578c3b176ede log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:02:35.202898  6461 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.228395  1633 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:35.230224  6464 consensus_queue.cc:1059] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:02:35.229493  6309 raft_consensus.cc:2804] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:35.220332  6407 raft_consensus.cc:3055] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:35.236701  6328 raft_consensus.cc:2804] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:35.224861  6292 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:35.206924  6361 consensus_queue.cc:1048] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:02:35.230532  6348 consensus_queue.cc:260] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:35.231920  5574 consensus_queue.cc:237] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:35.229791  6286 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:35.224740  6301 consensus_queue.cc:1048] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
W20260709 13:02:35.234985  6450 log.cc:927] Time spent T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da: Append to log took a long time: real 0.410s	user 0.000s	sys 0.004s
W20260709 13:02:35.239174  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 72268.7us
I20260709 13:02:35.165285  6380 consensus_queue.cc:260] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:35.299149  1556 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:35.163859  6334 consensus_queue.cc:260] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:35.244690  1633 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:35.248080  6128 consensus_queue.cc:1059] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:35.245817  6246 raft_consensus.cc:2804] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:35.249224  6328 raft_consensus.cc:697] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 11 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:35.251375  6166 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:35.253168  6006 consensus_queue.cc:1048] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:35.253415  6377 consensus_queue.cc:237] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:35.254824  6443 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:35.256080  1666 raft_consensus.cc:1275] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:02:35.245540  6239 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:35.242300  6463 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.257725  6406 consensus_queue.cc:1059] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:35.245177  6461 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:35.258976  6240 raft_consensus.cc:3055] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:35.262432  6355 raft_consensus.cc:3055] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:35.245884  6407 raft_consensus.cc:740] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:35.244585  6309 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.272755  6286 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:35.263324  6361 consensus_queue.cc:1243] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer 5bb87fe07da2414e84ee578c3b176ede log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:02:35.274564  5921 raft_consensus.cc:993] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:02:35.275370  6086 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:35.267215  6292 raft_consensus.cc:697] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:35.270462  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:35.279335  6311 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.279613  6429 raft_consensus.cc:3055] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:35.281872  6348 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:35.361251  6302 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.285351  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:35.287132  6305 raft_consensus.cc:3055] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:35.288125  1704 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:02:35.397024  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 109012us
I20260709 13:02:35.368278  6355 raft_consensus.cc:740] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:35.290223  6454 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.268146  6364 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:35.320479  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:35.440402  1592 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 14.
I20260709 13:02:35.321559  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:35.325670  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:35.242985  1558 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:35.341399  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:35.443290  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 200379us
I20260709 13:02:35.443370  1659 raft_consensus.cc:2410] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
W20260709 13:02:35.360598  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 200317us
I20260709 13:02:35.444293  1558 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:35.361877  1584 raft_consensus.cc:1240] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
W20260709 13:02:35.447613  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 97377.3us
I20260709 13:02:35.363257  1666 pending_rounds.cc:85] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 3
I20260709 13:02:35.449057  1666 pending_rounds.cc:107] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:02:35.449458  1666 raft_consensus.cc:2889] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:35.357343  6358 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.341259  6411 raft_consensus.cc:2749] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:02:35.359648  6324 consensus_queue.cc:1175] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6d4de2ce0683442498244b9529127f91" responder_term: 10 status { last_received { term: 10 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 10 index: 8 } }
I20260709 13:02:35.348848  6028 consensus_queue.cc:1059] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:02:35.360735  6334 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:35.514377  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.344321  6291 consensus_queue.cc:1048] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:02:35.283262  6360 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:35.387132  6286 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:35.393659  6406 consensus_queue.cc:1243] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer 6d4de2ce0683442498244b9529127f91 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:02:35.366312  6240 raft_consensus.cc:740] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:35.289505  6068 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.506726  6364 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:35.404107  6461 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:35.407467  6296 raft_consensus.cc:2804] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:35.395267  6311 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:35.396593  6305 raft_consensus.cc:740] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:35.411628  2548 raft_consensus.cc:2410] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:02:35.395681  6412 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:35.412971  5960 raft_consensus.cc:1081] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:02:35.419482  6292 consensus_queue.cc:237] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:35.371974  6309 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:35.450827  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:35.454563  1592 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:02:35.571763  1592 raft_consensus.cc:606] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:35.572208  1592 raft_consensus.cc:614] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:35.382532  6429 raft_consensus.cc:740] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:35.491413  6333 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:35.503240  2424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.395156  5921 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:35.532907  6166 consensus_queue.cc:1059] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:02:35.516558  1661 pending_rounds.cc:85] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 8
I20260709 13:02:35.580852  1661 pending_rounds.cc:107] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:02:35.433205  6312 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.499050  6455 consensus_queue.cc:1048] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:02:35.500993  6328 consensus_queue.cc:237] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:35.402590  6462 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:35.540776  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 295766us
I20260709 13:02:35.397543  6302 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:35.548094  6240 consensus_queue.cc:260] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:35.549502  6068 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:35.551241  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.518069  6471 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:35.486167  6454 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:35.506297  6358 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:35.442216  1733 raft_consensus.cc:2468] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 7.
I20260709 13:02:35.488106  6239 raft_consensus.cc:697] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 11 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:35.551630  6348 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
W20260709 13:02:35.581027  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.369065  6463 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:35.581327  1661 raft_consensus.cc:2889] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:35.582146  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 71211.5us
I20260709 13:02:35.578169  2426 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:35.563258  6296 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:35.586093  1633 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:35.569991  6461 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:35.564954  6246 raft_consensus.cc:697] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:35.535825  6407 consensus_queue.cc:260] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:35.624431  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 46378.6us
I20260709 13:02:35.604982  1558 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:35.623301  1662 raft_consensus.cc:2468] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 7.
I20260709 13:02:35.605891  6348 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:35.672641  6296 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:35.672878  6473 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.680439  6473 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:35.683081  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:35.672889  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 86937.1us
I20260709 13:02:35.674484  6429 consensus_queue.cc:260] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:35.690378  1633 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:02:35.675549  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 66785.6us
I20260709 13:02:35.673590  2426 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:35.584314  6333 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:35.583395  5921 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:35.703408  6006 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:35.640695  6166 raft_consensus.cc:3055] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:35.676707  6476 raft_consensus.cc:2749] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:35.706305  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:35.757014  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 152144us
I20260709 13:02:35.600935  6286 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.594305  6462 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:35.702724  6305 consensus_queue.cc:260] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:35.696815  6429 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:35.762676  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:35.696007  6463 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:35.605789  6239 consensus_queue.cc:237] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:35.676606  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:35.608690  6358 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:35.684563  6473 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:35.693003  6461 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:35.684719  2548 raft_consensus.cc:2468] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 7.
I20260709 13:02:35.639007  6464 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:35.614334  6454 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:35.618873  6355 consensus_queue.cc:260] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:35.588263  6312 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:35.737951  6407 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:35.786360  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 79628.1us
I20260709 13:02:35.687532  6291 consensus_queue.cc:1048] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 13:02:35.605733  6028 raft_consensus.cc:2804] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:35.747375  6166 raft_consensus.cc:740] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:35.771510  6006 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:35.840723  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.815899  6496 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:35.803344  5515 raft_consensus.cc:2804] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:35.786551  6360 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.794067  6305 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:35.765516  6456 consensus_queue.cc:1059] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:02:35.770267  6406 consensus_queue.cc:1059] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:02:35.769970  6286 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:35.798674  6463 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:35.809489  6412 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:35.787755  5942 raft_consensus.cc:2749] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:02:35.844376  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 85514.5us
W20260709 13:02:35.850387  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.824915  6464 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:35.856103  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:35.872159  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:35.882892  1741 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 15.
I20260709 13:02:35.857276  1740 raft_consensus.cc:1275] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:02:35.838665  6028 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.885833  6028 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:35.863843  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.864904  1737 raft_consensus.cc:1240] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:02:35.843859  6302 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:35.850360  6355 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:35.890477  1705 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.571s (SENT) [suppressed 5 similar messages]
I20260709 13:02:35.855273  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:35.872330  6463 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:35.893473  6463 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:35.798231  6246 consensus_queue.cc:237] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:35.897751  6333 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:35.857901  6311 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:35.851416  6496 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:35.849120  6348 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:35.901602  6496 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:35.871672  6356 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.902951  6356 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:35.905049  1558 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:35.906724  1558 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:35.908118  5942 consensus_queue.cc:1059] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:35.909111  6480 raft_consensus.cc:2749] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:35.910073  6480 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:35.910214  6462 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:35.911652  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:35.912288  1733 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 11.
I20260709 13:02:35.912424  6328 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.912748  2543 raft_consensus.cc:2393] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 13: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:02:35.879407  6166 consensus_queue.cc:260] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:35.917039  1558 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:35.918637  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:35.919283  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:35.920519  1660 raft_consensus.cc:1275] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:35.927647  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:35.930277  1667 raft_consensus.cc:1240] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:02:35.930425  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:35.931340  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:35.931813  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:35.934587  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:35.935045  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:35.932221  1658 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15.
W20260709 13:02:35.936596  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 119871us
I20260709 13:02:35.940914  1665 raft_consensus.cc:1275] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:35.944520  1558 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:35.849583  6006 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:35.945811  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 55355us
I20260709 13:02:35.953876  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:35.956751  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:35.959868  1558 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:35.904965  6356 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:35.861279  6476 consensus_queue.cc:1059] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 13:02:35.855175  6360 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:35.965031  1661 raft_consensus.cc:2393] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 10: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:35.921890  6473 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
W20260709 13:02:35.987596  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.994231  1659 raft_consensus.cc:1240] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 11 LEADER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:02:35.949443  6166 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:35.950851  6472 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:36.003531  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:36.003929  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:36.015106  1590 raft_consensus.cc:2393] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 11: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:36.015790  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:36.016093  1661 raft_consensus.cc:1240] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:36.003392  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:02:36.007180  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.007272  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:36.017362  1589 raft_consensus.cc:2393] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 12: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:36.016424  1592 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
I20260709 13:02:36.010100  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:35.942198  6068 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:35.879473  6412 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:35.963526  6291 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:36.032213  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:36.032833  6461 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:36.045495  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.051476  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:36.035245  2424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:36.074858  2424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.035925  6491 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.036607  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:35.935916  6328 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:36.082125  1707 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:35.978874  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:36.090471  1707 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:35.979559  5942 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:36.072801  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:36.072721  1584 raft_consensus.cc:1240] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:02:36.042970  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:36.080024  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:36.080885  1587 raft_consensus.cc:2393] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 14: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:36.017833  6305 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:36.022197  6472 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.980276  6246 consensus_queue.cc:1048] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.106s
I20260709 13:02:36.120428  1665 raft_consensus.cc:2468] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
I20260709 13:02:36.139146  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:36.166071  1589 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15.
I20260709 13:02:36.161185  1660 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
I20260709 13:02:36.168349  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:36.139405  1661 raft_consensus.cc:1275] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 13:02:35.961402  6292 consensus_queue.cc:1048] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.116s
W20260709 13:02:36.146138  6474 log.cc:927] Time spent T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.304s	user 0.000s	sys 0.001s
I20260709 13:02:36.146440  6464 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:36.149295  2543 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
I20260709 13:02:36.076143  6324 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:36.149869  6487 log.cc:927] Time spent T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.295s	user 0.000s	sys 0.001s
I20260709 13:02:36.088117  6491 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:36.164278  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:36.169819  1661 pending_rounds.cc:85] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 10
I20260709 13:02:36.187927  1661 pending_rounds.cc:107] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 16.11
W20260709 13:02:36.167339  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 317821us
I20260709 13:02:36.187963  1664 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 13.
I20260709 13:02:36.174690  1658 raft_consensus.cc:2410] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:02:36.169749  1707 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:36.018814  6473 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:36.137639  6462 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:36.139950  6461 raft_consensus.cc:2749] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:36.188273  1661 raft_consensus.cc:2889] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:36.174580  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:36.190173  6498 log.cc:927] Time spent T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:02:36.190828  6348 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:36.195096  6006 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:36.195274  6390 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:36.199241  6028 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:36.203341  6309 consensus_meta.cc:287] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.623s	user 0.011s	sys 0.002s
I20260709 13:02:36.221676  6390 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:36.222673  6309 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:36.223961  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:36.226091  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:36.226845  5515 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.227033  1586 raft_consensus.cc:2393] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 10: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:36.228224  1591 raft_consensus.cc:1240] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:02:36.205835  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:36.229388  1661 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
I20260709 13:02:36.208052  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:36.165524  6472 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:36.206020  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:02:36.237265  6447 consensus_meta.cc:287] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6: Time spent flushing consensus metadata: real 1.024s	user 0.009s	sys 0.006s
I20260709 13:02:36.237716  6447 raft_consensus.cc:2749] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:36.206943  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:36.213376  1704 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:36.215715  6028 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 15 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:36.216216  6473 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:36.217921  6328 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:36.220794  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:36.221258  6334 consensus_meta.cc:287] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.688s	user 0.015s	sys 0.000s
I20260709 13:02:36.233546  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:36.240310  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:36.212466  6348 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.241153  6286 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:36.260207  6380 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:36.261384  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:36.260269  6348 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:36.227501  5515 raft_consensus.cc:3060] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:36.264672  6412 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:36.166793  6305 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:36.244865  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:36.205205  6312 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:36.254926  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:36.204902  6324 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:36.259197  6462 raft_consensus.cc:2804] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:36.259512  6491 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:36.259809  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:36.303906  1584 raft_consensus.cc:2468] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 7.
W20260709 13:02:36.261651  1633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.242806  1664 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:36.267050  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.267040  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:36.300372  6324 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:36.267833  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:36.270658  1585 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:36.293048  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:36.271729  6292 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.271930  6504 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.331053  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:36.273428  6302 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:36.331998  6292 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:36.331514  1665 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
W20260709 13:02:36.331748  1633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:36.331442  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.329972  6334 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:36.294554  6462 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.294842  6412 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:36.337476  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:36.338975  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:36.335387  6435 consensus_meta.cc:287] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 1.180s	user 0.014s	sys 0.001s
I20260709 13:02:36.349577  1584 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 15.
I20260709 13:02:36.334996  1658 raft_consensus.cc:2393] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 11: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:36.336037  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:36.343847  1633 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:36.345479  6334 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:36.346306  6305 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:36.359413  6292 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:36.337634  6302 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:36.359995  1556 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:36.360849  6361 raft_consensus.cc:2804] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:36.361394  6361 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.361758  6361 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:36.361968  6302 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:36.362136  6334 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:36.356303  6412 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:36.363359  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:36.346535  1585 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15.
I20260709 13:02:36.346727  6356 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:36.350383  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:36.348362  6462 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:36.366812  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:36.336337  6504 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:36.373500  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:36.374073  1662 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:02:36.375267  6504 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:36.351878  6312 raft_consensus.cc:2749] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:36.352007  1583 raft_consensus.cc:2393] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 12: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:36.378610  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:36.380034  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.379463  1589 raft_consensus.cc:1275] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:02:36.380553  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:36.381678  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:36.382257  1583 raft_consensus.cc:2393] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 14: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:36.383113  1583 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:02:36.383370  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:36.383899  1583 raft_consensus.cc:606] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:36.384280  1592 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 16.
I20260709 13:02:36.369948  6361 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:36.385102  1665 raft_consensus.cc:2468] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
W20260709 13:02:36.386015  6296 consensus_meta.cc:287] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.701s	user 0.012s	sys 0.001s
I20260709 13:02:36.386971  6361 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:36.387252  1665 pending_rounds.cc:85] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 4
I20260709 13:02:36.387529  1587 raft_consensus.cc:1240] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:36.387733  1665 pending_rounds.cc:107] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:02:36.331185  6480 raft_consensus.cc:3055] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:36.371434  6356 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:36.390559  6356 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:36.370124  1705 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:36.388974  6480 raft_consensus.cc:740] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:36.397650  6305 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:36.397845  1586 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:02:36.398732  6305 consensus_queue.cc:1048] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:36.400151  1586 raft_consensus.cc:1275] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:36.396878  6480 consensus_queue.cc:260] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:36.402571  6480 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:36.405260  1705 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:36.384531  1583 raft_consensus.cc:614] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:36.406697  6305 raft_consensus.cc:2804] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:36.407126  6305 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.394280  6435 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:36.407629  6305 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:36.408447  1663 raft_consensus.cc:2368] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 7. Current term is 8.
I20260709 13:02:36.393460  6240 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:36.410145  1663 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39146
I20260709 13:02:36.410854  1663 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:36.411306  1663 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:36.415223  6412 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:36.348812  6309 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:36.415714  6435 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:36.367880  6407 consensus_meta.cc:287] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.533s	user 0.007s	sys 0.004s
I20260709 13:02:36.388273  1665 raft_consensus.cc:2889] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:36.386682  6296 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:36.383788  1589 raft_consensus.cc:1240] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:36.426085  6348 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:36.480387  2426 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:36.428934  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:36.482457  1658 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
I20260709 13:02:36.483027  6360 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:36.484866  6454 raft_consensus.cc:3055] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:36.485579  6454 raft_consensus.cc:740] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:36.486588  6454 consensus_queue.cc:260] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:36.488090  6454 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:36.489266  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 91624.2us
I20260709 13:02:36.490127  1705 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:36.429863  1732 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 14.
I20260709 13:02:36.493708  1705 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:36.494567  1707 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:36.429304  1586 raft_consensus.cc:1240] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:36.447662  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:36.496380  5515 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:36.497397  1733 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 12.
I20260709 13:02:36.498310  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:36.448575  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:36.499495  1735 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
I20260709 13:02:36.500381  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:36.501434  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:36.501981  1735 raft_consensus.cc:2468] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 7.
I20260709 13:02:36.502782  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:36.503512  1735 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 7.
I20260709 13:02:36.449162  1736 raft_consensus.cc:1240] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:36.506023  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:36.507210  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:36.507474  1663 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:36.449755  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:36.508395  1741 raft_consensus.cc:2468] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 7.
I20260709 13:02:36.509258  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:36.509653  1663 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:36.510516  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:36.511055  1741 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 15.
I20260709 13:02:36.450435  1738 raft_consensus.cc:1240] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:02:36.515782  1738 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:36.455515  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:36.517812  2543 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:02:36.452096  1734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35672 (request call id 585) took 1087 ms. Trace:
W20260709 13:02:36.520898  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.456172  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:36.522523  1667 raft_consensus.cc:2393] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 11: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:36.524209  1667 raft_consensus.cc:1240] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:36.456419  2548 raft_consensus.cc:1240] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:36.457032  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:36.527580  1740 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 14.
I20260709 13:02:36.460740  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:02:36.470532  2424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.530272  1659 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:36.465313  6412 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.531127  6412 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:36.474517  1591 raft_consensus.cc:1240] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:02:36.471199  6086 raft_consensus.cc:3055] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:36.533218  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:36.465479  6407 consensus_queue.cc:1048] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.069s
I20260709 13:02:36.436985  1589 raft_consensus.cc:1240] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:02:36.475710  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:36.464686  1633 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:36.431335  6296 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:36.436589  1592 raft_consensus.cc:1240] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:02:36.461683  6324 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.457891  1556 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:36.469012  1590 raft_consensus.cc:1240] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:36.449429  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:36.538319  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:36.463665  6334 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.539197  1737 raft_consensus.cc:2410] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:02:36.445768  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:36.539572  6334 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:36.540361  2553 raft_consensus.cc:2368] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 14. Current term is 15.
I20260709 13:02:36.470209  5921 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:36.450731  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:36.458330  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:36.541483  1739 raft_consensus.cc:2468] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 7.
I20260709 13:02:36.542692  6334 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:36.537345  6296 raft_consensus.cc:2749] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:36.546768  1740 raft_consensus.cc:1240] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:02:36.546720  6296 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:36.547722  6296 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.548254  6296 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:36.537685  6324 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:36.537374  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 72778.6us
I20260709 13:02:36.550009  1633 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:36.536211  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:36.543941  6407 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:36.519701  1734 rpcz_store.cc:276] 0709 13:02:35.364854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.365057 (+   203us) service_pool.cc:224] Handling call
0709 13:02:35.365496 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:35.690990 (+325494us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:35.691022 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:35.691749 (+   727us) log.cc:844] Serialized 26 byte log entry
0709 13:02:35.792602 (+100853us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:35.792644 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.451690 (+659046us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b5400184a54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:36.451740 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:36.451787 (+    47us) raft_consensus.cc:1685] finished
0709 13:02:36.451801 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.452033 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3781,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":138,"spinlock_wait_cycles":747598720,"thread_start_us":98207,"threads_started":1,"wal-append.queue_time_us":119391}
I20260709 13:02:36.551834  6324 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:36.551939  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:36.544374  1704 leader_election.cc:400] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 election: Vote denied by peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157) with higher term. Message: Invalid argument: T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 14. Current term is 15.
I20260709 13:02:36.553017  1589 raft_consensus.cc:2393] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 11: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:36.553264  1704 leader_election.cc:403] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:02:36.464804  6390 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:36.533317  6086 raft_consensus.cc:740] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:36.536170  1660 raft_consensus.cc:2410] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:02:36.539016  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:36.539119  1592 raft_consensus.cc:2393] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 14: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:36.534690  6412 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:36.534703  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:36.545507  1736 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 16.
I20260709 13:02:36.370824  1664 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
I20260709 13:02:36.554461  6390 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:36.555300  6086 consensus_queue.cc:260] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:36.572216  6239 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:36.572584  6086 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:36.572814  6239 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.441890  1555 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:36.559581  1590 raft_consensus.cc:1240] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:02:36.573571  6407 raft_consensus.cc:697] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 11 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:36.561291  1592 raft_consensus.cc:1275] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:02:36.597694  6507 log.cc:927] Time spent T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:02:36.567114  1664 raft_consensus.cc:1275] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:36.616093  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:36.617691  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:36.619012  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:36.567495  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:36.554147  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:36.567468  1659 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:02:36.623306  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:36.573613  6296 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:36.598042  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 140203us
I20260709 13:02:36.497715  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:36.607944  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
W20260709 13:02:36.635597  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 193831us
W20260709 13:02:36.492293  6445 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.939s	user 0.022s	sys 0.040s
I20260709 13:02:36.581061  1738 raft_consensus.cc:1275] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:02:36.636170  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:36.637010  1735 raft_consensus.cc:2368] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for earlier term 11. Current term is 12.
W20260709 13:02:36.610888  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.442701  1630 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:02:36.639611  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 197011us
I20260709 13:02:36.585026  6414 raft_consensus.cc:2749] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:36.645567  1664 raft_consensus.cc:2393] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 14: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:36.634027  5515 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 8 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:36.635612  1556 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:36.635836  2552 raft_consensus.cc:3060] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:36.493376  6461 raft_consensus.cc:2749] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:36.433478  6112 raft_consensus.cc:3055] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:36.614244  6239 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:36.643345  6471 raft_consensus.cc:2749] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:36.648326  6407 consensus_queue.cc:237] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:36.649861  5921 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:36.605172  6364 raft_consensus.cc:2804] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:36.652175  6356 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.640051  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:36.690402  1592 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:36.690682  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:36.654036  1591 raft_consensus.cc:1240] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:36.659168  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.659034  1556 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:36.654137  1738 raft_consensus.cc:1240] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:36.581949  6464 consensus_queue.cc:1059] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:02:36.662998  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:36.629380  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:36.697144  1659 raft_consensus.cc:2410] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 16 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 13:02:36.643932  6445 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.103s	user 0.022s	sys 0.041s
I20260709 13:02:36.654098  6312 raft_consensus.cc:2804] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:36.705169  1556 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:36.707823  1633 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:36.667531  6112 raft_consensus.cc:740] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:36.606330  6472 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:36.667984  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:36.721727  2553 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:36.668991  6361 raft_consensus.cc:2804] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:36.699321  6464 raft_consensus.cc:3055] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:36.701521  1659 raft_consensus.cc:1275] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:02:36.669523  6286 consensus_queue.cc:1059] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 13:02:36.699128  6068 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.710204  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:36.714354  1666 raft_consensus.cc:1240] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:36.692088  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:36.703806  6246 consensus_queue.cc:1059] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:02:36.689402  6390 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157) with higher term. Message: Invalid argument: T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 14. Current term is 15.
I20260709 13:02:36.735419  6361 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.718175  1590 raft_consensus.cc:1275] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:36.704962  6356 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:36.700836  5921 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:36.687839  6468 log.cc:927] Time spent T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 1.135s	user 0.005s	sys 0.008s
I20260709 13:02:36.720790  1555 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:36.696913  6364 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.725462  1592 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 15.
I20260709 13:02:36.712397  6471 consensus_queue.cc:1048] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:02:36.816082  1592 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:02:36.735917  6464 raft_consensus.cc:740] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:36.829456  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:36.731658  1558 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
W20260709 13:02:36.733497  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.830343  1588 raft_consensus.cc:1240] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:02:36.703760  6312 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.767408  1589 raft_consensus.cc:1240] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:36.700037  6309 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:36.770516  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:36.771255  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 51143.8us
W20260709 13:02:36.848663  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 354978us
I20260709 13:02:36.772976  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:36.715524  6348 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:36.768044  6462 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:36.785351  6355 consensus_queue.cc:1048] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:36.857893  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:02:36.858734  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 364208us
W20260709 13:02:36.828301  6508 log.cc:927] Time spent T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:02:36.773770  6435 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.798935  1740 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:02:36.712101  6328 raft_consensus.cc:2804] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:36.711932  6292 raft_consensus.cc:2804] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:36.811259  5515 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.812660  1583 raft_consensus.cc:1240] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:36.816862  1592 raft_consensus.cc:606] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:36.845564  6309 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:36.831372  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.842105  1739 raft_consensus.cc:1275] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:02:36.883409  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:36.884142  1739 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
W20260709 13:02:36.852912  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.723784  6475 consensus_queue.cc:1059] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 13:02:36.853590  6006 consensus_queue.cc:1059] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:02:36.853621  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:36.786789  6296 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:36.860157  1707 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:36.813735  6068 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:36.816546  6361 raft_consensus.cc:3060] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:36.868157  2552 raft_consensus.cc:2468] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 8.
I20260709 13:02:36.817914  6364 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:36.874233  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:36.774762  6305 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:36.875909  1705 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:36.845548  6312 raft_consensus.cc:3060] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:36.877291  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:36.846585  6246 raft_consensus.cc:2804] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:36.878425  5515 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:36.889503  6414 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.890686  1736 raft_consensus.cc:3060] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:36.895098   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:36.875658  6328 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.887274  6348 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:36.919080  1705 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:36.931258  1738 raft_consensus.cc:2368] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for earlier term 10. Current term is 11.
I20260709 13:02:36.889258  6309 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:36.727275  1732 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35672 (request call id 582) took 1406 ms (client timeout 1504 ms). Trace:
W20260709 13:02:36.961530  1732 rpcz_store.cc:269] 0709 13:02:35.320940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.321220 (+   280us) service_pool.cc:224] Handling call
0709 13:02:36.726936 (+1405716us) spinlock_profiling.cc:243] Waited 988 ms on lock 0x7b5400184f54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:36.727122 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2272299264}
I20260709 13:02:36.963521  1732 raft_consensus.cc:1240] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:36.878830  6390 consensus_queue.cc:1048] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
W20260709 13:02:36.970292  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 51314.9us
I20260709 13:02:36.972039  1705 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:36.957383  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 61405.9us
I20260709 13:02:36.876600  6435 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:36.958273  6414 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:37.006500  6435 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:36.842610  6112 consensus_queue.cc:260] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:36.965576  1733 raft_consensus.cc:2393] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 16: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:37.008512  6112 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:36.928187  6461 raft_consensus.cc:2804] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:37.009541  6461 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.009953  6461 raft_consensus.cc:3060] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:37.010530  5921 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:37.011806  6356 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:37.013180  6390 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:37.013960  6390 consensus_queue.cc:1048] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:37.014941  5515 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:37.015682  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:37.016276  2552 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:37.019500  2424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.906215  6491 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:36.974053  1707 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:36.990096  6360 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:36.968118  6334 consensus_queue.cc:1048] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:02:36.995869  6305 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:36.997965  6472 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 20 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:36.935292  6246 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:37.053848  6246 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:37.031138  6491 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:36.999760  1590 raft_consensus.cc:3055] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:37.054888  1590 raft_consensus.cc:740] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:37.055143  5515 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.999684  6068 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:37.055650  5515 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:36.935875  6412 consensus_queue.cc:1059] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:02:36.929590  6296 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:37.002350  6462 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:37.002743  6355 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:36.892758  6464 consensus_queue.cc:260] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:37.021334  1737 raft_consensus.cc:1240] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:02:37.030145  2553 raft_consensus.cc:2468] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 11.
I20260709 13:02:37.056658  6390 raft_consensus.cc:2804] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:02:37.036514  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 62518.1us
W20260709 13:02:37.039072  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 67114.7us
I20260709 13:02:37.039516  2552 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
I20260709 13:02:37.074069  1705 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:36.956846  6328 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:37.006880  6414 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:37.028261  6360 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.003788  6239 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:37.062880  1590 consensus_queue.cc:260] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:37.068902  5515 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:36.952899  6471 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.968187  6348 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:37.058493  6305 raft_consensus.cc:2804] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:37.072510  1704 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:36.980400  1736 raft_consensus.cc:2468] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 8.
I20260709 13:02:37.080438  1705 leader_election.cc:400] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Vote denied by peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683) with higher term. Message: Invalid argument: T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 7. Current term is 8.
I20260709 13:02:37.094059  1705 leader_election.cc:403] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:02:37.081990  1707 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:37.070634  6390 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:37.095465  1590 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:37.098142  1707 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:02:37.100795  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.104786  1666 raft_consensus.cc:1275] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:02:37.111766  1666 pending_rounds.cc:85] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 7
W20260709 13:02:37.112906  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.112933  1666 pending_rounds.cc:107] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:02:37.068580  6355 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:37.085508  6334 consensus_queue.cc:1059] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:02:37.130653  1659 raft_consensus.cc:1275] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:02:37.131112  1659 pending_rounds.cc:85] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 7
I20260709 13:02:37.131385  1659 pending_rounds.cc:107] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:02:37.131718  1659 raft_consensus.cc:2889] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:37.084939  6360 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:37.080588  6472 consensus_queue.cc:1048] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:02:37.134368  1666 raft_consensus.cc:2889] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:37.141316  1667 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.000s	sys 0.041s
W20260709 13:02:37.141682  1667 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.000s	sys 0.041s
I20260709 13:02:37.139709  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:37.141829  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:37.076608  6296 consensus_queue.cc:1048] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:02:37.075714  6514 consensus_queue.cc:1059] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:02:37.145325  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:37.114773  6390 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:37.149290  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 326308us
I20260709 13:02:37.083950  6462 consensus_queue.cc:1059] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:02:37.176640  6128 consensus_queue.cc:1048] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:37.177248  6504 consensus_queue.cc:1048] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:37.184345  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:37.185377  1659 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 13.
I20260709 13:02:37.185956  1590 raft_consensus.cc:2468] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 11.
I20260709 13:02:37.088950  6471 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:37.190805  1665 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.016s	sys 0.032s
I20260709 13:02:37.164549  6292 raft_consensus.cc:697] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:02:37.191478  1665 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.016s	sys 0.032s
I20260709 13:02:37.192420  6292 consensus_queue.cc:237] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:37.138178  6407 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.146587  6491 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:37.163744  6514 consensus_queue.cc:1243] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer 6d4de2ce0683442498244b9529127f91 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:02:37.196187  6509 log.cc:927] Time spent T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.289s	user 0.001s	sys 0.001s
I20260709 13:02:37.196384  6286 raft_consensus.cc:3055] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:02:37.245611  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.214118  2424 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:37.286054  6466 raft_consensus.cc:2804] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:37.291523  1738 raft_consensus.cc:3055] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:37.291926  1738 raft_consensus.cc:740] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:37.200918  6309 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:37.286655  6466 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.209189  6407 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:37.294154  1587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2317) took 1086 ms. Trace:
W20260709 13:02:37.296905  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 218229us
W20260709 13:02:37.337677  1741 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.002s	sys 0.014s
W20260709 13:02:37.290261  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 76243.6us
W20260709 13:02:37.283707  6515 log.cc:927] Time spent T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260709 13:02:37.292675  1738 consensus_queue.cc:260] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:37.347561  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.340868  1705 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:37.289099  6296 raft_consensus.cc:2804] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:37.281898  6494 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:37.342339  6516 log.cc:927] Time spent T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
W20260709 13:02:37.338129  1741 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.002s	sys 0.014s
I20260709 13:02:37.337760  1587 rpcz_store.cc:276] 0709 13:02:36.208130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.463379 (+255249us) service_pool.cc:224] Handling call
0709 13:02:36.463673 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:36.463889 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:36.879418 (+415529us) log.cc:844] Serialized 14 byte log entry
0709 13:02:37.256132 (+376714us) log.cc:844] Serialized 14 byte log entry
0709 13:02:37.293765 (+ 37633us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:37.293820 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:37.293872 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.293946 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.294097 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37390,"prepare.queue_time_us":506195,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":43,"raft.queue_time_us":39149,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":23683,"spinlock_wait_cycles":16338688,"thread_start_us":791198,"threads_started":2}
I20260709 13:02:37.386826  1662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58814 (request call id 731) took 1146 ms. Trace:
I20260709 13:02:37.287952  6286 raft_consensus.cc:740] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:37.320297  6334 raft_consensus.cc:2749] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683) with higher term. Message: Invalid argument: T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 7. Current term is 8.
I20260709 13:02:37.373736  1738 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:37.428288  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 330200us
I20260709 13:02:37.336726  6466 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:37.421700  1633 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.011s	sys 0.017s
I20260709 13:02:37.402905  1662 rpcz_store.cc:276] 0709 13:02:36.240787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.374993 (+134206us) service_pool.cc:224] Handling call
0709 13:02:36.375302 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:36.375504 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:36.375528 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:36.376004 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 13:02:36.653898 (+277894us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:36.653932 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.653995 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:37.386533 (+732538us) raft_consensus.cc:1685] finished
0709 13:02:37.386562 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.386746 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":277142,"threads_started":1,"wal-append.queue_time_us":477393}
W20260709 13:02:37.446044  1633 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.011s	sys 0.017s
W20260709 13:02:37.446995  1633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.447748  1633 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:37.448840  6524 raft_consensus.cc:2804] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:37.449365  6524 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:37.449769  6524 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:37.458105  1633 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:37.615916  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 275205us
W20260709 13:02:37.741592  1558 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.900s	user 0.008s	sys 0.018s
I20260709 13:02:37.744167  1735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3601) took 1155 ms. Trace:
W20260709 13:02:37.542407  1733 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.027s	sys 0.048s
W20260709 13:02:37.784267  1733 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.027s	sys 0.048s
I20260709 13:02:37.747172  1739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3602) took 1143 ms. Trace:
I20260709 13:02:37.461140  1741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43686 (request call id 2424) took 1012 ms. Trace:
I20260709 13:02:37.634864  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:37.794149  2552 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
W20260709 13:02:37.795158  1555 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.980s	user 0.016s	sys 0.021s
I20260709 13:02:37.474624  1658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3606) took 1228 ms. Trace:
W20260709 13:02:37.795599  1555 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.980s	user 0.016s	sys 0.021s
W20260709 13:02:37.796157  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 1.07539e+06us
I20260709 13:02:37.795964  1658 rpcz_store.cc:276] 0709 13:02:36.245899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.484301 (+238402us) service_pool.cc:224] Handling call
0709 13:02:36.484724 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:36.501821 (+ 17097us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:36.501852 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:36.502719 (+   867us) log.cc:844] Serialized 26 byte log entry
0709 13:02:36.891333 (+388614us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:36.891397 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.891476 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:37.474356 (+582880us) raft_consensus.cc:1685] finished
0709 13:02:37.474379 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.474552 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16598,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":14471,"thread_start_us":388269,"threads_started":1,"wal-append.queue_time_us":457060}
W20260709 13:02:37.540498  6166 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:02:37.784675  1739 rpcz_store.cc:276] 0709 13:02:36.603546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.884884 (+281338us) service_pool.cc:224] Handling call
0709 13:02:36.887781 (+  2897us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:36.888019 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:37.287130 (+399111us) log.cc:844] Serialized 14 byte log entry
0709 13:02:37.745927 (+458797us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:37.746096 (+   169us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:37.746256 (+   160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.746420 (+   164us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.746835 (+   415us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43909,"prepare.queue_time_us":102297,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":241362,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":2125,"thread_start_us":801816,"threads_started":3,"wal-append.queue_time_us":348189}
I20260709 13:02:37.420514  6494 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:37.806084  6541 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.807760  6541 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:37.491274  6239 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:37.657804  6246 consensus_meta.cc:287] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.603s	user 0.011s	sys 0.003s
I20260709 13:02:37.517378  6286 consensus_queue.cc:260] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:37.754451  6292 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.813726  6246 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:37.814455  6292 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:37.815407  1705 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:37.571635  6547 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:37.817211  6292 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:37.463307  6296 raft_consensus.cc:697] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 11 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:37.817438  6547 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:37.461982  6305 raft_consensus.cc:697] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 15 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:37.825862  6305 consensus_queue.cc:237] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:37.799759  1704 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:02:37.649065  6312 consensus_meta.cc:287] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.696s	user 0.012s	sys 0.005s
W20260709 13:02:37.691463  6328 consensus_meta.cc:287] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.610s	user 0.015s	sys 0.000s
I20260709 13:02:37.832857  6324 raft_consensus.cc:2804] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:37.833693  6324 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:37.833235  6312 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:37.834297  6324 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:37.490424  6334 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:37.488559  6348 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:37.518671  6355 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:37.686389  6360 consensus_meta.cc:287] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.535s	user 0.012s	sys 0.008s
W20260709 13:02:37.647243  6364 consensus_meta.cc:287] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.694s	user 0.010s	sys 0.007s
I20260709 13:02:37.837519  6360 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:37.839533  6312 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:37.666690  6361 consensus_meta.cc:287] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.721s	user 0.012s	sys 0.005s
I20260709 13:02:37.468441  6412 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:37.666692  6461 consensus_meta.cc:287] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.656s	user 0.019s	sys 0.002s
I20260709 13:02:37.842072  6461 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:37.569738  6407 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:37.651804  6466 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:37.531360  6471 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:37.573513  1665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3603) took 1329 ms. Trace:
I20260709 13:02:37.866017  1665 rpcz_store.cc:276] 0709 13:02:36.244000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.385961 (+141961us) service_pool.cc:224] Handling call
0709 13:02:36.386384 (+   423us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:36.420367 (+ 33983us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:36.420401 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:36.491176 (+ 70775us) log.cc:844] Serialized 52 byte log entry
0709 13:02:37.192117 (+700941us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:37.192181 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.192288 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:37.573151 (+380863us) raft_consensus.cc:1685] finished
0709 13:02:37.573180 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.573396 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3537,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"thread_start_us":700532,"threads_started":1,"wal-append.queue_time_us":1080442}
I20260709 13:02:37.619395  6514 raft_consensus.cc:2749] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:37.790480  1741 rpcz_store.cc:276] 0709 13:02:36.448652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.511632 (+ 62980us) service_pool.cc:224] Handling call
0709 13:02:36.511889 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:36.512094 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:36.835302 (+323208us) log.cc:844] Serialized 14 byte log entry
0709 13:02:37.460624 (+625322us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:37.460704 (+    80us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:37.460776 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.460863 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.461015 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66433,"prepare.queue_time_us":477385,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":43,"raft.queue_time_us":246457,"raft.run_cpu_time_us":749,"raft.run_wall_time_us":9484,"thread_start_us":884124,"threads_started":2,"wal-append.queue_time_us":737519}
W20260709 13:02:37.509356  6520 log.cc:927] Time spent T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
W20260709 13:02:37.550032  6525 log.cc:927] Time spent T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
I20260709 13:02:37.871604  6464 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:37.554937  6530 log.cc:927] Time spent T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.318s	user 0.001s	sys 0.000s
W20260709 13:02:37.691263  6526 log.cc:927] Time spent T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.410s	user 0.005s	sys 0.000s
W20260709 13:02:37.569820  6531 log.cc:927] Time spent T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:02:37.687593  6524 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:37.480581  2424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.614228  1734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3597) took 1157 ms. Trace:
I20260709 13:02:37.760005  6527 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.568621  6539 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:37.573807  6548 raft_consensus.cc:2804] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:37.771118  6554 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:37.571069  6546 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:37.530146  6553 raft_consensus.cc:3055] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:02:37.774168  6454 consensus_meta.cc:287] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 1.285s	user 0.018s	sys 0.000s
I20260709 13:02:37.906234  6547 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:37.906478  6554 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:37.906574  6539 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:37.776422  6533 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.910218  6533 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:37.557781  1660 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.009s	sys 0.010s
I20260709 13:02:37.781270  1736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43686 (request call id 2436) took 1011 ms. Trace:
W20260709 13:02:37.913769  1660 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.034s	user 0.009s	sys 0.011s
I20260709 13:02:37.916119  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:37.916229  1660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3614) took 1662 ms. Trace:
W20260709 13:02:37.787851  1558 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.946s	user 0.009s	sys 0.018s
I20260709 13:02:37.916965  1659 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:37.822935  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.782589  1735 rpcz_store.cc:276] 0709 13:02:36.588227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.646390 (+ 58163us) service_pool.cc:224] Handling call
0709 13:02:36.646865 (+   475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:36.647210 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:37.151519 (+504309us) log.cc:844] Serialized 14 byte log entry
0709 13:02:37.742887 (+591368us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:37.743040 (+   153us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:37.743193 (+   153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.743369 (+   176us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.743831 (+   462us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":342825,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":202284,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":130,"thread_start_us":1065579,"threads_started":3,"wal-append.queue_time_us":356376}
I20260709 13:02:37.538525  6309 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:37.918673  6548 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:37.835551  1664 raft_consensus.cc:2393] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 in current term 8: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:37.837601  6364 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:37.919274  6548 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:37.683818  6390 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:37.488119  6462 raft_consensus.cc:3055] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:37.846036  1740 raft_consensus.cc:2393] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 8: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:37.846949  6348 raft_consensus.cc:2804] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:37.921543  6462 raft_consensus.cc:740] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:37.847473  6361 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:37.848601  6286 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:37.904088  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:37.848690  6360 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:37.849205  6480 consensus_meta.cc:287] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 1.385s	user 0.012s	sys 0.003s
I20260709 13:02:37.843307  1705 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:37.799757  1661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58814 (request call id 729) took 1570 ms. Trace:
I20260709 13:02:37.781019  6435 raft_consensus.cc:3055] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:37.820535  6296 consensus_queue.cc:237] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:37.859935  1630 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:37.816766  6246 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:37.872898  1667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3613) took 1623 ms. Trace:
I20260709 13:02:37.879720  6541 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:37.893674  1734 rpcz_store.cc:276] 0709 13:02:36.456547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.551709 (+ 95162us) service_pool.cc:224] Handling call
0709 13:02:36.552061 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:36.552312 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:36.826064 (+273752us) log.cc:844] Serialized 14 byte log entry
0709 13:02:37.334826 (+508762us) log.cc:844] Serialized 14 byte log entry
0709 13:02:37.613277 (+278451us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:37.613454 (+   177us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:37.613546 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.613745 (+   199us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.614073 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8700,"prepare.queue_time_us":437726,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":128,"raft.queue_time_us":248367,"raft.run_cpu_time_us":370,"raft.run_wall_time_us":2675,"thread_start_us":1048012,"threads_started":4,"wal-append.queue_time_us":363714}
I20260709 13:02:37.897066  6527 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:37.903484  6546 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:37.904574  6553 raft_consensus.cc:740] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:37.913674  1736 rpcz_store.cc:276] 0709 13:02:36.769513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.101507 (+331994us) service_pool.cc:224] Handling call
0709 13:02:37.101855 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:37.291986 (+190131us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:37.292028 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:37.331842 (+ 39814us) log.cc:844] Serialized 26 byte log entry
0709 13:02:37.625843 (+294001us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:37.626270 (+   427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.626885 (+   615us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:37.780692 (+153807us) raft_consensus.cc:1685] finished
0709 13:02:37.780733 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.781047 (+   314us) inbound_call.cc:177] Queueing success response
0709 13:02:37.791878 (+ 10831us) spinlock_profiling.cc:243] Waited 6.37 ms on lock 0x7b4800120858. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b85eb8aa1 00007f1b85eafb37 00007f1b85eaf9ca 00007f1b85fa726f 00007f1b85fa6f37 00007f1b85fbb55c 00007f1b85fbb508 00007f1b85fbb488 00007f1b85fbb443 00007f1b85fba6ec 00007f1b84ee4a96
Metrics: {"mutex_wait_us":57445,"raft.queue_time_us":316984,"raft.run_cpu_time_us":4846,"raft.run_wall_time_us":364691,"spinlock_wait_cycles":14647552,"thread_start_us":392470,"threads_started":2,"wal-append.queue_time_us":344973}
I20260709 13:02:37.674077  6556 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.833909  6328 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:37.930563   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:37.926632  6364 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:37.940312  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 97237.5us
I20260709 13:02:37.925472  6348 raft_consensus.cc:697] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 11 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:37.947008  1666 raft_consensus.cc:2410] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:02:37.932617  6361 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:37.940796  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:37.932699  6390 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:37.964084  6348 consensus_queue.cc:237] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:37.935052  6435 raft_consensus.cc:740] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:37.922592  1660 rpcz_store.cc:276] 0709 13:02:36.253750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.556347 (+302597us) service_pool.cc:224] Handling call
0709 13:02:36.556978 (+   631us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:36.560913 (+  3935us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:36.562150 (+  1237us) log.cc:844] Serialized 14 byte log entry
0709 13:02:37.915172 (+1353022us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:37.915318 (+   146us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:37.915592 (+   274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.915743 (+   151us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.916047 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":369,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":62,"raft.queue_time_us":147075,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"thread_start_us":1332972,"threads_started":2,"wal-append.queue_time_us":428299}
W20260709 13:02:37.969925  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 1.23825e+06us
I20260709 13:02:37.970803  6435 consensus_queue.cc:260] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:37.972537  6435 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:37.972818  6556 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:37.973784  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 114991us
W20260709 13:02:37.976028  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.976570  1630 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:37.978516  1658 raft_consensus.cc:1275] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:37.933576  1661 rpcz_store.cc:276] 0709 13:02:36.229382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.230259 (+   877us) service_pool.cc:224] Handling call
0709 13:02:36.475782 (+245523us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:36.476130 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:36.476159 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:36.847590 (+371431us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b2c0009f8d8. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7f888a11 00007f1b7f898372 00007f1b80fcaa01 00007f1b80f8f43a 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2
0709 13:02:36.848008 (+   418us) log.cc:844] Serialized 26 byte log entry
0709 13:02:37.386773 (+538765us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:37.386817 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.386902 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:37.572726 (+185824us) raft_consensus.cc:1685] finished
0709 13:02:37.572747 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.799267 (+226520us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b54000a82d0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8e8ad 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:37.799515 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6609,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":92,"spinlock_wait_cycles":607198336,"thread_start_us":494844,"threads_started":1,"wal-append.queue_time_us":693909}
I20260709 13:02:37.942559  1667 rpcz_store.cc:276] 0709 13:02:36.253359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.547440 (+294081us) service_pool.cc:224] Handling call
0709 13:02:36.547983 (+   543us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:36.573288 (+ 25305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:36.573337 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:36.573925 (+   588us) log.cc:844] Serialized 26 byte log entry
0709 13:02:37.142349 (+568424us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:37.142387 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.142447 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:37.872433 (+729986us) raft_consensus.cc:1685] finished
0709 13:02:37.872478 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.872720 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19338,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"thread_start_us":568006,"threads_started":1,"wal-append.queue_time_us":710685}
I20260709 13:02:37.981045  6553 consensus_queue.cc:260] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:37.982581  6553 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:37.983290  6407 raft_consensus.cc:2804] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:37.983948  6407 raft_consensus.cc:697] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 11 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:37.984989  6462 consensus_queue.cc:260] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:37.985227  6407 consensus_queue.cc:237] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:37.985917  6494 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:37.986532  6462 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:37.989387  6328 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:37.990410  6557 raft_consensus.cc:2749] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:37.992381  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.996187  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:37.997421  2543 raft_consensus.cc:2393] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 8: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:02:37.951378  6454 raft_consensus.cc:2804] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:38.001596  6454 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:38.002137  6454 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:38.006282  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:37.997913  6541 raft_consensus.cc:2804] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:37.983968  2548 raft_consensus.cc:1240] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:38.009173  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:38.017330  2553 raft_consensus.cc:2368] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 13. Current term is 14.
I20260709 13:02:38.015748  6246 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.017984  6246 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:38.019291  1704 leader_election.cc:400] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: Vote denied by peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157) with higher term. Message: Invalid argument: T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 13. Current term is 14.
I20260709 13:02:38.019626  1704 leader_election.cc:403] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:02:38.019797  6527 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:38.020524  6246 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:38.021377  1740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43678 (request call id 3606) took 1314 ms. Trace:
I20260709 13:02:38.021422  6557 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:38.024214  6360 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:38.027967  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.029266  6360 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:38.029693  6445 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:38.030738  6445 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:38.031857  6360 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:38.032809  6546 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:38.033614  6541 raft_consensus.cc:697] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 8 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:38.034649  6361 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.022183  1740 rpcz_store.cc:276] 0709 13:02:36.660451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.873972 (+213521us) service_pool.cc:224] Handling call
0709 13:02:37.959626 (+1085654us) spinlock_profiling.cc:243] Waited 937 ms on lock 0x7b5400438fd4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:37.974890 (+ 15264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2154575104}
W20260709 13:02:38.069846  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 611703us
I20260709 13:02:38.069686  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:38.074640  1738 consensus_meta.cc:287] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.647s	user 0.014s	sys 0.009s
I20260709 13:02:38.075592  1738 raft_consensus.cc:1275] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:02:38.075950  1738 pending_rounds.cc:85] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 7
I20260709 13:02:38.076189  1738 pending_rounds.cc:107] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:02:38.076489  1738 raft_consensus.cc:2889] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:38.028985  6556 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:38.076676  6361 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:38.090457  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:38.100445  1705 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:38.103713  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:38.071494  6524 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:38.102821  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 44425.3us
I20260709 13:02:38.035226  6246 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:38.122838  1738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3605) took 1488 ms. Trace:
I20260709 13:02:38.123695  1738 rpcz_store.cc:276] 0709 13:02:36.634628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.996490 (+361862us) service_pool.cc:224] Handling call
0709 13:02:36.996868 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:37.291408 (+294540us) spinlock_profiling.cc:243] Waited 72 ms on lock 0x7b54002ef7a0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f06dc0 00007f1b80f911c0 00007f1b80f92231 00007f1b80f8ed8f 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c
0709 13:02:38.103723 (+812315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:38.122744 (+ 19021us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":165558656}
W20260709 13:02:38.134493  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.109807  6554 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:38.131409  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:38.134800  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:38.163862  1659 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 18.
I20260709 13:02:38.124775  6305 raft_consensus.cc:2749] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:38.168908  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:38.165598  1736 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:02:38.175551  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:02:38.176159  6513 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:02:38.176337  1667 raft_consensus.cc:3060] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:38.181304  6471 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:38.181881  6361 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:38.182322  6471 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:38.183714  1740 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:02:38.184963  6541 consensus_queue.cc:237] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:38.187438  1667 raft_consensus.cc:2468] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:02:38.188920  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:38.189916  1667 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:38.190200  6112 consensus_meta.cc:287] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 1.181s	user 0.020s	sys 0.002s
I20260709 13:02:38.191354  1663 raft_consensus.cc:1275] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:02:38.191421  6445 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:38.181489  6533 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:38.168691  6328 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.201557  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:38.202524  1659 raft_consensus.cc:2393] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 16: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:38.169566  6246 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:38.205470  6471 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:38.205745  2426 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:02:38.207091  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.209170  6569 raft_consensus.cc:2804] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:38.209872  6569 raft_consensus.cc:697] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:38.210948  6569 consensus_queue.cc:237] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:38.211962  1664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58814 (request call id 736) took 1607 ms. Trace:
I20260709 13:02:38.212395  1664 rpcz_store.cc:276] 0709 13:02:36.604776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.662720 (+ 57944us) service_pool.cc:224] Handling call
0709 13:02:38.162951 (+1500231us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b540041c8d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:38.211887 (+ 48936us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2618357120}
I20260709 13:02:38.213909  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:38.214761  1591 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 8.
I20260709 13:02:38.215481  6412 raft_consensus.cc:2749] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:38.216389  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:38.217581  6292 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.218312  6292 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:38.193472  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:38.219866  2543 raft_consensus.cc:2368] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for earlier term 10. Current term is 11.
I20260709 13:02:38.201262  6328 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:38.224006  1733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3608) took 1538 ms. Trace:
I20260709 13:02:38.226431  1733 rpcz_store.cc:276] 0709 13:02:36.686433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.022414 (+335981us) service_pool.cc:224] Handling call
0709 13:02:37.022885 (+   471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:37.829354 (+806469us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:37.829407 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:37.830497 (+  1090us) log.cc:844] Serialized 26 byte log entry
0709 13:02:37.937111 (+106614us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:37.937150 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.957247 (+ 20097us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:38.192712 (+235465us) raft_consensus.cc:1685] finished
0709 13:02:38.192742 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:38.223943 (+ 31201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15902,"raft.queue_time_us":36904,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":6955,"thread_start_us":852776,"threads_started":2,"wal-append.queue_time_us":228959}
I20260709 13:02:38.236343  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:38.226269  6360 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:38.238106  6360 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:38.241508  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:38.243139  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:38.243866  1592 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 12.
I20260709 13:02:38.244812  6537 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.245546  6537 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:38.247056  6328 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:38.248536  6537 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:38.250059  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:38.250859  1664 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:02:38.251015  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:38.251633  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.251720  2550 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 15.
I20260709 13:02:38.252096  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:38.224373  1633 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:38.237317  1585 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 16.
I20260709 13:02:38.205588  6246 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:38.237250  6166 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.256930  6361 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.236891  6548 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:38.285471  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:38.286697  1733 raft_consensus.cc:2393] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 16: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:38.267699  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:38.289726  1587 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12.
I20260709 13:02:38.268260  6328 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.290773  6328 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:38.291679  1734 raft_consensus.cc:1275] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:38.268946  6360 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:38.269485  1664 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:02:38.293166  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:38.269829  1667 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:02:38.259383  1555 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:38.265444  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:38.221060  6292 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:38.329830  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:38.330302  1589 raft_consensus.cc:1240] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 17. Current term is 18. Ops: [17.11-17.11]
W20260709 13:02:38.330574  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 201124us
I20260709 13:02:38.330827  6286 raft_consensus.cc:2749] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:38.331331  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:38.331705  1633 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:38.332159  1589 raft_consensus.cc:1240] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:02:38.277992  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:38.333105  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:38.333930  1584 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:38.334408  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:38.334688  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:38.335654  1587 raft_consensus.cc:2393] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 16: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:38.277586  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:38.336261  1586 raft_consensus.cc:1240] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:02:38.336678  1591 raft_consensus.cc:1240] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 13:02:38.281886  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 217317us
I20260709 13:02:38.282500  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:38.337611  1660 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 15.
W20260709 13:02:38.282696  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 157780us
I20260709 13:02:38.338181  1585 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:02:38.282971  6166 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:38.283932  6575 log.cc:927] Time spent T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:02:38.284010  6361 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:38.293056  6328 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:38.318908  6548 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:38.319607  6557 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157) with higher term. Message: Invalid argument: T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 13. Current term is 14.
I20260709 13:02:38.322019  6324 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:38.254926  6537 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
W20260709 13:02:38.334045  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 101285us
I20260709 13:02:38.352957  2426 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:02:38.466312  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 155696us
I20260709 13:02:38.362393  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:38.332299  1583 raft_consensus.cc:2393] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 8: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:38.281635  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:38.774565  1592 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
W20260709 13:02:38.369246  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:38.777773  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.363281  6292 raft_consensus.cc:2749] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:38.780149  6296 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:38.780843  6296 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:38.783232  6296 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:38.784343  6296 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.386700  6537 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:38.787025  6537 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:38.388191  1705 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:02:38.788604  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 400719us
I20260709 13:02:38.789654  1705 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:38.791354  1705 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:38.378273  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:38.792445  1733 raft_consensus.cc:2393] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 8: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:38.352905  6407 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
W20260709 13:02:38.419102  6464 consensus_meta.cc:287] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.547s	user 0.014s	sys 0.002s
I20260709 13:02:38.793665  6407 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:38.794335  1737 raft_consensus.cc:1275] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:02:38.794773  1737 pending_rounds.cc:85] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 7
I20260709 13:02:38.795007  1737 pending_rounds.cc:107] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:02:38.795230  1737 raft_consensus.cc:2889] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:38.419909  6466 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:38.420687  6513 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.797843  6513 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:38.800591  6513 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:38.421564  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:38.427774  6166 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:38.429842  6361 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:38.419173  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.435883  6324 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:38.467341  6454 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:38.470768  6569 raft_consensus.cc:2804] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:38.805845  6569 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:38.806123  6570 log.cc:927] Time spent T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.603s	user 0.004s	sys 0.000s
I20260709 13:02:38.806254  6569 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:38.807358  6454 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:38.808310  1665 raft_consensus.cc:1240] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:38.475220  1555 leader_election.cc:400] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Vote denied by peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157) with higher term. Message: Invalid argument: T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for earlier term 10. Current term is 11.
I20260709 13:02:38.813257  1555 leader_election.cc:403] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 13:02:38.813882  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 338882us
I20260709 13:02:38.814656  1555 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:38.815747  6539 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:38.518036  6462 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:38.541728  1558 leader_election.cc:400] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for earlier term 11. Current term is 12.
I20260709 13:02:38.816519  6462 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:38.817412  1558 leader_election.cc:403] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:02:38.818838  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 277254us
I20260709 13:02:38.819360  6462 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:38.576646  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:38.820892  2426 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:38.617036  6471 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.617874  6582 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:38.618682  6356 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:38.822114  6471 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:38.822403  6582 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:38.822500  6356 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:38.622815  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:38.825184  6356 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:38.825660  1666 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:38.824798  6582 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:38.826707  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:38.828341  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:38.660589  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 329106us
W20260709 13:02:38.829118  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.829710  1633 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:38.825070  6361 raft_consensus.cc:2804] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:38.831004  6361 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.831630  6361 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:38.693252  6412 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.694183  1590 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 12.
I20260709 13:02:38.832859  6412 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:38.834793  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:38.835644  2553 raft_consensus.cc:2410] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:02:38.836421  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:38.835814  6412 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:38.841717  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
W20260709 13:02:38.685774  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.847051  6435 raft_consensus.cc:2804] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:38.847611  6435 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:38.848049  6435 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:38.735333  6309 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:38.745245  1588 raft_consensus.cc:2393] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 8: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:38.753248  6246 consensus_queue.cc:1048] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:38.752681  1556 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:38.754398  1663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3607) took 2507 ms. Trace:
W20260709 13:02:38.755074  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:38.857328  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 104743us
I20260709 13:02:38.856979  1663 rpcz_store.cc:276] 0709 13:02:36.246756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.520372 (+273616us) service_pool.cc:224] Handling call
0709 13:02:36.520763 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:38.191808 (+1671045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:38.754137 (+562329us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b540030af54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:38.754321 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3840547712}
I20260709 13:02:38.858146  1556 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:38.858182  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
W20260709 13:02:38.714066  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.761387  1585 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12.
I20260709 13:02:38.861250  6166 raft_consensus.cc:2804] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:38.766440  6461 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:38.769322  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:38.862197  6246 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:38.796851  1737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43686 (request call id 2437) took 1912 ms. Trace:
W20260709 13:02:38.727882  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.862003  6166 raft_consensus.cc:697] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:38.862720  1737 rpcz_store.cc:276] 0709 13:02:36.884089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.165409 (+281320us) service_pool.cc:224] Handling call
0709 13:02:37.165763 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:38.795698 (+1629935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:38.796563 (+   865us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b5400438ad4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:38.796793 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3743964544}
I20260709 13:02:38.832171  6466 raft_consensus.cc:2804] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:38.864610  6466 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:38.754988  1584 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
I20260709 13:02:38.861989  6380 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.860432  1556 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:02:38.869964  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.870901  6466 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:38.862403  6356 raft_consensus.cc:2749] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for earlier term 11. Current term is 12.
I20260709 13:02:38.824743  6471 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:38.879599  1556 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:38.884457  6414 consensus_queue.cc:1059] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:02:38.862774  6246 raft_consensus.cc:697] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 18 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:38.784890  6296 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:38.877538  6548 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:38.894570  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:38.888988  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 58048.9us
W20260709 13:02:38.918102  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 97000.2us
W20260709 13:02:38.894500  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 103245us
I20260709 13:02:38.864270  6166 consensus_queue.cc:237] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:38.925447  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:38.869395  6407 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:38.849396  6309 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:38.889619  1556 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:38.872196  6360 raft_consensus.cc:2749] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157) with higher term. Message: Invalid argument: T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for earlier term 10. Current term is 11.
I20260709 13:02:38.880769  6557 raft_consensus.cc:2749] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:38.885375  6582 raft_consensus.cc:2804] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:38.894896  6562 raft_consensus.cc:3055] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:38.896136  6471 raft_consensus.cc:2804] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:38.938768  1558 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:38.903085  6412 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.888319  6464 raft_consensus.cc:2749] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:38.899670  6461 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:38.899439  6565 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:38.941635  1589 raft_consensus.cc:1275] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:38.943188  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:38.897300  6539 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.945438  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:38.947178  2552 raft_consensus.cc:1275] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:02:38.947633  2550 raft_consensus.cc:1275] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:38.886406  6380 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:38.936189  6582 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:38.947964  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 58455.4us
I20260709 13:02:38.940127  6471 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.937683  6562 raft_consensus.cc:740] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:38.960305  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:38.964740  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:38.959664  6292 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:38.978896  6454 consensus_queue.cc:1048] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:02:38.970638  6407 consensus_queue.cc:1048] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:02:38.961000  6537 raft_consensus.cc:2804] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:38.983109  6562 consensus_queue.cc:260] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:38.965548  6582 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:38.994853  6562 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:38.995591  6573 log.cc:927] Time spent T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.789s	user 0.000s	sys 0.002s
I20260709 13:02:38.977921  6539 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:39.000626  6539 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:39.001447  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 66532us
I20260709 13:02:38.967545  6471 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:39.007313  6537 raft_consensus.cc:697] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:39.008896  6537 consensus_queue.cc:237] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:38.987735  6296 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:39.022819  1558 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:39.023573  6380 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:39.024605  6480 raft_consensus.cc:2804] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:39.302385  6480 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:39.302925  6480 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:39.305636  6356 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:39.306375  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.306325  6356 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:39.033635  1666 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 14.
I20260709 13:02:39.037760  1633 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:38.966636  6461 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:39.062507  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 93158.8us
I20260709 13:02:39.067795  6582 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:39.421793  6582 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:39.424203  2426 leader_election.cc:336] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Timed out: RequestConsensusVote RPC to 127.0.107.195:32843 timed out after 1.504s (SENT)
I20260709 13:02:39.110430  6597 consensus_queue.cc:1048] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:39.425151  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:39.426088  6166 consensus_queue.cc:1048] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:39.424378  6588 consensus_queue.cc:1048] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.003s
W20260709 13:02:39.122081  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 62223.3us
I20260709 13:02:39.129351  6599 raft_consensus.cc:993] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:02:39.427838  6599 raft_consensus.cc:1081] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:02:39.163892  6435 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:39.430756  6435 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:39.164959  6466 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:39.432818  6466 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:38.985565  6412 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:39.434201  1486 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55132 (request call id 307) took 10487 ms. Trace:
I20260709 13:02:39.435082  6412 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:39.437018  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:39.437813  1738 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 14.
I20260709 13:02:39.437922  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:39.438943  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:39.434705  1486 rpcz_store.cc:276] 0709 13:02:28.946859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.947170 (+   311us) service_pool.cc:224] Handling call
0709 13:02:39.433940 (+10486770us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:33.680560 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:33.681216 (+   656us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:33.681251 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:02:33.681265 (+    14us) tablet.cc:662] Decoding operations
0709 13:02:33.687626 (+  6361us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:33.687702 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:33.687730 (+    28us) tablet.cc:685] Acquiring locks for 28 operations
0709 13:02:34.261505 (+573775us) tablet.cc:701] Row locks acquired
0709 13:02:34.261529 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:02:34.261705 (+   176us) write_op.cc:270] Start()
0709 13:02:34.261840 (+   135us) write_op.cc:276] Timestamp: P: 1783602154261651 usec, L: 0
0709 13:02:34.261864 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:02:34.429412 (+167548us) log.cc:844] Serialized 11017 byte log entry
0709 13:02:35.233049 (+803637us) spinlock_profiling.cc:243] Waited 2.76 ms on lock 0x7b4400022b4c. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7ddc8c85 00007f1b7ddc96a2 00007f1b80b3b1db 00007f1b80b36aaf 00007f1b80b2a86e 00007f1b80b29bb6 00007f1b80b297d8 00007f1b80b33221 00007f1b80b331d9 00007f1b80b33169
0709 13:02:35.424750 (+191701us) op_driver.cc:464] REPLICATION: finished
0709 13:02:35.815495 (+390745us) write_op.cc:301] APPLY: starting
0709 13:02:35.815735 (+   240us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:36.352516 (+536781us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:36.352534 (+    18us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:36.530255 (+177721us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:36.530860 (+   605us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=56,key_file_lookups=56,delta_file_lookups=56,mrs_lookups=0
0709 13:02:36.530941 (+    81us) write_op.cc:312] APPLY: finished
0709 13:02:36.531772 (+   831us) log.cc:844] Serialized 244 byte log entry
0709 13:02:36.840518 (+308746us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:36.872577 (+ 32059us) write_op.cc:454] Released schema lock
0709 13:02:36.881251 (+  8674us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:36.960616 (+ 79365us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:36.967123 (+  6507us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":176361,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":390250,"apply.run_cpu_time_us":90630,"apply.run_wall_time_us":1113070,"cfile_cache_hit":114,"cfile_cache_hit_bytes":121167,"num_ops":28,"prepare.queue_time_us":244196,"prepare.run_cpu_time_us":29115,"prepare.run_wall_time_us":1001317,"raft.queue_time_us":129221,"raft.run_cpu_time_us":31368,"raft.run_wall_time_us":390743,"replication_time_us":1162643,"spinlock_wait_cycles":6357760,"thread_start_us":1056059,"threads_started":5,"wal-append.queue_time_us":830739,"wal-append.run_cpu_time_us":25981,"wal-append.run_wall_time_us":2998067}]]}
I20260709 13:02:38.985088  6565 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:39.439531  1738 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 8.
I20260709 13:02:39.440021  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:39.206969  6569 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:39.441948  6565 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:39.227339  6296 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:39.442525  6569 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:39.442791  6296 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:39.443439  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:39.445542  6296 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:39.228271  6539 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.438158  1489 catalog_manager.cc:5697] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:02:39.447568  6539 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:39.229017  6557 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.235877  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:39.448925  1740 raft_consensus.cc:3060] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:39.448859  6557 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:39.450690  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:39.451150  6557 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:39.231140  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:39.452020  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:39.239295  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:02:39.247964  6571 log.cc:927] Time spent T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 1.047s	user 0.002s	sys 0.003s
I20260709 13:02:39.258452  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:39.259593  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:39.454211  1736 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 8.
W20260709 13:02:39.266319  2423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.269763  6533 raft_consensus.cc:2804] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:39.269299  1661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3648) took 1018 ms. Trace:
I20260709 13:02:39.267679  6464 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.456162  6533 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:39.455120  1661 rpcz_store.cc:276] 0709 13:02:38.250640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.287443 (+ 36803us) service_pool.cc:224] Handling call
0709 13:02:38.287777 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:38.288141 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:38.368337 (+ 80196us) log.cc:844] Serialized 14 byte log entry
0709 13:02:39.268714 (+900377us) log.cc:844] Serialized 14 byte log entry
0709 13:02:39.268922 (+   208us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:39.268969 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:39.269012 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:39.269116 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:39.269236 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":98949,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":71,"raft.queue_time_us":4264,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":172,"thread_start_us":81893,"threads_started":2}
I20260709 13:02:39.456305  6464 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:39.457603   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:39.458590  6464 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:39.459538  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:39.024904  1558 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
W20260709 13:02:39.314715  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.317378  6454 raft_consensus.cc:2804] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:39.462240  6454 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:39.462674  6454 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:39.316694  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 279019us
I20260709 13:02:39.465884  1633 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:39.466859  6407 raft_consensus.cc:2749] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:39.465711  1489 catalog_manager.cc:5697] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 7 to 9, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 9 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:39.319038  6246 consensus_queue.cc:237] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:39.469771  1489 catalog_manager.cc:5697] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 8 to 9, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 9 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.319435  6480 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:39.472414  1740 raft_consensus.cc:2468] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 8.
I20260709 13:02:39.473026  1489 catalog_manager.cc:5697] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:02:39.474664  6461 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:39.474779  1489 catalog_manager.cc:5697] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
W20260709 13:02:39.330826  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.334396  6361 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:39.478749  6361 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:39.479835  2548 raft_consensus.cc:2393] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 9: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:02:39.452877  1732 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 12.
I20260709 13:02:39.444850  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:39.482226  1665 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:02:39.479830  1741 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 14.
I20260709 13:02:39.476649  1489 catalog_manager.cc:5697] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 7 to 10, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 10 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:39.440675  1658 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:02:39.489722  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:39.490770  2548 raft_consensus.cc:2410] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:02:39.378728  6513 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:39.491765  2552 raft_consensus.cc:1275] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:02:39.308954  6356 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:39.409912  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.428671  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:39.493367  1735 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 12.
I20260709 13:02:39.439270  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:39.456689  6533 raft_consensus.cc:3060] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:39.496996  6539 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:39.283442  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 318323us
I20260709 13:02:39.490617  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:39.492015  6513 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:39.503773  2424 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:39.505249  6513 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:39.505877  6513 consensus_queue.cc:1048] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:39.382159  6324 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:39.507432  6324 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:39.508169  6466 raft_consensus.cc:2804] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:39.509495  6324 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:39.509759  6466 raft_consensus.cc:697] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:39.510738  6466 consensus_queue.cc:237] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:39.511440  6480 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:39.513255  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:39.521736  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 497036us
I20260709 13:02:39.522675  1558 leader_election.cc:400] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for earlier term 10. Current term is 11.
I20260709 13:02:39.524716  6582 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:39.525292  6582 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.525741  6582 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:39.527192  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:39.527801  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:39.528369  2553 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:39.535454  2554 raft_consensus.cc:1240] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:39.440642  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:39.541432  6582 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:39.541767  1738 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 9.
I20260709 13:02:39.543933  6582 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:39.546739  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:39.553670  1660 raft_consensus.cc:1240] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:39.554412  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.554548  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:39.347373  6309 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:39.468782  1633 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:39.566870  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:39.567852  6597 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.555882  6407 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:39.568233  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 99726.8us
I20260709 13:02:39.567651  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:39.567198  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:39.570101  1584 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 11.
W20260709 13:02:39.573412  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 48705.8us
I20260709 13:02:39.583848  2553 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16.
I20260709 13:02:39.585669  1555 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:39.568516  6435 raft_consensus.cc:2749] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:39.568285  1663 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 14.
W20260709 13:02:39.591568  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 167396us
I20260709 13:02:39.592542  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:02:39.591122  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 217352us
I20260709 13:02:39.591614  6539 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:39.632884  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:39.599260  6582 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:39.636895  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:39.627367  6548 consensus_meta.cc:287] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.698s	user 0.013s	sys 0.000s
I20260709 13:02:39.647182  1733 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 15.
I20260709 13:02:39.568691  6597 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:39.568784  6407 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:39.540980  6533 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:39.614336  6360 raft_consensus.cc:2804] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:39.650565  1734 raft_consensus.cc:1275] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:39.650514  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:39.652535  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:39.653858  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 84806.5us
I20260709 13:02:39.654039  1556 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:39.679891  1663 raft_consensus.cc:2410] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:02:39.629402  6480 consensus_queue.cc:1059] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:02:39.661648  6548 raft_consensus.cc:2749] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:39.642165  6539 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:39.694198  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:39.661192  6557 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.698854  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:02:39.711287  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 45485us
I20260709 13:02:39.674458  6360 raft_consensus.cc:697] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 16 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:39.713825  1660 raft_consensus.cc:2393] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 11: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:39.714737  1661 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:39.714314  1556 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:39.661023  6435 consensus_queue.cc:1048] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
W20260709 13:02:39.722206  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 136135us
I20260709 13:02:39.692751  6364 raft_consensus.cc:2749] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:39.723940  1556 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:02:39.718600  6471 consensus_meta.cc:287] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.716s	user 0.013s	sys 0.004s
I20260709 13:02:39.735185  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:39.737176  1666 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:39.681953  6582 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:39.721403  6464 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.743578  1633 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:39.733963  6557 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:39.686110  1659 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39146
W20260709 13:02:39.799032  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 75196.8us
I20260709 13:02:39.724934  6553 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:39.802724  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 120579us
I20260709 13:02:39.734237  6612 consensus_queue.cc:1059] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:02:39.811463  1667 raft_consensus.cc:1275] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:39.813819  1659 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:39.824316  1659 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:39.742421  6471 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:39.838231  1666 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16.
I20260709 13:02:39.795344  6548 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.829231  1556 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:39.812238  6542 raft_consensus.cc:2804] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:39.799808  6616 raft_consensus.cc:2804] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:39.851500  1556 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:39.854094  1556 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:39.864782  6620 consensus_queue.cc:1059] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:02:39.851364  6542 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.852741  6292 raft_consensus.cc:2749] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:39.817965  6464 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:39.852804  6616 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.859761  6364 raft_consensus.cc:2749] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:39.874131  6454 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:39.875342  1665 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:39.879880  6361 raft_consensus.cc:3055] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:39.880383  6361 raft_consensus.cc:740] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:39.855970  6480 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:39.881457  6480 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.881903  6480 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:39.882687  6557 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:39.826629  6553 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:39.850896  6548 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:39.869880  6542 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:39.909312  6361 consensus_queue.cc:260] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:39.912794  6582 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:39.850575  6360 consensus_queue.cc:237] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:39.868853  6533 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:39.889778  6324 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:39.883982  6616 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:39.912030  2426 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:39.921756  6597 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:39.926455  6539 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:39.938942  6407 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:39.944043  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.915125  6553 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:39.944545  6361 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:39.970194  6471 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:39.993212  6548 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:39.958086  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:39.960227  6324 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:39.947376  6606 log.cc:927] Time spent T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.125s	user 0.000s	sys 0.004s
I20260709 13:02:39.997376  6324 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:40.007591  6464 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:40.000945  1659 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:39.947543  6454 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:40.023793  1665 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 15.
W20260709 13:02:40.035243  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:39.970750  6608 log.cc:927] Time spent T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.165s	user 0.002s	sys 0.000s
I20260709 13:02:40.043121  1661 raft_consensus.cc:2410] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:02:39.975235  6615 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:39.970660  6414 raft_consensus.cc:2804] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:02:40.050879  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 188915us
W20260709 13:02:40.052700  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 140771us
W20260709 13:02:40.050971  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 324583us
I20260709 13:02:40.054526  2426 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:40.055727  2426 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 6d4de2ce0683442498244b9529127f91
W20260709 13:02:40.055934  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 381313us
I20260709 13:02:40.053315  1556 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:40.052209  1659 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:40.066212  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:40.071497  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 333035us
I20260709 13:02:40.070230  1558 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:40.077714  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:40.078485  1585 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:40.079972  2426 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:40.063841  6599 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:40.076483  1556 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:40.067998  6596 raft_consensus.cc:2804] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:40.068914  6414 raft_consensus.cc:697] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:40.069900  6494 raft_consensus.cc:2804] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:40.091792  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:40.092811  1590 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:40.093961  1738 raft_consensus.cc:1275] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:40.081754  6309 consensus_queue.cc:1048] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:02:40.088929  6596 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.100118  6292 raft_consensus.cc:3055] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:40.102190  1733 raft_consensus.cc:1240] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:40.104998  6414 consensus_queue.cc:237] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:40.108229  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:40.109819  6622 raft_consensus.cc:3055] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:40.110340  6622 raft_consensus.cc:740] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:40.111413  6622 consensus_queue.cc:260] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:40.112378  6626 raft_consensus.cc:2804] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:40.088554  6618 raft_consensus.cc:2804] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:40.113271  6626 raft_consensus.cc:697] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:40.113929  6582 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:02:40.100436  1688 debug-util.cc:398] Leaking SignalData structure 0x7b08001cf080 after lost signal to thread 434
I20260709 13:02:40.097683  6596 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:40.115795  1688 debug-util.cc:398] Leaking SignalData structure 0x7b080026d0c0 after lost signal to thread 1524
I20260709 13:02:40.113363  6618 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:40.117933  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:40.123761  1734 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:40.118398  1688 debug-util.cc:398] Leaking SignalData structure 0x7b08001e6c00 after lost signal to thread 1616
I20260709 13:02:40.111799  1558 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:40.112813  1665 raft_consensus.cc:1275] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:02:40.114213  6246 consensus_queue.cc:1048] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:40.096276  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:40.130689  1663 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:40.122689  1590 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 13.
W20260709 13:02:40.125900  1688 debug-util.cc:398] Leaking SignalData structure 0x7b08003437c0 after lost signal to thread 1691
I20260709 13:02:40.092622  6494 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:40.132396  1688 debug-util.cc:398] Leaking SignalData structure 0x7b080015f320 after lost signal to thread 1692
I20260709 13:02:40.100875  6292 raft_consensus.cc:740] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:02:40.136472  1688 debug-util.cc:398] Leaking SignalData structure 0x7b08003e4720 after lost signal to thread 1765
I20260709 13:02:40.143743  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:40.112737  6622 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:40.142297  6480 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:40.124776  6618 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:40.141767  1585 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 9.
I20260709 13:02:40.083855  6466 consensus_queue.cc:1048] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:02:40.154486  1556 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:40.158396  1688 debug-util.cc:398] Leaking SignalData structure 0x7b08003d7ec0 after lost signal to thread 2594
W20260709 13:02:40.159356  1688 debug-util.cc:398] Leaking SignalData structure 0x7b08003fefe0 after lost signal to thread 2595
I20260709 13:02:40.165887  6292 consensus_queue.cc:260] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:40.143762  6494 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:40.169589  1661 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
W20260709 13:02:40.172230  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 60509.9us
W20260709 13:02:40.175902  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 93959.9us
I20260709 13:02:40.190171  6596 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:40.180104  6292 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:40.193575  6548 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.194167  6548 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:40.194478  1558 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:40.196416  6548 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:40.197666  6553 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:40.198714  6553 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:40.201259  6480 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:40.150492  6542 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:40.202320  6539 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.202836  6539 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:40.203565  6542 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:40.205271  6596 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:40.205675  6616 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:40.207839  6616 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:40.197667  6361 raft_consensus.cc:2804] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:40.173261  6620 raft_consensus.cc:2804] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:40.208595  6361 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.208626  6596 consensus_queue.cc:1048] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:40.209177  6466 consensus_queue.cc:1059] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:02:40.209911  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.210193  6445 raft_consensus.cc:3055] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:40.210318  6620 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.210721  6445 raft_consensus.cc:740] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:40.210891  6620 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:40.204877  6539 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:40.197016  6548 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.211815  6445 consensus_queue.cc:260] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:40.212589  6548 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:40.213243  6445 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:40.215344  6548 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:40.209193  6361 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:40.216154  6553 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:40.216863  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:40.259554  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:40.260390  1665 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:40.263948  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:40.264784  1664 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:40.266960  1660 raft_consensus.cc:1240] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:40.217396  6626 consensus_queue.cc:237] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:40.221532  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:40.173206  6360 raft_consensus.cc:2749] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:40.226735  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:40.273053  1556 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:40.274843  1585 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:40.275188  6597 raft_consensus.cc:2804] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:40.275712  6597 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.276104  6597 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:40.235859  6454 consensus_queue.cc:1048] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:40.286283  6471 consensus_queue.cc:1059] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:40.287287  6471 raft_consensus.cc:3055] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:40.286985  6613 consensus_queue.cc:1048] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:40.287653  6471 raft_consensus.cc:740] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:40.294006  1585 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 13.
I20260709 13:02:40.278316  6582 consensus_queue.cc:1048] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:02:40.299176  1633 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:40.300028  6618 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:40.302488  6618 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 12 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:40.305359  2550 raft_consensus.cc:1240] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:40.308194  6633 consensus_queue.cc:1059] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:40.309314  6633 raft_consensus.cc:2749] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:40.309641  6631 log.cc:927] Time spent T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:02:40.310004  6633 consensus_queue.cc:1059] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:40.310895  6533 raft_consensus.cc:3055] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:40.311252  6533 raft_consensus.cc:740] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:40.312100  6533 consensus_queue.cc:260] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:40.321854  6533 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:40.331207  1665 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 15.
I20260709 13:02:40.236627  1558 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:40.272344  1740 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:40.332821  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 135772us
I20260709 13:02:40.333849  6542 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:40.334606  6542 consensus_queue.cc:1048] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:40.222621  2426 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede
W20260709 13:02:40.336218  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 113669us
I20260709 13:02:40.279618  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:40.338486  1661 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:40.308717  6553 consensus_queue.cc:1059] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:40.344743  1664 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:02:40.347506  1740 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 13.
I20260709 13:02:40.364880  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:40.365680  1733 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 14.
I20260709 13:02:40.253186  1663 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:02:40.255713  1734 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 9.
I20260709 13:02:40.346752  2426 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:40.368011  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.356840  1738 raft_consensus.cc:1240] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:40.368872  6466 raft_consensus.cc:2804] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:40.359975  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.369738  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.368063  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:40.351243  6414 raft_consensus.cc:2804] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:40.375144  1592 raft_consensus.cc:2368] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 8. Current term is 9.
I20260709 13:02:40.355235  6615 raft_consensus.cc:2749] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:40.383019  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:40.373811  6553 raft_consensus.cc:3055] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:40.390064  6553 raft_consensus.cc:740] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:40.393497  1736 raft_consensus.cc:1275] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:40.394685  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:40.395358  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:40.395941  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:40.396195  1741 raft_consensus.cc:2410] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:02:40.396504  1736 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 14.
I20260709 13:02:40.396983  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:40.397354  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:40.397890  1589 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:40.398108  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:40.398692  1741 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:02:40.399508  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:40.400141  1741 raft_consensus.cc:2393] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 9: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:02:40.401441  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:40.402266  1732 raft_consensus.cc:2410] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:02:40.403160  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:40.404433  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:40.405056  1739 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:02:40.409686  6324 consensus_queue.cc:1059] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:40.410526  6539 consensus_queue.cc:1059] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:40.410892  6324 raft_consensus.cc:3055] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:40.410997  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:40.411322  6324 raft_consensus.cc:740] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:40.411470  6539 raft_consensus.cc:3055] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:40.411892  6539 raft_consensus.cc:740] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:40.412313  6414 raft_consensus.cc:697] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:40.412557  6324 consensus_queue.cc:260] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:40.413547  1733 raft_consensus.cc:1275] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:02:40.413925  1733 pending_rounds.cc:85] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 4
I20260709 13:02:40.414184  1733 pending_rounds.cc:107] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:02:40.413369  6414 consensus_queue.cc:237] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:40.414350  6324 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:40.415998  6361 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:40.417675  1591 raft_consensus.cc:1240] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:02:40.414399  1733 raft_consensus.cc:2889] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:40.369738  6466 raft_consensus.cc:697] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:40.417848  6620 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:40.444092  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.445221  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:40.448388  1734 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:02:40.448457  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:40.450310  1741 raft_consensus.cc:1275] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:02:40.451993  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.457021  1661 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:02:40.461920  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.463167  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:40.463958  1736 raft_consensus.cc:2393] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 13: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
W20260709 13:02:40.465801  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:40.472983  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.474474  1589 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 12.
I20260709 13:02:40.476487  1556 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:40.480532  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.469414  6539 consensus_queue.cc:260] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:40.477809  1556 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:02:40.486685  6637 log.cc:927] Time spent T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:02:40.495172  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:40.495827  1737 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:40.487833  1589 raft_consensus.cc:1275] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:02:40.487928  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:40.491045  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:40.497166  1738 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:40.497275  1741 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:40.498150  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:40.387910  6597 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:40.570245  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:40.577354  1734 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:02:40.505666  6292 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:40.583336  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.584568  1589 raft_consensus.cc:1240] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:40.585131  1590 raft_consensus.cc:2393] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 13: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:40.483861  6360 raft_consensus.cc:2804] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:40.578559  1556 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:40.588807  1556 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:02:40.574473  6638 log.cc:927] Time spent T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:02:40.594383  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.605223  6466 consensus_queue.cc:237] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:40.608454  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.609722  1592 raft_consensus.cc:2393] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 20: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:40.610656  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.610883  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.611442  1589 raft_consensus.cc:2393] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 13: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:02:40.612746  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.614566  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.616380  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.616685  6360 raft_consensus.cc:697] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:40.617830  6360 consensus_queue.cc:237] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:40.619038  6361 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:40.622117  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:40.622540  6597 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:40.623306  1732 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:40.624254  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.594528  6364 raft_consensus.cc:2804] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:40.626300  6364 raft_consensus.cc:697] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:40.627816  6364 consensus_queue.cc:237] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:40.628187  6494 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:40.629191  1741 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:02:40.594956  6292 raft_consensus.cc:697] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:40.592377  6539 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:40.637503  1658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3664) took 1033 ms. Trace:
I20260709 13:02:40.638100  1658 rpcz_store.cc:276] 0709 13:02:39.604359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:39.614734 (+ 10375us) service_pool.cc:224] Handling call
0709 13:02:39.616160 (+  1426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:39.849356 (+233196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:39.849389 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:39.857554 (+  8165us) log.cc:844] Serialized 26 byte log entry
0709 13:02:40.360645 (+503091us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:40.360688 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:40.360817 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:40.637181 (+276364us) raft_consensus.cc:1685] finished
0709 13:02:40.637212 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:40.637419 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":168645,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":18433,"thread_start_us":556976,"threads_started":2,"wal-append.queue_time_us":692144}
I20260709 13:02:40.644019  1737 raft_consensus.cc:2410] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:02:40.636986  6596 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.630936  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:40.650938  1741 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:40.644222  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 50786.4us
I20260709 13:02:40.648789  1738 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 15.
I20260709 13:02:40.658484  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:40.675209  1736 raft_consensus.cc:1275] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:02:40.675741  1736 pending_rounds.cc:85] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 10
I20260709 13:02:40.675995  1736 pending_rounds.cc:107] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:02:40.676242  1736 raft_consensus.cc:2889] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:40.678323  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:40.681098  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:40.682013  1661 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:02:40.594147  6599 raft_consensus.cc:2804] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:40.686784  2553 raft_consensus.cc:1240] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:40.695413  1738 raft_consensus.cc:1275] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:40.698158  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.705003  1661 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:02:40.720152  1741 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 15.
I20260709 13:02:40.726156  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.727114  1591 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:40.732066  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.734097  1584 raft_consensus.cc:2393] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 13: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:40.735183  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.737691  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:40.739527  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.630846  6292 consensus_queue.cc:237] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:40.745971  1591 raft_consensus.cc:2393] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 16: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:40.713588  6599 raft_consensus.cc:697] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:40.674058  6596 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:40.755581  2550 raft_consensus.cc:1275] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:02:40.757972  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:40.765026  1583 raft_consensus.cc:2376] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12. Re-sending same reply.
I20260709 13:02:40.766539  1584 raft_consensus.cc:1240] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:40.768299  1588 raft_consensus.cc:1240] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:40.769964  1658 raft_consensus.cc:1240] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:02:40.774247  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:40.775727  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:40.776052  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:40.776379  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:40.776510  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.777135  1738 raft_consensus.cc:2393] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 16: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:40.757187  6533 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:40.776520  1741 raft_consensus.cc:2393] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 13: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:40.778155  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:40.779285  1739 raft_consensus.cc:2393] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 12: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:40.780782  1737 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
I20260709 13:02:40.779217  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.781984  1588 raft_consensus.cc:2368] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 8. Current term is 9.
I20260709 13:02:40.783362  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:40.783412  6471 consensus_queue.cc:260] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:40.781816  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:40.787577  1737 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:40.793287  1738 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 12.
I20260709 13:02:40.794380  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:40.794961  1738 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 11.
I20260709 13:02:40.795423  6599 consensus_queue.cc:237] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:40.796481  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:40.797449  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.798470  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.798807  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.799088  1587 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 16.
I20260709 13:02:40.799430  1591 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
I20260709 13:02:40.799809  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:40.800083  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.800377  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.800532  1589 raft_consensus.cc:2393] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 16: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:40.801440  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.802021  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.802461  2523 raft_consensus.cc:1240] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:40.802709  1592 raft_consensus.cc:2393] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 13: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:40.803812  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.806267  1587 raft_consensus.cc:1240] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:40.807269  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:40.807806  1587 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:40.809813  1592 raft_consensus.cc:1240] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:02:40.810868  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.811126  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:40.811949  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.812336  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:40.801491  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.813331  1585 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
I20260709 13:02:40.813863  6582 consensus_queue.cc:1048] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:40.804780  1586 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
I20260709 13:02:40.815430  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.816442  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.804780  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.817751  1587 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 17.
I20260709 13:02:40.818194  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:40.820536  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.795802  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:40.818265  6533 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:40.819587  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:40.803864  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.814154  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:40.819779  6620 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:40.818452  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:40.840860  1736 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 12.
I20260709 13:02:40.825690  1732 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:02:40.841482  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:40.826776  1739 raft_consensus.cc:2393] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 8: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:02:40.842748  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:40.844132  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.845669  1735 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:02:40.847309  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:40.812629  1592 raft_consensus.cc:2393] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 12: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:40.828653  1737 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 17.
I20260709 13:02:40.852315  1585 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 8.
I20260709 13:02:40.844825  1591 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
I20260709 13:02:40.853755  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.854547  1584 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
I20260709 13:02:40.855530  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:40.795883  6435 raft_consensus.cc:3055] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:40.857378  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.859306  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:40.863458  1741 raft_consensus.cc:2393] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 15: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:40.860345  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.864691  1587 raft_consensus.cc:1275] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:02:40.864887  1589 raft_consensus.cc:2410] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:02:40.866994  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:40.867717  1736 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:40.868724  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:40.870277  1658 raft_consensus.cc:2410] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:02:40.870709  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.871321  1589 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 15.
I20260709 13:02:40.874540  1732 raft_consensus.cc:1240] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 11. Current term is 12. Ops: []
W20260709 13:02:40.878067  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.872489  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:40.864998  6471 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:40.894732  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:40.891132  1739 raft_consensus.cc:2368] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 14. Current term is 15.
I20260709 13:02:40.890605  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:40.868600  6435 raft_consensus.cc:740] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:40.893561  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:40.898396  1587 raft_consensus.cc:2368] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 8. Current term is 9.
I20260709 13:02:40.899292  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:40.903661  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:40.904325  1739 raft_consensus.cc:1275] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:40.904052  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:40.905435  1732 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:40.909773  1705 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.921s (SENT) [suppressed 28 similar messages]
I20260709 13:02:40.926818  1658 raft_consensus.cc:2393] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 17: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:40.902189  6494 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:40.878790  6651 consensus_queue.cc:1059] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:02:40.936183  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:40.936700  1732 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 16.
I20260709 13:02:40.939533  1658 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
W20260709 13:02:40.947678  2426 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.013s	sys 0.009s
W20260709 13:02:40.948230  2426 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.013s	sys 0.009s
W20260709 13:02:40.948575  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 575919us
I20260709 13:02:40.952242  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:40.953706  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:40.954515  1735 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:40.961069  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:02:41.041626  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.058028  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:41.069684  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:41.072734  1664 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:41.079597  1558 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:41.082052  1658 raft_consensus.cc:1275] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:02:41.097443  1735 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:02:41.138239  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:41.139227  1737 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:41.144572  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 444880us
I20260709 13:02:41.056511  6622 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:41.154042  6648 log.cc:927] Time spent T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.314s	user 0.001s	sys 0.000s
I20260709 13:02:41.155028  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:41.156117  1659 raft_consensus.cc:2393] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 16: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:41.163827  1664 raft_consensus.cc:2410] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 13:02:41.174093  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 222516us
I20260709 13:02:41.192474  1737 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:02:41.174870  2426 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:41.209581  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:41.062382  6435 consensus_queue.cc:260] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:41.137583  6625 consensus_queue.cc:1048] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 13:02:41.152245  6533 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:41.214931  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 135445us
I20260709 13:02:41.216714  1664 raft_consensus.cc:2410] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:02:41.206992  6620 raft_consensus.cc:2749] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:41.221262  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.252444  1558 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:41.258227  1558 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:41.260852  1558 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:41.178763  6622 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:41.270994  1664 raft_consensus.cc:1240] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:02:41.240693  6435 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:41.147892  6553 consensus_queue.cc:260] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:41.283245  1662 raft_consensus.cc:1275] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:02:41.284193  6660 log.cc:927] Time spent T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:02:41.284705  6677 raft_consensus.cc:2804] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:02:41.285006  6656 log.cc:927] Time spent T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.350s	user 0.001s	sys 0.000s
W20260709 13:02:41.289420  6661 log.cc:927] Time spent T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:02:41.291390  6622 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:41.294781  1659 raft_consensus.cc:1240] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:02:41.270193  1558 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
W20260709 13:02:41.278055  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 103241us
I20260709 13:02:41.307085  1558 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:41.311107  1736 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 8.
I20260709 13:02:41.311640  1558 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:41.316200  6630 consensus_queue.cc:1048] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:02:41.318912  6657 log.cc:927] Time spent T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:02:41.273228  6582 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:41.281819  6539 consensus_meta.cc:287] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.644s	user 0.011s	sys 0.002s
I20260709 13:02:41.315061  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:41.274031  6364 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:41.329222  1659 raft_consensus.cc:2368] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 13. Current term is 14.
I20260709 13:02:41.331334  1661 raft_consensus.cc:1275] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:41.326156  1558 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:41.281333  6599 raft_consensus.cc:2749] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:41.314399  6292 raft_consensus.cc:2804] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:41.345559  6292 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:41.346063  6292 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:41.347836  6676 log.cc:927] Time spent T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:02:41.349644  2553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49222 (request call id 612) took 1125 ms. Trace:
W20260709 13:02:41.350404  6672 log.cc:927] Time spent T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:02:41.353504  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:41.354229  1660 raft_consensus.cc:1275] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:02:41.329592  6553 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:41.353439  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:41.358057  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:41.359057  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:41.359982  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:41.350103  2553 rpcz_store.cc:276] 0709 13:02:40.223818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.223987 (+   169us) service_pool.cc:224] Handling call
0709 13:02:40.224289 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:40.688576 (+464287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:41.349368 (+660792us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b540056f254. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:41.349558 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1063062272}
I20260709 13:02:41.368089  1660 raft_consensus.cc:2393] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 13: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:41.371716  1558 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:41.322211  6675 raft_consensus.cc:2749] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:41.379122  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:41.386402  6599 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:41.387188  6599 raft_consensus.cc:697] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:41.388257  6599 consensus_queue.cc:237] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:41.389338  6361 consensus_queue.cc:1048] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:41.390726  6630 consensus_queue.cc:1048] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:41.397801  1558 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:41.357393  6625 raft_consensus.cc:2749] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:41.403350  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:41.405102  1665 raft_consensus.cc:2393] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 8: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:41.407217  1739 raft_consensus.cc:1275] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:02:41.407598  1739 pending_rounds.cc:85] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 5
I20260709 13:02:41.407827  1739 pending_rounds.cc:107] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:02:41.408083  1739 raft_consensus.cc:2889] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:41.409862  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:41.413689  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 105679us
I20260709 13:02:41.417289  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:41.418236  1663 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 11.
I20260709 13:02:41.413709  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:41.403967  6361 raft_consensus.cc:2804] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:41.429711  1658 raft_consensus.cc:1240] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:41.445143  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:41.447935  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:41.448907  1658 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 20.
W20260709 13:02:41.455436  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.459683  6435 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.469781  6435 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:41.441100  6361 raft_consensus.cc:697] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:41.490142   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:41.497764  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:41.462339  6471 consensus_meta.cc:287] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.564s	user 0.008s	sys 0.004s
I20260709 13:02:41.503768  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:41.452256  6668 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:41.508221  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:41.443359  6673 consensus_queue.cc:1048] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:02:41.524678  1558 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:41.526182  1558 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:41.527591  1558 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:41.510491  1658 raft_consensus.cc:2393] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 13: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:41.511999  6668 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:41.514081  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:41.515393  6435 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:41.516466  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:41.539667  1663 raft_consensus.cc:2393] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 8: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:41.473431  6582 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.517896  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:41.542023  1665 raft_consensus.cc:2393] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 11: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:41.519778  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:41.521698  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:41.530473  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:41.533157  1590 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 16.
I20260709 13:02:41.535300  1660 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
W20260709 13:02:41.534610  6667 log.cc:927] Time spent T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:02:41.543681  1661 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:02:41.550597  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:41.539933  6471 raft_consensus.cc:2749] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:41.549434  6582 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:41.559118  6582 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:41.569254  2426 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:41.570362  6652 raft_consensus.cc:2804] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:41.542150  6542 raft_consensus.cc:2804] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:41.570977  6652 raft_consensus.cc:697] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:41.571161  6542 raft_consensus.cc:697] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:41.572196  6542 consensus_queue.cc:237] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:41.577706  6361 consensus_queue.cc:237] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:41.580099  6292 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:41.585739  6548 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:41.586539  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:41.586416  6548 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:41.587491  1732 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16.
I20260709 13:02:41.590709  6292 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:41.591711  1558 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:41.554899  6669 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:41.594014  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:41.594965  6669 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:41.595435  6669 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:41.596155  6292 raft_consensus.cc:2804] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:41.596742  6292 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.597209  6292 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:41.548548  6616 consensus_queue.cc:1048] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:02:41.542503  6480 raft_consensus.cc:2804] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:41.600955  6480 raft_consensus.cc:697] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:41.602034  6480 consensus_queue.cc:237] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:41.615801  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.635968  1585 raft_consensus.cc:1275] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:41.639807  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:41.641211  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:41.643043  1584 raft_consensus.cc:1275] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:41.639796  6675 consensus_queue.cc:1059] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:02:41.644279  6675 raft_consensus.cc:3055] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:41.644651  6675 raft_consensus.cc:740] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:41.645509  6675 consensus_queue.cc:260] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:41.646858  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.650030  6675 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:41.647557  6630 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:41.652544  6630 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:41.653108  6678 log.cc:927] Time spent T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.369s	user 0.002s	sys 0.000s
I20260709 13:02:41.655189  6630 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:41.655853  6596 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:41.660466  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:41.663231  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:41.572163  6652 consensus_queue.cc:237] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:41.674896  1661 raft_consensus.cc:1240] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:41.676352  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:41.676949  1658 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16.
I20260709 13:02:41.678702  1661 raft_consensus.cc:1275] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:41.682489  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:41.704414  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:41.708871  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:41.705407  1660 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
W20260709 13:02:41.714125  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.714865  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:41.715121  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.716295  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:41.686110  6630 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:41.728681  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:41.732224  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:41.736428  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:41.732177  1707 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:41.740145  1707 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:41.742517  1707 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:41.709926  6548 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:41.756728  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 334850us
I20260709 13:02:41.767154  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:41.757020  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:41.776633  1659 raft_consensus.cc:1275] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:41.745445  6651 raft_consensus.cc:2749] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:41.729830  6464 consensus_queue.cc:1048] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:02:41.806381  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:41.732736  6597 consensus_queue.cc:1048] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
W20260709 13:02:41.809095  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 97445.1us
I20260709 13:02:41.793545  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:41.735874  6569 consensus_queue.cc:1048] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:02:41.745229  6539 consensus_queue.cc:1059] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:02:41.770411  6548 raft_consensus.cc:2749] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:41.776773  6677 raft_consensus.cc:697] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
W20260709 13:02:41.790591  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 48150.1us
I20260709 13:02:41.769579  6582 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.765617  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:41.745720  6630 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:41.819605  1707 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:41.819169  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:41.889866  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.897841  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:41.894487  6435 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.898599  1660 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
I20260709 13:02:41.904989  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:41.906010  1659 raft_consensus.cc:2393] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 8: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
W20260709 13:02:41.907704  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.914150  6630 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:41.917845  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:41.918634  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:41.919104  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:41.919284  1740 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 10.
I20260709 13:02:41.899938  6674 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.971417  6674 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:41.973924  6674 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:41.974519  6674 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:41.975050  6674 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:41.929711  6654 raft_consensus.cc:2749] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:41.930712  6665 consensus_queue.cc:1048] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.196s
I20260709 13:02:41.981561  6685 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.982285  6685 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:41.982740  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:41.983500  1659 raft_consensus.cc:2393] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 13: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:41.985307  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:41.946000  6686 log.cc:927] Time spent T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:02:41.947659  6464 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.911451  6539 raft_consensus.cc:3055] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:41.959895  6292 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:41.905179  6668 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:41.961436  6696 log.cc:927] Time spent T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:02:42.038810  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:41.962414  6690 log.cc:927] Time spent T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:02:41.851114  6582 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:42.069475  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:42.069950  6582 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:42.070910  1733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3646) took 1602 ms. Trace:
I20260709 13:02:42.072175  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:41.986663  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 48738.3us
W20260709 13:02:41.955262  6688 log.cc:927] Time spent T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:02:41.907227  6435 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:42.024111  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:41.997641  6677 consensus_queue.cc:237] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:42.027063  6694 log.cc:927] Time spent T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
W20260709 13:02:42.030143  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.035925  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:42.036680  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:42.037433  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:42.099421  1662 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:42.038308  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:42.100455  1666 raft_consensus.cc:2393] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 16: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:42.039686  1663 raft_consensus.cc:2410] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:02:42.040184  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:42.102063  1658 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 20.
I20260709 13:02:41.905210  6364 consensus_queue.cc:1048] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:02:42.004330  6674 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:42.023639  6464 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:42.063094  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:42.063611  6685 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:42.021378  6539 raft_consensus.cc:740] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:42.066476  6668 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.071286  1733 rpcz_store.cc:276] 0709 13:02:40.468148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.482875 (+ 14727us) service_pool.cc:224] Handling call
0709 13:02:40.483212 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:40.483579 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:40.483606 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:40.490384 (+  6778us) log.cc:844] Serialized 26 byte log entry
0709 13:02:41.524276 (+1033892us) spinlock_profiling.cc:243] Waited 1.68 ms on lock 0x7b180045c1c0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7de84e07 00007f1b86cdfab9 00007f1b7dea169b 00007f1b7de9f93f 00007f1b7dea1c02 00007f1b80b2920b 00007f1b80b2ed23 00007f1b80b2f0d1 00007f1b80f4aa0f
0709 13:02:41.676600 (+152324us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:41.676642 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:41.676709 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:42.070613 (+393904us) raft_consensus.cc:1685] finished
0709 13:02:42.070638 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:42.070848 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":699,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":13650,"spinlock_wait_cycles":3855104,"thread_start_us":152145,"threads_started":1,"wal-append.queue_time_us":1274795}
I20260709 13:02:42.006778  1735 raft_consensus.cc:1275] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:02:42.082559  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 263884us
I20260709 13:02:42.113760  1707 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:42.097792  1660 raft_consensus.cc:2393] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 17: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:42.099509  1664 raft_consensus.cc:2368] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 13. Current term is 14.
I20260709 13:02:42.058583  6292 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:42.098171  2424 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:42.106902  1555 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:42.109429  2550 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 11.
I20260709 13:02:42.115737  1707 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:02:42.119272  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 43589.1us
I20260709 13:02:42.123413  1707 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:42.131102  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:42.131196  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:42.132063  1735 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:42.136461  1666 raft_consensus.cc:1275] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:02:42.140882  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 325716us
I20260709 13:02:42.142015  1738 raft_consensus.cc:1275] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:42.142613  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:42.145364  1732 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:02:42.147437  1707 leader_election.cc:400] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 8. Current term is 9.
I20260709 13:02:42.118294  6582 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.118544  6651 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:42.150488  6553 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:42.160043  6464 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:42.160200  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:42.173352  1737 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 11.
I20260709 13:02:42.174528  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:42.175276  1737 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
I20260709 13:02:42.161875  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:42.124279  6654 raft_consensus.cc:2764] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:02:42.169426  1662 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
W20260709 13:02:42.142966  6669 consensus_meta.cc:287] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.547s	user 0.011s	sys 0.003s
I20260709 13:02:42.123845  6685 raft_consensus.cc:2804] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:42.177626  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:42.123998  6668 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:42.182757  6553 raft_consensus.cc:697] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 12 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:42.169904  6582 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:42.190310  6553 consensus_queue.cc:237] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:42.191432  6582 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:42.192453  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.183588  1737 raft_consensus.cc:2393] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 11: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:42.173410  6539 consensus_queue.cc:260] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:42.192847  6669 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:42.193562  6539 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:42.195308  6669 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:42.196190  1741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43686 (request call id 2464) took 1269 ms. Trace:
I20260709 13:02:42.182839  6685 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.197386  6685 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:42.171244  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:42.203256  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.170250  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:42.205025  1732 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
I20260709 13:02:42.206722  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:42.195215  6674 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:42.179071  1735 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
W20260709 13:02:42.217439  1633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.196557  1741 rpcz_store.cc:276] 0709 13:02:40.926480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.930684 (+  4204us) service_pool.cc:224] Handling call
0709 13:02:40.944541 (+ 13857us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:40.957762 (+ 13221us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:41.200784 (+243022us) log.cc:844] Serialized 14 byte log entry
0709 13:02:41.523872 (+323088us) spinlock_profiling.cc:243] Waited 96.2 ms on lock 0x7b4800120858. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b85eb8aa1 00007f1b85eafb37 00007f1b85eaf9ca 00007f1b85fa726f 00007f1b85fa6f37 00007f1b85fbb55c 00007f1b85fbb508 00007f1b85fbb488 00007f1b85fbb443 00007f1b85fba6ec 00007f1b84ee4a96
0709 13:02:41.527415 (+  3543us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:41.527914 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 13:02:41.528034 (+   120us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:41.528073 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:41.528137 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:42.194255 (+666118us) spinlock_profiling.cc:243] Waited 5.64 ms on lock 0x7b2400250868. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7dd289c4 00007f1b7dd26acb 00007f1b7dee1dc9 00007f1b7dee1a55 00007f1b7dee0fb0 00007f1b80b57488 00007f1b80b57be8 00007f1b80b2f398 00007f1b80b2a76a 00007f1b80b29bb6
0709 13:02:42.195963 (+  1708us) raft_consensus.cc:1685] finished
0709 13:02:42.195986 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:42.196127 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12783,"prepare.queue_time_us":243063,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":68,"raft.queue_time_us":13953,"raft.run_cpu_time_us":2987,"raft.run_wall_time_us":571111,"spinlock_wait_cycles":234279040,"thread_start_us":428269,"threads_started":2,"wal-append.queue_time_us":521411}
I20260709 13:02:42.131207  6466 consensus_queue.cc:1048] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:02:42.170198  1707 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:02:42.226370  1633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.231225  1630 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:02:42.230789  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 54640.9us
I20260709 13:02:42.237169  2426 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:02:42.239809  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 69669.6us
I20260709 13:02:42.240710  1707 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:02:42.219022  6626 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.918s	user 0.004s	sys 0.013s
I20260709 13:02:42.188918  6668 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:42.247902  1556 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:02:42.220868  6675 consensus_meta.cc:287] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.570s	user 0.012s	sys 0.000s
I20260709 13:02:42.174304  6569 consensus_queue.cc:1048] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 13:02:42.229851  6625 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:02:42.248637  6626 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.964s	user 0.005s	sys 0.013s
W20260709 13:02:42.265204  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 158400us
I20260709 13:02:42.243536  6445 raft_consensus.cc:2749] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:42.247728  6654 raft_consensus.cc:2764] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:02:42.258631  6651 raft_consensus.cc:2804] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:42.230253  6674 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:42.330709  1633 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
W20260709 13:02:42.332039  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 211833us
W20260709 13:02:42.325027  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 45103.8us
I20260709 13:02:42.259409  1707 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:42.337476  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:42.276463  6668 raft_consensus.cc:2764] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:02:42.255652  6655 consensus_queue.cc:1048] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:02:42.340004  1665 raft_consensus.cc:1275] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:42.381026  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:42.279481  6361 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:42.266836  6599 consensus_queue.cc:1059] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
W20260709 13:02:42.370208  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 110889us
I20260709 13:02:42.369302  1592 raft_consensus.cc:1275] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:02:42.380065  1633 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:42.381953  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:42.382099  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:42.398645  1583 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
I20260709 13:02:42.382813  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:42.384653  1584 raft_consensus.cc:1240] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:02:42.385128  1589 raft_consensus.cc:2393] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 10: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:42.385740  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:42.386819  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:42.389892  6435 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:42.393769  6715 raft_consensus.cc:2804] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:42.397624  1633 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:42.402165  1663 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:42.394006  6709 log.cc:927] Time spent T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:02:42.395069  6553 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:42.414286  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 72063.2us
I20260709 13:02:42.394748  6620 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.328116  6651 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.418913  1707 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:42.436501  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:42.437341  1707 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:42.278529  6669 consensus_queue.cc:1048] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 13:02:42.418157  6668 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:42.418411  6715 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:42.422781  6435 raft_consensus.cc:2764] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:02:42.424908  1633 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
W20260709 13:02:42.429014  6710 log.cc:927] Time spent T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:02:42.434620  1661 raft_consensus.cc:1275] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:42.440539  1662 raft_consensus.cc:1275] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 6. (term mismatch)
I20260709 13:02:42.440081  1663 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
I20260709 13:02:42.443051  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:42.443754  6464 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:42.450057  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.453454  1667 raft_consensus.cc:2410] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:02:42.443907  1707 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:42.435917  6699 log.cc:927] Time spent T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:02:42.451081  1662 pending_rounds.cc:85] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 5
I20260709 13:02:42.465965  1662 pending_rounds.cc:107] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:02:42.466377  1662 raft_consensus.cc:2889] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:42.467191  1633 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:42.472003  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:42.441560  6651 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:42.443709  6654 raft_consensus.cc:2804] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:42.445363  6668 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:42.482052  1556 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:42.482069  1707 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:42.485386  1633 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:42.451336  6715 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:42.468863  6622 raft_consensus.cc:2804] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:42.465212  6464 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
W20260709 13:02:42.491820  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 70133.5us
I20260709 13:02:42.441380  6620 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:42.492913  1707 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:42.455190  6652 consensus_queue.cc:1048] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:02:42.485822  6654 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:42.494634  1633 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:42.509581  1633 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:42.502139  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 270958us
I20260709 13:02:42.493708  6553 raft_consensus.cc:2804] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:42.489697  6435 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:42.488183  6708 raft_consensus.cc:2749] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:42.489303  6668 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:42.494190  6622 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:42.495218  6464 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:42.529867  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 47885.9us
I20260709 13:02:42.499749  6548 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:42.536468  6703 raft_consensus.cc:2804] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:42.543226  6435 raft_consensus.cc:2804] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:42.545953  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:42.546980  6246 consensus_queue.cc:1048] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:42.540726  6622 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:42.536872  6702 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:42.509469  6654 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:42.570626  1740 raft_consensus.cc:1275] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:02:42.574060  1556 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:42.696961  1740 pending_rounds.cc:85] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 5
I20260709 13:02:42.574702  6625 consensus_queue.cc:1048] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:42.578816  6685 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:42.580013  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:42.711781  1734 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:02:42.587175  6651 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:42.588620  6464 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:42.577562  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 314012us
I20260709 13:02:42.611158  1590 raft_consensus.cc:1275] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:42.513197  6553 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.602994  6703 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.662798  6730 raft_consensus.cc:2749] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:42.625834  6360 raft_consensus.cc:3055] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:02:42.674793  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 181990us
I20260709 13:02:42.763692  1707 leader_election.cc:400] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 8. Current term is 9.
I20260709 13:02:42.764051  1707 leader_election.cc:403] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 13:02:42.764317  6726 log.cc:927] Time spent T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
W20260709 13:02:42.672070  6717 log.cc:927] Time spent T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.217s	user 0.001s	sys 0.001s
I20260709 13:02:42.766830  6736 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 8. Current term is 9.
W20260709 13:02:42.683302  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 173825us
I20260709 13:02:42.659394  6731 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:42.697299  1740 pending_rounds.cc:107] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:02:42.770119  1740 raft_consensus.cc:2889] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:42.746578  6553 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:42.697314  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 123323us
I20260709 13:02:42.680809  6674 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:42.743490  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.762379  6360 raft_consensus.cc:740] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:42.782428  6360 consensus_queue.cc:260] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:42.784052  6360 raft_consensus.cc:3060] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:42.784545  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:42.728632  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.758327  1705 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:42.710987  6704 raft_consensus.cc:2804] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:42.755080  6703 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:42.711661  6616 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.805936  1739 raft_consensus.cc:1275] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:42.808053  1739 raft_consensus.cc:1275] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:02:42.808821  1738 raft_consensus.cc:1275] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
W20260709 13:02:42.817757  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.824115  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:42.830943  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:42.832525  1741 raft_consensus.cc:2410] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:02:42.788866  6731 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:42.822822  6714 log.cc:927] Time spent T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.329s	user 0.005s	sys 0.000s
W20260709 13:02:42.843171  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 84977.8us
I20260709 13:02:42.801553  6736 raft_consensus.cc:2749] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:42.835495  1558 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:42.847705  6466 consensus_queue.cc:1048] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:02:42.866394  6732 log.cc:927] Time spent T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:02:42.870229  6736 consensus_queue.cc:1048] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:42.872011  1733 raft_consensus.cc:1275] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:02:42.875980  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 194598us
W20260709 13:02:42.880980  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 45596.2us
W20260709 13:02:42.884210  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.825131  6704 raft_consensus.cc:697] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:42.816159  6616 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:42.822563  6480 consensus_queue.cc:1048] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:02:42.859104  6620 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:42.939615  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 194935us
I20260709 13:02:42.900811  6626 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:02:42.922668  6697 log.cc:927] Time spent T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
W20260709 13:02:43.007617  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 60069.6us
W20260709 13:02:43.011083  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 56117.3us
W20260709 13:02:43.013288  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 244308us
I20260709 13:02:43.015435  1633 leader_election.cc:400] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 election: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 14. Current term is 15.
I20260709 13:02:43.016199  1633 leader_election.cc:403] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:02:42.876633  6730 consensus_queue.cc:1059] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.112s
I20260709 13:02:42.860481  6731 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:42.947417  6435 raft_consensus.cc:697] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 17 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:43.033859  1633 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:42.988230  6626 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:43.036350  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 166440us
I20260709 13:02:43.038872  1705 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:43.054826  1705 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:43.082958  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:43.084400  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:43.086170  1705 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:43.048007  6626 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:43.092451  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 58673.6us
I20260709 13:02:43.094336  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:43.050787  6708 raft_consensus.cc:2749] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:43.099858  1589 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:43.041868  6751 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 14. Current term is 15.
I20260709 13:02:43.095888  6651 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:43.139470  6706 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:43.140319  6706 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:43.116847  6669 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.143651  1633 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:43.117568  6674 raft_consensus.cc:3055] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:43.153116  1633 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:43.154461  1633 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:43.141903  6669 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:43.156574  1589 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
I20260709 13:02:43.166754  1633 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:43.042806  6704 consensus_queue.cc:237] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:43.169059  1707 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:43.145486  6708 raft_consensus.cc:2749] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:43.152040  6674 raft_consensus.cc:740] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:43.170352  6751 raft_consensus.cc:2804] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:43.195942  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:02:43.199164  6739 log.cc:927] Time spent T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.057s	user 0.001s	sys 0.001s
I20260709 13:02:43.200325  6742 consensus_queue.cc:1048] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.150s
I20260709 13:02:43.173828  6730 raft_consensus.cc:2804] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:43.204501  6708 raft_consensus.cc:2804] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:02:43.206292  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.170867  6750 raft_consensus.cc:2804] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:43.208765  1732 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
W20260709 13:02:43.194128  6539 consensus_meta.cc:287] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 1.000s	user 0.010s	sys 0.007s
I20260709 13:02:43.243626  1736 raft_consensus.cc:1275] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:02:43.244139  1736 pending_rounds.cc:85] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 7
I20260709 13:02:43.244422  1736 pending_rounds.cc:107] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:02:43.244848  1736 raft_consensus.cc:2889] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:43.195611  6753 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:43.251035  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 164939us
I20260709 13:02:43.208485  6751 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:43.253672  1705 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:43.230944  6730 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.264575  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:43.301920  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:43.305305  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 51712.8us
I20260709 13:02:43.307636  1705 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:43.314013  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:43.182488  6435 consensus_queue.cc:237] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:43.328591  1555 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:43.232173  6703 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:43.332517  1705 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:43.266121  6730 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:43.339229  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.257308  6747 raft_consensus.cc:2804] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:43.273447  6706 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:43.264138  6751 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:43.341758  1705 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:43.301381  6708 raft_consensus.cc:697] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 11 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
W20260709 13:02:43.337111  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 163778us
W20260709 13:02:43.363376  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.322753  6753 raft_consensus.cc:2749] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:43.377051  1633 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:43.336302  6719 raft_consensus.cc:2749] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:43.338392  6616 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:43.352876  6743 raft_consensus.cc:2804] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:43.342466  6539 raft_consensus.cc:2749] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:43.352900  6747 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:43.393555  1705 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:43.354323  6731 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:43.379942  6750 raft_consensus.cc:697] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 8 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:43.410118  1705 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:43.386265  6651 raft_consensus.cc:2749] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:43.429701  6651 raft_consensus.cc:3060] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:43.434044  6760 log.cc:927] Time spent T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 13:02:43.436949  6703 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:43.440099  6762 log.cc:927] Time spent T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:02:43.412735  1633 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:43.413280  1705 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:02:43.428850  6761 log.cc:927] Time spent T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:02:43.393005  6753 raft_consensus.cc:2749] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:43.451853  1705 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:43.467432  1705 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:43.459025  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:43.471146  1661 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:43.397917  6747 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:43.370457  6674 consensus_queue.cc:260] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:43.485613  6772 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:43.444993  6539 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:43.478072  6703 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:43.493201  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 80568.2us
I20260709 13:02:43.494244  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:43.520910  1633 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:43.520918  1732 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 11.
I20260709 13:02:43.505597  1737 raft_consensus.cc:1275] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:43.440310  6731 consensus_queue.cc:1059] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
W20260709 13:02:43.513827  6622 consensus_meta.cc:287] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.785s	user 0.007s	sys 0.012s
I20260709 13:02:43.538604  1661 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 12.
I20260709 13:02:43.537313  6622 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:43.543706  1735 raft_consensus.cc:1275] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:02:43.441797  6750 consensus_queue.cc:237] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:43.515944  6759 log.cc:927] Time spent T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.291s	user 0.000s	sys 0.002s
I20260709 13:02:43.516713  6753 raft_consensus.cc:2749] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:43.511611  6669 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:43.580348  6674 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:43.581118  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 52199.7us
W20260709 13:02:43.587149  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:43.587180  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 66373.3us
W20260709 13:02:43.590493  6754 log.cc:927] Time spent T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.382s	user 0.002s	sys 0.000s
I20260709 13:02:43.592660  1664 raft_consensus.cc:1240] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 12. Current term is 13. Ops: []
W20260709 13:02:43.569819  6715 consensus_meta.cc:287] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 1.073s	user 0.014s	sys 0.009s
I20260709 13:02:43.596823  6539 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.599277  6539 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:43.601490  6703 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.602160  6703 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:43.605248  6772 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:43.608413  6745 raft_consensus.cc:3055] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:43.608883  6745 raft_consensus.cc:740] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:43.609745  6745 consensus_queue.cc:260] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:43.479463  6708 consensus_queue.cc:237] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:43.610844  6763 raft_consensus.cc:2749] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:43.611243  6745 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:43.611887  6775 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:43.592957  6721 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.610167  6622 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:43.614799  6721 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:43.592720  6748 consensus_queue.cc:1048] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:02:43.610283  1736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3677) took 1614 ms. Trace:
I20260709 13:02:43.619673  1736 rpcz_store.cc:276] 0709 13:02:41.995470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.997865 (+  2395us) service_pool.cc:224] Handling call
0709 13:02:42.077754 (+ 79889us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:43.245900 (+1168146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.610069 (+364169us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400441e54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:43.610220 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2680113536}
I20260709 13:02:43.621531  6721 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:43.594996  6553 consensus_meta.cc:287] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.824s	user 0.014s	sys 0.000s
I20260709 13:02:43.632472  6651 raft_consensus.cc:2749] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:43.628926  6622 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:43.633455  6622 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:43.635882  6622 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:43.629961  6703 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:43.627846  6715 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:43.638825  6715 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:43.639667  1665 raft_consensus.cc:1240] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 10. Current term is 11. Ops: []
W20260709 13:02:43.641294  6668 consensus_meta.cc:287] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 1.041s	user 0.019s	sys 0.000s
I20260709 13:02:43.641986  6668 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:43.597539  1633 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:43.645998  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 48611.2us
W20260709 13:02:43.649217  6758 log.cc:927] Time spent T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.254s	user 0.000s	sys 0.002s
W20260709 13:02:43.650413  6740 log.cc:927] Time spent T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.803s	user 0.007s	sys 0.007s
I20260709 13:02:43.652050  1585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46836 (request call id 657) took 1545 ms. Trace:
I20260709 13:02:43.652475  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:43.652424  1585 rpcz_store.cc:276] 0709 13:02:42.106497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.107526 (+  1029us) service_pool.cc:224] Handling call
0709 13:02:42.124966 (+ 17440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:42.324846 (+199880us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:42.324907 (+    61us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:42.582874 (+257967us) spinlock_profiling.cc:243] Waited 6.64 ms on lock 0x7b2c00000658. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7f888a11 00007f1b7f898372 00007f1b80fcaa01 00007f1b80f8f43a 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2
0709 13:02:42.583583 (+   709us) log.cc:844] Serialized 26 byte log entry
0709 13:02:42.820751 (+237168us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:42.820804 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.821493 (+   689us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:43.649695 (+828202us) spinlock_profiling.cc:243] Waited 4.72 ms on lock 0x7b4400022b4c. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7ddc8c85 00007f1b7ddc96a2 00007f1b80b3b1db 00007f1b80b36aaf 00007f1b80b2a86e 00007f1b80b29bb6 00007f1b80b297d8 00007f1b80b33221 00007f1b80b331d9 00007f1b80b33169
0709 13:02:43.651772 (+  2077us) raft_consensus.cc:1685] finished
0709 13:02:43.651799 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:43.651966 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2292,"raft.queue_time_us":63491,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":116,"spinlock_wait_cycles":26128384,"thread_start_us":425011,"threads_started":2,"wal-append.queue_time_us":262023}
W20260709 13:02:43.654524  6755 log.cc:927] Time spent T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.203s	user 0.003s	sys 0.000s
I20260709 13:02:43.657109  1658 raft_consensus.cc:1275] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:02:43.657625  1658 pending_rounds.cc:85] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 6
I20260709 13:02:43.657898  1658 pending_rounds.cc:107] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:02:43.662994  1658 raft_consensus.cc:2889] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:43.672384  1633 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:02:43.672837  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 503880us
I20260709 13:02:43.674494  1633 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:43.685776  1667 raft_consensus.cc:1240] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:43.697695  1633 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:43.699549  1633 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:43.670095  6435 raft_consensus.cc:2749] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:43.706959  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.683882  6715 raft_consensus.cc:2749] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:43.712729  1633 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:43.632892  6553 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:43.681805  6753 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
W20260709 13:02:43.713781  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 165321us
I20260709 13:02:43.727931  1633 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:02:43.794632  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 66803.8us
I20260709 13:02:43.712229  6743 raft_consensus.cc:697] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 16 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:43.713104  6622 raft_consensus.cc:2749] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:43.801388  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 70668.8us
I20260709 13:02:43.827976  1660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3714) took 1492 ms. Trace:
I20260709 13:02:43.833650  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:43.801529  1633 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:43.825539  6539 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:43.807303  6360 consensus_meta.cc:287] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 1.023s	user 0.015s	sys 0.002s
I20260709 13:02:43.845467  1660 rpcz_store.cc:276] 0709 13:02:42.335812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.336017 (+   205us) service_pool.cc:224] Handling call
0709 13:02:42.336293 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:42.336493 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:02:42.465794 (+129301us) log.cc:844] Serialized 14 byte log entry
0709 13:02:43.827505 (+1361711us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b18002a89e0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b80b374bc 00007f1b7de8548b 00007f1b86cdfab9 00007f1b7dea169b 00007f1b7de9f93f 00007f1b7de9f455 00007f1b80f87060 00007f1b80f99716 00007f1b80faa287
0709 13:02:43.827631 (+   126us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:43.827679 (+    48us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:43.827723 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.827792 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:43.827913 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27074,"prepare.queue_time_us":55762,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":153056,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":15955,"spinlock_wait_cycles":40406272,"thread_start_us":426700,"threads_started":3,"wal-append.queue_time_us":232731}
W20260709 13:02:43.839593  6654 consensus_meta.cc:287] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 1.092s	user 0.022s	sys 0.002s
I20260709 13:02:43.795567  6782 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:43.798427  6776 raft_consensus.cc:2749] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:43.807374  6553 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:43.797353  6771 raft_consensus.cc:2804] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:43.822301  6464 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:43.822867  6685 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 12 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:43.797480  6735 raft_consensus.cc:2749] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:43.862164  6659 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.797013  6779 raft_consensus.cc:2749] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:43.870186  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 68727.9us
I20260709 13:02:43.792685  6753 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:43.807703  6751 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:43.807678  6772 consensus_queue.cc:1048] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 13:02:43.911727  1633 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:43.813522  6743 consensus_queue.cc:237] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:43.928102  1666 raft_consensus.cc:1240] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 11. Current term is 12. Ops: []
W20260709 13:02:43.916447  6626 consensus_meta.cc:287] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.800s	user 0.015s	sys 0.001s
I20260709 13:02:43.922254  2426 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:43.893678  6771 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.889032  6780 raft_consensus.cc:2749] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:43.882019  6654 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:43.942358  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:43.953330  1739 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 11.
I20260709 13:02:43.959450  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:43.959808  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:43.941632  6562 raft_consensus.cc:2804] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:43.886475  6782 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:43.918002  6464 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.964449  1738 raft_consensus.cc:1240] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:43.965946  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:43.980533  1741 raft_consensus.cc:1240] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:43.970011  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:43.970767  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:43.977849  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:44.001865  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:44.002066  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:43.957890  6779 raft_consensus.cc:2749] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:44.011715  6782 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:44.002907  6464 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:44.014134  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:44.015550  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:44.015930  6464 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:44.016774  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:44.018838  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:43.954361  6683 consensus_queue.cc:1048] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:02:44.019658  1664 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:43.979120  6562 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.021337  6562 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:43.965255  6668 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:43.963032  6466 consensus_queue.cc:1048] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 13:02:44.026526  6751 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:43.918850  6659 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:44.031410  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:44.032858  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:44.034153  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:44.034801  1662 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12.
I20260709 13:02:44.035553  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:44.037379  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:44.039052  2553 raft_consensus.cc:2393] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 10: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:02:44.039069  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:43.946883  6771 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:43.975021  6730 consensus_meta.cc:287] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.602s	user 0.013s	sys 0.001s
I20260709 13:02:44.044685  1660 raft_consensus.cc:1275] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:02:44.045406  1660 pending_rounds.cc:85] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 6
I20260709 13:02:44.046169  1660 pending_rounds.cc:107] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:02:44.046578  1660 raft_consensus.cc:2889] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:44.051515  1633 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:43.940819  6626 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:44.062625  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:44.069617  1633 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:44.057926  1664 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12.
I20260709 13:02:44.045034  6785 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:44.079257  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:44.081565  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:44.063551  6753 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:44.091738  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:44.049373  6730 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:44.078369  6786 raft_consensus.cc:2804] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:44.078639  6751 raft_consensus.cc:2749] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:44.098749  6659 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:44.099547  6654 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:44.089067  6785 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:44.065901  6360 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:44.102727  1735 raft_consensus.cc:1275] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:02:44.106596  6791 consensus_queue.cc:1059] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:02:44.108342  6747 consensus_meta.cc:287] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.561s	user 0.014s	sys 0.002s
I20260709 13:02:44.110401  6626 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:44.122854  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:44.165877  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:44.146430  1662 raft_consensus.cc:2393] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 11: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:44.125005  1666 raft_consensus.cc:1275] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:02:44.121567  2424 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:02:44.169255  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 47815.3us
I20260709 13:02:44.082964  6787 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:44.173710  6787 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:44.169358  6659 raft_consensus.cc:2804] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:44.166832  1664 raft_consensus.cc:2410] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 17 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:02:44.184505  6659 raft_consensus.cc:697] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:44.186338  6659 consensus_queue.cc:237] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:44.198422  6787 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:44.211364  1664 raft_consensus.cc:1240] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:44.113595  6786 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:44.211809  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 50369.4us
I20260709 13:02:44.213032  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:44.146528  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 239134us
W20260709 13:02:44.223837  1705 leader_election.cc:336] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.741s (SENT)
W20260709 13:02:44.210801  6737 log.cc:927] Time spent T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:02:44.225509  1705 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:44.140748  6721 consensus_queue.cc:1048] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:02:44.143544  6364 consensus_queue.cc:1048] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 13:02:44.250540  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:44.254417  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:44.255851  1664 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 18.
I20260709 13:02:44.257702  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:44.259613  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:44.263247  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.266742  1590 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 10.
W20260709 13:02:44.270718  1705 leader_election.cc:336] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.756s (SENT)
I20260709 13:02:44.271216  1705 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:02:44.272332  1705 leader_election.cc:336] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.948s (SENT)
W20260709 13:02:44.273209  1705 leader_election.cc:336] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.977s (SENT)
I20260709 13:02:44.208667  6674 consensus_queue.cc:1048] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:02:44.229554  6786 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:44.275158  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:44.277748  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:44.290228  1663 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:44.279680  1659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3718) took 1938 ms. Trace:
W20260709 13:02:44.283610  1705 leader_election.cc:336] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.983s (SENT)
I20260709 13:02:44.291666  1705 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:44.213892  6360 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:44.237205  6654 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:44.293270  1705 leader_election.cc:336] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.102s (SENT)
I20260709 13:02:44.293530  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:44.347858  1739 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:02:44.291513  1659 rpcz_store.cc:276] 0709 13:02:42.340849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.341172 (+   323us) service_pool.cc:224] Handling call
0709 13:02:42.341453 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:42.493191 (+151738us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:42.493244 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:42.499383 (+  6139us) log.cc:844] Serialized 26 byte log entry
0709 13:02:42.684733 (+185350us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:42.728472 (+ 43739us) log.cc:844] Serialized 14 byte log entry
0709 13:02:42.943163 (+214691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.943418 (+   255us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:43.629533 (+686115us) spinlock_profiling.cc:243] Waited 4.88 ms on lock 0x7b180032c740. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7dea23f3 00007f1b7dea47c1 00007f1b7dea4779 00007f1b7dea4709 00007f1b7dea46d1 00007f1b7dea39cd 000000000038f354 000000000038f199 00007f1b7de8583a
0709 13:02:43.811738 (+182205us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b180032c740. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7dea2557 00007f1b7dea47c1 00007f1b7dea4779 00007f1b7dea4709 00007f1b7dea46d1 00007f1b7dea39cd 000000000038f354 000000000038f199 00007f1b7de8583a
0709 13:02:44.071356 (+259618us) spinlock_profiling.cc:243] Waited 5.73 ms on lock 0x7b180032c740. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7de702a6 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7dea23f3 00007f1b7dea47c1
0709 13:02:44.279143 (+207787us) raft_consensus.cc:1685] finished
0709 13:02:44.279175 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:44.279586 (+   411us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27434,"prepare.queue_time_us":52740,"prepare.run_cpu_time_us":926,"prepare.run_wall_time_us":7387,"raft.queue_time_us":164066,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":3895,"spinlock_wait_cycles":55403264,"thread_start_us":461347,"threads_started":3,"wal-append.queue_time_us":260835}
W20260709 13:02:44.357300  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 64053us
W20260709 13:02:44.358525  1705 leader_election.cc:336] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.112s (SENT)
I20260709 13:02:44.359021  1705 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:02:44.361646  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 67877.2us
I20260709 13:02:44.362795  2426 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:02:44.368901  1705 leader_election.cc:336] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.156s (SENT)
W20260709 13:02:44.369908  1705 leader_election.cc:336] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.240s (SENT)
I20260709 13:02:44.370291  1705 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:44.373605  1663 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:02:44.350308  6730 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:44.372885  6782 raft_consensus.cc:2749] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:44.387135  6680 raft_consensus.cc:2804] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:44.404937  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:44.410018  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 186790us
I20260709 13:02:44.390080  6360 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:44.302811  6795 log.cc:927] Time spent T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:02:44.305378  6793 log.cc:927] Time spent T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:02:44.306965  1732 raft_consensus.cc:1240] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:44.397850  6680 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.277711  6464 raft_consensus.cc:2749] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:44.309409  6743 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.270861  6791 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.312490  1738 raft_consensus.cc:1275] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:44.208498  6747 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:44.446427  6745 consensus_queue.cc:1059] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:02:44.451920  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:44.327193  2523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd"
dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:33568
W20260709 13:02:44.336663  6740 log.cc:927] Time spent T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:02:44.269556  6712 consensus_queue.cc:1048] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 13:02:44.339299  1667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3738) took 1411 ms. Trace:
I20260709 13:02:44.341796  6785 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:44.344252  6751 raft_consensus.cc:3055] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:44.344038  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:44.273254  6753 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.475842  1738 raft_consensus.cc:1275] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:02:44.410467  1705 leader_election.cc:336] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.303s (SENT)
I20260709 13:02:44.292603  6553 raft_consensus.cc:2749] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:44.444643  6680 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:44.301265  1664 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12.
I20260709 13:02:44.420277  1558 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:44.428233  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:44.402930  6562 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:44.398499  6674 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:44.447403  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:44.487413  1733 raft_consensus.cc:2393] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 11: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:44.403585  6702 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.441781  6582 consensus_queue.cc:1048] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:02:44.450098  6743 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:44.450955  6791 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:44.452700  1658 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:44.453115  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:44.453855  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:44.455293  1587 raft_consensus.cc:1240] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:44.456034  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:44.460917  2523 raft_consensus.cc:606] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:44.461920  1667 rpcz_store.cc:276] 0709 13:02:42.928351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.928592 (+   241us) service_pool.cc:224] Handling call
0709 13:02:42.989118 (+ 60526us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:43.686770 (+697652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.339050 (+652280us) spinlock_profiling.cc:243] Waited 696 ms on lock 0x7b54002fbf54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:44.339227 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1601594624}
I20260709 13:02:44.479280  1705 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:44.414983  6788 raft_consensus.cc:2749] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:44.427762  6734 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:44.446877  6787 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.483318  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:44.428819  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:44.485229  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 65046.5us
I20260709 13:02:44.471576  6751 raft_consensus.cc:740] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:44.486474  6745 consensus_queue.cc:1048] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:02:44.499825  6360 raft_consensus.cc:2749] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:44.509323  1665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3742) took 1413 ms. Trace:
I20260709 13:02:44.477876  6730 consensus_queue.cc:1048] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:02:44.515067  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:44.534824  1592 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:44.502126  1583 raft_consensus.cc:1275] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:44.481010  6753 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:44.547058  1558 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:44.532780  1665 rpcz_store.cc:276] 0709 13:02:43.095720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.643849 (+548129us) service_pool.cc:224] Handling call
0709 13:02:43.644257 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:43.673535 (+ 29278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:43.673580 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:43.674188 (+   608us) log.cc:844] Serialized 26 byte log entry
0709 13:02:43.962931 (+288743us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:43.962973 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.963040 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:44.509047 (+546007us) raft_consensus.cc:1685] finished
0709 13:02:44.509069 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:44.509257 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5444,"raft.queue_time_us":16191,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":13405,"thread_start_us":288265,"threads_started":1,"wal-append.queue_time_us":405958}
W20260709 13:02:44.537074  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 126634us
I20260709 13:02:44.532438  6734 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:44.529194  6787 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:44.500567  6674 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:44.494030  6702 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:44.568349  1705 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:44.576843  6774 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:44.578927  6774 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:44.552657  6246 consensus_queue.cc:1059] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:02:44.586941  1705 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:44.549928  6782 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:44.595737  1589 raft_consensus.cc:1240] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:44.595814  1705 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:02:44.574059  6771 consensus_meta.cc:287] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.522s	user 0.013s	sys 0.001s
I20260709 13:02:44.566828  6730 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:44.600019  1705 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:44.620371  1705 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:44.584676  6807 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:44.601531  6785 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:44.585069  6747 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:44.641233  6819 consensus_queue.cc:1048] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:44.588975  6788 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:44.601945  6553 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:44.650105  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 97990.5us
W20260709 13:02:44.650075  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 86969us
I20260709 13:02:44.534128  6751 consensus_queue.cc:260] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:44.680846  1739 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 12.
I20260709 13:02:44.629626  6464 raft_consensus.cc:2749] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:44.629360  6708 raft_consensus.cc:2804] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:02:44.758332  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 195881us
W20260709 13:02:44.759306  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 133733us
I20260709 13:02:44.618837  6771 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:44.654804  6807 consensus_queue.cc:1059] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.146s
I20260709 13:02:44.624300  6730 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:44.808494  6812 log.cc:927] Time spent T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:02:44.811625  1588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46836 (request call id 667) took 2001 ms. Trace:
I20260709 13:02:44.848007  1588 rpcz_store.cc:276] 0709 13:02:42.809776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.810451 (+   675us) service_pool.cc:224] Handling call
0709 13:02:42.830872 (+ 20421us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:42.895592 (+ 64720us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:42.895644 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:43.843555 (+947911us) spinlock_profiling.cc:243] Waited 5.21 ms on lock 0x7b18003b65c0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7de702a6 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7f888a11 00007f1b7f898372 00007f1b80fcaa01 00007f1b80f8f43a
0709 13:02:44.345011 (+501456us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b2c00000658. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7f888a11 00007f1b7f898372 00007f1b80fcaa01 00007f1b80f8f43a 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2
0709 13:02:44.346189 (+  1178us) log.cc:844] Serialized 52 byte log entry
0709 13:02:44.524322 (+178133us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:44.524392 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.524479 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:44.811256 (+286777us) raft_consensus.cc:1685] finished
0709 13:02:44.811308 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:44.811517 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19434,"raft.queue_time_us":44920,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":17077,"spinlock_wait_cycles":37097216,"thread_start_us":177586,"threads_started":1,"wal-append.queue_time_us":298000}
I20260709 13:02:44.813287  6702 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:44.760412  6747 consensus_queue.cc:1059] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:02:44.853931  6747 raft_consensus.cc:3055] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:44.854574  6747 raft_consensus.cc:740] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:44.814641  6774 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:44.815821  6734 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:44.817044  6816 log.cc:927] Time spent T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:02:44.760820  6708 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.861706  6708 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:44.754559  6785 consensus_queue.cc:1048] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:02:44.772749  6813 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.866859  6813 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:44.823877  6674 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:44.873726  6730 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:44.830751  6719 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
W20260709 13:02:44.832970  6806 log.cc:927] Time spent T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.329s	user 0.002s	sys 0.000s
W20260709 13:02:44.842146  6814 log.cc:927] Time spent T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:02:44.826140  6821 consensus_queue.cc:1048] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:44.887094  6813 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:44.888752  6654 consensus_meta.cc:287] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.540s	user 0.015s	sys 0.000s
W20260709 13:02:44.840720  6786 consensus_meta.cc:287] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.512s	user 0.011s	sys 0.000s
I20260709 13:02:44.783238  1660 raft_consensus.cc:1240] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:02:44.795776  1592 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 11.
I20260709 13:02:44.790447  6771 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:44.790251  6753 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:44.772979  1705 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:44.906910  1658 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
I20260709 13:02:44.855846  6747 consensus_queue.cc:260] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:44.893877  1666 raft_consensus.cc:1275] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:02:44.774482  6751 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:44.794157  6803 log.cc:927] Time spent T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
I20260709 13:02:44.920907  6719 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:44.800212  6822 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:44.954437  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 181557us
I20260709 13:02:44.958638  6654 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:02:44.982515  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.967720  1705 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:45.012161  6791 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:45.014287  6743 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:45.017814  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:44.996275  1705 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:44.960963  6712 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:45.023648  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:45.024731  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:45.026885  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:44.925056  6680 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:45.029063  1733 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 12.
W20260709 13:02:45.030655  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 279258us
W20260709 13:02:45.020542  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 364021us
I20260709 13:02:45.023943  1705 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:44.935086  6786 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:45.039311  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:45.020637  6814 log.cc:927] Time spent T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:02:45.039162  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:45.049816  1664 raft_consensus.cc:2368] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 11. Current term is 12.
I20260709 13:02:45.047446  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:45.051576  1735 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 11.
I20260709 13:02:45.029629  1738 raft_consensus.cc:2468] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 9.
I20260709 13:02:45.055610  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:45.056641  1733 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 20.
I20260709 13:02:45.058921  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:45.020995  6747 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:45.069145  1633 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:45.057932  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:45.009228  6827 raft_consensus.cc:2804] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:45.076012  1633 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:45.073093  1558 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:45.076725  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:45.079628  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:45.083662  1733 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 17.
I20260709 13:02:45.034724  6785 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:44.973917  6822 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:45.051395  6654 raft_consensus.cc:2804] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:45.088268  1633 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:45.089574  6827 raft_consensus.cc:697] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 12 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:45.099584  6246 consensus_queue.cc:1059] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:45.099732  1666 raft_consensus.cc:1240] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:02:45.100179  6827 consensus_queue.cc:237] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:45.101832  6246 raft_consensus.cc:2804] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:45.102294  6246 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:45.102703  6246 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:45.111781  6680 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:45.112007  6246 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:45.113458  6668 raft_consensus.cc:2804] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:02:45.082254  6803 log.cc:927] Time spent T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:02:45.073944  6788 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
W20260709 13:02:45.116601  1632 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.075s	sys 0.092s
I20260709 13:02:45.085641  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:45.081316  6825 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:45.114085  6817 log.cc:927] Time spent T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:02:45.114046  6668 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:45.041507  6712 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:45.093205  6743 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:45.091030  6785 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:45.099732  6761 log.cc:927] Time spent T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.883s	user 0.005s	sys 0.003s
I20260709 13:02:45.119246  1741 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 14.
W20260709 13:02:45.119028  1632 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.076s	sys 0.092s
I20260709 13:02:45.092073  6826 raft_consensus.cc:2804] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:45.131968  1705 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:45.097741  6654 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:45.138154  1734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43686 (request call id 2474) took 1183 ms. Trace:
I20260709 13:02:45.132912  6668 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:45.133342  6743 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.155280  1734 rpcz_store.cc:276] 0709 13:02:43.954917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.955072 (+   155us) service_pool.cc:224] Handling call
0709 13:02:43.977132 (+ 22060us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:43.977584 (+   452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:43.977624 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:44.002685 (+ 25061us) log.cc:844] Serialized 26 byte log entry
0709 13:02:44.409603 (+406918us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:44.450994 (+ 41391us) log.cc:844] Serialized 14 byte log entry
0709 13:02:44.451212 (+   218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.451291 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:45.137921 (+686630us) raft_consensus.cc:1685] finished
0709 13:02:45.137947 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:45.138087 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":41647,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":1966,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":41296,"thread_start_us":365208,"threads_started":1,"wal-append.queue_time_us":458790}
I20260709 13:02:45.163100  1705 leader_election.cc:400] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Vote denied by peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683) with higher term. Message: Invalid argument: T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 11. Current term is 12.
I20260709 13:02:45.155432  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:45.163527  1705 leader_election.cc:403] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:45.163821  1741 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 9.
I20260709 13:02:45.165607  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:45.142021  6819 raft_consensus.cc:3055] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:45.142215  6785 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:45.146898  6829 consensus_queue.cc:1048] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:02:45.144974  6826 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:45.178216  6824 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:45.178949  6824 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:45.181197  6826 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:45.184803  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:45.158706  6246 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:45.188333  6822 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:45.123308  6788 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:45.168870  6830 raft_consensus.cc:2749] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:45.190773  6788 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:45.191205  6791 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:45.192240  6791 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:45.192831  6708 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:45.159037  6654 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:45.190619  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:45.185060  6786 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:45.198802  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 111974us
I20260709 13:02:45.167088  6743 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:45.169811  6819 raft_consensus.cc:740] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:45.215487  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:45.226023  2523 raft_consensus.cc:2393] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 12: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:02:45.225827  6819 consensus_queue.cc:260] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:45.226658  6654 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:45.227475  6819 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:45.230502  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:45.231863  6787 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:45.234241  6712 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:45.131249  6825 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:45.236639  6825 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:45.236842  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:45.237980  6791 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:45.239830  1660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 2907) took 1240 ms. Trace:
I20260709 13:02:45.240363  1660 rpcz_store.cc:276] 0709 13:02:43.999538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.049060 (+ 49522us) service_pool.cc:224] Handling call
0709 13:02:44.049504 (+   444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:44.934812 (+885308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.239512 (+304700us) spinlock_profiling.cc:243] Waited 733 ms on lock 0x7b540041d7d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:45.239755 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1686813056}
I20260709 13:02:45.171283  6553 raft_consensus.cc:2749] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683) with higher term. Message: Invalid argument: T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 11. Current term is 12.
I20260709 13:02:45.209638  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:45.244395  1666 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12.
I20260709 13:02:45.245877  6708 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:45.201066  6824 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:45.173224  6782 consensus_queue.cc:1059] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:02:45.210691  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:45.252548  1732 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:45.254488  1633 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:45.205605  6719 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:45.239714  6787 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:45.260118  6787 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:45.255430  1633 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:45.261566  6791 raft_consensus.cc:2804] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:45.261986  6791 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.262315  6791 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:45.265172  6824 raft_consensus.cc:2804] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:45.265723  1633 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:45.265797  6824 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:45.266477  6824 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:45.274690  6562 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 12 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:45.277057  6721 raft_consensus.cc:3055] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:45.277640  6721 raft_consensus.cc:740] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:45.278525  6721 consensus_queue.cc:260] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:45.280332  6721 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:45.256209  6753 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:45.251834  6782 raft_consensus.cc:3055] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:45.282580  6782 raft_consensus.cc:740] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:45.283918  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:45.284870  1741 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 11.
I20260709 13:02:45.286808  6822 raft_consensus.cc:2804] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:45.287273  6822 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:45.287657  6822 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:45.289832  1633 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:45.245914  1705 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:45.256601  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:45.291316  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 45675.1us
I20260709 13:02:45.293422  1737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35672 (request call id 645) took 1050 ms. Trace:
I20260709 13:02:45.293843  1737 rpcz_store.cc:276] 0709 13:02:44.243495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.253571 (+ 10076us) service_pool.cc:224] Handling call
0709 13:02:44.253918 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:44.254301 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:44.254327 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:44.274784 (+ 20457us) log.cc:844] Serialized 26 byte log entry
0709 13:02:44.553989 (+279205us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:44.636787 (+ 82798us) log.cc:844] Serialized 14 byte log entry
0709 13:02:45.254813 (+618026us) spinlock_profiling.cc:243] Waited 5.86 ms on lock 0x7b18002b7800. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b80b374bc 00007f1b7de8548b 00007f1b86cdfab9 00007f1b7dea169b 00007f1b7de9f93f 00007f1b7de9f455 00007f1b80f87060 00007f1b80f99716 00007f1b80faa287
0709 13:02:45.254942 (+   129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.255023 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:45.255135 (+   112us) raft_consensus.cc:1685] finished
0709 13:02:45.293091 (+ 37956us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:45.293356 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":82655,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":134454,"raft.run_cpu_time_us":343,"raft.run_wall_time_us":20160,"spinlock_wait_cycles":13480192,"thread_start_us":435468,"threads_started":3,"wal-append.queue_time_us":344516}
W20260709 13:02:45.211381  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 122446us
I20260709 13:02:45.301931  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:45.305197  1737 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16.
I20260709 13:02:45.306080  1633 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:45.309273  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:45.309900  1660 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:45.312479  1732 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 12.
I20260709 13:02:45.313530  1737 raft_consensus.cc:1240] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 12 LEADER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:45.315099  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:45.319944  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:45.316463  1633 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
W20260709 13:02:45.321348  1658 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 2904) took 1334 ms (client timeout 1704 ms). Trace:
I20260709 13:02:45.321686  1665 raft_consensus.cc:1275] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:02:45.321780  1658 rpcz_store.cc:269] 0709 13:02:43.987139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.001822 (+ 14683us) service_pool.cc:224] Handling call
0709 13:02:45.321140 (+1319318us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b54002e6dd4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:45.321278 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1034396416}
I20260709 13:02:45.322480  1732 raft_consensus.cc:1275] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:02:45.328785  6810 log.cc:927] Time spent T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.681s	user 0.001s	sys 0.001s
I20260709 13:02:45.333657  6785 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:45.336306  1740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35672 (request call id 649) took 1091 ms. Trace:
I20260709 13:02:45.315323  6818 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:45.336685  1740 rpcz_store.cc:276] 0709 13:02:44.244946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.245183 (+   237us) service_pool.cc:224] Handling call
0709 13:02:44.245606 (+   423us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:44.246019 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:44.246044 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:44.246853 (+   809us) log.cc:844] Serialized 52 byte log entry
0709 13:02:44.474177 (+227324us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:44.489025 (+ 14848us) log.cc:844] Serialized 14 byte log entry
0709 13:02:44.500287 (+ 11262us) log.cc:844] Serialized 14 byte log entry
0709 13:02:44.500485 (+   198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.500568 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:45.328154 (+827586us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b4400022b4c. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7ddc8c85 00007f1b7ddc96a2 00007f1b80b3b1db 00007f1b80b36aaf 00007f1b80b2a86e 00007f1b80b29bb6 00007f1b80b297d8 00007f1b80b33221 00007f1b80b331d9 00007f1b80b33169
0709 13:02:45.336081 (+  7927us) raft_consensus.cc:1685] finished
0709 13:02:45.336108 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:45.336246 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":458,"prepare.queue_time_us":16216,"raft.queue_time_us":1762,"raft.run_cpu_time_us":461,"raft.run_wall_time_us":17396,"spinlock_wait_cycles":13491328,"thread_start_us":226982,"threads_started":1,"wal-append.queue_time_us":337206}
I20260709 13:02:45.344120  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:45.345429  1586 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:45.331519  6826 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:45.347404  1664 raft_consensus.cc:2393] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 13: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:45.315203  6464 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:45.349629  6464 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:45.352264  6553 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:45.352921  6553 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:45.353880  1738 raft_consensus.cc:1275] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:02:45.360016  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:45.367038  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:45.369546  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 64904.7us
I20260709 13:02:45.299328  6654 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:45.374413  1741 raft_consensus.cc:1240] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:02:45.315836  6730 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.302135  6708 raft_consensus.cc:2804] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:02:45.397068  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 82626.8us
I20260709 13:02:45.358976  6751 raft_consensus.cc:2804] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:45.298264  6782 consensus_queue.cc:260] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:45.402428  1586 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 11.
I20260709 13:02:45.404857  1556 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:45.360010  6785 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:45.436300  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:02:45.408540  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.449816  6708 raft_consensus.cc:697] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 12 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
W20260709 13:02:45.451074  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 46328.3us
I20260709 13:02:45.352339  6826 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:45.452639  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:45.455307  1739 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:02:45.453025  1741 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:45.404011  6620 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:45.407712  6734 raft_consensus.cc:2804] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:45.453555  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:45.458813  6719 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:45.360922  6824 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:45.442406  6751 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.393322  6829 consensus_queue.cc:1048] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:02:45.468456  1737 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:02:45.498317  1663 raft_consensus.cc:1240] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:45.500253  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:45.513124  1661 raft_consensus.cc:2468] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:02:45.494710  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:45.515043  1666 raft_consensus.cc:2468] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:02:45.497723  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:45.407974  6820 consensus_queue.cc:1059] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:02:45.523151  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:45.520103  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 54424.9us
I20260709 13:02:45.526648  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:45.527897  1741 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 12.
I20260709 13:02:45.528966  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:45.531356  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:45.531988  1741 raft_consensus.cc:2468] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 8.
I20260709 13:02:45.535483  1663 raft_consensus.cc:2393] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 16: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:45.535812  1741 raft_consensus.cc:1275] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:45.537596  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:45.538633  1666 raft_consensus.cc:2410] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:02:45.538853  6553 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:45.510001  6751 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:45.541445  6702 raft_consensus.cc:3055] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:45.541889  6702 raft_consensus.cc:740] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:45.517887  6785 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:45.542872  6702 consensus_queue.cc:260] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:45.543423  6785 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:45.543727  2426 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:45.544217  6702 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:45.445645  6788 consensus_queue.cc:1059] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 13:02:45.548822  1739 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 11.
I20260709 13:02:45.551437  1741 raft_consensus.cc:1240] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:02:45.553481  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:45.553923  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:45.555956  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:45.556823  1591 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 20.
I20260709 13:02:45.557981  1583 raft_consensus.cc:2368] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 10. Current term is 11.
I20260709 13:02:45.560928  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:45.561688  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:45.562731  1591 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:45.563673  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:45.564131  1733 raft_consensus.cc:1240] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:45.564647  1737 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:45.566537  1586 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:02:45.567400  1586 raft_consensus.cc:606] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:45.567834  1586 raft_consensus.cc:614] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:45.510282  6826 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:45.560708  6553 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:45.520753  6734 raft_consensus.cc:697] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 12 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:45.468120  6616 consensus_queue.cc:1059] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 13:02:45.579983  1588 raft_consensus.cc:1275] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:45.456260  6730 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:45.522028  6654 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:45.503238  6620 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:45.586695  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:45.587409  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:45.587994  1592 raft_consensus.cc:1275] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:02:45.558049  6719 raft_consensus.cc:697] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:45.589541  6683 raft_consensus.cc:2804] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:45.589831  6785 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:45.593422  6246 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.593669  6821 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:45.595431  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:45.575279  1658 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:02:45.602537  6464 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:45.604056  6616 raft_consensus.cc:3055] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:45.605748  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:45.606469  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:45.646224  6616 raft_consensus.cc:740] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:45.585901  6553 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:45.610908  6847 log.cc:927] Time spent T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:02:45.612447  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:45.618275  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:45.618288  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:45.619535  1737 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 13.
I20260709 13:02:45.621824  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:45.489614  6708 consensus_queue.cc:237] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:45.627301  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:45.628965  1633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.653913  1590 raft_consensus.cc:2393] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 12: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:45.617455  6713 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.655419  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:45.740492  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:45.718502  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 174833us
I20260709 13:02:45.584756  6826 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:45.743402  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:45.750744  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:45.751878  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:45.756448  1660 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 13.
I20260709 13:02:45.648123  6616 consensus_queue.cc:260] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:45.767568  1662 raft_consensus.cc:1240] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:02:45.768595  1590 raft_consensus.cc:1275] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:45.653409  6683 raft_consensus.cc:697] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:45.774148  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:45.779304  1583 raft_consensus.cc:2368] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 10. Current term is 11.
I20260709 13:02:45.615607  6654 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:45.777303  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:45.781308  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:45.787281  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:45.789779  1588 raft_consensus.cc:2393] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 11: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:45.791430  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:45.641363  6743 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:45.795533  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:45.804414  1588 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:45.801324  2426 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:45.749737  6464 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:45.651432  6246 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:45.808663  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:45.743010  6713 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:45.816931  1556 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:45.804494  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:45.811851  6445 raft_consensus.cc:2804] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:45.828169  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:45.829561  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:45.777034  6788 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:45.839823  1556 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:45.840404  1659 raft_consensus.cc:2376] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11. Re-sending same reply.
I20260709 13:02:45.654685  6821 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:45.850972  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 60297.8us
I20260709 13:02:45.852030  6833 raft_consensus.cc:2804] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:45.852221  6683 consensus_queue.cc:237] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:45.815296  6616 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:45.886176  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:45.888226  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:45.875909  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:45.917984  1659 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 13.
W20260709 13:02:45.890626  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 50948.5us
I20260709 13:02:45.919052  1586 raft_consensus.cc:2410] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
W20260709 13:02:45.884248  6847 log.cc:927] Time spent T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:02:45.892141  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:45.895440  1558 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:45.896333  6553 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:45.818528  6582 consensus_queue.cc:1048] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.089s
W20260709 13:02:45.896881  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 45081.2us
W20260709 13:02:45.897468  6843 log.cc:927] Time spent T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.278s	user 0.001s	sys 0.000s
I20260709 13:02:45.898406  6832 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:45.899152  6445 raft_consensus.cc:697] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
W20260709 13:02:45.900054  6848 log.cc:927] Time spent T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:02:45.778069  6734 consensus_queue.cc:237] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:45.836658  6464 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:45.901121  6854 consensus_queue.cc:1048] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:45.817559  6719 consensus_queue.cc:237] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:45.902570  6360 raft_consensus.cc:2804] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:45.903293  1584 raft_consensus.cc:2393] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 12: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:45.871233  1591 raft_consensus.cc:2410] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:02:45.920099  1556 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:45.919133  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:45.870054  1705 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:45.929164  1558 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:45.953230  1585 raft_consensus.cc:1240] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:45.954125  1558 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:45.931969  1659 raft_consensus.cc:1275] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:45.960664  1733 raft_consensus.cc:1240] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:02:45.927384  6824 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:45.889225  6747 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:45.837020  6839 consensus_queue.cc:1059] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 13:02:45.914242  6833 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.837565  6711 consensus_queue.cc:1048] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:02:45.935717  6840 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:02:45.975685  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 161534us
W20260709 13:02:45.978286  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 108358us
I20260709 13:02:45.883111  6788 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:45.951593  6360 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:45.974754  6730 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:45.977814  6835 raft_consensus.cc:2749] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:46.032418  6360 raft_consensus.cc:3060] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:45.981114  6828 raft_consensus.cc:2749] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:45.972338  6625 consensus_queue.cc:1048] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:02:45.987661  6840 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.992063  6824 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:45.947578  6832 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:46.046867  6620 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:45.961395  6751 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:45.982532  6833 raft_consensus.cc:3060] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:46.045608  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:46.061898  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.047221  6582 raft_consensus.cc:2749] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:46.041586  6819 consensus_meta.cc:287] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.811s	user 0.013s	sys 0.000s
I20260709 13:02:46.043501  6862 raft_consensus.cc:3055] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:02:46.043062  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 84500.7us
I20260709 13:02:45.984261  6747 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:46.086123  6668 consensus_meta.cc:287] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.918s	user 0.010s	sys 0.004s
I20260709 13:02:46.087129  6821 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:46.086728  6668 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:46.087352  6747 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:46.088217  1663 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12.
I20260709 13:02:46.090006  6668 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:46.060964  6840 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:46.088212  1664 raft_consensus.cc:1240] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:46.082010  1589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2365) took 1677 ms. Trace:
W20260709 13:02:46.068611  6791 consensus_meta.cc:287] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.806s	user 0.014s	sys 0.002s
I20260709 13:02:46.151190  1588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:02:46.154323  1588 raft_consensus.cc:606] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:46.154716  1588 raft_consensus.cc:614] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:46.095505  1589 rpcz_store.cc:276] 0709 13:02:44.405389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.405526 (+   137us) service_pool.cc:224] Handling call
0709 13:02:44.406161 (+   635us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:44.596234 (+190073us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.081624 (+1485390us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b54002b1954. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:46.081933 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":430830976}
W20260709 13:02:46.155256  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 201226us
I20260709 13:02:46.156853  1665 raft_consensus.cc:2393] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 in current term 12: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:46.036558  6246 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:46.064523  6868 raft_consensus.cc:2804] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:46.140964  6862 raft_consensus.cc:740] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
W20260709 13:02:46.154891  1633 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.644s (SENT) [suppressed 20 similar messages]
I20260709 13:02:46.172384  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:46.172828  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:46.042367  6445 consensus_queue.cc:237] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:46.067281  6824 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:46.156606  6743 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 21 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:46.179687  6868 raft_consensus.cc:697] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 13 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
W20260709 13:02:46.182149  6822 consensus_meta.cc:287] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.894s	user 0.010s	sys 0.006s
W20260709 13:02:46.179703  6860 log.cc:927] Time spent T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 13:02:46.159204  6791 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:46.207605  1558 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:02:46.206760  6721 consensus_meta.cc:287] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.926s	user 0.011s	sys 0.006s
I20260709 13:02:46.227581  1588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:02:46.240880  1588 raft_consensus.cc:606] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:46.241382  1588 raft_consensus.cc:614] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:46.238297  1558 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:46.250555  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:46.212013  6743 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.192449  6582 consensus_queue.cc:1048] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
W20260709 13:02:46.232517  6702 consensus_meta.cc:287] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.673s	user 0.009s	sys 0.004s
I20260709 13:02:46.220593  6877 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:46.269670  1592 raft_consensus.cc:2410] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:02:46.268390  1558 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:46.213577  6822 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:46.274129  1558 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:46.278544  6702 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:46.279289  6819 consensus_queue.cc:1059] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:46.250517  6881 raft_consensus.cc:2804] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:46.253069  6788 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:46.242482  6786 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:46.272946  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 118076us
I20260709 13:02:46.267323  6839 raft_consensus.cc:2749] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:46.225171  6874 consensus_queue.cc:1059] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:02:46.299592  1667 raft_consensus.cc:1240] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:46.294260  1633 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:46.306038  1588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:02:46.306787  1588 raft_consensus.cc:606] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:46.258244  6743 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:46.276961  6875 raft_consensus.cc:2749] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:46.312225  6751 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:46.300726  6786 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:46.318519  1633 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:46.319615  6745 raft_consensus.cc:2804] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:46.320204  6745 raft_consensus.cc:697] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 13 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:46.320528  6873 raft_consensus.cc:2749] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:46.321755  6745 consensus_queue.cc:237] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:46.324054  6654 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:46.326931  1633 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:46.334743  6822 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:46.338104  6743 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:46.273329  6878 consensus_queue.cc:1059] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.078s
I20260709 13:02:46.345899  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:46.357869  6868 consensus_queue.cc:237] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:46.267045  6862 consensus_queue.cc:260] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:46.395061  6862 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:46.395278  6833 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:46.283528  6877 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:46.399341  6791 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:46.400522  6877 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:46.267750  6721 consensus_queue.cc:1059] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:02:46.286864  6881 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.402446  1588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:02:46.403209  1588 raft_consensus.cc:606] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:46.403661  1588 raft_consensus.cc:614] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:02:46.386838  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 59981us
I20260709 13:02:46.361615  6824 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:46.391418  1661 raft_consensus.cc:1240] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 12 LEADER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:46.406666  1633 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:46.415066  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:46.416531  1587 raft_consensus.cc:1240] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:46.389221  6743 raft_consensus.cc:2749] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:46.414260  1633 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:46.420527   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:02:46.425000  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:46.431465  1633 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:46.433450  1633 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:46.441951  1633 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:46.408689  6881 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:46.420908  6877 raft_consensus.cc:2749] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:46.434475  6822 raft_consensus.cc:2749] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:46.444984  6743 raft_consensus.cc:2749] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:46.497171  6833 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:46.446992  6828 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:46.506852  1633 leader_election.cc:400] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 10. Current term is 11.
I20260709 13:02:46.507524  1633 leader_election.cc:403] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:02:46.475090  6873 raft_consensus.cc:2804] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:02:46.460857  6859 log.cc:927] Time spent T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.560s	user 0.003s	sys 0.003s
I20260709 13:02:46.434353  6824 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:46.447355  6734 consensus_queue.cc:1048] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:02:46.521529  1633 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:46.516588  6626 raft_consensus.cc:3055] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:46.481158  6840 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:46.535166  6840 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:46.527194  6626 raft_consensus.cc:740] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:46.526180  1633 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:46.513917  6822 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 10. Current term is 11.
I20260709 13:02:46.539346  6822 raft_consensus.cc:2749] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:46.539067  6626 consensus_queue.cc:260] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:46.529345  6616 consensus_meta.cc:287] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.598s	user 0.014s	sys 0.002s
I20260709 13:02:46.544986  6745 raft_consensus.cc:2749] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:46.554432  6875 raft_consensus.cc:3055] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:46.554970  6875 raft_consensus.cc:740] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:46.557441  1662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3764) took 1058 ms. Trace:
I20260709 13:02:46.557863  1662 rpcz_store.cc:276] 0709 13:02:45.499161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.501065 (+  1904us) service_pool.cc:224] Handling call
0709 13:02:45.759335 (+258270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:45.768164 (+  8829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.557229 (+789065us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b540019dcd0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8e8ad 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:46.557372 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":592950656}
I20260709 13:02:46.558518  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:46.558782  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:46.559499  1586 raft_consensus.cc:2393] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 17: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:46.560506  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:46.564096  1705 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:46.559882  6719 raft_consensus.cc:3055] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:46.565325  6719 raft_consensus.cc:740] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:46.565582  6753 raft_consensus.cc:2804] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:46.565939  6829 raft_consensus.cc:3055] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:46.566605  6753 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:46.567087  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:46.567400  6753 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:46.519129  6873 raft_consensus.cc:697] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:46.540155  6626 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:46.575533  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:46.584336  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:46.578372  6880 log.cc:927] Time spent T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.411s	user 0.002s	sys 0.000s
I20260709 13:02:46.567179  6829 raft_consensus.cc:740] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:46.511363  6828 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:46.566643  6719 consensus_queue.cc:260] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:46.596431  6719 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:46.597750  6829 consensus_queue.cc:260] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:46.599977  6829 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:46.517056  6360 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:46.585182  1659 raft_consensus.cc:2393] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 11: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:46.516882  6743 consensus_queue.cc:1048] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:02:46.584698  1662 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15.
I20260709 13:02:46.605316  6360 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:46.606618  1662 raft_consensus.cc:1240] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:02:46.518602  6791 consensus_queue.cc:1048] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:02:46.609490  1659 raft_consensus.cc:1275] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:02:46.606642  1705 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:46.555866  6875 consensus_queue.cc:260] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:46.613543  6708 consensus_queue.cc:1048] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:46.595489  6828 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:46.613862  6875 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:46.594404  6881 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:46.614565  6873 consensus_queue.cc:237] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:46.617671  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.622681  6881 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:46.654419  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:46.655172  1732 raft_consensus.cc:3060] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:46.670096  6674 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.672151  6674 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:46.674815  6674 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:46.657593  6868 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:46.683427  1732 raft_consensus.cc:2468] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:02:46.684825  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:46.686547  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:46.687183  1732 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:46.687268  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:46.688304  1589 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:02:46.690377  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:46.691164  1659 raft_consensus.cc:2410] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:02:46.691829  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:46.692095  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:46.693485  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:46.657326  6719 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.695079  1732 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 21.
I20260709 13:02:46.695487  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:46.696223  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:46.694416  1588 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
I20260709 13:02:46.681934  6868 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:46.697283  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:46.697430  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:46.698016  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:46.700075  1732 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 16.
I20260709 13:02:46.700208  1588 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 13.
I20260709 13:02:46.701715  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:46.702280  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:46.702874  1732 raft_consensus.cc:2393] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 12: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:02:46.704974  1659 raft_consensus.cc:1240] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:46.683612  6870 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:46.698848  1707 connection.cc:256] RPC call timeout handler was delayed by -1.2207541170000127s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1824s for a response
I20260709 13:02:46.692020  6674 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.708431  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:46.722409  1659 raft_consensus.cc:3060] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:46.710168  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:46.683477  6753 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:46.700695  6719 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:46.712453  6673 raft_consensus.cc:993] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6: : Instructing follower 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:02:46.720469  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:46.720757  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:46.732060  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:46.737121  1732 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:46.751271  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.786170  6862 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:46.734512  6828 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:46.786973  6862 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:46.788177  6828 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:46.742717  6820 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.789912  6820 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:46.790556  6862 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:46.790738  6828 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:46.791947  6820 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:46.730119  6876 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:46.792536  6719 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:46.740470  6445 raft_consensus.cc:1081] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 LEADER]: Signalling peer 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:02:46.792671  6876 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:46.730844  6626 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:46.794394  6626 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:46.721292  6870 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:46.797842  6870 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:46.803893  2553 raft_consensus.cc:2468] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:02:46.807056  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:46.821926  1659 raft_consensus.cc:2468] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:02:46.734180  6674 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:46.795033  6876 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:46.796818  6626 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:46.874944  1732 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
I20260709 13:02:46.875684  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:46.879856  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:46.916939  1659 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:46.917297  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 208085us
W20260709 13:02:46.918116  1707 connection.cc:256] RPC call timeout handler was delayed by -1.0453245799999991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16240000000000002s for a response
I20260709 13:02:46.919257  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:46.920449  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:46.924456  1666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3770) took 1352 ms. Trace:
W20260709 13:02:46.928078  1558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:46.881425  6896 log.cc:927] Time spent T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
W20260709 13:02:46.927001  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 155684us
I20260709 13:02:46.932543  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:46.934130  1732 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 12.
I20260709 13:02:46.880272  6753 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:46.864457  6862 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:46.925945  1666 rpcz_store.cc:276] 0709 13:02:45.572497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.572700 (+   203us) service_pool.cc:224] Handling call
0709 13:02:45.573188 (+   488us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:45.793942 (+220754us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:45.793977 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:45.794018 (+    41us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:45.794055 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.924173 (+1130118us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b540030af54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:46.924246 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.924389 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":507171584}
I20260709 13:02:46.877424  6674 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:46.878065  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:46.919278  6708 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:46.940975  1556 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:46.949604  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:46.950829  1556 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:46.952363  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:46.952009  1556 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:46.958333  6868 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:46.959245  6868 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:46.933465  6878 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:46.960505  6878 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:46.960935  6713 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:46.955987  6821 raft_consensus.cc:2804] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:46.956146  6708 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:46.955730  6820 consensus_queue.cc:1059] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:02:46.969066  1664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3757) took 1475 ms. Trace:
I20260709 13:02:46.973599  1664 rpcz_store.cc:276] 0709 13:02:45.493534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.494499 (+   965us) service_pool.cc:224] Handling call
0709 13:02:45.494795 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.094194 (+599399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.968823 (+874629us) spinlock_profiling.cc:243] Waited 593 ms on lock 0x7b54002701d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:46.968999 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1364232576}
I20260709 13:02:46.974979  1662 raft_consensus.cc:1240] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:02:46.975477  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:46.976352  1664 raft_consensus.cc:1240] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:46.981050  1663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 2927) took 1190 ms. Trace:
I20260709 13:02:46.982511  1663 rpcz_store.cc:276] 0709 13:02:45.790240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.882459 (+ 92219us) service_pool.cc:224] Handling call
0709 13:02:46.980685 (+1098226us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b5400358ed4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:46.980879 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":391046016}
I20260709 13:02:46.946982  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:46.970065  1661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3766) took 1456 ms. Trace:
I20260709 13:02:46.984383  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:46.985018  1661 rpcz_store.cc:276] 0709 13:02:45.513561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.514004 (+   443us) service_pool.cc:224] Handling call
0709 13:02:45.514410 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.406034 (+891624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.969830 (+563796us) spinlock_profiling.cc:243] Waited 877 ms on lock 0x7b54000a78d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:46.970003 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2016399744}
I20260709 13:02:46.981536  1736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43686 (request call id 2489) took 1965 ms. Trace:
I20260709 13:02:46.969956  6708 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:46.986650  1736 rpcz_store.cc:276] 0709 13:02:45.015864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.019160 (+  3296us) service_pool.cc:224] Handling call
0709 13:02:45.019574 (+   414us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:02:45.020139 (+   565us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:45.020172 (+    33us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:02:45.026540 (+  6368us) log.cc:844] Serialized 78 byte log entry
0709 13:02:46.340329 (+1313789us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b180045c940. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7de84e07 00007f1b86cdfab9 00007f1b7dea169b 00007f1b7de9f93f 00007f1b7dea1c02 00007f1b80b2920b 00007f1b80b2ed23 00007f1b80b2f0d1 00007f1b80f4aa0f
0709 13:02:46.444225 (+103896us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:46.965312 (+521087us) log.cc:844] Serialized 14 byte log entry
0709 13:02:46.980578 (+ 15266us) log.cc:844] Serialized 14 byte log entry
0709 13:02:46.980936 (+   358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.981068 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:46.981238 (+   170us) raft_consensus.cc:1685] finished
0709 13:02:46.981258 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.981456 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":532907,"prepare.queue_time_us":533156,"raft.queue_time_us":14255,"raft.run_cpu_time_us":455,"raft.run_wall_time_us":41212,"spinlock_wait_cycles":12265984,"thread_start_us":103658,"threads_started":1,"wal-append.queue_time_us":1425135}
I20260709 13:02:46.997820  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:47.000643  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:47.004009  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:47.005502  1586 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 12.
I20260709 13:02:47.007941  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:47.008656  1585 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:46.954006  6829 raft_consensus.cc:2749] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:47.010727  1664 raft_consensus.cc:1240] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 13 LEADER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:47.009914  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:47.010659  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:47.012529  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:46.987991  6626 raft_consensus.cc:2749] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:46.981143  6654 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:47.019444  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:47.039729  1736 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 12.
I20260709 13:02:46.952733  6862 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:47.003849  6630 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.004878  6719 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
W20260709 13:02:47.051656  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.017715  6713 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.054796  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:47.055413  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:47.057292  1737 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 12.
I20260709 13:02:47.057359  1736 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:46.997916  6868 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:47.058332  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:47.055271  6708 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:47.065035  6708 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:47.045802  6654 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:47.065492  6878 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:47.078974  6864 log.cc:927] Time spent T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 1.176s	user 0.003s	sys 0.000s
I20260709 13:02:47.084565  1732 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:47.086993  1665 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58814 (request call id 809) took 1465 ms (client timeout 1736 ms). Trace:
I20260709 13:02:47.053570  6630 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:47.090142  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:02:47.091073  1660 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 2923) took 1434 ms (client timeout 1686 ms). Trace:
W20260709 13:02:47.091431  1660 rpcz_store.cc:269] 0709 13:02:45.730951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.089853 (+1358902us) service_pool.cc:224] Handling call
0709 13:02:47.091005 (+  1152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:47.091971  1555 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:47.092739  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:47.093057  6878 raft_consensus.cc:2804] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:47.093581  6878 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:47.094029  6878 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:47.095788  6845 log.cc:927] Time spent T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 1.638s	user 0.000s	sys 0.011s
I20260709 13:02:47.060452  6713 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:47.070628  6841 log.cc:927] Time spent T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 1.604s	user 0.005s	sys 0.029s
I20260709 13:02:47.099999  6713 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:47.104385  1584 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 3026) took 1505 ms (client timeout 1987 ms). Trace:
I20260709 13:02:47.083129  6862 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:47.105413  1732 raft_consensus.cc:2468] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
W20260709 13:02:47.100852  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.107963  6708 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:47.108620  6708 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:47.111498  1736 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:02:47.090353  6630 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:47.114229  6853 log.cc:927] Time spent T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 1.215s	user 0.006s	sys 0.000s
I20260709 13:02:47.114594  6445 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:47.020676  6702 raft_consensus.cc:3055] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:02:47.104838  1584 rpcz_store.cc:269] 0709 13:02:45.599307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.627009 (+ 27702us) service_pool.cc:224] Handling call
0709 13:02:47.104137 (+1477128us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b54002b7ad4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:47.104291 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":547398912}
I20260709 13:02:46.998342  6821 raft_consensus.cc:697] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:47.060905  1585 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 21.
I20260709 13:02:47.029366  1659 raft_consensus.cc:2410] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 17 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:02:47.119313  1736 raft_consensus.cc:1240] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 13 LEADER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:02:47.144733  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:47.055634  6719 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:47.087566  1665 rpcz_store.cc:269] 0709 13:02:45.621446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.621593 (+   147us) service_pool.cc:224] Handling call
0709 13:02:47.086772 (+1465179us) spinlock_profiling.cc:243] Waited 501 ms on lock 0x7b54000a82d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:47.086936 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1152879488}
I20260709 13:02:47.086273  6868 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:47.030416  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:47.129513  1735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3716) took 1725 ms. Trace:
I20260709 13:02:47.100215  6753 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:47.154947  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:47.133054  1558 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:47.148205  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:47.125149  1633 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:47.083386  6809 raft_consensus.cc:3055] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:47.152035  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:47.129308  6702 raft_consensus.cc:740] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:47.151435  1735 rpcz_store.cc:276] 0709 13:02:45.404189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.404646 (+   457us) service_pool.cc:224] Handling call
0709 13:02:45.405484 (+   838us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:45.414046 (+  8562us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:45.414093 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:45.414742 (+   649us) log.cc:844] Serialized 26 byte log entry
0709 13:02:45.640378 (+225636us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:45.640446 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.640557 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:47.113270 (+1472713us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b4400022b4c. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7ddc8c85 00007f1b7ddc96a2 00007f1b80b3b1db 00007f1b80b36aaf 00007f1b80b2a86e 00007f1b80b29bb6 00007f1b80b297d8 00007f1b80b33221 00007f1b80b331d9 00007f1b80b33169
0709 13:02:47.115778 (+  2508us) raft_consensus.cc:1685] finished
0709 13:02:47.115806 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:47.129416 (+ 13610us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7998,"raft.queue_time_us":9117,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":12277,"spinlock_wait_cycles":43129216,"thread_start_us":174495,"threads_started":1,"wal-append.queue_time_us":372371}
I20260709 13:02:47.161202  1633 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:47.083743  6832 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:47.115810  6445 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:47.182888  1707 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:47.182973  1633 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
W20260709 13:02:47.188707  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 55790.5us
I20260709 13:02:47.189843  1558 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:47.188234  1705 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:47.193496  1739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43686 (request call id 2501) took 1402 ms. Trace:
I20260709 13:02:47.197669  1585 raft_consensus.cc:1275] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:47.193971  1739 rpcz_store.cc:276] 0709 13:02:45.791103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.791259 (+   156us) service_pool.cc:224] Handling call
0709 13:02:45.791553 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:45.791771 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:45.836397 (+ 44626us) log.cc:844] Serialized 14 byte log entry
0709 13:02:46.964115 (+1127718us) log.cc:844] Serialized 14 byte log entry
0709 13:02:47.193114 (+228999us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:47.193172 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:47.193219 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:47.193287 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:47.193432 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1058064,"prepare.queue_time_us":1087922,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":97,"raft.queue_time_us":111298,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":9756,"thread_start_us":309210,"threads_started":2,"wal-append.queue_time_us":220395}
I20260709 13:02:47.131776  6872 consensus_queue.cc:1048] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:02:47.201875  1558 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:47.208563  1735 raft_consensus.cc:1275] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:47.209616  1736 raft_consensus.cc:1240] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:02:47.213057  1707 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:47.181097  6873 raft_consensus.cc:2749] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:47.163185  6809 raft_consensus.cc:740] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:47.192958  6870 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:47.223670  1735 raft_consensus.cc:1275] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:02:47.219412  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.192771  6582 raft_consensus.cc:2749] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:47.222278  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:47.116086  6708 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:47.235049  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.236152  1707 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:47.202906  6901 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:47.237462  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 89449.4us
I20260709 13:02:47.181246  6753 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:47.249897  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 66994.7us
I20260709 13:02:47.250118  1558 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:02:47.256335  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 68179.2us
I20260709 13:02:47.226643  6904 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:47.251732  1633 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:47.266732  1707 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:47.234396  6873 raft_consensus.cc:2764] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:02:47.243463  6828 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:47.235219  6870 raft_consensus.cc:697] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 21 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:47.244377  6900 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:47.196910  6821 consensus_queue.cc:237] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:47.281082  6616 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:47.250252  6901 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:47.286937  6616 raft_consensus.cc:697] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:47.230684  6702 consensus_queue.cc:260] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:47.289737  6907 log.cc:927] Time spent T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:02:47.256763  6906 raft_consensus.cc:2804] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:47.251585  6887 consensus_queue.cc:1059] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:02:47.269598  6903 raft_consensus.cc:2749] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:47.297487  6903 raft_consensus.cc:2749] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:47.298441  6903 raft_consensus.cc:2749] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:47.251956  6829 consensus_queue.cc:1059] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:02:47.278545  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:47.296627  6702 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:47.302775  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 52732.2us
W20260709 13:02:47.314426  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 62755.1us
I20260709 13:02:47.293553  6906 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:47.315584  1707 leader_election.cc:400] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 10. Current term is 11.
I20260709 13:02:47.315806  1633 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:47.295485  6616 consensus_queue.cc:237] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:47.318226  6906 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:47.318773  1633 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:47.317703  1707 leader_election.cc:403] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:47.326606  1707 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:47.302583  6910 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:47.303176  6903 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:47.331151  1558 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
W20260709 13:02:47.332408  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 46985.5us
I20260709 13:02:47.274150  6809 consensus_queue.cc:260] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:47.334270  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:47.291105  6900 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:47.335440  6917 raft_consensus.cc:2749] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:47.327174  6870 consensus_queue.cc:237] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:47.337445  6900 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:47.338452  6915 raft_consensus.cc:2804] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:47.339038  6915 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:47.324539  6901 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:47.339448  6915 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:47.340471  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.319666  6708 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:47.332442  6910 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.344885  1707 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:47.353994  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.319988  6719 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:47.318899  6913 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:47.355777  1707 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:47.316231  6914 consensus_queue.cc:1048] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:02:47.330411  6868 raft_consensus.cc:2749] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 10. Current term is 11.
I20260709 13:02:47.348958  6832 consensus_queue.cc:1059] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:02:47.334197  6445 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:47.364687  6832 consensus_queue.cc:1243] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Peer 5bb87fe07da2414e84ee578c3b176ede log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:02:47.365398  6868 consensus_queue.cc:1059] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:47.366425  6868 consensus_queue.cc:1243] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Peer 6d4de2ce0683442498244b9529127f91 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:02:47.362421  6901 raft_consensus.cc:2804] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:47.367151  6901 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:47.367559  6901 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:47.367894  1707 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:47.370602  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 51907us
I20260709 13:02:47.372200  1707 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:47.350292  6829 raft_consensus.cc:2804] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:47.374830  1707 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:47.361411  6708 raft_consensus.cc:2749] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:47.393549  1707 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:47.357205  6910 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:47.398056  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:47.401616  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:47.401782  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:47.403275  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:47.370359  6782 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:47.405383  1586 raft_consensus.cc:2393] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 10: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:47.409946  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:47.411157  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:47.411662  1591 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 13.
I20260709 13:02:47.412305  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:47.402551  1583 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 13.
I20260709 13:02:47.366816  6913 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:47.391450  6830 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:47.413447  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:47.414059  6920 raft_consensus.cc:2804] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:47.414544  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:47.414824  6920 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.415202  1583 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12.
I20260709 13:02:47.415427  6920 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:47.416157  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:47.421412  6787 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:47.422873  6873 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:47.423520  6873 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:47.389395  6868 raft_consensus.cc:2804] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:47.425588  6868 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
W20260709 13:02:47.427621  1592 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 3020) took 1833 ms (client timeout 1824 ms). Trace:
I20260709 13:02:47.410594  1584 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
W20260709 13:02:47.428428  1592 rpcz_store.cc:269] 0709 13:02:45.593884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.617882 (+ 23998us) service_pool.cc:224] Handling call
0709 13:02:47.427378 (+1809496us) spinlock_profiling.cc:243] Waited 616 ms on lock 0x7b5400391cd4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:47.427549 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1417621376}
I20260709 13:02:47.431994  1583 raft_consensus.cc:1275] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:02:47.432395  1583 pending_rounds.cc:85] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91: Aborting all ops after (but not including) 8
I20260709 13:02:47.342621  6903 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:47.433153  1583 pending_rounds.cc:107] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:02:47.435132  1583 raft_consensus.cc:2889] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:47.405435  6829 raft_consensus.cc:697] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:47.442207  6829 consensus_queue.cc:237] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:47.443558  6826 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:47.447147  6858 log.cc:927] Time spent T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 1.548s	user 0.005s	sys 0.003s
I20260709 13:02:47.415452  6913 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:47.407550  6900 raft_consensus.cc:2749] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:47.396062  6911 raft_consensus.cc:2804] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:47.426084  6868 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:47.431632  6719 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:47.457049  6719 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:47.458827  6903 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:47.460793  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:47.461236  6878 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:47.464051  6464 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:47.466779  6713 raft_consensus.cc:2749] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:47.468146  6771 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:47.468609  6809 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:47.468853  6771 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:47.484514  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:47.486920  1739 raft_consensus.cc:1240] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:02:47.491084  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:47.493602  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:47.494470  1739 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:02:47.495558  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:47.496308  1739 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:02:47.485280  1740 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:02:47.497762  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:47.498404  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:47.498610  1737 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
W20260709 13:02:47.499487  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 127900us
I20260709 13:02:47.499608  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:47.500365  1737 raft_consensus.cc:2468] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 7.
I20260709 13:02:47.501528  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:47.453330  6911 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:47.502794  1737 raft_consensus.cc:2410] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:02:47.504598  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:47.520407  1588 raft_consensus.cc:1240] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:47.509811  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:47.505309  1735 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:02:47.517067  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:47.508018  6911 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:47.510835  6771 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:47.490772  6901 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:47.600785  1734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35672 (request call id 664) took 1836 ms. Trace:
I20260709 13:02:47.606235  1734 rpcz_store.cc:276] 0709 13:02:45.764119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.764277 (+   158us) service_pool.cc:224] Handling call
0709 13:02:45.783791 (+ 19514us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.048514 (+264723us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:46.048563 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:46.048623 (+    60us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:46.048667 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:47.531172 (+1482505us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b5400184f54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:47.600473 (+ 69301us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:47.600675 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":608115456}
I20260709 13:02:47.597965  6903 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.523068  6870 consensus_queue.cc:1048] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.081s
W20260709 13:02:47.623413  1658 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39146 (request call id 3760) took 2122 ms (client timeout 2149 ms). Trace:
W20260709 13:02:47.623925  1658 rpcz_store.cc:269] 0709 13:02:45.497174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.497398 (+   224us) service_pool.cc:224] Handling call
0709 13:02:47.619084 (+2121686us) spinlock_profiling.cc:243] Waited 59 ms on lock 0x7b540041c3d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:47.619237 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":135768320}
I20260709 13:02:47.633850  1734 raft_consensus.cc:1240] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:47.619110  6925 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:47.633734  6873 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:47.628338  6910 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:47.632863  6903 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:47.663869  6903 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:47.637223  6915 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:47.650121  6771 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.644606  6906 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:47.655471  6712 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:47.657729  6873 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:47.651834  6925 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:47.684556  6712 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:47.685742  6833 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.686352  6833 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:47.687400  6910 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:47.688001  6712 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:47.676858  6771 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:47.689467  6833 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:47.689956  6923 log.cc:927] Time spent T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:02:47.691015  6771 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:47.693301  6906 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:47.695097  6654 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:47.697264  6922 log.cc:927] Time spent T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:02:47.697547  6901 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:47.674428  6878 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:47.720144  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 78918.5us
I20260709 13:02:47.702330  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:47.717131  6826 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.734629  1732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43686 (request call id 2506) took 1145 ms. Trace:
I20260709 13:02:47.735134  1732 rpcz_store.cc:276] 0709 13:02:46.589081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.936548 (+347467us) service_pool.cc:224] Handling call
0709 13:02:47.734422 (+797874us) spinlock_profiling.cc:243] Waited 99.8 ms on lock 0x7b54002233d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:47.734550 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":229633920}
I20260709 13:02:47.735766  6786 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:47.736418  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:47.739743  1733 raft_consensus.cc:1240] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:47.757264  1732 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 19.
I20260709 13:02:47.759191  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:47.716791  6873 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:47.768237  6873 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:47.762936  1590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46836 (request call id 701) took 1995 ms. Trace:
I20260709 13:02:47.738016  6826 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:47.769294  1590 rpcz_store.cc:276] 0709 13:02:45.767201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.772060 (+  4859us) service_pool.cc:224] Handling call
0709 13:02:46.342379 (+570319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.342587 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:02:46.406553 (+ 63966us) log.cc:844] Serialized 14 byte log entry
0709 13:02:47.465494 (+1058941us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b180009e4a0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7de1cc0a 00007f1b8755c219 00007f1b7dea4a40 00007f1b7de9f4e4 00007f1b7de9f455 00007f1b849873c7 00007f1b80f999a7 00007f1b80fa90bf 00007f1b80fa9038
0709 13:02:47.465716 (+   222us) log.cc:844] Serialized 14 byte log entry
0709 13:02:47.465941 (+   225us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:47.465993 (+    52us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:47.466421 (+   428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:47.466542 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:47.762502 (+295960us) spinlock_profiling.cc:243] Waited 570 ms on lock 0x7b54003a0550. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8e8ad 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:47.762659 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":957037,"prepare.queue_time_us":1129759,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":1200,"raft.queue_time_us":13032,"raft.run_cpu_time_us":358,"raft.run_wall_time_us":17702,"spinlock_wait_cycles":1313181312,"thread_start_us":162349,"threads_started":2,"wal-append.queue_time_us":155528}
I20260709 13:02:47.771970  6826 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:47.776628  6927 log.cc:927] Time spent T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.143s	user 0.000s	sys 0.002s
I20260709 13:02:47.783667  1585 raft_consensus.cc:1275] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:02:47.787143  6868 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:47.793252  6862 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.793973  6862 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:47.794881  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:47.795496  1738 raft_consensus.cc:2410] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:02:47.817708  1583 raft_consensus.cc:1240] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:47.819249  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 419115us
I20260709 13:02:47.822913  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:47.842649   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:47.847662  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:02:47.848819  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.848966  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:47.849772  1591 raft_consensus.cc:1275] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:02:47.853536  1591 pending_rounds.cc:85] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91: Aborting all ops after (but not including) 6
I20260709 13:02:47.853796  1591 pending_rounds.cc:107] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:02:47.854066  1591 raft_consensus.cc:2889] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:47.854179  1707 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:47.850349  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:47.851011  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:47.851639  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:47.857290  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:47.858053  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:47.864717  1587 raft_consensus.cc:2393] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 in current term 12: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:47.880635  1591 raft_consensus.cc:1240] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:47.791380  6868 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:47.855376  6719 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:47.855792  6919 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:47.909960  6930 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.910452  6921 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:47.910915  6930 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:47.911535  6921 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:47.913228  6849 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:47.913863  6849 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:47.917912  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:47.920102  1583 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12.
I20260709 13:02:47.934361  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:47.935626  1658 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:02:47.937455  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:47.940291  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:47.943163  1659 raft_consensus.cc:2393] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 in current term 12: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:47.945032  1666 raft_consensus.cc:1275] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:47.945261  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:47.946079  1658 raft_consensus.cc:2393] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 13: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:47.946835  1660 raft_consensus.cc:2393] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 13: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:47.947314  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:47.949997  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:47.948257  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:47.951701  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:47.953327  1660 raft_consensus.cc:2393] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 13: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:47.954365  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:47.951329  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:47.954367  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:47.927711  6786 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:47.959530  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:47.930125  6771 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:47.916091  6849 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:47.893844  6919 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:47.961767  1633 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:47.964694  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:47.965291  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:48.249030  1658 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12.
W20260709 13:02:48.254444  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 292612us
I20260709 13:02:48.216568  1589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2401) took 1098 ms. Trace:
W20260709 13:02:48.217222  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.259928  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:48.259991  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:02:48.262503  1489 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55138 (request call id 319) took 19699 ms (client timeout 15000 ms). Trace:
I20260709 13:02:47.965945  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:48.274106  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:48.259859  1488 catalog_manager.cc:5697] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 12 to 13, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 13 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:02:48.284349  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:48.281026  1667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58814 (request call id 810) took 2658 ms. Trace:
I20260709 13:02:48.299338  1740 raft_consensus.cc:1275] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:02:48.320111  6870 raft_consensus.cc:2749] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:48.321592  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.334153  1733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3742) took 1731 ms. Trace:
I20260709 13:02:48.316452  1740 pending_rounds.cc:85] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 6
I20260709 13:02:48.350025  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:48.318240  6826 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:48.370231  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:48.371673  6930 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:48.372331  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:48.036056  6921 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:48.377938  6786 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:48.383792  6730 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:48.385903  6730 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:47.998061  6788 raft_consensus.cc:2804] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:48.389906  1660 raft_consensus.cc:2393] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 13: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:48.395368  6616 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:48.351961  1740 pending_rounds.cc:107] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:02:48.350265  1733 rpcz_store.cc:276] 0709 13:02:46.565558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.094387 (+528829us) service_pool.cc:224] Handling call
0709 13:02:47.739472 (+645085us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:47.740372 (+   900us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:48.296083 (+555711us) spinlock_profiling.cc:243] Waited 645 ms on lock 0x7b54002233d0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8e8ad 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:48.296756 (+   673us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1482852096}
I20260709 13:02:48.005107  6364 raft_consensus.cc:3055] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:48.410396  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:48.410930  6364 raft_consensus.cc:740] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:48.411733  1733 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:02:48.315528  1667 rpcz_store.cc:276] 0709 13:02:45.622011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.622289 (+   278us) service_pool.cc:224] Handling call
0709 13:02:45.622552 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.303128 (+680576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:48.279415 (+1976287us) spinlock_profiling.cc:243] Waited 677 ms on lock 0x7b54000a7dd4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:48.280631 (+  1216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1556535040}
I20260709 13:02:48.413954  6771 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:48.414603  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:48.415424  1667 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:02:48.416517  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:48.034804  6920 consensus_meta.cc:287] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.619s	user 0.017s	sys 0.000s
I20260709 13:02:48.422084  6920 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:48.422255  1738 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43678 (request call id 3712) took 2993 ms (client timeout 2492 ms). Trace:
I20260709 13:02:48.423243  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:48.424705  2523 raft_consensus.cc:2468] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:48.076588  6753 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:48.423324  1738 rpcz_store.cc:269] 0709 13:02:45.359229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.359769 (+   540us) service_pool.cc:224] Handling call
0709 13:02:48.292950 (+2933181us) spinlock_profiling.cc:243] Waited 2.43 s on lock 0x7b540021ff54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:48.352573 (+ 59623us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5598732032}
I20260709 13:02:48.266878  1589 rpcz_store.cc:276] 0709 13:02:47.117422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.117597 (+   175us) service_pool.cc:224] Handling call
0709 13:02:47.118004 (+   407us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:47.118492 (+   488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:47.118532 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:47.119380 (+   848us) log.cc:844] Serialized 52 byte log entry
0709 13:02:47.232113 (+112733us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:47.854092 (+621979us) log.cc:844] Serialized 14 byte log entry
0709 13:02:47.855440 (+  1348us) log.cc:844] Serialized 14 byte log entry
0709 13:02:48.010841 (+155401us) spinlock_profiling.cc:243] Waited 9.57 ms on lock 0x7b48001227d8. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b85eb8aa1 00007f1b85eafb37 00007f1b85eaf9ca 00007f1b85fa726f 00007f1b85fa6f37 00007f1b85fbb55c 00007f1b85fbb508 00007f1b85fbb488 00007f1b85fbb443 00007f1b85fba6ec 00007f1b84ee4a96
0709 13:02:48.214278 (+203437us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b180009bd40. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7de1cc0a 00007f1b8755c219 00007f1b7dea4a40 00007f1b7de9f4e4 00007f1b7de9f455 00007f1b80f87060 00007f1b80f99716 00007f1b80faa287 00007f1b80faa208
0709 13:02:48.215230 (+   952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:48.215459 (+   229us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:48.215610 (+   151us) raft_consensus.cc:1685] finished
0709 13:02:48.215653 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:48.216117 (+   464us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":265350,"prepare.queue_time_us":390294,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":96,"raft.queue_time_us":499343,"raft.run_cpu_time_us":5835,"raft.run_wall_time_us":171537,"spinlock_wait_cycles":46131200,"thread_start_us":424058,"threads_started":2,"wal-append.queue_time_us":86475}
W20260709 13:02:48.002411  6940 log.cc:927] Time spent T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:02:48.425042  1665 raft_consensus.cc:2393] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 10: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:48.391919  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:48.406031  1740 raft_consensus.cc:2889] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:48.433710  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:48.436160  1658 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 18.
W20260709 13:02:48.030462  6936 log.cc:927] Time spent T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:02:48.400640  6826 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:48.450939  1667 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
W20260709 13:02:48.268663  1489 rpcz_store.cc:269] 0709 13:02:28.517854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.518300 (+   446us) service_pool.cc:224] Handling call
0709 13:02:28.735068 (+216768us) spinlock_profiling.cc:243] Waited 37.7 ms on lock 0x7b5400119254. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef9090 00007f1b80f97f3a 00007f1b86d4e1cc 00007f1b86e4c37e 00007f1b8530d2a4 00007f1b8530d232 00007f1b8530d161 00007f1b8530d0dc 00007f1b8530c392 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:48.216977 (+19481909us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:39.536789 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:39.537439 (+   650us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:39.537484 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:02:39.537505 (+    21us) tablet.cc:662] Decoding operations
0709 13:02:39.538228 (+   723us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:39.538326 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:39.538343 (+    17us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:02:39.538859 (+   516us) tablet.cc:701] Row locks acquired
0709 13:02:39.538906 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:02:39.539045 (+   139us) write_op.cc:270] Start()
0709 13:02:39.539175 (+   130us) write_op.cc:276] Timestamp: P: 1783602159538984 usec, L: 0
0709 13:02:39.539213 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:02:39.553286 (+ 14073us) log.cc:844] Serialized 2467 byte log entry
0709 13:02:39.966562 (+413276us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b5400119254. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8ae28 00007f1b849c5581 00007f1b849c4d58 00007f1b849c99f1 00007f1b849c99a9 00007f1b849c9939 00007f1b849c9901 00007f1b849c8b2d 000000000038f354 000000000038f199
0709 13:02:40.126965 (+160403us) op_driver.cc:464] REPLICATION: finished
0709 13:02:40.469578 (+342613us) write_op.cc:301] APPLY: starting
0709 13:02:40.469784 (+   206us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:40.812931 (+343147us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:40.812976 (+    45us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:41.329899 (+516923us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:41.355445 (+ 25546us) spinlock_profiling.cc:243] Waited 5.86 ms on lock 0x7b1800357be0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7dea2522 00007f1b7dea47c1 00007f1b7dea4779 00007f1b7dea4709 00007f1b7dea46d1 00007f1b7dea39cd 000000000038f354 000000000038f199 00007f1b7de8583a
0709 13:02:41.356312 (+   867us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:02:41.356383 (+    71us) write_op.cc:312] APPLY: finished
0709 13:02:41.356746 (+   363us) log.cc:844] Serialized 65 byte log entry
0709 13:02:41.502181 (+145435us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:41.504648 (+  2467us) write_op.cc:454] Released schema lock
0709 13:02:41.504730 (+    82us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:41.544598 (+ 39868us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:41.550098 (+  5500us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2674,"reported_tablets":42,"spinlock_wait_cycles":86778752,"child_traces":[["op",{"apply.queue_time_us":342176,"apply.run_cpu_time_us":22200,"apply.run_wall_time_us":1035689,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29207,"num_ops":6,"prepare.queue_time_us":40703,"prepare.run_cpu_time_us":27164,"prepare.run_wall_time_us":430034,"raft.queue_time_us":325366,"raft.run_cpu_time_us":43210,"raft.run_wall_time_us":277818,"replication_time_us":543735,"spinlock_wait_cycles":43991552,"thread_start_us":726703,"threads_started":5,"wal-append.queue_time_us":264248,"wal-append.run_cpu_time_us":26118,"wal-append.run_wall_time_us":2394821}]]}
I20260709 13:02:48.454969  1665 raft_consensus.cc:1240] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:48.462815  1664 raft_consensus.cc:1240] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:02:48.463205  1660 raft_consensus.cc:1275] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:48.464636  1588 raft_consensus.cc:1275] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:02:48.465575  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 102956us
I20260709 13:02:48.462667  1704 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:48.396628  6616 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:48.417071  6771 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:48.471717  6875 raft_consensus.cc:3055] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:48.472373  1666 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:48.069391  6925 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:48.472980  1663 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 16.
I20260709 13:02:48.068086  6911 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:48.467168  6826 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:48.477751  1658 raft_consensus.cc:1275] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:48.482851  6875 raft_consensus.cc:740] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:02:48.501374  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 127766us
I20260709 13:02:48.446534  6788 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:48.504959  6625 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.497762  6920 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:48.526291  6625 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:48.530560  6818 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.531786  6818 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:48.533545  1585 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.018s	sys 0.017s
W20260709 13:02:48.534308  1585 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.018s	sys 0.017s
I20260709 13:02:48.535328  6821 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.517386  6788 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:48.536451  6821 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:48.537376  6757 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:48.538528  6757 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:48.541824  6878 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.542977  6878 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:48.543424  6911 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:48.549441  1556 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:48.550179  6625 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:48.550788  6786 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:48.550984  6625 raft_consensus.cc:2804] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:48.551532  6625 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.551946  6625 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:48.555341  6878 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:48.556541  6821 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:48.559334  6730 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:48.565505  6919 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:48.566277  6875 consensus_queue.cc:260] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:48.568339  6875 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:48.545360  6364 consensus_queue.cc:260] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:48.570333  6364 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:48.573453  1633 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:48.589306  6818 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:48.595208  1739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3762) took 1090 ms. Trace:
I20260709 13:02:48.597338  6757 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:48.600829  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 747041us
I20260709 13:02:48.606874  1732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43686 (request call id 2518) took 1097 ms. Trace:
I20260709 13:02:48.607467  1732 rpcz_store.cc:276] 0709 13:02:47.509313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.772158 (+262845us) service_pool.cc:224] Handling call
0709 13:02:47.772490 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:47.773311 (+   821us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:02:47.773613 (+   302us) log.cc:844] Serialized 14 byte log entry
0709 13:02:48.605630 (+832017us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:48.605780 (+   150us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:48.605943 (+   163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:48.606354 (+   411us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:48.606659 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":829534,"prepare.queue_time_us":470,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":51}
I20260709 13:02:48.609983  1740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3754) took 1122 ms. Trace:
I20260709 13:02:48.611003  1734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3764) took 1102 ms. Trace:
I20260709 13:02:48.612178  1735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3761) took 1122 ms. Trace:
I20260709 13:02:48.611485  1734 rpcz_store.cc:276] 0709 13:02:47.508804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.634710 (+125906us) service_pool.cc:224] Handling call
0709 13:02:47.642767 (+  8057us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:47.642998 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:47.650600 (+  7602us) log.cc:844] Serialized 14 byte log entry
0709 13:02:48.610202 (+959602us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:48.610368 (+   166us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:48.610489 (+   121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:48.610604 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:48.610840 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":959099,"prepare.queue_time_us":31898,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46}
I20260709 13:02:48.612562  1735 rpcz_store.cc:276] 0709 13:02:47.504609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.522678 (+ 18069us) service_pool.cc:224] Handling call
0709 13:02:47.578939 (+ 56261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:47.579354 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:02:47.722051 (+142697us) log.cc:844] Serialized 14 byte log entry
0709 13:02:48.611438 (+889387us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:48.611557 (+   119us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:48.611754 (+   197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:48.611861 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:48.612012 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":881788,"prepare.queue_time_us":59108,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"thread_start_us":126419,"threads_started":2,"wal-append.queue_time_us":7334}
I20260709 13:02:48.615307  1737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3759) took 1126 ms. Trace:
I20260709 13:02:48.622400  6654 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:48.623613  6654 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:48.610558  1740 rpcz_store.cc:276] 0709 13:02:47.487885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.502438 (+ 14553us) service_pool.cc:224] Handling call
0709 13:02:48.297453 (+795015us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:48.449059 (+151606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:48.609666 (+160607us) spinlock_profiling.cc:243] Waited 794 ms on lock 0x7b540021ff50. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8e8ad 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:48.609885 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1827001216}
I20260709 13:02:48.599311  6616 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:48.635591  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 173301us
I20260709 13:02:48.637205  6753 raft_consensus.cc:2804] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:48.637821  6753 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:48.638286  6753 raft_consensus.cc:3060] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:48.638652  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 81320.1us
I20260709 13:02:48.599608  1741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3723) took 3134 ms. Trace:
I20260709 13:02:48.620891  6464 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.646087  6464 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:48.650604  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:48.651643  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:48.652524  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:48.650871  1663 raft_consensus.cc:1275] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:48.654047  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:48.657470  6674 raft_consensus.cc:2749] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:02:48.660001  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.626752  6708 raft_consensus.cc:2804] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:48.615798  1737 rpcz_store.cc:276] 0709 13:02:47.488956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.506493 (+ 17537us) service_pool.cc:224] Handling call
0709 13:02:47.506774 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:47.507087 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:47.524884 (+ 17797us) log.cc:844] Serialized 14 byte log entry
0709 13:02:48.614590 (+1089706us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:48.614719 (+   129us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:48.614843 (+   124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:48.614931 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:48.615132 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":964303,"prepare.queue_time_us":19390,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":42,"thread_start_us":124617,"threads_started":1,"wal-append.queue_time_us":146403}
I20260709 13:02:48.663864  1666 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 14.
I20260709 13:02:48.642491  1741 rpcz_store.cc:276] 0709 13:02:45.466494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.553446 (+ 86952us) service_pool.cc:224] Handling call
0709 13:02:45.578081 (+ 24635us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:45.650595 (+ 72514us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:45.743416 (+ 92821us) log.cc:844] Serialized 14 byte log entry
0709 13:02:46.328582 (+585166us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b4400022b4c. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7ddc8c85 00007f1b7ddc96a2 00007f1b80b3b1db 00007f1b80b36aaf 00007f1b80b2a86e 00007f1b80b29bb6 00007f1b80b297d8 00007f1b80b33221 00007f1b80b331d9 00007f1b80b33169
0709 13:02:47.988564 (+1659982us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b1800299560. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b80b374bc 00007f1b7de8548b 00007f1b86cdfab9 00007f1b7dea169b 00007f1b7de9f93f 00007f1b7de9f455 00007f1b80f87060 00007f1b80f99716 00007f1b80faa287
0709 13:02:47.992345 (+  3781us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:47.992443 (+    98us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:47.992550 (+   107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:48.598908 (+606358us) spinlock_profiling.cc:243] Waited 72.2 ms on lock 0x7b54001581d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:48.598974 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:48.599237 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25630,"prepare.queue_time_us":113937,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":30,"raft.queue_time_us":111076,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"spinlock_wait_cycles":204488192,"thread_start_us":102386,"threads_started":2,"wal-append.queue_time_us":156650,"wal-append.run_cpu_time_us":12551,"wal-append.run_wall_time_us":1626296}
I20260709 13:02:48.604600  1707 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:48.595829  1739 rpcz_store.cc:276] 0709 13:02:47.505127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.528712 (+ 23585us) service_pool.cc:224] Handling call
0709 13:02:47.529409 (+   697us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:47.529747 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:02:47.630668 (+100921us) log.cc:844] Serialized 14 byte log entry
0709 13:02:48.593716 (+963048us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b18004701a0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7de1cc0a 00007f1b8755c219 00007f1b7dea4a40 00007f1b7de9f4e4 00007f1b7de9f455 00007f1b80f87060 00007f1b80f99716 00007f1b80faa287 00007f1b80faa208
0709 13:02:48.594157 (+   441us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:48.594270 (+   113us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:48.594496 (+   226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:48.594649 (+   153us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:48.594983 (+   334us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1924,"prepare.queue_time_us":84281,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":2778,"spinlock_wait_cycles":6044032,"thread_start_us":100495,"threads_started":1}
I20260709 13:02:48.668380  6821 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:48.670675  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:48.671519  1663 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:02:48.671216  6821 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:48.672597  6881 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.672777  6878 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:48.673014  6753 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:48.665810  6708 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:48.672547  6862 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:48.673324  6911 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:48.684034  1488 catalog_manager.cc:5697] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 10 to 11, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 11 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:48.695704  1660 raft_consensus.cc:1240] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:48.697633  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 93413.5us
I20260709 13:02:48.680907  6903 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.688117  6819 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:48.714257  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.714293  6915 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:48.714869  6903 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:48.715785  6829 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.716048  1665 raft_consensus.cc:1275] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:48.694430  6708 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:48.691814  6464 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:48.726487  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:48.722230  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:48.711787  6674 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.716464  6862 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:48.729005  6625 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:48.721491  6819 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:48.740340  6862 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:48.748178  6862 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:48.746145  6829 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:48.754685  1667 raft_consensus.cc:1240] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:48.735997  1633 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:48.762516  1707 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:48.710000  6878 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:48.726941  6920 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.772894  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:48.740518  6821 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:48.757874  6947 log.cc:927] Time spent T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.388s	user 0.006s	sys 0.000s
I20260709 13:02:48.722467  6911 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:48.774606  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:48.827147  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.753667  6829 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:48.749450  6819 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:48.748998  6625 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:48.835443  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 75195.6us
I20260709 13:02:48.848459  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:48.839969  1659 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:02:48.843094  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:48.854895  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:48.775058  6674 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:48.857369  6849 raft_consensus.cc:2749] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:48.860244  6674 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:48.861269  6946 log.cc:927] Time spent T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.320s	user 0.003s	sys 0.000s
I20260709 13:02:48.861650  6654 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:48.868611   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:48.775148  6881 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:48.852671  1488 catalog_manager.cc:5697] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 7 to 8, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 8 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
W20260709 13:02:48.885063  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 189744us
I20260709 13:02:48.890916  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:48.893255  2426 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:48.896270  6680 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:48.898370  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:48.883467  6753 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:48.901551  1735 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:35672
I20260709 13:02:48.902576  1735 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:48.903275  1735 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:48.846491  6920 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:48.912402  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:48.923919  6683 consensus_queue.cc:1059] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:02:48.914702  6464 raft_consensus.cc:2804] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:48.928887  1556 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:48.910689  6903 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:48.909020  6878 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:48.938827  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 215797us
I20260709 13:02:48.939963  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:48.949374  6881 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:48.954478  1737 raft_consensus.cc:1275] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:02:48.969724  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 90823.7us
I20260709 13:02:48.970059  1633 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:48.966965  1733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43686 (request call id 2520) took 1450 ms. Trace:
I20260709 13:02:48.984127  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:48.972194  1733 rpcz_store.cc:276] 0709 13:02:47.516440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.436650 (+920210us) service_pool.cc:224] Handling call
0709 13:02:48.456142 (+ 19492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:48.456665 (+   523us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:02:48.677759 (+221094us) log.cc:844] Serialized 14 byte log entry
0709 13:02:48.965573 (+287814us) log.cc:844] Serialized 14 byte log entry
0709 13:02:48.966578 (+  1005us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:48.966626 (+    48us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:48.966679 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:48.966765 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:48.966893 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":291511,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":1007,"raft.queue_time_us":22282,"spinlock_wait_cycles":3863808,"thread_start_us":458022,"threads_started":2}
I20260709 13:02:48.988941  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:48.989933  1736 raft_consensus.cc:2393] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 in current term 9: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:48.974491  6881 raft_consensus.cc:2804] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:48.995760  1734 raft_consensus.cc:1240] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:48.974691  6674 raft_consensus.cc:2749] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:48.998208  1585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 3057) took 1152 ms. Trace:
I20260709 13:02:49.002158  6911 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:48.977428  6849 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:49.008682  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 67031.1us
I20260709 13:02:49.013907  1633 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:48.983006  6788 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:49.019856  6788 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:49.012881  6920 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:49.025758  6949 raft_consensus.cc:3055] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:49.026484  6949 raft_consensus.cc:740] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:49.027726  6949 consensus_queue.cc:260] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:49.028370  6849 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:48.993536  6757 consensus_queue.cc:1059] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:02:48.999022  6654 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:49.000804  6881 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:49.033598  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:49.039992  6950 consensus_queue.cc:1059] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:49.044900  6683 consensus_queue.cc:1048] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:49.046236  6948 consensus_queue.cc:1059] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:02:49.052119  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 56793.1us
I20260709 13:02:49.055187  1733 raft_consensus.cc:1275] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:02:49.058689  1707 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:48.999547  1585 rpcz_store.cc:276] 0709 13:02:47.846100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.846252 (+   152us) service_pool.cc:224] Handling call
0709 13:02:47.846658 (+   406us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:47.847058 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:47.847086 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:47.857593 (+ 10507us) log.cc:844] Serialized 52 byte log entry
0709 13:02:48.723125 (+865532us) spinlock_profiling.cc:243] Waited 40.9 ms on lock 0x7b54002100a0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef9090 00007f1b80f066b8 00007f1b80f8f92b 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c
0709 13:02:48.732020 (+  8895us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:48.971452 (+239432us) log.cc:844] Serialized 14 byte log entry
0709 13:02:48.977299 (+  5847us) log.cc:844] Serialized 14 byte log entry
0709 13:02:48.978296 (+   997us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:48.982632 (+  4336us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:48.998025 (+ 15393us) raft_consensus.cc:1685] finished
0709 13:02:48.998043 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:48.998160 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":591096,"raft.queue_time_us":15192,"raft.run_cpu_time_us":899,"raft.run_wall_time_us":27059,"spinlock_wait_cycles":94130560,"thread_start_us":782430,"threads_started":2,"wal-append.queue_time_us":631170}
I20260709 13:02:49.061815  6654 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:49.062162  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
W20260709 13:02:49.062225  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 93024.6us
I20260709 13:02:49.064647  6875 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.049484  6849 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:49.054934  6881 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:49.065415  6875 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:49.068670  6683 raft_consensus.cc:3055] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:49.069342  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:49.082077  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:49.083557  1555 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:49.069803  1630 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:49.071599  1558 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:49.030500  6862 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:49.100211  6713 raft_consensus.cc:2749] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:49.108824  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:49.085083  6788 raft_consensus.cc:2804] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:49.116552  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:49.117409  6878 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:49.096073  6753 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:49.098647  6949 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:49.084810  6683 raft_consensus.cc:740] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
W20260709 13:02:49.115279  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 133555us
I20260709 13:02:49.125001  2426 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:49.132105  1735 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:49.132643  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 119336us
I20260709 13:02:49.135206  1739 raft_consensus.cc:1240] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:49.135763  1556 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:49.114384  6911 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:49.121447  6788 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
W20260709 13:02:49.149531  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 142264us
W20260709 13:02:49.151387  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 101913us
W20260709 13:02:49.157439  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 91216.5us
I20260709 13:02:49.160637  1735 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:49.165060  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:49.131768  6753 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:49.153774  6920 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:49.150766  6788 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:49.170349  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:49.188854  1556 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:49.207803  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.168586  6906 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.227641  1558 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:49.229473  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 63800.7us
W20260709 13:02:49.201742  6954 log.cc:927] Time spent T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.174s	user 0.001s	sys 0.001s
I20260709 13:02:49.167372  6826 raft_consensus.cc:2749] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:49.192358  6713 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:49.167637  6683 consensus_queue.cc:260] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:49.259902  6713 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:49.271879  6713 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:49.264957  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 100518us
I20260709 13:02:49.281255  1707 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:49.294827  6753 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:49.224038  6911 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:49.272723  6625 raft_consensus.cc:2804] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:49.268991  6878 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:49.311880  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 242410us
I20260709 13:02:49.190842  6849 consensus_queue.cc:1048] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.111s
W20260709 13:02:49.321208  6708 consensus_meta.cc:287] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.551s	user 0.015s	sys 0.001s
I20260709 13:02:49.321478  6959 raft_consensus.cc:2749] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:49.321777  6708 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:49.323206  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 154142us
I20260709 13:02:49.323864  2554 raft_consensus.cc:3055] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:49.324222  2554 raft_consensus.cc:740] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:49.310966  6875 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:49.325297  6920 consensus_queue.cc:1059] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:49.308002  6906 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:49.326589  6920 raft_consensus.cc:3055] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:49.327029  6920 raft_consensus.cc:740] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
W20260709 13:02:49.327220  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 66183.5us
I20260709 13:02:49.327672  6948 raft_consensus.cc:3055] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:49.328362  6948 raft_consensus.cc:740] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:49.328872  6906 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:49.330606  6911 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:49.331321  6654 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:49.332831  6680 raft_consensus.cc:2749] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:49.334707  6958 log.cc:927] Time spent T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:02:49.328737  1707 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:49.307169  6862 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:49.312024  6625 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
W20260709 13:02:49.344305  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 157160us
I20260709 13:02:49.317812  6683 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:49.328202  6920 consensus_queue.cc:260] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:49.324882  2554 consensus_queue.cc:260] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:49.314705  6753 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:49.366235  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 76877.3us
I20260709 13:02:49.358340  6862 raft_consensus.cc:2749] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:49.369942  1558 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:49.371848  1558 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:49.373538  6582 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:49.373783  6878 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.374073  6582 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:49.374553  6582 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:49.374521  6878 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:49.355590  6625 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:49.377709  1733 raft_consensus.cc:1275] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:49.378825  6360 raft_consensus.cc:2804] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:49.379410  6360 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:49.379913  6360 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:49.380940  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:49.382442  6915 consensus_queue.cc:1048] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:49.383118  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:49.384052  1737 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:02:49.384227  6948 consensus_queue.cc:260] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:49.385116  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:49.387689  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:49.387878  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:49.388659  1736 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
W20260709 13:02:49.373268  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 94004.1us
I20260709 13:02:49.345242  6875 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
W20260709 13:02:49.377000  1705 leader_election.cc:336] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.686s (SENT)
I20260709 13:02:49.389040  1733 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:02:49.394634  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:49.414876  1630 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:49.400000  1662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 2944) took 1448 ms. Trace:
I20260709 13:02:49.393785  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:49.407891  6948 raft_consensus.cc:3060] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:49.417567  1735 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:02:49.428684  1740 raft_consensus.cc:2393] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 9: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:49.395947  6878 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:49.429416  6878 consensus_queue.cc:1048] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:02:49.429847  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.414222  1705 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:49.401302  6464 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:49.431077  6464 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:49.431586  6903 raft_consensus.cc:2749] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:49.409986  6674 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.433599  6674 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:49.424194  6826 raft_consensus.cc:2749] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:49.415724  6708 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:49.408625  6875 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:49.411090  2425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.408885  6821 consensus_queue.cc:1059] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:02:49.409735  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:49.436062  6881 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:49.431195  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 54251.2us
W20260709 13:02:49.451505  2425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.454834  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:49.457311  2554 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:49.469946  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:49.454854  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:49.471035  1740 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 15.
I20260709 13:02:49.473991  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:49.480880  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:49.428282  1662 rpcz_store.cc:276] 0709 13:02:47.951787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.439805 (+488018us) service_pool.cc:224] Handling call
0709 13:02:48.440680 (+   875us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:48.513139 (+ 72459us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:48.675205 (+162066us) log.cc:844] Serialized 14 byte log entry
0709 13:02:48.976229 (+301024us) log.cc:844] Serialized 14 byte log entry
0709 13:02:49.113545 (+137316us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b1800304360. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7de1cc0a 00007f1b8755c219 00007f1b7dea4a40 00007f1b7de9f4e4 00007f1b7de9f455 00007f1b80f87060 00007f1b80f99716 00007f1b80faa287 00007f1b80faa208
0709 13:02:49.113772 (+   227us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:49.113846 (+    74us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:49.121762 (+  7916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.334913 (+213151us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b1800304360. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7dea23f3 00007f1b7dea47c1 00007f1b7dea4779 00007f1b7dea4709 00007f1b7dea46d1 00007f1b7dea39cd 000000000038f354 000000000038f199 00007f1b7de8583a
0709 13:02:49.398826 (+ 63913us) spinlock_profiling.cc:243] Waited 4.07 ms on lock 0x7b1800304360. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7de702a6 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419
0709 13:02:49.399777 (+   951us) spinlock_profiling.cc:243] Waited 27.7 ms on lock 0x7b54002e6dd4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:49.399811 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.399941 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":140623,"prepare.queue_time_us":117935,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":107,"raft.queue_time_us":141195,"raft.run_cpu_time_us":601,"raft.run_wall_time_us":39417,"spinlock_wait_cycles":114238848,"thread_start_us":261291,"threads_started":1,"wal-append.queue_time_us":308995}
I20260709 13:02:49.473394  1558 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:49.453311  6958 log.cc:927] Time spent T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:02:49.491466  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:49.484441  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:49.495546  1739 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:49.498044  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:49.501950  1738 raft_consensus.cc:2393] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 12: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:49.476930  6674 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:49.510991  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 182363us
I20260709 13:02:49.518021  1630 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:49.509466  6821 raft_consensus.cc:3055] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:49.524313  1738 raft_consensus.cc:1240] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:49.524714  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 77494.3us
I20260709 13:02:49.531919  6920 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:49.534420  1734 raft_consensus.cc:1275] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:49.538972  2554 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15.
I20260709 13:02:49.540372  1704 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:49.544292  1558 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:49.533531  6364 raft_consensus.cc:2804] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:49.525944  6821 raft_consensus.cc:740] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:49.544682  6849 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:49.553243  6903 consensus_queue.cc:1048] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:02:49.553309  2553 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:02:49.557961  6963 raft_consensus.cc:2804] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:49.566538  6881 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:49.566926  6360 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:49.568694  6881 raft_consensus.cc:2749] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:49.571837  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 57779us
I20260709 13:02:49.552284  6364 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:49.578504  6875 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:49.585922  1558 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:49.592300  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
W20260709 13:02:49.569897  6957 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:02:49.598397  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:49.556442  6680 consensus_queue.cc:1048] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:02:49.552425  6708 consensus_queue.cc:1048] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:02:49.584756  6364 raft_consensus.cc:3060] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:49.608906  2426 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:49.611841  6757 raft_consensus.cc:3060] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:49.593701  6875 raft_consensus.cc:2749] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:49.617990  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 71305.5us
I20260709 13:02:49.608453  1707 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:49.586011  6963 raft_consensus.cc:697] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 15 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:49.629693  6969 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:49.631893  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:49.629839  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:02:49.635172  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 227197us
I20260709 13:02:49.636754  1737 raft_consensus.cc:1240] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:49.586525  6821 consensus_queue.cc:260] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:49.632565  6360 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:49.646513  1733 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
W20260709 13:02:49.654314  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.642971  6862 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:49.637059  6826 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.664693  1558 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:49.679950  6464 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:49.682291  6788 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:49.688084  6788 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:49.689795  6963 consensus_queue.cc:237] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:49.662382  6969 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:49.658169  6964 consensus_queue.cc:1048] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:02:49.661906  6821 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:49.696262  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:02:49.698879  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 49783.1us
W20260709 13:02:49.682674  6970 log.cc:927] Time spent T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:02:49.698122  6360 raft_consensus.cc:2804] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:49.748090  6360 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:49.748767  6360 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:49.701884  6849 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.751752  6849 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:49.733183  6826 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:49.755329  6826 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:49.704753  1555 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:49.717216  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:49.642099  6948 consensus_queue.cc:1059] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:02:49.758098  6974 consensus_queue.cc:1048] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:49.672601  6625 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:49.695497  6464 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:49.718473  1556 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:49.734607  1739 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 13.
W20260709 13:02:49.737927  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 132321us
I20260709 13:02:49.742681  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:49.742964  6713 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:49.746940  6969 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:49.785966  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 144795us
I20260709 13:02:49.715821  6862 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:49.775480  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 70919.7us
I20260709 13:02:49.816005  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:49.772449  1705 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:02:49.811796  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 93463.4us
I20260709 13:02:49.819235  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:49.761521  6878 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.835239  6878 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:49.767313  6364 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:49.837667  6878 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:49.829893  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:49.832324  1735 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 13.
I20260709 13:02:49.773792  6881 consensus_queue.cc:1059] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:02:49.832650  1707 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:49.840255  6364 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:49.833777  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 61437.2us
I20260709 13:02:49.769565  6967 raft_consensus.cc:3055] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:49.834396  6911 raft_consensus.cc:2749] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:49.760983  6753 raft_consensus.cc:2749] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:49.834296  6849 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:49.820147  6974 raft_consensus.cc:2804] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:49.866487  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:49.850973  1705 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:49.853125  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:49.768107  6757 raft_consensus.cc:2749] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:49.866240  1556 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:49.870286  1737 raft_consensus.cc:1275] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:02:49.840716  6881 raft_consensus.cc:3055] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:49.832250  6973 raft_consensus.cc:2804] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:49.865712  6862 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:49.877957  1588 raft_consensus.cc:1240] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:02:49.878190  6862 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:49.880118  6713 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 20 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:49.880682  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:49.882007  1734 raft_consensus.cc:2393] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 14: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:49.866725  6364 consensus_queue.cc:1059] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:02:49.884133  6878 raft_consensus.cc:2804] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:49.884730  6878 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:49.885179  6878 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:49.840692  6582 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:49.887892  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:49.888772  1733 raft_consensus.cc:2393] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 19: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:49.889391  6708 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:49.889658  2554 raft_consensus.cc:1240] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:49.873143  1556 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:49.889858  6582 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:49.890543  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:49.890671  6582 raft_consensus.cc:2749] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:49.891379  1739 raft_consensus.cc:2393] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 13: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:49.892313  6826 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:49.892913  6826 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:49.893486  1736 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 13.
I20260709 13:02:49.872946  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:49.844631  6967 raft_consensus.cc:740] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:49.852075  6788 raft_consensus.cc:2749] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:49.913285  6949 consensus_queue.cc:1059] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:49.913712  1588 raft_consensus.cc:1240] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:49.866484  6974 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:49.906584  6849 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.916246  6974 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:49.916448  6949 raft_consensus.cc:3055] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:49.874928  6464 consensus_queue.cc:1048] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:02:49.917375  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:49.918210  1734 raft_consensus.cc:2393] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 16: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:49.918753  6911 consensus_queue.cc:1048] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:49.916687  6849 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:49.916973  6949 raft_consensus.cc:740] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:49.906708  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:49.922102  6849 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:49.922562  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:49.924817  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:49.925511  1739 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 13.
I20260709 13:02:49.902573  1705 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:49.903787  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:49.929129  1737 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 11.
I20260709 13:02:49.906890  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:49.907336  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:49.930100  1664 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:49.907800  1589 raft_consensus.cc:1240] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:49.908485  1583 raft_consensus.cc:1240] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:49.908969  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:49.909412  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:49.931099  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:49.909837  1665 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:49.893364  6753 consensus_queue.cc:1048] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:02:49.911486  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:49.912401  6967 consensus_queue.cc:260] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:49.932932  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:49.933063  1666 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16.
I20260709 13:02:49.875526  6973 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:49.938941  1733 raft_consensus.cc:2410] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:02:49.931591  1662 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:02:49.873006  6881 raft_consensus.cc:740] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:49.946938  1659 raft_consensus.cc:1275] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 8. (term mismatch)
I20260709 13:02:49.947759  1659 pending_rounds.cc:85] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 7
I20260709 13:02:49.948117  1659 pending_rounds.cc:107] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:02:49.948452  1659 raft_consensus.cc:2889] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:49.946007  6683 consensus_queue.cc:1059] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:02:49.949522  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:49.950599  6708 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.951043  6683 raft_consensus.cc:3055] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:49.961490  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:49.962368  1738 raft_consensus.cc:1240] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:49.945001  6973 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:49.969439  6881 consensus_queue.cc:260] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:49.971532  6881 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:49.952852  6903 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.975241  6625 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:49.974738  6903 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:49.957448  6862 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.976296  6862 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:49.965629  6683 raft_consensus.cc:740] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:49.978171  6683 consensus_queue.cc:260] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:49.982923  6674 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.983014  6849 consensus_queue.cc:1048] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:49.984156  6674 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:49.985692  1633 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:49.986801  6582 consensus_queue.cc:1048] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:49.993068  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:49.996719  6674 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:50.001037  6949 consensus_queue.cc:260] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:49.943447  6464 raft_consensus.cc:2804] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:02:50.005735  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.951155  6708 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:50.036093  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
W20260709 13:02:50.041026  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 77488.7us
I20260709 13:02:50.042358  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:49.990438  6360 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:50.045801  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 63020us
I20260709 13:02:50.047266  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:50.026010  6920 raft_consensus.cc:2749] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:50.048561  1667 raft_consensus.cc:2468] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:02:50.021584  6875 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:50.052510  1664 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:02:50.049906  1665 raft_consensus.cc:1275] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:50.032464  6683 raft_consensus.cc:3060] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:50.032090  6826 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:50.051129  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:50.065697  1585 raft_consensus.cc:1240] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:50.067212  1583 raft_consensus.cc:2393] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 13: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:50.035966  6625 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.064014  6963 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:50.030889  6950 consensus_queue.cc:1059] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:02:50.110544  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:50.111876  6966 raft_consensus.cc:3055] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:50.112468  6966 raft_consensus.cc:740] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:50.114140  6966 consensus_queue.cc:260] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:50.115128  6967 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:50.115605  6966 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:50.065060  6464 raft_consensus.cc:697] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 14 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:50.086053  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:50.034232  6975 consensus_queue.cc:1059] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:02:50.038069  6674 consensus_queue.cc:1059] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:02:50.083060  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:50.093430  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:50.094401  6360 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:50.095086  6985 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:50.099046  6625 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:50.045904  6962 consensus_queue.cc:1059] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:02:50.138213  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:50.072631  6949 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:50.102468  6821 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.093485  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:50.103869  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:50.145659  6821 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:50.107372  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:50.147502  1586 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 12.
I20260709 13:02:50.107671  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:50.148447  6821 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:50.148802  6674 raft_consensus.cc:3055] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:50.149292  6674 raft_consensus.cc:740] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:50.150315  6674 consensus_queue.cc:260] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:50.151804  6674 raft_consensus.cc:3060] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:50.109148  6708 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:50.134402  6920 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:50.161907  6920 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:50.169523  6985 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:50.076951  1633 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:50.107298  1588 raft_consensus.cc:1275] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:50.109290  6963 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:50.131129  1661 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:02:50.131279  1664 raft_consensus.cc:2393] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 13: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:50.102034  6903 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:50.145272  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:50.108865  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:50.130481  6849 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:50.170831  6878 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:50.171144  6464 consensus_queue.cc:237] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:50.172890  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:50.174522  6962 raft_consensus.cc:3055] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:50.175557  6862 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:50.085479  6875 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:50.192830  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 130846us
I20260709 13:02:50.193018  1592 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 11.
I20260709 13:02:50.194088  6875 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:50.184716  6974 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:50.186704  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:50.195890  1588 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 14.
I20260709 13:02:50.196799  6625 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:50.197280  6974 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:50.121905  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 77712us
I20260709 13:02:50.176194  6968 raft_consensus.cc:3055] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:50.201561  6968 raft_consensus.cc:740] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:50.186640  6962 raft_consensus.cc:740] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:50.201370  1558 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:50.201624  6974 consensus_queue.cc:1048] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:50.203102  6968 consensus_queue.cc:260] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:50.203454  6962 consensus_queue.cc:260] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:50.204946  6962 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:50.205052  6875 raft_consensus.cc:2804] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:50.205520  6875 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.206103  6875 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:50.208088  6985 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:50.209434  6826 raft_consensus.cc:2804] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:50.210057  6826 raft_consensus.cc:697] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:50.211097  6826 consensus_queue.cc:237] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:50.213042  1558 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:50.195254  6963 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:50.202069  2552 raft_consensus.cc:1275] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:50.204996  6968 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:50.165016  6920 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:50.216118  1558 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:50.225708  6360 raft_consensus.cc:2804] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:50.228965  1589 raft_consensus.cc:2393] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 14: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:50.229827  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:50.230535  1741 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16.
I20260709 13:02:50.233685  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:50.234479  1738 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:02:50.229012  6360 raft_consensus.cc:697] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:50.238838  6360 consensus_queue.cc:237] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:50.189661  6849 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:50.241930  2426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.248119  1740 raft_consensus.cc:1275] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:50.253185  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:50.253935  1736 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16.
I20260709 13:02:50.255604  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:50.257229  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:50.222227  6974 raft_consensus.cc:2804] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:50.260993  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:50.280840  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:50.262372  1734 raft_consensus.cc:1275] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:02:50.282119  1666 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:02:50.282159  1736 raft_consensus.cc:2410] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 12 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:02:50.256410  1584 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 13.
I20260709 13:02:50.281661  6974 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.264333  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:50.285627  6974 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:50.286330  1739 raft_consensus.cc:2468] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:02:50.286482  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:50.287283  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:50.287465  1736 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:50.264202  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:50.288889  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:50.264680  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:50.265451  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:50.296852  1556 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:50.269439  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:50.297684  6625 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:50.298477  1586 raft_consensus.cc:2410] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:02:50.273183  1588 raft_consensus.cc:2368] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 19. Current term is 20.
I20260709 13:02:50.297678  1591 raft_consensus.cc:2393] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 12: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:50.277714  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:50.284293  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:50.265057  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:50.301887  1734 raft_consensus.cc:2393] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 13: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:50.298503  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:50.302373  1666 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:50.317595  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:50.319983  1587 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 13.
I20260709 13:02:50.320679  1660 raft_consensus.cc:1240] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:50.253960  6849 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:50.319218  1556 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:02:50.321684  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 102386us
I20260709 13:02:50.326807  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:50.327078  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:50.326867  1667 raft_consensus.cc:2410] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:02:50.325433  1556 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:50.337514  1659 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:02:50.252097  6963 consensus_queue.cc:1048] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.071s
I20260709 13:02:50.341876  6821 raft_consensus.cc:2804] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:50.345623  6821 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.346130  6821 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:50.349321  6982 raft_consensus.cc:2804] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:50.350013  6982 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.350433  6982 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:50.343359  1633 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:50.249405  6973 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:50.353492  1666 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:02:50.354967  1556 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:50.369318  2426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.370513  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:50.371775  1732 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:50.390309  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:50.409829  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:50.410893  1734 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:02:50.414520  1661 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 20.
I20260709 13:02:50.418977  1736 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 20.
I20260709 13:02:50.429358  6911 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:50.430325  6911 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:50.434592  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 91397.5us
I20260709 13:02:50.436244  6878 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:50.436489  6991 log.cc:927] Time spent T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:02:50.436614  6911 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:50.441541  6994 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:50.444135  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:50.445163  2552 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 13.
I20260709 13:02:50.453055  1704 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:50.446442  1633 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:50.456615  6625 raft_consensus.cc:2749] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:50.424365  6969 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.442272  6994 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:50.464560  6464 raft_consensus.cc:2804] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:02:50.469235  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 114355us
I20260709 13:02:50.472559  6849 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:50.433166  7000 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.473927  7000 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:50.477035  7000 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:50.477690  7000 consensus_queue.cc:1048] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:50.480233  1633 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:50.471460  1556 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:50.482380  1556 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:50.466552  6881 raft_consensus.cc:2749] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:50.468734  6464 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
W20260709 13:02:50.488451  6996 log.cc:927] Time spent T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.136s	user 0.000s	sys 0.002s
I20260709 13:02:50.456696  6875 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:50.475863  6821 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:50.489933  6674 raft_consensus.cc:2749] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:50.498772  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:50.468478  6994 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:50.489055  6988 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:50.517807  1633 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:50.529125  1732 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:02:50.537926  6875 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:50.539456  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.532155  2552 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:50.529978  6713 raft_consensus.cc:2804] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:50.542893  6713 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.543913  6713 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:50.494019  6973 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:50.522882  6464 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:50.519073  1556 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:50.559517  1633 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:50.483824  7000 raft_consensus.cc:2749] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:50.486770  6969 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:50.578722  6974 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:50.581183  6974 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:50.547961  6988 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:50.586884  6988 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:50.568817  6674 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:50.588999  1633 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:50.526768  6826 consensus_queue.cc:1059] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:02:50.621644  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:50.601612  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 82662.6us
I20260709 13:02:50.605239  6821 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:50.609512  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:50.625059  2543 raft_consensus.cc:2468] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:50.610297  6875 raft_consensus.cc:2749] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:50.622563  2550 raft_consensus.cc:2468] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:02:50.612455  6969 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:50.601662  6920 raft_consensus.cc:2749] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:50.614787  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:50.629053  2554 raft_consensus.cc:2410] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:02:50.629612  1589 raft_consensus.cc:2393] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 17: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:50.615912  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:50.630501  1587 raft_consensus.cc:2393] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 13: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:50.616189  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:50.617168  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:50.630916  2552 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:02:50.617621  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:50.618424  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:50.618925  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:50.618947  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:50.616909  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:50.534591  6849 consensus_queue.cc:1048] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:02:50.627669  1704 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:50.633574  1585 raft_consensus.cc:2368] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 11. Current term is 12.
I20260709 13:02:50.631361  1584 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12.
I20260709 13:02:50.640928  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:50.641595  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:50.637013  1555 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:50.650442  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:50.651379  1591 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 18.
I20260709 13:02:50.644017  6992 raft_consensus.cc:2804] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:50.681630  6992 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
W20260709 13:02:50.682030  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 45184.3us
I20260709 13:02:50.682760  7003 raft_consensus.cc:2804] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:50.683481  7003 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.683910  7003 raft_consensus.cc:3060] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:50.684178  1555 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:50.638059  6969 consensus_queue.cc:1048] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:02:50.686460  6969 raft_consensus.cc:2804] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:50.682060  6992 raft_consensus.cc:3060] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:50.687449  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:50.688599  1585 raft_consensus.cc:2393] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 14: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:50.689623  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:50.692104  6982 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:50.693517  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:50.694196  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:50.704100  1592 raft_consensus.cc:2393] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 13: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:50.697031  1591 raft_consensus.cc:1240] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:02:50.698779  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:50.676816  1556 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:50.703043  1589 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
W20260709 13:02:50.708945  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 120035us
I20260709 13:02:50.709795  1633 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:50.709812  1556 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:50.713376  1556 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:50.720999  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:50.724464  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:50.729991  1588 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 13.
I20260709 13:02:50.728161  1586 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 21.
I20260709 13:02:50.739006  1583 raft_consensus.cc:2368] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 13. Current term is 14.
I20260709 13:02:50.739481  1633 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:50.740360  1556 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:50.687176  6969 raft_consensus.cc:697] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:50.755496  1633 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:50.711171  6920 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:50.723580  6821 raft_consensus.cc:2804] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:50.726915  6713 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:50.753624  6994 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:50.754043  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:50.750408  6982 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:50.728483  6625 raft_consensus.cc:2804] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:50.758507  7002 raft_consensus.cc:2804] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:50.784137  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:50.763422  6674 raft_consensus.cc:697] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 13 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:50.762036  6875 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:50.788753  1585 raft_consensus.cc:2393] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 8: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:50.766542  6920 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:50.796042  6826 raft_consensus.cc:3055] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:50.766064  6821 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.878163  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:50.903777  1663 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:50.798138  7010 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.883570  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:50.888761  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:50.890360  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:50.893700  1707 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:50.879707  1740 raft_consensus.cc:1240] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:50.782069  6625 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:50.916771  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:02:50.921927  1705 leader_election.cc:336] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.546s (SENT)
I20260709 13:02:50.922525  1705 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:50.922273  7010 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:50.922008  1732 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:50.924952  1738 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:50.905027  1586 raft_consensus.cc:1275] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:02:50.929669  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:50.952068  1664 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:50.930418  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:50.931209  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:02:50.932611  7008 log.cc:927] Time spent T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:02:50.933444  6674 consensus_queue.cc:237] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:50.934300  6713 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:50.929675  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:50.915731  6821 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:50.938037  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:50.982131  1659 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:02:50.939116  7014 raft_consensus.cc:2804] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:50.940231  7012 raft_consensus.cc:2804] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:50.929790  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:50.807619  7002 raft_consensus.cc:697] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:50.873914  6920 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:50.954299  1741 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:51.015676  7010 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:50.955767  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:51.018685  1740 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:50.936813  6360 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.873761  6875 raft_consensus.cc:697] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 20 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:02:50.948639  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 145778us
I20260709 13:02:50.966260  1663 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 14.
I20260709 13:02:50.929849  6862 raft_consensus.cc:2804] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:50.997709  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 75857.6us
W20260709 13:02:51.035522  1705 leader_election.cc:336] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.572s (SENT)
I20260709 13:02:51.035986  1705 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:50.948717  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:50.997736  1733 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:02:50.869030  7011 raft_consensus.cc:2749] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:50.904856  6826 raft_consensus.cc:740] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:51.002988  1707 leader_election.cc:400] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 11. Current term is 12.
I20260709 13:02:51.057236  1707 leader_election.cc:403] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:02:50.961310  6987 consensus_queue.cc:1048] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.081s
I20260709 13:02:51.003029  7014 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:50.961119  6988 raft_consensus.cc:2749] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:51.003084  7012 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.007241  7009 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:51.009724  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:50.999753  6962 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.945482  6625 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:51.027788  1732 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
I20260709 13:02:51.040267  6862 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:51.048704  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 106761us
W20260709 13:02:51.029620  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 274160us
I20260709 13:02:51.058038  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:51.086073  7007 log.cc:927] Time spent T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:02:51.097652  6963 raft_consensus.cc:2749] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 11. Current term is 12.
I20260709 13:02:51.097447  6875 consensus_queue.cc:237] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:51.029847  6969 consensus_queue.cc:237] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:51.114344  1556 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:51.116918  1558 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:51.113541  1633 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:51.119488  1664 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
I20260709 13:02:51.127166  1556 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:51.091729  6911 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:51.137559  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 102065us
W20260709 13:02:51.142242  1705 leader_election.cc:336] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.589s (SENT)
I20260709 13:02:51.142706  1705 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:51.040702  6992 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:51.091518  7014 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:51.095275  7012 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:51.143600  1741 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:02:51.121816  6862 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:51.163291  1740 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 14.
I20260709 13:02:51.144829  6878 raft_consensus.cc:2804] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:51.171283  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:51.138731  6982 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:02:51.179613  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 253497us
I20260709 13:02:51.147576  7013 raft_consensus.cc:2764] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:02:51.116722  6360 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:51.186237  1707 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:51.111829  7009 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:51.116067  6962 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:51.165694  6963 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 15 LEADER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:51.202217  1705 leader_election.cc:336] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.630s (SENT)
I20260709 13:02:51.179370  6982 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.183405  7000 raft_consensus.cc:2804] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:02:51.221670  1705 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.748s (SENT) [suppressed 26 similar messages]
I20260709 13:02:51.224270  7028 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.138370  7003 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:51.185588  6878 raft_consensus.cc:697] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:51.229365  2554 raft_consensus.cc:2468] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 12.
I20260709 13:02:51.233294  1662 raft_consensus.cc:2368] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 11. Current term is 12.
I20260709 13:02:51.224943  7028 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:51.253118  6878 consensus_queue.cc:237] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:51.254683  7003 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:51.255386  6911 raft_consensus.cc:2804] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:51.255853  6911 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:51.256269  6911 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:51.226936  6982 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:51.226249  7000 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:51.228807  6994 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:51.262411  6360 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:51.268293  7028 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:51.271503  1738 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 14.
I20260709 13:02:51.161195  7002 consensus_queue.cc:237] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:51.298578  7009 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:51.278949  7000 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:51.303025  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:51.304539  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:51.305750  2553 raft_consensus.cc:3060] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:51.282047  6957 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.247255  7024 consensus_queue.cc:1048] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
W20260709 13:02:51.312915  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 177386us
W20260709 13:02:51.318409  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 132231us
I20260709 13:02:51.322201  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:51.319476  1707 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:51.330152  1558 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:51.332242  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:51.332886  6962 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:51.333707  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:02:51.334365  7017 log.cc:927] Time spent T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
W20260709 13:02:51.336634  7022 log.cc:927] Time spent T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:02:51.343036  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:51.344789  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:51.348673  1707 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:51.348914  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:51.352620  1665 raft_consensus.cc:2393] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 15: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:51.354738  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:51.357247  1558 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:51.361469  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:51.362030  7035 raft_consensus.cc:2749] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:51.363906  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:51.365947  7025 log.cc:927] Time spent T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
W20260709 13:02:51.369408  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 146679us
I20260709 13:02:51.370412  6582 raft_consensus.cc:2749] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:51.367692  1558 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:51.373728  1665 raft_consensus.cc:2393] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 12: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:51.375228  7003 raft_consensus.cc:2749] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:51.359536  6988 raft_consensus.cc:2749] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:51.376997  1558 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:51.377943  7003 raft_consensus.cc:2749] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:02:51.378587  6464 consensus_meta.cc:287] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.809s	user 0.011s	sys 0.002s
I20260709 13:02:51.379207  6464 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:51.351637  6992 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:51.313678  6957 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:51.394759  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:51.403258  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 51870.6us
I20260709 13:02:51.404119  1707 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:51.405769  1707 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:51.406322  2553 raft_consensus.cc:2468] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:02:51.408227  1707 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:51.425544  1558 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:51.430460  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:51.434389  1558 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:02:51.438437  7032 log.cc:927] Time spent T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:02:51.446869  1664 raft_consensus.cc:2468] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:02:51.396488  6963 raft_consensus.cc:2804] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:51.440590  1555 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:51.452943  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:51.455451  1664 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
I20260709 13:02:51.347498  6878 consensus_queue.cc:1048] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:02:51.439749  6862 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:51.470687  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:51.432548  6582 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:51.440907  6969 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:51.448447  6988 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:51.407677  6821 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:51.454025  6992 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:51.454881  6963 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:51.484563  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 76389.6us
I20260709 13:02:51.486845  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:51.484622  1558 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:51.488659  1664 raft_consensus.cc:2393] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 18: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:51.468488  7024 raft_consensus.cc:2804] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:51.490423  6963 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:51.465514  6875 raft_consensus.cc:2749] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:51.499615  7047 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:51.499506  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:51.500597  6821 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:51.507195  6713 consensus_queue.cc:1059] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:51.508248  1558 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:51.509606  7030 consensus_queue.cc:1059] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 13:02:51.510322  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:51.484018  6582 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:51.490995  6920 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:51.533464  7047 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.536510  7047 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:51.537000  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:51.537726  1660 raft_consensus.cc:2468] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:02:51.537911  6920 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:51.538906  1667 raft_consensus.cc:1240] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:51.540132  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:51.518103  7040 log.cc:927] Time spent T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:02:51.544461  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:51.545102  6582 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:51.540736  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:51.546631  1667 raft_consensus.cc:2393] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 17: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:51.547477  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:51.548170  1667 raft_consensus.cc:2393] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 15: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:51.525467  1630 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:51.530018  6957 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:51.508996  6862 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:51.552229  6982 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:51.494091  6969 raft_consensus.cc:2749] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:51.553763  6969 raft_consensus.cc:3055] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:51.554162  6969 raft_consensus.cc:740] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:51.555034  6969 consensus_queue.cc:260] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:51.556316  6969 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:51.531877  1664 raft_consensus.cc:2393] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 16: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:51.497454  7024 raft_consensus.cc:697] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:51.557896  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:51.558135  1705 leader_election.cc:336] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.577s (SENT)
I20260709 13:02:51.558728  1705 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:51.559284  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:51.560144  1705 leader_election.cc:336] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.774s (SENT)
I20260709 13:02:51.560604  1705 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:51.534300  1661 raft_consensus.cc:2393] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 12: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:51.545876  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:51.557967  7024 consensus_queue.cc:237] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:51.568565  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:51.569334  1741 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 12.
I20260709 13:02:51.492496  6988 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.564447  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:51.477991  6625 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:51.540766  1663 raft_consensus.cc:2468] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 12.
I20260709 13:02:51.574561  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:51.575300  1584 raft_consensus.cc:1240] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:02:51.538919  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:51.548945  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:51.563766  1590 raft_consensus.cc:1240] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:02:51.494267  6992 raft_consensus.cc:697] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 13 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:51.573334  1586 raft_consensus.cc:2393] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 13: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:51.575402  1663 raft_consensus.cc:2393] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 13: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
W20260709 13:02:51.575449  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 67306.7us
I20260709 13:02:51.582549  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:51.583341  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:51.560510  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:51.578186  6920 raft_consensus.cc:2804] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:51.578368  7046 raft_consensus.cc:2749] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:51.586915  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:51.586798  6992 consensus_queue.cc:237] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:51.587778  1588 raft_consensus.cc:2393] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 14: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:51.578912  6875 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:51.590981  7014 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:51.591823  1705 leader_election.cc:336] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.606s (SENT)
I20260709 13:02:51.592262  1705 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:51.579419  6988 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:51.597873  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:51.599470  1662 raft_consensus.cc:2393] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 13: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:51.600693  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:51.601824  1665 raft_consensus.cc:2393] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 13: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:51.602949  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:51.604507  1558 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:51.605656  1585 raft_consensus.cc:1240] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:51.607436  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:51.608266  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:51.608559  7046 raft_consensus.cc:2749] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:51.611137  6911 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:51.611626  1705 leader_election.cc:336] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.653s (SENT)
I20260709 13:02:51.682861  1705 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:51.612308  6826 consensus_queue.cc:260] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:51.613997  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:51.684711  1658 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:51.613744  7000 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:51.617244  1586 raft_consensus.cc:1275] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:02:51.617916  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:51.618167  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:51.618434  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:51.693143  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:51.620765  1592 raft_consensus.cc:1240] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:51.694777  1663 raft_consensus.cc:2393] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 16: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:51.700491  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:51.700925  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:51.701531  1667 raft_consensus.cc:2393] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 13: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:51.702215  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:51.702298  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:51.703476  1665 raft_consensus.cc:2393] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 17: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:51.704509  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:51.706674  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:51.708202  1583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 3075) took 1059 ms. Trace:
W20260709 13:02:51.710767  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 99290.2us
W20260709 13:02:51.622124  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 181620us
I20260709 13:02:51.623039  6920 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.626230  6988 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:51.626509  2424 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:02:51.728466  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 101948us
I20260709 13:02:51.626968  6464 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:51.632501  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:51.634315  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:51.729997  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:51.730420  1735 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 11.
I20260709 13:02:51.637545  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:51.731002  1663 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:51.638273  1733 raft_consensus.cc:1240] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 13. Current term is 14. Ops: [12.8-13.9]
I20260709 13:02:51.638652  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:51.732232  1736 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 17.
I20260709 13:02:51.646729  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:51.734091  1738 raft_consensus.cc:2393] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 13: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:51.649173  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:51.736819  1741 raft_consensus.cc:1275] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:51.649411  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:51.649628  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:51.738055  1660 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:02:51.739040  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:51.740105  1660 raft_consensus.cc:3060] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:02:51.740192  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:51.650233  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:51.741400  1587 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 12.
I20260709 13:02:51.632304  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
W20260709 13:02:51.669050  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 82994.6us
I20260709 13:02:51.681500  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:51.687052   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:51.668309  1661 raft_consensus.cc:2376] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9. Re-sending same reply.
I20260709 13:02:51.704937  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:51.743512  1558 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:51.744030  1665 raft_consensus.cc:2393] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 13: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:51.744359  7002 raft_consensus.cc:2804] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:51.744555  1558 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:51.744930  7002 raft_consensus.cc:697] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:51.745023  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:51.746034  7002 consensus_queue.cc:237] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:51.746515  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:51.747839  6974 raft_consensus.cc:2804] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:51.748590  6974 raft_consensus.cc:697] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:51.738112  6680 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.665702  1740 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 10.
I20260709 13:02:51.743549  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:51.749642  6680 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:51.751027  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:51.708680  1583 rpcz_store.cc:276] 0709 13:02:50.619323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.640629 (+ 21306us) service_pool.cc:224] Handling call
0709 13:02:51.678817 (+1038188us) spinlock_profiling.cc:243] Waited 85.6 ms on lock 0x7b54004376d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:51.678974 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":196834560}
I20260709 13:02:51.752112  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:51.749666  6974 consensus_queue.cc:237] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:51.754925  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:51.752233  6680 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:51.752830  1741 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:51.755754  1590 raft_consensus.cc:2368] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 12. Current term is 13.
I20260709 13:02:51.756685  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:51.761523  1587 raft_consensus.cc:2468] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 12.
I20260709 13:02:51.762490  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:51.763563  1732 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:51.755244  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:51.766851  1583 raft_consensus.cc:2393] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 8: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:51.752169  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:51.769515  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:51.770511  1583 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 9.
I20260709 13:02:51.772574  1661 raft_consensus.cc:1240] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:51.649962  7009 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.636837  6625 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:51.783983  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:51.784770  1585 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 13.
I20260709 13:02:51.776763  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:51.631090  6982 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:51.779449  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:51.786386  1662 raft_consensus.cc:2393] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 13: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:51.787587  1662 raft_consensus.cc:1240] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:02:51.776608  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:51.789600  1659 raft_consensus.cc:2393] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 18: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
W20260709 13:02:51.790047  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 56750.6us
I20260709 13:02:51.778434  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:51.778498  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:51.791074  2543 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:02:51.784873  1741 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:02:51.778196  6683 raft_consensus.cc:2804] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:51.691766  7037 raft_consensus.cc:2749] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:51.691185  6360 raft_consensus.cc:2804] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:51.728319  6920 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:51.794284  1705 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:51.837553  1705 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:51.838838  1705 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:51.727313  6713 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:51.775552  7030 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.840001  1555 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:51.840514  1663 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:02:51.636689  7012 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:51.798615  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:51.812438  2552 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 13.
I20260709 13:02:51.778996  6988 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:51.799974  6683 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.830224  7037 consensus_queue.cc:1048] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:51.848840  1662 raft_consensus.cc:1240] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:51.849639  1663 raft_consensus.cc:1275] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:02:51.852919  1704 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:51.840549  1705 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:51.856814  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:51.857713  1590 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 13.
I20260709 13:02:51.807782  7046 raft_consensus.cc:2749] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:51.878782  1663 raft_consensus.cc:1275] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:51.860351  2426 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:02:51.890688  1488 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55154 (request call id 306) took 31632 ms (client timeout 15000 ms). Trace:
I20260709 13:02:51.893553  1666 raft_consensus.cc:2393] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 14: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:51.853874  6683 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:51.901027  2426 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:51.805126  2553 raft_consensus.cc:2468] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:51.854224  6360 raft_consensus.cc:697] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:51.841320  7009 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:51.855219  6713 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:51.906962  6826 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:51.925073  1660 raft_consensus.cc:2468] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:02:51.938187  1490 catalog_manager.cc:5697] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 8 to 9, leader changed from 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
W20260709 13:02:51.891505  1488 rpcz_store.cc:269] 0709 13:02:20.258257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.258494 (+   237us) service_pool.cc:224] Handling call
0709 13:02:51.890592 (+31632098us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:49.285906 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:49.287385 (+  1479us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:49.287461 (+    76us) write_op.cc:435] Acquired schema lock
0709 13:02:49.287490 (+    29us) tablet.cc:662] Decoding operations
0709 13:02:49.288563 (+  1073us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:49.288693 (+   130us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:49.288750 (+    57us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:02:49.315948 (+ 27198us) tablet.cc:701] Row locks acquired
0709 13:02:49.316022 (+    74us) write_op.cc:260] PREPARE: finished
0709 13:02:49.316288 (+   266us) write_op.cc:270] Start()
0709 13:02:49.316490 (+   202us) write_op.cc:276] Timestamp: P: 1783602169316198 usec, L: 0
0709 13:02:49.316540 (+    50us) op_driver.cc:348] REPLICATION: starting
0709 13:02:49.390463 (+ 73923us) log.cc:844] Serialized 1313 byte log entry
0709 13:02:49.886223 (+495760us) op_driver.cc:464] REPLICATION: finished
0709 13:02:50.095757 (+209534us) write_op.cc:301] APPLY: starting
0709 13:02:50.095872 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:50.099155 (+  3283us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:50.099277 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:50.168479 (+ 69202us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:50.194317 (+ 25838us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:02:50.194385 (+    68us) write_op.cc:312] APPLY: finished
0709 13:02:50.194705 (+   320us) log.cc:844] Serialized 41 byte log entry
0709 13:02:50.196665 (+  1960us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:50.196789 (+   124us) write_op.cc:454] Released schema lock
0709 13:02:50.196858 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:50.197399 (+   541us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:50.197427 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":18590,"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":208941,"apply.run_cpu_time_us":9671,"apply.run_wall_time_us":101654,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16667,"num_ops":3,"prepare.queue_time_us":162028,"prepare.run_cpu_time_us":39583,"prepare.run_wall_time_us":249802,"raft.queue_time_us":210277,"raft.run_cpu_time_us":39983,"raft.run_wall_time_us":154334,"replication_time_us":569463,"thread_start_us":482833,"threads_started":4,"wal-append.queue_time_us":158180,"wal-append.run_cpu_time_us":20392,"wal-append.run_wall_time_us":1656018}]]}
I20260709 13:02:51.879570  6988 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:51.916292  7034 raft_consensus.cc:2804] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:51.878677  7030 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:51.910970  6961 raft_consensus.cc:2804] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:51.901031  7050 raft_consensus.cc:2804] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:51.954334  1659 raft_consensus.cc:1275] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:51.950943  1490 catalog_manager.cc:5697] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 10 to 12, leader changed from 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 12 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:02:51.973184  1666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39146 (request call id 3861) took 1034 ms. Trace:
I20260709 13:02:51.992213  1658 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:02:51.932148  7014 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:51.984956  1666 rpcz_store.cc:276] 0709 13:02:50.938894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.948391 (+  9497us) service_pool.cc:224] Handling call
0709 13:02:51.972844 (+1024453us) spinlock_profiling.cc:243] Waited 857 ms on lock 0x7b540044e654. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:51.973058 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1969972480}
I20260709 13:02:51.951890  7034 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.957419  6961 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.997495  1490 catalog_manager.cc:5697] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:51.946939  7049 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:51.957779  7050 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:51.973851  7000 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:51.968015  6862 raft_consensus.cc:3055] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:51.971536  7054 raft_consensus.cc:2749] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:51.968212  6464 raft_consensus.cc:2804] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:52.027644  6464 raft_consensus.cc:697] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 13 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:52.028801  6464 consensus_queue.cc:237] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:51.981458  6992 raft_consensus.cc:2749] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:51.968274  6975 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:52.011574  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 263914us
I20260709 13:02:51.963897  7051 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:52.019052  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:52.035671  1741 raft_consensus.cc:2393] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 10: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:52.005149  6961 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:52.020977  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 168130us
I20260709 13:02:52.010941  6968 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.006075  7034 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:52.023844  7047 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:52.016887  1490 catalog_manager.cc:5697] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 10 to 11, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 11 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:51.973362  6963 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:52.011287  6994 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.045646  1633 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:51.929888  1732 raft_consensus.cc:2468] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:02:52.040740  6967 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.012873  7050 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:52.016007  6862 raft_consensus.cc:740] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:52.029421  2554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919"
dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:33568
I20260709 13:02:52.077639  2554 raft_consensus.cc:606] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:52.078089  2554 raft_consensus.cc:614] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:51.971920  6360 consensus_queue.cc:237] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:52.078977  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 45730.4us
I20260709 13:02:52.031047  6911 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:52.076509  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:52.085448  1733 raft_consensus.cc:1240] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:02:52.086001  1734 raft_consensus.cc:1240] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:02:52.034476  7051 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:52.086962  1707 leader_election.cc:400] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 13. Current term is 14.
I20260709 13:02:52.091799  1707 leader_election.cc:403] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
W20260709 13:02:52.081138  7056 log.cc:927] Time spent T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.135s	user 0.000s	sys 0.002s
W20260709 13:02:52.101333  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 55818.1us
I20260709 13:02:52.099031  1490 catalog_manager.cc:5697] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 6 to 9, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 9 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:52.091867  6674 raft_consensus.cc:2749] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:52.098933  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 198802us
I20260709 13:02:52.106029  1707 leader_election.cc:400] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 12. Current term is 13.
I20260709 13:02:52.113233  1707 leader_election.cc:403] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:02:52.112766  1732 raft_consensus.cc:1275] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:52.049597  6968 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:52.090126  6982 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.043915  6975 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:52.117019  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 276614us
I20260709 13:02:52.118535  1707 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:52.119793  1633 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:52.122596  7047 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:52.089943  7054 consensus_queue.cc:1059] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:02:52.125406  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:52.126931  7058 raft_consensus.cc:2749] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 13. Current term is 14.
I20260709 13:02:52.128921  6968 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:52.095492  7051 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:52.075059  6994 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:52.081523  6967 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:52.108460  7012 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:52.147163  1633 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:52.155417  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:52.158459  1490 catalog_manager.cc:5697] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 9 to 13, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 13 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:52.163245  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:52.162813  1732 raft_consensus.cc:1275] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:52.165063  1585 raft_consensus.cc:1240] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:02:52.166227  1739 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:52.170544  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:52.175541  1583 raft_consensus.cc:2393] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 12: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
W20260709 13:02:52.175742  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 548051us
I20260709 13:02:52.178154  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:52.178860  1583 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:52.156831  7002 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:52.169682  6713 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:52.177408  7047 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:52.197480  7047 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.197898  7047 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:52.201488  7053 log.cc:927] Time spent T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:02:52.204082  7058 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:52.205631  6713 consensus_queue.cc:1059] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:52.206427  1556 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:52.207198  6713 raft_consensus.cc:3055] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:52.208000  6713 raft_consensus.cc:740] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:52.208261  6992 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:52.208499  7063 log.cc:927] Time spent T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:02:52.141531  7060 raft_consensus.cc:2749] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 12. Current term is 13.
I20260709 13:02:52.209678  7054 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:52.210232  7054 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:52.208050  7023 raft_consensus.cc:2804] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:52.212656  6969 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.204658  7058 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:52.213152  7023 raft_consensus.cc:697] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:52.215067  7030 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:52.209657  6713 consensus_queue.cc:260] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:52.219786  6713 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:52.208979  6992 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:52.221828  6992 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:52.216897  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:52.217291  7009 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:52.216007  7058 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:52.214701  7023 consensus_queue.cc:237] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:52.223551  6973 consensus_queue.cc:1059] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:52.224021  7000 consensus_queue.cc:1048] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:52.226004  6821 raft_consensus.cc:3055] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:52.226528  6821 raft_consensus.cc:740] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:52.226864  6975 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:52.227416  6821 consensus_queue.cc:260] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:52.229923  6994 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:52.228837  6821 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:52.231585  6967 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:52.134815  6982 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:52.232587  1556 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:52.234745  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:52.245621  1666 raft_consensus.cc:2468] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 9.
I20260709 13:02:52.246910  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:52.233233  1704 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:52.247330  2424 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:52.247560  1733 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:52.160516  7064 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:52.242035  1661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 2973) took 1008 ms. Trace:
I20260709 13:02:52.278666  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:52.279142  1583 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 22.
I20260709 13:02:52.182696  6674 raft_consensus.cc:2804] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:52.287626  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:52.186726  6988 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:52.295408  1739 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
W20260709 13:02:52.295881  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 148869us
I20260709 13:02:52.297161  1633 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:52.298069  1741 raft_consensus.cc:1275] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:52.281376  1732 raft_consensus.cc:1275] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:02:52.284092  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:52.212690  7054 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:52.279464  1667 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 13.
I20260709 13:02:52.290973  1587 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 18.
I20260709 13:02:52.254683  1661 rpcz_store.cc:276] 0709 13:02:51.234004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.774491 (+540487us) service_pool.cc:224] Handling call
0709 13:02:51.774823 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:51.850130 (+ 75307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:51.850191 (+    61us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:51.902847 (+ 52656us) log.cc:844] Serialized 26 byte log entry
0709 13:02:52.110503 (+207656us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:52.110562 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:52.110657 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:52.241649 (+130992us) raft_consensus.cc:1685] finished
0709 13:02:52.241672 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:52.241968 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28703,"raft.queue_time_us":78916,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":25490,"thread_start_us":157635,"threads_started":1,"wal-append.queue_time_us":271005}
W20260709 13:02:52.295962  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 60609.7us
I20260709 13:02:52.299588  1737 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 15.
I20260709 13:02:52.307650  1490 catalog_manager.cc:5697] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 7 to 9, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 9 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:52.280294  6967 raft_consensus.cc:2804] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:52.322152  1490 catalog_manager.cc:5697] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 11 to 12, leader changed from 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 12 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:02:52.322973  1558 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:52.233004  6364 consensus_queue.cc:1059] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.111s
I20260709 13:02:52.156056  6862 consensus_queue.cc:260] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:52.200943  6683 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:52.287685  6674 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:52.404160  6674 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:52.389545  2424 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:52.401551  1490 catalog_manager.cc:5697] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 5 to 6, leader changed from 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 6 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:02:52.244315  7002 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:52.315265  6625 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.250983  6969 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:52.448208  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 58654.1us
I20260709 13:02:52.392110  6967 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.241251  6961 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:52.325742  7064 raft_consensus.cc:2749] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:52.416100  7051 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:52.422528  6920 consensus_meta.cc:287] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.571s	user 0.007s	sys 0.006s
I20260709 13:02:52.420945  7034 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:52.409799  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 112636us
I20260709 13:02:52.522817  1633 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:02:52.454531  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 265112us
I20260709 13:02:52.524001  6994 consensus_queue.cc:1048] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:02:52.461313  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 231209us
I20260709 13:02:52.527486  2554 raft_consensus.cc:2368] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 12. Current term is 13.
I20260709 13:02:52.493667  1733 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 14.
I20260709 13:02:52.462904  6967 raft_consensus.cc:3060] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:52.532119  2426 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:52.453380  6963 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:52.485929  6862 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:52.485642  6982 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:52.537369  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:52.551649  1587 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 14.
I20260709 13:02:52.542683  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:02:52.519474  7059 log.cc:927] Time spent T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.231s	user 0.002s	sys 0.000s
I20260709 13:02:52.551021  2553 raft_consensus.cc:2393] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 11: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:02:52.551568  1633 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:52.554829  7064 raft_consensus.cc:2764] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:02:52.556699  1633 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:52.559509  1658 raft_consensus.cc:1275] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:02:52.561478  1667 raft_consensus.cc:1275] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:02:52.565575  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:52.566839  1658 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 14.
I20260709 13:02:52.568358  7064 raft_consensus.cc:2764] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:02:52.569190  1667 raft_consensus.cc:1275] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:02:52.571233  1633 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:52.575289  1659 raft_consensus.cc:1275] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:02:52.536608  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:52.521202  7000 raft_consensus.cc:2804] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:52.580049  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:52.582168  1661 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:52.453516  6674 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:52.451185  6625 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:52.525851  6920 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:52.533246  7012 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:52.512053  7047 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:52.581161  6950 raft_consensus.cc:2804] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:52.573676  6994 raft_consensus.cc:2749] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:52.591897  6982 raft_consensus.cc:2804] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:02:52.611057  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 461511us
I20260709 13:02:52.655355  1664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 2986) took 1398 ms. Trace:
W20260709 13:02:52.655476  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 332559us
I20260709 13:02:52.620666  1665 raft_consensus.cc:2393] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 13: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:52.654436  1633 leader_election.cc:400] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 19. Current term is 20.
I20260709 13:02:52.746965  1633 leader_election.cc:403] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:52.602965  7081 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.743105  1664 rpcz_store.cc:276] 0709 13:02:51.256598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.788285 (+531687us) service_pool.cc:224] Handling call
0709 13:02:51.788602 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:51.788952 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:52.004100 (+215148us) log.cc:844] Serialized 14 byte log entry
0709 13:02:52.654900 (+650800us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:52.654970 (+    70us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:52.655042 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:52.655128 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:52.655280 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9769,"prepare.queue_time_us":253550,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":8462,"raft.queue_time_us":16829,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":18992,"thread_start_us":850571,"threads_started":3,"wal-append.queue_time_us":390944}
W20260709 13:02:52.764494  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 188926us
I20260709 13:02:52.766551  1633 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:52.608769  7067 raft_consensus.cc:2804] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:52.745038  6969 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:52.776214  1661 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 14.
I20260709 13:02:52.781658  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:52.782850  1736 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 14.
I20260709 13:02:52.609791  6950 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:52.793108  7076 log.cc:927] Time spent T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:02:52.793506  6950 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:52.795629  6821 consensus_meta.cc:287] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.564s	user 0.010s	sys 0.001s
W20260709 13:02:52.769048  7070 log.cc:927] Time spent T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.282s	user 0.002s	sys 0.000s
I20260709 13:02:52.797276  7064 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:52.782056  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:52.799011  1737 raft_consensus.cc:2468] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 9.
I20260709 13:02:52.709678  7092 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.676744  6876 raft_consensus.cc:2804] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:52.752600  6994 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:52.782757  7002 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:52.731689  6982 raft_consensus.cc:697] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:52.784449  7009 raft_consensus.cc:2749] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 19. Current term is 20.
I20260709 13:02:52.869755  6876 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.908864  6876 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:52.913810  6920 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:52.796918  7084 log.cc:927] Time spent T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:02:52.917485  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:52.917879  7047 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:52.918650  2550 raft_consensus.cc:2393] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 13: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:02:52.827045  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:52.920235  1739 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 13.
I20260709 13:02:52.792719  6961 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:52.789820  1633 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:52.753125  6683 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:52.888962  6994 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:52.895006  7085 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.901579  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:52.901779  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:52.902005  6982 consensus_queue.cc:237] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:52.903677  6674 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:53.112098  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:53.127295  1590 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:02:53.141832  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:53.141669  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:02:52.949980  1490 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.035s	sys 0.045s
W20260709 13:02:53.184449  1490 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.040s	sys 0.068s
W20260709 13:02:53.076799  1555 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.001s	sys 0.041s
W20260709 13:02:53.185212  1555 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.004s	sys 0.045s
I20260709 13:02:53.076576  1665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39146 (request call id 3867) took 1794 ms. Trace:
I20260709 13:02:53.190124  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:53.190990  1658 raft_consensus.cc:2393] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 in current term 13: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:53.193717  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:53.196586  1587 raft_consensus.cc:2468] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 12.
I20260709 13:02:53.197372  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:53.189142  1665 rpcz_store.cc:276] 0709 13:02:51.282057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.746275 (+464218us) service_pool.cc:224] Handling call
0709 13:02:53.076329 (+1330054us) spinlock_profiling.cc:243] Waited 869 ms on lock 0x7b5400241b54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:53.076476 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1998844160}
I20260709 13:02:53.198035  1585 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 12.
I20260709 13:02:52.853276  7000 raft_consensus.cc:697] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:52.870801  7034 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:53.211882  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:53.177614  1590 raft_consensus.cc:606] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:02:53.268950  1558 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.045s	sys 0.076s
W20260709 13:02:53.269398  1558 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.045s	sys 0.076s
I20260709 13:02:53.205407  2426 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:02:53.269690  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 525055us
I20260709 13:02:53.207096  1659 raft_consensus.cc:1275] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:02:53.202685  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 412886us
I20260709 13:02:52.856987  7067 raft_consensus.cc:697] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:53.211115  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:53.190548  6826 consensus_meta.cc:287] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 1.243s	user 0.017s	sys 0.000s
I20260709 13:02:53.231434  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:02:53.076391  7050 consensus_meta.cc:287] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.975s	user 0.011s	sys 0.000s
I20260709 13:02:53.232424  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:53.278932  1588 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:53.280705  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:53.281694  1665 raft_consensus.cc:1275] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:53.233256  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:53.192049  6948 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.282979  1660 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:02:52.918646  7051 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:53.112130  6973 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.138036  6957 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:52.980222  6920 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.260879  6974 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:53.309388  6920 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:52.953552  6625 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:53.311026  7075 log.cc:927] Time spent T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.717s	user 0.004s	sys 0.000s
I20260709 13:02:52.990586  7009 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.192648  7047 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:53.209805  6360 raft_consensus.cc:3055] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:53.271442  1633 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:52.774909  7081 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:53.274217  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:53.275230  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 69918.5us
I20260709 13:02:53.206703  6464 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:53.207773  7085 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:53.264285  7002 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.231199  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:53.346181  1591 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:53.287181  1659 raft_consensus.cc:1275] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:02:52.887254  7092 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:53.290949  1658 raft_consensus.cc:3055] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:53.347596  1658 raft_consensus.cc:740] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:53.291260  7049 raft_consensus.cc:3055] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:02:53.291814  7090 log.cc:927] Time spent T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:02:53.304922  7086 consensus_queue.cc:1048] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:53.258212  7079 raft_consensus.cc:2804] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:53.310787  6625 consensus_queue.cc:1048] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:52.903710  7023 consensus_queue.cc:1048] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.359s
I20260709 13:02:53.264106  6994 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:53.283178  6948 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:52.956822  6876 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:53.312244  1558 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:02:53.368594  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 57115.3us
I20260709 13:02:53.369710  1558 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
W20260709 13:02:53.285105  6862 consensus_meta.cc:287] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.706s	user 0.013s	sys 0.002s
W20260709 13:02:53.319183  1705 leader_election.cc:336] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.910s (SENT)
I20260709 13:02:53.313964  1588 raft_consensus.cc:2468] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 13.
I20260709 13:02:53.263634  7000 consensus_queue.cc:237] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:53.373811  1592 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 14.
W20260709 13:02:53.377336  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 105983us
I20260709 13:02:53.313447  6973 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:53.362061  6826 raft_consensus.cc:2749] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:53.283735  7012 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.286023  7034 raft_consensus.cc:2804] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:53.286504  7050 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:53.309823  6974 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:53.323951  7047 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:53.323581  7110 consensus_queue.cc:1048] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:02:53.357203  2553 raft_consensus.cc:1275] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:53.357321  1740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3814) took 1608 ms. Trace:
I20260709 13:02:53.380052  7094 raft_consensus.cc:2804] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:53.319841  6360 raft_consensus.cc:740] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:53.356221  1658 consensus_queue.cc:260] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:53.322983  7096 consensus_queue.cc:1048] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:02:53.354748  7049 raft_consensus.cc:740] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:53.385454  2550 raft_consensus.cc:1275] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:53.386912  6948 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:53.389061  6876 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 15 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:53.319873  7024 consensus_queue.cc:1048] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:02:53.395059  7092 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:53.437860  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 62590.9us
I20260709 13:02:53.397624  7085 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:53.360450  7002 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:53.400691  7067 consensus_queue.cc:237] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:53.322000  7009 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:53.372968  1705 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:53.318320  1556 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:53.315096  6957 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:53.413995  1591 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 13.
W20260709 13:02:53.463303  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 176211us
I20260709 13:02:53.415045  1740 rpcz_store.cc:276] 0709 13:02:51.748822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.749851 (+  1029us) service_pool.cc:224] Handling call
0709 13:02:51.756232 (+  6381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:52.042384 (+286152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:52.042416 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:52.074915 (+ 32499us) log.cc:844] Serialized 26 byte log entry
0709 13:02:52.326696 (+251781us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:52.326899 (+   203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:52.327012 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:53.310336 (+983324us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b4400022b4c. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7ddc8c85 00007f1b7ddc96a2 00007f1b80b3b1db 00007f1b80b36aaf 00007f1b80b2a86e 00007f1b80b29bb6 00007f1b80b297d8 00007f1b80b33221 00007f1b80b331d9 00007f1b80b33169
0709 13:02:53.348834 (+ 38498us) raft_consensus.cc:1685] finished
0709 13:02:53.348857 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:53.357211 (+  8354us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16851,"raft.queue_time_us":148960,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":29498,"spinlock_wait_cycles":6487296,"thread_start_us":492505,"threads_started":2,"wal-append.queue_time_us":411706}
I20260709 13:02:53.313779  7083 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.374156  6683 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:53.402673  6713 consensus_meta.cc:287] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 1.158s	user 0.009s	sys 0.007s
W20260709 13:02:53.469904  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 151666us
I20260709 13:02:53.471561  1556 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:53.378295  7079 raft_consensus.cc:697] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 13 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
W20260709 13:02:53.405117  7064 consensus_meta.cc:287] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.607s	user 0.010s	sys 0.003s
I20260709 13:02:53.431393  6826 consensus_queue.cc:1059] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:02:53.376546  7107 raft_consensus.cc:2804] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:53.486164  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:53.487210  1666 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:02:53.406412  7034 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.403621  7051 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.430888  1589 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:53.416738  6968 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.439942  1707 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:53.442289  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:53.444855  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:02:53.445503  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 112254us
I20260709 13:02:53.445528  1737 raft_consensus.cc:1240] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:53.502595  1738 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:02:53.448822  1732 raft_consensus.cc:1240] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:53.453426  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:53.458702  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:53.461596  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:53.462044  1734 raft_consensus.cc:1275] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:02:53.462772  1704 leader_election.cc:400] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Vote denied by peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157) with higher term. Message: Invalid argument: T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 12. Current term is 13.
I20260709 13:02:53.506589  1739 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:02:53.507007  1704 leader_election.cc:403] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:53.414316  7012 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:53.508829  2523 raft_consensus.cc:2393] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 15: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:02:53.509837  2426 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:53.432883  7094 raft_consensus.cc:697] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:02:53.514914  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 75069.7us
I20260709 13:02:53.438889  6364 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.474099  1740 raft_consensus.cc:1275] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:02:53.476476  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 157374us
I20260709 13:02:53.424817  1658 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:53.486011  2552 raft_consensus.cc:2410] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:02:53.358013  6464 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:53.454733  6674 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:53.482177  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:53.523545  2426 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:02:53.484421  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 80688.1us
W20260709 13:02:53.472208  6967 consensus_meta.cc:287] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent flushing consensus metadata: real 0.890s	user 0.007s	sys 0.009s
I20260709 13:02:53.464303  7085 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:53.473469  6862 raft_consensus.cc:2749] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:53.583418  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 120821us
I20260709 13:02:53.515888  1707 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:53.484825  6881 raft_consensus.cc:2804] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:53.491807  7064 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:53.530767  7047 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:53.611057  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:53.494707  6875 consensus_queue.cc:1048] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:02:53.516903  6968 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:53.519547  7081 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:53.485610  7049 consensus_queue.cc:260] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:53.483609  6683 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:53.537894  6950 consensus_meta.cc:287] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent flushing consensus metadata: real 0.744s	user 0.010s	sys 0.005s
I20260709 13:02:53.538481  1556 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:53.542387  7110 consensus_queue.cc:1048] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:53.549176  1666 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 15.
I20260709 13:02:53.548974  1583 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 16.
I20260709 13:02:53.487704  7105 consensus_queue.cc:1048] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:02:53.554375  6975 raft_consensus.cc:2804] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:53.486922  7107 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:53.493191  7034 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:53.560730  1633 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:53.526921  1665 raft_consensus.cc:2468] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 11.
W20260709 13:02:53.597191  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 75005.8us
I20260709 13:02:53.608913  6876 raft_consensus.cc:2804] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:53.604138  1658 raft_consensus.cc:1275] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:02:53.606084  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:02:53.690637  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 130017us
I20260709 13:02:53.690819  1658 pending_rounds.cc:85] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 8
I20260709 13:02:53.691421  1658 pending_rounds.cc:107] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:02:53.608136  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:53.561731  7114 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:53.691960  1658 raft_consensus.cc:2889] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:53.692389  7114 raft_consensus.cc:697] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 22 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:53.508953  7051 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:53.497720  7108 consensus_queue.cc:1048] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.128s
I20260709 13:02:53.693524  7114 consensus_queue.cc:237] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:53.673698  2424 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:53.590296  6881 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.482571  7083 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:53.685165  1705 leader_election.cc:336] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.639s (SENT)
I20260709 13:02:53.513125  6878 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:53.685806  1589 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 11.
I20260709 13:02:53.687760  2523 raft_consensus.cc:1275] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:02:53.687899  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 149499us
I20260709 13:02:53.706141  2424 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:53.707581  7094 consensus_queue.cc:237] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:53.675058  6862 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:02:53.585259  6967 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:53.691011  1588 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:53.630584  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:53.592407  6920 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:53.562379  6364 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:53.699834  1705 leader_election.cc:336] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.747s (SENT)
I20260709 13:02:53.584910  6674 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:53.711393  1736 raft_consensus.cc:1275] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 13:02:53.594762  7085 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:53.738904  1736 pending_rounds.cc:85] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 6
I20260709 13:02:53.739634  1736 pending_rounds.cc:107] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:02:53.722915  1738 raft_consensus.cc:1240] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:53.682196  7107 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:53.699862  6713 raft_consensus.cc:2749] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:53.746726  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:53.747610  1667 raft_consensus.cc:1240] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:53.704628  6881 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:53.751912  7125 raft_consensus.cc:2804] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:53.740549  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:53.702188  7064 raft_consensus.cc:2749] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:53.740056  1736 raft_consensus.cc:2889] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:53.742533  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:53.721594  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:53.761014  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:53.761392  1732 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:53.761818  1660 raft_consensus.cc:2393] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 14: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:53.744531  1556 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:53.695786  6975 raft_consensus.cc:697] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:53.748710  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:53.750313  1663 raft_consensus.cc:1240] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:53.686957  7049 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:53.673703  6950 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:53.709286  6876 raft_consensus.cc:697] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:53.709594  7079 consensus_queue.cc:237] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:53.584441  6360 consensus_queue.cc:260] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:53.702539  7047 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:53.709481  6826 consensus_queue.cc:1048] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 13:02:53.739876  1705 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:53.753249  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:53.753737  1739 raft_consensus.cc:1240] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 13. Current term is 14. Ops: []
W20260709 13:02:53.757035  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 50974.1us
I20260709 13:02:53.757417  1665 raft_consensus.cc:2393] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 18: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:53.778925  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:02:53.758466  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:53.742601  6878 raft_consensus.cc:697] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:53.760092  1588 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 15.
I20260709 13:02:53.756536  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:53.738528  7078 raft_consensus.cc:2804] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:53.767787  1663 raft_consensus.cc:1275] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:53.782383  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:53.768323  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:53.754686  7050 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:53.786705  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:53.787475  1660 raft_consensus.cc:2393] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 14: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:53.773627  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:53.752167  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:53.756223  7125 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.759562  6974 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:53.737823  7101 consensus_queue.cc:1048] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:02:53.774401  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:53.752642  7121 raft_consensus.cc:2804] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:53.761734  7115 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.712831  7118 consensus_queue.cc:1059] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:02:53.803213  6876 consensus_queue.cc:237] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:53.806753  7118 raft_consensus.cc:3055] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:53.807612  7118 raft_consensus.cc:740] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
W20260709 13:02:53.810748  7116 log.cc:927] Time spent T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:02:53.785228  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:53.817952  1739 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 13.
I20260709 13:02:53.783968  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:53.791052  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:53.759341  7108 consensus_queue.cc:1048] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:02:53.792251  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:53.792580  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:53.824822  1590 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:53.825305  1586 raft_consensus.cc:2393] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 13: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:02:53.793037  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:53.793758  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:53.769260  7110 raft_consensus.cc:2804] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:53.794409  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:53.798974  1732 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 14.
I20260709 13:02:53.800174  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:53.801968  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:53.804360  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:53.805249  1633 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:53.831279  1592 raft_consensus.cc:2410] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:02:53.810266  6975 consensus_queue.cc:237] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:53.782648  6957 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:53.813195  6950 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:53.788302  1667 raft_consensus.cc:2393] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 15: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:02:53.819859  1658 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 20.
I20260709 13:02:53.771319  6713 consensus_queue.cc:1048] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:02:53.777356  7023 consensus_queue.cc:1048] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:02:53.794345  7125 raft_consensus.cc:3060] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:53.834371  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:53.845539  1739 raft_consensus.cc:2393] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 14: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:53.834178  1633 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:53.835886  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:53.795053  7083 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:53.799778  7009 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:53.803233  7078 raft_consensus.cc:697] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:53.783167  7047 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:53.842128  7002 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:53.830996  7110 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.856253  1633 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:53.808743  7118 consensus_queue.cc:260] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:53.851184  7064 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.887138  1633 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:53.870122  6881 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:53.843664  7128 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:53.853605  7127 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:53.879763  7117 raft_consensus.cc:2764] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 13:02:53.880578  7119 log.cc:927] Time spent T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
W20260709 13:02:53.880887  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:53.882340  6826 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:53.818275  7115 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:53.883177  6364 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:53.883895  7122 raft_consensus.cc:476] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 15 LEADER]: Not starting pre-election -- already a leader
I20260709 13:02:53.884423  6878 consensus_queue.cc:237] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:53.872869  6464 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:53.872323  7085 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:53.897483  7110 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:53.897888  6674 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:53.898387  7009 raft_consensus.cc:2749] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:53.893008  1590 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 13.
I20260709 13:02:53.901976  1633 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:53.893842  1588 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 14.
W20260709 13:02:53.924775  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 408927us
I20260709 13:02:53.934662  6920 raft_consensus.cc:2749] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:53.850210  7083 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:53.981146  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 79296.9us
I20260709 13:02:53.982470  1633 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:53.939628  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:53.864856  7047 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:53.951336  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 251519us
W20260709 13:02:53.985359  1705 leader_election.cc:336] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.883s (SENT)
I20260709 13:02:53.986011  1705 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:53.953933  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 172402us
I20260709 13:02:53.951683  6826 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:53.898952  6968 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:53.952903  7121 raft_consensus.cc:697] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 18 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:53.972509  1556 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:53.996196  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:53.967476  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:54.011883  6881 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:53.939985  7064 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:53.934239  7127 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:54.197914  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 212610us
W20260709 13:02:54.204942  1705 leader_election.cc:336] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.899s (SENT)
I20260709 13:02:53.965803  7122 consensus_queue.cc:1048] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.240s
I20260709 13:02:54.134637  7047 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.206315  7064 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:54.206398  7047 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:54.205456  1705 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:54.012130  7131 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:53.933877  7128 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:54.011340  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:54.209705  1705 leader_election.cc:336] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.909s (SENT)
I20260709 13:02:54.007220  1659 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16.
W20260709 13:02:54.012415  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.211963  1705 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:54.219075  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:53.994056  6464 raft_consensus.cc:2749] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:54.203838  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:54.236073  7128 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:54.238905  7130 log.cc:927] Time spent T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
W20260709 13:02:54.239512  6862 consensus_meta.cc:287] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.524s	user 0.006s	sys 0.004s
I20260709 13:02:54.240104  6862 raft_consensus.cc:2749] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157) with higher term. Message: Invalid argument: T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 12. Current term is 13.
I20260709 13:02:54.199895  7118 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:54.016053  6826 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:54.214043  2523 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
I20260709 13:02:54.219883  1666 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 15.
I20260709 13:02:54.262915  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:54.211018  7085 raft_consensus.cc:2749] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:54.260070  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:53.964759  6967 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:54.261199  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:54.268368  1665 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:54.015775  6994 raft_consensus.cc:3055] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:54.269239  6994 raft_consensus.cc:740] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:54.270219  6994 consensus_queue.cc:260] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:54.271515  6994 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:54.272470  7088 raft_consensus.cc:993] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:02:54.263542  1659 raft_consensus.cc:3060] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:54.273031  7002 raft_consensus.cc:1081] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Signalling peer 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:02:54.258150  1556 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:54.217134  6920 raft_consensus.cc:2749] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:54.276135  6974 raft_consensus.cc:2804] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:54.276620  6974 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:54.277040  6974 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:54.277645  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:54.277988  1592 raft_consensus.cc:1240] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:02:54.280005  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:54.015548  7108 raft_consensus.cc:2749] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:54.116798  7078 consensus_queue.cc:237] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:54.233469  7064 raft_consensus.cc:2749] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:54.217432  6821 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.281052  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:54.291291  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:54.294307  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:54.288143  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:54.313295  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:54.314231  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 104564us
W20260709 13:02:54.316491  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 334141us
I20260709 13:02:54.317008  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:54.321204  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:54.311065  1558 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:54.321034  1633 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:54.337062  1738 raft_consensus.cc:2393] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 10: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:54.337607  1659 raft_consensus.cc:2468] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 10.
I20260709 13:02:54.338088  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:54.338896  1738 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
I20260709 13:02:54.339998  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:54.336935  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:54.341018  1738 raft_consensus.cc:2410] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:02:54.004508  7083 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:54.296275  7049 consensus_meta.cc:287] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.524s	user 0.008s	sys 0.002s
I20260709 13:02:54.378604  1665 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 15.
I20260709 13:02:54.383193  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:54.385159  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:54.389716  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 78732.8us
I20260709 13:02:54.286875  7115 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:54.390573  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:54.391076  1738 raft_consensus.cc:1275] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:02:54.391501  1558 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:54.391534  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:54.400575  1585 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:54.401818  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:54.291882  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:54.292601  6683 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:54.394369  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 57645us
I20260709 13:02:54.335652  7128 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:54.412002  1587 raft_consensus.cc:1240] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:54.336910  7085 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:54.335837  6821 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:54.370927  6862 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:54.296427  6974 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:54.414211  6975 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.007s	sys 0.055s
I20260709 13:02:54.370425  7088 consensus_queue.cc:1059] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:02:54.400672  7050 raft_consensus.cc:2804] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:54.281628  7121 consensus_queue.cc:237] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:54.414757  7122 consensus_queue.cc:1059] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:02:54.456518  2548 raft_consensus.cc:2393] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 10: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:02:54.458660  7088 raft_consensus.cc:3055] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:54.465065  7088 raft_consensus.cc:740] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:54.466585  7088 consensus_queue.cc:260] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:54.468514  7088 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:54.471582  1585 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 14.
I20260709 13:02:54.473414  7131 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:54.458938  7083 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:54.459425  7067 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.441934  7023 raft_consensus.cc:2749] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:54.448711  7050 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:54.501449  7034 consensus_meta.cc:287] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6: Time spent flushing consensus metadata: real 0.801s	user 0.009s	sys 0.004s
W20260709 13:02:54.446641  6975 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.007s	sys 0.055s
I20260709 13:02:54.439814  7085 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:54.445677  6862 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:54.460067  1705 leader_election.cc:336] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.748s (SENT)
W20260709 13:02:55.161167  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 701070us
W20260709 13:02:55.161880  1705 leader_election.cc:336] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.758s (SENT)
I20260709 13:02:55.162286  1705 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:54.478366  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:55.166617  1738 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16.
I20260709 13:02:55.167968  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:55.168743  1738 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:54.553546  7125 consensus_meta.cc:287] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent flushing consensus metadata: real 0.692s	user 0.011s	sys 0.003s
I20260709 13:02:55.169993  7125 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:55.172348  7125 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 12 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:54.474138  7131 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:55.175320  7131 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:54.509917  7050 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:54.655468  7137 log.cc:927] Time spent T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
W20260709 13:02:54.655512  7151 log.cc:927] Time spent T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:02:54.723654  6862 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:54.775034  7085 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:54.848752  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.909721  6973 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:54.940387  1667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3904) took 1004 ms. Trace:
I20260709 13:02:54.962009  7083 raft_consensus.cc:3055] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:54.980017  2424 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:55.189778  7083 raft_consensus.cc:740] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
W20260709 13:02:55.190109  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 210271us
I20260709 13:02:55.189644  1667 rpcz_store.cc:276] 0709 13:02:53.936325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.936539 (+   214us) service_pool.cc:224] Handling call
0709 13:02:53.937011 (+   472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:54.371348 (+434337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:54.371446 (+    98us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:54.384649 (+ 13203us) log.cc:844] Serialized 26 byte log entry
0709 13:02:54.939952 (+555303us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:54.940001 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.940082 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:54.940134 (+    52us) raft_consensus.cc:1685] finished
0709 13:02:54.940149 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:54.940296 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10303,"raft.queue_time_us":42745,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":11810,"thread_start_us":931597,"threads_started":2,"wal-append.queue_time_us":212890}
I20260709 13:02:55.191304  2424 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:55.192111  7066 raft_consensus.cc:2804] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:55.192556  7066 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:54.995818  6974 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:55.004958  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.192929  6680 raft_consensus.cc:2804] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:55.017382  7127 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:55.193534  6680 raft_consensus.cc:697] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
W20260709 13:02:55.043818  7120 log.cc:927] Time spent T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 1.277s	user 0.004s	sys 0.003s
W20260709 13:02:55.049309  1733 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.008s	sys 0.009s
W20260709 13:02:55.052253  1739 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.022s	sys 0.026s
W20260709 13:02:55.195402  1733 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.008s	sys 0.010s
W20260709 13:02:55.195740  1739 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.023s	sys 0.026s
W20260709 13:02:55.060206  7118 consensus_meta.cc:287] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.797s	user 0.014s	sys 0.000s
W20260709 13:02:55.067548  1556 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.005s	sys 0.003s
I20260709 13:02:54.534868  7034 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:55.196991  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:55.197429  1659 raft_consensus.cc:1275] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:02:55.197834  1659 pending_rounds.cc:85] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 6
I20260709 13:02:55.198076  1659 pending_rounds.cc:107] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:02:55.198185  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:55.194669  6680 consensus_queue.cc:237] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:55.197014  1556 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.006s	sys 0.004s
W20260709 13:02:55.199345  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 820696us
I20260709 13:02:55.199429  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:55.117290  7134 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.192974  7066 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:55.121253  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:55.128047  1584 raft_consensus.cc:1240] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:55.190816  7083 consensus_queue.cc:260] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:54.983382  1737 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.007s	sys 0.013s
W20260709 13:02:55.205602  1737 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.008s	sys 0.014s
I20260709 13:02:55.205305  7083 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:55.207244  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:55.198391  1659 raft_consensus.cc:2889] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:55.097908  6826 consensus_meta.cc:287] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.773s	user 0.012s	sys 0.000s
I20260709 13:02:55.210381  6826 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:55.116722  7107 consensus_meta.cc:287] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 1.352s	user 0.017s	sys 0.000s
I20260709 13:02:55.213452  7107 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:55.202294  7134 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:55.117746  7128 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:55.193571  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.216194  7128 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:55.218629  7085 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:55.219170  7107 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:55.198647  7034 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 15 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:55.219573  7085 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:55.205305  7127 raft_consensus.cc:2749] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:55.221932  6826 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:55.228036  6973 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:55.229126  7157 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:55.228034  7087 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:55.229933  7157 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:55.230333  7087 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:55.228739  6973 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:55.232832  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:55.233744  1737 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:55.244606  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 82755.4us
W20260709 13:02:55.248127  1705 leader_election.cc:336] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.862s (SENT)
W20260709 13:02:55.250212  1705 leader_election.cc:336] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.914s (SENT)
I20260709 13:02:55.251096  1705 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:55.257444  1733 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 13.
I20260709 13:02:55.259068  7127 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:55.259646  7157 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:55.260335  7128 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:55.260438  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:55.262233  1733 raft_consensus.cc:3060] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:55.263079  7087 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:55.254082  7107 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.268440  7107 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:55.271245  7107 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:55.258226  1705 leader_election.cc:336] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.934s (SENT)
I20260709 13:02:55.274642  6821 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:55.274712  1705 leader_election.cc:336] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.024s (SENT)
W20260709 13:02:55.275766  1662 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.861s	user 0.014s	sys 0.015s
W20260709 13:02:55.276115  1662 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.015s	sys 0.015s
I20260709 13:02:55.276846  1662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3909) took 1319 ms. Trace:
I20260709 13:02:55.277208  1662 rpcz_store.cc:276] 0709 13:02:53.957041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.957220 (+   179us) service_pool.cc:224] Handling call
0709 13:02:53.957585 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:54.334207 (+376622us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:54.334260 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:54.335133 (+   873us) log.cc:844] Serialized 26 byte log entry
0709 13:02:55.276474 (+941341us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:55.276513 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.276583 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.276625 (+    42us) raft_consensus.cc:1685] finished
0709 13:02:55.276635 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.276759 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":219598,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":11072,"thread_start_us":1244927,"threads_started":2,"wal-append.queue_time_us":275282}
I20260709 13:02:55.278529  1733 raft_consensus.cc:2468] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 10.
W20260709 13:02:55.273262  1558 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.016s	sys 0.012s
W20260709 13:02:55.279353  1558 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.873s	user 0.016s	sys 0.012s
I20260709 13:02:55.279438  1733 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:43678
W20260709 13:02:55.279938  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 888446us
I20260709 13:02:55.264540  6973 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:55.287565  1558 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:55.291579  1558 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:54.496991  7067 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:55.297384  7050 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:55.300292  7067 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:55.303169  1733 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:55.283587  7128 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.303762  1733 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:55.302845  1738 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 11.
W20260709 13:02:55.302841  7088 consensus_meta.cc:287] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.834s	user 0.000s	sys 0.020s
I20260709 13:02:55.301370  7157 raft_consensus.cc:2804] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:55.317534  1733 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:55.289242  7107 consensus_queue.cc:1048] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:02:55.290220  7087 consensus_queue.cc:1048] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:02:55.321856  7088 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:55.322531  7088 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:55.307154  6821 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:55.327046  1740 raft_consensus.cc:2410] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:02:55.332258  7088 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:55.333675  7078 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.036s	user 0.020s	sys 0.003s
W20260709 13:02:55.334898  7078 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.037s	user 0.020s	sys 0.003s
I20260709 13:02:55.304682  7128 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:55.343046  1737 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 14.
W20260709 13:02:55.352985  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 61514.1us
I20260709 13:02:55.314465  7157 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:02:55.352411  7067 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.313724  6862 consensus_queue.cc:1048] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:02:55.362042  7088 consensus_queue.cc:1048] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:02:55.368256  7012 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:55.364974  1707 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:55.369629  6862 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.367290  7128 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:55.370501  7128 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:55.370359  6862 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:55.374622  1585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:02:55.375385  1585 raft_consensus.cc:606] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:55.350384  7083 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:55.378530  7083 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:55.351887  7066 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:55.389525  6821 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:55.390172  6821 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:55.363682  7157 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:55.372792  6862 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:55.358355  7050 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:55.395747  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:55.397589  1585 raft_consensus.cc:1275] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:55.359251  7087 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.400591  7088 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.392742  6821 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:55.408758  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:55.410709  1588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:02:55.411517  1588 raft_consensus.cc:606] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:55.411980  1588 raft_consensus.cc:614] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:55.380070  7067 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:55.413885  1588 raft_consensus.cc:1240] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:55.404019  7088 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:55.416399  7088 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:55.416852  1585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:02:55.417572  1585 raft_consensus.cc:606] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:55.418082  1585 raft_consensus.cc:614] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:02:55.419379  1735 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.963s	user 0.002s	sys 0.011s
W20260709 13:02:55.419812  1735 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.964s	user 0.003s	sys 0.011s
I20260709 13:02:55.420091  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:55.420598  1735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3846) took 1104 ms. Trace:
I20260709 13:02:55.421737  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:55.425107  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:55.426633  1587 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:02:55.427532  1587 raft_consensus.cc:606] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:02:55.427891  1658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3908) took 1478 ms. Trace:
I20260709 13:02:55.428769  1585 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12.
I20260709 13:02:55.429783  1733 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:55.427901  1587 raft_consensus.cc:614] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:55.430306  1733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:43678 (request call id 3855) took 1035 ms. Trace:
I20260709 13:02:55.430644  1733 rpcz_store.cc:276] 0709 13:02:54.395082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.279315 (+884233us) service_pool.cc:224] Handling call
0709 13:02:55.428528 (+149213us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b5400185454. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f86a3d 00007f1b85f56cd0 00007f1b7f4db254 00007f1b7f4db1e2 00007f1b7f4db111 00007f1b7f4db08c 00007f1b7f4da342 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:55.430231 (+  1703us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53281536}
I20260709 13:02:55.431453  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:55.428891  1658 rpcz_store.cc:276] 0709 13:02:53.949695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.955605 (+  5910us) service_pool.cc:224] Handling call
0709 13:02:53.956105 (+   500us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:55.152857 (+1196752us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b48001bc258. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b85eb8aa1 00007f1b85eafb37 00007f1b85eaf9ca 00007f1b85fa726f 00007f1b85fa6f37 00007f1b85fbb55c 00007f1b85fbb508 00007f1b85fbb488 00007f1b85fbb443 00007f1b85fba6ec 00007f1b84ee4a96
0709 13:02:55.177886 (+ 25029us) spinlock_profiling.cc:243] Waited 81.1 ms on lock 0x7b180036d600. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b80b374bc 00007f1b7de8548b 00007f1b86cdfab9 00007f1b7dea169b 00007f1b7de9f93f 00007f1b7de9f455 00007f1b80f87060 00007f1b80f87bfb 00007f1b80f9264b
0709 13:02:55.178041 (+   155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:55.178068 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:55.178710 (+   642us) log.cc:844] Serialized 26 byte log entry
0709 13:02:55.309910 (+131200us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:55.309977 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.310075 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.427667 (+117592us) raft_consensus.cc:1685] finished
0709 13:02:55.427688 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.427832 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":161116,"raft.run_cpu_time_us":4516,"raft.run_wall_time_us":943702,"spinlock_wait_cycles":191071744,"thread_start_us":308631,"threads_started":2,"wal-append.queue_time_us":185662}
I20260709 13:02:55.432121  1585 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:02:55.433923  7088 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.434177   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:02:55.434526  7088 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:55.435704  7171 consensus_queue.cc:1048] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:55.421018  1735 rpcz_store.cc:276] 0709 13:02:54.315861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.318972 (+  3111us) service_pool.cc:224] Handling call
0709 13:02:54.387435 (+ 68463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:54.414597 (+ 27162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:54.414641 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:54.415203 (+   562us) log.cc:844] Serialized 26 byte log entry
0709 13:02:55.420200 (+1004997us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:55.420251 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.420331 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.420392 (+    61us) raft_consensus.cc:1685] finished
0709 13:02:55.420407 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.420536 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26617,"raft.queue_time_us":28183,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":24395,"spinlock_wait_cycles":1225088,"thread_start_us":963962,"threads_started":1,"wal-append.queue_time_us":212389}
I20260709 13:02:55.428485  7067 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:55.439251  7083 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:55.419391  1588 raft_consensus.cc:1275] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:02:55.442647  7127 consensus_queue.cc:1059] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
W20260709 13:02:55.439325  7110 consensus_meta.cc:287] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 1.445s	user 0.009s	sys 0.009s
I20260709 13:02:55.447602  7110 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:55.450409  7110 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:55.452615  7088 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:55.455102  7066 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 16 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:55.456033  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:55.402870  7087 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:55.458561  2553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49238 (request call id 587) took 1246 ms. Trace:
I20260709 13:02:55.459537  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:55.461576  1707 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:55.462417  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:55.459107  2553 rpcz_store.cc:276] 0709 13:02:54.210776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.211224 (+   448us) service_pool.cc:224] Handling call
0709 13:02:54.235129 (+ 23905us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:54.264654 (+ 29525us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:54.264705 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:54.284587 (+ 19882us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b2c00022158. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7f888a11 00007f1b7f898372 00007f1b80fcaa01 00007f1b80f8f43a 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2
0709 13:02:54.285106 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 13:02:54.474886 (+189780us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:54.474942 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.475028 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.457225 (+982197us) raft_consensus.cc:1685] finished
0709 13:02:55.457248 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.457477 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11160,"raft.queue_time_us":24542,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":28041,"spinlock_wait_cycles":41495808,"thread_start_us":189358,"threads_started":1,"wal-append.queue_time_us":289827}
I20260709 13:02:55.467555  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:55.458235  7127 raft_consensus.cc:3055] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:55.471102  7127 raft_consensus.cc:740] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:55.472254  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:55.474200  1591 raft_consensus.cc:2393] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 14: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:02:55.474798  7110 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.475458  7110 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:55.475752  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:55.474577  7127 consensus_queue.cc:260] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:55.470252  7121 raft_consensus.cc:2804] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:55.478684  7110 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:55.479108  7121 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:55.480890  7051 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:55.483654  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:55.484586  1591 raft_consensus.cc:3055] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:55.484992  1591 raft_consensus.cc:740] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:55.486418  1591 consensus_queue.cc:260] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:55.487179  1584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 3108) took 1206 ms. Trace:
I20260709 13:02:55.488951  1591 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:55.489887  1659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3917) took 1196 ms. Trace:
I20260709 13:02:55.487967  1584 rpcz_store.cc:276] 0709 13:02:54.280408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.413958 (+133550us) service_pool.cc:224] Handling call
0709 13:02:54.441252 (+ 27294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.204126 (+762874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.486789 (+282663us) spinlock_profiling.cc:243] Waited 686 ms on lock 0x7b54001d29d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:55.487095 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1578599296}
I20260709 13:02:55.495170  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:55.498049  1585 raft_consensus.cc:2393] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 16: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
W20260709 13:02:55.498592  1705 leader_election.cc:336] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.821s (SENT)
I20260709 13:02:55.499109  1705 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:55.499889  7051 raft_consensus.cc:2749] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:55.501207  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:55.502605  1589 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46836 (request call id 755) took 2307 ms (client timeout 1722 ms). Trace:
W20260709 13:02:55.503062  1589 rpcz_store.cc:269] 0709 13:02:53.195638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.195770 (+   132us) service_pool.cc:224] Handling call
0709 13:02:55.502424 (+2306654us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54003b47d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:55.502525 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":359891840}
W20260709 13:02:55.506150  2552 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49218 (request call id 382) took 2607 ms (client timeout 2795 ms). Trace:
W20260709 13:02:55.506770  2552 rpcz_store.cc:269] 0709 13:02:52.898397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.900879 (+  2482us) service_pool.cc:224] Handling call
0709 13:02:55.505327 (+2604448us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b5400812ed4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:55.506042 (+   715us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":682237184}
I20260709 13:02:55.508220  2554 raft_consensus.cc:1240] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:55.496279  1659 rpcz_store.cc:276] 0709 13:02:54.288322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.949613 (+661291us) service_pool.cc:224] Handling call
0709 13:02:54.949983 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.209966 (+259983us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.484729 (+274763us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b54002701d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:55.485008 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":568092544}
W20260709 13:02:55.496596  1583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 2441) took 2355 ms (client timeout 1958 ms). Trace:
W20260709 13:02:55.511634  1583 rpcz_store.cc:269] 0709 13:02:53.141016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.141345 (+   329us) service_pool.cc:224] Handling call
0709 13:02:55.496373 (+2355028us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b54003b38d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:55.496488 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":664718208}
I20260709 13:02:55.526575  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:55.527534  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:55.528436  1585 raft_consensus.cc:2376] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 14. Re-sending same reply.
I20260709 13:02:55.530058  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:55.535463  1591 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 18.
I20260709 13:02:55.536070  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:55.480551  7121 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:55.548988  1587 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12.
I20260709 13:02:55.465744  7157 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:55.554922  7051 consensus_queue.cc:1048] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:55.557346  1660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3912) took 1339 ms. Trace:
W20260709 13:02:55.559734  1521 debug-util.cc:398] Leaking SignalData structure 0x7b0800040020 after lost signal to thread 434
I20260709 13:02:55.557837  1660 rpcz_store.cc:276] 0709 13:02:54.218340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.268919 (+ 50579us) service_pool.cc:224] Handling call
0709 13:02:54.269279 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:55.515527 (+1246248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:55.515566 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:55.516185 (+   619us) log.cc:844] Serialized 26 byte log entry
0709 13:02:55.550823 (+ 34638us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:55.550865 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.550929 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.557070 (+  6141us) raft_consensus.cc:1685] finished
0709 13:02:55.557112 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.557269 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1245578,"thread_start_us":34144,"threads_started":1,"wal-append.queue_time_us":38830}
I20260709 13:02:55.562011  1741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3839) took 2112 ms. Trace:
I20260709 13:02:55.562521  7157 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:55.562484  1741 rpcz_store.cc:276] 0709 13:02:53.449499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.449649 (+   150us) service_pool.cc:224] Handling call
0709 13:02:53.464411 (+ 14762us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:53.764057 (+299646us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:53.764094 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:53.764129 (+    35us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:53.764159 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.561700 (+1797541us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b54001577d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:55.561768 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.561945 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":688563584}
I20260709 13:02:55.565652  7051 consensus_queue.cc:1059] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:55.566680  7051 consensus_queue.cc:1243] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer 6d4de2ce0683442498244b9529127f91 log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:02:55.568817  1707 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:55.569177  7114 raft_consensus.cc:3055] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:55.569716  7114 raft_consensus.cc:740] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:55.569893  7067 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:55.570468  7067 raft_consensus.cc:697] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 14 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:55.570551  7114 consensus_queue.cc:260] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:55.571393  7067 consensus_queue.cc:237] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:55.571875  7114 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:55.573351  7047 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:55.576918  1707 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:55.550487  7127 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:55.585953  1737 raft_consensus.cc:1275] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:55.600622  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:55.601754  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:55.599071  2426 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:55.588423  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:55.602331  1737 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:55.602701  1733 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:55.589368  7000 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.041s	user 0.011s	sys 0.001s
I20260709 13:02:55.590860  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:55.594213  1707 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:55.606606  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:02:55.588253  6994 consensus_meta.cc:287] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 1.316s	user 0.019s	sys 0.002s
I20260709 13:02:55.611284  2426 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:55.613935  1737 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 15.
I20260709 13:02:55.614096  1733 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
I20260709 13:02:55.615124  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:55.617858  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:02:55.606262  7000 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.058s	user 0.012s	sys 0.001s
I20260709 13:02:55.621513  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:55.606992  7092 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.605780  7047 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:55.609579  7131 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:55.615027  6680 raft_consensus.cc:2804] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:55.636780  1736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3837) took 2189 ms. Trace:
I20260709 13:02:55.637283  1736 rpcz_store.cc:276] 0709 13:02:53.447835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.447971 (+   136us) service_pool.cc:224] Handling call
0709 13:02:53.448243 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:53.760949 (+312706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.636527 (+1875578us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b540001e354. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:55.636715 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":604328832}
I20260709 13:02:55.638681  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:55.639343  1736 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:55.622056  7034 raft_consensus.cc:2804] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:55.648447  1558 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:55.656690  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:55.657034  1704 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:55.664286  1736 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 14.
I20260709 13:02:55.667121  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:55.668159  1736 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 15.
I20260709 13:02:55.670149  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:55.671082  1736 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 14.
I20260709 13:02:55.672873  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:55.642760  7087 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:55.651757  6360 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:55.671262  1558 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:55.686551  2553 raft_consensus.cc:1275] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:02:55.690567  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.674068  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:55.691377  1736 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:55.688650  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:55.696121  1737 raft_consensus.cc:2393] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 12: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
W20260709 13:02:55.697062  1521 debug-util.cc:398] Leaking SignalData structure 0x7b08000bb980 after lost signal to thread 1524
I20260709 13:02:55.700913  1736 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 18.
W20260709 13:02:55.702667  1664 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39146 (request call id 3893) took 2397 ms (client timeout 1902 ms). Trace:
W20260709 13:02:55.703277  1664 rpcz_store.cc:269] 0709 13:02:53.280225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.280463 (+   238us) service_pool.cc:224] Handling call
0709 13:02:55.677171 (+2396708us) spinlock_profiling.cc:243] Waited 2.25 s on lock 0x7b5400358ed4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:55.677314 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5182118784}
I20260709 13:02:55.704967  1558 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:55.708173  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:55.649959  7047 raft_consensus.cc:697] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 18 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:55.653863  7131 raft_consensus.cc:697] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 12 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:55.706020  1558 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:55.709774  1736 raft_consensus.cc:2410] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 14 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
W20260709 13:02:55.742162  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.674026  6680 raft_consensus.cc:697] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:55.741178   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:55.689559  7096 raft_consensus.cc:2804] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:02:55.747654  1521 debug-util.cc:398] Leaking SignalData structure 0x7b080003c6e0 after lost signal to thread 1616
W20260709 13:02:55.748114  1521 debug-util.cc:398] Leaking SignalData structure 0x7b08002f2c80 after lost signal to thread 1617
I20260709 13:02:55.704706  7171 raft_consensus.cc:2804] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:55.657856  7088 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.651232  7110 consensus_queue.cc:1048] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 13:02:55.644289  7092 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:55.715086  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:55.746587  1558 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:55.752259  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:55.749269  1521 debug-util.cc:398] Leaking SignalData structure 0x7b08002ed780 after lost signal to thread 1633
I20260709 13:02:55.731053  7086 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:55.730849  7094 raft_consensus.cc:2804] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:55.763180  1737 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:55.679340  7034 raft_consensus.cc:697] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
W20260709 13:02:55.769461  1521 debug-util.cc:398] Leaking SignalData structure 0x7b0800040f00 after lost signal to thread 1691
I20260709 13:02:55.748849  7157 raft_consensus.cc:2804] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:55.804157  7157 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:55.804608  7157 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:55.769809  7170 raft_consensus.cc:2804] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:55.810181  7170 raft_consensus.cc:697] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 18 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:55.811172  7170 consensus_queue.cc:237] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:55.814559  2554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49238 (request call id 582) took 2539 ms. Trace:
I20260709 13:02:55.815094  2554 rpcz_store.cc:276] 0709 13:02:53.274834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.275010 (+   176us) service_pool.cc:224] Handling call
0709 13:02:55.507983 (+2232973us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.508840 (+   857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.814266 (+305426us) spinlock_profiling.cc:243] Waited 2.22 s on lock 0x7b5400812ed0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8e8ad 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:55.814444 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5101475200}
W20260709 13:02:55.774780  1521 debug-util.cc:398] Leaking SignalData structure 0x7b0800040ec0 after lost signal to thread 1692
I20260709 13:02:55.781723  6680 consensus_queue.cc:237] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:55.762804  7096 raft_consensus.cc:697] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:55.754680  7134 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:55.772687  7086 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:55.785480  7172 log.cc:927] Time spent T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.205s	user 0.002s	sys 0.000s
W20260709 13:02:55.786299  7175 log.cc:927] Time spent T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:02:55.787215  1661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3913) took 1551 ms. Trace:
I20260709 13:02:55.702816  7168 consensus_queue.cc:1048] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:02:55.766582  7088 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:55.791013  1704 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:55.852875  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 62096.5us
W20260709 13:02:55.853844  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.796084  7121 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:55.851846  1661 rpcz_store.cc:276] 0709 13:02:54.236220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.373446 (+137226us) service_pool.cc:224] Handling call
0709 13:02:54.394004 (+ 20558us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:55.575017 (+1181013us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:55.575048 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:55.575683 (+   635us) log.cc:844] Serialized 52 byte log entry
0709 13:02:55.602249 (+ 26566us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:55.602298 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.602362 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.786961 (+184599us) raft_consensus.cc:1685] finished
0709 13:02:55.786980 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.787149 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1180502,"thread_start_us":26149,"threads_started":1,"wal-append.queue_time_us":85541}
I20260709 13:02:55.754387  7171 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:55.839331  1521 debug-util.cc:398] Leaking SignalData structure 0x7b080035a540 after lost signal to thread 1765
W20260709 13:02:55.871004  1521 debug-util.cc:398] Leaking SignalData structure 0x7b08002ecba0 after lost signal to thread 2594
W20260709 13:02:55.871454  1521 debug-util.cc:398] Leaking SignalData structure 0x7b0800230620 after lost signal to thread 2595
I20260709 13:02:55.846143  1737 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:02:55.748719  7051 consensus_queue.cc:1048] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 13:02:55.851243  1586 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 14.
I20260709 13:02:55.798550  7047 consensus_queue.cc:237] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:55.799733  7131 consensus_queue.cc:237] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:55.875806  1558 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:55.836268  7094 raft_consensus.cc:697] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:55.903095  6360 raft_consensus.cc:2804] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:55.876870  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:55.849884  7086 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:55.906085  1737 raft_consensus.cc:2393] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 15: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:02:55.874171  7134 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:55.873907  7171 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:55.911857  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 293444us
I20260709 13:02:55.916013  2426 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:55.926153  1738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35672 (request call id 719) took 1471 ms. Trace:
I20260709 13:02:55.926924  1738 rpcz_store.cc:276] 0709 13:02:54.454536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.390742 (+936206us) service_pool.cc:224] Handling call
0709 13:02:55.391039 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.394892 (+  3853us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:55.394924 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:55.394964 (+    40us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:55.394995 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.925823 (+530828us) spinlock_profiling.cc:243] Waited 3.65 ms on lock 0x7b5400184f54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:55.925877 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.926077 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8388864}
I20260709 13:02:55.875419  6862 consensus_queue.cc:1059] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
W20260709 13:02:55.966679  7182 log.cc:927] Time spent T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:02:55.931032  6967 raft_consensus.cc:2804] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:55.971169  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:55.973613  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:55.956073  7094 consensus_queue.cc:237] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:55.989727  6360 raft_consensus.cc:697] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:55.972425  7121 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:55.995723  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:55.997124  6360 consensus_queue.cc:237] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:55.998359  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:55.998836  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:55.911800  7034 consensus_queue.cc:237] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:55.999456  1591 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:56.000990  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:55.993443  6967 raft_consensus.cc:697] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:55.998991  1590 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:56.003556  1587 raft_consensus.cc:1240] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:55.971872  7085 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:56.014593  1591 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 13.
I20260709 13:02:56.023733  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:56.024533  1734 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:02:56.025157  1732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43686 (request call id 2567) took 2297 ms. Trace:
I20260709 13:02:56.025974  1732 rpcz_store.cc:276] 0709 13:02:53.727627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.835511 (+107884us) service_pool.cc:224] Handling call
0709 13:02:56.024937 (+2189426us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b5400277c54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:56.025099 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3706656128}
W20260709 13:02:56.024032  1740 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43678 (request call id 3854) took 1645 ms (client timeout 1725 ms). Trace:
W20260709 13:02:56.027985  1740 rpcz_store.cc:269] 0709 13:02:54.378519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.120900 (+742381us) service_pool.cc:224] Handling call
0709 13:02:56.023862 (+902962us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b5400223dd4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:56.023978 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":282442112}
I20260709 13:02:56.023974  2543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49222 (request call id 666) took 2587 ms. Trace:
I20260709 13:02:55.919726  7096 consensus_queue.cc:237] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:55.990149  7157 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:56.030098  2543 rpcz_store.cc:276] 0709 13:02:53.436241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.436388 (+   147us) service_pool.cc:224] Handling call
0709 13:02:53.458804 (+ 22416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:53.684648 (+225844us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:53.684713 (+    65us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:53.684773 (+    60us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:53.684821 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:56.023711 (+2338890us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54007328d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:56.023770 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:56.023901 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":518532992}
I20260709 13:02:55.997356  7088 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:56.036515  1732 raft_consensus.cc:1275] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:02:56.046172  7192 log.cc:927] Time spent T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:02:56.048115  7157 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:56.062207  7171 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:56.063424  1738 raft_consensus.cc:1275] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:02:56.079732  1738 pending_rounds.cc:85] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 8
I20260709 13:02:56.080147  1738 pending_rounds.cc:107] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:02:56.080657  1738 raft_consensus.cc:2889] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:56.070889  1707 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:56.072974  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:56.082754  1735 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:56.077611  1591 raft_consensus.cc:1240] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:56.078262  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:56.084769  1583 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:56.086159  1587 raft_consensus.cc:1275] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:56.088001  7121 raft_consensus.cc:2804] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:56.088891  7121 raft_consensus.cc:697] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 13 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:56.076198  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:56.091784  1558 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:56.093690  1590 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 14.
I20260709 13:02:56.096276  6875 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.096935  6875 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:56.110220  7134 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:56.113237  6967 consensus_queue.cc:237] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:56.129177  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 208131us
I20260709 13:02:56.131189  1739 raft_consensus.cc:1240] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:56.100589  7194 raft_consensus.cc:2804] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:02:56.163955  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 59731.1us
I20260709 13:02:56.155555  1583 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 15.
W20260709 13:02:56.178260  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 44734.9us
I20260709 13:02:56.117430  7157 consensus_queue.cc:1048] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:02:56.089818  7121 consensus_queue.cc:237] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:56.186129  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.163089  7194 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:56.201169  6680 consensus_queue.cc:1059] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:02:56.200501  7194 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:56.218559  1735 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 15.
I20260709 13:02:56.221045  1588 raft_consensus.cc:1275] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:02:56.228364  7207 log.cc:927] Time spent T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:02:56.228986  1558 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:56.230409  1588 raft_consensus.cc:1275] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:02:56.234174  6875 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:56.245538  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.250316  1737 raft_consensus.cc:1275] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:02:56.253157   436 debug-util.cc:398] Leaking SignalData structure 0x7b080000fe60 after lost signal to thread 1633
I20260709 13:02:56.257480  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:56.276890  1737 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 14.
W20260709 13:02:56.287997   436 kernel_stack_watchdog.cc:198] Thread 1633 stuck at /apache/dev/git/kudu/src/kudu/rpc/outbound_call.cc:307 for 927ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
W20260709 13:02:56.304713  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 48831.9us
I20260709 13:02:56.306825  1558 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:02:56.295958  7201 log.cc:927] Time spent T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:02:56.284732  7191 raft_consensus.cc:2804] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:56.261054  7086 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:56.318576  7086 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:56.319489  7086 raft_consensus.cc:2804] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:56.320029  7086 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:56.320396  7086 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:56.323843  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:56.314596  6360 consensus_queue.cc:1048] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:56.325724  2543 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:56.359934  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:56.360688  1741 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Advancing to term 17
W20260709 13:02:56.324144  7197 log.cc:927] Time spent T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
W20260709 13:02:56.329248  7202 log.cc:927] Time spent T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:02:56.324441  7171 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:56.364598  7191 raft_consensus.cc:697] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:56.383127  7191 consensus_queue.cc:237] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:56.386794  1586 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 3101) took 2112 ms (client timeout 1776 ms). Trace:
W20260709 13:02:56.387491  1586 rpcz_store.cc:269] 0709 13:02:54.274418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.279707 (+  5289us) service_pool.cc:224] Handling call
0709 13:02:56.386581 (+2106874us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b54003b3dd4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:56.386705 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3611671296}
W20260709 13:02:56.417176  7210 log.cc:927] Time spent T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:02:56.405567  7000 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.426127  1741 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
W20260709 13:02:56.429322  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 224294us
W20260709 13:02:56.432049  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.422951  7000 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:56.437582  6680 consensus_queue.cc:1059] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:56.441423  7000 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:56.447731  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:56.447921  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:56.447943  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:56.450364  2543 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12.
I20260709 13:02:56.451690  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:56.452396  1586 raft_consensus.cc:2376] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 11. Re-sending same reply.
I20260709 13:02:56.444912  6967 consensus_queue.cc:1048] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:02:56.457566  6920 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:56.458232  6920 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:56.460647  6920 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:56.468289  1663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3916) took 2184 ms. Trace:
I20260709 13:02:56.471127  1558 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:56.474112  1704 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:02:56.457454  1521 debug-util.cc:398] Leaking SignalData structure 0x7b08003dc4e0 after lost signal to thread 6948
W20260709 13:02:56.476447  1521 debug-util.cc:398] Leaking SignalData structure 0x7b08003dc2e0 after lost signal to thread 6957
W20260709 13:02:56.478394  1521 debug-util.cc:398] Leaking SignalData structure 0x7b08000df440 after lost signal to thread 7072
W20260709 13:02:56.478763  1521 debug-util.cc:398] Leaking SignalData structure 0x7b080009e580 after lost signal to thread 7075
I20260709 13:02:56.479756  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:56.480729  1588 raft_consensus.cc:2376] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 15. Re-sending same reply.
I20260709 13:02:56.481590  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:56.482223  1664 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:56.484491  7009 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:56.485231  7009 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:56.487041  6713 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:56.487628  6713 raft_consensus.cc:697] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:56.487854  7118 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:56.488619  7118 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:56.489670  7121 raft_consensus.cc:2804] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:02:56.456564  7204 log.cc:927] Time spent T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:02:56.490223  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:56.490973  1590 raft_consensus.cc:1275] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:02:56.492734  2424 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.505s (SENT) [suppressed 36 similar messages]
W20260709 13:02:56.494882  1521 debug-util.cc:398] Leaking SignalData structure 0x7b0800329b00 after lost signal to thread 7091
W20260709 13:02:56.495365  1521 debug-util.cc:398] Leaking SignalData structure 0x7b080032d340 after lost signal to thread 7101
W20260709 13:02:56.496011  1521 debug-util.cc:398] Leaking SignalData structure 0x7b0800299820 after lost signal to thread 7109
I20260709 13:02:56.468737  1663 rpcz_store.cc:276] 0709 13:02:54.283527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.473693 (+190166us) service_pool.cc:224] Handling call
0709 13:02:54.473949 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:54.474153 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:54.859194 (+385041us) log.cc:844] Serialized 14 byte log entry
0709 13:02:56.467824 (+1608630us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:56.467894 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:56.467967 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:56.468053 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:56.468212 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1607605,"prepare.queue_time_us":632621,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":50}
I20260709 13:02:56.513216  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:56.494360  6826 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.519656  7141 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:56.519656  6826 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:56.520535  7141 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:56.508836  7121 raft_consensus.cc:697] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 12 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:56.522187  6826 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:56.523077  7141 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:56.522943  7121 consensus_queue.cc:237] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:56.523762  1661 raft_consensus.cc:1275] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:02:56.488611  6713 consensus_queue.cc:237] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:56.525761  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 53562.2us
I20260709 13:02:56.536667  1732 raft_consensus.cc:1275] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:02:56.545517  1664 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
I20260709 13:02:56.548666  1733 raft_consensus.cc:1275] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:56.555480  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:56.556254  1660 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:02:56.558342  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:56.558315  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 2.23716e+06us
I20260709 13:02:56.559316  1661 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:02:56.560612  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:56.515223  6674 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.514588  7079 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:56.568588  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:56.548462  7009 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:56.527563  7096 consensus_queue.cc:1048] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:02:56.552783  6994 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:56.584403  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:56.586732  1633 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:56.588733  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:56.574752  1664 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 18.
I20260709 13:02:56.571424  7117 raft_consensus.cc:2749] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:56.601395  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:56.602864  1665 raft_consensus.cc:2468] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 6.
I20260709 13:02:56.572762  7079 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:56.569612  7118 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:56.594875  7009 consensus_queue.cc:1059] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 13:02:56.598156  6826 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:56.592295  7141 consensus_queue.cc:1059] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:02:56.598589  6994 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:56.605407  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:56.606766  1660 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16.
W20260709 13:02:56.592504  7221 log.cc:927] Time spent T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:02:56.609018  1633 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:56.614643  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:56.631778  1664 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 14.
I20260709 13:02:56.571065  6674 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:56.616539  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:56.617321  7009 raft_consensus.cc:3055] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:02:56.617815  6826 raft_consensus.cc:697] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 14 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:56.571344  7086 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:56.618211  7141 raft_consensus.cc:3055] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:56.644184  7141 raft_consensus.cc:740] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:56.644524  6994 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:56.624863  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:56.625401  7194 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:56.626626  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:56.645390  7141 consensus_queue.cc:260] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:56.645967  1659 raft_consensus.cc:2468] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:02:56.629302  1663 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:02:56.633169  1665 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:56.655169  1662 raft_consensus.cc:1275] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:56.635149  1633 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
W20260709 13:02:56.659236  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 86164.9us
I20260709 13:02:56.638294  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:02:56.660389  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.612527  6920 consensus_queue.cc:1059] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:02:56.638847  6826 consensus_queue.cc:237] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:56.633833  7009 raft_consensus.cc:740] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:56.639714  7117 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:56.642115  7086 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:56.642124  6674 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:56.642902  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:56.689863  1664 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:02:56.643137  2543 raft_consensus.cc:1240] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:56.673475  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:56.628819  7079 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:56.681124  1705 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:56.685166  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:56.614789  7143 consensus_queue.cc:1059] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:02:56.692302  1659 raft_consensus.cc:2376] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 15. Re-sending same reply.
I20260709 13:02:56.687129  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:56.693452  1737 raft_consensus.cc:1275] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:56.672895  7141 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:56.679227  7012 raft_consensus.cc:2804] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:02:56.697829  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 185824us
I20260709 13:02:56.687831  7117 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:56.692337  7194 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:56.697376  7079 raft_consensus.cc:3055] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:56.715945  7110 consensus_queue.cc:1048] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:56.717200  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:56.732287  1737 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:56.734674  7009 consensus_queue.cc:260] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:56.735795  7009 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:56.718614  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:56.737385  1735 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:56.701581  7114 raft_consensus.cc:2749] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:56.741438  1665 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:02:56.710031  7117 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:56.720420  1739 raft_consensus.cc:1275] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:02:56.746935  1705 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:02:56.747901  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:56.748569  1659 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:56.707451  7012 raft_consensus.cc:697] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 14 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:56.759274  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:56.760126  1665 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 15.
I20260709 13:02:56.707058  7050 consensus_queue.cc:1048] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:02:56.730432  7079 raft_consensus.cc:740] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:56.764990  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:56.767151  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:56.701398  7131 consensus_queue.cc:1059] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 13:02:56.786620  7012 consensus_queue.cc:237] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:56.749347  7127 raft_consensus.cc:3055] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:56.788951  1736 raft_consensus.cc:2393] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 10: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
W20260709 13:02:56.768337  7223 log.cc:927] Time spent T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:02:56.795770  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:56.798688  1665 raft_consensus.cc:3055] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:56.799113  1665 raft_consensus.cc:740] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:56.793131  1737 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 15.
I20260709 13:02:56.800588  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:56.800024  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:56.766973  7114 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:56.797643  1735 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 14.
I20260709 13:02:56.756469  7083 consensus_queue.cc:1048] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:02:56.803937  1659 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
I20260709 13:02:56.807525  1738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3877) took 1168 ms. Trace:
I20260709 13:02:56.807902  1738 rpcz_store.cc:276] 0709 13:02:55.639558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.928429 (+288871us) service_pool.cc:224] Handling call
0709 13:02:55.928758 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:56.081473 (+152715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:56.807302 (+725829us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54000e6d54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:56.807470 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":308810496}
I20260709 13:02:56.813606  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:56.814343  1733 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 16.
I20260709 13:02:56.814044  7079 consensus_queue.cc:260] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:56.815423  7079 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:56.815667  7083 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:56.816248  7083 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:56.820758  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:56.822997  7083 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:56.828608  1661 raft_consensus.cc:3055] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:56.772147  7224 consensus_queue.cc:1048] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 13:02:56.804255  7114 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:56.842785  7114 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:56.841413  1661 raft_consensus.cc:740] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:56.848917  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:56.850632  1667 raft_consensus.cc:1275] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:56.851157  1662 raft_consensus.cc:3060] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:56.858234  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:56.861584  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:56.862452  1733 raft_consensus.cc:2468] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 8.
I20260709 13:02:56.863066  7092 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:56.863724  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:56.796717  7127 raft_consensus.cc:740] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:56.806277  1665 consensus_queue.cc:260] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:56.865950  7127 consensus_queue.cc:260] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:56.868069  7127 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:56.868691  7078 raft_consensus.cc:3055] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:56.869376  7078 raft_consensus.cc:740] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:56.869822  1661 consensus_queue.cc:260] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:56.870179  7078 consensus_queue.cc:260] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:56.871055  1661 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:56.871805  7078 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:56.850220  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:56.877933  1666 raft_consensus.cc:3060] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:56.808223  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 96163.5us
I20260709 13:02:56.865940  1665 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:56.880788  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:56.881043  1732 raft_consensus.cc:1240] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 13 LEADER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:56.891114  1737 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 12.
I20260709 13:02:56.883530  1738 raft_consensus.cc:1275] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:02:56.911561  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.957356  1658 raft_consensus.cc:1275] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:02:56.993873  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:56.806890  1633 connection.cc:256] RPC call timeout handler was delayed by -2.1507876890000261s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3279s for a response
I20260709 13:02:57.144182  1662 raft_consensus.cc:2410] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:02:57.171056  1665 raft_consensus.cc:1275] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:02:57.451683  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:57.394304  7217 raft_consensus.cc:3055] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:57.452476  7217 raft_consensus.cc:740] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:57.079495  7143 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:57.449579  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:57.037168  6674 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:57.445583  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.079826  6920 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:57.297547   436 debug-util.cc:398] Leaking SignalData structure 0x7b080000fec0 after lost signal to thread 1633
I20260709 13:02:57.454392  6920 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:57.454622  6674 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:57.312984  6826 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.008s	sys 0.015s
W20260709 13:02:57.022921  1705 leader_election.cc:336] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.500s (SENT)
I20260709 13:02:57.507599  1705 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:57.183751  7114 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:57.115556  1666 raft_consensus.cc:2468] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 16.
I20260709 13:02:56.885349  7118 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
W20260709 13:02:57.073633  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.461808  1739 raft_consensus.cc:2393] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 10: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
W20260709 13:02:57.518412  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.096282  1661 raft_consensus.cc:1275] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:02:57.174657  2424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.994999  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:57.519788  1659 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 13.
I20260709 13:02:57.449995  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:57.450606  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.466522  2426 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:57.520812  1658 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 13.
W20260709 13:02:57.521996  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 55566.2us
W20260709 13:02:57.471005  1633 connection.cc:256] RPC call timeout handler was delayed by -1.4460647270000209s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1684s for a response
W20260709 13:02:57.478018  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:57.522785  1633 connection.cc:256] RPC call timeout handler was delayed by -1.2795647270000359s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1869s for a response
W20260709 13:02:57.523054  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:57.523150  1633 connection.cc:256] RPC call timeout handler was delayed by -1.2624647270000082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1888s for a response
W20260709 13:02:57.523980  1633 connection.cc:256] RPC call timeout handler was delayed by -1.081564727s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
W20260709 13:02:57.305064  7117 consensus_meta.cc:287] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.553s	user 0.008s	sys 0.004s
I20260709 13:02:57.203850  7110 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
W20260709 13:02:57.259971  7141 consensus_meta.cc:287] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.561s	user 0.008s	sys 0.000s
I20260709 13:02:57.498003  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:57.500005  1585 raft_consensus.cc:1240] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:57.500602  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:57.508949  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 486048us
I20260709 13:02:57.470113  1583 raft_consensus.cc:1275] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:02:57.526507  2426 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:02:57.255569  7009 consensus_meta.cc:287] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.519s	user 0.008s	sys 0.004s
I20260709 13:02:57.540679  7009 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.541416  6674 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:57.541324  7009 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:57.527968  1666 raft_consensus.cc:1275] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:57.529309  1662 raft_consensus.cc:1240] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:57.542572  1592 raft_consensus.cc:2393] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 12: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
W20260709 13:02:57.519448  6826 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.011s	sys 0.017s
W20260709 13:02:57.524281  1633 connection.cc:256] RPC call timeout handler was delayed by -1.0599647270000219s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21130000000000002s for a response
I20260709 13:02:57.533217  1589 raft_consensus.cc:1240] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:57.536167  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:57.550745  1739 raft_consensus.cc:2410] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:02:57.541539  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:57.536466  1584 raft_consensus.cc:1217] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Deduplicated request from leader. Original: 18.11->[19.12-21.13]   Dedup: 21.13->[]
I20260709 13:02:57.526986  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:57.551283  1584 raft_consensus.cc:1240] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 21. Current term is 22. Ops: [19.12-21.13]
I20260709 13:02:57.551743  1665 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:57.498003  6920 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:57.531069  1667 raft_consensus.cc:1275] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:02:57.548816  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:57.557407  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:57.517351  7012 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.561338  1665 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 14.
I20260709 13:02:57.550463  1633 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:57.555130  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:57.566968  1633 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:57.527580  7051 raft_consensus.cc:2749] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:57.580641  1587 raft_consensus.cc:1275] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:57.580992  1592 raft_consensus.cc:1240] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 18 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:57.581657  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:57.581997  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:57.582379  1587 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 13.
I20260709 13:02:57.583495  1587 raft_consensus.cc:1240] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:57.583649  1734 raft_consensus.cc:1275] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:57.532783  7034 raft_consensus.cc:2749] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:57.579986  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:57.453310  7143 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:57.593326  1589 raft_consensus.cc:1275] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:57.593761  6360 consensus_queue.cc:1059] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:57.594185  1592 raft_consensus.cc:1240] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 12. Current term is 13. Ops: []
W20260709 13:02:57.569348  7127 consensus_meta.cc:287] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.701s	user 0.016s	sys 0.005s
I20260709 13:02:57.556838  7188 raft_consensus.cc:2749] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:57.602109  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:57.603204  1633 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:57.603704  1739 raft_consensus.cc:1275] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:02:57.604943  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.613427  1633 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:57.615264  1633 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:57.619653  1584 raft_consensus.cc:2393] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 18: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:57.584286  6674 raft_consensus.cc:2804] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:57.533205  7117 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:57.542626  7110 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:57.533259  7118 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:57.600941  7009 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:57.556643  7224 consensus_queue.cc:1048] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:02:57.686791  2543 raft_consensus.cc:1275] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:02:57.747797  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 163213us
I20260709 13:02:57.710996  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:57.712121  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:57.749123  6360 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.587895  7206 consensus_queue.cc:1048] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.088s
I20260709 13:02:57.594108  7067 consensus_queue.cc:1048] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.092s
I20260709 13:02:57.453624  7217 consensus_queue.cc:260] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:57.585177  7012 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:57.665275  6674 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:57.621212  7250 raft_consensus.cc:2749] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:02:57.741178  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 184669us
I20260709 13:02:57.743908  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:57.744971  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 151107us
I20260709 13:02:57.621474  6826 raft_consensus.cc:2749] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:57.664861  6920 raft_consensus.cc:2749] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:57.652683  1633 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:57.756951  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:57.739941  7127 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.758425  6360 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:57.806687  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 52929.6us
I20260709 13:02:57.826881  2552 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 16.
I20260709 13:02:57.809058  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:57.811894  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:57.816403  1705 leader_election.cc:336] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.723s (SENT)
I20260709 13:02:57.806259  6680 consensus_queue.cc:1048] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:02:57.756630  7085 consensus_queue.cc:1048] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:02:57.833423  2552 raft_consensus.cc:1240] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:02:57.814610  6674 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:57.857448  2553 raft_consensus.cc:2393] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 16: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:02:57.862746  2543 raft_consensus.cc:1240] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
W20260709 13:02:57.827625  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 175049us
I20260709 13:02:57.865507  6360 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:57.868495  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:57.832906  1705 leader_election.cc:336] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.770s (SENT)
I20260709 13:02:57.823563  7241 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:57.877063  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 44163.1us
I20260709 13:02:57.877185  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
W20260709 13:02:57.878212  1705 leader_election.cc:336] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.776s (SENT)
I20260709 13:02:57.812886  7188 consensus_queue.cc:1059] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:02:57.827656  7121 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.880071  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:57.880820  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 337437us
I20260709 13:02:57.828826  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:57.829150  7009 raft_consensus.cc:2764] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:02:57.884353  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:57.886909  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:57.892732  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:57.893436  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:57.826845  7248 consensus_queue.cc:1048] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.075s
W20260709 13:02:57.889972  7079 consensus_meta.cc:287] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 1.069s	user 0.015s	sys 0.000s
I20260709 13:02:57.896194  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:57.900326  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:57.857020  7127 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:57.901135  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 295552us
I20260709 13:02:57.881896  7114 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:57.867583  7181 consensus_queue.cc:1048] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:02:57.964181  1667 raft_consensus.cc:2393] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 18: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:57.964668  7188 consensus_queue.cc:1243] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Peer 5ced62816f8545cd9b63a27e9055e42d log is divergent from this leader: its last log entry 13.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:02:57.966981  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:57.966928  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:57.969419  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 153602us
I20260709 13:02:57.971125  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:58.147063  1662 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 13.
W20260709 13:02:57.970903  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 155091us
I20260709 13:02:57.972892  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:58.002403  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.006108  1733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35672 (request call id 732) took 1120 ms. Trace:
I20260709 13:02:58.149477  1733 rpcz_store.cc:276] 0709 13:02:56.885317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.885630 (+   313us) service_pool.cc:224] Handling call
0709 13:02:58.004691 (+1119061us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b58000e4398. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7de6ab71 00007f1b7de6aa22 00007f1b86d83c09 00007f1b85eddee0 00007f1b85fa70ab 00007f1b85fa7131 00007f1b85f68fc0 00007f1b85f53929 00007f1b85f533d2 00007f1b7f4cabd4
0709 13:02:58.005178 (+   487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:58.005590 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:58.005632 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:58.005690 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:58.005743 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:58.005826 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:58.006025 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39453056}
I20260709 13:02:58.010751  6821 raft_consensus.cc:3055] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:58.022986  1588 raft_consensus.cc:1240] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:58.025446  1591 raft_consensus.cc:1275] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:02:58.034860  1586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 3146) took 1138 ms. Trace:
I20260709 13:02:58.157902  1586 rpcz_store.cc:276] 0709 13:02:56.896800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.504718 (+607918us) service_pool.cc:224] Handling call
0709 13:02:57.505114 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:57.745613 (+240499us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:57.745665 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:57.745731 (+    66us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:57.745790 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:58.034556 (+288766us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b5400391cd4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:58.034619 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:58.034785 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":552062848}
I20260709 13:02:56.748200   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:02:58.043306  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:58.050920  7245 log.cc:927] Time spent T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.346s	user 0.000s	sys 0.003s
W20260709 13:02:58.052515  1490 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51168 (request call id 134) took 25851 ms (client timeout 15000 ms). Trace:
I20260709 13:02:57.878623  1705 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:02:58.350517  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 472286us
I20260709 13:02:58.351331  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:58.056025  7047 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:57.882897  7241 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:57.898092  7143 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:57.898365  7067 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:58.066085  1631 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.015s	sys 0.046s
I20260709 13:02:58.061012  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:57.892194  7246 consensus_queue.cc:1059] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.105s
W20260709 13:02:58.072427  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 183115us
W20260709 13:02:58.078558  7266 log.cc:927] Time spent T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:02:58.362378  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:58.363042  7278 consensus_queue.cc:1048] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:58.364374  7248 consensus_queue.cc:1048] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:02:58.079767  7242 log.cc:927] Time spent T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.270s	user 0.000s	sys 0.001s
I20260709 13:02:58.080163  7110 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:58.080950  7238 log.cc:927] Time spent T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.271s	user 0.000s	sys 0.000s
I20260709 13:02:57.994163  7079 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.081630  1737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3914) took 1188 ms. Trace:
I20260709 13:02:58.084244  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:02:58.084692  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:58.066273  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 97787.3us
I20260709 13:02:58.374358  1737 rpcz_store.cc:276] 0709 13:02:56.893516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.440558 (+547042us) service_pool.cc:224] Handling call
0709 13:02:58.080834 (+640276us) spinlock_profiling.cc:243] Waited 8.51 ms on lock 0x7b58000e4398. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7de6ab71 00007f1b7de6aa22 00007f1b86d83c09 00007f1b85eddee0 00007f1b85fa70ab 00007f1b85fa7131 00007f1b85f68fc0 00007f1b85f53929 00007f1b85f533d2 00007f1b7f4cabd4
0709 13:02:58.081066 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:58.081300 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:58.081326 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:58.081381 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:58.081414 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:58.081468 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:58.081573 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19577600}
I20260709 13:02:57.997535  7206 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.891410  7121 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:57.901216  1665 raft_consensus.cc:2393] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 14: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:58.060912  7117 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:58.062083  7009 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:58.061012  7265 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:58.098570  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 210494us
I20260709 13:02:58.117130  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:58.117594  7261 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.118062  1590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46836 (request call id 781) took 1231 ms. Trace:
W20260709 13:02:58.118659  7243 log.cc:927] Time spent T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.366s	user 0.001s	sys 0.001s
I20260709 13:02:58.142043  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:58.105427  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:58.156566  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:58.386940  1662 raft_consensus.cc:2468] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:58.387140  1667 raft_consensus.cc:2410] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:02:58.388010  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:58.388562  1662 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:58.389408  6360 consensus_queue.cc:1048] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:58.168879  1588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46836 (request call id 783) took 1281 ms. Trace:
I20260709 13:02:58.166754  1558 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:58.190390  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:58.391433  6360 raft_consensus.cc:2804] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:58.086966  7118 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:58.197394  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:58.390868  1588 rpcz_store.cc:276] 0709 13:02:56.887675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.888795 (+  1120us) service_pool.cc:224] Handling call
0709 13:02:58.022574 (+1133779us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b5800002798. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7de6ab71 00007f1b7de6aa22 00007f1b86d83c09 00007f1b85eddee0 00007f1b85fa70ab 00007f1b85fa7131 00007f1b85f68fc0 00007f1b85f53929 00007f1b85f533d2 00007f1b7f4cabd4
0709 13:02:58.022776 (+   202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:58.168537 (+145761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:58.168808 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32744320}
W20260709 13:02:58.156726  7249 log.cc:927] Time spent T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.414s	user 0.001s	sys 0.000s
I20260709 13:02:58.156668  6821 raft_consensus.cc:740] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:02:58.171419  6994 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 13:02:58.145514  7247 consensus_queue.cc:1059] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 13:02:58.401456  7248 consensus_queue.cc:1048] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:58.383517  7009 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:58.169984  1490 rpcz_store.cc:269] 0709 13:02:32.201401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.225170 (+ 23769us) service_pool.cc:224] Handling call
0709 13:02:58.052411 (+25827241us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:53.391572 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:53.392226 (+   654us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:53.392267 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:02:53.392286 (+    19us) tablet.cc:662] Decoding operations
0709 13:02:53.393370 (+  1084us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:53.393435 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:53.393466 (+    31us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:02:53.394266 (+   800us) tablet.cc:701] Row locks acquired
0709 13:02:53.394289 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:02:53.394468 (+   179us) write_op.cc:270] Start()
0709 13:02:53.394596 (+   128us) write_op.cc:276] Timestamp: P: 1783602173394405 usec, L: 0
0709 13:02:53.394620 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:02:53.395390 (+   770us) log.cc:844] Serialized 3601 byte log entry
0709 13:02:54.532205 (+1136815us) op_driver.cc:464] REPLICATION: finished
0709 13:02:54.664108 (+131903us) write_op.cc:301] APPLY: starting
0709 13:02:54.664197 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:54.670289 (+  6092us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:54.670393 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:54.676548 (+  6155us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:54.676791 (+   243us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:02:54.676861 (+    70us) write_op.cc:312] APPLY: finished
0709 13:02:54.677241 (+   380us) log.cc:844] Serialized 89 byte log entry
0709 13:02:54.677451 (+   210us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:54.677597 (+   146us) write_op.cc:454] Released schema lock
0709 13:02:54.677662 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:54.678154 (+   492us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:54.678188 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":142622,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":122006,"apply.run_cpu_time_us":13958,"apply.run_wall_time_us":14003,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41747,"num_ops":9,"prepare.queue_time_us":920663,"prepare.run_cpu_time_us":34598,"prepare.run_wall_time_us":258449,"raft.queue_time_us":562660,"raft.run_cpu_time_us":80128,"raft.run_wall_time_us":168946,"replication_time_us":1114395,"thread_start_us":1239807,"threads_started":4,"wal-append.queue_time_us":299930,"wal-append.run_cpu_time_us":34869,"wal-append.run_wall_time_us":2807986}]]}
I20260709 13:02:58.225049  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:58.225267  7127 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:58.396665  7261 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:58.242954  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:58.246536  1630 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:02:58.410588  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 164132us
I20260709 13:02:58.410704  6994 raft_consensus.cc:2804] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:58.411286  6994 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:58.411695  6994 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:58.254263  1660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39146 (request call id 3944) took 1596 ms. Trace:
W20260709 13:02:58.412621  2426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.199025  7274 consensus_queue.cc:1048] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.086s
I20260709 13:02:58.207602  7268 consensus_queue.cc:1048] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:02:58.415360  7121 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:58.281703  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:58.416332  1658 raft_consensus.cc:2410] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:02:58.417196  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:58.391928  7265 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:58.417850  1658 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:02:58.418774  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:58.419649  7265 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:58.419754  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:58.281522  7141 raft_consensus.cc:2749] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:58.421620  7241 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:58.380980  7079 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:58.260473  7271 consensus_queue.cc:1059] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:02:58.295818  1733 raft_consensus.cc:1217] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 22 LEADER]: Deduplicated request from leader. Original: 19.12->[21.13-21.13]   Dedup: 21.13->[]
I20260709 13:02:58.423235  1733 raft_consensus.cc:1240] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 22 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:02:58.424585  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:58.425836  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:58.426498  1733 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:58.428157  7079 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:58.427734  6821 consensus_queue.cc:260] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:58.297406  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:58.297925  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:58.430248  1659 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12.
I20260709 13:02:58.431203  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:58.431733  1659 raft_consensus.cc:2468] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:02:58.432542  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:58.307443  1734 raft_consensus.cc:1240] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:58.311390  1738 raft_consensus.cc:1240] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 16. Current term is 17. Ops: []
W20260709 13:02:58.298868  7078 consensus_meta.cc:287] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent flushing consensus metadata: real 1.427s	user 0.020s	sys 0.001s
I20260709 13:02:58.306830  7254 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:58.433938  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:58.434514  1734 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 14.
I20260709 13:02:58.434320  7254 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:58.436601  7254 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:58.320201  7262 log.cc:927] Time spent T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:02:58.408969  7261 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:58.328341  7244 log.cc:927] Time spent T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.446s	user 0.005s	sys 0.000s
I20260709 13:02:58.312856  7085 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.442569  7085 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:58.312755  7255 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.445652  1659 raft_consensus.cc:2410] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:02:58.445560  7255 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:58.446764  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:58.447894  7255 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:58.447983  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:58.333917  6674 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:58.448652  1659 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 16.
I20260709 13:02:58.449606  6821 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:58.450037  6674 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:58.313256  6826 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.336606  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:58.451197  1664 raft_consensus.cc:2393] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 18: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:58.352074  1663 raft_consensus.cc:2468] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:02:58.451741  1741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35672 (request call id 733) took 1564 ms. Trace:
I20260709 13:02:58.343329  1735 raft_consensus.cc:1240] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:58.452178  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:58.338644  6920 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:02:58.355048  1631 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.015s	sys 0.046s
I20260709 13:02:58.353992  7051 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:58.452116  1741 rpcz_store.cc:276] 0709 13:02:56.887378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.889359 (+  1981us) service_pool.cc:224] Handling call
0709 13:02:57.451151 (+561792us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:57.498576 (+ 47425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:57.498608 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:57.516806 (+ 18198us) log.cc:844] Serialized 26 byte log entry
0709 13:02:57.900030 (+383224us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:57.900074 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:57.900153 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:58.451516 (+551363us) raft_consensus.cc:1685] finished
0709 13:02:58.451537 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:58.451679 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46953,"raft.queue_time_us":55576,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":10652,"spinlock_wait_cycles":276224,"thread_start_us":323231,"threads_started":1,"wal-append.queue_time_us":627192}
I20260709 13:02:58.453110  1663 raft_consensus.cc:2393] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 13: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:58.355777  7047 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:58.420982  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:58.455354  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:58.455986  1663 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
W20260709 13:02:58.456149  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.357208  7067 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:58.357630  7246 raft_consensus.cc:3055] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:58.358536  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:58.467846  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:58.468503  1661 raft_consensus.cc:2410] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:02:58.360366  2424 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:02:58.469655  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 109362us
I20260709 13:02:58.471005  2424 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:02:58.356173  1705 leader_election.cc:336] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.969s (SENT)
I20260709 13:02:58.369975  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:58.376255  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:02:58.473598  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 119017us
I20260709 13:02:58.378860  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:58.383669  1633 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:58.392413  1666 raft_consensus.cc:2393] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 18: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
W20260709 13:02:58.474162  1705 leader_election.cc:336] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.991s (SENT)
W20260709 13:02:58.391335  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 224691us
I20260709 13:02:58.474428  1665 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 17.
I20260709 13:02:58.474676  1705 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:58.475049  1558 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:02:58.475796  1705 leader_election.cc:336] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.019s (SENT)
I20260709 13:02:58.385612  1590 rpcz_store.cc:276] 0709 13:02:56.887114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.887540 (+   426us) service_pool.cc:224] Handling call
0709 13:02:56.887863 (+   323us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:56.888250 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:56.888294 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:57.440993 (+552699us) log.cc:844] Serialized 52 byte log entry
0709 13:02:57.742997 (+302004us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:57.743057 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:57.743154 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:58.117804 (+374650us) raft_consensus.cc:1685] finished
0709 13:02:58.117828 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:58.117992 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1397,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":103,"thread_start_us":177879,"threads_started":1,"wal-append.queue_time_us":359548}
I20260709 13:02:58.393101  6360 raft_consensus.cc:697] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:58.388897  1556 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:58.385190  7188 consensus_queue.cc:1048] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:02:58.480300  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:58.397400  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:58.481427  1661 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 13.
I20260709 13:02:58.482692  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:58.472677  2424 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:58.484220  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:02:58.484470  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 101084us
I20260709 13:02:58.379709  7143 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.411580  1630 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:58.251539  1555 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:58.412264  1660 rpcz_store.cc:276] 0709 13:02:56.657594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.657821 (+   227us) service_pool.cc:224] Handling call
0709 13:02:58.254038 (+1596217us) spinlock_profiling.cc:243] Waited 804 ms on lock 0x7b54002fc454. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:58.254193 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1849614080}
I20260709 13:02:58.208966  7012 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:58.255841  7114 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.428829  7009 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:58.297204  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:58.493130  1739 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 14.
I20260709 13:02:58.420671  6994 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:58.450845  6826 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:58.352870  1736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3913) took 1466 ms. Trace:
I20260709 13:02:58.455994  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:58.498898  1658 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
I20260709 13:02:58.499694  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:58.500605  1658 raft_consensus.cc:2410] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:02:58.452174  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:58.458952  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:58.501001  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:58.501479  1659 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
I20260709 13:02:58.501644  1735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43686 (request call id 2581) took 1641 ms. Trace:
I20260709 13:02:58.502420  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:58.503212  1659 raft_consensus.cc:2410] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:02:58.466454  1662 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12.
I20260709 13:02:58.456446  7047 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:58.475594  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:58.381358  7206 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:58.516202  1659 raft_consensus.cc:1240] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 12. Current term is 14. Ops: []
I20260709 13:02:58.483191  7248 raft_consensus.cc:2749] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:58.497354  7143 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:58.479373  7246 raft_consensus.cc:740] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:58.483047  7051 raft_consensus.cc:2749] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:58.456851  1732 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 17.
I20260709 13:02:58.480194  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:58.485260  1633 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:58.526037  1666 raft_consensus.cc:2368] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 12. Current term is 13.
I20260709 13:02:58.527129  1666 raft_consensus.cc:1240] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 12. Current term is 13. Ops: []
W20260709 13:02:58.486284  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 97443.8us
I20260709 13:02:58.528774  1556 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:02:58.487370  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 235924us
I20260709 13:02:58.483522  7078 raft_consensus.cc:2804] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:02:58.489143  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 77570.1us
I20260709 13:02:58.492080  1733 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 14.
I20260709 13:02:58.444888  7085 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:58.504050  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:58.494868  6360 consensus_queue.cc:237] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:58.502032  1735 rpcz_store.cc:276] 0709 13:02:56.860084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.933793 (+ 73709us) service_pool.cc:224] Handling call
0709 13:02:58.057996 (+1124203us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b58000e4398. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7de6ab71 00007f1b7de6aa22 00007f1b86d83c09 00007f1b85eddee0 00007f1b85fa70ab 00007f1b85fa7131 00007f1b85f68fc0 00007f1b85f53929 00007f1b85f533d2 00007f1b7f4cabd4
0709 13:02:58.343124 (+285128us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:58.452530 (+109406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:58.501449 (+ 48919us) spinlock_profiling.cc:243] Waited 285 ms on lock 0x7b540001e850. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8e8ad 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:58.501586 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":694476928}
I20260709 13:02:58.506558  1667 raft_consensus.cc:2410] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:02:58.508252  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:02:58.497681  1736 rpcz_store.cc:276] 0709 13:02:56.886124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.886258 (+   134us) service_pool.cc:224] Handling call
0709 13:02:58.007418 (+1121160us) spinlock_profiling.cc:243] Waited 8.52 ms on lock 0x7b58000e4398. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7de6ab71 00007f1b7de6aa22 00007f1b86d83c09 00007f1b85eddee0 00007f1b85fa70ab 00007f1b85fa7131 00007f1b85f68fc0 00007f1b85f53929 00007f1b85f533d2 00007f1b7f4cabd4
0709 13:02:58.007692 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:58.008186 (+   494us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:58.008224 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:58.008811 (+   587us) log.cc:844] Serialized 26 byte log entry
0709 13:02:58.337964 (+329153us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:58.338011 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:58.338079 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:58.342939 (+  4860us) raft_consensus.cc:1685] finished
0709 13:02:58.342962 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:58.352768 (+  9806us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13467,"raft.run_cpu_time_us":50,"raft.run_wall_time_us":50,"spinlock_wait_cycles":19586304,"thread_start_us":328764,"threads_started":1,"wal-append.queue_time_us":332148}
I20260709 13:02:58.509756  1665 raft_consensus.cc:2410] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:02:58.512598  2543 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16.
W20260709 13:02:58.513506  2424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.520068  7047 consensus_queue.cc:1048] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:58.505264  7264 raft_consensus.cc:2804] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:58.495165  7241 raft_consensus.cc:2804] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:02:58.532583  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 47410.3us
I20260709 13:02:58.494598  7271 consensus_queue.cc:1048] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:02:58.453038  6920 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:58.496030  7254 raft_consensus.cc:2749] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:58.477782  1705 leader_election.cc:336] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.019s (SENT)
I20260709 13:02:58.495715  7247 raft_consensus.cc:2804] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:58.583062  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:58.592614  1588 raft_consensus.cc:1275] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:58.616338  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:58.616755  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:58.539948  1665 raft_consensus.cc:1275] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:02:58.566071  1740 raft_consensus.cc:2410] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:02:58.619457  1664 raft_consensus.cc:2393] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 13: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:02:58.605201  1633 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:58.594027  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:58.533942  1662 raft_consensus.cc:2410] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:02:58.620488  1583 raft_consensus.cc:2410] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:02:58.571424  1556 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:58.617354  1588 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 16.
I20260709 13:02:58.621526  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:58.569878  1735 raft_consensus.cc:1275] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:02:58.496953  7012 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:58.575325  1737 raft_consensus.cc:1275] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:02:58.548105  1666 raft_consensus.cc:1275] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:02:58.572142  1736 raft_consensus.cc:1275] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:02:58.544735  1661 raft_consensus.cc:1275] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 13. (term mismatch)
W20260709 13:02:58.533202  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.587630  7067 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:58.497162  7114 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:58.595193  1741 raft_consensus.cc:1275] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:58.593001  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:02:58.613621  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:02:58.614495  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 84611.1us
I20260709 13:02:58.504900  7275 raft_consensus.cc:2749] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:58.619272  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:58.644309  1662 raft_consensus.cc:1275] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:58.668222  1739 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 14.
I20260709 13:02:58.669308  1666 pending_rounds.cc:85] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 8
I20260709 13:02:58.670097  1666 pending_rounds.cc:107] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 13.9
W20260709 13:02:58.555467  7295 log.cc:927] Time spent T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:02:58.625188  1732 raft_consensus.cc:1240] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 12 LEADER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:58.554438  7110 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.620808  1633 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:02:58.606767  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 129027us
W20260709 13:02:58.627365  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 56028.3us
I20260709 13:02:58.562484  7143 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:58.573287  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:58.666293  7273 consensus_queue.cc:1048] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:02:58.667008  7246 consensus_queue.cc:260] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:58.686075  7246 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:58.591696  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:58.532691  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:58.537058  1667 raft_consensus.cc:1275] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:02:58.693418  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:58.694065  1587 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
I20260709 13:02:58.632134  1663 raft_consensus.cc:2410] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:02:58.587968  7265 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:02:58.670267  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.643257  7268 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:58.588214  7217 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:58.536579  7250 raft_consensus.cc:2749] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:58.671780  1555 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:58.664674  1661 pending_rounds.cc:85] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 12
I20260709 13:02:58.673319  1666 raft_consensus.cc:2889] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:58.710451  1590 raft_consensus.cc:1275] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:02:58.573129  7078 raft_consensus.cc:697] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:58.697364  7110 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:58.711333  1555 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:58.711790  7078 consensus_queue.cc:237] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:58.710461  1661 pending_rounds.cc:107] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 21.13
I20260709 13:02:58.537151  7240 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.675272  1660 raft_consensus.cc:1240] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:02:58.713446  1665 raft_consensus.cc:1275] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:02:58.602123  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.676829  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:58.715375  1583 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15.
I20260709 13:02:58.715618  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:58.604600  7264 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
W20260709 13:02:58.679103  1705 leader_election.cc:336] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.029s (SENT)
I20260709 13:02:58.679425  1556 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:58.615125  7247 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:58.681860  1707 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:58.683133  7114 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:58.683406  6826 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:02:58.691789  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 71072.4us
I20260709 13:02:58.694952  1662 raft_consensus.cc:3055] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:58.619059  7098 consensus_queue.cc:1059] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 13:02:58.624881  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:58.620565  7241 raft_consensus.cc:697] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:58.700408  7296 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.700632  6920 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:58.628067  7293 raft_consensus.cc:2749] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:58.697927  7143 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:58.708103  6994 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:58.713485  1661 raft_consensus.cc:2889] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:58.717832  1705 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:58.722321  7085 raft_consensus.cc:2749] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:58.722137  1707 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:58.698457  7067 consensus_queue.cc:1048] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:02:58.716374  7094 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:58.719398  7264 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:58.718930  7271 raft_consensus.cc:2749] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:58.721212  7247 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:58.741544  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 62469.6us
I20260709 13:02:58.743278  7051 raft_consensus.cc:2804] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:58.743736  1707 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:58.742081  7047 raft_consensus.cc:2749] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:58.719204  7240 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:58.747377  7051 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.738857  7296 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:58.720748  1555 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:58.719889  1556 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:58.723378  1633 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:58.723143  1662 raft_consensus.cc:740] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:58.893285  7250 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.896838  7271 raft_consensus.cc:2804] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:58.897606  7271 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:58.897929  2550 raft_consensus.cc:1275] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:02:58.898211  7271 raft_consensus.cc:3060] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:58.899801  6994 raft_consensus.cc:2804] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:58.900528  6994 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:58.901124  6994 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:58.905098  2424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.905588  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:58.907141  2540 raft_consensus.cc:2410] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:02:58.907300  2424 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:02:58.910569  2426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.911559  7078 raft_consensus.cc:2749] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:58.771437  7110 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:58.753204  7296 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:58.916939  7094 raft_consensus.cc:2749] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:58.919716  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:58.921427  6821 raft_consensus.cc:2804] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:58.864367  1662 consensus_queue.cc:260] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:58.923723  2543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49222 (request call id 672) took 1047 ms. Trace:
I20260709 13:02:58.925047  1662 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:58.769850  7241 consensus_queue.cc:237] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:58.924263  2543 rpcz_store.cc:276] 0709 13:02:57.876336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.876858 (+   522us) service_pool.cc:224] Handling call
0709 13:02:58.923279 (+1046421us) spinlock_profiling.cc:243] Waited 559 ms on lock 0x7b540060f754. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:58.923517 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1284588800}
I20260709 13:02:58.897442  7250 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:58.751169  7051 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:58.749810  7114 raft_consensus.cc:2804] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:58.939550  7114 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.939982  7114 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:58.850648  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 127174us
I20260709 13:02:58.821625  1487 catalog_manager.cc:5697] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:58.947532  1633 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:02:58.846805  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 126833us
I20260709 13:02:58.758137  7268 raft_consensus.cc:2749] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:58.853570  1658 raft_consensus.cc:3055] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:58.777931  7247 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:58.840308  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 119546us
W20260709 13:02:58.747637  1705 leader_election.cc:336] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.033s (SENT)
I20260709 13:02:58.748600  1707 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:02:58.994246  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.957618  1658 raft_consensus.cc:740] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:58.995527  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:58.996436  1658 consensus_queue.cc:260] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:58.959824  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.997821  1658 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:58.998502  7067 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.965941  1705 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:58.999414  7067 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:58.968763  1558 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:02:58.972766  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:59.001350  7047 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:59.002126  2540 raft_consensus.cc:2376] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16. Re-sending same reply.
I20260709 13:02:58.994159  2550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49238 (request call id 604) took 1167 ms. Trace:
I20260709 13:02:59.003551  6974 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:59.004344  6974 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:59.004841  6974 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:59.004699  7110 consensus_queue.cc:1048] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:58.997293  1739 raft_consensus.cc:1240] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:58.972322  6821 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:58.974721  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:59.009662  7265 consensus_queue.cc:1048] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:58.974561  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:59.011463  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:59.012447  2552 raft_consensus.cc:2468] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 12.
I20260709 13:02:59.012563  7265 consensus_queue.cc:1048] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:59.014096  6360 raft_consensus.cc:3055] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:59.014562  6360 raft_consensus.cc:740] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:58.980820  7247 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:59.016054  6360 consensus_queue.cc:260] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:59.019138  7206 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:58.953541  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.008430  6821 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:58.990800  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 86522.2us
W20260709 13:02:59.041570  2426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:59.040228  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 292605us
I20260709 13:02:59.003692  2550 rpcz_store.cc:276] 0709 13:02:57.826614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.826810 (+   196us) service_pool.cc:224] Handling call
0709 13:02:57.861691 (+ 34881us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:58.898527 (+1036836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:58.993819 (+ 95292us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540051c554. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:58.994074 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2330912000}
I20260709 13:02:58.949029  1487 catalog_manager.cc:5697] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:58.983656  7250 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:58.973786  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:58.988636  7240 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:59.057833  2548 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:02:59.058244  6360 raft_consensus.cc:3060] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:59.059659  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 112433us
W20260709 13:02:59.060115  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 153172us
I20260709 13:02:59.061030  1633 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:58.954028  7293 raft_consensus.cc:2749] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:59.061235  7206 consensus_queue.cc:1048] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:59.061542  7240 consensus_queue.cc:1048] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:59.063721  7067 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:58.990855  7296 raft_consensus.cc:2804] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:59.064481  7296 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:59.064898  7296 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:59.065284  2548 raft_consensus.cc:1240] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:58.989550  7085 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.067795  7067 consensus_queue.cc:1059] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:59.068892  7274 raft_consensus.cc:3055] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:59.069507  7274 raft_consensus.cc:740] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:59.070806  7274 consensus_queue.cc:260] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:59.071758  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.071980  7143 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:58.990439  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 241753us
I20260709 13:02:59.072625  7274 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:59.068642  7085 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:59.072862  7143 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:59.072337  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.073730  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:58.980090  2543 consensus_queue.cc:237] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:59.088490  7085 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:59.095677  7143 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:59.101745  1705 leader_election.cc:336] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.167s (SENT)
W20260709 13:02:59.103717  1705 leader_election.cc:336] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.244s (SENT)
I20260709 13:02:59.104041  1662 raft_consensus.cc:1275] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:02:58.775317  7264 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:59.106611  7293 raft_consensus.cc:2804] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:59.107105  7293 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:59.107518  7293 raft_consensus.cc:3060] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:59.107978  7264 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:59.111485  1662 pending_rounds.cc:85] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 8
I20260709 13:02:59.111985  1662 pending_rounds.cc:107] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:02:59.111558  6994 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:59.112370  1662 raft_consensus.cc:2889] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:59.111145  6974 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:59.117690  1663 raft_consensus.cc:1240] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 16. Current term is 17. Ops: []
W20260709 13:02:59.117715  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 56932.3us
I20260709 13:02:59.126566  7067 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:59.124872  7254 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.139286  7067 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:59.139523  7254 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:59.130807  7085 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.123356  6974 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:59.123835  6994 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:59.116988  6821 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:59.162745  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 176584us
I20260709 13:02:59.164000  1633 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:59.141290  7085 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:59.186425  7294 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:59.186725  7254 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:59.187207  7294 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:59.191937  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.191457  7296 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:59.195498  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 52513.2us
I20260709 13:02:59.196494  1633 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:59.197674  7254 raft_consensus.cc:2749] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:59.199323  1633 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:59.199869  7067 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:59.211212  1556 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:59.211665  1739 raft_consensus.cc:1240] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:59.212436  7110 raft_consensus.cc:2804] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:59.212894  7110 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:59.213325  7110 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:59.201896  1487 catalog_manager.cc:5697] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:59.227610  1590 raft_consensus.cc:1240] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:02:59.219112  7254 raft_consensus.cc:2749] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:59.277968  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 78855.7us
I20260709 13:02:59.252137  7143 raft_consensus.cc:2804] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:59.224802  7264 consensus_queue.cc:1059] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:02:59.289912  7051 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:59.292493  7051 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:02:59.296108  2425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.297480  1588 raft_consensus.cc:1240] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:59.231195  7067 consensus_queue.cc:1048] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:02:59.299088  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:59.285794  7143 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:59.314365  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:59.316958  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:02:59.310487  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:59.288348  1487 catalog_manager.cc:5697] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:59.321990  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 121460us
I20260709 13:02:59.326629  1583 raft_consensus.cc:1275] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:59.317880  6821 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:59.319597  7143 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:59.351125  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:59.355440  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:59.356246  1583 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15.
I20260709 13:02:59.345731  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:59.360133  2548 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:59.365895  7114 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:59.367931  1739 raft_consensus.cc:1240] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
W20260709 13:02:59.368979  7312 log.cc:927] Time spent T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:02:59.370312  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:59.370862  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:02:59.371452  1733 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:59.369134  1633 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:59.374893  1740 raft_consensus.cc:2393] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 in current term 17: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:02:59.331159  7294 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:59.365753  7316 log.cc:927] Time spent T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:02:59.350747  1487 catalog_manager.cc:5697] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 8 to 10, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:59.413615  2426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.381867  7114 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:59.418840  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:59.420679  6674 raft_consensus.cc:2749] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:59.421587  2423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:59.422606  7315 log.cc:927] Time spent T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:02:59.422657  6974 consensus_queue.cc:1048] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:59.429596  1487 catalog_manager.cc:5697] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:02:59.431737  1487 catalog_manager.cc:5697] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 11 to 15, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:59.434314  1487 catalog_manager.cc:5697] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 10 to 11, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:59.438714  1733 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 15.
W20260709 13:02:59.441480  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 74302.6us
I20260709 13:02:59.443814  1633 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:59.446970  1555 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:59.449347  6974 raft_consensus.cc:2804] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:59.450940  1740 raft_consensus.cc:1275] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:02:59.449954  6974 raft_consensus.cc:697] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 16 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:59.452481  6974 consensus_queue.cc:237] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:59.416821  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:02:59.456055  1659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 3064) took 1171 ms. Trace:
I20260709 13:02:59.458288  7240 consensus_queue.cc:1059] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:02:59.458670  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:02:59.459966  7034 raft_consensus.cc:3055] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:59.460362  7034 raft_consensus.cc:740] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:02:59.461259  7034 consensus_queue.cc:260] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:59.462868  1662 raft_consensus.cc:1275] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:59.463263  1741 raft_consensus.cc:1240] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 20. Current term is 21. Ops: []
W20260709 13:02:59.415032  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.465034  1630 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:02:59.466364  1664 raft_consensus.cc:1275] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:02:59.466907  1556 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:02:59.467504  7254 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:59.468000  7254 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:59.468353  7254 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:59.383074  7296 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:02:59.469539  2424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.395347  7293 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:59.447127  2548 raft_consensus.cc:2468] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 17.
I20260709 13:02:59.474656  1555 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:59.456542  1659 rpcz_store.cc:276] 0709 13:02:58.284400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:58.594854 (+310454us) service_pool.cc:224] Handling call
0709 13:02:59.015780 (+420926us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:59.016609 (+   829us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:59.017070 (+   461us) log.cc:844] Serialized 14 byte log entry
0709 13:02:59.151270 (+134200us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:59.186288 (+ 35018us) log.cc:844] Serialized 52 byte log entry
0709 13:02:59.201067 (+ 14779us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:59.201409 (+   342us) log.cc:844] Serialized 14 byte log entry
0709 13:02:59.201709 (+   300us) log.cc:844] Serialized 14 byte log entry
0709 13:02:59.203245 (+  1536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:59.208255 (+  5010us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:59.356862 (+148607us) spinlock_profiling.cc:243] Waited 4.73 ms on lock 0x7b48001bc258. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b85eb8aa1 00007f1b85eafb37 00007f1b85eaf9ca 00007f1b85fa726f 00007f1b85fa6f37 00007f1b85fbb55c 00007f1b85fbb508 00007f1b85fbb488 00007f1b85fbb443 00007f1b85fba6ec 00007f1b84ee4a96
0709 13:02:59.371396 (+ 14534us) raft_consensus.cc:1685] finished
0709 13:02:59.371417 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:59.376029 (+  4612us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b180009d900. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7dea2522 00007f1b7dea47c1 00007f1b7dea4779 00007f1b7dea4709 00007f1b7dea46d1 00007f1b7dea39cd 000000000038f354 000000000038f199 00007f1b7de8583a
0709 13:02:59.455716 (+ 79687us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b540030aa50. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8e8ad 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:02:59.455848 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1092,"prepare.queue_time_us":193179,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":113,"raft.queue_time_us":3995,"raft.run_cpu_time_us":3330,"raft.run_wall_time_us":210104,"spinlock_wait_cycles":1032504704,"thread_start_us":133119,"threads_started":1,"wal-append.queue_time_us":168105}
W20260709 13:02:59.411696  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 132149us
I20260709 13:02:59.436167  1487 catalog_manager.cc:5697] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 8 to 15. New cstate: current_term: 15 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:59.468530  7264 raft_consensus.cc:2804] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:59.412724  7085 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:59.488327  6360 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:59.501015  1633 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:59.501430  7248 consensus_queue.cc:1048] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 13:02:59.502938  1633 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:59.503654  7282 consensus_queue.cc:1048] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:02:59.504871  1633 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:02:59.515992  1733 raft_consensus.cc:1275] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:59.518710  1704 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:02:59.522562  1705 connection.cc:256] RPC call timeout handler was delayed by -1.3684491770000022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2801s for a response
I20260709 13:02:59.512742  7264 raft_consensus.cc:697] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:59.542572  7143 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:59.526167  6994 raft_consensus.cc:2804] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:59.538476  1487 catalog_manager.cc:5697] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:59.548358  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 99261.9us
I20260709 13:02:59.538183  6674 raft_consensus.cc:2804] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:59.553956  7293 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:59.527261  7110 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:59.575904  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 71173.2us
I20260709 13:02:59.552666  6994 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:59.579420  1661 raft_consensus.cc:1240] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:59.579459  1487 catalog_manager.cc:5697] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:59.579965  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 93347.1us
W20260709 13:02:59.586040  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 46832.7us
I20260709 13:02:59.571643  6674 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:59.591769  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:02:59.599663  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 134772us
W20260709 13:02:59.601184  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.587074  6994 raft_consensus.cc:3060] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:59.608614  1705 connection.cc:256] RPC call timeout handler was delayed by -1.2157743850000315s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2654s for a response
W20260709 13:02:59.609325  1705 connection.cc:256] RPC call timeout handler was delayed by -1.1527195490000395s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1665s for a response
I20260709 13:02:59.605111  1558 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:02:59.609654  1705 connection.cc:256] RPC call timeout handler was delayed by -1.12095629800001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30350000000000005s for a response
W20260709 13:02:59.614709  1705 connection.cc:256] RPC call timeout handler was delayed by -1.1131195490000323s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17090000000000002s for a response
W20260709 13:02:59.615051  1705 connection.cc:256] RPC call timeout handler was delayed by -1.0167119540000158s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15600000000000003s for a response
I20260709 13:02:59.598559  6674 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:59.608500  1707 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:59.621711  1556 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:59.623783  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:02:59.616459  1487 catalog_manager.cc:5697] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:59.628566  1592 raft_consensus.cc:1240] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:02:59.629431  7341 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:59.630260  7341 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:59.631346  1556 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:59.632649  7098 raft_consensus.cc:2804] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:59.633157  7098 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:59.633260  7085 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.633601  7098 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:59.634055  7085 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:59.638705  1707 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:59.639986  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 88181.3us
I20260709 13:02:59.640419  7051 raft_consensus.cc:2804] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:59.641008  7051 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:59.641571  7051 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:59.643170  7034 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:59.645342  7274 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:59.652585  7323 raft_consensus.cc:2804] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:59.653234  7241 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:02:59.656350  7306 log.cc:927] Time spent T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.399s	user 0.003s	sys 0.003s
I20260709 13:02:59.656188  7247 consensus_queue.cc:1059] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:59.657226  7264 consensus_queue.cc:237] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:59.659083  7328 log.cc:927] Time spent T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:02:59.613353  7293 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:59.659227  7094 raft_consensus.cc:3055] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:59.661489  7253 consensus_queue.cc:1059] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:02:59.663769  7271 consensus_meta.cc:287] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.765s	user 0.006s	sys 0.012s
I20260709 13:02:59.639192  7265 raft_consensus.cc:2804] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:59.640759  1555 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:02:59.681612  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:59.628692  7314 log.cc:927] Time spent T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.277s	user 0.002s	sys 0.000s
I20260709 13:02:59.688553  1487 catalog_manager.cc:5697] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 9 to 11, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:59.693094  2425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:59.694073  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 47393.5us
W20260709 13:02:59.695573  7311 log.cc:927] Time spent T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 13:02:59.695065  7273 consensus_queue.cc:1048] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
W20260709 13:02:59.709528  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:59.727921  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:59.728653  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.687119  7341 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:59.692548  7241 raft_consensus.cc:697] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:59.706558  7094 raft_consensus.cc:740] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:02:59.718353  7323 raft_consensus.cc:697] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 17 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:02:59.721570  7085 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:02:59.748622  1487 catalog_manager.cc:5697] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 9 to 11, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:59.717247  7265 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:02:59.731364  7293 raft_consensus.cc:697] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 14 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:02:59.768669  7334 raft_consensus.cc:2804] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:59.769284  6821 raft_consensus.cc:2804] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:59.769776  7334 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:02:59.769994  6821 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:02:59.770414  7334 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:59.770478  6821 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:59.770816  7268 consensus_queue.cc:1048] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:02:59.776727  1487 catalog_manager.cc:5697] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:59.721935  7271 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:59.755932  7265 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:59.817938  7329 log.cc:927] Time spent T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:02:59.817971  7240 consensus_queue.cc:1048] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:02:59.829949  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 63287.5us
W20260709 13:02:59.838304  1705 leader_election.cc:336] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.560s (SENT)
I20260709 13:02:59.842027  1705 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:02:59.842150  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 201464us
I20260709 13:02:59.838174  1487 catalog_manager.cc:5697] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 14 to 16, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 16 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:59.828886  7110 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:59.854888  1586 raft_consensus.cc:1240] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:59.849561  7206 raft_consensus.cc:2749] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:59.855121  6821 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:02:59.855329  1705 leader_election.cc:336] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.593s (SENT)
I20260709 13:02:59.857286  1705 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:02:59.858039  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 100946us
W20260709 13:02:59.859032  1705 leader_election.cc:336] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.665s (SENT)
I20260709 13:02:59.859530  1705 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:59.860878  7325 raft_consensus.cc:2749] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:59.861281  7206 raft_consensus.cc:2749] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:59.861761  7332 log.cc:927] Time spent T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
W20260709 13:02:59.862107  1705 leader_election.cc:336] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.703s (SENT)
W20260709 13:02:59.863420  7326 log.cc:927] Time spent T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.269s	user 0.002s	sys 0.000s
W20260709 13:02:59.863603  1705 leader_election.cc:336] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.709s (SENT)
I20260709 13:02:59.864125  1705 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:59.864988  7206 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 18 LEADER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:59.865813  7337 log.cc:927] Time spent T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.164s	user 0.002s	sys 0.000s
W20260709 13:02:59.867215  1705 leader_election.cc:336] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.857s (SENT)
I20260709 13:02:59.867799  1705 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:02:59.868685  7206 raft_consensus.cc:2749] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:59.870258  1705 leader_election.cc:336] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.929s (SENT)
W20260709 13:02:59.878414  7339 log.cc:927] Time spent T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:02:59.887187  1738 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 14.
I20260709 13:02:59.890128  1705 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:02:59.893972  1584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59112 (request call id 3157) took 1231 ms. Trace:
I20260709 13:02:59.894599  7348 consensus_queue.cc:1048] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:59.894896  7110 consensus_queue.cc:1048] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:59.894555  1584 rpcz_store.cc:276] 0709 13:02:58.591943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:58.594095 (+  2152us) service_pool.cc:224] Handling call
0709 13:02:58.613265 (+ 19170us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:58.712128 (+ 98863us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:58.712157 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:58.712662 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 13:02:59.093583 (+380921us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:59.093673 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:59.374741 (+281068us) spinlock_profiling.cc:243] Waited 98.5 ms on lock 0x7b54003a0554. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:02:59.374784 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:59.655564 (+280780us) spinlock_profiling.cc:243] Waited 4.3 ms on lock 0x7b4400022b4c. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7ddc8c85 00007f1b7ddc96a2 00007f1b80b3b1db 00007f1b80b36aaf 00007f1b80b2a86e 00007f1b80b29bb6 00007f1b80b297d8 00007f1b80b33221 00007f1b80b331d9 00007f1b80b33169
0709 13:02:59.810398 (+154834us) raft_consensus.cc:1685] finished
0709 13:02:59.810428 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:59.822996 (+ 12568us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4484,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":1252,"spinlock_wait_cycles":236411008,"thread_start_us":380303,"threads_started":1,"wal-append.queue_time_us":467915}
I20260709 13:02:59.843398  7143 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:02:59.897823  1487 catalog_manager.cc:5697] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 9 to 11, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:59.908221  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 94305.2us
I20260709 13:02:59.896911  7348 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.920284  1487 catalog_manager.cc:5697] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 10 to 11, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 11 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:02:59.928784  7271 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:59.933362  7346 raft_consensus.cc:2749] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:59.941655  1487 catalog_manager.cc:5697] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:59.854809  7094 consensus_queue.cc:260] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:02:59.952756  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 44948.7us
I20260709 13:02:59.951089  1487 catalog_manager.cc:5697] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 12 to 13, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 13 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:02:59.885582  7241 consensus_queue.cc:237] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:59.962399  7094 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:59.965956  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:02:59.967017  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:02:59.948838  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 89645.6us
I20260709 13:02:59.908577  7293 consensus_queue.cc:237] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:59.854121  7323 consensus_queue.cc:237] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:59.977363  1737 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 11.
I20260709 13:02:59.945679  7143 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.988869  7098 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:02:59.991658  7098 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:59.999210  7143 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:02:59.977022  1487 catalog_manager.cc:5697] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:00.014068  1487 catalog_manager.cc:5697] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:00.020658  6821 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:02:59.951470  7348 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:00.025166  7078 consensus_queue.cc:1059] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:03:00.027750  7351 raft_consensus.cc:3055] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:00.028239  7351 raft_consensus.cc:740] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:00.008213  7282 consensus_queue.cc:1048] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:03:00.029356  7351 consensus_queue.cc:260] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:00.030869  7351 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:00.033756  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:03:00.035655  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 56881.4us
W20260709 13:03:00.039023  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:00.041718  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 171486us
I20260709 13:03:00.016865  1487 catalog_manager.cc:5697] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:00.048625  6674 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:00.105108  7348 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:00.104933  2424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.104926  7282 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.106683  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:00.106380  7282 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:00.107249  6674 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:00.109247  7282 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:00.114019  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.115710  7334 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:00.118898  2426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.119314  1487 catalog_manager.cc:5697] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:00.128249  1705 leader_election.cc:336] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.654s (SENT)
I20260709 13:03:00.128041  1487 catalog_manager.cc:5697] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 7 to 12, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:00.130769  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:00.138917  1734 raft_consensus.cc:1275] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:03:00.140501  7341 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.142364  7341 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:00.145184  7143 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:00.146353  7051 consensus_meta.cc:287] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.504s	user 0.014s	sys 0.000s
I20260709 13:03:00.146984  7051 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:00.149946  7254 consensus_meta.cc:287] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.663s	user 0.007s	sys 0.006s
I20260709 13:03:00.150487  7254 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:00.141615  7098 consensus_queue.cc:1048] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:03:00.156819  7282 consensus_queue.cc:1059] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:03:00.157224  6994 consensus_meta.cc:287] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.539s	user 0.015s	sys 0.000s
I20260709 13:03:00.157703  7247 consensus_queue.cc:1048] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:00.157846  6994 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:00.158505  7341 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:00.158438  2426 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:00.159291  7349 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:00.165971  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 63644us
I20260709 13:03:00.159737  7247 raft_consensus.cc:3055] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:00.164424  7265 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:00.178838  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.199738  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:00.162981  7248 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:00.224316  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.190570  6360 raft_consensus.cc:3055] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:00.226162  6360 raft_consensus.cc:740] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:00.230618  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
W20260709 13:03:00.235514  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:00.233007  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 115615us
I20260709 13:03:00.232542  7143 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:03:00.246239  1705 leader_election.cc:336] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 3.194s (SENT)
I20260709 13:03:00.248836  7265 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:00.171823  7247 raft_consensus.cc:740] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:00.173715  7067 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:00.195962  7341 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:00.228379  7051 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:00.206640  7349 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:00.205004  6994 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:00.200814  7078 consensus_queue.cc:1059] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:03:00.275640  6360 consensus_queue.cc:260] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:00.264626  7067 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:00.282109  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:00.263250  7254 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:00.287108  1705 leader_election.cc:336] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 4.499s (SENT)
I20260709 13:03:00.287700  1705 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:00.285462  1732 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 15.
W20260709 13:03:00.308983  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.327136  7214 raft_consensus.cc:3055] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:00.326161  7369 raft_consensus.cc:2955] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index 5 to 8, VOTER 6d4de2ce0683442498244b9529127f91 (127.0.107.193) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:00.327613  7214 raft_consensus.cc:740] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
W20260709 13:03:00.327963  7320 log.cc:927] Time spent T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.816s	user 0.009s	sys 0.007s
I20260709 13:03:00.328331  7248 raft_consensus.cc:3055] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:00.328918  7248 raft_consensus.cc:740] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:00.328996  7214 consensus_queue.cc:260] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:00.329947  7248 consensus_queue.cc:260] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:00.330698  7214 raft_consensus.cc:3060] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:00.272094  7143 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:00.326263  1738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35672 (request call id 747) took 1031 ms. Trace:
I20260709 13:03:00.336165  1738 rpcz_store.cc:276] 0709 13:02:59.295172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:59.298699 (+  3527us) service_pool.cc:224] Handling call
0709 13:03:00.326015 (+1027316us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54000e6354. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:03:00.326184 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":269875072}
I20260709 13:03:00.341290  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:00.344733  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:00.348191  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:00.348510  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:00.349715  7349 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:00.350075  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:00.351541  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:00.353049  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:03:00.366437  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 88038.4us
I20260709 13:03:00.337046  7114 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:00.332201  1664 raft_consensus.cc:2955] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 5 to 8, VOTER 6d4de2ce0683442498244b9529127f91 (127.0.107.193) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:00.335829  7334 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:00.374612  1589 raft_consensus.cc:1240] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:00.317919  7341 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:00.386729  7336 log.cc:927] Time spent T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.794s	user 0.011s	sys 0.000s
I20260709 13:03:00.337352  7247 consensus_queue.cc:260] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:00.405750  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:00.409327  7341 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:00.423799  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 258365us
I20260709 13:03:00.431948  1592 raft_consensus.cc:1240] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:00.413954  7368 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:00.447903  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:00.445657  1707 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:00.453558  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:00.421175  7294 consensus_queue.cc:1059] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:03:00.456875  7294 raft_consensus.cc:3055] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:00.457360  7294 raft_consensus.cc:740] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:00.457723  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:00.458356  7294 consensus_queue.cc:260] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:00.459091  6821 consensus_queue.cc:1048] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:00.459766  7294 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:00.462244  7143 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:00.453960  7247 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:00.468883  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 44166.5us
I20260709 13:03:00.458391  1588 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:00.477159  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:03:00.478078  7313 log.cc:927] Time spent T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 1.148s	user 0.010s	sys 0.010s
I20260709 13:03:00.478153  1661 raft_consensus.cc:2393] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 13: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:00.479617  7369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:51390 (request call id 0) took 1540 ms. Trace:
I20260709 13:03:00.480088  7369 rpcz_store.cc:276] 0709 13:02:58.938822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:58.975285 (+ 36463us) service_pool.cc:224] Handling call
0709 13:02:59.091818 (+116533us) log.cc:844] Serialized 501 byte log entry
0709 13:03:00.479523 (+1387705us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":898,"raft.queue_time_us":10578,"raft.run_cpu_time_us":1362,"raft.run_wall_time_us":1358,"thread_start_us":89344,"threads_started":1,"wal-append.queue_time_us":131295}
I20260709 13:03:00.481523  2550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49238 (request call id 615) took 1415 ms. Trace:
I20260709 13:03:00.481943  2550 rpcz_store.cc:276] 0709 13:02:59.065757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:59.066309 (+   552us) service_pool.cc:224] Handling call
0709 13:02:59.066791 (+   482us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:59.067276 (+   485us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:59.067322 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:59.067907 (+   585us) log.cc:844] Serialized 26 byte log entry
0709 13:02:59.205802 (+137895us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:59.206616 (+   814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:59.206705 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:00.388591 (+1181886us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b4400022b4c. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7ddc8c85 00007f1b7ddc96a2 00007f1b80b3b1db 00007f1b80b36aaf 00007f1b80b2a86e 00007f1b80b29bb6 00007f1b80b297d8 00007f1b80b33221 00007f1b80b331d9 00007f1b80b33169
0709 13:03:00.481165 (+ 92574us) raft_consensus.cc:1685] finished
0709 13:03:00.481189 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:00.481440 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7777,"raft.queue_time_us":8025,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":11779,"spinlock_wait_cycles":5858176,"thread_start_us":115893,"threads_started":1,"wal-append.queue_time_us":202547}
I20260709 13:03:00.483723  7067 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:03:00.484154  2425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.486660  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:00.490062  1735 raft_consensus.cc:1240] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 17 LEADER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:00.494189  7346 consensus_queue.cc:1059] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:00.494801  2548 raft_consensus.cc:1240] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:03:00.489094  7051 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:00.498047  1661 raft_consensus.cc:1275] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:00.498250  1740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 3946) took 1192 ms. Trace:
I20260709 13:03:00.499317  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:03:00.501804  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:03:00.498523  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:03:00.508854  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.508930  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:03:00.509186  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:00.514168  1659 raft_consensus.cc:1240] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:03:00.498672  1740 rpcz_store.cc:276] 0709 13:02:59.305608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:59.451738 (+146130us) service_pool.cc:224] Handling call
0709 13:02:59.452101 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:59.469667 (+ 17566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:59.469710 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:59.490958 (+ 21248us) log.cc:844] Serialized 26 byte log entry
0709 13:02:59.559365 (+ 68407us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:59.559408 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:59.559481 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:00.386389 (+826908us) spinlock_profiling.cc:243] Waited 8.85 ms on lock 0x7b2400250988. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7dd289c4 00007f1b7dd26acb 00007f1b7dee1dc9 00007f1b7dee1a55 00007f1b7dee109d 00007f1b80b1310e 00007f1b80b2a88c 00007f1b80b29bb6 00007f1b80b297d8 00007f1b80b33221
0709 13:03:00.492955 (+106566us) raft_consensus.cc:1685] finished
0709 13:03:00.492974 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:00.498176 (+  5202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9760,"raft.queue_time_us":17078,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":6063,"spinlock_wait_cycles":20351360,"thread_start_us":24840,"threads_started":1,"wal-append.queue_time_us":37537}
I20260709 13:03:00.515621  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:00.518290  1592 raft_consensus.cc:1240] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:00.510300  1661 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 14.
I20260709 13:03:00.522047  1733 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 12.
I20260709 13:03:00.523499  1662 raft_consensus.cc:1240] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 14. Current term is 15. Ops: []
W20260709 13:03:00.525275  2426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.513875  7047 consensus_queue.cc:1048] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:03:00.528879  7143 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:00.529603  7143 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:00.532119  7143 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:00.528748  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:00.533689  2426 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:00.535223  2426 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:00.535351  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:03:00.540306  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:00.554291  1733 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 13.
I20260709 13:03:00.563522  1588 raft_consensus.cc:2468] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 16.
I20260709 13:03:00.565724  1589 raft_consensus.cc:1240] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:03:00.537882  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:03:00.484989  7368 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:00.555949  7370 raft_consensus.cc:2804] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:00.581183  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:03:00.564877  7110 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.537911  7325 consensus_queue.cc:1048] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:03:00.570775  7369 raft_consensus.cc:2804] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:00.619920  7368 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:00.570142  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
W20260709 13:03:00.622721  7351 consensus_meta.cc:287] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6: Time spent flushing consensus metadata: real 0.591s	user 0.014s	sys 0.002s
I20260709 13:03:00.622536  1474 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b37805060ac444b6b6e9e7da8164233c with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:00.585896  7370 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:00.631655  1707 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:00.634608  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:00.662298  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:00.652841  7369 raft_consensus.cc:697] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:00.653743  7370 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:00.678176  1667 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:03:00.682317  1555 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:00.681921  1583 raft_consensus.cc:3055] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:00.684341  7389 consensus_queue.cc:1048] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:03:00.686085  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 150962us
I20260709 13:03:00.686329  7390 raft_consensus.cc:2804] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:00.686897  7390 raft_consensus.cc:697] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 16 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
W20260709 13:03:00.693264  7364 log.cc:927] Time spent T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 13:03:00.693661  7143 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.694283  7143 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:00.696549  7143 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:00.668143  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:00.683295  1583 raft_consensus.cc:740] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:03:00.711100  1633 connection.cc:256] RPC call timeout handler was delayed by -1.309498987999973s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1947s for a response
I20260709 13:03:00.703943  7369 consensus_queue.cc:237] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:00.719328  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:00.720942  7351 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.721751  7351 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:00.724319  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:00.725941  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:00.726131  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:00.726716  1736 raft_consensus.cc:2393] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 21: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:00.727205  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:00.728408  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:00.728754  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:00.729565  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:00.730316  1585 raft_consensus.cc:2368] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 13. Current term is 14.
I20260709 13:03:00.730206  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:00.730499  1555 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:00.731145  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:00.731501  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:00.732052  7114 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:00.732218  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:00.732822  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:00.733431  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:00.733705  1734 raft_consensus.cc:1240] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:00.734227  7241 raft_consensus.cc:2749] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:00.665174  7110 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:00.734701  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:00.733050  1737 raft_consensus.cc:2410] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:03:00.731648   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:00.738610  1592 raft_consensus.cc:1240] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:00.715351  1583 consensus_queue.cc:260] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:00.734239  1590 raft_consensus.cc:1240] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:00.742269  1583 raft_consensus.cc:3060] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:00.751420  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:00.699609  7346 consensus_queue.cc:1059] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.055s
W20260709 13:03:00.755716  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 104855us
I20260709 13:03:00.745612  7351 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:00.754808  7143 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:00.713789  7214 consensus_queue.cc:1059] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.040s
W20260709 13:03:00.757764  7381 log.cc:927] Time spent T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:03:00.757652  7143 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:00.759346  7110 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:00.760123  7372 log.cc:927] Time spent T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.231s	user 0.002s	sys 0.000s
I20260709 13:03:00.760449  7143 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:00.761317  7214 raft_consensus.cc:3055] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:00.761737  7214 raft_consensus.cc:740] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:00.762737  7214 consensus_queue.cc:260] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:00.763449  7294 consensus_queue.cc:1048] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:00.763959  7214 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:00.764895  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:00.765172  7294 consensus_queue.cc:1048] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:03:00.776304  7379 log.cc:927] Time spent T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:03:00.778628  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:00.736892  7390 consensus_queue.cc:237] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:00.781435  7373 raft_consensus.cc:2749] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:00.679853  7378 consensus_queue.cc:1059] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.232s
I20260709 13:03:00.783466  7378 raft_consensus.cc:3055] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:00.783943  7378 raft_consensus.cc:740] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:00.780951  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:03:00.789392  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.794920  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:00.795847  1667 raft_consensus.cc:2393] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 in current term 17: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:00.796043  7324 raft_consensus.cc:3055] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:00.796666  7324 raft_consensus.cc:740] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:00.820660  7051 raft_consensus.cc:3055] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:00.821149  7324 consensus_queue.cc:260] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:00.779971  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:00.822315  1592 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 12.
I20260709 13:03:00.822402  7324 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:00.823422  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:00.824054  7388 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:00.824582  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:00.821195  7051 raft_consensus.cc:740] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:00.826327  2552 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:03:00.826021  7051 consensus_queue.cc:260] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:00.827427  7051 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:00.830837  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:00.832568  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:00.845657  1741 raft_consensus.cc:1240] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 15. Current term is 16. Ops: []
W20260709 13:03:00.801362  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.846204  1592 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:00.847575  1587 raft_consensus.cc:1240] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 14. Current term is 15. Ops: []
W20260709 13:03:00.803002  7316 log.cc:927] Time spent T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.340s	user 0.003s	sys 0.000s
I20260709 13:03:00.807945  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:00.812891  2540 raft_consensus.cc:1275] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:00.819195  1737 raft_consensus.cc:2955] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 5 to 8, VOTER 6d4de2ce0683442498244b9529127f91 (127.0.107.193) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:00.852034  1732 raft_consensus.cc:1275] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:03:00.835623  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.853451  1733 raft_consensus.cc:1240] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:00.836251  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:00.824615  7388 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:00.854321  1584 raft_consensus.cc:2393] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 16: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:00.836404  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:00.838109  7248 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:00.856208  7388 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:00.776895  1585 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 14.
I20260709 13:03:00.842208  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:00.858525  1738 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:03:00.857321  7378 consensus_queue.cc:260] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:00.799167  6360 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:00.861763  7378 raft_consensus.cc:3060] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:00.824959  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:00.868172  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:00.866767  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:00.870792  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:00.878545  1592 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 14.
I20260709 13:03:00.881888  1738 raft_consensus.cc:1275] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:03:00.884214  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:00.889288  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:00.894122  1555 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:00.910184  1591 raft_consensus.cc:2468] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 12.
I20260709 13:03:00.931984  1590 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 21.
I20260709 13:03:00.937443  1661 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:00.937158  7094 raft_consensus.cc:2804] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:00.945971  1667 raft_consensus.cc:1275] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:03:00.931243  7206 consensus_queue.cc:1048] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
W20260709 13:03:00.942811  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 45106.4us
I20260709 13:03:00.969182  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:00.972961  6360 consensus_queue.cc:1059] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:00.959708  7094 raft_consensus.cc:697] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:03:00.980242  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.976020  6360 consensus_queue.cc:1243] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer 5ced62816f8545cd9b63a27e9055e42d log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:03:00.994297  1661 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 19.
I20260709 13:03:00.995455  1583 raft_consensus.cc:1275] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:03:00.997208  1583 pending_rounds.cc:85] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91: Aborting all ops after (but not including) 12
I20260709 13:03:00.997512  1583 pending_rounds.cc:107] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91: Aborting uncommitted NO_OP operation due to leader change: 16.13
W20260709 13:03:00.987866  7293 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.004s	sys 0.012s
W20260709 13:03:01.002012  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 133473us
I20260709 13:03:01.002475  1583 raft_consensus.cc:2889] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:01.010372  6360 consensus_queue.cc:1048] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:03:01.004513  7293 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.004s	sys 0.013s
I20260709 13:03:01.030710  1558 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:01.041334  1664 raft_consensus.cc:1240] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 14 LEADER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:01.007433  7247 consensus_queue.cc:1059] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:03:01.049429  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:03:01.091434  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 169879us
I20260709 13:03:01.091601  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:01.070210  7110 raft_consensus.cc:2804] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:03:01.106868  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 384602us
W20260709 13:03:01.113039  1633 connection.cc:256] RPC call timeout handler was delayed by -1.1978989879999631s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20710000000000003s for a response
W20260709 13:03:01.113619  1633 connection.cc:256] RPC call timeout handler was delayed by -1.0736989879999896s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2209s for a response
W20260709 13:03:01.101395  1705 leader_election.cc:336] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.720s (SENT)
I20260709 13:03:01.122299  1705 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:01.125591  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:01.130474  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:01.038995  7094 consensus_queue.cc:237] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:01.134629  1556 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:01.136511  7365 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:01.136790  6821 consensus_queue.cc:1048] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:01.138906  1586 raft_consensus.cc:1240] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:01.144090  7369 consensus_queue.cc:1059] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:01.145682  7368 raft_consensus.cc:3055] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:01.146116  7368 raft_consensus.cc:740] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:01.146330  1556 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:01.147048  7368 consensus_queue.cc:260] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:01.147202  6974 consensus_queue.cc:1059] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:01.147814  7354 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:01.148150  7368 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:01.148319  7354 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:01.148782  7354 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:01.156777  7354 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:01.159193  7354 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:01.162683  1658 raft_consensus.cc:2393] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 14: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:01.163745  6360 consensus_queue.cc:1059] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:01.076638  7370 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:01.115723  7348 raft_consensus.cc:3055] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:01.144853  7365 raft_consensus.cc:2749] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:01.178874  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:01.112937  7110 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.189405  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:01.192098  1659 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:01.278571  1736 raft_consensus.cc:1240] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 16 LEADER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 15. Current term is 16. Ops: []
W20260709 13:03:01.277716  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 110402us
I20260709 13:03:01.281788  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:01.178026  7206 raft_consensus.cc:2749] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:01.166785  7143 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:01.293682  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:01.295326  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:01.296128  1665 raft_consensus.cc:2393] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 15: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:01.296923  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:01.296604  7143 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:01.298099  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:01.298985  1665 raft_consensus.cc:2393] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 15: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:01.299440  7143 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:01.300287  1660 raft_consensus.cc:2410] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:03:01.186556  7348 raft_consensus.cc:740] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:03:01.281733  7313 log.cc:927] Time spent T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 13:03:01.302686  7399 log.cc:927] Time spent T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:03:01.307394  1664 pending_rounds.cc:85] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 9
W20260709 13:03:01.308545  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.186610  6821 consensus_queue.cc:1048] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.117s
I20260709 13:03:01.309370  2548 raft_consensus.cc:1240] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 15. Current term is 16. Ops: []
W20260709 13:03:01.311131  7396 log.cc:927] Time spent T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 13:03:01.277312  7110 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:01.312383  7398 log.cc:927] Time spent T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.239s	user 0.000s	sys 0.000s
I20260709 13:03:01.286435  7373 raft_consensus.cc:3055] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:01.322175  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:01.322736  1664 pending_rounds.cc:107] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:03:01.342978  1664 raft_consensus.cc:2889] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:01.186488  7324 consensus_queue.cc:1048] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.115s
I20260709 13:03:01.331632  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:03:01.338847  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 240113us
W20260709 13:03:01.345583  1705 leader_election.cc:336] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.732s (SENT)
I20260709 13:03:01.346112  1705 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:01.348058  1658 raft_consensus.cc:2393] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 18: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:01.349630  1556 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:03:01.356317  7400 log.cc:927] Time spent T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:03:01.358966  7370 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 16 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:01.341153  7373 raft_consensus.cc:740] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:01.360690  7373 consensus_queue.cc:260] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:01.369414  7240 raft_consensus.cc:3055] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:01.369915  2424 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:01.370503  7348 consensus_queue.cc:260] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:01.371621  7348 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:01.372913  7368 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:01.375604  7114 raft_consensus.cc:2749] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:01.380476  7365 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:01.334972  7347 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:01.353431  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:01.389168  7347 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:01.392091  7347 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:01.395224  7346 raft_consensus.cc:476] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 18 LEADER]: Not starting pre-election -- already a leader
W20260709 13:03:01.397818  7392 log.cc:927] Time spent T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:03:01.401180  7402 log.cc:927] Time spent T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:03:01.401983  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.403497  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:01.404747  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:03:01.411191  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:01.412102  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.418582  1659 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 21.
I20260709 13:03:01.389649  1665 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 17.
W20260709 13:03:01.445888  1705 leader_election.cc:336] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.891s (SENT)
I20260709 13:03:01.446103  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:01.446475  1705 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:01.380961  7365 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:01.472563  7365 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:01.479200  7404 log.cc:927] Time spent T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:03:01.485599  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:01.487357  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:01.488691  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:01.448628  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:01.519114  1736 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:01.449419  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:01.450452  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:03:01.454229  7051 consensus_meta.cc:287] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.626s	user 0.012s	sys 0.000s
I20260709 13:03:01.458491  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:01.458716  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:01.459779  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:01.460242  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:03:01.396982  7248 consensus_meta.cc:287] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent flushing consensus metadata: real 0.540s	user 0.011s	sys 0.000s
I20260709 13:03:01.461051  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:03:01.461313  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 51682.8us
I20260709 13:03:01.461915  7324 raft_consensus.cc:2749] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:01.470435  1556 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:01.471837  7347 consensus_queue.cc:1048] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:03:01.489467  7393 log.cc:927] Time spent T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.138s	user 0.004s	sys 0.001s
W20260709 13:03:01.491215  7405 log.cc:927] Time spent T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.106s	user 0.000s	sys 0.002s
W20260709 13:03:01.493162  7406 log.cc:927] Time spent T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.123s	user 0.002s	sys 0.000s
I20260709 13:03:01.498490  1658 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15.
I20260709 13:03:01.499218  1663 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:03:01.369911  7240 raft_consensus.cc:740] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:01.543807  2543 raft_consensus.cc:2410] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:03:01.447393  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:01.510517  7349 raft_consensus.cc:3055] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:03:01.513913  7410 log.cc:927] Time spent T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.127s	user 0.002s	sys 0.000s
I20260709 13:03:01.556239  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:03:01.514954  7408 log.cc:927] Time spent T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.129s	user 0.002s	sys 0.000s
I20260709 13:03:01.561205  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:01.561946  1663 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12.
W20260709 13:03:01.534368  1633 connection.cc:256] RPC call timeout handler was delayed by -1.6792094699999893s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1615s for a response
W20260709 13:03:01.528900  1705 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.902s (SENT) [suppressed 32 similar messages]
W20260709 13:03:01.537679  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 67326.9us
I20260709 13:03:01.545248  1659 raft_consensus.cc:2393] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 9: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:01.555266  7355 raft_consensus.cc:2804] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:01.555518  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:01.573129  1556 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:01.578138  1556 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:01.579774  1556 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:03:01.574263  1633 connection.cc:256] RPC call timeout handler was delayed by -1.674709469999982s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16200000000000003s for a response
W20260709 13:03:01.581049  1633 connection.cc:256] RPC call timeout handler was delayed by -1.6486094699999967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16490000000000002s for a response
W20260709 13:03:01.581547  1633 connection.cc:256] RPC call timeout handler was delayed by -1.5127094700000043s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18000000000000002s for a response
I20260709 13:03:01.583038  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:01.556059  7349 raft_consensus.cc:740] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:01.510851  7110 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:01.584816  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:01.585794  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:01.588064  1663 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 17.
I20260709 13:03:01.589470  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:01.587476  1658 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 14.
I20260709 13:03:01.599861  2543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49222 (request call id 691) took 1098 ms. Trace:
I20260709 13:03:01.600364  2543 rpcz_store.cc:276] 0709 13:03:00.501236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.501503 (+   267us) service_pool.cc:224] Handling call
0709 13:03:01.593201 (+1091698us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540018f1d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:03:01.599742 (+  6541us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2393004928}
W20260709 13:03:01.604463  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 75603.2us
I20260709 13:03:01.605000  2424 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:03:01.605180  1705 leader_election.cc:336] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.911s (SENT)
I20260709 13:03:01.607075  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:01.608145  1738 raft_consensus.cc:2393] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 14: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:03:01.610555  1556 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:01.612641  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:01.613339  1659 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:01.615120  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:01.616135  7110 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:01.616380  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:01.616849  7247 raft_consensus.cc:2804] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:01.617327  7247 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.617722  7247 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:01.617650  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:01.618994  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:01.612392  7268 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:01.620088  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:01.626304  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:01.628566  1659 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 15.
I20260709 13:03:01.605930  1705 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:01.582931  7264 raft_consensus.cc:2749] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:01.588887  7373 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:01.587625  7241 raft_consensus.cc:2749] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:01.613416  7248 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.605770  7355 raft_consensus.cc:697] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:01.591516  7293 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:01.629885  1663 raft_consensus.cc:1240] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:01.634137  1661 raft_consensus.cc:1275] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:03:01.655838  1633 connection.cc:256] RPC call timeout handler was delayed by -1.500109469999984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1814s for a response
I20260709 13:03:01.636534  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:01.642167  1740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35672 (request call id 756) took 1135 ms. Trace:
I20260709 13:03:01.645259  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:01.645605  1737 raft_consensus.cc:1275] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:01.648813  1736 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 14.
I20260709 13:03:01.667552  1556 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:03:01.716874  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 49492.8us
I20260709 13:03:01.713555  1740 rpcz_store.cc:276] 0709 13:03:00.506298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.526658 (+ 20360us) service_pool.cc:224] Handling call
0709 13:03:00.547669 (+ 21011us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:00.559722 (+ 12053us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:00.559773 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:00.623670 (+ 63897us) log.cc:844] Serialized 26 byte log entry
0709 13:03:01.007994 (+384324us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:03:01.020571 (+ 12577us) log.cc:844] Serialized 14 byte log entry
0709 13:03:01.020796 (+   225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.020904 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:01.488041 (+467137us) spinlock_profiling.cc:243] Waited 53.3 ms on lock 0x7b4400022b4c. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7ddc8c85 00007f1b7ddc96a2 00007f1b80b3b1db 00007f1b80b36aaf 00007f1b80b2a86e 00007f1b80b29bb6 00007f1b80b297d8 00007f1b80b33221 00007f1b80b331d9 00007f1b80b33169
0709 13:03:01.641823 (+153782us) raft_consensus.cc:1685] finished
0709 13:03:01.641936 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:01.642087 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6061,"prepare.queue_time_us":14685,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":12256,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":13534,"spinlock_wait_cycles":122566912,"thread_start_us":350927,"threads_started":1,"wal-append.queue_time_us":521877}
I20260709 13:03:01.659337  7348 raft_consensus.cc:2749] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:01.640057  7368 raft_consensus.cc:2749] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:01.658859  7378 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.708302  7324 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:01.728278  1658 raft_consensus.cc:1240] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:03:01.629035  7365 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:01.720870  7264 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:01.738543  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:01.739406  1658 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:01.741762  7051 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.742362  7051 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:01.744721  7051 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:01.750993  7365 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:01.642268  7349 consensus_queue.cc:260] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:01.758052  7349 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:01.761283  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 156115us
W20260709 13:03:01.762336  1705 leader_election.cc:336] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.943s (SENT)
I20260709 13:03:01.762615  7264 raft_consensus.cc:697] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:01.762902  1705 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:01.731747  7241 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:01.764045  7051 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:01.764601  7241 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:01.764045  7264 consensus_queue.cc:237] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:01.765589  7355 consensus_queue.cc:237] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:01.774135  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:01.734094  7268 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:01.776624  7268 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:01.778898  1633 connection.cc:256] RPC call timeout handler was delayed by -1.3705094700000018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1958s for a response
W20260709 13:03:01.779367  1633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:01.779670  1633 connection.cc:256] RPC call timeout handler was delayed by -1.2076094700000226s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21389999999999998s for a response
W20260709 13:03:01.780296  1633 connection.cc:256] RPC call timeout handler was delayed by -1.1752094700000271s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2175s for a response
I20260709 13:03:01.782743  1661 raft_consensus.cc:1240] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:01.783703  7143 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:01.784318  7143 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:01.786500  7143 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:01.787484  1666 raft_consensus.cc:3055] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:01.788044  1666 raft_consensus.cc:740] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:01.722086  7293 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:01.790405  1666 consensus_queue.cc:260] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:01.791534  7293 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:03:01.792064  7410 log.cc:927] Time spent T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:03:01.792187  7241 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:03:01.792801  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.779603  7268 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:01.793697  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:01.636173  7247 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:01.709506  7248 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:01.812951  2543 raft_consensus.cc:2393] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 12: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
W20260709 13:03:01.817375  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.817520  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:01.631449  7240 consensus_queue.cc:260] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:01.821584  1736 raft_consensus.cc:1275] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:03:01.830016  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:01.830089  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:01.737517  7378 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:01.833107  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:01.835958  1666 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:01.838601  1705 leader_election.cc:336] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.024s (SENT)
I20260709 13:03:01.843111  1705 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:01.846310  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:01.854277  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:01.854882  1590 raft_consensus.cc:3060] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:01.867554  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:01.848549  7240 raft_consensus.cc:3060] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:01.869431  1658 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
W20260709 13:03:01.902949  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.853252  7391 raft_consensus.cc:2749] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:01.843040  7034 consensus_queue.cc:1048] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:03:01.910257  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:01.916709  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:03:01.921211  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 52779.6us
I20260709 13:03:01.922394  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:01.922806  1633 leader_election.cc:400] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 13. Current term is 14.
I20260709 13:03:01.923085  2543 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:03:01.923738  2548 raft_consensus.cc:1240] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:01.924537  1586 raft_consensus.cc:1240] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:03:01.925217  1662 raft_consensus.cc:1240] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:01.925688  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:01.925236  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:01.929545  1590 raft_consensus.cc:2468] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 13.
I20260709 13:03:01.923763  1633 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:01.945664  7414 log.cc:927] Time spent T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:03:01.948418  1658 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:01.911055  1558 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.032s	sys 0.063s
W20260709 13:03:01.953192  1558 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.032s	sys 0.063s
W20260709 13:03:01.953476  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 608640us
W20260709 13:03:01.956250  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 121504us
I20260709 13:03:01.956983  7293 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:01.957582  1705 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:01.959029  2426 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:01.959860  7294 raft_consensus.cc:2749] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:01.960779  7366 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:01.965101  1592 raft_consensus.cc:2410] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:03:01.967586  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:01.968781  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:01.969306  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:01.969846  1585 raft_consensus.cc:2376] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 14. Re-sending same reply.
I20260709 13:03:01.971333  7418 consensus_queue.cc:1059] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:01.972457  7418 raft_consensus.cc:3055] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:01.977278  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:01.978132  7378 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:01.977349  7294 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.978792  7294 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:01.979611  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:01.980638  1660 raft_consensus.cc:2393] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 in current term 13: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:01.987507  6360 consensus_queue.cc:1059] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:03:01.988306  1556 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:01.990218  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:03:01.990566  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 66875us
I20260709 13:03:01.990868  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:01.991493  1660 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:01.991550  1666 raft_consensus.cc:1275] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 7. (term mismatch)
I20260709 13:03:01.991999  1666 pending_rounds.cc:85] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 6
I20260709 13:03:01.992233  1666 pending_rounds.cc:107] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260709 13:03:01.992467  1666 raft_consensus.cc:2889] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:01.993175  6360 raft_consensus.cc:3055] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:01.993650  6360 raft_consensus.cc:740] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:03:01.994277  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.995278  1658 raft_consensus.cc:1275] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:03:01.972867  7418 raft_consensus.cc:740] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:02.005398  1555 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:03:02.007239  1705 leader_election.cc:336] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.757s (SENT)
I20260709 13:03:01.989197  7294 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:02.011274  1705 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:02.007581  6360 consensus_queue.cc:260] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:02.024860  1555 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:01.999014  7348 raft_consensus.cc:2804] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:02.029655  7191 raft_consensus.cc:2749] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:02.023375  7294 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:02.037366  1633 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:02.038995  6360 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:02.030427  7365 raft_consensus.cc:2804] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:02.047969  2550 raft_consensus.cc:1275] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:03:02.051539  1737 raft_consensus.cc:1240] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:03:02.042182  7143 raft_consensus.cc:2749] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:02.059844  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:02.064447  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:02.064754  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:02.065237  1588 raft_consensus.cc:2393] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 in current term 13: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:02.003718  7282 consensus_queue.cc:1048] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:03:02.016170  7347 consensus_queue.cc:1059] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:03:02.074676  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:02.075601  1738 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Advancing to term 18
W20260709 13:03:02.077214  1705 leader_election.cc:336] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.462s (SENT)
I20260709 13:03:02.077783  1705 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:02.079025  1740 raft_consensus.cc:2393] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 12: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:02.084880  2426 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:02.042419  7365 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:02.088363  7378 raft_consensus.cc:3060] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:02.054661  7247 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 18 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:02.055434  7348 raft_consensus.cc:697] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:02.100952  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:03:02.105067  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 91001.3us
I20260709 13:03:02.104104  1740 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:02.100848  7206 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:02.092195  7365 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:02.101481  7347 consensus_queue.cc:1243] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer 7e839e91a1314c2f9a99b25b17c916a6 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:03:02.113983  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:02.094377  6821 consensus_queue.cc:1048] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:03:02.161288  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:02.174898  1633 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:02.176762  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 99588.4us
I20260709 13:03:02.115792  7247 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.187090  1583 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 15.
I20260709 13:03:02.187425  1738 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 18.
W20260709 13:03:02.201735  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.241214  7426 raft_consensus.cc:2749] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:02.246984  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.063400  7418 consensus_queue.cc:260] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:02.150655  7370 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:02.253047  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 98284.1us
I20260709 13:03:02.263878  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:02.268785  1737 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:03:02.269090  7418 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:02.249992  7282 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:02.278159  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 262747us
I20260709 13:03:02.279124  6360 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:02.279754  6360 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:02.188082  7206 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.307547  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:02.316735  1584 raft_consensus.cc:1240] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 14. Current term is 15. Ops: []
W20260709 13:03:02.321707  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 44461.5us
I20260709 13:03:02.262506  7348 consensus_queue.cc:237] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:02.273406  7247 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:02.359179  1590 raft_consensus.cc:1240] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:02.359298  1586 raft_consensus.cc:1275] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:03:02.352659  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:02.304420  6821 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.276654  7282 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:02.363214  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:02.361018  1589 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 13.
I20260709 13:03:02.275683  7370 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:02.300513  7241 consensus_queue.cc:1048] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:03:02.388358  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:02.299463  7206 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:02.411013  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.411621  1633 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:02.418195  1660 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 18.
I20260709 13:03:02.390213  7425 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:02.380685  7389 consensus_queue.cc:1059] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:03:02.425695  1633 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:02.380651  6821 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:02.446976  1740 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:03:02.450358  7436 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.450953  7436 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:02.453576  7429 log.cc:927] Time spent T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:03:02.455356  1662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 3098) took 1029 ms. Trace:
I20260709 13:03:02.455828  1662 rpcz_store.cc:276] 0709 13:03:01.425964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.926119 (+500155us) service_pool.cc:224] Handling call
0709 13:03:01.926433 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:01.926845 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:01.926874 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:01.927383 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 13:03:02.270245 (+342862us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:02.293806 (+ 23561us) log.cc:844] Serialized 14 byte log entry
0709 13:03:02.294197 (+   391us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.294379 (+   182us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:02.455123 (+160744us) raft_consensus.cc:1685] finished
0709 13:03:02.455144 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.455295 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81024,"prepare.queue_time_us":24774,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":306,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":2526,"thread_start_us":342434,"threads_started":1,"wal-append.queue_time_us":442240}
I20260709 13:03:02.458461  7282 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:02.461272  7424 raft_consensus.cc:2749] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:02.464552  6821 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:02.425824  7143 raft_consensus.cc:2764] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:03:02.470736  7282 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:02.471975  7282 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:02.391211  7391 consensus_queue.cc:1059] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:03:02.476755  7282 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:02.469738  7378 raft_consensus.cc:2749] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:02.439091  7428 log.cc:927] Time spent T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.251s	user 0.001s	sys 0.001s
W20260709 13:03:02.497385  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 71901.1us
I20260709 13:03:02.501680  7247 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:02.503051  7206 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:02.508919  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:02.506778  2426 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:02.448524  7389 consensus_queue.cc:1243] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer 6d4de2ce0683442498244b9529127f91 log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:03:02.512869  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.518239  1659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 3998) took 1152 ms. Trace:
I20260709 13:03:02.518289  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:02.518965  1659 rpcz_store.cc:276] 0709 13:03:01.366189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.653486 (+287297us) service_pool.cc:224] Handling call
0709 13:03:01.708198 (+ 54712us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:01.990244 (+282046us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:01.990272 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:01.990672 (+   400us) log.cc:844] Serialized 26 byte log entry
0709 13:03:02.304809 (+314137us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:02.419264 (+114455us) log.cc:844] Serialized 14 byte log entry
0709 13:03:02.424753 (+  5489us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.424826 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:02.514175 (+ 89349us) raft_consensus.cc:1685] finished
0709 13:03:02.518053 (+  3878us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.518181 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9949,"prepare.queue_time_us":131199,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":7041,"raft.queue_time_us":31399,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":13611,"thread_start_us":628812,"threads_started":3,"wal-append.queue_time_us":380986}
I20260709 13:03:02.512267  1665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 3097) took 1103 ms. Trace:
W20260709 13:03:02.493853  7406 log.cc:927] Time spent T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:03:02.440299  7427 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:02.524721  1633 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:03:02.514406  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 91887.5us
I20260709 13:03:02.497025  7436 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:02.532032  7438 raft_consensus.cc:2804] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:02.481170  7425 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:02.532999  7143 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:02.522603  1665 rpcz_store.cc:276] 0709 13:03:01.425566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.717803 (+292237us) service_pool.cc:224] Handling call
0709 13:03:01.727743 (+  9940us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:01.989660 (+261917us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:01.989697 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:01.998151 (+  8454us) log.cc:844] Serialized 26 byte log entry
0709 13:03:02.319689 (+321538us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:02.511540 (+191851us) log.cc:844] Serialized 14 byte log entry
0709 13:03:02.511837 (+   297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.511944 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:02.512006 (+    62us) raft_consensus.cc:1685] finished
0709 13:03:02.512025 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.512190 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77545,"prepare.queue_time_us":132120,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":10232,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":1355,"thread_start_us":651040,"threads_started":3,"wal-append.queue_time_us":492940}
I20260709 13:03:02.563653  7248 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:02.534338  7427 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:02.567413  7425 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:02.569417  7427 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:02.573021  7370 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:02.550365  7438 raft_consensus.cc:697] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:02.576431  7438 consensus_queue.cc:237] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:02.579259  1663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 3095) took 1206 ms. Trace:
I20260709 13:03:02.579752  1663 rpcz_store.cc:276] 0709 13:03:01.408642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.717898 (+309256us) service_pool.cc:224] Handling call
0709 13:03:01.718320 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:02.000801 (+282481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:02.000858 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:02.015417 (+ 14559us) log.cc:844] Serialized 26 byte log entry
0709 13:03:02.307359 (+291942us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:02.515581 (+208222us) log.cc:844] Serialized 14 byte log entry
0709 13:03:02.524649 (+  9068us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.524728 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:02.579032 (+ 54304us) raft_consensus.cc:1685] finished
0709 13:03:02.579054 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.579195 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66927,"prepare.queue_time_us":144200,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":20481,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":4448,"thread_start_us":601591,"threads_started":3,"wal-append.queue_time_us":514140}
W20260709 13:03:02.585624  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 43624.9us
I20260709 13:03:02.590265  7268 raft_consensus.cc:3055] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:02.590808  7268 raft_consensus.cc:740] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:02.588696  1558 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:02.591725  7268 consensus_queue.cc:260] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:02.592685  7436 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:03:02.602299  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 63767.8us
I20260709 13:03:02.594842  1558 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:02.604578  7324 raft_consensus.cc:3055] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:02.606210  6360 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:02.605436  7416 raft_consensus.cc:2804] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:02.619251  7416 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:02.619433  7294 raft_consensus.cc:3055] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:02.619724  7416 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:02.622591  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:02.623235  1663 raft_consensus.cc:2468] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 6.
I20260709 13:03:02.623649  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:02.624086  7444 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.624212  1665 raft_consensus.cc:2468] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 9.
I20260709 13:03:02.624632  7444 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:02.605110  7324 raft_consensus.cc:740] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:02.626120  7324 consensus_queue.cc:260] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:02.626971  7444 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:02.627276  7324 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:02.604708  1633 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:02.619844  7294 raft_consensus.cc:740] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:02.629252  2424 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:02.629786  1633 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:02.629606  7294 consensus_queue.cc:260] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:02.607179  7428 log.cc:927] Time spent T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:03:02.632893  1633 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:02.633069  2424 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:02.635255  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:02.619742  1558 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:02.639071  6360 raft_consensus.cc:2749] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:02.639299  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:02.640100  1586 raft_consensus.cc:2393] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 in current term 14: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:02.639883  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:02.640587  1589 raft_consensus.cc:2468] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 7.
I20260709 13:03:02.640838  7425 raft_consensus.cc:2804] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:02.630806  7294 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:02.643659  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:02.644694  1705 leader_election.cc:336] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.521s (SENT)
I20260709 13:03:02.647645  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:02.650225  1707 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:02.649387  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:02.652050  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:02.607229  7268 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:02.657120  1705 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:02.656394  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:02.656653  1633 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:02.642429  7370 raft_consensus.cc:2804] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:02.642874  7427 raft_consensus.cc:2764] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:03:02.678352  1589 raft_consensus.cc:2468] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 14.
I20260709 13:03:02.682947  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:02.689311  1736 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 14.
I20260709 13:03:02.642604  7368 raft_consensus.cc:2804] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:02.678349  1586 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 16.
I20260709 13:03:02.692176  1661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 4002) took 1277 ms. Trace:
I20260709 13:03:02.647735  7425 raft_consensus.cc:697] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 14 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:02.693324  1662 raft_consensus.cc:2468] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 13.
I20260709 13:03:02.702169  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:03:02.691771  7445 log.cc:927] Time spent T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:03:02.705821  2426 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:03:02.708427  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 51842.8us
W20260709 13:03:02.684741  7240 consensus_meta.cc:287] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6: Time spent flushing consensus metadata: real 0.802s	user 0.006s	sys 0.007s
I20260709 13:03:02.716127  1556 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:02.709121  1633 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:02.692765  1661 rpcz_store.cc:276] 0709 13:03:01.414795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.790032 (+375237us) service_pool.cc:224] Handling call
0709 13:03:01.790327 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:01.790675 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:01.790702 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:01.791229 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 13:03:01.998383 (+207154us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:02.018141 (+ 19758us) log.cc:844] Serialized 14 byte log entry
0709 13:03:02.018403 (+   262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.018499 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:02.451022 (+432523us) spinlock_profiling.cc:243] Waited 7.08 ms on lock 0x7b18004508e0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7dea23f3 00007f1b7dea47c1 00007f1b7dea4779 00007f1b7dea4709 00007f1b7dea46d1 00007f1b7dea39cd 000000000038f354 000000000038f199 00007f1b7de8583a
0709 13:03:02.682369 (+231347us) raft_consensus.cc:1685] finished
0709 13:03:02.691956 (+  9587us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.692095 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9349,"prepare.queue_time_us":25112,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":1472,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":7087,"spinlock_wait_cycles":16289152,"thread_start_us":206773,"threads_started":1,"wal-append.queue_time_us":315184}
I20260709 13:03:02.709245  2426 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:02.654511  7426 raft_consensus.cc:2804] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:02.683647  7047 raft_consensus.cc:2804] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:02.651458  7206 consensus_queue.cc:1048] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:03:02.720502  7248 raft_consensus.cc:2804] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:02.692751  7368 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:02.687376  7370 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:02.649605  7365 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:02.734390  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 89740.5us
I20260709 13:03:02.704989  7389 raft_consensus.cc:2749] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:02.730489  2523 raft_consensus.cc:1275] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:03:02.732654  7047 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:02.755718  1667 raft_consensus.cc:1275] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:03:02.758330  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:02.727072  7442 raft_consensus.cc:2804] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:02.730623  7373 raft_consensus.cc:2749] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:02.730863  1666 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:02.727011  7449 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:02.750026  7426 raft_consensus.cc:697] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 13 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
W20260709 13:03:02.760473  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 51432us
I20260709 13:03:02.801111  1633 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:02.740244  7248 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:02.742707  7143 raft_consensus.cc:2749] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:02.743089  7427 raft_consensus.cc:2804] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:02.731738  7424 raft_consensus.cc:2749] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:02.756510  7370 raft_consensus.cc:3060] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:02.799630  1592 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 12.
I20260709 13:03:02.755137  7368 raft_consensus.cc:3060] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:02.790499  7047 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:02.794169  7442 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:02.810608  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 47646.5us
I20260709 13:03:02.814427  1660 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 16.
I20260709 13:03:02.805181  7248 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:02.830825  1665 raft_consensus.cc:1275] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:02.804698  7427 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:02.839823  1633 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:02.811501  7464 raft_consensus.cc:2749] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:02.850822  2523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49238 (request call id 630) took 1452 ms. Trace:
W20260709 13:03:02.860286  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.815375  7442 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:02.859217  2523 rpcz_store.cc:276] 0709 13:03:01.397996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.398135 (+   139us) service_pool.cc:224] Handling call
0709 13:03:01.398473 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.759364 (+1360891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.846759 (+ 87395us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b5400198554. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:03:02.850692 (+  3933us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3062484224}
I20260709 13:03:02.853034  1666 raft_consensus.cc:1275] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:03:02.876220  7047 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:02.877489  7426 consensus_queue.cc:237] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:02.878278  1633 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:02.806877  7425 consensus_queue.cc:237] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:02.899437  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 81565.7us
W20260709 13:03:02.900507  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 53419.1us
I20260709 13:03:02.849457  7427 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:02.802239  7449 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:02.932843  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:02.926578  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:03:02.949590  7456 log.cc:927] Time spent T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
W20260709 13:03:02.958029  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 79822.9us
I20260709 13:03:02.901677  7424 raft_consensus.cc:2749] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:02.965955  1558 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:02.897739  7391 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.937147  7206 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.880738  7416 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:02.936102  7464 raft_consensus.cc:2749] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:02.985735  1558 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:02.990049  1633 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:02.994027  1583 raft_consensus.cc:1240] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:02.995545  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:02.996263  1733 raft_consensus.cc:2468] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 8.
I20260709 13:03:03.005349  1633 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:03.009717  1633 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:02.991681  7378 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.014767  1741 raft_consensus.cc:1275] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:02.988103  7354 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:02.990988  7465 consensus_queue.cc:1048] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 13:03:02.984315  7206 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:03.028862  1733 raft_consensus.cc:1275] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:03:03.036692  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:03:03.088243  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.101650  1659 raft_consensus.cc:1275] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:03:03.098981  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:03.113807  1588 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:03.100701  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:03.004379  7424 raft_consensus.cc:2804] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:03.020025  7436 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:03.054198  7459 log.cc:927] Time spent T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
W20260709 13:03:03.073939  7467 log.cc:927] Time spent T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:03:03.133567  1737 raft_consensus.cc:1275] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:03:03.134518  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:02.983764  7391 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:03.075562  7449 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:03.045837  7441 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.016203  7464 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:03.023420  7354 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.122786  7424 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:03.038575  7373 consensus_queue.cc:1048] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.118s
I20260709 13:03:03.082711  7416 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:03.046134  7347 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.038096  7047 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:03.155400  1732 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 12.
I20260709 13:03:03.162142  1738 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 14.
I20260709 13:03:03.054265  1583 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:03:03.178181  1583 raft_consensus.cc:606] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:03.178675  1583 raft_consensus.cc:614] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:03.026722  7378 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:03.181242  1588 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 14.
I20260709 13:03:03.186095  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:03:03.068984  7370 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:03.158214  7143 raft_consensus.cc:2749] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:03.038337  7434 consensus_queue.cc:1048] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.126s
I20260709 13:03:03.191947  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:03:03.166355  7441 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:03.195681  7248 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:03.198050  7457 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:03.201162  7268 consensus_meta.cc:287] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.516s	user 0.005s	sys 0.006s
I20260709 13:03:03.171626  7354 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:03.171877  7424 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:03.218968  2552 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
W20260709 13:03:03.218315  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 67548.7us
I20260709 13:03:03.204496  7427 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:03.219908  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 68886us
W20260709 13:03:03.221046  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 211408us
I20260709 13:03:03.223850  1664 raft_consensus.cc:1275] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:03:03.223563  1633 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:03.237435  7370 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 8 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:03.239593  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:03.240258  1667 raft_consensus.cc:3060] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:03:03.243326  7427 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:03.245653  7441 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:03.246515  7206 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:03.190253  7347 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:03.218091  7457 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:03.250883  7347 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:03.251053  7457 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:03.217674  7442 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:03.233319  7241 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.252758  7241 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:03.253607  7442 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 15 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:03.255048  7241 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:03.254973  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:03.256021  1659 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:03:03.256959  6821 consensus_queue.cc:1048] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:03.260506  7365 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:03.263049  1555 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:03.266449  7451 raft_consensus.cc:2804] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:03.267040  7451 raft_consensus.cc:697] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:03.268041  7451 consensus_queue.cc:237] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:03.269837  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.269743  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:03.270507  2550 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:03:03.281661  1555 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:03.282678  7348 raft_consensus.cc:2804] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:03.283068  7348 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.283380  7348 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:03.289278  1659 raft_consensus.cc:2468] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 15.
I20260709 13:03:03.293354  1667 raft_consensus.cc:2468] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 8.
W20260709 13:03:03.299918  1705 leader_election.cc:336] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.801s (SENT)
I20260709 13:03:03.300581  1705 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:03.306206  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 82730us
I20260709 13:03:03.307411  1633 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:03.309204  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 74445.9us
W20260709 13:03:03.311856  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 157560us
I20260709 13:03:03.214483  7368 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:03.314371  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:03:03.314924  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 83964.7us
I20260709 13:03:03.316741  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:03.318102  1585 raft_consensus.cc:3060] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:03.318274  1588 raft_consensus.cc:3060] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:03.316905  2426 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:03.318094  2424 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:03.321766  1633 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:03.330003  1633 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:03.332309  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:03.333622  2552 raft_consensus.cc:2410] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:03:03.308919  7206 raft_consensus.cc:2749] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:03.310619  7427 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:03.336366  2424 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:03.337327  7475 raft_consensus.cc:2749] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:03.310684  7143 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:03.342953  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:03.356241  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:03.356854  2552 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 13.
I20260709 13:03:03.338106  1633 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:03.359149  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.347939  1666 raft_consensus.cc:1240] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:03.359876  1633 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:03.363075  1588 raft_consensus.cc:2468] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 15.
I20260709 13:03:03.359894  1704 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:03.374698  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:03.375703  1663 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 15.
I20260709 13:03:03.332602  7425 raft_consensus.cc:2749] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:03.379140  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:03.386255  1662 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 21.
I20260709 13:03:03.386639  1585 raft_consensus.cc:2468] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 8.
I20260709 13:03:03.319593  7391 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:03:03.381583  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 44334.3us
I20260709 13:03:03.388267  2426 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 6d4de2ce0683442498244b9529127f91
W20260709 13:03:03.388623  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 88771.9us
W20260709 13:03:03.389922  1705 leader_election.cc:336] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.550s (SENT)
I20260709 13:03:03.390394  1705 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:03.358579  7370 raft_consensus.cc:2804] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:03.331832  7441 consensus_queue.cc:1048] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:03:03.358745  7442 raft_consensus.cc:2804] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:03.379978  7464 raft_consensus.cc:2749] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:03.367136  7110 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.367640  7438 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.379740  7282 raft_consensus.cc:2804] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:03.397775  1558 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:03.358419  7354 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:03.418010  1738 raft_consensus.cc:1275] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:03:03.358924  7457 consensus_queue.cc:1048] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 13:03:03.391516  7458 raft_consensus.cc:2804] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:03.336180  7424 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:03.396294  7426 raft_consensus.cc:2749] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:03.407585  7370 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:03.450618  1705 leader_election.cc:336] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 3.035s (SENT)
I20260709 13:03:03.388624  7240 consensus_queue.cc:1059] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:03:03.406002  7391 raft_consensus.cc:2749] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:03.505847  1705 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:03.463336  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 51515.7us
W20260709 13:03:03.502758  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 114571us
I20260709 13:03:03.392364  7476 consensus_queue.cc:1048] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.039s
I20260709 13:03:03.422560  7034 raft_consensus.cc:2804] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:03:03.509337  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 80047.1us
I20260709 13:03:03.507108  1556 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:03.456699  7458 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.457844  7282 raft_consensus.cc:697] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:03.516393  7294 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:03.516029  7282 consensus_queue.cc:237] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:03.524941  7458 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:03.427853  7438 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:03.528213  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:03.528816  1734 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 21.
W20260709 13:03:03.508919  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 149105us
I20260709 13:03:03.529908  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:03.530709  1740 raft_consensus.cc:2410] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 15 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:03:03.530808  1633 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:03.532050  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:03.532655  1733 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 14.
I20260709 13:03:03.527484  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:03.464900  7094 raft_consensus.cc:2749] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:03.538775  1707 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:03.543622  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:03.540633  1556 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:03:03.508867  7466 log.cc:927] Time spent T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:03:03.502542  7370 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:03.551959  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 101561us
I20260709 13:03:03.429637  7442 raft_consensus.cc:697] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
W20260709 13:03:03.553800  7482 log.cc:927] Time spent T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 13:03:03.553896  7442 consensus_queue.cc:237] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:03.464663  7347 consensus_queue.cc:1048] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 13:03:03.455981  7206 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:03.546895  1633 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:03.424585  7418 consensus_queue.cc:1048] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.121s
I20260709 13:03:03.567974  1633 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:03.425108  7110 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:03.571399  1633 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:03.572216  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:03.577852  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:03.521570  7034 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:03.540796  7416 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:03.502153  7264 consensus_queue.cc:1059] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:03:03.571179  7489 raft_consensus.cc:2749] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:03:03.596890  1705 leader_election.cc:336] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.765s (SENT)
I20260709 13:03:03.597692  1705 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:03.566231  7465 raft_consensus.cc:2804] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:03.565886  7449 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:03.569423  7426 raft_consensus.cc:2749] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:03.576138  7475 raft_consensus.cc:2749] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:03.519862  7348 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:03.579632  7347 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:03.584753  7034 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:03.587953  7416 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.571123  7206 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:03.642998  1585 raft_consensus.cc:2393] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 15: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:03.620373  7324 raft_consensus.cc:2749] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:03.621253  7489 raft_consensus.cc:2749] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:03.617769  7465 raft_consensus.cc:697] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 14 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:03.631281  7347 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.653594  7206 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:03.637176  7416 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:03.639686  7354 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:03.672540  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 75686.4us
W20260709 13:03:03.674199  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 90455.2us
I20260709 13:03:03.620924  7449 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:03.677399  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 119081us
I20260709 13:03:03.658394  7347 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:03.691145  7110 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:03.703284  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.703270  7489 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:03.711138  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:03.712007  1659 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 17.
I20260709 13:03:03.727041  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:03.727736  1659 raft_consensus.cc:3060] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:03.738257  1705 leader_election.cc:336] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.854s (SENT)
I20260709 13:03:03.686781  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:03.744907  1590 raft_consensus.cc:2393] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 15: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:03.739310  2424 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:03:03.767299  1705 leader_election.cc:336] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.878s (SENT)
I20260709 13:03:03.767802  1705 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:03.766177  7442 raft_consensus.cc:2804] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:03.750428  7465 consensus_queue.cc:237] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:03.804909  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 233571us
I20260709 13:03:03.806489  1633 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:03.816991  2550 raft_consensus.cc:1275] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:03.800585  1659 raft_consensus.cc:2468] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 10.
I20260709 13:03:03.822755  1633 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:03.709630  7489 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:03.810840  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 43579.3us
I20260709 13:03:03.832897  7426 raft_consensus.cc:2749] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:03.883683  7427 consensus_queue.cc:1048] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:03:03.794714  7424 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:03.801782  7442 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:03.890903  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 69113.6us
W20260709 13:03:03.891239  1705 leader_election.cc:336] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.902s (SENT)
I20260709 13:03:03.884871  2424 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:03.902338  1705 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:03.825937  7498 raft_consensus.cc:2749] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:03.905251  7475 raft_consensus.cc:2749] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:03.898783  7442 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:03.926960  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 72645.4us
I20260709 13:03:03.827797  7416 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:03.932757  7416 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:03.933315  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:03.942149  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 46273.9us
I20260709 13:03:03.948657  7493 consensus_queue.cc:1048] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.003s
I20260709 13:03:03.952631  7282 raft_consensus.cc:2804] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:03.953797  7282 raft_consensus.cc:697] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:03.910377  7389 raft_consensus.cc:2749] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:03.909932  7424 consensus_queue.cc:1048] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
W20260709 13:03:03.989840  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 61893.1us
I20260709 13:03:04.002013  7247 raft_consensus.cc:3055] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:04.002995  7247 raft_consensus.cc:740] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:03.962488  7348 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:03:04.070011  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 125671us
I20260709 13:03:04.014780  7368 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 10 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:04.060153  7513 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:04.124963  7494 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.039693  7282 consensus_queue.cc:237] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:04.130467  7370 consensus_meta.cc:287] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6: Time spent flushing consensus metadata: real 0.579s	user 0.015s	sys 0.000s
I20260709 13:03:04.130929  7370 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:04.112694  7247 consensus_queue.cc:260] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:04.133576  7492 log.cc:927] Time spent T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.300s	user 0.000s	sys 0.002s
W20260709 13:03:04.137552  7503 log.cc:927] Time spent T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.105s	user 0.002s	sys 0.000s
I20260709 13:03:04.113842  7513 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:04.142654  7370 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:04.142468  7489 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:04.153159  7458 consensus_meta.cc:287] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.627s	user 0.015s	sys 0.002s
I20260709 13:03:04.155495  7248 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 17 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:04.157238  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:04.174418  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:04.175211  1666 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15.
W20260709 13:03:04.168881  7034 consensus_meta.cc:287] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6: Time spent flushing consensus metadata: real 0.525s	user 0.018s	sys 0.000s
I20260709 13:03:04.167387  7458 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:04.282300  7034 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:04.126406  7494 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:04.285552  1741 raft_consensus.cc:2393] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 15: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:04.286541  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:04.286895  7513 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:04.287253  7494 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:04.289367  7424 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.290166  7424 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:04.247067  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:04.249816  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:04.271710  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:04.271950  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:04.294776  1667 raft_consensus.cc:2393] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 15: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:04.295562  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:04.273102  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:03:04.289398  7507 log.cc:927] Time spent T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:03:04.297024  1664 raft_consensus.cc:2376] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 21. Re-sending same reply.
I20260709 13:03:04.309185  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:04.321038  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:04.276582  1633 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:04.285620  7425 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:04.294173  1662 raft_consensus.cc:2393] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 18: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:04.270414  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:03:04.337374  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 60951.3us
I20260709 13:03:04.337641  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:04.287374  1663 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 13.
I20260709 13:03:04.341450  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:04.346664  1663 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:04.344113  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:04.349363  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:04.351107  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:04.351845  1662 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:04.169667  7347 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:04.315429  7424 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:04.358825  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:04.352982  7458 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:04.372289  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:04.363668  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:04.374215  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:04.355945  7475 raft_consensus.cc:2804] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:04.388441  7034 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:04.390676  7515 log.cc:927] Time spent T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.272s	user 0.001s	sys 0.001s
I20260709 13:03:04.390995  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:04.395351  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:04.395996  1739 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:04.400300  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:04.412988  7438 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:04.415211  1739 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 12.
I20260709 13:03:04.416313  7449 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:04.422464  7143 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:04.423139  7143 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:04.420751  7378 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:04.428167  1661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 4048) took 1079 ms. Trace:
I20260709 13:03:04.429049  7143 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:04.354908  7425 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:04.458171  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:04.490198  1739 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 13.
I20260709 13:03:04.465785  1733 raft_consensus.cc:1275] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:04.493028  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:04.466898  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:03:04.494933  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:04.495234  1740 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:04.478565  1658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 4045) took 1133 ms. Trace:
I20260709 13:03:04.495815  1658 rpcz_store.cc:276] 0709 13:03:03.345397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.346225 (+   828us) service_pool.cc:224] Handling call
0709 13:03:03.346626 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:03.417457 (+ 70831us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:03.417503 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:03.417559 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:03.417616 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.478152 (+1060536us) spinlock_profiling.cc:243] Waited 70.6 ms on lock 0x7b54002fc454. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:03:04.478229 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:04.478479 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":162343040}
I20260709 13:03:04.494948  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:03:04.497865  2523 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:04.499177  1662 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 14.
I20260709 13:03:04.506215  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:04.485849  1661 rpcz_store.cc:276] 0709 13:03:03.348764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.348951 (+   187us) service_pool.cc:224] Handling call
0709 13:03:03.349488 (+   537us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:03:03.354101 (+  4613us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:03.354137 (+    36us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:03:03.357886 (+  3749us) log.cc:844] Serialized 78 byte log entry
0709 13:03:03.613294 (+255408us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:04.427185 (+813891us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b18003d1080. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b80b374bc 00007f1b7de8548b 00007f1b86cdfab9 00007f1b7dea169b 00007f1b7de9f93f 00007f1b7de9f455 00007f1b849873c7 00007f1b80f999a7 00007f1b80fa90bf
0709 13:03:04.427369 (+   184us) log.cc:844] Serialized 14 byte log entry
0709 13:03:04.427610 (+   241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.427693 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:04.427738 (+    45us) raft_consensus.cc:1685] finished
0709 13:03:04.427906 (+   168us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:04.428074 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13893,"prepare.queue_time_us":127749,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":36388,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":15070,"spinlock_wait_cycles":5376896,"thread_start_us":311496,"threads_started":2,"wal-append.queue_time_us":387792}
I20260709 13:03:04.507712  1739 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 13.
I20260709 13:03:04.409637  7475 raft_consensus.cc:697] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 15 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:04.513130  7511 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:04.506124  7470 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:04.519079  1740 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 14.
I20260709 13:03:04.526217  1667 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:03:04.482900  7449 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:04.475968  7458 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:04.493167  7347 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 22 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:04.536157  7442 consensus_meta.cc:287] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6: Time spent flushing consensus metadata: real 0.573s	user 0.008s	sys 0.006s
I20260709 13:03:04.536855  7442 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:04.537295  7511 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:04.541307  7442 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 18 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:04.545878  1663 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 16.
I20260709 13:03:04.552858  7425 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:04.542740  7470 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:04.543064  7458 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:04.556082  1741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43678 (request call id 4055) took 1033 ms. Trace:
I20260709 13:03:04.556547  1741 rpcz_store.cc:276] 0709 13:03:03.522632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.527206 (+  4574us) service_pool.cc:224] Handling call
0709 13:03:04.555887 (+1028681us) spinlock_profiling.cc:243] Waited 751 ms on lock 0x7b54000c4c54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:03:04.556019 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1726805376}
I20260709 13:03:04.559273  7457 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.563635  7457 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:04.566639  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:04.566833  2523 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15.
I20260709 13:03:04.569043  1704 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:04.557446  7458 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:04.570292  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:04.575100  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:04.578949  1589 raft_consensus.cc:1275] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:03:04.577653  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:04.586336  7458 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:04.543697  7449 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:04.572664  7498 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:04.606256  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:03:04.587744  7496 raft_consensus.cc:2804] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:04.608119  2550 raft_consensus.cc:2393] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 15: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:04.610231  1590 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:03:04.610845  1590 raft_consensus.cc:606] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:04.612608  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:04.613215  1663 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16.
I20260709 13:03:04.616820  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:04.617426  1662 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:04.623010  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:04.624822  1658 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:04.598318  7498 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:04.604980  7424 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:04.641665  7424 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:04.593050  7475 consensus_queue.cc:237] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:04.589771  7458 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:04.646349  7425 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:04.686897  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:04.697283  7347 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.705572  7347 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:04.705961  1589 raft_consensus.cc:1275] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:03:04.708189  7347 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:04.711169  7347 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.687295  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:04.700091  1590 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 17.
I20260709 13:03:04.651033  7426 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.716408  7268 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.716747  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:04.716924  7268 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:04.717505  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:04.718775  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:04.724040  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:04.725011  1586 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 17.
I20260709 13:03:04.684139  7324 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:04.726368  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:04.720434  7451 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.720636  7457 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:04.719139  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:04.727074  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:04.727939  1590 raft_consensus.cc:2393] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 12: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:04.728425  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:04.735230  1662 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16.
I20260709 13:03:04.719110  7268 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:04.682507  7469 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:04.749388  1591 raft_consensus.cc:1275] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:04.744980  1589 raft_consensus.cc:1275] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:03:04.745841  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:04.753199  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:04.782160  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:04.782691  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:04.769428  7324 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:04.789441  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:03:04.790014  1705 leader_election.cc:336] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.950s (SENT)
I20260709 13:03:04.814947  1705 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:04.790370  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:04.791729  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:04.792023  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:04.796264  1707 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:04.713056  7511 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:04.835968  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:04.798215  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:04.836690  2548 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:03:04.712284  7094 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.743911  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:04.699518  7425 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:04.803786  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:04.805121  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:04.806140  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:04.738270  7470 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:04.819440  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:04.822299  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:04.824436  2552 raft_consensus.cc:1240] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:04.825755  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:04.829977  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:04.831194  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:04.847473  7424 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:04.849304  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:04.881965  1584 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 12.
I20260709 13:03:04.891019  1740 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:03:04.770015  7451 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:04.853248  7498 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:04.854311  7449 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:04.855370  7527 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.802611  7469 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:04.857225  7523 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:04.768414  7526 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:04.838634  1555 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:03:04.865723  2425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:04.850608  1663 raft_consensus.cc:1275] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:03:04.890867  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:04.935523  1583 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:04.851948  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:04.901793  1591 raft_consensus.cc:1240] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:04.917965  1740 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16.
I20260709 13:03:04.918295  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:04.745527  7524 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:04.763744  7496 raft_consensus.cc:697] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 15 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:04.727209  7426 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:04.929962  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 133804us
I20260709 13:03:04.926317  1658 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 22.
I20260709 13:03:04.857759  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:04.724251  7347 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:04.941872  1741 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16.
I20260709 13:03:04.902691  7424 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:04.903497  7470 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:04.951459  1587 raft_consensus.cc:2393] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 13: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:04.970014  2548 raft_consensus.cc:2393] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 16: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:03:04.831700  7484 consensus_queue.cc:1048] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.120s
W20260709 13:03:04.972890  1705 leader_election.cc:336] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.998s (SENT)
I20260709 13:03:04.975592  1556 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:03:04.976178  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 137651us
I20260709 13:03:04.891453  7094 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:04.983547  1705 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:04.982105  2426 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:04.988761  7485 raft_consensus.cc:2804] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:04.989739  7485 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:04.990249  7485 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:04.990954  1556 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:04.992726  7418 raft_consensus.cc:2804] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:04.993180  7418 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:04.993587  7418 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:04.993419  7248 consensus_queue.cc:1048] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:04.995982  1633 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:04.997512  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:04.998165  1741 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:05.001353  7324 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:05.003335  7500 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:05.010680  7469 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:05.013968  7436 raft_consensus.cc:3055] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:05.014561  7436 raft_consensus.cc:740] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:05.015580  7436 consensus_queue.cc:260] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:05.018898  7451 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:05.016817  7436 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:05.028597  1592 raft_consensus.cc:2410] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
W20260709 13:03:05.029464  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 46094.7us
I20260709 13:03:04.963266  7524 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:05.028333  7441 raft_consensus.cc:2804] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:05.065665  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:05.048528  1588 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:05.053371  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:05.068033  1740 raft_consensus.cc:1275] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:03:05.069137  2548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3"
dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:33568
I20260709 13:03:05.069988  2548 raft_consensus.cc:606] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:05.051502  1583 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 18.
I20260709 13:03:05.072860  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:05.073828  1586 raft_consensus.cc:2393] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 14: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:05.071497  2426 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:04.950320  7526 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:05.084306  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:05.086540  1707 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:04.982234  7424 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:05.042166  7047 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:05.042215  7349 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:05.104684  1740 raft_consensus.cc:1240] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:05.101238  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:04.962061  7527 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:05.067258  7441 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.055368  7525 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:05.169363  7525 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:05.116977  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:05.117841  1556 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:05.043011  7475 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:05.121861  7468 consensus_queue.cc:1059] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:03:05.123951  7425 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:05.218767  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:05.055673  7470 consensus_queue.cc:1048] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
W20260709 13:03:05.124413  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 151539us
I20260709 13:03:05.061043  7500 raft_consensus.cc:697] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 16 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:05.131085  7524 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:05.124402  7349 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:05.072680  7496 consensus_queue.cc:237] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:05.115628  7047 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:05.134433  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 47990us
I20260709 13:03:05.136507  7523 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:05.138921  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:05.263372  2548 raft_consensus.cc:2393] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 17: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:03:05.141578  7094 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:05.144594  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:05.145306  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:05.147944  1733 raft_consensus.cc:1240] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:05.150385  7418 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:05.152282  7424 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:05.083770  7508 raft_consensus.cc:2804] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:05.153082  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:05.153844  7527 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:05.166328  1661 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12.
W20260709 13:03:05.173182  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 55439.7us
I20260709 13:03:05.173502  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:03:05.273357  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 277314us
I20260709 13:03:05.177472  1741 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 22.
I20260709 13:03:05.156728  7434 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.172374  7441 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:05.183167  7526 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:05.185914  7485 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:05.186777  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:05.189330  7426 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:05.195184  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:05.196926  1737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 4058) took 1673 ms. Trace:
I20260709 13:03:05.200304  1588 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 17.
I20260709 13:03:05.210378  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:03:05.211792  1585 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 3210) took 1669 ms (client timeout 2003 ms). Trace:
W20260709 13:03:05.221524  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:05.200515  7247 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:05.264184  1740 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 14.
I20260709 13:03:05.303228  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:05.264225  1732 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
W20260709 13:03:05.303639  1705 leader_election.cc:336] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 3.696s (SENT)
I20260709 13:03:05.303938  1662 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:03:05.304345  1705 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:05.277455  1590 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:03:05.305687  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:05.306146  1590 raft_consensus.cc:606] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:05.279188  1658 raft_consensus.cc:1240] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:05.227007  7469 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:05.281723  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:05.281032  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:05.300144  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:05.313890  1733 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 9.
I20260709 13:03:05.314059  1741 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
I20260709 13:03:05.314458  2540 raft_consensus.cc:2393] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 17: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:03:05.284219  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:05.287454  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:05.219178  6974 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:05.316581  6974 raft_consensus.cc:697] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 22 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:05.317457  7349 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:05.317291  7500 consensus_queue.cc:237] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:05.317667  6974 consensus_queue.cc:237] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:05.279249  7508 raft_consensus.cc:697] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:05.301326  1735 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:03:05.309828  7047 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:05.310400  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:05.322690  7508 consensus_queue.cc:237] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:05.285866  7434 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:05.266153  7533 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:05.327188  7525 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:05.327862  7434 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:05.313328  7469 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:05.330418  1667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 3114) took 1055 ms. Trace:
I20260709 13:03:05.331123  7469 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:05.331645  7418 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:05.332238  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:05.332846  1738 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 12.
W20260709 13:03:05.302465  1585 rpcz_store.cc:269] 0709 13:03:03.542555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.543361 (+   806us) service_pool.cc:224] Handling call
0709 13:03:05.211474 (+1668113us) spinlock_profiling.cc:243] Waited 98.4 ms on lock 0x7b54003a0554. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:03:05.211682 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":226333568}
I20260709 13:03:05.300828  1737 rpcz_store.cc:276] 0709 13:03:03.523555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.531324 (+  7769us) service_pool.cc:224] Handling call
0709 13:03:03.531606 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:05.023354 (+1491748us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:05.023385 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:05.023424 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:05.023793 (+   369us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.196564 (+172771us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b54002233d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:03:05.196635 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:05.196823 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3430179584}
I20260709 13:03:05.330834  1667 rpcz_store.cc:276] 0709 13:03:04.274797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.308778 (+ 33981us) service_pool.cc:224] Handling call
0709 13:03:05.330215 (+1021437us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b5400359654. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:03:05.330348 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":496149888}
I20260709 13:03:05.343629  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:05.344404  1663 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 18.
I20260709 13:03:05.346218  7447 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:05.346850  7534 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:05.347129  7447 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:05.347587  7534 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:05.350003  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 217385us
I20260709 13:03:05.352803  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:05.220157  7475 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:05.346145  1665 raft_consensus.cc:1240] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:05.276077  7528 raft_consensus.cc:2749] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:03:05.368413  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:05.366587  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:05.369339  1665 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:03:05.285298  7531 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:03:05.372068  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 68482.2us
I20260709 13:03:05.372406  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:05.374312  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:05.375015  1738 raft_consensus.cc:3060] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:03:05.375404  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:05.376701  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:05.377655  1740 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:05.382570  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:05.383452  1667 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16.
I20260709 13:03:05.365840  7426 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.365445  7469 raft_consensus.cc:2749] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:05.422359  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 150079us
I20260709 13:03:05.426460  1585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:03:05.427368  1585 raft_consensus.cc:606] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:05.434824  1738 raft_consensus.cc:2468] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 10.
I20260709 13:03:05.436604  1558 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:05.367882  7425 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:03:05.438787  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 55215.2us
I20260709 13:03:05.370841  7533 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:05.376705  7524 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.457702  1740 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 13.
I20260709 13:03:05.459642  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:05.388871  7525 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:05.451051  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:05.452764  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:05.382524  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:05.379432  7526 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:05.375607  7498 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:05.464825  1740 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:05.465878  1633 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:05.470198  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:05.472802  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:05.473671  1732 raft_consensus.cc:1813] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Handling vote request from an unknown peer 6d4de2ce0683442498244b9529127f91
I20260709 13:03:05.474432  1732 raft_consensus.cc:2410] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:03:05.453655  1705 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:05.479285  1705 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:05.483629  1740 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
I20260709 13:03:05.445724  7273 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.484640  7525 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:05.494848  7273 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:05.497423  7525 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:05.463909  7533 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:05.469673  7524 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:05.463665  7349 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:05.505698  7498 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:05.508288  7458 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:05.436668  7366 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:05.492488  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:05.506664  7475 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:05.493865  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:05.533196  1664 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:05.494767  1585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:03:05.509356  1583 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 14.
I20260709 13:03:05.512569  1705 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:05.534811  1585 raft_consensus.cc:606] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:05.518782  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:05.540233  1659 raft_consensus.cc:1813] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Handling vote request from an unknown peer 6d4de2ce0683442498244b9529127f91
I20260709 13:03:05.543084  1659 raft_consensus.cc:2410] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:03:05.509570  2552 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 14.
W20260709 13:03:05.529141  2425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:05.571835  6360 raft_consensus.cc:993] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5ced62816f8545cd9b63a27e9055e42d to start an election
W20260709 13:03:05.571869  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 59409.8us
I20260709 13:03:05.574568  1705 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:05.588567  7525 raft_consensus.cc:2804] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:05.588716  7524 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:05.589550  7525 raft_consensus.cc:697] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 12 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:05.469357  7425 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:05.590760  7525 consensus_queue.cc:237] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:05.592339  7425 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:05.593634  7534 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:05.593791  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 103850us
I20260709 13:03:05.446106  7426 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:05.381152  7531 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:05.601331  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:05.611030  1705 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:05.614482  1664 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
I20260709 13:03:05.487879  7470 raft_consensus.cc:2749] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:05.509009  7498 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:05.589377  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:05.638711   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:03:05.550593  7447 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:05.546468  7529 raft_consensus.cc:2749] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:05.648473  1705 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:05.550190  7484 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.598268  7354 raft_consensus.cc:1081] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Signalling peer 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:03:05.667704  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:05.671263  1705 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:05.676505  1664 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 18.
I20260709 13:03:05.598824  7458 raft_consensus.cc:2749] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:05.677666  1705 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:05.678923  1705 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:05.588924  7273 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:05.681999  7484 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:05.510093  7526 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:05.675841  7498 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:05.692740  7526 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:05.693753  1705 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:05.695007  1705 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:05.643293  7524 raft_consensus.cc:2749] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:05.716652  2523 raft_consensus.cc:1240] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:03:05.697247  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:05.659790  7047 raft_consensus.cc:2749] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:05.728523  7498 raft_consensus.cc:2749] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:05.666424  7468 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:05.679422  7534 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:05.726636  7470 raft_consensus.cc:2749] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:05.682725  7469 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:05.695492  7527 raft_consensus.cc:2749] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:05.741394  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:05.753681  1660 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:05.754271  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:05.684062  7391 raft_consensus.cc:2764] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won
W20260709 13:03:05.745569  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 279723us
I20260709 13:03:05.687759  7475 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
W20260709 13:03:05.751652  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 84520.4us
I20260709 13:03:05.755445  1633 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:05.579277  7366 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:05.754976  1661 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 11.
I20260709 13:03:05.731411  7529 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:05.750945  7489 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:05.784446  1633 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:05.789880  1633 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:05.758813  7485 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:05.805179  7545 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.806600  7545 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:05.808929  1664 raft_consensus.cc:1275] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:03:05.810529  7366 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:05.810873  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:05.811519  1664 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:05.811590  7540 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.812165  7540 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:05.814555  7540 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:03:05.816865  7543 log.cc:927] Time spent T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:03:05.818557  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:05.821024  1664 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 18.
I20260709 13:03:05.822924  6821 raft_consensus.cc:3055] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:05.823388  6821 raft_consensus.cc:740] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:03:05.835207  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 74173us
I20260709 13:03:05.837888  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:05.838716  1665 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:03:05.824712  6821 consensus_queue.cc:260] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:05.844224  6821 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:05.771150  7534 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:05.774286  7475 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:05.749715  7468 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:05.864337  7557 raft_consensus.cc:2804] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:05.798134  7489 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:05.778498  7529 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:05.970790  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 275821us
W20260709 13:03:05.976805  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 127420us
I20260709 13:03:05.841329  7540 consensus_queue.cc:1048] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.111s
I20260709 13:03:05.945240  7425 raft_consensus.cc:2804] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:05.871767  7557 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:03:06.017285  7548 log.cc:927] Time spent T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.218s	user 0.000s	sys 0.002s
I20260709 13:03:06.017901  7534 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:05.955350  7537 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:06.018900  7537 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:06.019567  7537 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:06.020117  7549 log.cc:927] Time spent T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.267s	user 0.001s	sys 0.000s
I20260709 13:03:06.009814  7533 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:06.022734  2552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49238 (request call id 653) took 1124 ms. Trace:
I20260709 13:03:06.058363  1660 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 17.
W20260709 13:03:06.066385  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 55308us
I20260709 13:03:06.023185  2552 rpcz_store.cc:276] 0709 13:03:04.898689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.917975 (+ 19286us) service_pool.cc:224] Handling call
0709 13:03:06.020300 (+1102325us) spinlock_profiling.cc:243] Waited 568 ms on lock 0x7b540056f254. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:03:06.022653 (+  2353us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1306542976}
I20260709 13:03:06.067736  1556 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:06.018867  7534 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.024864  7557 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:06.028365  7468 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:03:06.013593  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 417528us
I20260709 13:03:06.014019  7465 consensus_queue.cc:1048] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:03:06.071453  7425 raft_consensus.cc:697] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 14 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:06.093847  1558 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:06.099485  1556 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:06.121814  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:06.122514  1556 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:03:06.100781  1705 leader_election.cc:336] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.567s (SENT)
I20260709 13:03:06.078631  7426 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:06.078001  7469 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:06.080677  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:03:06.103308  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 313591us
I20260709 13:03:06.125312  1705 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:06.137404  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 80327.8us
I20260709 13:03:06.119797  7110 raft_consensus.cc:2804] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:06.143373  1633 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:06.097987  7366 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:06.149926  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:03:06.150286  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 56557.8us
I20260709 13:03:06.148262  1740 raft_consensus.cc:1275] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:03:06.129906  7478 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
W20260709 13:03:06.144167  7441 consensus_meta.cc:287] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.844s	user 0.019s	sys 0.000s
I20260709 13:03:06.157881  7441 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:06.162016  7556 log.cc:927] Time spent T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.092s	user 0.000s	sys 0.002s
I20260709 13:03:06.162202  7441 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:06.129068  7416 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:03:06.153260  2425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.153259  6821 raft_consensus.cc:2749] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:06.154068  1666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39162 (request call id 3119) took 1869 ms. Trace:
I20260709 13:03:06.079105  7534 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:06.154958  1660 raft_consensus.cc:1275] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:03:06.150925  2426 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:06.177580  7561 consensus_queue.cc:1048] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:06.156865  7478 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:06.109308  7531 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:06.172964  1666 rpcz_store.cc:276] 0709 13:03:04.276221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.399204 (+122983us) service_pool.cc:224] Handling call
0709 13:03:06.145037 (+1745833us) spinlock_profiling.cc:243] Waited 636 ms on lock 0x7b540019dcd4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:03:06.145194 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1461690752}
I20260709 13:03:06.121389  7434 consensus_queue.cc:1059] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:03:06.175065  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:06.133054  7564 raft_consensus.cc:2764] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:03:06.150480  7545 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:06.144919  7391 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:03:06.188128  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 44849.5us
I20260709 13:03:06.144153  7110 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:06.171627  7416 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:06.204414  1663 raft_consensus.cc:1275] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:03:06.208288  1633 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:06.214645  1558 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:06.138348  7469 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:06.228279  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 49992.8us
W20260709 13:03:06.225253  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 52812.9us
I20260709 13:03:06.166638  7366 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:06.230232  2426 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:06.231997  1633 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:06.204572  7247 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:06.254346  1633 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:06.245965  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 74107.4us
I20260709 13:03:06.221995  7416 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:06.218380  7110 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:06.256799  2424 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:06.252717  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:06.258498  2426 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:06.233187  7348 consensus_queue.cc:1059] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:03:06.264581  7248 raft_consensus.cc:2804] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:06.258704  7273 raft_consensus.cc:2804] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:06.267814  7273 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:06.268360  7273 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:06.223229  7478 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:06.233621  7425 consensus_queue.cc:237] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:06.279031  7508 raft_consensus.cc:2804] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:06.279446  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:06.281301  1735 raft_consensus.cc:2376] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16. Re-sending same reply.
I20260709 13:03:06.282274  7248 raft_consensus.cc:697] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:06.282719  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:06.283581  7248 consensus_queue.cc:237] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:06.285971  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:03:06.287766  7523 consensus_meta.cc:287] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 1.013s	user 0.005s	sys 0.010s
I20260709 13:03:06.288990  7523 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:06.259696  7489 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:06.289987  1737 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16.
I20260709 13:03:06.292750  1704 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:06.293190  1666 raft_consensus.cc:1275] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:03:06.289603  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:06.296285  1741 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:43678
I20260709 13:03:06.296705  7478 raft_consensus.cc:2749] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:06.297019  1741 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:06.256215  7426 raft_consensus.cc:2804] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:06.234177  7475 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:06.298269  1707 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:06.256366  7526 raft_consensus.cc:2749] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:03:06.322399  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 46768.3us
I20260709 13:03:06.301093  1665 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 13.
W20260709 13:03:06.303674  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 45572.1us
I20260709 13:03:06.325771  7478 consensus_queue.cc:1048] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:03:06.325934  7368 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:06.325945  1741 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:06.331241  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:06.331583  1556 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:03:06.335717  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 79158.1us
I20260709 13:03:06.332458  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:06.333258  2424 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:06.335903  1556 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:06.336625  1633 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:06.342437  7475 raft_consensus.cc:2749] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:06.348934  1633 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:06.349241  7566 raft_consensus.cc:2804] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:06.350214  7566 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:06.350375  7475 raft_consensus.cc:2749] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:06.350692  7566 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:06.321602  7426 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:06.351672  7426 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:06.351884  1633 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:06.353006  7368 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:06.355170  7368 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:03:06.363085  7366 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:06.294227  7529 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:06.367373  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:06.320889  7391 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:06.348048  7501 raft_consensus.cc:2749] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:06.299434  7508 raft_consensus.cc:697] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:06.328750  7523 raft_consensus.cc:2804] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:06.323308  7436 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:06.297565  7486 consensus_queue.cc:1048] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.067s
I20260709 13:03:06.367244  7526 raft_consensus.cc:2749] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:06.386186  7391 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:06.363960  7564 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:06.328279  7511 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:06.391757  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:06.393323  1633 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:06.394145  7562 raft_consensus.cc:2804] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:06.387388  7523 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:06.384770  7368 raft_consensus.cc:2804] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:06.391453  7436 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:06.396730  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:06.397468  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:06.391808  7565 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:06.398624  7534 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:06.337805  7528 raft_consensus.cc:2804] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:06.408572  1665 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 12.
I20260709 13:03:06.423178  1585 raft_consensus.cc:2393] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 15: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:06.390187  7508 consensus_queue.cc:237] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:06.441131  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 47788.7us
I20260709 13:03:06.419135  7523 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:06.475322  2424 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:06.459266  1633 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:06.467235  1741 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:06.427649  7562 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:06.442338  7526 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:06.397058  7557 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:06.411516  7511 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:06.496208  7569 log.cc:927] Time spent T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.237s	user 0.001s	sys 0.001s
W20260709 13:03:06.497035  7570 log.cc:927] Time spent T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:03:06.443500  7368 raft_consensus.cc:697] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:06.443871  7528 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:06.512012  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 216861us
I20260709 13:03:06.487975  7366 raft_consensus.cc:2804] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:03:06.529676  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 193928us
I20260709 13:03:06.529791  1741 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:06.512974  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 182912us
I20260709 13:03:06.493570  7534 raft_consensus.cc:2749] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:06.442193  7565 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:06.500566  1633 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:06.549587  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 49943.9us
I20260709 13:03:06.498272  7562 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:06.555743  1556 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:03:06.526126  7537 consensus_meta.cc:287] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.506s	user 0.012s	sys 0.005s
I20260709 13:03:06.571615  7557 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:06.504549  7475 consensus_queue.cc:1048] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:03:06.552707  7248 consensus_queue.cc:1048] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:03:06.575495  7502 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.576058  7502 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:06.577298  7391 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:06.579185  7391 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:06.579711  7502 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:06.581461  7425 consensus_queue.cc:1059] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:06.586973  7484 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:06.559448  1633 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:06.579651  7391 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:06.528018  7366 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:06.593751  1556 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:06.599197  1662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 4093) took 1108 ms. Trace:
I20260709 13:03:06.527609  7528 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:06.604570  1662 rpcz_store.cc:276] 0709 13:03:05.491104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.491250 (+   146us) service_pool.cc:224] Handling call
0709 13:03:05.491861 (+   611us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:05.598191 (+106330us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:03:05.765792 (+167601us) log.cc:844] Serialized 14 byte log entry
0709 13:03:06.015278 (+249486us) log.cc:844] Serialized 14 byte log entry
0709 13:03:06.015420 (+   142us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:06.015462 (+    42us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:06.015512 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.598929 (+583417us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b540012ff54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:03:06.598981 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.599133 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":187540,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":95,"raft.queue_time_us":16249,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":121,"spinlock_wait_cycles":243813248,"thread_start_us":414512,"threads_started":2,"wal-append.queue_time_us":356994}
I20260709 13:03:06.556748  7526 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:06.610023  1633 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:03:06.607751  7570 log.cc:927] Time spent T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:03:06.592581  7537 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:06.591991  7368 consensus_queue.cc:237] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:06.654735  7537 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:06.619443  7573 log.cc:927] Time spent T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.212s	user 0.000s	sys 0.002s
W20260709 13:03:06.618003  7538 log.cc:927] Time spent T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 1.124s	user 0.017s	sys 0.017s
I20260709 13:03:06.658385  1591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46836 (request call id 829) took 1619 ms. Trace:
I20260709 13:03:06.658748  1591 rpcz_store.cc:276] 0709 13:03:05.038878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.039018 (+   140us) service_pool.cc:224] Handling call
0709 13:03:05.063046 (+ 24028us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:05.117094 (+ 54048us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:05.117127 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:05.124171 (+  7044us) log.cc:844] Serialized 26 byte log entry
0709 13:03:05.371021 (+246850us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:05.371063 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.371135 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:06.594647 (+1223512us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b240013f268. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7dd289c4 00007f1b7dd26acb 00007f1b7dee1dc9 00007f1b7dee1a55 00007f1b7dee109d 00007f1b80b1310e 00007f1b80b2a88c 00007f1b80b29bb6 00007f1b80b297d8 00007f1b80b33221
0709 13:03:06.658098 (+ 63451us) raft_consensus.cc:1685] finished
0709 13:03:06.658122 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.658319 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47648,"raft.queue_time_us":40860,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":39870,"spinlock_wait_cycles":43773184,"thread_start_us":245074,"threads_started":1,"wal-append.queue_time_us":341443}
I20260709 13:03:06.618132  7373 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:06.662065  7373 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:06.606503  7366 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:06.662459  7373 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:06.603344  7475 raft_consensus.cc:2749] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:06.666821  7566 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:06.618275  7425 raft_consensus.cc:2749] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:06.660647  7273 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:06.653478  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:06.650959  1662 raft_consensus.cc:1240] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:06.682178  1660 raft_consensus.cc:2393] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 13: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:03:06.693771  1737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43678 (request call id 4087) took 1307 ms. Trace:
I20260709 13:03:06.694728  1737 rpcz_store.cc:276] 0709 13:03:05.372015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.372183 (+   168us) service_pool.cc:224] Handling call
0709 13:03:06.632929 (+1260746us) spinlock_profiling.cc:243] Waited 917 ms on lock 0x7b540001ed54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:03:06.679770 (+ 46841us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2108485504}
I20260709 13:03:06.698594  1662 raft_consensus.cc:1275] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:03:06.614208  7578 raft_consensus.cc:2804] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:03:06.696522  7574 log.cc:927] Time spent T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.157s	user 0.000s	sys 0.004s
W20260709 13:03:06.717912  2426 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.848s (SENT) [suppressed 14 similar messages]
I20260709 13:03:06.705399  7143 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.647683  7577 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:06.670075  7416 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:06.669260  7523 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:06.706672  7391 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:06.733291  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:06.734912  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:06.735553  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:06.734572  7047 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:06.737372  7511 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:06.737648  7047 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:06.740181  7047 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:06.715883  7578 raft_consensus.cc:697] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:06.742796  7578 consensus_queue.cc:237] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:06.745169  7565 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:06.746771  7566 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:06.742630  7584 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:06.749143  7584 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:06.748670  7579 log.cc:927] Time spent T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:03:06.755366  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:06.711472  7436 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:03:06.747134  7582 log.cc:927] Time spent T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 13:03:06.753672  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:06.759039  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:06.760311  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:06.736500  7577 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:06.788976  1735 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 14.
I20260709 13:03:06.789726  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:03:06.774263  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.774662  7523 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:03:06.775038  1588 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46836 (request call id 822) took 2089 ms (client timeout 1848 ms). Trace:
I20260709 13:03:06.751595  7143 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:06.800576  1588 rpcz_store.cc:269] 0709 13:03:04.685521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.685650 (+   129us) service_pool.cc:224] Handling call
0709 13:03:06.774817 (+2089167us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b54000316d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:03:06.774954 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":711445376}
I20260709 13:03:06.777390  7354 raft_consensus.cc:3055] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:06.780067  7416 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:06.781611  7584 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:06.782711  7110 consensus_meta.cc:287] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.508s	user 0.012s	sys 0.001s
I20260709 13:03:06.794036  1658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 4097) took 1301 ms. Trace:
I20260709 13:03:06.794821  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:06.798126  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:06.815093  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:03:06.813598  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:06.806550  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:06.816857  1739 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 15.
W20260709 13:03:06.817616  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 283297us
I20260709 13:03:06.815169  1658 rpcz_store.cc:276] 0709 13:03:05.492987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.505597 (+ 12610us) service_pool.cc:224] Handling call
0709 13:03:05.506497 (+   900us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:05.547273 (+ 40776us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:05.547319 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:05.547377 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:05.547424 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.793805 (+1246381us) spinlock_profiling.cc:243] Waited 40.5 ms on lock 0x7b540041c3d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:03:06.793856 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.793979 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93193088}
I20260709 13:03:06.823269  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:03:06.825933  7273 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:06.827768  7580 log.cc:927] Time spent T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.069s	user 0.000s	sys 0.002s
I20260709 13:03:06.810659  7354 raft_consensus.cc:740] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:06.852313  1663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58814 (request call id 987) took 1088 ms. Trace:
I20260709 13:03:06.852774  1663 rpcz_store.cc:276] 0709 13:03:05.763975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.086841 (+322866us) service_pool.cc:224] Handling call
0709 13:03:06.093192 (+  6351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:06.218870 (+125678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.852059 (+633189us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b540041c8d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:03:06.852249 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":252960640}
I20260709 13:03:06.853559  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:06.854379  1658 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:06.811657  7348 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.784636  7528 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:06.831379  7577 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:06.827759  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:06.864490  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:06.800038  7424 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:06.869670  7424 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:06.841776  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:06.841125  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:06.844589  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:06.877169  1585 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 12.
I20260709 13:03:06.844740  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:06.845873  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:06.847389  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:06.878640  7424 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:06.871368  1591 raft_consensus.cc:2393] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 in current term 13: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:06.850618  7347 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:06.830817  7426 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:06.867765  1737 raft_consensus.cc:2468] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
I20260709 13:03:06.840936  7457 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:06.892648  1558 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:06.881587  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:06.838164  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:06.907610  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:06.907094  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:06.895362  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:03:06.907331  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:06.839423  7143 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:06.908105  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:06.930542  1662 raft_consensus.cc:1240] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:06.902436  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:06.838888  7427 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:06.912002  1737 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:03:06.906071  1740 raft_consensus.cc:1240] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:03:06.895697  1633 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:06.917824  1738 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:03:06.942585  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:03:06.942008  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 47230.9us
I20260709 13:03:06.944039  1633 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:06.901382  1558 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:06.917804  1658 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 14.
I20260709 13:03:06.901558  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:06.946444  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:06.934975  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:06.954905  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:06.937490  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:06.819624  7110 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:06.999255  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:03:06.991868  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 48166.3us
I20260709 13:03:06.985705  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:06.999560  1585 raft_consensus.cc:1275] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:07.000666  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:07.009707  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:06.988273  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:07.017839  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:07.022018  6360 raft_consensus.cc:2749] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:07.022475  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:07.000450  1633 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:07.025262  1584 raft_consensus.cc:1240] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:07.025650  1633 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:07.022806  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 121194us
W20260709 13:03:06.934128  7506 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.092s	user 0.008s	sys 0.021s
I20260709 13:03:07.050122  1589 raft_consensus.cc:1275] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:03:07.052416  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:07.052709  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:06.897970  7273 raft_consensus.cc:2749] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:07.055748  1658 raft_consensus.cc:1275] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:07.056192  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:07.058303  1633 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:07.062927  1660 raft_consensus.cc:2468] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:03:07.084144  1664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58814 (request call id 984) took 1321 ms. Trace:
I20260709 13:03:07.090219  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:07.084753  1664 rpcz_store.cc:276] 0709 13:03:05.762398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.823762 (+ 61364us) service_pool.cc:224] Handling call
0709 13:03:05.824571 (+   809us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:05.953907 (+129336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:05.953943 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:05.953988 (+    45us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:05.954023 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.083488 (+1129465us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b540019c654. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:03:07.083754 (+   266us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:07.084066 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":296891136}
I20260709 13:03:07.091140  1585 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 22.
I20260709 13:03:06.887632  7348 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:07.096925  1556 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:07.098217  1738 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 13.
I20260709 13:03:07.098412  1633 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:07.023695  7424 raft_consensus.cc:2749] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:07.104238  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:06.930709  2537 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16.
I20260709 13:03:07.095073  1558 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:06.891119  7354 consensus_queue.cc:260] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:06.997164  7566 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.997897  7368 consensus_queue.cc:1048] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.113s
I20260709 13:03:07.001735  7143 raft_consensus.cc:2749] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:06.897830  7457 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:07.059520  7425 raft_consensus.cc:2804] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:07.132952  1737 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16.
I20260709 13:03:07.195562  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:07.196728  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:07.198556  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:03:07.137836  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 420533us
I20260709 13:03:07.140700  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:07.153323  1583 raft_consensus.cc:2393] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 18: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:03:07.106678  7531 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:07.062311  7506 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.262s	user 0.008s	sys 0.022s
W20260709 13:03:07.172792  7583 log.cc:927] Time spent T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 13:03:07.002246  7427 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:07.171572  7591 log.cc:927] Time spent T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.347s	user 0.000s	sys 0.003s
I20260709 13:03:07.185900  7426 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:07.138543  1630 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:07.074436  7537 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:07.202509  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:07.203460  1737 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:07.142060  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:03:07.206526  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 111522us
I20260709 13:03:07.161580  7566 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:07.207628  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 69938.4us
I20260709 13:03:07.216974  2550 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 14.
I20260709 13:03:07.143388  7526 raft_consensus.cc:2804] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:07.152047  7418 raft_consensus.cc:2749] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:07.232684  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:07.251556  1590 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 14.
I20260709 13:03:07.253917  1558 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:07.122051  7502 consensus_queue.cc:1059] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.106s
I20260709 13:03:07.188957  7110 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:07.257027  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:07.258533  1665 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 14.
I20260709 13:03:07.185643  7424 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:03:07.254870  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 116419us
I20260709 13:03:07.261732  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:07.271044  1738 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:07.207140  7425 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:07.247334  1587 raft_consensus.cc:2468] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 8.
I20260709 13:03:07.275424  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:07.227648  7273 raft_consensus.cc:2804] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:07.270908  7501 raft_consensus.cc:2804] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:07.309940  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:07.281867  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:07.311754  1585 raft_consensus.cc:2393] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 15: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:07.276136  1592 raft_consensus.cc:3055] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:07.288393  1737 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 13.
I20260709 13:03:07.254269  7526 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:07.274370  7592 log.cc:927] Time spent T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.369s	user 0.000s	sys 0.002s
I20260709 13:03:07.300966  7502 raft_consensus.cc:3055] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:07.275952  7424 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:07.314229  1592 raft_consensus.cc:740] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:07.266573  7426 raft_consensus.cc:2749] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:07.318137  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:03:07.278640  7366 consensus_meta.cc:287] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent flushing consensus metadata: real 0.610s	user 0.014s	sys 0.002s
I20260709 13:03:07.302703  7457 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:07.312726  7501 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:07.330694  1737 raft_consensus.cc:1240] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:07.306185  7348 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:07.277244  7425 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:07.282135  7273 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:07.304461  7427 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:07.334478  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:07.276893  7416 consensus_queue.cc:1048] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.064s
I20260709 13:03:07.317469  7502 raft_consensus.cc:740] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:07.314950  7526 raft_consensus.cc:3060] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:07.346836  1592 consensus_queue.cc:260] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:07.345070  7501 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:07.359107  1592 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:07.342725  7528 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:07.369206  7566 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:07.369774  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:03:07.370651  7562 consensus_meta.cc:287] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.780s	user 0.011s	sys 0.004s
I20260709 13:03:07.371127  7562 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:07.371594  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:07.372618  1667 raft_consensus.cc:1240] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:07.355870  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:07.373047  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:07.377875  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:07.351765  7273 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:07.326591  1738 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 14.
W20260709 13:03:07.357147  7599 log.cc:927] Time spent T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.169s	user 0.000s	sys 0.002s
I20260709 13:03:07.342465  7366 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:07.391469  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:07.395838  1590 raft_consensus.cc:2393] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 14: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:07.397959  1740 raft_consensus.cc:1275] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:07.399456  1740 raft_consensus.cc:1275] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
W20260709 13:03:07.400857  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 123296us
I20260709 13:03:07.409204  1592 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 13.
W20260709 13:03:07.409823  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 102492us
I20260709 13:03:07.411459  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:07.415863  2552 raft_consensus.cc:1240] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:07.421972  1633 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:07.423815  2426 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:07.403838  7594 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:07.434716  7457 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.426185  7143 raft_consensus.cc:2764] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:03:07.402530  7502 consensus_queue.cc:260] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:07.420113  7426 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.448319  6360 raft_consensus.cc:993] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:03:07.450018  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:07.450947  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:07.479758  1591 raft_consensus.cc:2368] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 13. Current term is 14.
I20260709 13:03:07.457396  7562 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:07.458534  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
W20260709 13:03:07.468621  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 44919us
I20260709 13:03:07.469293  1705 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:07.475677  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:07.453858  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:07.487987  2426 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:07.488288  1741 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 14.
I20260709 13:03:07.442979  7366 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:03:07.493057  1741 raft_consensus.cc:1240] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:07.495937  2426 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:07.455175  7425 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:07.514712  7425 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:07.515475  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:07.491222  7594 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:07.516654  7501 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:07.490757  7426 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:07.519503  7426 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:07.521737  7587 raft_consensus.cc:2804] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:07.522217  7587 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:07.522667  7587 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:07.478922  7457 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:07.525288  7594 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:07.486841  7607 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:07.505816  7502 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:07.505831  7550 raft_consensus.cc:2804] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:03:07.491719  7373 consensus_meta.cc:287] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.829s	user 0.016s	sys 0.001s
I20260709 13:03:07.498317  7578 raft_consensus.cc:1081] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Signalling peer 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:03:07.539690  1704 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:07.516583  7526 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:07.503537  2426 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:07.511003  7241 raft_consensus.cc:993] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:03:07.555548  7241 raft_consensus.cc:1081] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Signalling peer 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:03:07.555706  7607 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:07.556140  7565 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:07.556377  7607 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:07.556782  7565 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:07.555140  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:03:07.558857  7565 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:07.559363  7391 raft_consensus.cc:2804] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:07.555073  1556 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:07.555075  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:07.570255  1583 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:07.575073  1589 raft_consensus.cc:1275] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:03:07.578903  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:03:07.584733  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 115529us
I20260709 13:03:07.585587  1705 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:07.586925  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:07.536644  7373 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:07.587383  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 83979.3us
I20260709 13:03:07.587388  1705 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:07.584051  7457 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:07.563251  7529 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.530321  7550 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:07.600879  1583 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15.
I20260709 13:03:07.597416  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:07.590142  7511 raft_consensus.cc:2764] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:03:07.558804  7607 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:07.585158  7434 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:07.603787  7391 raft_consensus.cc:697] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 14 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:07.606590  1707 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:07.619570  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:07.622118  1588 raft_consensus.cc:2376] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 17. Re-sending same reply.
I20260709 13:03:07.602125  1591 raft_consensus.cc:1275] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:03:07.564167  7526 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:07.615777  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:07.610199  1705 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:07.611064  7498 raft_consensus.cc:2749] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:07.627193  7391 consensus_queue.cc:237] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:07.628932  7434 raft_consensus.cc:697] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:07.629161  7527 raft_consensus.cc:2804] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:07.590430  7496 raft_consensus.cc:2749] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:07.644217  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:07.600288  7508 raft_consensus.cc:2804] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:07.613198  7550 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:07.612216  7501 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:07.652740  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:07.655071  7434 consensus_queue.cc:237] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:07.665819  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:07.616456  7529 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:07.667641  7527 raft_consensus.cc:697] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 13 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:07.668625  7498 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.677111  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:07.651242  7508 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:07.662453  7590 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:07.638128  7511 consensus_queue.cc:1048] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:03:07.694923  1736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 4100) took 1416 ms. Trace:
I20260709 13:03:07.695362  1736 rpcz_store.cc:276] 0709 13:03:06.278563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.291420 (+ 12857us) service_pool.cc:224] Handling call
0709 13:03:06.298077 (+  6657us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:06.298303 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:03:06.426458 (+128155us) log.cc:844] Serialized 14 byte log entry
0709 13:03:06.832081 (+405623us) spinlock_profiling.cc:243] Waited 5.47 ms on lock 0x7b4400022b4c. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7ddc8c85 00007f1b7ddc96a2 00007f1b80b3b1db 00007f1b80b36aaf 00007f1b80b2a86e 00007f1b80b29bb6 00007f1b80b297d8 00007f1b80b33221 00007f1b80b331d9 00007f1b80b33169
0709 13:03:07.694460 (+862379us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b1800278d40. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b80b374bc 00007f1b7de8548b 00007f1b86cdfab9 00007f1b7dea169b 00007f1b7de9f93f 00007f1b7de9f455 00007f1b80f87060 00007f1b80f99716 00007f1b80faa287
0709 13:03:07.694642 (+   182us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:07.694684 (+    42us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:07.694733 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.694784 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:07.694870 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":292125,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":3906,"raft.queue_time_us":89227,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":7097,"spinlock_wait_cycles":17576064,"thread_start_us":312215,"threads_started":3,"wal-append.queue_time_us":168852}
I20260709 13:03:07.688606  7373 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:07.702605  1738 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 22.
I20260709 13:03:07.704846  1633 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:07.715548  7527 consensus_queue.cc:237] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:07.717929  7427 raft_consensus.cc:2804] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:07.718838  7427 raft_consensus.cc:697] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 13 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:07.679402  7498 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:07.723585  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.707304  7273 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:07.705273  7508 raft_consensus.cc:3060] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:07.758785  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:07.790715  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:07.762568  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:07.793342  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:07.794430  1583 raft_consensus.cc:2393] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 19: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:07.763108  1587 raft_consensus.cc:1240] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:03:07.763444  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:07.797032  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:07.797901  1740 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:03:07.771857  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:03:07.799454  2552 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:07.761168  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:07.801949  1740 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:43678
I20260709 13:03:07.803342  1740 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:07.803836  1740 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:07.785377  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:07.783398  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:07.807334  1737 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:03:07.810390  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:07.810881  1741 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:43678
I20260709 13:03:07.811576  1741 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:07.812059  1741 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:07.822243  1735 raft_consensus.cc:1275] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:07.844295  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:07.727588  7498 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:07.849016  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:07.849705  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:07.763960  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:07.744937  1633 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:07.855532  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:07.720890  7427 consensus_queue.cc:237] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:07.868779  1736 raft_consensus.cc:1275] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:03:07.870374  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 125972us
I20260709 13:03:07.871551  1633 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:07.873268  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 106080us
I20260709 13:03:07.877518  1587 raft_consensus.cc:1275] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:03:07.891690  1633 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:07.894956  2552 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
W20260709 13:03:07.753261  7617 log.cc:927] Time spent T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.075s	user 0.002s	sys 0.000s
I20260709 13:03:07.897554  2550 raft_consensus.cc:1275] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:03:07.907078  1555 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:07.927775  1737 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 19.
I20260709 13:03:07.755553  7273 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:07.751765  7529 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:07.750442  7475 consensus_queue.cc:1059] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.173s
I20260709 13:03:07.898341  7501 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.874986  7526 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:07.932731  1633 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:07.750401  7568 consensus_queue.cc:1059] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.181s
I20260709 13:03:07.942951   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:07.914920  7373 raft_consensus.cc:2804] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:07.911881  7594 raft_consensus.cc:2749] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:07.933890  1740 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:07.923281  1741 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:07.928970  7426 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:07.994398  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 61249.1us
I20260709 13:03:07.772042  7468 consensus_queue.cc:1059] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.160s
I20260709 13:03:07.897516  7609 consensus_queue.cc:1048] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.075s
I20260709 13:03:07.964272  7590 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.995301  1633 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:08.001579  7478 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.003017  7468 raft_consensus.cc:3055] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:08.002900  7478 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:08.003465  7468 raft_consensus.cc:740] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:08.004673  7468 consensus_queue.cc:260] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:07.931171  7498 consensus_queue.cc:1048] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.066s
I20260709 13:03:08.010612  1740 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:08.014951  1633 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:08.012005  1741 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:07.993523  7354 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:08.025408  1633 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:07.996387  7566 raft_consensus.cc:2749] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:08.001307  7373 raft_consensus.cc:697] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:07.979149  7501 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:08.028919  1633 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:08.013655  7568 raft_consensus.cc:2749] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:08.034252  1633 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:08.020960  7468 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:08.020747  7526 raft_consensus.cc:2749] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:08.006991  7425 consensus_queue.cc:1048] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:03:08.018112  7590 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:08.023631  7475 consensus_queue.cc:1059] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:03:08.033407  7426 consensus_queue.cc:1048] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
W20260709 13:03:08.061229  1739 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43686 (request call id 2636) took 1326 ms (client timeout 1711 ms). Trace:
I20260709 13:03:08.032326  7594 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:03:08.114091  1739 rpcz_store.cc:269] 0709 13:03:06.735195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.735329 (+   134us) service_pool.cc:224] Handling call
0709 13:03:08.059770 (+1324441us) spinlock_profiling.cc:243] Waited 80.6 ms on lock 0x7b54000ff5d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:03:08.061002 (+  1232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":185394944}
W20260709 13:03:08.096146  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 485991us
I20260709 13:03:08.124699  1705 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:08.051085  7566 raft_consensus.cc:2749] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:08.131534  7529 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:08.133606  1705 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:08.138393  1734 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43678 (request call id 4075) took 3307 ms (client timeout 2136 ms). Trace:
I20260709 13:03:08.139529  1586 raft_consensus.cc:1275] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:08.141484  7590 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:08.084447  7469 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:08.051812  7478 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:08.062953  7568 raft_consensus.cc:2749] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:08.146373  1734 rpcz_store.cc:269] 0709 13:03:04.830691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.830953 (+   262us) service_pool.cc:224] Handling call
0709 13:03:08.138109 (+3307156us) spinlock_profiling.cc:243] Waited 2.11 s on lock 0x7b54000c4c54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:03:08.138277 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4860259072}
I20260709 13:03:08.154045  1705 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:08.116199  7594 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:08.179847  1705 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:03:08.182451  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:08.170604  7587 consensus_meta.cc:287] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent flushing consensus metadata: real 0.647s	user 0.012s	sys 0.004s
I20260709 13:03:08.182318  7469 raft_consensus.cc:2749] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:08.147058  7501 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:08.102098  7373 consensus_queue.cc:237] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:08.171319  7621 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:08.186903  1705 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:08.177148  7594 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:03:08.201216  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 167038us
I20260709 13:03:08.208125  1633 leader_election.cc:400] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 13. Current term is 14.
W20260709 13:03:08.199510  7623 log.cc:927] Time spent T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:03:08.190162  7590 raft_consensus.cc:2749] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:03:08.199645  7627 log.cc:927] Time spent T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.186s	user 0.000s	sys 0.005s
I20260709 13:03:08.214257  1633 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:08.206471  7426 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:08.189869  7587 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:08.235189  7625 log.cc:927] Time spent T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:03:08.215396  7469 raft_consensus.cc:2804] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:08.244575  7475 consensus_queue.cc:1059] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:08.234079  7566 raft_consensus.cc:2749] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:08.246445  7426 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:08.261775  7565 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.013s	sys 0.023s
I20260709 13:03:08.252921  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:08.277017  1665 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 18.
I20260709 13:03:08.257062  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:08.257543  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:08.258795  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:08.278273  1662 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12.
I20260709 13:03:08.278445  1667 raft_consensus.cc:2468] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 8.
I20260709 13:03:08.270181  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:08.279335  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:08.273718  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:08.272013  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:08.275604  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:08.278318  1663 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15.
I20260709 13:03:08.285594  1664 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:08.287063  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:03:08.248375  7550 consensus_meta.cc:287] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent flushing consensus metadata: real 0.576s	user 0.014s	sys 0.001s
I20260709 13:03:08.285478  1734 raft_consensus.cc:1275] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:03:08.283975  1662 raft_consensus.cc:2468] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
I20260709 13:03:08.287895  1663 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:08.251228  7508 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:08.290408  1732 raft_consensus.cc:1240] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:03:08.295909  1660 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 13.
I20260709 13:03:08.263317  7469 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:08.293931  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:08.294026  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:08.303712  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:08.304299  1667 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:08.276644  7565 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.013s	sys 0.024s
I20260709 13:03:08.304278  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:08.307253  1665 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15.
I20260709 13:03:08.310834  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:08.294023  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:08.292234  1705 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:08.299886  1592 raft_consensus.cc:1240] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:03:08.299587  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:08.311548  1659 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 14.
I20260709 13:03:08.316658  1662 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 16.
I20260709 13:03:08.321610  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:08.322898  1665 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 22.
W20260709 13:03:08.324734  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.330621  1664 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 13.
I20260709 13:03:08.335763  1663 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 14.
I20260709 13:03:08.295660  7424 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:08.311523  7469 raft_consensus.cc:3060] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:08.337744  1667 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 16.
I20260709 13:03:08.319643  7545 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:08.324692  7427 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:08.311702  7475 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:08.345695  7424 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.327867  7527 raft_consensus.cc:2804] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:08.326220  1633 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:08.296531  7550 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:08.365159  1633 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:08.349033  2550 raft_consensus.cc:1240] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:08.352980  7427 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:08.381979  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 52411.3us
I20260709 13:03:08.363140  7527 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:08.384776  1705 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:08.387735  7465 consensus_queue.cc:1059] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:08.352094  7545 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:08.373152  7566 raft_consensus.cc:2749] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:08.355279  7475 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:08.369153  7628 raft_consensus.cc:2749] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:08.394520  1705 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:08.392328  7527 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:08.395789  7630 log.cc:927] Time spent T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:03:08.439915  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:08.441035  1592 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 15.
I20260709 13:03:08.441761  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:08.442426  6821 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:08.445317  6821 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:08.403676  7641 raft_consensus.cc:2804] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:08.404940  1633 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:08.368211  7424 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:08.412679  7475 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:08.413934  7545 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:08.418092  7426 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:08.418712  7587 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 15 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:08.419286  7508 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:08.423439  7427 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:08.412353  7550 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:08.430994  7562 raft_consensus.cc:3055] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:08.433898  7529 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:08.412446  7465 raft_consensus.cc:3055] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:03:08.467626  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 62785.6us
I20260709 13:03:08.476066  1633 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:08.477131  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:08.480393  7424 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:08.481374  7529 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:08.484002  7425 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:08.484758  7529 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:08.475308  7562 raft_consensus.cc:740] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:08.486913  1633 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:08.487381  7427 raft_consensus.cc:2749] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:08.487116  7562 consensus_queue.cc:260] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:08.488005  7427 consensus_queue.cc:1048] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:08.489585  7426 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:08.475421  7465 raft_consensus.cc:740] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:08.490347  7426 consensus_queue.cc:1048] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:08.490921  7465 consensus_queue.cc:260] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:08.473848  7565 raft_consensus.cc:2804] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:08.491981  7565 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:08.492354  7565 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:08.492671  7465 raft_consensus.cc:3060] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:08.471043  6821 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:08.438468  7594 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:08.488626  1633 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:08.497244  6821 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.488891  7562 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:08.500972  6821 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:08.503979  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:08.510468  1664 raft_consensus.cc:1275] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:03:08.513558  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:08.515874  1707 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:08.517570  1662 raft_consensus.cc:1240] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 13 LEADER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:08.518429  1663 raft_consensus.cc:1275] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:03:08.519145  1633 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:08.524632  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.526924  1633 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:08.534996  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:08.535607  1584 raft_consensus.cc:3055] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:08.536165  1584 raft_consensus.cc:740] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:08.537109  1659 raft_consensus.cc:1240] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:03:08.530932  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:08.528688  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:08.539427  1588 raft_consensus.cc:3055] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:08.539281  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:08.540074  1588 raft_consensus.cc:740] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:08.533522  6821 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:08.537673  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:08.539266  1666 raft_consensus.cc:1240] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 22. Current term is 23. Ops: []
I20260709 13:03:08.544747  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:08.545432  1739 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:08.548720  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:03:08.553467  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 159055us
I20260709 13:03:08.555372  1740 raft_consensus.cc:1275] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:08.556638  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:08.557864  1735 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:08.558805  1705 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:08.572875  1662 raft_consensus.cc:1240] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:08.577172  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:08.468801  7641 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:08.541391  1588 consensus_queue.cc:260] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:08.579265  1588 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:08.590906  1733 raft_consensus.cc:1240] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:08.591769  1741 raft_consensus.cc:1275] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:03:08.521064  7566 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:08.517580  7545 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:08.533624  7424 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:08.573581  1584 consensus_queue.cc:260] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:08.613510  1584 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:08.605898  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:08.616693  7636 raft_consensus.cc:2804] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:08.556949  7527 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:08.617195  7545 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:08.638816  7545 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:08.640275  7469 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:08.570338  7426 consensus_queue.cc:1059] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:03:08.619249  7566 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:08.645812  1664 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:08.646613  7594 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 23 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:08.618089  7638 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.583746  7641 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:08.650153  7638 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:08.521319  7550 consensus_queue.cc:1059] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 13:03:08.652654  7638 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:08.652722  7550 raft_consensus.cc:3055] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:08.673275  7550 raft_consensus.cc:740] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:08.538839  7427 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:08.674048  2426 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:08.575217  7628 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:08.635250  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:08.648984  7469 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:08.655555  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:08.658427  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:08.659163  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:08.691712  1583 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:08.692911  1664 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 13.
I20260709 13:03:08.693776  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:08.695603  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:08.572175  7526 raft_consensus.cc:2804] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:08.647707  1586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2536) took 1690 ms. Trace:
I20260709 13:03:08.639396  7545 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:08.671459  1589 raft_consensus.cc:1275] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:03:08.712472  1589 pending_rounds.cc:85] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91: Aborting all ops after (but not including) 9
I20260709 13:03:08.712702  1585 raft_consensus.cc:1275] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:03:08.712790  1589 pending_rounds.cc:107] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:03:08.713330  1589 raft_consensus.cc:2889] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:08.715520  1585 raft_consensus.cc:1275] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:08.716331  1589 raft_consensus.cc:1240] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:08.716583  1739 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:03:08.696059  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:08.697165  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:08.597817  1705 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:08.702653  1586 rpcz_store.cc:276] 0709 13:03:06.957248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.073386 (+116138us) service_pool.cc:224] Handling call
0709 13:03:07.073735 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:08.147191 (+1073456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:08.646368 (+499177us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54001d2ed4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:03:08.647627 (+  1259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2449995520}
I20260709 13:03:08.705271  1734 raft_consensus.cc:1240] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:08.706339  2426 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:08.707497  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:08.675568  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:08.718629  1738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43686 (request call id 2656) took 1064 ms. Trace:
I20260709 13:03:08.724324  1583 raft_consensus.cc:2468] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 15.
I20260709 13:03:08.730649  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:08.726799  7545 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:08.671166  7640 raft_consensus.cc:2804] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:08.702834  7526 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:08.759212  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:08.765997  1732 raft_consensus.cc:2410] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 18 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:03:08.735905  1738 rpcz_store.cc:276] 0709 13:03:07.654359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.662941 (+  8582us) service_pool.cc:224] Handling call
0709 13:03:08.718401 (+1055460us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b5400277254. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:03:08.718554 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54155136}
I20260709 13:03:08.750765  1741 raft_consensus.cc:1240] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:03:08.734529  1588 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 16.
I20260709 13:03:08.751274  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:08.749133  1660 raft_consensus.cc:1275] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:08.739485  2550 raft_consensus.cc:1240] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:08.745293  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:08.771730  1583 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 14.
W20260709 13:03:08.736752  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 176887us
I20260709 13:03:08.773680  1705 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:08.784268  1705 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:08.785286  1558 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:08.787544  1558 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:08.786993  6821 raft_consensus.cc:2804] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:08.788870  1705 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:08.789155  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:08.790943  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:03:08.794271  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:08.795050  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:08.795600  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.690946  7485 consensus_queue.cc:1048] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.061s
W20260709 13:03:08.837462  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 43701.7us
I20260709 13:03:08.783152  7629 raft_consensus.cc:3055] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:08.756593  7143 raft_consensus.cc:3055] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:03:08.840546  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.842342  6821 raft_consensus.cc:697] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 16 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:08.748202  7566 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:08.750522  7640 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:08.674150  7550 consensus_queue.cc:260] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:08.852249  7527 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:08.752759  7571 raft_consensus.cc:2749] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:08.856348  7545 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:08.783923  7526 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:08.738298  7391 raft_consensus.cc:2749] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:08.836339  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 48925.8us
I20260709 13:03:08.870882  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:08.867688  7143 raft_consensus.cc:740] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:08.872365  2550 raft_consensus.cc:1275] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:03:08.874040  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:08.926499  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:08.926994  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:08.710343  7628 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:08.849817  7426 consensus_queue.cc:1048] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:08.870586  6821 consensus_queue.cc:237] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:08.876480  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:08.878746  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:08.783322  7502 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.882208  1589 raft_consensus.cc:1240] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 14. Current term is 15. Ops: [12.7-14.8]
I20260709 13:03:08.884815  7640 raft_consensus.cc:3060] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:08.836566  7637 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:08.885654  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:08.858106  7629 raft_consensus.cc:740] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:08.889963  1633 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:08.857632  7373 raft_consensus.cc:2749] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:08.869175  7094 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.872212  1592 raft_consensus.cc:1240] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:03:08.932255  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:08.857827  7475 consensus_queue.cc:1059] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:03:08.883876  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:08.969841  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:08.858521  7508 consensus_queue.cc:1059] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:03:08.906913  7527 raft_consensus.cc:2804] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:03:09.014561  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 124694us
I20260709 13:03:08.902055  7635 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:09.030539  1588 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 13.
I20260709 13:03:09.019762  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:03:09.047377  2423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.076333  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:09.077028  1663 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
I20260709 13:03:08.939292  7550 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:08.905494  7468 consensus_queue.cc:1048] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.124s
I20260709 13:03:09.023473  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:09.095522  2537 raft_consensus.cc:2393] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 13: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:03:09.105425  7373 consensus_queue.cc:1059] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:09.079783  7094 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:09.111583  7094 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:09.112324  7094 consensus_queue.cc:1048] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:09.048321  7391 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:09.074409  7143 consensus_queue.cc:260] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:09.116137  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:09.145414  1662 raft_consensus.cc:1813] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Handling vote request from an unknown peer 6d4de2ce0683442498244b9529127f91
I20260709 13:03:09.117851  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:09.117991  1660 raft_consensus.cc:1275] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:03:09.146011  1662 raft_consensus.cc:2393] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 10: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:09.082484  7527 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:09.123227  7368 consensus_queue.cc:1048] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:09.120285  1663 raft_consensus.cc:1240] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:09.048688  7594 raft_consensus.cc:2749] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:09.075650  7635 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:09.127758  7607 consensus_queue.cc:1048] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 13:03:09.160842  7635 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:09.150111  7527 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:09.158839  7143 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:09.145707  7094 consensus_queue.cc:1243] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer 7e839e91a1314c2f9a99b25b17c916a6 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 13:03:09.063091  1735 consensus_meta.cc:287] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.505s	user 0.014s	sys 0.003s
I20260709 13:03:09.176877  1735 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
W20260709 13:03:09.139748  1584 consensus_meta.cc:287] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.525s	user 0.014s	sys 0.001s
I20260709 13:03:08.971714  7636 raft_consensus.cc:697] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 15 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:08.907078  7639 consensus_queue.cc:1059] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.175s
I20260709 13:03:09.157557  1664 raft_consensus.cc:1240] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:09.178586  1584 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 14.
I20260709 13:03:09.012704  7529 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:09.211705  1633 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
W20260709 13:03:09.213404  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 133920us
W20260709 13:03:09.217180  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 428355us
I20260709 13:03:09.224887  1705 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:09.181064  7594 raft_consensus.cc:3055] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:03:09.227762  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 458345us
W20260709 13:03:09.210583  7366 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.017s	sys 0.102s
I20260709 13:03:09.149444  7391 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:08.998185  7502 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:09.237977  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 451810us
I20260709 13:03:09.208086  7475 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.227732  7545 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:03:09.245126  7366 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.017s	sys 0.102s
I20260709 13:03:09.245636  7622 raft_consensus.cc:2804] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:09.259162  2426 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:03:09.264586  7565 consensus_meta.cc:287] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.772s	user 0.017s	sys 0.000s
I20260709 13:03:09.239272  7594 raft_consensus.cc:740] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:09.211611  7529 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:09.296731  2550 raft_consensus.cc:3055] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:09.251554  7651 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:09.305792  2550 raft_consensus.cc:740] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
W20260709 13:03:09.301431  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 76685us
I20260709 13:03:09.275866  7545 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:03:09.294658  7562 consensus_meta.cc:287] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.776s	user 0.010s	sys 0.007s
I20260709 13:03:09.294070  7622 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:09.314764  2550 consensus_queue.cc:260] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:09.329684  1665 raft_consensus.cc:2410] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 13:03:09.273597  7475 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:09.334218  2552 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.000s	sys 0.016s
W20260709 13:03:09.338403  2552 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.000s	sys 0.018s
I20260709 13:03:09.313180  1705 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:09.337919  2550 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:09.335170  6821 raft_consensus.cc:3055] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:09.340462  6821 raft_consensus.cc:740] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:09.322089  7545 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:09.349522  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:09.364996  1734 raft_consensus.cc:1275] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:09.365118  1741 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 17.
I20260709 13:03:09.361388  6821 consensus_queue.cc:260] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:09.302505  7565 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:09.335407  7622 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:09.363641  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 242446us
I20260709 13:03:09.293596  7636 consensus_queue.cc:237] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:09.385651  2424 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:09.347010  7587 raft_consensus.cc:2804] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:03:09.372776  7642 log.cc:927] Time spent T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.093s	user 0.000s	sys 0.003s
I20260709 13:03:09.336380  7590 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:09.342521  7571 consensus_queue.cc:1048] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:03:09.315727  7651 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:09.386906  7656 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:09.343073  7653 consensus_queue.cc:1048] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:03:09.390389  7508 raft_consensus.cc:2804] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:03:09.412528  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 153460us
I20260709 13:03:09.366505  7594 consensus_queue.cc:260] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:09.428133  7465 consensus_meta.cc:287] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.918s	user 0.017s	sys 0.000s
I20260709 13:03:09.414422  7656 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:09.450412  7391 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:09.451656  7469 raft_consensus.cc:3055] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:09.452350  7565 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:09.455578  7629 consensus_queue.cc:260] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:09.452240  7469 raft_consensus.cc:740] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
W20260709 13:03:09.467423  7650 log.cc:927] Time spent T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:03:09.475131  7529 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:09.471562  7587 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:09.502461  7587 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:09.475265  7644 log.cc:927] Time spent T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.199s	user 0.000s	sys 0.002s
I20260709 13:03:09.485090  7594 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:09.472601  7654 raft_consensus.cc:2749] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:09.475096  7641 consensus_meta.cc:287] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.825s	user 0.015s	sys 0.000s
I20260709 13:03:09.438305  7502 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:03:09.476549  7647 log.cc:927] Time spent T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.168s	user 0.002s	sys 0.002s
I20260709 13:03:09.408113  7590 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:09.487462  7629 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:09.525781  7641 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:09.525514  7637 consensus_meta.cc:287] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.513s	user 0.016s	sys 0.005s
I20260709 13:03:09.536625  7641 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:09.536852  7640 consensus_meta.cc:287] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.519s	user 0.016s	sys 0.002s
I20260709 13:03:09.540896  7640 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:09.544189  7640 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:09.534055  7637 raft_consensus.cc:2749] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:09.594342  1555 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.004s	sys 0.008s
W20260709 13:03:09.595299  1555 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.004s	sys 0.008s
W20260709 13:03:09.595839  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 648414us
W20260709 13:03:09.597470  1556 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.004s	sys 0.006s
W20260709 13:03:09.598043  1556 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.004s	sys 0.006s
W20260709 13:03:09.598510  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 700117us
W20260709 13:03:09.606494  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:09.609485  1558 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.003s	sys 0.006s
W20260709 13:03:09.610930  1558 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.004s	sys 0.007s
W20260709 13:03:09.611681  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 704677us
W20260709 13:03:09.629789  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.632058  1658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58814 (request call id 1009) took 1118 ms. Trace:
I20260709 13:03:09.633812  1667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58814 (request call id 1000) took 1127 ms. Trace:
I20260709 13:03:09.604635  1585 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 13.
W20260709 13:03:09.499574  7427 consensus_meta.cc:287] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.800s	user 0.012s	sys 0.003s
I20260709 13:03:09.677306  7651 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:09.678468  7628 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:09.679234  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 286488us
I20260709 13:03:09.679786  7502 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:09.683176  7529 raft_consensus.cc:2804] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:09.676714  7640 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:09.518133  7508 raft_consensus.cc:697] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:09.699970  7659 consensus_queue.cc:1048] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 13:03:09.715374  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:09.716853  2550 raft_consensus.cc:1275] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:03:09.717943  7527 consensus_meta.cc:287] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.552s	user 0.013s	sys 0.006s
W20260709 13:03:09.718783  7485 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:03:09.677451  7562 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.538322  7635 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:09.726300  7562 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:09.678215  7427 raft_consensus.cc:2749] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:09.712698  7641 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.656423  1667 rpcz_store.cc:276] 0709 13:03:08.506513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.507044 (+   531us) service_pool.cc:224] Handling call
0709 13:03:08.507369 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:08.507819 (+   450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:08.507845 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:08.523200 (+ 15355us) log.cc:844] Serialized 26 byte log entry
0709 13:03:09.030141 (+506941us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:09.030188 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.031054 (+   866us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:09.633159 (+602105us) raft_consensus.cc:1685] finished
0709 13:03:09.633225 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:09.633590 (+   365us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16040,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":12953,"thread_start_us":418710,"threads_started":1,"wal-append.queue_time_us":673291}
I20260709 13:03:09.717348  7502 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:09.701058  7660 consensus_queue.cc:1048] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
W20260709 13:03:09.734401  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 383946us
I20260709 13:03:09.736238  1705 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:09.747766  7640 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:09.656236  1658 rpcz_store.cc:276] 0709 13:03:08.513187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.513307 (+   120us) service_pool.cc:224] Handling call
0709 13:03:08.538175 (+ 24868us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:08.538374 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:03:08.964431 (+426057us) log.cc:844] Serialized 14 byte log entry
0709 13:03:09.631056 (+666625us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:09.631187 (+   131us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:03:09.631355 (+   168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.631509 (+   154us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:09.631759 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":292772,"prepare.queue_time_us":695050,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":327896,"raft.run_cpu_time_us":817,"raft.run_wall_time_us":38185,"thread_start_us":725200,"threads_started":2,"wal-append.queue_time_us":448682}
I20260709 13:03:09.761756  7143 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:09.762791  7143 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:09.694065  7529 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:09.739197  7427 consensus_queue.cc:1048] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:03:09.720577  7654 consensus_queue.cc:1059] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:03:09.778863  7529 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:09.793759  7637 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:09.794345  7637 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.795980  7637 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:09.699852  7426 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:09.801774  7426 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:09.786754  1587 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.007s	sys 0.019s
I20260709 13:03:09.790231  6821 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:09.791726  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 55847.4us
I20260709 13:03:09.782554  7562 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:09.752292  7640 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:09.718782  7527 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:09.799165  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:09.800053  7671 raft_consensus.cc:3055] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:03:09.815716  1587 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.008s	sys 0.020s
I20260709 13:03:09.731292  7641 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:09.817929  1705 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:09.815300  7671 raft_consensus.cc:740] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:09.833596  7651 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:09.822095  7640 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:09.834170  7651 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.834568  7651 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:09.834954  7640 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:09.841019  7635 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:09.843700  7641 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:09.819316  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 199476us
I20260709 13:03:09.852661  7640 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:09.869230  1665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39146 (request call id 4117) took 1313 ms. Trace:
I20260709 13:03:09.870234  7527 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:09.869496  1705 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:09.870003  1665 rpcz_store.cc:276] 0709 13:03:08.537262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.537452 (+   190us) service_pool.cc:224] Handling call
0709 13:03:09.812048 (+1274596us) spinlock_profiling.cc:243] Waited 787 ms on lock 0x7b540019dcd4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:03:09.850165 (+ 38117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1809658752}
I20260709 13:03:09.871232  7658 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:09.892951  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 59835.7us
I20260709 13:03:09.877665  7475 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:09.878597  7502 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:09.901499  7640 raft_consensus.cc:2804] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:09.903119  7640 raft_consensus.cc:697] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 14 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:09.879797  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:09.907166  7469 consensus_queue.cc:260] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:09.910184  7658 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:09.590865   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:09.917694  7590 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:09.917630  7640 consensus_queue.cc:237] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:09.921132  1587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46836 (request call id 845) took 1264 ms. Trace:
I20260709 13:03:09.921599  1587 rpcz_store.cc:276] 0709 13:03:08.656625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.658086 (+  1461us) service_pool.cc:224] Handling call
0709 13:03:08.658402 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:08.658776 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:08.658804 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:08.659356 (+   552us) log.cc:844] Serialized 26 byte log entry
0709 13:03:09.141648 (+482292us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:03:09.855821 (+714173us) log.cc:844] Serialized 14 byte log entry
0709 13:03:09.919918 (+ 64097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.920036 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:09.920101 (+    65us) raft_consensus.cc:1685] finished
0709 13:03:09.920111 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:09.921010 (+   899us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20824,"prepare.queue_time_us":614678,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":71,"raft.queue_time_us":13298,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":17083,"thread_start_us":1152050,"threads_started":2,"wal-append.queue_time_us":578073}
I20260709 13:03:09.931607  2537 pending_rounds.cc:85] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6: Aborting all ops after (but not including) 10
I20260709 13:03:09.932126  2537 pending_rounds.cc:107] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:03:09.932513  2537 raft_consensus.cc:2889] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:09.882495  7426 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:09.831909  7671 consensus_queue.cc:260] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:09.933427  1705 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:09.932610  7469 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:09.873188  7143 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:09.942849  7656 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:03:09.945914  7622 consensus_meta.cc:287] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.554s	user 0.014s	sys 0.012s
I20260709 13:03:09.969692  1735 raft_consensus.cc:1240] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 15 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 14. Current term is 15. Ops: [14.8-14.8]
W20260709 13:03:09.979674  7650 log.cc:927] Time spent T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.086s	user 0.000s	sys 0.008s
W20260709 13:03:09.985352  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 52067.9us
I20260709 13:03:09.989395  1705 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:09.990649  7590 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:03:09.989440  2424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.892524  7508 consensus_queue.cc:237] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:10.034327  7475 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:10.035668  7475 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:10.036607  7545 consensus_meta.cc:287] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.636s	user 0.013s	sys 0.016s
I20260709 13:03:10.038733  7426 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:10.038990  7545 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:10.039598  7426 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:10.034929  1633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:10.043864  1633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.044349  7562 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:10.086090  7562 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:10.050644  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 61450.8us
I20260709 13:03:10.050470  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:10.090565  1740 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 17.
I20260709 13:03:10.090904  7527 consensus_queue.cc:1059] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:10.051798  7465 raft_consensus.cc:2804] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:10.092214  7465 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:10.052253  7590 raft_consensus.cc:697] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 16 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:10.046892  7143 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:10.093194  7641 raft_consensus.cc:3055] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:03:10.093886  7641 raft_consensus.cc:740] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:10.094164  7143 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:10.092782  7465 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:10.095875  7641 consensus_queue.cc:260] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:10.057411  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:10.067029  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:10.059906  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:10.069836  7475 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:10.075531  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:10.073724  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:10.075992  7427 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:10.098963  1734 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 13.
I20260709 13:03:10.099076  7427 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:10.098637  1738 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 14.
I20260709 13:03:10.103195  7143 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:10.104449  7669 consensus_queue.cc:1048] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:10.105199  7660 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:10.106191  7660 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:10.082937  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.094614  7590 consensus_queue.cc:237] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:10.104729  7143 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.018582  7671 raft_consensus.cc:3060] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:10.117537  7426 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:10.118620  7426 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.119186  7426 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:10.117555  1741 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 11.
I20260709 13:03:10.115494  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:10.114085  7475 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
W20260709 13:03:10.116346  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 48897.9us
W20260709 13:03:10.132409  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.977725  7622 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:10.142014  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:10.131309  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:10.151662  7637 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:10.133908  7656 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:10.153679  7674 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:10.154074  7656 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:10.154633  7674 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:10.155403  1486 catalog_manager.cc:5697] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 18 to 19, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 19 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:03:10.129005  7427 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:10.134387  7635 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:10.157492  7527 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:10.157891  7635 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:10.159340  7629 consensus_meta.cc:287] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.627s	user 0.010s	sys 0.010s
I20260709 13:03:10.135033  7658 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:10.159368  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.156802  7656 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:10.134460  7562 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:10.162827  7660 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:10.172031  7635 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:10.198047  7143 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:10.205549  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:10.227210  1659 raft_consensus.cc:2410] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:03:10.135882  7475 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:10.253784  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 183873us
I20260709 13:03:10.204387  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:10.148069  7651 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:10.215382  7527 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:10.231436  7426 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:10.265981  7587 consensus_meta.cc:287] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6: Time spent flushing consensus metadata: real 0.759s	user 0.015s	sys 0.015s
W20260709 13:03:10.267319  7679 log.cc:927] Time spent T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.068s	user 0.004s	sys 0.000s
I20260709 13:03:10.256644  7674 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:10.257718  7635 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:10.210597  7641 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:10.308491  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:03:10.274135  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.277819  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:03:10.232336  7526 consensus_meta.cc:287] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 1.306s	user 0.019s	sys 0.021s
I20260709 13:03:10.358207  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:10.358511  7526 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:10.264634  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:10.364024  1589 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 14.
I20260709 13:03:10.262830  1661 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 19.
W20260709 13:03:10.368184  1661 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39146 (request call id 4126) took 1780 ms (client timeout 2222 ms). Trace:
I20260709 13:03:10.317276  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:10.321681  7587 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:10.322743  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:10.270714  7465 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:10.330684  1558 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:10.331849  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:10.333129  7637 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:10.334913  7622 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:10.335745  1659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39146 (request call id 4147) took 1219 ms. Trace:
I20260709 13:03:10.336671  7475 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:03:10.336871  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:10.344022  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 88788.7us
W20260709 13:03:10.351262  7594 consensus_meta.cc:287] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.826s	user 0.010s	sys 0.012s
I20260709 13:03:10.353312  7143 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:10.291885  7545 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 23 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:10.273319  7658 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:10.355249  7529 consensus_meta.cc:287] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.562s	user 0.012s	sys 0.012s
I20260709 13:03:10.356746  2548 raft_consensus.cc:2468] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
W20260709 13:03:10.368717  1661 rpcz_store.cc:269] 0709 13:03:08.587264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.625734 (+ 38470us) service_pool.cc:224] Handling call
0709 13:03:10.367953 (+1742219us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540041d7d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:03:10.368118 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2390796032}
W20260709 13:03:10.390986  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.328809  7427 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.369517  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:10.415668  1659 rpcz_store.cc:276] 0709 13:03:09.116717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.117573 (+   856us) service_pool.cc:224] Handling call
0709 13:03:10.335363 (+1217790us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540040ddd4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:03:10.335691 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2338540800}
I20260709 13:03:10.437808  2543 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
I20260709 13:03:10.451184  7622 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
W20260709 13:03:10.454474  1487 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55132 (request call id 308) took 23884 ms (client timeout 15000 ms). Trace:
I20260709 13:03:10.453936  7622 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:10.453914  7636 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.458777  7636 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:10.438625  7529 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:10.463667  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 133250us
I20260709 13:03:10.461407  7594 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:10.453997  7427 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:10.428318  7660 raft_consensus.cc:2804] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:10.454859  1486 catalog_manager.cc:5697] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:03:10.461495  1704 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:10.484885  7637 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:10.486140  7637 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:10.444326  7143 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.493316  1583 raft_consensus.cc:2393] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 19: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:10.493794  7143 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:10.495657  7636 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:10.496963  1630 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:10.427062  7635 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:10.496625  1556 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:10.484076  1486 catalog_manager.cc:5697] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:10.496729  7143 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:10.464881  7594 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:10.475791  7660 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:10.497807  7427 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:10.502017  1633 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:10.492957  7637 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:10.512792  7691 log.cc:927] Time spent T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:03:10.515000  1558 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:10.499640  7426 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:10.517338  6821 raft_consensus.cc:2749] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:10.476121  7629 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:10.513185  7545 raft_consensus.cc:2804] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:10.542770  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:10.509495  7622 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:10.557924  7545 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.568411  7465 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:10.569123  7527 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:03:10.570273  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 93268.3us
I20260709 13:03:10.571044  7426 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:10.523402  7658 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:10.526481  7660 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:10.573498  7656 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.576215  7651 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:10.576884  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:10.577523  7590 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.576215  7637 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:03:10.581393  7682 log.cc:927] Time spent T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.059s	user 0.000s	sys 0.003s
I20260709 13:03:10.583103  7688 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
W20260709 13:03:10.583161  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 86805.3us
I20260709 13:03:10.576916  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:10.588511  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:10.564924  2543 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
W20260709 13:03:10.591478  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 95127.4us
W20260709 13:03:10.593736  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 56313us
I20260709 13:03:10.618536  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:10.560317  7475 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.590983  7545 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:10.537175  7636 raft_consensus.cc:2804] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:10.543092  7143 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:10.630877  7658 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:10.630697  1486 catalog_manager.cc:5697] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 9 to 10, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 10 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:03:10.598517  7427 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:10.634493  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:10.608691  7529 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:10.587550  7629 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:10.644062  1633 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:10.651516  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.635031  7526 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:10.659835  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 151482us
W20260709 13:03:10.455129  1487 rpcz_store.cc:269] 0709 13:02:46.524836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.529227 (+  4391us) service_pool.cc:224] Handling call
0709 13:03:10.387747 (+23858520us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:00.513464 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:00.667374 (+153910us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:00.667431 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:03:00.668792 (+  1361us) tablet.cc:662] Decoding operations
0709 13:03:00.702801 (+ 34009us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:00.702923 (+   122us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:00.702953 (+    30us) tablet.cc:685] Acquiring locks for 25 operations
0709 13:03:00.721262 (+ 18309us) tablet.cc:701] Row locks acquired
0709 13:03:00.721320 (+    58us) write_op.cc:260] PREPARE: finished
0709 13:03:00.721529 (+   209us) write_op.cc:270] Start()
0709 13:03:00.721696 (+   167us) write_op.cc:276] Timestamp: P: 1783602180721447 usec, L: 0
0709 13:03:00.721738 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 13:03:00.894931 (+173193us) log.cc:844] Serialized 9825 byte log entry
0709 13:03:01.917686 (+1022755us) op_driver.cc:464] REPLICATION: finished
0709 13:03:02.402196 (+484510us) write_op.cc:301] APPLY: starting
0709 13:03:02.421631 (+ 19435us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:02.962027 (+540396us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:02.965290 (+  3263us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:03.275846 (+310556us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:03.276272 (+   426us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=50,mrs_lookups=0
0709 13:03:03.276342 (+    70us) write_op.cc:312] APPLY: finished
0709 13:03:03.276916 (+   574us) log.cc:844] Serialized 220 byte log entry
0709 13:03:03.394378 (+117462us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:03.394649 (+   271us) write_op.cc:454] Released schema lock
0709 13:03:03.394755 (+   106us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:03.505503 (+110748us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:03.507819 (+  2316us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1225253,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":445368,"apply.run_cpu_time_us":54350,"apply.run_wall_time_us":1035710,"cfile_cache_hit":102,"cfile_cache_hit_bytes":108627,"num_ops":25,"prepare.queue_time_us":116261,"prepare.run_cpu_time_us":33964,"prepare.run_wall_time_us":821360,"raft.queue_time_us":436687,"raft.run_cpu_time_us":25467,"raft.run_wall_time_us":340054,"replication_time_us":1195734,"thread_start_us":1091310,"threads_started":5,"wal-append.queue_time_us":524709,"wal-append.run_cpu_time_us":31100,"wal-append.run_wall_time_us":2520717}]]}
I20260709 13:03:10.633945  7636 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:10.659860  1704 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:10.673054  7562 raft_consensus.cc:2749] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:10.645562  7656 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:10.671700  7636 raft_consensus.cc:3060] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:10.637354  7475 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:10.694398  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:10.695035  6821 consensus_queue.cc:1048] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:10.695549  1739 raft_consensus.cc:1240] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:10.695932  7094 raft_consensus.cc:2749] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:10.696108  7562 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:03:10.694027  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 75149.3us
I20260709 13:03:10.693168  1486 catalog_manager.cc:5697] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 11 to 15, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 15 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:10.710551  2543 raft_consensus.cc:1240] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:10.651573  7590 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:10.715530  7695 log.cc:927] Time spent T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:03:10.716218  7700 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.716688  7687 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.716066  7562 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:10.777819  7687 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:10.778781  7628 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:10.779336  7562 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:10.704591  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:03:10.779455  7628 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:10.722151  7526 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.780472  7687 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:10.728456  7475 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:10.781128  7526 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:10.783965  7700 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:10.784428  1486 catalog_manager.cc:5697] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 9 to 11, leader changed from 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 11 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:10.729387  1584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46836 (request call id 852) took 1118 ms. Trace:
I20260709 13:03:10.789239  1584 rpcz_store.cc:276] 0709 13:03:09.611930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.612330 (+   400us) service_pool.cc:224] Handling call
0709 13:03:09.617907 (+  5577us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:09.811150 (+193243us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:03:09.859980 (+ 48830us) log.cc:844] Serialized 14 byte log entry
0709 13:03:10.297276 (+437296us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:10.309809 (+ 12533us) log.cc:844] Serialized 26 byte log entry
0709 13:03:10.309987 (+   178us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:10.310251 (+   264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:10.310336 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:10.728917 (+418581us) raft_consensus.cc:1685] finished
0709 13:03:10.728949 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:10.729169 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42185,"prepare.queue_time_us":10204,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":120039,"raft.run_cpu_time_us":1007,"raft.run_wall_time_us":122706,"thread_start_us":444380,"threads_started":2,"wal-append.queue_time_us":489843}
I20260709 13:03:10.731146  7656 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:10.732978  7629 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:10.734067  7635 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:10.737716  7426 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:10.687709  7587 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 16 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:10.692003  7527 raft_consensus.cc:2804] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:10.793663  7527 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:10.794198  7527 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:10.710666  1558 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:10.670990  7637 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:10.799341  7590 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:10.799726  7637 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:10.805751  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 113264us
I20260709 13:03:10.807910  1558 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:10.811406  6821 raft_consensus.cc:2804] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:10.811990  6821 raft_consensus.cc:697] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:10.677604  7143 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:10.671739  7688 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:10.818331  1734 raft_consensus.cc:2468] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 13.
I20260709 13:03:10.809803  7094 raft_consensus.cc:2749] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:03:10.760922  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 49245.9us
W20260709 13:03:10.818564  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:10.825410  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.818820  7526 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:10.775404  7674 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:10.828671  7674 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:10.832540  7674 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:03:10.820097  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 204758us
I20260709 13:03:10.833992  1633 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:10.834403  7527 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:10.835795  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:10.836972  7706 raft_consensus.cc:2749] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:10.836860  1633 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:10.787246  1486 catalog_manager.cc:5697] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:03:10.846478  7710 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:10.817757  6821 consensus_queue.cc:237] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:10.770704  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 129996us
I20260709 13:03:10.869048  2552 raft_consensus.cc:1240] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 LEADER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:10.849134  1633 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:10.875469  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 155699us
I20260709 13:03:10.876616  1556 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:03:10.884094  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 79893.1us
I20260709 13:03:10.891360  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:03:10.874243  7527 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:10.895412  1738 raft_consensus.cc:2468] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 9.
I20260709 13:03:10.896819  7710 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.897642  7710 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:10.900085  7710 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:10.901178  7707 raft_consensus.cc:2749] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:10.901366  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 53845.7us
I20260709 13:03:10.903371  1633 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:10.904564  7427 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:10.906471  7688 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:10.907644  7641 consensus_meta.cc:287] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.569s	user 0.011s	sys 0.004s
I20260709 13:03:10.909863  7700 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:10.914965  7636 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:10.917975  1735 raft_consensus.cc:1240] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:10.922662  7708 consensus_queue.cc:1059] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:10.927210  7485 raft_consensus.cc:3055] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:10.927896  7485 raft_consensus.cc:740] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:10.917570  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:10.872642  7143 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:10.849908  7594 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:10.917749  7628 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:10.894359  7465 consensus_queue.cc:1059] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:03:10.892418  7674 consensus_queue.cc:1048] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.058s
W20260709 13:03:10.950587  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 52332.2us
I20260709 13:03:10.951443  7674 consensus_queue.cc:1243] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer 5ced62816f8545cd9b63a27e9055e42d log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:03:10.955113  7700 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.955865  7700 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:10.933838  7688 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:10.957438  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:10.957813  7688 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:10.959079  2552 raft_consensus.cc:2410] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:03:10.962956  2426 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:10.950608  7465 consensus_queue.cc:1243] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer 7e839e91a1314c2f9a99b25b17c916a6 log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
W20260709 13:03:10.983310  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 106858us
I20260709 13:03:10.983649  7674 raft_consensus.cc:2804] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:10.988338  7674 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:10.879776  7651 consensus_queue.cc:1059] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.082s
I20260709 13:03:10.960729  7688 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:10.988761  7674 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:11.007772  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 191986us
I20260709 13:03:11.001564  7700 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:11.034597  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 113540us
I20260709 13:03:11.019434  2540 raft_consensus.cc:2393] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 13: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:03:11.041698  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:11.045948  7715 consensus_queue.cc:1048] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
W20260709 13:03:11.049412  7718 log.cc:927] Time spent T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.056s	user 0.000s	sys 0.002s
I20260709 13:03:11.054617  1558 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:03:11.055583  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.068030  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:11.069989  1585 raft_consensus.cc:1275] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:03:11.071328  7485 consensus_queue.cc:260] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:11.073376  7485 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:11.074905  7674 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:11.056751  1665 raft_consensus.cc:2376] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 13. Re-sending same reply.
I20260709 13:03:11.079816  7715 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:11.084872  1556 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:11.085245  7094 consensus_queue.cc:1059] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:11.089224  7658 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:11.091187  7636 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:11.080717  7708 raft_consensus.cc:2804] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:11.094591  1584 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:11.092609  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:03:11.097343  1633 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:11.103477  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 74815.3us
I20260709 13:03:11.127597  1584 raft_consensus.cc:2468] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 16.
W20260709 13:03:11.132006  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 47249.1us
I20260709 13:03:11.138749  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:11.139688  1735 raft_consensus.cc:2376] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 9. Re-sending same reply.
I20260709 13:03:11.142005  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:11.143905  7688 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:03:11.145393  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:11.150206  7708 raft_consensus.cc:697] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:11.110008  7465 raft_consensus.cc:3055] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:11.151412  7465 raft_consensus.cc:740] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:11.151899  7708 consensus_queue.cc:237] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:11.127636  7527 raft_consensus.cc:3055] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:11.154253  7527 raft_consensus.cc:740] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:11.155198  7527 consensus_queue.cc:260] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:11.156486  7527 raft_consensus.cc:3060] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:11.097041  7660 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:11.159721  1585 raft_consensus.cc:1240] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 13. Current term is 14. Ops: []
W20260709 13:03:11.163151  2424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.171512  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:03:11.172508  7674 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:11.152462  7465 consensus_queue.cc:260] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:11.186491  1556 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:11.159330  7660 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:11.181533  7671 consensus_queue.cc:1048] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 13:03:11.195986  7724 raft_consensus.cc:2749] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:11.194483  2426 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:11.209288  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:03:11.211158  7508 raft_consensus.cc:2804] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:11.211827  7508 raft_consensus.cc:697] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:11.212790  7508 consensus_queue.cc:237] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:11.214205  7715 raft_consensus.cc:3055] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:11.214937  7715 raft_consensus.cc:740] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:11.221617  2543 raft_consensus.cc:2468] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
I20260709 13:03:11.223193  2548 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
I20260709 13:03:11.233723  2426 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:03:11.237412  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 99326.7us
I20260709 13:03:11.230621  1704 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:11.226711  2424 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:11.241832  1558 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:11.244175  1587 raft_consensus.cc:1240] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:11.245014  1704 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:03:11.231024  7545 consensus_meta.cc:287] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.577s	user 0.014s	sys 0.002s
I20260709 13:03:11.257416  7715 consensus_queue.cc:260] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:11.259275  7715 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:11.259826  7658 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:11.240028  7094 consensus_queue.cc:1048] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:03:11.253691  7651 raft_consensus.cc:2804] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:11.252699  7705 raft_consensus.cc:2804] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:11.252847  7700 raft_consensus.cc:2804] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:11.244171  7465 raft_consensus.cc:3060] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:11.269707  7660 raft_consensus.cc:2804] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:03:11.271219  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.271852  1734 raft_consensus.cc:1275] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 13:03:11.272138  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:11.272846  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:03:11.273329  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 186312us
I20260709 13:03:11.273582  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:11.276367  1658 raft_consensus.cc:1275] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 13:03:11.277582  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:11.277910  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:11.278692  7545 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:11.284919  7696 consensus_queue.cc:1059] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:11.298158  1734 pending_rounds.cc:85] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 12
I20260709 13:03:11.303352  1734 pending_rounds.cc:107] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:03:11.304931  1734 raft_consensus.cc:2889] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:11.298623  1665 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 14.
I20260709 13:03:11.300801  1667 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16.
I20260709 13:03:11.299580  1658 pending_rounds.cc:85] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 7
I20260709 13:03:11.314050  1658 pending_rounds.cc:107] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 13:03:11.314410  1658 raft_consensus.cc:2889] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:11.317906  1664 raft_consensus.cc:2393] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 23: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:11.316859  1659 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
W20260709 13:03:11.330871  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:11.342744  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.346235  7674 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:11.296792  7651 raft_consensus.cc:697] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 10 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
W20260709 13:03:11.352974  7720 log.cc:927] Time spent T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.122s	user 0.000s	sys 0.002s
I20260709 13:03:11.316614  7700 raft_consensus.cc:697] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 11 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:11.353250  7702 consensus_queue.cc:1059] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:03:11.314271  7705 raft_consensus.cc:697] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
W20260709 13:03:11.355038  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 138698us
I20260709 13:03:11.364626  1667 raft_consensus.cc:1240] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 22. Current term is 23. Ops: []
I20260709 13:03:11.365334  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:11.369395  7587 raft_consensus.cc:2804] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:11.347919  7674 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:11.314827  7660 raft_consensus.cc:697] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:03:11.384528  7716 log.cc:927] Time spent T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:03:11.387229  1633 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:03:11.388567  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 94807.2us
I20260709 13:03:11.389055  7707 raft_consensus.cc:2764] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:03:11.390799  1633 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:11.392373  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:11.393975  7594 raft_consensus.cc:2804] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:11.394556  7594 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:11.394194  7660 consensus_queue.cc:237] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:11.394984  7594 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:11.395164  1735 raft_consensus.cc:1240] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:11.397022  7545 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:11.398680  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:03:11.399363  2540 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:11.402261  7587 raft_consensus.cc:697] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:11.403801  7587 consensus_queue.cc:237] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:11.407498  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:11.408272  7670 raft_consensus.cc:3055] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:11.408685  7594 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:11.408928  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:11.411755  1735 raft_consensus.cc:2410] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:03:11.411795  7594 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:11.413539  7636 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.414146  7636 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:11.417361  7636 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:11.419889  7527 consensus_queue.cc:1048] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:11.413298  7674 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:11.422052  7641 consensus_queue.cc:1059] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:11.423180  7651 consensus_queue.cc:237] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:11.446725  7700 consensus_queue.cc:237] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:11.424171  7637 raft_consensus.cc:3055] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:11.448848  7637 raft_consensus.cc:740] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:11.450548  7637 consensus_queue.cc:260] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:11.451881  7729 log.cc:927] Time spent T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.094s	user 0.000s	sys 0.002s
I20260709 13:03:11.452037  7637 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:11.446743  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 64796.1us
I20260709 13:03:11.453689  7705 consensus_queue.cc:237] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:11.427758  1707 leader_election.cc:336] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.567s (SENT)
I20260709 13:03:11.393010  1633 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:11.436324  7702 raft_consensus.cc:3055] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:11.442873  1556 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:11.443316  7674 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.372390  7669 consensus_queue.cc:1059] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.073s
I20260709 13:03:11.474311  1556 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:03:11.473160  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 80255.5us
I20260709 13:03:11.485780  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:03:11.487102  7719 raft_consensus.cc:2804] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:11.408885  7670 raft_consensus.cc:740] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:11.496541  1556 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:11.494163  1707 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:11.505697  1738 raft_consensus.cc:1240] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:11.494160  1633 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:11.509321  1735 raft_consensus.cc:1275] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:03:11.511693  1739 raft_consensus.cc:1240] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:03:11.473160  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:11.473320  7702 raft_consensus.cc:740] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:11.517380  6821 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:11.517884  6821 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.518252  6821 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:11.493294  7725 log.cc:927] Time spent T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.138s	user 0.006s	sys 0.000s
I20260709 13:03:11.519338  1556 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:11.520287  1587 raft_consensus.cc:1240] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:11.489238  7688 raft_consensus.cc:2804] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:11.525290  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:11.497879  7719 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:11.541251  1737 raft_consensus.cc:1240] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:03:11.547966  1734 raft_consensus.cc:2410] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
W20260709 13:03:11.551823  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.556335  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:11.546277  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:11.543530  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:11.526023  7594 raft_consensus.cc:2749] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:11.580876  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:11.525395  7688 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.524787  7502 raft_consensus.cc:2804] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:11.587361  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:11.539139  7724 raft_consensus.cc:2749] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:11.581739  1556 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:11.589944  1734 raft_consensus.cc:1275] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:03:11.538704  7713 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.599455  7713 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:11.513641  7674 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:11.555754  7719 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:11.602667  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 251580us
I20260709 13:03:11.628719  2540 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 11.
I20260709 13:03:11.631145  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:11.581454  7636 raft_consensus.cc:2749] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:11.639225  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:03:11.633787  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 206089us
I20260709 13:03:11.592237  7708 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:11.637219  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:11.656724  1741 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 23.
I20260709 13:03:11.589661  7502 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.657821  7502 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:11.602661  7688 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:11.568351  7703 consensus_queue.cc:1048] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:03:11.632902  6821 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:11.672605  1633 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:11.673213  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:11.676128  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:11.677065  1589 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15.
I20260709 13:03:11.645974  7670 consensus_queue.cc:260] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:11.681717  7722 log.cc:927] Time spent T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.098s	user 0.000s	sys 0.002s
I20260709 13:03:11.684466  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:11.693149  6821 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:11.675382  7731 log.cc:927] Time spent T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.168s	user 0.002s	sys 0.000s
I20260709 13:03:11.696333  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:11.637477  7658 consensus_queue.cc:1059] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.053s
W20260709 13:03:11.724473  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.691367  7696 raft_consensus.cc:3055] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:03:11.761389  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 189673us
I20260709 13:03:11.692633  7594 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:11.764220  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:11.628628  7702 consensus_queue.cc:260] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:11.766976  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:11.670190  7708 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:11.775801  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 151788us
I20260709 13:03:11.784404  1741 raft_consensus.cc:1240] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:11.790230  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:11.766727  7594 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:11.765690  7696 raft_consensus.cc:740] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:11.762130  7143 consensus_queue.cc:1048] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
W20260709 13:03:11.804657  1705 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.703s (SENT) [suppressed 16 similar messages]
I20260709 13:03:11.804741  1666 raft_consensus.cc:1240] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:11.805956  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:11.832811  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:11.834867  1732 raft_consensus.cc:1240] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 11. Current term is 12. Ops: []
W20260709 13:03:11.836323  7735 log.cc:927] Time spent T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:03:11.842403  7702 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:11.843250  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:11.843967  1585 raft_consensus.cc:2368] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 16. Current term is 17.
I20260709 13:03:11.845902  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:11.846035  1586 raft_consensus.cc:1275] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:11.847519  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:11.848838  1591 raft_consensus.cc:1275] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:03:11.848795  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:11.850106  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:11.851611  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:11.852916  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:11.855291  1732 raft_consensus.cc:1240] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:11.856164  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:11.856634  1732 raft_consensus.cc:1240] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:11.856096  1737 raft_consensus.cc:2393] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 13: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:03:11.857894  1734 pending_rounds.cc:85] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 8
I20260709 13:03:11.853150  7696 consensus_queue.cc:260] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:11.858203  1734 pending_rounds.cc:107] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:03:11.858541  1734 raft_consensus.cc:2889] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:11.805516  7594 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:11.847831  7502 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:11.876681  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.890938  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:11.896638  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:11.897611  7715 raft_consensus.cc:3055] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:03:11.898028  7715 raft_consensus.cc:740] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:11.898358  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:11.899024  1662 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:03:11.898849  7715 consensus_queue.cc:260] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:11.896713  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:11.901835  1660 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:11.891374  7711 raft_consensus.cc:2749] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:11.917460  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:11.922398  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:11.924837  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:03:11.951546  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.974200  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:11.976336  1589 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
I20260709 13:03:11.977921  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:11.985965  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:11.981655  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:03:11.974186  7737 log.cc:927] Time spent T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.144s	user 0.000s	sys 0.003s
I20260709 13:03:11.991235  1588 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 14.
I20260709 13:03:11.996253  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:03:12.007238  7637 consensus_meta.cc:287] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.555s	user 0.012s	sys 0.007s
I20260709 13:03:11.958771  7700 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.993305  1666 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 14.
I20260709 13:03:12.011351  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:11.986943  1592 raft_consensus.cc:2376] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 14. Re-sending same reply.
I20260709 13:03:11.987861  7713 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:11.988204  7715 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:03:12.018880  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.011970  1660 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
I20260709 13:03:11.968778  7669 consensus_queue.cc:1059] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 13:03:12.033959  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:12.036285  7708 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:12.042388  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 266113us
I20260709 13:03:12.057348  1592 raft_consensus.cc:1240] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:12.067780  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:12.069162  1739 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 13.
I20260709 13:03:12.078105  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:12.082453  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:12.088212  1556 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:12.091081  1633 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:12.093178  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:12.019912  7700 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:12.095788  1587 raft_consensus.cc:3060] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:12.059610  7671 consensus_queue.cc:1048] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:03:12.109890  1592 raft_consensus.cc:3060] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:12.112560  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:12.114255  1633 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:12.115283  1584 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15.
I20260709 13:03:12.115765  1633 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:12.122763  7747 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:12.128328  1664 raft_consensus.cc:1275] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:03:12.134438  7688 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:12.134912  7719 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:12.135723  1592 raft_consensus.cc:1275] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:03:12.137004  7688 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:12.137970  7719 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:12.138271  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 50408.6us
I20260709 13:03:12.111378  7713 raft_consensus.cc:2804] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:12.150332  1633 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:12.128194  7508 raft_consensus.cc:3055] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:12.152112  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:12.107540  7674 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:12.153134  7713 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.165496  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:12.165812  7713 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:12.142256  7707 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:12.166976  7707 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:12.167745  7707 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:12.170014  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:12.156155  1590 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15.
I20260709 13:03:12.154099  7508 raft_consensus.cc:740] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:12.178792  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:12.179538  1590 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 15.
I20260709 13:03:12.181896  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:12.183272  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:12.184003  1585 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 15.
I20260709 13:03:12.186496  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:12.186811  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:12.187060  7700 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:12.187885  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:12.187744  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:12.188297  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:12.188843  1737 raft_consensus.cc:2393] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 15: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:12.187765  1732 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 16.
I20260709 13:03:12.190258  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:12.192655  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:12.193536  1590 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 11.
I20260709 13:03:12.194501  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:12.189721  1586 raft_consensus.cc:1240] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:12.195001  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:12.195749  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:12.111068  7748 raft_consensus.cc:2804] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:12.196586  7748 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:12.197019  7748 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:12.195971  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:12.189380  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:12.202824  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:12.204537  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:12.209216  7688 raft_consensus.cc:2804] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:12.189347  1741 raft_consensus.cc:2393] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 23: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:12.209849  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:12.210989  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:12.212080  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:12.212620  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:12.213323  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:12.213848  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:12.214227  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:12.230947  1737 raft_consensus.cc:2393] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 16: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:12.231243  1735 raft_consensus.cc:2393] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 10: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
W20260709 13:03:12.217109  7705 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.021s	sys 0.024s
I20260709 13:03:12.228878  1740 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 15.
I20260709 13:03:12.184775  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:12.156232  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:12.217933   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:12.196962  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:12.224459  1592 raft_consensus.cc:1240] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:03:12.227638  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:12.216043  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:12.232776  1583 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 15.
I20260709 13:03:12.241591  1734 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 14.
I20260709 13:03:12.246184  7594 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:12.227043  7688 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:12.253324  7688 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:12.255726  7707 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:12.258559  7707 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:12.258682  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:12.261288  1630 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:12.263759  1738 raft_consensus.cc:2393] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 15: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:12.274180  7594 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:12.274298  7747 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:12.274483  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:12.275305  1589 raft_consensus.cc:2393] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 15: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:12.276348  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:12.276633  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:12.277565  1733 raft_consensus.cc:2393] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 12: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:12.277892  7670 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:12.278388  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:12.279126  1733 raft_consensus.cc:2393] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 13: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:12.279911  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:12.280491  1733 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 13.
I20260709 13:03:12.272925  1587 raft_consensus.cc:1275] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:03:12.243043  7705 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.022s	sys 0.024s
I20260709 13:03:12.289505  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:12.292158  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:12.292630  1738 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
I20260709 13:03:12.293292  2543 raft_consensus.cc:1275] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:03:12.295152  1733 raft_consensus.cc:2393] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 9: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:12.298661  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:12.299045  7508 consensus_queue.cc:260] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:12.289727  7545 raft_consensus.cc:2804] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:12.301738  7545 raft_consensus.cc:697] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 11 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:12.302913  7545 consensus_queue.cc:237] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:12.295147  7748 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:12.304915  7700 consensus_queue.cc:1048] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:12.305639  1588 raft_consensus.cc:2410] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:03:12.306705  7748 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:12.315570  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:12.316449  1583 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:12.311736  2548 raft_consensus.cc:1240] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:12.300997  7508 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:12.252578  7713 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:12.325181  1591 raft_consensus.cc:1240] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:12.326406  7713 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:12.327185  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:12.327411  7688 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:12.329991  1667 raft_consensus.cc:1275] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:12.333037  1556 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:12.334712  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:12.335469  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:03:12.338296  7660 raft_consensus.cc:2804] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:12.338804  7660 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.339224  7660 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:12.339413  7696 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:12.341818  1665 raft_consensus.cc:1240] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:12.349237  1556 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:12.353863  6821 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:12.354525  6821 raft_consensus.cc:697] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:12.364923  1665 raft_consensus.cc:1240] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:12.385699  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:12.386977  1663 raft_consensus.cc:2368] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 14. Current term is 15.
W20260709 13:03:12.395221  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.396011  6821 consensus_queue.cc:237] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:12.405362  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:12.411284  1583 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 15.
I20260709 13:03:12.412856  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:03:12.415457  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.415709  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:12.397985  7465 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.424108  7465 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:12.428345  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:12.430284  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:12.428388  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:12.436235  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:12.437223  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:12.437862  1584 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15.
I20260709 13:03:12.437978  1663 raft_consensus.cc:2393] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 11: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:12.439090  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:12.439654  7688 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:12.439911  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:12.446056  7465 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:12.441241  7671 consensus_queue.cc:1059] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:12.454499  7671 raft_consensus.cc:3055] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:12.454898  7671 raft_consensus.cc:740] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:12.456465  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:12.457420  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:12.457513  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:12.458024  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:12.358960  7701 consensus_queue.cc:1048] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 13:03:12.463181  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:03:12.463687  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.469982  1740 raft_consensus.cc:1275] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:03:12.470661  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:12.470811  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:12.456104  7671 consensus_queue.cc:260] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:12.463302  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:12.472223  7700 consensus_queue.cc:1059] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:12.472498  7671 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:12.483470  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:12.475962  7502 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:12.477960  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:03:12.485321  1707 leader_election.cc:336] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.976s (SENT)
I20260709 13:03:12.478276  1667 raft_consensus.cc:1275] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:03:12.480630  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:12.471665  1741 raft_consensus.cc:2393] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 16: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:12.496877  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:12.502528  1659 raft_consensus.cc:1240] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:12.505419  1741 raft_consensus.cc:1275] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:03:12.473551  7700 raft_consensus.cc:3055] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:12.503549  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:12.494470  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:12.516749  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:12.519104  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:12.523118  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:12.524183  1665 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:12.525446  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:12.526544  1734 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:03:12.523008  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:12.527099  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:12.529542  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:12.530865  1660 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:12.532967  2426 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:12.535842  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:12.539038  1661 raft_consensus.cc:1240] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 14. Current term is 15. Ops: []
W20260709 13:03:12.539611  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 54327.2us
I20260709 13:03:12.541530  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:12.545565  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:12.540179  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:12.555387  7709 raft_consensus.cc:2804] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:12.557979  1732 raft_consensus.cc:1275] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:03:12.555974  7709 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:12.516374  7700 raft_consensus.cc:740] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:12.579893  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:12.590256  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:12.512522  7701 consensus_queue.cc:1048] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:03:12.512336  7741 consensus_queue.cc:1048] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:03:12.545077  7711 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.569222  7709 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:12.528934  7708 consensus_queue.cc:1059] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:03:12.616546  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:12.605719  1660 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 14.
I20260709 13:03:12.623886  1667 raft_consensus.cc:1240] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:03:12.630275  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:12.551147  7651 consensus_queue.cc:1048] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:03:12.570302  7465 consensus_queue.cc:1048] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.060s
W20260709 13:03:12.643168  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 47316us
I20260709 13:03:12.646180  1558 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:12.669890  1662 raft_consensus.cc:1240] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:12.701013  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:12.612778  7715 consensus_queue.cc:1059] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
W20260709 13:03:12.703881  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 160202us
I20260709 13:03:12.642014  7734 consensus_queue.cc:1048] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
W20260709 13:03:12.727783  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 111515us
I20260709 13:03:12.732285  1734 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 15.
I20260709 13:03:12.629412  7508 consensus_queue.cc:1048] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:03:12.627151  7712 consensus_queue.cc:1048] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:03:12.625254  7711 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:12.747823  1707 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:12.642211  7658 consensus_queue.cc:1059] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.083s
I20260709 13:03:12.756606  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:03:12.799872  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 153872us
I20260709 13:03:12.739686  7733 raft_consensus.cc:2749] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:12.737710  7637 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:12.756757  7742 log.cc:927] Time spent T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
W20260709 13:03:12.815263  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 64927.1us
I20260709 13:03:12.804155  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:12.629370  1586 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06d03acc62b5400ebdca03680f553818"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:03:12.819329  1556 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:12.822733  1661 raft_consensus.cc:2393] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 16: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:12.783812  7758 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:12.813885  7670 consensus_meta.cc:287] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6: Time spent flushing consensus metadata: real 0.536s	user 0.012s	sys 0.003s
I20260709 13:03:12.654224  7700 consensus_queue.cc:260] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:12.827423  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:03:12.827353  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 79632.4us
W20260709 13:03:12.826864  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 189436us
I20260709 13:03:12.817754  1586 raft_consensus.cc:606] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:12.785403  7660 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:12.856134  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:12.856756  1707 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:12.866475  1663 raft_consensus.cc:1240] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:12.847892  7705 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.817852  7637 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:12.858676  6821 consensus_queue.cc:1059] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
W20260709 13:03:12.868314  7762 log.cc:927] Time spent T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.298s	user 0.002s	sys 0.000s
I20260709 13:03:12.832738  7674 consensus_queue.cc:1059] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:03:12.855322  7724 raft_consensus.cc:2804] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:12.844233  7769 raft_consensus.cc:2764] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:03:12.850586  7658 consensus_queue.cc:1048] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:03:12.877310  7636 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:12.831561  7702 consensus_queue.cc:1059] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:03:12.830637  7758 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:12.867815  7700 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:12.936544  7674 raft_consensus.cc:3055] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:12.937005  7724 raft_consensus.cc:697] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:12.970458  7674 raft_consensus.cc:740] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:12.970901  7711 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:12.942780  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:12.973920  1663 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:12.964406  7636 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.974642  7636 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:12.974761  1658 raft_consensus.cc:1275] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:03:12.975167  1658 pending_rounds.cc:85] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 7
I20260709 13:03:12.975401  1658 pending_rounds.cc:107] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:03:12.975630  1658 raft_consensus.cc:2889] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:12.943794  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:03:12.966924  7767 log.cc:927] Time spent T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.214s	user 0.002s	sys 0.000s
I20260709 13:03:12.972213  7724 consensus_queue.cc:237] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:12.973923  7765 log.cc:927] Time spent T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.321s	user 0.000s	sys 0.002s
I20260709 13:03:12.987368  7758 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:12.944723  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:12.944953  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:12.991693  1660 raft_consensus.cc:2393] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 23: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:12.950789  7660 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:12.953356  7736 consensus_queue.cc:1059] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:12.857689  7651 consensus_queue.cc:1059] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:03:12.990996  1662 raft_consensus.cc:1275] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:12.971705  7674 consensus_queue.cc:260] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:12.997411  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:03:12.999965  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.002065  7651 raft_consensus.cc:3055] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:13.013072  7651 raft_consensus.cc:740] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:13.014107  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:13.014919  1666 raft_consensus.cc:2393] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 15: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:13.016522  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:13.003077  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:13.003756  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:03:13.010473  7775 log.cc:927] Time spent T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.094s	user 0.000s	sys 0.003s
I20260709 13:03:13.002270  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:13.014107  7651 consensus_queue.cc:260] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:13.031378  1660 raft_consensus.cc:2393] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 11: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:13.031770  7651 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:13.002374  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:03:13.052574  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 46717.1us
I20260709 13:03:13.053382  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:03:13.058192  1665 consensus_meta.cc:287] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.523s	user 0.013s	sys 0.000s
I20260709 13:03:13.058662  1665 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 14.
I20260709 13:03:13.073424  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:13.073550  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:13.073755  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:13.074172  1660 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15.
I20260709 13:03:13.074436  1658 raft_consensus.cc:2410] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:03:13.073448  7744 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.075945  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:13.076155  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:03:13.078028  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 206000us
I20260709 13:03:13.077955  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:03:13.087213  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.101028  1660 raft_consensus.cc:1275] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:03:13.101697  1663 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15.
I20260709 13:03:13.114148  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:13.115321  1662 raft_consensus.cc:2393] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 11: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:13.117688  1666 raft_consensus.cc:1275] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:03:13.117976  1658 raft_consensus.cc:1240] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 11 LEADER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:13.119318  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:13.119891  1660 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:13.125258  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:13.128437  1662 raft_consensus.cc:2393] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 11: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:13.127085  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:13.129745  1658 raft_consensus.cc:2393] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 15: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:13.129539  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:13.131244  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:13.132652  1658 raft_consensus.cc:2393] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 15: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:13.118049  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:13.133595  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:13.134188  1658 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:13.134446  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:13.134701  7637 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:13.135346  7637 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:13.135774  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:13.135874  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:13.135861  7637 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:13.137002  1662 raft_consensus.cc:1240] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:13.139556  1665 raft_consensus.cc:1240] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:12.966569  7705 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:13.141280  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 86943.1us
I20260709 13:03:13.144474  7705 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:13.131397  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:13.075179  7744 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:13.148890  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:13.149837  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:13.171137  1665 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 19.
I20260709 13:03:13.172506  1667 raft_consensus.cc:1240] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:03:13.153649  7700 consensus_queue.cc:1059] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:13.182118  7744 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:13.155455  7671 consensus_meta.cc:287] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6: Time spent flushing consensus metadata: real 0.651s	user 0.012s	sys 0.000s
I20260709 13:03:13.155251  7465 consensus_queue.cc:1059] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:13.192164  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:13.156117  1707 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:13.162099  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:13.173486  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:13.154883  7669 raft_consensus.cc:3055] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:13.185249  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:13.187536  7736 consensus_queue.cc:1059] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:13.192934  1667 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 15.
I20260709 13:03:13.195492  1740 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 13.
I20260709 13:03:13.194577  1659 raft_consensus.cc:2368] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 14. Current term is 15.
I20260709 13:03:13.193873  1591 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 14.
I20260709 13:03:13.204465  1660 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 15.
I20260709 13:03:13.205859  2426 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:03:13.197002  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 378246us
I20260709 13:03:13.203410  2424 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:13.207870  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:13.209491  1663 raft_consensus.cc:1240] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:13.208881  1734 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 15.
I20260709 13:03:13.213861  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:13.194885  7669 raft_consensus.cc:740] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:13.222332  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:13.223326  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:13.224643  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:03:13.224942  1558 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:13.225890  2552 raft_consensus.cc:1275] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:03:13.224987  7749 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.009s	sys 0.005s
W20260709 13:03:13.227015  7749 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.009s	sys 0.005s
I20260709 13:03:13.227447  7748 consensus_queue.cc:1048] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:13.228477  7660 raft_consensus.cc:2749] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:13.172842  7709 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:13.234225  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 78178.6us
I20260709 13:03:13.235517  1556 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:13.216622  6821 consensus_queue.cc:1059] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:03:13.239902  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:13.240716  2548 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 12.
I20260709 13:03:13.217096  7744 raft_consensus.cc:2804] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:13.216648  7508 raft_consensus.cc:2804] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:13.251940  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:13.253508  1586 raft_consensus.cc:1240] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:03:13.259022  7637 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:13.253382  7744 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.259642  7746 raft_consensus.cc:3055] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:13.259938  7744 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:13.260217  7746 raft_consensus.cc:740] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:13.262168  7746 consensus_queue.cc:260] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:13.253834  7787 raft_consensus.cc:3055] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:13.269309  7787 raft_consensus.cc:740] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:13.269687  7746 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:13.269614  7669 consensus_queue.cc:260] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:13.271667  7669 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:13.273399  7700 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.254730  1707 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:13.276137  7786 raft_consensus.cc:2804] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:13.280366  7502 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.283684  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:13.284869  1660 raft_consensus.cc:2376] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15. Re-sending same reply.
I20260709 13:03:13.286131  1658 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15.
I20260709 13:03:13.273500  7791 raft_consensus.cc:3055] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:03:13.298748  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 57579.4us
I20260709 13:03:13.274138  7700 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:13.297607  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:13.299813  1558 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:13.272140  7636 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:13.307139  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:13.253684  7508 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:13.304672  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 51636.1us
I20260709 13:03:13.313179  1707 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:13.314307  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:13.316085  1662 raft_consensus.cc:2393] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 11: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:13.288164  7758 raft_consensus.cc:2804] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:13.281451  7734 raft_consensus.cc:3055] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:13.315593  1556 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:13.320920  1707 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:13.321928  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:13.322829  1741 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:13.288053  7786 raft_consensus.cc:697] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 15 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:13.328099  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:13.327359  7786 consensus_queue.cc:237] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:13.335208  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:13.335369  6821 consensus_queue.cc:1059] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:13.299322  7791 raft_consensus.cc:740] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:13.311729  7637 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:13.338034  7700 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:13.251463  7754 consensus_queue.cc:1059] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 13:03:13.299407  7502 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:13.317492  7724 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:03:13.334268  7792 log.cc:927] Time spent T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:03:13.317852  7508 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:13.362238  1633 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:13.397832  1633 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:13.338798  7758 raft_consensus.cc:697] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:03:13.365803  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.374338  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:13.398300  1705 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:13.369375  7748 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.324311  7711 consensus_queue.cc:1059] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:03:13.381361  7789 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:13.382588  1732 raft_consensus.cc:1275] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:03:13.338387  7651 raft_consensus.cc:2749] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:13.311012  7755 consensus_queue.cc:1048] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:03:13.325484  7734 raft_consensus.cc:740] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:13.335412  7465 raft_consensus.cc:2804] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:13.365027  7688 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:13.334571  7715 consensus_queue.cc:1048] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:03:13.399457  7733 raft_consensus.cc:3055] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:13.334827  7660 consensus_queue.cc:1059] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:03:13.396713  7636 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:13.394933  7724 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:13.447332  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:03:13.447234  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 131722us
I20260709 13:03:13.417011  7658 raft_consensus.cc:3055] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:13.270852  7787 consensus_queue.cc:260] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:13.423877  1732 pending_rounds.cc:85] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 8
I20260709 13:03:13.426680  7789 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.417523  7545 raft_consensus.cc:2804] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:13.429466  7465 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:13.473037  1556 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:13.459836  7651 raft_consensus.cc:2749] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:13.451771  7724 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:03:13.463052  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 143313us
I20260709 13:03:13.426869  7748 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:13.438220  7733 raft_consensus.cc:740] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:13.466241  1732 pending_rounds.cc:107] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 10.9
W20260709 13:03:13.477185  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 79432.6us
I20260709 13:03:13.488734  1732 raft_consensus.cc:2889] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:13.482164  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 73323.1us
I20260709 13:03:13.482920  1741 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 18.
I20260709 13:03:13.450863  7658 raft_consensus.cc:740] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:13.472265  7545 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.471408  7789 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:13.475471  7465 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:13.439549  7688 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:13.494836  1705 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:13.492316  1633 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:03:13.504036  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.450776  7791 consensus_queue.cc:260] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:13.516536  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 43809.9us
I20260709 13:03:13.473850  7636 consensus_queue.cc:1048] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:03:13.502319  7545 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:13.470733  7769 consensus_queue.cc:1048] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
W20260709 13:03:13.524286  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.508483  7709 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:13.535028  7748 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:13.537850  7795 log.cc:927] Time spent T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:03:13.542006  7502 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:13.563401  7803 raft_consensus.cc:2804] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:13.563922  7803 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.564546  7803 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:13.552093  7733 consensus_queue.cc:260] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:13.567766  7733 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:13.569262  7748 raft_consensus.cc:2804] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:13.569772  7748 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:13.570288  7797 log.cc:927] Time spent T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:03:13.571470  7658 consensus_queue.cc:260] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:13.562923  7711 consensus_queue.cc:1059] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:13.580248  7799 raft_consensus.cc:2804] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:13.507056  7758 consensus_queue.cc:237] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:13.593227  7799 raft_consensus.cc:697] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:13.594362  7799 consensus_queue.cc:237] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:13.601349  7688 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:03:13.607846  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 89089.7us
W20260709 13:03:13.608933  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 114154us
W20260709 13:03:13.610967  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 118830us
I20260709 13:03:13.613399  1633 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:13.617350  1633 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:13.619741  7809 raft_consensus.cc:2749] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:13.622237  7712 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.623503  7712 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:13.570299  7748 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:13.626399  1705 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:13.636063  7814 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.636662  7814 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:13.636974  7711 consensus_queue.cc:1059] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:13.639238  7814 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:03:13.632119  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 113823us
I20260709 13:03:13.641575  1558 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:13.625902  7688 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:13.644825  7688 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.645586  7688 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:13.649547  7712 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:13.655262  1633 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:13.657850  7674 raft_consensus.cc:3060] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:13.658147  7809 raft_consensus.cc:2804] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:03:13.672730  7798 log.cc:927] Time spent T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.205s	user 0.003s	sys 0.003s
I20260709 13:03:13.675840  7744 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:13.669513  7703 raft_consensus.cc:3055] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:13.677403  7703 raft_consensus.cc:740] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:13.678313  7703 consensus_queue.cc:260] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:13.679663  7703 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:13.693018  7811 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:13.693166  7758 consensus_queue.cc:1059] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:13.701930  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:13.704273  1586 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 18.
I20260709 13:03:13.703078  7508 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:13.708485  2552 raft_consensus.cc:2368] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 14. Current term is 15.
I20260709 13:03:13.713728  1558 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:13.712612  7813 raft_consensus.cc:3055] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:13.716384  2426 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:03:13.716681  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 45872.3us
I20260709 13:03:13.720256  7709 raft_consensus.cc:2804] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:13.722698  7709 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.723443  7709 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:13.727272  7776 raft_consensus.cc:3055] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:13.728024  7776 raft_consensus.cc:740] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:13.730751  7776 consensus_queue.cc:260] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:13.732335  7700 consensus_queue.cc:1048] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:13.736904  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:13.736788  7789 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:13.737500  7804 raft_consensus.cc:2749] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:13.738288  7804 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.738731  7804 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:13.739219  7789 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 20 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:13.718494  7813 raft_consensus.cc:740] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:13.741514  7813 consensus_queue.cc:260] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:13.743893  7813 raft_consensus.cc:3060] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:13.745855  1630 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:13.747555  7713 raft_consensus.cc:3055] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:13.748435  7713 raft_consensus.cc:740] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:03:13.749342  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 123001us
I20260709 13:03:13.732966  7776 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:13.750695  1705 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:13.751875  7812 raft_consensus.cc:2749] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:13.752494  1705 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:13.753247  7746 consensus_queue.cc:1048] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:13.752641  7812 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:13.757812  7803 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:13.758942  7804 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:13.763763  2550 raft_consensus.cc:1275] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:03:13.764258  2550 pending_rounds.cc:85] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6: Aborting all ops after (but not including) 9
I20260709 13:03:13.764459  2550 pending_rounds.cc:107] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:03:13.765128  2550 raft_consensus.cc:2889] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:13.765796  7545 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:13.768393  7724 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:13.771121  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:03:13.774863  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 117393us
W20260709 13:03:13.763845  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.775740  1633 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:13.778846  1705 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:13.779537  7651 raft_consensus.cc:2749] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:03:13.780431  7782 log.cc:927] Time spent T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.938s	user 0.005s	sys 0.014s
I20260709 13:03:13.771731  7803 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:13.787145  1705 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:13.736161  7748 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:13.796550  1558 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:03:13.806497  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:13.807312  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 61634.9us
W20260709 13:03:13.807438  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 176056us
I20260709 13:03:13.816612  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:13.808039  7820 raft_consensus.cc:2804] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:13.808550  7809 raft_consensus.cc:697] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 15 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
W20260709 13:03:13.768911  7794 log.cc:927] Time spent T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.487s	user 0.000s	sys 0.002s
I20260709 13:03:13.817854  1584 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:13.784348  7744 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 16 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:13.771183  7508 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 15 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:13.820243  7820 raft_consensus.cc:697] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 12 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:13.739265  7465 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:13.821398  7545 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:13.808315  7822 raft_consensus.cc:2749] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:13.832305  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 45222.8us
I20260709 13:03:13.813366  7715 raft_consensus.cc:2749] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:13.841826  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 66194us
I20260709 13:03:13.845542  1705 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:13.804498  7804 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:13.848011  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.854202  7820 consensus_queue.cc:237] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:13.804553  7702 consensus_queue.cc:1048] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:03:13.859516  7819 consensus_queue.cc:1048] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:03:13.827868  7660 raft_consensus.cc:2749] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:13.875388  1584 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 15.
I20260709 13:03:13.868052  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:13.869661  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:13.871217  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:13.867964  1633 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:13.842640  7700 raft_consensus.cc:2749] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:13.877244  1588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:03:13.818475  7688 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:13.878931  2426 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:13.844030  1558 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:13.888346  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:13.883904  1633 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:13.897539  1740 raft_consensus.cc:1240] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:13.903995  1732 raft_consensus.cc:1275] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:03:13.910144  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:13.910972  1741 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 19.
I20260709 13:03:13.913426  1741 raft_consensus.cc:1275] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 8. (term mismatch)
I20260709 13:03:13.914000  1741 pending_rounds.cc:85] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 7
I20260709 13:03:13.914280  1741 pending_rounds.cc:107] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 16.8
I20260709 13:03:13.914577  1741 raft_consensus.cc:2889] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:13.900393  7791 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:13.917384  1633 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:13.917681  1741 raft_consensus.cc:1240] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:13.922101  1739 raft_consensus.cc:1240] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 18. Current term is 19. Ops: []
W20260709 13:03:13.922757  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 77045.7us
I20260709 13:03:13.923931  1705 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:13.883814  7812 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:13.860572  7713 consensus_queue.cc:260] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:13.931470  7713 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:13.931154  7812 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:13.894232  7674 raft_consensus.cc:2749] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:13.934134  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:13.926820  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:13.934895  1741 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 23.
I20260709 13:03:13.887600  7545 raft_consensus.cc:2749] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:13.925988  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:13.935051  1658 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 23.
I20260709 13:03:13.926256  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:13.925308  1633 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:13.940150  1705 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:13.941936  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:13.946398  1658 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
I20260709 13:03:13.951629  7724 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 23 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:13.919565  7746 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:13.952833  7809 consensus_queue.cc:237] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:13.909171  7822 raft_consensus.cc:2749] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:13.956219  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.952461  7465 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:13.917239  7508 raft_consensus.cc:2804] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:13.962013  1633 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:13.964390  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:13.965101  7700 raft_consensus.cc:2749] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:13.965909  7748 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:13.966768  7748 raft_consensus.cc:3060] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:13.965142  1662 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 17.
W20260709 13:03:13.969734  7817 log.cc:927] Time spent T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:03:13.970788  7827 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:13.972733  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:13.973778  1662 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:13.974165  1732 raft_consensus.cc:1240] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:13.972963  7688 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:13.960836  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:13.976892  1665 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:13.980016  1705 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:13.973529  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:13.979173  7508 raft_consensus.cc:697] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:13.981594  1734 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:13.981597  7746 raft_consensus.cc:2749] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:13.982317  7508 consensus_queue.cc:237] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:13.988402  7787 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:13.991703  1705 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:13.994335  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:13.958729  7798 log.cc:927] Time spent T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:03:13.998103  7587 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.952649  7818 raft_consensus.cc:2804] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:13.998831  7587 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:13.999679  7818 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:14.000144  7818 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:14.004863  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:14.006464  1584 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 13.
I20260709 13:03:14.009357  2426 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:03:14.013020  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 51115.6us
I20260709 13:03:14.017373  1633 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:14.026021  1705 leader_election.cc:400] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Vote denied by peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683) with higher term. Message: Invalid argument: T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 14. Current term is 15.
I20260709 13:03:14.027202  1705 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:14.028918  1705 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:14.033357  7821 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:14.035425  7700 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:14.036916  7587 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:14.004770  7746 raft_consensus.cc:2749] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:14.018750  7736 raft_consensus.cc:2804] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:14.038962  7736 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:14.039341  7736 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:14.056684  1591 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 15.
W20260709 13:03:14.066944  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 49656.2us
I20260709 13:03:14.068931  1633 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:14.076601  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 47773.1us
I20260709 13:03:14.077742  1705 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:14.029762  1583 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 18.
I20260709 13:03:14.087242  1665 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 20.
I20260709 13:03:14.090306  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:14.112790  1664 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 14.
I20260709 13:03:14.091048  1734 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 20.
W20260709 13:03:14.096949  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.099642  1705 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:14.104295  1633 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:14.074340  7822 raft_consensus.cc:2749] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:14.108994  7651 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:14.127031  1705 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:14.097240  7821 raft_consensus.cc:2749] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:14.111230  7688 raft_consensus.cc:2749] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:03:14.171559  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:14.171868  7715 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.172629  7715 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:14.173756  1583 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
I20260709 13:03:14.157440  7805 raft_consensus.cc:3055] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:14.172011  1586 raft_consensus.cc:1240] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:03:14.122285  7709 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:14.189913  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:14.235625  1704 leader_election.cc:400] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Vote denied by peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157) with higher term. Message: Invalid argument: T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 14. Current term is 15.
I20260709 13:03:14.058055  7734 consensus_queue.cc:260] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:14.235968  1704 leader_election.cc:403] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:14.124439  7746 raft_consensus.cc:2749] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:14.251468  1587 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 18.
I20260709 13:03:14.187386  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:03:14.223866  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.187940  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:14.258100  1585 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:14.260432  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:14.188746  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:14.144556  1633 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:14.265745  1589 raft_consensus.cc:2393] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 20: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:14.267109  1583 raft_consensus.cc:2368] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 14. Current term is 15.
I20260709 13:03:14.153875  7820 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:14.145844  7801 raft_consensus.cc:2804] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:14.271090  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:14.273811  2548 raft_consensus.cc:2368] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 18. Current term is 19.
I20260709 13:03:14.273754  1591 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 23.
I20260709 13:03:14.183761  7748 raft_consensus.cc:2749] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:14.174834  7715 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:14.305416  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:14.307391  1556 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:14.310240  7713 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:03:14.310911  7713 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:14.276193  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 131780us
I20260709 13:03:14.274099  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:14.190392  7804 raft_consensus.cc:2749] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:14.311908  1633 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:14.312776  1741 raft_consensus.cc:1240] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:14.313655  1633 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:14.275601  7828 log.cc:927] Time spent T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:03:14.317313  7822 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:14.281673  7833 log.cc:927] Time spent T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.098s	user 0.001s	sys 0.004s
I20260709 13:03:14.319011  7713 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:14.294890  7688 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:14.284030  7736 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:14.296599  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:14.297042  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:14.297354  1587 raft_consensus.cc:1275] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:03:14.298542  7835 log.cc:927] Time spent T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:03:14.332792  1739 raft_consensus.cc:3055] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:14.333194  1659 raft_consensus.cc:2393] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 23: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:14.298496  1661 raft_consensus.cc:1275] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:03:14.299573  1666 raft_consensus.cc:1275] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:03:14.235160  7805 raft_consensus.cc:740] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:14.310812  1556 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:14.293900  1630 leader_election.cc:400] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Vote denied by peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157) with higher term. Message: Invalid argument: T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 18. Current term is 19.
I20260709 13:03:14.319842  2543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 447) took 1087 ms. Trace:
I20260709 13:03:14.275843  1732 raft_consensus.cc:1240] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:14.320940  7734 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:14.328325  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.333331  1739 raft_consensus.cc:740] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:14.334425  1666 pending_rounds.cc:85] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 8
I20260709 13:03:14.346493  1666 pending_rounds.cc:107] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:03:14.338944  2543 rpcz_store.cc:276] 0709 13:03:13.232815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.233013 (+   198us) service_pool.cc:224] Handling call
0709 13:03:13.233391 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:13.237243 (+  3852us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:13.237284 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:13.251165 (+ 13881us) log.cc:844] Serialized 26 byte log entry
0709 13:03:13.833153 (+581988us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b18004961e0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7de84e07 00007f1b86cdfab9 00007f1b7dea169b 00007f1b7de9f93f 00007f1b7dea1c02 00007f1b80b2920b 00007f1b80b2ed23 00007f1b80b2f0d1 00007f1b80f4aa0f
0709 13:03:14.020548 (+187395us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:14.020594 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:14.020666 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:14.319469 (+298803us) raft_consensus.cc:1685] finished
0709 13:03:14.319497 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:14.319753 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5730,"raft.queue_time_us":14746,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":4663,"spinlock_wait_cycles":45388032,"thread_start_us":183559,"threads_started":1,"wal-append.queue_time_us":863627}
I20260709 13:03:14.346936  1666 raft_consensus.cc:2889] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:14.334802  1667 raft_consensus.cc:2393] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 12: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:14.330452  1633 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:14.337787  1630 leader_election.cc:403] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:14.342790  1707 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:14.350014  1739 consensus_queue.cc:260] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:14.353912  1739 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:14.352609  7805 consensus_queue.cc:260] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:14.347348  1556 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:03:14.357774  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 64051.9us
I20260709 13:03:14.358373  1633 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:14.353830  7818 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:14.367815  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:14.368695  1732 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:03:14.388520  1590 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15.
W20260709 13:03:14.388998  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.390377  1662 raft_consensus.cc:2468] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 16.
I20260709 13:03:14.394882  1633 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:14.397644  1633 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:14.399309  1633 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:14.401757  7827 raft_consensus.cc:3060] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:14.402454  1732 raft_consensus.cc:1240] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:03:14.406018  7805 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:14.355798  7754 raft_consensus.cc:2804] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:14.412045  1663 raft_consensus.cc:1240] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:14.367648  7820 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:14.368304  7660 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:14.375994  7545 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:03:14.412757  7825 raft_consensus.cc:2804] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:14.410181  7812 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:14.414861  7754 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:14.416527  7803 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:14.451119  1733 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 23.
I20260709 13:03:14.471381  7822 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:14.477396  7803 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:14.477959  7803 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:14.478577  7658 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:14.451109  7825 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:14.489198  1586 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 16.
I20260709 13:03:14.434044  7748 raft_consensus.cc:2749] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:14.435138  7660 raft_consensus.cc:697] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 20 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:14.524005  2424 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:14.480283  7825 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:14.535280  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:14.548411  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.539302  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:14.456090  7754 raft_consensus.cc:3060] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:14.540345  1666 raft_consensus.cc:1275] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:14.555703  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:14.556334  1733 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:14.544727  1739 raft_consensus.cc:1275] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:03:14.551846  1663 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:14.480329  7803 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:14.573261  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:14.573992  1732 raft_consensus.cc:3060] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:03:14.485957  7736 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 15 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:14.577670  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.553191  7502 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.559543  1739 pending_rounds.cc:85] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 7
I20260709 13:03:14.586565  1739 pending_rounds.cc:107] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:03:14.590073  1739 raft_consensus.cc:2889] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:14.561566  7712 raft_consensus.cc:2804] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:03:14.592310  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 358955us
I20260709 13:03:14.570192  1733 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 14.
I20260709 13:03:14.615450  1663 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 15.
I20260709 13:03:14.582213  7502 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:14.560489  7827 raft_consensus.cc:2749] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:14.636479  7660 consensus_queue.cc:237] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:14.630767  1585 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 16.
I20260709 13:03:14.599720  7803 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:14.657156  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 197947us
I20260709 13:03:14.606051  7801 raft_consensus.cc:697] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 15 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:14.706660  7818 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:14.711199  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:03:14.712268  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 54376.3us
I20260709 13:03:14.644208  7465 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.666870  7800 consensus_queue.cc:1059] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
W20260709 13:03:14.733579  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 186139us
I20260709 13:03:14.689853  7700 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.699144  7502 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:14.643414  7651 raft_consensus.cc:2804] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:03:14.733978  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 334748us
I20260709 13:03:14.741972  1633 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:14.745904  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 403157us
W20260709 13:03:14.710727  7787 consensus_meta.cc:287] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.707s	user 0.011s	sys 0.005s
I20260709 13:03:14.669502  7702 consensus_queue.cc:1048] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.089s
I20260709 13:03:14.758183  1588 raft_consensus.cc:606] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:14.755002  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:14.766887  1588 raft_consensus.cc:614] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:14.767158  1585 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:03:14.681321  1705 leader_election.cc:336] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.633s (SENT)
W20260709 13:03:14.768863  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 87650.9us
W20260709 13:03:14.771445  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 236699us
I20260709 13:03:14.739347  1732 raft_consensus.cc:2468] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 15.
I20260709 13:03:14.776382  7746 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157) with higher term. Message: Invalid argument: T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 14. Current term is 15.
I20260709 13:03:14.791396  1735 raft_consensus.cc:2410] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:03:14.769003  1707 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:14.794327  1583 raft_consensus.cc:1275] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:03:14.757781  7545 raft_consensus.cc:2749] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157) with higher term. Message: Invalid argument: T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 18. Current term is 19.
I20260709 13:03:14.797698  2426 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede
W20260709 13:03:14.799243  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.744956  7651 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:14.771692  7821 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.801231  7734 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.738816  7465 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:14.805365  7801 consensus_queue.cc:237] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:14.732836  7813 consensus_queue.cc:1048] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:03:14.745093  7727 consensus_queue.cc:1048] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:03:14.778376  7842 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:03:14.846415  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 48870.7us
I20260709 13:03:14.808863  1585 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 15.
I20260709 13:03:14.847397  7651 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:14.847259  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:14.866370  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 261366us
W20260709 13:03:14.864420  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 128483us
I20260709 13:03:14.754465  7700 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:14.885726  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:14.898090  2550 raft_consensus.cc:2393] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 12: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:14.815842  7787 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.879303  7587 raft_consensus.cc:2804] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:14.902633  2424 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:03:14.896885  7713 consensus_meta.cc:287] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.541s	user 0.014s	sys 0.000s
I20260709 13:03:14.889295  7719 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.889894  7545 raft_consensus.cc:2749] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:14.828572  7734 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:14.884646  7805 consensus_queue.cc:1048] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:03:14.919318  7502 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.897661  7842 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:14.898016  7791 consensus_queue.cc:1059] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:03:14.887344  7821 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:14.905208  7755 consensus_queue.cc:1048] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:03:14.987643  7852 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.934273  7587 raft_consensus.cc:697] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
W20260709 13:03:14.980103  7688 consensus_meta.cc:287] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.647s	user 0.014s	sys 0.000s
I20260709 13:03:15.007335  2552 raft_consensus.cc:1275] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:03:14.923532  7827 consensus_queue.cc:1048] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:03:14.984030  7465 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:14.996661  7749 raft_consensus.cc:2804] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:14.944417  7713 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:14.949033  7825 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:14.924448  7787 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:15.033601  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:15.049258  1665 raft_consensus.cc:2468] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:03:14.949584  7719 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:15.042520  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 328207us
I20260709 13:03:14.988240  7502 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:15.072588  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:15.105677  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:15.106139  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.046373  7803 raft_consensus.cc:2749] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:15.045760  7688 raft_consensus.cc:2749] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:15.114226  1558 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:15.111183  1662 raft_consensus.cc:1240] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:03:15.123227  7791 consensus_queue.cc:1059] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:15.125931  7800 raft_consensus.cc:3055] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:15.127403  7800 raft_consensus.cc:740] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:15.128952  7800 consensus_queue.cc:260] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:15.134761  7800 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:15.117763  7702 raft_consensus.cc:2749] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:03:15.113466  7829 log.cc:927] Time spent T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 13:03:15.113798  7820 consensus_meta.cc:287] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.690s	user 0.007s	sys 0.008s
W20260709 13:03:15.151834  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 340915us
I20260709 13:03:15.104583  7749 raft_consensus.cc:697] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:15.171494  1741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 4186) took 1214 ms. Trace:
I20260709 13:03:15.048928  7852 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:15.172421  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 386847us
I20260709 13:03:15.172358  1741 rpcz_store.cc:276] 0709 13:03:13.946300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.946421 (+   121us) service_pool.cc:224] Handling call
0709 13:03:13.946851 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:14.313356 (+366505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:15.159912 (+846556us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b54000febd4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:03:15.160146 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":841025408}
I20260709 13:03:15.187558  1633 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
W20260709 13:03:15.188486  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 253770us
I20260709 13:03:15.172590  7820 raft_consensus.cc:2749] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:15.205017  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 310363us
W20260709 13:03:15.201643  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 84087.2us
I20260709 13:03:15.207276  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:03:15.210762  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.208958  1741 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 23.
I20260709 13:03:15.185563  7700 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:15.189530  7465 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:15.201826  7688 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:15.245954  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:15.222116  7734 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:15.253850  1733 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:15.257890  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:15.218276  7843 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:03:15.265002  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 67268us
I20260709 13:03:15.259387  7688 raft_consensus.cc:697] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 18 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
W20260709 13:03:15.295457  1705 leader_election.cc:336] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.822s (SENT)
W20260709 13:03:15.275868  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 144568us
I20260709 13:03:15.180006  7587 consensus_queue.cc:237] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:15.272078  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.245653  7804 raft_consensus.cc:2749] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:15.297266  1558 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:15.298525  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:15.299993  1739 raft_consensus.cc:2393] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 14: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:15.300789  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:15.301888  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:15.287880  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:15.302999  1732 raft_consensus.cc:2393] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 16: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:15.303315  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:15.304106  1658 raft_consensus.cc:2393] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 17: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:15.288408  1735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43678 (request call id 4172) took 1395 ms. Trace:
I20260709 13:03:15.273439  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:15.307608  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:03:15.287328  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 78002.1us
I20260709 13:03:15.305830  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:15.308511  1658 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15.
I20260709 13:03:15.309549  1663 raft_consensus.cc:2393] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 16: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:15.310683  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:15.310808  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:15.307662  1666 raft_consensus.cc:1240] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:03:15.311326  1658 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 23.
I20260709 13:03:15.246281  7465 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:15.312374  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:15.315532  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:15.317663  1633 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:15.273955  7842 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:15.304785  1735 rpcz_store.cc:276] 0709 13:03:13.887622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.887964 (+   342us) service_pool.cc:224] Handling call
0709 13:03:15.282889 (+1394925us) spinlock_profiling.cc:243] Waited 902 ms on lock 0x7b540001cf54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:03:15.283043 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2073930496}
I20260709 13:03:15.312453  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:15.321029  1739 raft_consensus.cc:1275] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:15.314723  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:15.361413  1733 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 16.
I20260709 13:03:15.367038  1658 raft_consensus.cc:2393] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 11: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:15.367208  7746 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.368059  7746 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:15.368897  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:15.371068  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:03:15.371553  7754 consensus_meta.cc:287] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.780s	user 0.009s	sys 0.005s
I20260709 13:03:15.371826  1658 raft_consensus.cc:2368] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 15. Current term is 16.
I20260709 13:03:15.372048  7754 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:15.372777  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:15.373564  1658 raft_consensus.cc:2393] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 23: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
W20260709 13:03:15.374648  7834 log.cc:927] Time spent T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.784s	user 0.002s	sys 0.003s
I20260709 13:03:15.358878  7787 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:15.308732  7821 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:15.232679  7749 consensus_queue.cc:237] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:15.376626  7651 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:15.377426  7860 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:15.378003  7860 raft_consensus.cc:697] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 15 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:15.378068  1741 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:15.378927  7860 consensus_queue.cc:237] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:15.371743  7746 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:15.376756  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 59188.9us
I20260709 13:03:15.382671  1633 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:15.385277  7818 raft_consensus.cc:2804] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:15.385964  7818 raft_consensus.cc:697] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 18 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:15.387029  7818 consensus_queue.cc:237] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:15.397281  1741 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 12.
I20260709 13:03:15.401625  1591 raft_consensus.cc:2393] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 in current term 19: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:15.327123  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:15.312922  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:15.305312  7852 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:15.329352  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:03:15.334468  7850 log.cc:927] Time spent T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:03:15.337428  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:03:15.338003  7851 log.cc:927] Time spent T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:03:15.338536  7465 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:15.322500  7855 raft_consensus.cc:2804] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:15.339172  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:15.339879  1558 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
W20260709 13:03:15.425660  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 51477.4us
I20260709 13:03:15.341348  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:15.334358  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:15.349958  7688 consensus_queue.cc:237] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:15.319561  7825 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:15.306444  7719 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:15.355023  7854 log.cc:927] Time spent T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
W20260709 13:03:15.355755  7853 log.cc:927] Time spent T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.162s	user 0.002s	sys 0.000s
W20260709 13:03:15.356706  7870 log.cc:927] Time spent T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:03:15.455646  7651 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:15.415401  7746 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.456766  7746 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:15.459688  7746 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:15.396418  1633 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:15.419692  1665 raft_consensus.cc:2393] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 16: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:15.414995  7734 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:15.463200  7734 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:15.319141  7713 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 24 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:15.470562  1736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 4193) took 1197 ms. Trace:
I20260709 13:03:15.471637  1736 rpcz_store.cc:276] 0709 13:03:14.273271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.273437 (+   166us) service_pool.cc:224] Handling call
0709 13:03:14.288034 (+ 14597us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:14.628222 (+340188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:14.628260 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:14.664981 (+ 36721us) log.cc:844] Serialized 26 byte log entry
0709 13:03:14.890791 (+225810us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:14.890833 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:14.890901 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:15.343527 (+452626us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b4800120858. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b85eb8aa1 00007f1b85eafb37 00007f1b85eaf9ca 00007f1b85fa726f 00007f1b85fa6f37 00007f1b85fbb55c 00007f1b85fbb508 00007f1b85fbb488 00007f1b85fbb443 00007f1b85fba6ec 00007f1b84ee4a96
0709 13:03:15.470230 (+126703us) raft_consensus.cc:1685] finished
0709 13:03:15.470256 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:15.470482 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":334407,"raft.queue_time_us":318089,"raft.run_cpu_time_us":3800,"raft.run_wall_time_us":726575,"spinlock_wait_cycles":32298752,"thread_start_us":198953,"threads_started":1,"wal-append.queue_time_us":455038}
W20260709 13:03:15.491701  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 95386.4us
I20260709 13:03:15.434401  1663 raft_consensus.cc:1240] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 14. Current term is 15. Ops: [14.8-14.8]
W20260709 13:03:15.352633  7858 log.cc:927] Time spent T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:03:15.496815  7748 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:03:15.497069  7840 log.cc:927] Time spent T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.780s	user 0.006s	sys 0.006s
W20260709 13:03:15.441464  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 79392.4us
I20260709 13:03:15.445551  7875 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:03:15.436601  7855 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.452217  1667 raft_consensus.cc:2393] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 20: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:15.271034  7843 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:15.430342  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 90573.6us
I20260709 13:03:15.497362  7748 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.438669  1666 raft_consensus.cc:1275] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:03:15.511685  1738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 4194) took 1235 ms. Trace:
I20260709 13:03:15.512553  7748 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:15.512287  1738 rpcz_store.cc:276] 0709 13:03:14.276032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.280747 (+  4715us) service_pool.cc:224] Handling call
0709 13:03:14.281962 (+  1215us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:14.593297 (+311335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:14.593327 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:14.609774 (+ 16447us) log.cc:844] Serialized 26 byte log entry
0709 13:03:15.042056 (+432282us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:15.104301 (+ 62245us) log.cc:844] Serialized 14 byte log entry
0709 13:03:15.109002 (+  4701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:15.109108 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:15.511222 (+402114us) raft_consensus.cc:1685] finished
0709 13:03:15.511256 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:15.511472 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":323524,"prepare.queue_time_us":63217,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":409810,"raft.run_cpu_time_us":506,"raft.run_wall_time_us":32973,"thread_start_us":331349,"threads_started":1,"wal-append.queue_time_us":541699}
I20260709 13:03:15.516225  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:15.519481  7709 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 19 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:15.520836  7755 consensus_queue.cc:1048] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:03:15.524506  1558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.526124  7866 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.512725  7855 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:15.499812  7874 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.539654  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:15.534098  1707 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:15.537396  7875 raft_consensus.cc:697] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 23 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:15.544407  7746 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:03:15.553561  7878 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.559034  7746 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.559417  7878 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:15.564121  7878 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:15.540905  7866 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:15.567451  7866 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:15.537176  7825 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:15.568537  7825 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:15.550647  7874 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:15.573998  7754 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:15.576987  7875 consensus_queue.cc:237] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:15.579909  7825 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:15.582206  7734 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:15.586633  7748 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:15.559525  7746 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:15.467317  7508 consensus_queue.cc:1048] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 13:03:15.611321  7658 raft_consensus.cc:3055] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:03:15.612709  7712 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.981s	user 0.067s	sys 0.100s
I20260709 13:03:15.615319  7848 consensus_queue.cc:1048] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:15.620685  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:15.627615  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:15.643528  1662 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:03:15.644166  1583 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15.
I20260709 13:03:15.644579  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:15.645279  1662 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 15.
I20260709 13:03:15.614027  1707 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:15.630797  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:15.631947  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:15.647773  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:15.632900  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:15.633584  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:15.647940  1662 raft_consensus.cc:1240] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:15.649849  1587 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15.
I20260709 13:03:15.652477  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:15.652647  1665 raft_consensus.cc:1275] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:03:15.653383  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:15.637018  1667 raft_consensus.cc:2468] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 19.
I20260709 13:03:15.653976  1660 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:15.654738  1659 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16.
I20260709 13:03:15.656287  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:15.656982  1592 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 18.
I20260709 13:03:15.623941  7878 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.669397  7674 raft_consensus.cc:3055] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:15.669904  7674 raft_consensus.cc:740] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:15.669559  7878 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:15.637504  7874 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:15.671007  7713 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.671259  7674 consensus_queue.cc:260] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:15.671684  7713 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:15.672366  7674 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:15.673724  7713 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:15.657416  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:15.675690  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:15.676430  1585 raft_consensus.cc:2393] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 16: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:15.657919  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:15.651674  7877 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.678066  7866 raft_consensus.cc:2764] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 13:03:15.623245  7658 raft_consensus.cc:740] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:15.640776  7754 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.680393  7754 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:15.659642  1664 raft_consensus.cc:1275] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:03:15.687319  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:15.660837  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:15.623008  7800 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
W20260709 13:03:15.637189  7712 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.009s	user 0.067s	sys 0.101s
I20260709 13:03:15.693434  7712 raft_consensus.cc:697] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:15.693532  7800 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:15.694483  7838 log.cc:927] Time spent T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.984s	user 0.003s	sys 0.000s
I20260709 13:03:15.694751  7712 consensus_queue.cc:237] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:15.696003  7800 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:15.696269  1740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 4183) took 1777 ms. Trace:
I20260709 13:03:15.696511  7878 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:15.666664  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:15.623802  7734 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:15.698890  1589 raft_consensus.cc:2368] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 14. Current term is 15.
I20260709 13:03:15.680393  7658 consensus_queue.cc:260] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:15.663568  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 49627.9us
I20260709 13:03:15.683925  1588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:47714 (request call id 73) took 1812 ms. Trace:
I20260709 13:03:15.691670  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:15.698998  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:15.711333  1705 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:15.711556  1591 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 17.
I20260709 13:03:15.712534  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:15.701439  1587 raft_consensus.cc:1275] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:15.703054  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:15.714234  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:15.717842  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:15.718307  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:15.711122  1707 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:15.719401  1705 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:15.703972  2424 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:03:15.705318  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 66950.4us
I20260709 13:03:15.717566  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:15.757838  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:15.758621  1592 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:15.710881  1588 rpcz_store.cc:276] 0709 13:03:13.871081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.871802 (+   721us) service_pool.cc:224] Handling call
0709 13:03:15.682884 (+1811082us) spinlock_profiling.cc:243] Waited 880 ms on lock 0x7b54002ee354. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f89853 00007f1b85f5760a 00007f1b7f4dd7d4 00007f1b7f4dd762 00007f1b7f4dd691 00007f1b7f4dd60c 00007f1b7f4dc8c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:03:15.683004 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2024472448}
I20260709 13:03:15.763442  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:03:15.764904  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 54058.5us
I20260709 13:03:15.765738  1707 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:15.766296  1658 raft_consensus.cc:2393] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 19: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:03:15.767942  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:03:15.768966  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 49642us
I20260709 13:03:15.769851  1705 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
W20260709 13:03:15.772079  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 68188.1us
I20260709 13:03:15.696695  1740 rpcz_store.cc:276] 0709 13:03:13.918726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.918865 (+   139us) service_pool.cc:224] Handling call
0709 13:03:14.057180 (+138315us) spinlock_profiling.cc:243] Waited 8.44 ms on lock 0x7b58000e4398. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7de6ab71 00007f1b7de6aa22 00007f1b86d83c09 00007f1b85eddee0 00007f1b85fa70ab 00007f1b85fa7131 00007f1b85f68fc0 00007f1b85f53929 00007f1b85f533d2 00007f1b7f4cabd4
0709 13:03:14.057386 (+   206us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:14.072722 (+ 15336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:14.072755 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:14.078398 (+  5643us) log.cc:844] Serialized 26 byte log entry
0709 13:03:14.423293 (+344895us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:14.459512 (+ 36219us) log.cc:844] Serialized 14 byte log entry
0709 13:03:14.607629 (+148117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:14.607710 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:15.693708 (+1085998us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b4400022b4c. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7ddc8c85 00007f1b7ddc96a2 00007f1b80b3b1db 00007f1b80b36aaf 00007f1b80b2a86e 00007f1b80b29bb6 00007f1b80b297d8 00007f1b80b33221 00007f1b80b331d9 00007f1b80b33169
0709 13:03:15.696039 (+  2331us) raft_consensus.cc:1685] finished
0709 13:03:15.696064 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:15.696202 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":162736,"prepare.queue_time_us":32713,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":189388,"raft.run_cpu_time_us":691,"raft.run_wall_time_us":45977,"spinlock_wait_cycles":67635200,"thread_start_us":269903,"threads_started":1,"wal-append.queue_time_us":581177}
I20260709 13:03:15.679484  7843 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:15.686662  7754 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:15.791867  1707 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:15.794674  7651 raft_consensus.cc:2804] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:15.790004  7465 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:15.795387  7801 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:15.795930  7801 raft_consensus.cc:697] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 16 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:15.717929  7866 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.801939  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:15.757368  7800 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:15.805382  1592 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 16.
I20260709 13:03:15.831399  2552 raft_consensus.cc:1240] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:15.785440  7658 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:15.779675  7848 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:15.831619  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:15.842841  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:15.678138  7877 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:15.838773  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:03:15.800804  7821 raft_consensus.cc:2804] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:15.768141  7734 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:15.866619  7734 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:15.868518  1660 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 24.
I20260709 13:03:15.868539  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:15.806418  7883 raft_consensus.cc:2804] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:15.796835  7801 consensus_queue.cc:237] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:15.871053  7868 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.797464  7825 consensus_queue.cc:1048] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:03:15.851208  7821 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.892315  7748 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 24 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:15.873870  7860 consensus_queue.cc:1059] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:03:15.850960  7812 raft_consensus.cc:2804] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:15.893782  7883 raft_consensus.cc:697] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 19 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:15.839637  7866 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:15.906076  1585 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 14.
I20260709 13:03:15.834040  7800 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:15.913759  7877 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:15.914173  7465 raft_consensus.cc:2749] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:15.918529  7871 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.930040  7502 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:15.932507  1583 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 17.
W20260709 13:03:15.871973  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 104283us
I20260709 13:03:15.937857  7860 consensus_queue.cc:1243] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer 7e839e91a1314c2f9a99b25b17c916a6 log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:03:15.937654  7821 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:15.977584  1556 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:15.938545  7812 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.934010  7848 consensus_queue.cc:1059] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:03:15.953053  1633 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:15.958678  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:15.960353  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:03:15.957594  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 159475us
I20260709 13:03:15.936007  7651 raft_consensus.cc:697] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 16 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
W20260709 13:03:15.933665  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.974025  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:16.004066  1740 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:03:15.974906  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:16.005813  1737 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:15.946033  7658 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:15.991910  1705 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:15.990461  1633 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
W20260709 13:03:15.951867  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 160103us
W20260709 13:03:16.010625  1558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:16.012141  1558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.014170  1556 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:16.017061  1705 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:16.017783  1584 raft_consensus.cc:1275] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:03:15.964821  7545 consensus_queue.cc:1048] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:03:15.937171  7746 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:16.002413  7674 raft_consensus.cc:2804] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:15.992275  7465 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:16.025379  1738 raft_consensus.cc:1240] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:15.936327  7868 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:16.002180  7843 raft_consensus.cc:2804] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:03:16.040283  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.013146  7787 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.043555  1705 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:16.049201  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:16.001397  7895 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:16.040966  1556 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:15.988602  7812 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:15.967893  7855 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:15.978708  7871 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:16.022004  7859 raft_consensus.cc:2804] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:16.067478  1740 raft_consensus.cc:1275] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:03:16.079087  1740 pending_rounds.cc:85] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 7
I20260709 13:03:16.079396  1740 pending_rounds.cc:107] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:03:16.079687  1740 raft_consensus.cc:2889] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:16.070922  1705 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:16.052457  7674 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.018741  7877 consensus_queue.cc:1059] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:03:16.054603  7715 raft_consensus.cc:2804] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:16.091720  1733 raft_consensus.cc:2468] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:03:16.094031  1556 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:16.015947  7658 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:16.096513  1705 leader_election.cc:400] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 election: Vote denied by peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683) with higher term. Message: Invalid argument: T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 15. Current term is 16.
I20260709 13:03:16.113852  1705 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:16.096654  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:16.115926  1738 raft_consensus.cc:1813] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Handling vote request from an unknown peer 6d4de2ce0683442498244b9529127f91
I20260709 13:03:16.116537  1738 raft_consensus.cc:2410] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:03:16.104095  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:16.117879  1732 raft_consensus.cc:2468] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:03:16.069039  7733 raft_consensus.cc:2804] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:16.106848  1590 raft_consensus.cc:2368] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 11. Current term is 12.
I20260709 13:03:16.108850  1740 raft_consensus.cc:1275] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:03:16.078889  7860 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.054569  7788 consensus_queue.cc:1048] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:03:16.112143  1633 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:16.089454  7896 raft_consensus.cc:2749] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:16.110760  2548 raft_consensus.cc:1240] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 LEADER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:16.129990  1705 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:16.131361  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:16.133421  1584 raft_consensus.cc:1275] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:03:16.135092  1738 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16.
I20260709 13:03:16.128475  7734 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:16.136421  7734 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.096751  7893 consensus_queue.cc:1048] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:03:16.136782  7734 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:16.137833  7871 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:16.138473  7871 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.138971  7871 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:16.102172  7674 raft_consensus.cc:3060] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:16.142434  1633 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:16.069393  7895 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:16.145394  7809 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:16.146442  7809 raft_consensus.cc:2749] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:16.133541  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:16.147480  1732 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 14.
I20260709 13:03:16.148094  7895 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:16.162938  7866 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:16.110180  1739 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
I20260709 13:03:16.150950  1705 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:16.128412  7894 raft_consensus.cc:2749] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:16.169642  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:16.153240  1633 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:16.203737  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:03:16.204178  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 51103.5us
I20260709 13:03:16.205567  1633 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:16.079234  7843 raft_consensus.cc:697] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 16 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:16.125479  7733 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.151309  7804 raft_consensus.cc:2749] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:16.067500  7787 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:16.134181  7791 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.169308  7746 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 24 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:16.153218  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:16.110280  7715 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.152622  7896 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:16.167186  7658 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:16.057801  7465 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:16.201467  1738 raft_consensus.cc:1240] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:16.207166  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:03:16.210264  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 59411.3us
I20260709 13:03:16.215649  7733 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:16.132203  7859 raft_consensus.cc:697] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 12 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:16.157656  7660 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.230235  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:03:16.210126  7888 log.cc:927] Time spent T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.372s	user 0.003s	sys 0.001s
I20260709 13:03:16.203873  7755 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.243017  1705 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:16.058214  7883 consensus_queue.cc:237] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:16.212927  7809 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:16.102798  7651 consensus_queue.cc:237] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:16.276747  1737 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 24.
I20260709 13:03:16.241232  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:16.278056  1705 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:16.157862  7860 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:16.234309  7868 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:16.218034  7871 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:16.265116  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:03:16.265221  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 251608us
I20260709 13:03:16.233884  7715 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:16.279582  1583 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:03:16.309736  1583 raft_consensus.cc:606] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:16.310129  1583 raft_consensus.cc:614] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:16.225497  7866 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:16.220443  7825 consensus_queue.cc:1048] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:03:16.305601  1732 raft_consensus.cc:2393] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 24: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:16.265501  7746 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:16.305733  1707 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:16.275978  7894 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:16.318590  1707 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:16.263983  7896 raft_consensus.cc:2749] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:16.311213  1705 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:16.232453  7791 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:16.276934  7809 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:16.314837  7871 raft_consensus.cc:2749] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:16.289417  7800 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:16.304335  7895 raft_consensus.cc:2749] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 24 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:03:16.275662  7660 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:16.332615  7746 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:16.350113  7860 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:16.355633  7900 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:16.315634  7878 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:16.385617  7878 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:16.387006  7787 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:16.355891  7871 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:16.280920  7755 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:16.317647  7899 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.413365  7821 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:16.373191  7791 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:16.350117  7465 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:16.374740  7903 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:16.424602  7746 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:16.375993  7859 consensus_queue.cc:237] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:16.354664  7809 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:16.377013  7855 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:16.402992  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 190692us
I20260709 13:03:16.421519  2550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd"
dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:33568
I20260709 13:03:16.424162  7903 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:16.375468  7860 raft_consensus.cc:2749] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:16.434705  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 196190us
I20260709 13:03:16.467968  1558 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:16.315160  7843 consensus_queue.cc:237] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:16.363478  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 323433us
I20260709 13:03:16.369346  7900 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
W20260709 13:03:16.571830  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 260834us
I20260709 13:03:16.460358  2550 raft_consensus.cc:606] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:16.431874  7868 raft_consensus.cc:2749] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:03:16.582496  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 114637us
I20260709 13:03:16.406344  7734 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:16.606448  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 288087us
W20260709 13:03:16.571461  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 113626us
I20260709 13:03:16.333797  7894 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:16.629616  1707 leader_election.cc:400] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 14. Current term is 15.
I20260709 13:03:16.616433  1732 raft_consensus.cc:1275] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:03:16.628800  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:16.611757  1558 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:16.627472  1633 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:16.638304  7755 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:16.639302  7812 consensus_meta.cc:287] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.554s	user 0.016s	sys 0.001s
I20260709 13:03:16.639599  7860 consensus_queue.cc:1048] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:16.585168  7900 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:16.656651  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 300067us
I20260709 13:03:16.657526  1633 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:16.649688  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:16.609581  7876 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:16.571187  7878 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:16.705735  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:16.624257  7871 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:16.415855  7899 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:16.609895  7801 consensus_queue.cc:1048] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.097s
I20260709 13:03:16.666385  7746 raft_consensus.cc:3055] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:16.797923  7746 raft_consensus.cc:740] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:16.667238  7913 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:16.805913  2540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:16.584807  7791 consensus_queue.cc:1048] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.110s
I20260709 13:03:16.692396  7804 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.820176  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:16.820848  1736 raft_consensus.cc:1275] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:03:16.838248  7734 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:16.841861  7908 raft_consensus.cc:2804] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:16.842555  7908 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:16.843132  7908 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:16.792243  7878 raft_consensus.cc:2804] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:16.845428  7878 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.845804  7878 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:16.799216  7746 consensus_queue.cc:260] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:16.721649  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 110398us
I20260709 13:03:16.656100  7674 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:16.859899  7674 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:16.854861  7746 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:16.855866  7860 raft_consensus.cc:2804] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:16.865054  7804 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:16.865867  7860 raft_consensus.cc:697] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 17 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:16.867534  7860 consensus_queue.cc:237] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:16.689868  7812 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:16.870020  1734 raft_consensus.cc:2393] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 16: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
W20260709 13:03:16.868894  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:16.868700  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 73488.8us
I20260709 13:03:16.873639  1558 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:16.678478  7712 consensus_queue.cc:1048] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.126s
I20260709 13:03:16.875301  1736 raft_consensus.cc:1240] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:03:16.884892  1558 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:16.808370  7903 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:16.912699  1558 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:16.711678  7876 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:16.915171  7800 raft_consensus.cc:2804] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:16.915352  7876 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:16.915705  7800 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:16.916069  1738 raft_consensus.cc:3055] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:16.916419  1738 raft_consensus.cc:740] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:16.916548  7800 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:16.917361  1738 consensus_queue.cc:260] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:16.918296  7821 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:16.918411  1738 raft_consensus.cc:3060] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:16.918968  7821 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:16.919468  7821 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:16.931898  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.871599  7812 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:16.880402  7804 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:16.789121  7871 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:16.942636  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:16.943929  1584 raft_consensus.cc:2393] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 18: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:16.909840  7855 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:16.909283  7903 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.948019  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:16.949394  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:16.951333  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:16.952478  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:03:16.936640  7688 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.452s	user 0.027s	sys 0.030s
I20260709 13:03:16.927934  7911 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:16.965957  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:16.892736  7674 consensus_queue.cc:1048] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:03:16.967831  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:16.968684  1589 raft_consensus.cc:2393] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 11: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:16.972695  1738 raft_consensus.cc:1275] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 13:03:16.974076  7894 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:16.974805  1738 pending_rounds.cc:85] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 12
I20260709 13:03:16.959431  7711 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:03:16.976046  7711 raft_consensus.cc:697] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 24 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:16.977051  7711 consensus_queue.cc:237] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:16.981392  7734 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:16.982951  1738 pending_rounds.cc:107] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:03:16.982189  7734 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:16.983263  1738 raft_consensus.cc:2889] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:16.983453  7871 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:16.984076  7911 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:16.985688  7658 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.986228  7658 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:16.986583  7911 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:16.972880  7754 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:16.987237  7754 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:16.992336  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:16.993284  1589 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 19.
I20260709 13:03:16.994318  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:16.995281  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:16.957263  7855 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:16.964265  7688 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.480s	user 0.027s	sys 0.030s
I20260709 13:03:16.978518  7878 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:17.001945  7733 consensus_meta.cc:287] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.726s	user 0.012s	sys 0.002s
I20260709 13:03:17.046979  7855 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:16.968936  7883 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.026s	sys 0.077s
I20260709 13:03:17.013752  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:17.023514  7859 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
W20260709 13:03:17.058310  7883 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.027s	sys 0.080s
I20260709 13:03:16.988633  7658 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:17.013149  7911 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.071785  1584 raft_consensus.cc:2393] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 13: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:17.002791  7748 raft_consensus.cc:3055] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:16.964183  7903 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:17.072127  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:17.046587  7734 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:17.070976  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:17.088771  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:17.070469  7754 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:03:17.064215  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 366489us
I20260709 13:03:17.097275  1589 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 16.
I20260709 13:03:17.053264  7733 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:17.088685  7922 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.078419  7748 raft_consensus.cc:740] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:17.128930  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:17.064409  7859 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:17.092039  7925 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:17.139956  1586 raft_consensus.cc:1240] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:03:17.084228  7911 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:17.142268  7843 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:17.163762  7711 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:17.131388  7922 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:17.148516  7925 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:17.155697  7929 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:17.201059  2540 raft_consensus.cc:1240] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:17.158308  7899 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:17.158151  7688 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:17.197494  7711 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:17.199447  7843 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:17.199973  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:17.167217  7930 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:17.167057  7860 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:17.158450  7748 consensus_queue.cc:260] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:17.221491  1741 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.022s	sys 0.009s
I20260709 13:03:17.242434  7748 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:17.257611  7938 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:17.258265  7938 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:17.226086  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:17.226722  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:03:17.227206  7915 log.cc:927] Time spent T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.208s	user 0.000s	sys 0.002s
I20260709 13:03:17.440845  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:17.240922  7911 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:17.235925  7927 log.cc:927] Time spent T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:03:17.242833  7925 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:03:17.233393  7914 log.cc:927] Time spent T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.240s	user 0.000s	sys 0.002s
I20260709 13:03:17.255987  7733 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:17.213909  7929 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:17.236423  7920 log.cc:927] Time spent T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
W20260709 13:03:17.245896  7715 consensus_meta.cc:287] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.928s	user 0.014s	sys 0.000s
W20260709 13:03:17.272202  7809 consensus_meta.cc:287] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.687s	user 0.016s	sys 0.000s
I20260709 13:03:17.253856  7903 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:17.442564  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:17.236752  7711 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:17.245767  7947 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.244176  7859 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:17.245380  7878 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:17.438728  2548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49238 (request call id 712) took 1429 ms. Trace:
I20260709 13:03:17.444212  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:17.230935  7688 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:17.448496  1556 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.703s (SENT) [suppressed 45 similar messages]
I20260709 13:03:17.238181  7843 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:17.439253  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 55853.5us
I20260709 13:03:17.239974  7913 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:17.450522  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:03:17.523020  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 74545.8us
W20260709 13:03:17.251502  1741 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.022s	sys 0.009s
I20260709 13:03:17.455890  7938 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:17.546782  1587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46836 (request call id 910) took 1799 ms. Trace:
I20260709 13:03:17.517717  7947 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:17.548014  7846 raft_consensus.cc:993] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:03:17.548533  7846 raft_consensus.cc:1081] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:03:17.549352  7947 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:17.553117  7804 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:17.553825  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:17.555353  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:17.556341  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:17.558703  1733 raft_consensus.cc:2393] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 12: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:17.559450  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:17.560266  7880 consensus_queue.cc:1048] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:17.560693  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:17.561911  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:17.562641  1733 raft_consensus.cc:3060] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:17.248978  7860 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:17.457599  2543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49222 (request call id 753) took 1622 ms. Trace:
I20260709 13:03:17.249121  7930 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:17.221601  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:17.458698  1659 raft_consensus.cc:1275] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:03:17.466499  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:03:17.249747  7928 log.cc:927] Time spent T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:03:17.477573  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:17.575902  1591 raft_consensus.cc:2468] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:03:17.477818  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:17.438723  7821 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:17.580353  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:17.581067  1738 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:17.479332  7932 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:17.582917  7932 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:17.458277  7746 consensus_meta.cc:287] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.597s	user 0.014s	sys 0.009s
I20260709 13:03:17.479142  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:03:17.471813  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 220981us
I20260709 13:03:17.589180  1736 raft_consensus.cc:2468] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:03:17.590528  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:03:17.457360  7866 consensus_meta.cc:287] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 1.125s	user 0.008s	sys 0.011s
I20260709 13:03:17.593111  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:17.593379  7866 raft_consensus.cc:2749] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:17.594396  1740 raft_consensus.cc:1275] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:03:17.594753  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:17.596028  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:17.500100  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:17.597450  1732 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
W20260709 13:03:17.459177  7923 log.cc:927] Time spent T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.372s	user 0.000s	sys 0.006s
W20260709 13:03:17.456856  7937 log.cc:927] Time spent T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.223s	user 0.005s	sys 0.000s
I20260709 13:03:17.449527  7825 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.602732  7825 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:17.498286  7715 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:17.606040  1588 raft_consensus.cc:2393] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 14: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:17.515466  2548 rpcz_store.cc:276] 0709 13:03:16.009460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.011217 (+  1757us) service_pool.cc:224] Handling call
0709 13:03:16.011639 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:16.134616 (+122977us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:17.379022 (+1244406us) spinlock_profiling.cc:243] Waited 98.9 ms on lock 0x7b540025f3d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:03:17.438663 (+ 59641us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":227412352}
I20260709 13:03:17.522225  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:17.607295  7715 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:17.509786  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.524890  1741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 4203) took 1565 ms. Trace:
I20260709 13:03:17.609473  1741 rpcz_store.cc:276] 0709 13:03:15.959365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.959650 (+   285us) service_pool.cc:224] Handling call
0709 13:03:15.960070 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:16.097431 (+137361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:16.097495 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:16.098105 (+   610us) log.cc:844] Serialized 26 byte log entry
0709 13:03:16.451884 (+353779us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:17.524236 (+1072352us) log.cc:844] Serialized 14 byte log entry
0709 13:03:17.524472 (+   236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:17.524563 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:17.524629 (+    66us) raft_consensus.cc:1685] finished
0709 13:03:17.524645 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:17.524824 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":155717,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":50,"raft.queue_time_us":74338,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":25935,"thread_start_us":1445676,"threads_started":3,"wal-append.queue_time_us":578379}
I20260709 13:03:17.526052  7896 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:17.613961  7896 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.614616  1664 raft_consensus.cc:1275] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:03:17.614436  7896 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:17.594419  7938 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:17.619038  7932 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:17.528834  7688 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:17.553726  7804 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:17.616945  7938 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:17.533363  1739 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43678 (request call id 4204) took 1573 ms (client timeout 1706 ms). Trace:
I20260709 13:03:17.623653  7804 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:17.623839  1739 rpcz_store.cc:269] 0709 13:03:15.959668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.960088 (+   420us) service_pool.cc:224] Handling call
0709 13:03:17.533185 (+1573097us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54000e6d54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:03:17.533297 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":276168960}
W20260709 13:03:17.535071  7900 consensus_meta.cc:287] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.823s	user 0.011s	sys 0.001s
I20260709 13:03:17.625392  7900 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:17.627686  7900 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:17.535454  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:03:17.536338  1590 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 3344) took 1903 ms (client timeout 1654 ms). Trace:
W20260709 13:03:17.629302  1590 rpcz_store.cc:269] 0709 13:03:15.632540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.632680 (+   140us) service_pool.cc:224] Handling call
0709 13:03:17.536057 (+1903377us) spinlock_profiling.cc:243] Waited 457 ms on lock 0x7b54002b84d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:03:17.536224 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1051344768}
I20260709 13:03:17.538126  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:17.630271  7748 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.630781  1592 raft_consensus.cc:2410] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
W20260709 13:03:17.538585  7800 consensus_meta.cc:287] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.621s	user 0.013s	sys 0.004s
I20260709 13:03:17.538846  1735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 4201) took 1580 ms. Trace:
I20260709 13:03:17.631634  7800 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:17.631633  1735 rpcz_store.cc:276] 0709 13:03:15.958565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.958821 (+   256us) service_pool.cc:224] Handling call
0709 13:03:15.959395 (+   574us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:16.171888 (+212493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:16.171928 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:16.203428 (+ 31500us) log.cc:844] Serialized 26 byte log entry
0709 13:03:16.407176 (+203748us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:16.426833 (+ 19657us) log.cc:844] Serialized 14 byte log entry
0709 13:03:16.427362 (+   529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.427656 (+   294us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:17.179905 (+752249us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b18004337e0. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7dea23f3 00007f1b7dea47c1 00007f1b7dea4779 00007f1b7dea4709 00007f1b7dea46d1 00007f1b7dea39cd 000000000038f354 000000000038f199 00007f1b7de8583a
0709 13:03:17.538553 (+358648us) raft_consensus.cc:1685] finished
0709 13:03:17.538657 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:17.538788 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23893,"prepare.queue_time_us":24073,"prepare.run_cpu_time_us":5225,"prepare.run_wall_time_us":16670,"raft.queue_time_us":78753,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":16935,"spinlock_wait_cycles":6070528,"thread_start_us":370063,"threads_started":2,"wal-append.queue_time_us":703201}
I20260709 13:03:17.633929  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:17.634258  7800 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:17.634496  1735 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:17.540006  1584 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:03:17.637436  1584 raft_consensus.cc:606] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:17.541711  7929 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:17.507366  7809 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:17.639971  7809 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:17.543320  1707 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:03:17.640807  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 97547.9us
I20260709 13:03:17.544559  7922 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:17.547317  1587 rpcz_store.cc:276] 0709 13:03:15.747312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.761677 (+ 14365us) service_pool.cc:224] Handling call
0709 13:03:15.762288 (+   611us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:15.763072 (+   784us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:03:15.979809 (+216737us) spinlock_profiling.cc:243] Waited 7.38 ms on lock 0x7b180030e020. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7de84e07 00007f1b86cdfab9 00007f1b7dea169b 00007f1b7de9f93f 00007f1b7de9f455 00007f1b849873c7 00007f1b80f999a7 00007f1b80fa90bf 00007f1b80fa9038
0709 13:03:16.267444 (+287635us) log.cc:844] Serialized 14 byte log entry
0709 13:03:17.214040 (+946596us) log.cc:844] Serialized 14 byte log entry
0709 13:03:17.227105 (+ 13065us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:17.227607 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 13:03:17.227839 (+   232us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:17.227877 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:17.227945 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:17.546557 (+318612us) raft_consensus.cc:1685] finished
0709 13:03:17.546579 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:17.546705 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52961,"prepare.queue_time_us":803380,"prepare.run_cpu_time_us":7978,"prepare.run_wall_time_us":169974,"raft.queue_time_us":147423,"raft.run_cpu_time_us":543,"raft.run_wall_time_us":40796,"spinlock_wait_cycles":16978688,"thread_start_us":1129333,"threads_started":4,"wal-append.queue_time_us":690003}
I20260709 13:03:17.564656  2543 rpcz_store.cc:276] 0709 13:03:15.817687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.838346 (+ 20659us) service_pool.cc:224] Handling call
0709 13:03:17.385820 (+1547474us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b5400753354. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:03:17.439792 (+ 53972us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2824015104}
W20260709 13:03:17.570317  7941 log.cc:927] Time spent T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.084s	user 0.000s	sys 0.002s
I20260709 13:03:17.532553  7660 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:17.574414  1660 raft_consensus.cc:1275] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:03:17.577971  1633 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.011s	sys 0.006s
I20260709 13:03:17.579365  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:03:17.665858  1633 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.011s	sys 0.006s
I20260709 13:03:17.580116  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:17.594396  7727 consensus_queue.cc:1048] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:17.640893  1485 catalog_manager.cc:5697] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 9 to 11, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 11 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:17.649883  7715 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:17.668725  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:17.612068  1740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43686 (request call id 2727) took 1445 ms. Trace:
I20260709 13:03:17.669593  1740 rpcz_store.cc:276] 0709 13:03:16.167231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.275423 (+108192us) service_pool.cc:224] Handling call
0709 13:03:16.308181 (+ 32758us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:17.594816 (+1286635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:17.611846 (+ 17030us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54001f6b54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:03:17.612008 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2957197696}
I20260709 13:03:17.607681  1586 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:17.562187  7880 consensus_queue.cc:1048] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:03:17.500970  7908 consensus_meta.cc:287] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.657s	user 0.014s	sys 0.006s
W20260709 13:03:17.648288  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 196671us
I20260709 13:03:17.652981  1738 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 18.
I20260709 13:03:17.667060  1734 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16.
I20260709 13:03:17.649181  1707 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:17.616852  7896 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:03:17.688664  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.689378  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:17.691116  1588 raft_consensus.cc:1275] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:03:17.693336  1733 raft_consensus.cc:2468] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:03:17.703868  1558 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:17.697659  1555 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:17.708698  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:17.709167  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:17.670246  7651 raft_consensus.cc:2804] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:17.669955  7929 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:17.710042  1666 raft_consensus.cc:2410] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:03:17.712209  1558 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:17.712982  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:17.713699  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:17.721905  1667 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 16.
I20260709 13:03:17.723007  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:17.715381  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:17.673893  7922 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:17.734046  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:17.734992  1666 raft_consensus.cc:2468] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12.
I20260709 13:03:17.717133  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:17.720510  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:17.729171  1558 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:17.738246  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:17.739467  1663 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:03:17.682392  7825 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:17.715356  7651 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.718662  7911 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:17.755790  1486 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55154 (request call id 307) took 37634 ms (client timeout 15000 ms). Trace:
I20260709 13:03:17.741364  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:17.742117  7934 raft_consensus.cc:2749] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:17.630789  7748 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:17.746678  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:17.774926  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:17.775563  1660 raft_consensus.cc:2468] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:03:17.776347  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:17.747051  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:17.746763  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:17.748471  1662 raft_consensus.cc:2393] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 24: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:17.777626  1661 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 14.
I20260709 13:03:17.778497  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:17.749939  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:17.751226  1592 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:03:17.779665  1592 raft_consensus.cc:606] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:17.780004  1592 raft_consensus.cc:614] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:17.752269  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:17.742527  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:17.751600  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:17.764017  1586 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 16.
I20260709 13:03:17.767153  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:17.701804  7900 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.669402  7715 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:17.778344  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:17.786504  1662 raft_consensus.cc:2393] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 16: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:17.787654  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:17.779906  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:17.780903  1658 raft_consensus.cc:2410] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:03:17.781147  1733 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:17.779204  1661 raft_consensus.cc:2468] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 9.
I20260709 13:03:17.734144  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:17.716262  7843 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.788501  1662 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16.
I20260709 13:03:17.720705  7938 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:17.718246  7809 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:03:17.756404  1486 rpcz_store.cc:269] 0709 13:02:40.103781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.104010 (+   229us) service_pool.cc:224] Handling call
0709 13:02:40.356645 (+252635us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b5400119254. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef9090 00007f1b80f97f3a 00007f1b86d4e1cc 00007f1b86e4c37e 00007f1b8530d2a4 00007f1b8530d232 00007f1b8530d161 00007f1b8530d0dc 00007f1b8530c392 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:03:17.738417 (+37381772us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:11.211288 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:11.212020 (+   732us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:11.212077 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:03:11.212096 (+    19us) tablet.cc:662] Decoding operations
0709 13:03:11.213100 (+  1004us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:11.213202 (+   102us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:11.213228 (+    26us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:03:11.213948 (+   720us) tablet.cc:701] Row locks acquired
0709 13:03:11.213992 (+    44us) write_op.cc:260] PREPARE: finished
0709 13:03:11.214159 (+   167us) write_op.cc:270] Start()
0709 13:03:11.214315 (+   156us) write_op.cc:276] Timestamp: P: 1783602191214089 usec, L: 0
0709 13:03:11.214346 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:03:11.279607 (+ 65261us) log.cc:844] Serialized 2860 byte log entry
0709 13:03:12.031104 (+751497us) op_driver.cc:464] REPLICATION: finished
0709 13:03:12.216261 (+185157us) write_op.cc:301] APPLY: starting
0709 13:03:12.216371 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:12.305989 (+ 89618us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:12.306116 (+   127us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:12.338623 (+ 32507us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:12.342465 (+  3842us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 13:03:12.342530 (+    65us) write_op.cc:312] APPLY: finished
0709 13:03:12.342891 (+   361us) log.cc:844] Serialized 73 byte log entry
0709 13:03:12.345653 (+  2762us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:12.345830 (+   177us) write_op.cc:454] Released schema lock
0709 13:03:12.345931 (+   101us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:12.374969 (+ 29038us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:12.377279 (+  2310us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":158727,"reported_tablets":52,"spinlock_wait_cycles":536783616,"child_traces":[["op",{"apply.queue_time_us":184730,"apply.run_cpu_time_us":16048,"apply.run_wall_time_us":134619,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33387,"num_ops":7,"prepare.queue_time_us":111702,"prepare.run_cpu_time_us":27264,"prepare.run_wall_time_us":330385,"raft.queue_time_us":179130,"raft.run_cpu_time_us":10492,"raft.run_wall_time_us":68015,"replication_time_us":816472,"thread_start_us":415477,"threads_started":4,"wal-append.queue_time_us":394603,"wal-append.run_cpu_time_us":17447,"wal-append.run_wall_time_us":1668346}]]}
I20260709 13:03:17.801391  7809 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:17.803702  7809 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:17.803766  7930 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:17.804862  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:17.795780  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:17.748961  1558 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:17.709968  7949 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.810672  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:17.717554  7859 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:17.740543  7800 raft_consensus.cc:3055] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:17.743867  7674 raft_consensus.cc:2749] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:17.710750  7688 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:17.798810  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:17.823669  1663 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:17.824262  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 75412.2us
I20260709 13:03:17.798949  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:17.692359  7908 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:17.734620  7935 raft_consensus.cc:2749] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:17.805296  7855 consensus_meta.cc:287] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.735s	user 0.008s	sys 0.008s
I20260709 13:03:17.766409  7651 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:17.813244  1658 raft_consensus.cc:1240] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:03:17.769618  7502 raft_consensus.cc:2749] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:17.814800  1665 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 13.
I20260709 13:03:17.809736  1735 raft_consensus.cc:2468] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:03:17.820081  1733 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 14.
I20260709 13:03:17.826174  1558 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:17.842051  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:17.844457  1661 raft_consensus.cc:1240] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:17.796814  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:17.869570  1558 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:17.855175  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:17.752851  7922 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:17.857635   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:03:17.748802  7929 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:17.669493  1485 catalog_manager.cc:5697] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:17.870497  1659 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 14.
I20260709 13:03:17.822791  7800 raft_consensus.cc:740] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:17.877467  1735 raft_consensus.cc:1240] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 24 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 23. Current term is 24. Ops: []
I20260709 13:03:17.875769  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:17.876269  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:17.879323  1558 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:17.797720  7900 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:17.853001  7934 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:17.771323  7911 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:17.866326  7942 log.cc:927] Time spent T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.365s	user 0.001s	sys 0.000s
I20260709 13:03:17.873035   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:17.888088  1661 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16.
I20260709 13:03:17.888528  1660 raft_consensus.cc:2468] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 9.
I20260709 13:03:17.901582  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:03:17.889640  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 332815us
I20260709 13:03:17.813109  7843 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:17.897585  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:17.903182  1659 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:17.880342  7660 raft_consensus.cc:2804] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:17.846027  7859 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:17.886044  7674 raft_consensus.cc:2749] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:17.853240  7688 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:17.917624  1660 raft_consensus.cc:1275] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:17.842710  7949 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:17.923898  1662 raft_consensus.cc:1275] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:03:17.887032  7952 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.928886  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:17.929040  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:17.867213  7855 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:17.917657  1663 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 16.
I20260709 13:03:17.933647  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:17.938416  1663 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 14.
I20260709 13:03:17.938946  1666 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 18.
I20260709 13:03:17.941275  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:17.921289  7660 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.943450  1667 raft_consensus.cc:2468] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
I20260709 13:03:17.945472  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:17.945858  1633 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:17.952220  1663 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 18.
I20260709 13:03:17.954342  1583 raft_consensus.cc:2393] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 17: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:17.934334  7932 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.930765  7860 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:03:17.964179  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 278199us
W20260709 13:03:17.974033  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:17.974575  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.953588  7660 raft_consensus.cc:3060] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:17.969302  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:17.973011  1736 raft_consensus.cc:1275] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 24 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:03:17.979760  1707 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:17.989008  1663 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15.
I20260709 13:03:17.991565  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:17.955742  1633 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:17.993410  7860 raft_consensus.cc:2749] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:17.994308  1633 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:17.995324  7860 raft_consensus.cc:2749] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:17.996450  1633 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:17.960326  7930 raft_consensus.cc:2749] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:17.992698  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:03:18.009724  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.939535  7952 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:18.019428  1707 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:18.027609  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:18.002892  7830 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:03:18.013191  7848 raft_consensus.cc:2804] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:17.975870  7932 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:18.030014  1663 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:18.029529  7930 consensus_queue.cc:1059] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
W20260709 13:03:18.032725  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 153375us
I20260709 13:03:18.025846  7465 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:18.056444  1705 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:17.939723  7800 consensus_queue.cc:260] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:18.031697  7843 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:18.019061  7748 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:17.997725  7866 consensus_queue.cc:1059] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:03:18.026113  7896 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
W20260709 13:03:18.036761  7950 log.cc:927] Time spent T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.179s	user 0.002s	sys 0.000s
I20260709 13:03:18.051636  7502 raft_consensus.cc:2804] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:18.081537  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:18.075681  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:18.079852  1659 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 18.
I20260709 13:03:18.078155  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:18.075215  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:18.081250  1660 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 15.
I20260709 13:03:18.061721  7925 raft_consensus.cc:2749] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:18.086062  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:18.088251  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:18.084964  1584 raft_consensus.cc:2393] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 13: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:18.090255  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:18.083282  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:18.093390  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:18.094071  1705 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:18.099092  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:18.041932  7825 consensus_queue.cc:1048] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:03:18.062450  7848 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:18.094905  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:18.101372  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:18.080431  7830 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:18.141520  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:18.087497  7922 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:18.083588  7502 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.086750  7800 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:18.130441  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:18.157331  7502 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:18.161026  1659 raft_consensus.cc:1240] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 24 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 23. Current term is 24. Ops: []
I20260709 13:03:18.095644  7866 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:18.157202  7958 log.cc:927] Time spent T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:03:18.183442  1659 raft_consensus.cc:1275] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 24 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:03:18.142797  7465 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:18.138851  7848 raft_consensus.cc:3060] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:18.085299  7896 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:18.150470  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:18.142700  7911 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:18.164568  7859 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:18.151803  1663 raft_consensus.cc:2468] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:03:18.191943  7465 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:18.154392  7957 log.cc:927] Time spent T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:03:18.155376  7960 log.cc:927] Time spent T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:03:18.156301  7959 log.cc:927] Time spent T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:03:18.105926  1705 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:18.100742  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:18.149654  1588 raft_consensus.cc:2368] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 17. Current term is 18.
I20260709 13:03:18.197628  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:03:18.237418  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 131574us
I20260709 13:03:18.152580  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:03:18.233294  7954 log.cc:927] Time spent T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 13:03:18.240694  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:18.242348  7908 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:18.234728  7952 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:18.238214  1705 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:18.238561  1584 raft_consensus.cc:2393] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 14: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:18.162235  7830 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:18.068126  1485 catalog_manager.cc:5697] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:18.213943  7900 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:18.222244  7866 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:18.246815  1658 raft_consensus.cc:1240] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:03:18.259229  7935 raft_consensus.cc:2764] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:03:18.261232  1590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46836 (request call id 916) took 1094 ms. Trace:
I20260709 13:03:18.230378  7465 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:18.282521  1732 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.021s	sys 0.027s
W20260709 13:03:18.303869  1732 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.021s	sys 0.028s
I20260709 13:03:18.300583  1590 rpcz_store.cc:276] 0709 13:03:17.167440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.673915 (+506475us) service_pool.cc:224] Handling call
0709 13:03:17.674264 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:17.683861 (+  9597us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:17.683892 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:17.684341 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 13:03:17.939202 (+254861us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:17.939265 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:17.939365 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:18.260975 (+321610us) raft_consensus.cc:1685] finished
0709 13:03:18.261000 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:18.261165 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9215,"raft.queue_time_us":28690,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":11441,"thread_start_us":254538,"threads_started":1,"wal-append.queue_time_us":333201}
I20260709 13:03:18.285933  1633 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:18.290206  1588 raft_consensus.cc:1240] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 14. Current term is 15. Ops: []
W20260709 13:03:18.290371  7956 log.cc:927] Time spent T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
I20260709 13:03:18.291134  7660 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:18.293131  7900 raft_consensus.cc:2804] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:18.325894  7900 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:18.326404  7900 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:18.327047  7804 raft_consensus.cc:3055] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:18.327471  7804 raft_consensus.cc:740] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:18.331244  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:18.334127  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:18.335589  1737 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:18.336094  1738 raft_consensus.cc:1275] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:03:18.337791  1738 raft_consensus.cc:1275] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:18.339052  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:18.339350  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:18.340745  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:18.341024  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:18.341342  1735 raft_consensus.cc:2468] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 9.
I20260709 13:03:18.342202  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:18.348620  1741 raft_consensus.cc:2393] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 13: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:18.349706  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:18.350796  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:18.351517  1735 raft_consensus.cc:2393] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 14: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:18.352073  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:18.352648  1658 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:18.352921  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:18.353544  1661 raft_consensus.cc:2376] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13. Re-sending same reply.
I20260709 13:03:18.354403  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:18.354552  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:18.303601  7846 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:18.357127  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:18.367553  1585 raft_consensus.cc:2393] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 10: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:18.366036  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:18.368247  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:18.370326  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:18.370488  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:18.371485  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:18.372568  1735 raft_consensus.cc:1240] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:03:18.312254  7651 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:18.373330  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:18.320197  7922 raft_consensus.cc:2804] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:18.374249  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:18.374349  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:18.328686  7804 consensus_queue.cc:260] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:18.375849  1737 raft_consensus.cc:1275] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:03:18.379055  1736 raft_consensus.cc:2368] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 17. Current term is 18.
I20260709 13:03:18.376809  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:18.378265  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:18.381543  7651 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:18.383193  7651 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:18.383723  7651 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:18.378225  1633 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:18.350883  7949 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:18.386348  7952 raft_consensus.cc:2749] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:18.387969  1633 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:03:18.392077  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 117309us
I20260709 13:03:18.392925  1705 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:18.394320  1705 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:18.395992  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.303828  7866 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:18.403294  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:18.404085  1737 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 17.
I20260709 13:03:18.399066  1705 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:18.405942  1705 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:18.399083  1633 leader_election.cc:400] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 17. Current term is 18.
I20260709 13:03:18.407509  1633 leader_election.cc:403] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:03:18.407814  1658 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
I20260709 13:03:18.374675  7935 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.378810  7922 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.426844  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:18.428520  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:18.429428  1736 raft_consensus.cc:2368] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 19. Current term is 20.
I20260709 13:03:18.398337  7859 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.468478  1741 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 19.
I20260709 13:03:18.404397  1591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2611) took 1379 ms. Trace:
I20260709 13:03:18.422602  7804 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:18.400991  7932 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:18.469828  1735 raft_consensus.cc:1275] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:18.377775  7846 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:18.423095  7908 raft_consensus.cc:2749] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 17. Current term is 18.
I20260709 13:03:18.391992  7952 raft_consensus.cc:2749] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:18.535637  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:18.542900  1735 raft_consensus.cc:1240] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:03:18.423271  7949 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.433581  7922 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:18.528980  7969 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:18.553762  7973 raft_consensus.cc:2804] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:18.554142  7969 raft_consensus.cc:2749] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:18.554286  7973 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:18.554858  7973 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:18.530768  1591 rpcz_store.cc:276] 0709 13:03:17.024960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.576536 (+551576us) service_pool.cc:224] Handling call
0709 13:03:17.576880 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:17.601520 (+ 24640us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:17.601555 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:17.602779 (+  1224us) log.cc:844] Serialized 26 byte log entry
0709 13:03:17.871105 (+268326us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:17.871146 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:17.871216 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:18.404185 (+532969us) raft_consensus.cc:1685] finished
0709 13:03:18.404209 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:18.404336 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24188,"raft.queue_time_us":30696,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"thread_start_us":267957,"threads_started":1,"wal-append.queue_time_us":465763}
I20260709 13:03:18.548101  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:18.549314  1736 raft_consensus.cc:2393] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 14: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:18.548753  1633 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:18.563339  1633 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:18.565719  1740 raft_consensus.cc:2393] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 11: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:18.568464  1633 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:18.465974  7911 consensus_queue.cc:1059] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.095s
W20260709 13:03:18.582343  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 176457us
I20260709 13:03:18.545805  7970 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:03:18.533167  7859 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:18.563629  7952 consensus_queue.cc:1048] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:03:18.580334  7896 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:18.586524  7809 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:18.565397  7908 consensus_queue.cc:1048] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:03:18.561874  7949 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:18.537377  7935 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:18.604245  7748 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:03:18.624063  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.612547  1705 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:18.745922  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 133499us
I20260709 13:03:18.748481  7977 raft_consensus.cc:2749] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:18.651542  7688 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:18.633821  7651 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:18.633287  7660 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:18.644315  7465 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:18.753768  7465 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:18.754786  1738 raft_consensus.cc:2393] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 17: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:18.650507  1485 catalog_manager.cc:5697] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:18.650982  7715 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:18.663134  7848 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:18.760668  7848 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:18.663372  1583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 3348) took 1731 ms. Trace:
I20260709 13:03:18.670385  1732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 4236) took 1200 ms. Trace:
I20260709 13:03:18.747081  1705 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:03:18.618674  7965 log.cc:927] Time spent T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 13:03:18.764312  1583 rpcz_store.cc:276] 0709 13:03:16.939078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.939886 (+   808us) service_pool.cc:224] Handling call
0709 13:03:18.663182 (+1723296us) spinlock_profiling.cc:243] Waited 987 ms on lock 0x7b54000bbb54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:03:18.663315 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2269036288}
W20260709 13:03:18.811129  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 64254us
I20260709 13:03:18.764597  1732 rpcz_store.cc:276] 0709 13:03:17.470352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.599213 (+128861us) service_pool.cc:224] Handling call
0709 13:03:17.599508 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:17.644359 (+ 44851us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:03:17.681922 (+ 37563us) log.cc:844] Serialized 14 byte log entry
0709 13:03:18.304464 (+622542us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:18.304538 (+    74us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:18.304585 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:18.670140 (+365555us) spinlock_profiling.cc:243] Waited 44.6 ms on lock 0x7b5400276d54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:03:18.670185 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:18.670320 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":37839,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":3272,"raft.queue_time_us":18902,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":22601,"spinlock_wait_cycles":102632832,"thread_start_us":622124,"threads_started":1,"wal-append.queue_time_us":726271}
W20260709 13:03:18.663203  7502 consensus_meta.cc:287] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.505s	user 0.008s	sys 0.002s
W20260709 13:03:18.810191  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 277221us
I20260709 13:03:18.642621  7859 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:18.819010  1705 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:18.648713  7938 raft_consensus.cc:993] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5ced62816f8545cd9b63a27e9055e42d to start an election
W20260709 13:03:18.619186  7968 log.cc:927] Time spent T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:03:18.661823  7846 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:03:18.627072  7935 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:18.670534  7949 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:18.778376  1485 catalog_manager.cc:5697] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 11 to 12, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 12 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:03:18.821828  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 141320us
I20260709 13:03:18.616143  7980 raft_consensus.cc:2804] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:18.825536  1664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 4269) took 1065 ms. Trace:
W20260709 13:03:18.882401  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.871778  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:18.872308  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:03:18.911331  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 342928us
I20260709 13:03:18.965772  1633 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:18.900986  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 82107.2us
W20260709 13:03:18.879491  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 813082us
W20260709 13:03:18.898511  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 74760.8us
I20260709 13:03:18.677304  7869 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
W20260709 13:03:18.984422  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.829385  7991 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:18.968912  1705 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:18.768987  7465 raft_consensus.cc:2749] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:18.842346  7978 log.cc:927] Time spent T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.240s	user 0.000s	sys 0.002s
I20260709 13:03:19.001793  1705 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:18.668852  7900 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:18.825577  7860 raft_consensus.cc:3055] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:18.992656  1633 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:18.846589  7979 log.cc:927] Time spent T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
W20260709 13:03:18.828191  7962 log.cc:927] Time spent T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.789s	user 0.008s	sys 0.007s
I20260709 13:03:18.843127  7830 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:18.837136  7929 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:18.974299  1664 rpcz_store.cc:276] 0709 13:03:17.760059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.884605 (+124546us) service_pool.cc:224] Handling call
0709 13:03:17.909989 (+ 25384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:17.952200 (+ 42211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:17.952231 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:17.969006 (+ 16775us) log.cc:844] Serialized 26 byte log entry
0709 13:03:18.094254 (+125248us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:18.094307 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:18.671343 (+577036us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b540019aad4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:03:18.671390 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:18.825169 (+153779us) raft_consensus.cc:1685] finished
0709 13:03:18.825191 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:18.825452 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6861,"raft.queue_time_us":5214,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":6281,"spinlock_wait_cycles":53396736,"thread_start_us":91673,"threads_started":1,"wal-append.queue_time_us":335503}
I20260709 13:03:18.670819  7866 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:18.846761  7855 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:18.866191  1662 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:58814
I20260709 13:03:18.824424  7848 raft_consensus.cc:2749] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:18.830809  7908 raft_consensus.cc:3055] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:18.991073  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:19.006562  1705 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:18.916378  7878 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.823956  7502 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:18.963510  7727 raft_consensus.cc:1081] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Signalling peer 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:03:19.004335  7949 raft_consensus.cc:2749] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:19.012450  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:19.004433  7804 raft_consensus.cc:2804] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:18.964145  7980 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.014268  1633 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:19.015668  7988 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:19.017884   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:19.019264  1558 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:19.024340  1662 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:19.051685  1662 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:18.845954  7973 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:19.029510  1705 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:19.021265  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:19.058574  1592 raft_consensus.cc:1240] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:19.013749  7970 raft_consensus.cc:2804] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:19.007372  7860 raft_consensus.cc:740] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:18.991353  7922 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:19.047821  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 165863us
I20260709 13:03:19.023186  7938 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.026050  7791 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.054322  1633 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:19.007373  7976 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:19.058620  1705 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:19.059322  1558 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:19.054639  2424 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:19.028337  7908 raft_consensus.cc:740] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:19.007045  7869 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:19.042833  7866 raft_consensus.cc:2804] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:19.005702  7991 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:19.038897  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
W20260709 13:03:19.131886  7986 log.cc:927] Time spent T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:03:19.022395  7983 consensus_queue.cc:1048] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:03:19.046459  7804 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.133374  7804 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:19.061405  7989 log.cc:927] Time spent T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:03:19.084296  1485 catalog_manager.cc:5697] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:19.138948  1733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35672 (request call id 873) took 1564 ms. Trace:
I20260709 13:03:19.139770  1485 catalog_manager.cc:5697] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:19.140611  7651 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.141295  7651 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:19.139354  1733 rpcz_store.cc:276] 0709 13:03:17.574567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.881684 (+307117us) service_pool.cc:224] Handling call
0709 13:03:17.882193 (+   509us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:17.882755 (+   562us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:17.882800 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:17.883422 (+   622us) log.cc:844] Serialized 26 byte log entry
0709 13:03:18.678694 (+795272us) spinlock_profiling.cc:243] Waited 2.75 ms on lock 0x7b1800339b80. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7de84e07 00007f1b86cdfab9 00007f1b7dea169b 00007f1b7de9f93f 00007f1b7dea1c02 00007f1b80b2920b 00007f1b80b2ed23 00007f1b80b2f0d1 00007f1b80f4aa0f
0709 13:03:18.817547 (+138853us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:18.817607 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:18.817711 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:19.138645 (+320934us) raft_consensus.cc:1685] finished
0709 13:03:19.138668 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:19.138882 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":120,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":5004,"spinlock_wait_cycles":6327040,"thread_start_us":138607,"threads_started":1,"wal-append.queue_time_us":1125813}
I20260709 13:03:19.143857  7651 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:19.146642  7869 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:19.130721  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 76214.3us
I20260709 13:03:19.144538  7651 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:19.083220  1556 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:03:19.156749  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 73590us
I20260709 13:03:19.076838  7719 raft_consensus.cc:2804] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:19.087314  1558 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:19.076581  7848 raft_consensus.cc:2804] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:19.160809  7848 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:19.161303  7848 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:19.161675  7805 raft_consensus.cc:2804] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:19.162094  7805 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.162429  7805 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:19.089666  7938 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:19.158960  7465 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:19.165962  7938 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:19.100162  7973 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:19.166574  7719 raft_consensus.cc:697] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:19.100869  7969 raft_consensus.cc:2804] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:19.167433  7969 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:19.167904  7969 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:19.167795  7719 consensus_queue.cc:237] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:19.165966  7465 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:19.053229  7980 raft_consensus.cc:3060] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:19.171653  7465 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:19.177205  7987 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:19.177906  7987 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:19.180529  7987 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:19.122102  7800 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:19.115495  1741 raft_consensus.cc:1240] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:19.117714  7908 consensus_queue.cc:260] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:19.064007  7970 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.119073  7976 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:19.066056  7949 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:19.123471  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 69236us
I20260709 13:03:19.217337  1633 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:19.042068  7878 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:19.127942  7727 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:19.120167  7860 consensus_queue.cc:260] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:19.075376  1662 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:19.111387  7502 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:19.191138  1556 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:19.146744  7867 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:03:19.196105  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 108875us
I20260709 13:03:19.238461  1558 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:19.239878  1558 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:19.126184  7825 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:19.156389  7866 raft_consensus.cc:697] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 16 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:19.194689  7973 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:03:19.234792  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 43725.9us
I20260709 13:03:19.266918  1556 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:19.269793  7908 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:19.270854  7805 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:19.243578  7860 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:19.241569  1558 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:19.236896  1662 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:19.218613  7938 raft_consensus.cc:2804] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:19.225414  1633 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:19.246738  7715 raft_consensus.cc:2804] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:19.247439  7674 raft_consensus.cc:2749] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:19.202448  7800 raft_consensus.cc:697] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 18 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:03:19.249854  7975 log.cc:927] Time spent T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.647s	user 0.003s	sys 0.000s
I20260709 13:03:19.250000  7922 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:19.230990  7911 raft_consensus.cc:2749] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:19.194144  7846 consensus_queue.cc:1048] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 13:03:19.251071  7866 consensus_queue.cc:237] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:19.201185  7970 raft_consensus.cc:3060] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:19.253484  1586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59106 (request call id 2612) took 1180 ms. Trace:
I20260709 13:03:19.255131  7976 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:19.257927  7878 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:19.258695  7900 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:19.213920  7935 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:19.259716  7804 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:19.260639  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:03:19.306162  2553 raft_consensus.cc:3055] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:19.200908  7869 consensus_queue.cc:1048] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.063s
I20260709 13:03:19.232165  7727 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:19.285442  7930 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:19.227830  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:19.215380  7990 consensus_queue.cc:1048] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:03:19.265820  7973 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:19.328744  7825 raft_consensus.cc:2749] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:19.243145  7925 raft_consensus.cc:2804] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:19.126449  7791 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:19.282670  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 57430.2us
I20260709 13:03:19.184969  7651 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:19.283866  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.277004  7991 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:19.278757  7855 raft_consensus.cc:2749] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:03:19.285974  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 101423us
I20260709 13:03:19.294677  1586 rpcz_store.cc:276] 0709 13:03:18.072880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.073284 (+   404us) service_pool.cc:224] Handling call
0709 13:03:18.073638 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:18.957395 (+883757us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:18.957430 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:18.957956 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 13:03:19.073129 (+115173us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:19.073171 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:19.073238 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:19.253254 (+180016us) raft_consensus.cc:1685] finished
0709 13:03:19.253276 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:19.253422 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":896850,"raft.queue_time_us":889833,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":13009,"thread_start_us":114847,"threads_started":1,"wal-append.queue_time_us":236946}
I20260709 13:03:19.279984  7938 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:19.281926  7502 raft_consensus.cc:2804] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:19.283164  7805 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:19.298916  7893 consensus_queue.cc:1048] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:19.328115  7800 consensus_queue.cc:237] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:19.391058  7727 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:19.391765  7804 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:19.294982  7715 raft_consensus.cc:697] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:19.306502  2553 raft_consensus.cc:740] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:19.268757  1556 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:03:19.395306  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 126617us
I20260709 13:03:19.396410  1556 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:19.337586  1633 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:19.286281  7713 consensus_queue.cc:1059] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
W20260709 13:03:19.338038  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 141816us
I20260709 13:03:19.398391  2553 consensus_queue.cc:260] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:19.407224  2553 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:19.399115  7727 raft_consensus.cc:2749] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:19.420428  7970 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:19.423494  7970 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:19.426378  7791 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:19.428468  7651 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:19.379702  7976 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:03:19.430291  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 92761.9us
I20260709 13:03:19.431105  7976 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:19.431860  7922 raft_consensus.cc:2749] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:19.434053  1633 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:19.336460  7925 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:19.435971  2424 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:19.385936  7938 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:19.440996  2424 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:19.444335  1633 leader_election.cc:400] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 election: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 17. Current term is 18.
I20260709 13:03:19.362325  7973 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:19.453472  7976 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:19.454061  7932 consensus_queue.cc:1048] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:03:19.400188  7502 raft_consensus.cc:697] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:19.458243  7502 consensus_queue.cc:237] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:19.329792  7935 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:19.460214  7980 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:19.463302  7980 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:19.393904  7715 consensus_queue.cc:237] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:19.446856  7922 consensus_queue.cc:1059] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:03:19.467800  7922 raft_consensus.cc:3055] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:19.468227  7922 raft_consensus.cc:740] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
W20260709 13:03:19.477299  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.480931  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:19.399644  7804 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:19.501636  2553 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 19.
I20260709 13:03:19.503477  1630 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:19.503654  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:19.450610  1633 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:19.504437  1737 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 17.
I20260709 13:03:19.336766  7848 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:19.522037  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 71516.1us
I20260709 13:03:19.523555  1633 leader_election.cc:400] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 19. Current term is 20.
I20260709 13:03:19.523975  1633 leader_election.cc:403] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:19.446542  7991 raft_consensus.cc:2749] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:19.450780  7925 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:19.445468  7855 raft_consensus.cc:2749] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:19.557591  7935 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:19.408885  7969 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:19.559754  7969 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:19.559970  7848 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:19.446355  7825 raft_consensus.cc:2749] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:19.535555  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:19.546568  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:19.550834  7748 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:03:19.561167  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:03:19.509606  7912 raft_consensus.cc:2749] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:19.529955  7908 raft_consensus.cc:2804] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:19.576242  1633 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:19.579344  1633 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:19.540871  7932 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:19.521070  7804 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:19.608222  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 307558us
W20260709 13:03:19.602620  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 339470us
W20260709 13:03:19.606694  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 205085us
I20260709 13:03:19.586398  7932 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:19.591137  7911 raft_consensus.cc:2749] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:19.611047  2426 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:19.547721  7922 consensus_queue.cc:260] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:19.578433  7930 consensus_queue.cc:1048] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
W20260709 13:03:19.644415  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.611330  7988 raft_consensus.cc:2804] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:19.607860  7908 raft_consensus.cc:697] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 19 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:19.642616  2426 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:19.658607  7804 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:19.660547  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:19.661315  7860 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:19.661900  7860 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:19.664053  7860 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:19.631781  7932 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:19.606185  7651 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:19.647140  7869 raft_consensus.cc:2804] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:19.617322  7990 consensus_queue.cc:1059] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:03:19.676030  7869 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:19.677752  7869 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:19.653090  7988 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:19.686267  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:19.687853  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:19.719190  1738 raft_consensus.cc:2393] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 10: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:19.688707  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:19.695781  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:19.695583  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:19.697405  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:19.698951  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:19.721167  1585 raft_consensus.cc:2368] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 18. Current term is 19.
I20260709 13:03:19.700315  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:19.702095  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:19.638849  7805 consensus_queue.cc:1059] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:03:19.639528  1556 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:19.722208  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:19.701749  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:03:19.722724  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 83303.3us
I20260709 13:03:19.723109  1590 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:19.725145  1732 raft_consensus.cc:2393] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 17: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:19.721230  1591 raft_consensus.cc:2393] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 10: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:19.720185  1739 raft_consensus.cc:2376] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 18. Re-sending same reply.
I20260709 13:03:19.727258  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:19.730201  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:19.731194  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:19.732064  1556 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:19.732244  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:19.732884  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:19.733206  1737 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:19.733965  1739 raft_consensus.cc:2393] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 20: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:19.667253  7860 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.732301  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:19.671219  7991 raft_consensus.cc:2749] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:19.744256  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:19.745146  1588 raft_consensus.cc:1240] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:19.744307  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:19.746330  1556 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:19.737118  1735 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:43678
I20260709 13:03:19.638906  7719 consensus_queue.cc:1048] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 13:03:19.737126  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:19.746614  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:19.747299  1735 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:19.753774  1735 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:19.747608  1734 raft_consensus.cc:1240] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:19.749399  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:19.755468  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:19.756606  1736 raft_consensus.cc:2393] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 16: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:19.756767  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:19.684758  7804 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.752200  1584 raft_consensus.cc:2368] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 11. Current term is 12.
I20260709 13:03:19.758919  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:19.717411  7713 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.740267  1738 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
I20260709 13:03:19.729423  7949 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.765596  1737 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 19.
I20260709 13:03:19.766494  1590 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 19.
I20260709 13:03:19.717132  7934 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.760618  1732 raft_consensus.cc:2393] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 19: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:19.716223  7900 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.800465  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:19.801059  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:19.804776  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:19.739197  7969 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:19.768114  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:19.722832  7988 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:19.799355  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:03:19.813580  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 197234us
I20260709 13:03:19.754024  7855 raft_consensus.cc:2749] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:19.813290  1735 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:19.817314  1737 raft_consensus.cc:1275] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:03:19.777940  1556 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:19.819149  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:19.676837  7651 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:19.768733  7800 raft_consensus.cc:2749] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:19.831156  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:19.792870  7748 raft_consensus.cc:2749] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 19. Current term is 20.
I20260709 13:03:19.787304  7791 raft_consensus.cc:2749] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:19.820376  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:19.833338  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:19.831390  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:19.834991  1585 raft_consensus.cc:2393] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 10: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:19.753808  7848 consensus_queue.cc:1048] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:03:19.845220  1591 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:19.845721  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:19.846371  1736 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:19.836926  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:19.847546  1588 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 17.
I20260709 13:03:19.837116  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:19.849258  1735 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:19.753530  7930 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:19.842630  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:19.752683  7860 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:19.856859  1584 raft_consensus.cc:2393] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 17: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
W20260709 13:03:19.858361  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 80570.6us
I20260709 13:03:19.794339  7804 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:19.800002  7713 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:19.869412  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 25 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:19.814620  7900 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:19.815071  7949 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:19.813410  7934 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:19.829807  7969 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:19.925032  8024 log.cc:927] Time spent T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:03:19.926599  7976 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:19.800199  7908 consensus_queue.cc:237] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:19.937810  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:20.005646  1735 raft_consensus.cc:2393] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 10: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:19.869943  7719 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:03:19.945684  8006 log.cc:927] Time spent T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:03:19.947667  7860 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:19.952711  7660 raft_consensus.cc:3055] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:03:19.962647  7651 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:19.964541  7949 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:19.966517  7713 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:19.968508  7900 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:19.967353  7932 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:19.972359  7938 consensus_meta.cc:287] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.521s	user 0.009s	sys 0.000s
I20260709 13:03:19.974298  7804 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:20.025840  7932 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:20.029826  7938 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:20.032215  7938 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:19.921862  7962 log.cc:927] Time spent T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:03:19.993422  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 208980us
I20260709 13:03:19.851922  7925 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:20.034507  7969 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:19.869592  7866 consensus_queue.cc:1048] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.131s
I20260709 13:03:20.034744  7934 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:20.020171  7660 raft_consensus.cc:740] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:20.036381  7660 consensus_queue.cc:260] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:19.996344  7976 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:20.037726  7660 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:20.039083  7976 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:20.034859  7925 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:20.026327  7719 raft_consensus.cc:697] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:20.043294  7719 consensus_queue.cc:237] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:19.867406  7930 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:20.046828  7930 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:20.053678  7879 raft_consensus.cc:3055] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:20.054355  7879 raft_consensus.cc:740] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:20.055246  7869 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:20.055555  7879 consensus_queue.cc:260] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:20.059619  7988 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:20.061288  2424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.063380  7988 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:20.064908  7869 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 18 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:20.065014  7922 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:20.083921  7879 raft_consensus.cc:3060] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:20.097364  7996 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.029s	sys 0.047s
W20260709 13:03:20.099649  7996 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.029s	sys 0.047s
W20260709 13:03:20.136080  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 276648us
I20260709 13:03:20.138833  1556 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:20.141913  1587 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 14.
I20260709 13:03:20.142571  1589 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 16.
I20260709 13:03:19.932653  1591 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 20.
W20260709 13:03:20.144742  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.145982  1592 raft_consensus.cc:1240] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 18. Current term is 19. Ops: []
W20260709 13:03:19.985697  1633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.155773  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:20.158629  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:20.164265  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:20.167349  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:20.168494  1589 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 16.
I20260709 13:03:20.174441  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:03:20.175031  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 374362us
I20260709 13:03:20.175953  1591 raft_consensus.cc:2368] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 19. Current term is 20.
I20260709 13:03:20.177461  1558 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:20.180446  1584 raft_consensus.cc:1275] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:20.181167  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:03:20.181177  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.155364  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:03:20.185259  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.177908  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:20.184254  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:20.187119  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:20.188545  1659 raft_consensus.cc:2393] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 20: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
W20260709 13:03:20.189136  1733 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.009s	sys 0.012s
I20260709 13:03:20.189460  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:19.979317  1737 raft_consensus.cc:2410] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:03:20.001384  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:20.198112  1739 raft_consensus.cc:1240] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:03:20.199216  1734 raft_consensus.cc:1240] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:19.998719  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:20.202188  1738 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 19.
I20260709 13:03:20.155381  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:20.188508  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:20.279714  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:03:20.294950  7502 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.005s	sys 0.025s
W20260709 13:03:20.296741  7502 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.006s	sys 0.026s
I20260709 13:03:20.299585  7980 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:20.300912  7980 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:20.302037  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:20.302194  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 25 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:20.303464  7825 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:20.303902  1658 raft_consensus.cc:2410] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 25 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:03:20.292093  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:20.292636  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:20.309415  7932 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.331741  7932 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:20.334527  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:20.335789  1589 raft_consensus.cc:2410] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:03:20.335850  1584 raft_consensus.cc:1275] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:20.338068  1591 raft_consensus.cc:1275] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:03:20.338722  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:20.337949  7985 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:20.340049  1665 raft_consensus.cc:2393] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 17: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:20.342531  7932 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:20.352540  1662 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:20.353749  7925 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:20.371001  7980 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:20.373732  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:20.374723  1664 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 17.
I20260709 13:03:20.375473  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:20.375897  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:20.376502  1663 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12.
I20260709 13:03:20.376930  1659 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 19.
I20260709 13:03:20.378229  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:20.378957  1659 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 17.
I20260709 13:03:20.379247  7935 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.380077  7935 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:20.380908  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:20.382571  1664 raft_consensus.cc:2393] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 10: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:20.344275  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:20.365640  7825 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:20.342537  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:20.367501  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:03:20.353968  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:20.394620  1590 raft_consensus.cc:2393] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 17: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:20.396374  1662 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15.
I20260709 13:03:20.340356  7985 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:20.397718  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:03:20.385681  1583 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.009s	sys 0.013s
I20260709 13:03:20.356503  1584 raft_consensus.cc:1240] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 14. Current term is 15. Ops: []
W20260709 13:03:20.405915  1583 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.009s	sys 0.013s
I20260709 13:03:20.400892  7910 consensus_queue.cc:1059] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:03:20.408041  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:20.411131  7985 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:20.411286  7791 raft_consensus.cc:2804] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:20.392904  7825 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:20.421442  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:20.423753  1667 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:20.437523  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:20.441066  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:20.441444  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:20.448028  1661 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 20.
I20260709 13:03:20.456089  1589 raft_consensus.cc:1240] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:03:20.458443  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:20.458094  1665 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 14.
I20260709 13:03:20.462540  1666 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 20.
I20260709 13:03:20.468287  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:20.459952  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:20.470343  1586 raft_consensus.cc:2393] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 10: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:20.478943  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:20.480038  1662 raft_consensus.cc:2468] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
I20260709 13:03:20.463111  1658 raft_consensus.cc:1240] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:03:20.462792  1660 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:20.495266  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:20.501374  1666 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:20.534958  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:20.535919  1664 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:20.536482  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 303399us
I20260709 13:03:20.532905  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:03:20.572248  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.584221  1667 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15.
W20260709 13:03:20.594688  8020 log.cc:927] Time spent T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.143s	user 0.000s	sys 0.004s
I20260709 13:03:20.602444  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:20.603559  1665 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 14.
I20260709 13:03:20.612494  7935 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:20.617305  1558 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:20.628866  7880 consensus_queue.cc:1059] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.036s
I20260709 13:03:20.631860  7880 raft_consensus.cc:3055] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:20.634785  7880 raft_consensus.cc:740] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:20.641841  1666 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 16.
I20260709 13:03:20.639523  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:20.648124  1662 raft_consensus.cc:2393] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 14: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:20.647491  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:20.650503  1666 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15.
I20260709 13:03:20.643622  7502 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:20.664981  7791 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:20.666004  7791 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:20.668058  8035 log.cc:927] Time spent T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da: Append to log took a long time: real 0.322s	user 0.005s	sys 0.000s
W20260709 13:03:20.674079  8044 log.cc:927] Time spent T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:03:20.682260  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:03:20.683105  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.683384  1659 raft_consensus.cc:2393] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 10: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:20.687626  1667 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 16.
I20260709 13:03:20.695462  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:20.680174  7935 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:20.700824  8042 log.cc:927] Time spent T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.243s	user 0.003s	sys 0.001s
I20260709 13:03:20.703804  1665 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 14.
W20260709 13:03:20.705476  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 110805us
I20260709 13:03:20.705148  7935 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:20.706832  1558 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:03:20.707244  8043 log.cc:927] Time spent T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.127s	user 0.002s	sys 0.001s
I20260709 13:03:20.708920  1558 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:03:20.711730  1736 consensus_meta.cc:287] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.850s	user 0.011s	sys 0.020s
I20260709 13:03:20.712154  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:20.745015  1736 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 19.
I20260709 13:03:20.708993  7935 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:20.713420  7715 raft_consensus.cc:2804] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:20.713963  1659 raft_consensus.cc:1275] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:20.746739  7715 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.747390  7715 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:20.748442  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:20.716852  7992 raft_consensus.cc:3055] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:20.718954  1664 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15.
W20260709 13:03:20.719246  1707 leader_election.cc:336] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.654s (SENT)
I20260709 13:03:20.721331  7925 consensus_queue.cc:1059] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:03:20.725052  2424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.727025  7880 consensus_queue.cc:260] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:20.730685  2553 raft_consensus.cc:1275] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 19 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:03:20.737982  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:20.740593  1741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 4267) took 1041 ms. Trace:
I20260709 13:03:20.742038  2426 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:20.749645  7878 raft_consensus.cc:2804] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:20.751511  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:20.781760  1737 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 24.
I20260709 13:03:20.714627  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:20.783938  1663 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 24.
I20260709 13:03:20.785431  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:20.786677  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:20.787423  1663 raft_consensus.cc:2393] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 10: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:20.788231  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:20.790303  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:20.755424  7855 consensus_queue.cc:1048] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:20.757301  1667 raft_consensus.cc:2410] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
W20260709 13:03:20.764652  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.763054  1707 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:20.778131  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:20.780854  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:03:20.752559  8041 log.cc:927] Time spent T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.189s	user 0.000s	sys 0.002s
I20260709 13:03:20.795086  1667 raft_consensus.cc:1240] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:20.798137  7880 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:20.795533  7985 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.778379  1741 rpcz_store.cc:276] 0709 13:03:19.698581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:19.751617 (+ 53036us) service_pool.cc:224] Handling call
0709 13:03:19.751847 (+   230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:20.014165 (+262318us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:03:20.227895 (+213730us) log.cc:844] Serialized 14 byte log entry
0709 13:03:20.690190 (+462295us) spinlock_profiling.cc:243] Waited 3.18 ms on lock 0x7b4400022b4c. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7ddc8c85 00007f1b7ddc96a2 00007f1b80b3b1db 00007f1b80b36aaf 00007f1b80b2a86e 00007f1b80b29bb6 00007f1b80b297d8 00007f1b80b33221 00007f1b80b331d9 00007f1b80b33169
0709 13:03:20.721565 (+ 31375us) spinlock_profiling.cc:243] Waited 4.98 ms on lock 0x7b1800453580. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b80b374bc 00007f1b7de8548b 00007f1b86cdfab9 00007f1b7dea169b 00007f1b7de9f93f 00007f1b7dea1c02 00007f1b80b2920b 00007f1b80b2ed23 00007f1b80b2f23a
0709 13:03:20.721965 (+   400us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:20.722154 (+   189us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:20.738386 (+ 16232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:20.739427 (+  1041us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b540001cf54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:03:20.739474 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:20.740400 (+   926us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":192693,"prepare.queue_time_us":220081,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":3357,"raft.queue_time_us":13251,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":323,"spinlock_wait_cycles":621241856,"thread_start_us":44632,"threads_started":1,"wal-append.queue_time_us":213312}
I20260709 13:03:20.796769  7878 raft_consensus.cc:697] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:20.800511  1664 raft_consensus.cc:2393] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 17: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:20.764158  7992 raft_consensus.cc:740] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:20.813622  7719 raft_consensus.cc:3055] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:20.814239  7719 raft_consensus.cc:740] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:20.813949  7922 consensus_queue.cc:1048] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:03:20.815584  7719 consensus_queue.cc:260] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:20.818020  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 98977.1us
I20260709 13:03:20.818900  7866 raft_consensus.cc:2749] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:20.819020  7976 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:20.819841  7976 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:20.820318  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:20.822247  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:20.823575  7976 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:20.825114  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:20.800431  1663 raft_consensus.cc:2410] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:03:20.829602  7992 consensus_queue.cc:260] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:20.830731  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:20.806233  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:20.801432  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:20.837819  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:20.838246  1658 raft_consensus.cc:2393] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 20: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:20.839557  1663 raft_consensus.cc:2393] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 15: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
W20260709 13:03:20.839838  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 45856.3us
I20260709 13:03:20.840858  1660 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
I20260709 13:03:20.842743  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:20.844579  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:20.845507  1661 raft_consensus.cc:2393] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 16: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:20.846444  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:03:20.848241  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 106897us
I20260709 13:03:20.842801  1735 raft_consensus.cc:2410] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:03:20.849403  7996 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:20.850351  7715 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:20.851015  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:20.856392  1662 raft_consensus.cc:1240] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:20.857372  7715 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:20.860363  7502 raft_consensus.cc:2749] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:20.862094  7878 consensus_queue.cc:237] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:20.801679  7985 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:20.893891  1658 raft_consensus.cc:1240] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:20.896086  1661 raft_consensus.cc:1275] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:20.874581  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:20.898655  1735 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 16.
I20260709 13:03:20.900950  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:20.902058  1589 raft_consensus.cc:2410] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:03:20.904217  2550 raft_consensus.cc:1240] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:20.879869  1741 raft_consensus.cc:1275] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:03:20.844583  7719 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:20.881631  1633 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:20.882673  1663 raft_consensus.cc:1240] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:20.913367  7922 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:20.915194  7875 consensus_queue.cc:1059] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:20.916491  7875 raft_consensus.cc:3055] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:20.917004  7875 raft_consensus.cc:740] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:20.918210  7875 consensus_queue.cc:260] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:20.870213  1667 raft_consensus.cc:1240] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:20.897661  1662 raft_consensus.cc:1275] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:20.907439  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:20.921940  1661 raft_consensus.cc:1275] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:20.926321  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:20.919394  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:03:20.932049  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 46782.9us
I20260709 13:03:20.897230  7985 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:20.943159  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:20.948594  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:20.949295  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:20.949872  7922 consensus_queue.cc:1059] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:20.930015  7992 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:20.961162  7922 raft_consensus.cc:3055] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:20.961709  7922 raft_consensus.cc:740] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:20.962719  7922 consensus_queue.cc:260] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:20.964190  7922 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:20.936094  7825 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.961174  1586 raft_consensus.cc:2410] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 25 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 13:03:20.965636  7825 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:20.967659  7875 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:20.972885  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:20.973692  1587 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 15.
W20260709 13:03:20.974844  7879 consensus_meta.cc:287] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent flushing consensus metadata: real 0.890s	user 0.007s	sys 0.023s
I20260709 13:03:20.994798  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:21.002094  1556 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:21.013860  1707 leader_election.cc:400] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 18. Current term is 19.
I20260709 13:03:21.027949  1707 leader_election.cc:403] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:21.014098  7791 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:21.017024  7825 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:21.019148  7935 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:21.020905  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:03:21.030197  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:21.024408  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 202560us
I20260709 13:03:21.033031  1633 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:21.039350  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 99086.5us
I20260709 13:03:21.045573  1587 raft_consensus.cc:2393] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 16: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:21.034641  7976 raft_consensus.cc:2749] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 18. Current term is 19.
I20260709 13:03:21.036032  7935 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:21.052546  7791 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:21.040655  7855 raft_consensus.cc:2749] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:03:21.055675  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 53722.8us
I20260709 13:03:21.063468  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:21.053182  7935 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:03:21.084822  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 71250.2us
I20260709 13:03:21.095703  1705 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:21.097671  1705 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:21.098681  1705 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
W20260709 13:03:21.098821  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 106288us
I20260709 13:03:21.099798  7935 raft_consensus.cc:2804] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:03:21.100328  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.100301  7935 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:21.100826  7935 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:21.105952  7976 raft_consensus.cc:2804] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:21.106628  7976 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:21.107221  7976 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:21.090489  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:03:21.121255  1740 raft_consensus.cc:1240] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:21.124848  1586 raft_consensus.cc:1240] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:21.099890  1633 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:21.127554  7866 raft_consensus.cc:2804] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:21.128026  7866 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:21.128463  7866 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:21.129515  7976 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:21.134620  1633 leader_election.cc:400] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 19. Current term is 20.
I20260709 13:03:21.135772  7985 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:21.134413  7935 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:21.137502  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 79811.2us
W20260709 13:03:21.139590  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 47649.6us
I20260709 13:03:21.144622  7985 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:21.150955  7985 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:21.151618  7935 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:21.173410  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 74820.8us
I20260709 13:03:21.186647  1633 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:21.188318  1633 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:21.194603  1633 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:21.199076  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:21.219276  2425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:21.230136  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.231742  7976 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:21.237444  8062 consensus_queue.cc:1059] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:21.238591  8062 raft_consensus.cc:3055] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:21.238941  8062 raft_consensus.cc:740] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:21.239811  8062 consensus_queue.cc:260] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:21.216814  7880 consensus_queue.cc:1059] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 13:03:21.245584  8002 raft_consensus.cc:3055] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:21.246117  8002 raft_consensus.cc:740] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
W20260709 13:03:21.246556  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 52074.1us
I20260709 13:03:21.247040  8002 consensus_queue.cc:260] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:21.208046  7875 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:21.263242  1705 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:21.264710  7976 raft_consensus.cc:2804] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:21.265482  7976 raft_consensus.cc:697] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 20 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:21.267246  7976 consensus_queue.cc:237] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:21.273227  7930 consensus_queue.cc:1048] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:03:21.268018  7875 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:21.248847  8002 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:21.276232  7922 raft_consensus.cc:2749] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:21.277252  7875 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:03:21.277267  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 119403us
I20260709 13:03:21.285415  8062 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:21.288621  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.274921  7930 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:21.290307  7985 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:21.292721  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:03:21.255249  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.306495  1705 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:21.313160  7930 raft_consensus.cc:3060] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:21.280936  7866 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:21.320756  8064 consensus_queue.cc:1048] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:21.321435  8066 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.322150  8066 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:21.323247  7985 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:21.311540  7825 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:21.329208  1556 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:21.329870  7719 consensus_queue.cc:1059] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:21.331053  1556 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:21.333904  7719 raft_consensus.cc:2749] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:21.333933  7875 raft_consensus.cc:3055] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:21.335104  7875 raft_consensus.cc:740] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:21.335456  7866 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:21.335985  7875 consensus_queue.cc:260] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:21.337894  7935 raft_consensus.cc:2764] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:03:21.337966  7875 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:21.339533  1705 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:21.340338  7935 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:21.340718  7935 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:21.341295  1740 raft_consensus.cc:1240] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:21.341679  1733 raft_consensus.cc:1240] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:21.342082  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:21.342963  1741 raft_consensus.cc:2393] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 15: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:21.343103  7935 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:21.349064  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:21.349690  1740 raft_consensus.cc:1275] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:21.350092  8066 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:21.351028  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:21.351086  1735 raft_consensus.cc:1275] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:03:21.353483  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:21.357456  1705 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:21.358038  1732 raft_consensus.cc:1240] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 12. Current term is 13. Ops: []
W20260709 13:03:21.366887  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 119123us
W20260709 13:03:21.371944  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 61647.4us
I20260709 13:03:21.374320  1732 raft_consensus.cc:1275] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:21.378419  1707 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:21.380199  1707 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:21.381570  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 50630.1us
I20260709 13:03:21.381841  1705 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:21.382423  1556 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:03:21.382848  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 46661us
I20260709 13:03:21.383740  1556 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:21.393883  1735 raft_consensus.cc:1240] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:21.385021  7878 raft_consensus.cc:2749] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:21.397825  8071 raft_consensus.cc:2749] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:21.385232  7855 raft_consensus.cc:2749] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:21.409814  1732 raft_consensus.cc:1240] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:21.409919  8065 consensus_queue.cc:1048] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:21.412482  1633 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:21.375110  7719 raft_consensus.cc:2749] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:21.413816  1556 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:03:21.432706  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 47059.7us
I20260709 13:03:21.435139  7791 raft_consensus.cc:2749] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:21.435547  7935 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:21.435993  7791 consensus_queue.cc:1059] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:21.436769  1736 raft_consensus.cc:1240] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:21.437060  7878 consensus_queue.cc:1059] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:21.417462  8061 raft_consensus.cc:2804] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:21.418560  8071 raft_consensus.cc:2749] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:21.419430  8002 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.420622  1705 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:21.440778  1741 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16.
I20260709 13:03:21.437364  7719 consensus_queue.cc:1048] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:03:21.441674  8061 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:21.445250  8065 raft_consensus.cc:2749] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:21.465361  7976 raft_consensus.cc:2804] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:03:21.478644  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 66278.7us
I20260709 13:03:21.463308  8061 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:21.447487  8002 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:21.484589  8033 consensus_queue.cc:1048] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:03:21.487762  8002 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:21.490444  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:21.482024  7855 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.493484  7855 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:21.481492  1705 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:21.513613  8062 raft_consensus.cc:2764] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:03:21.521596  7878 raft_consensus.cc:3055] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:21.478252  7791 raft_consensus.cc:3055] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:21.501950  7866 raft_consensus.cc:2764] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 13:03:21.543535  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 144648us
I20260709 13:03:21.527359  7976 raft_consensus.cc:697] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 15 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:21.529677  7935 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:21.543916  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 107677us
I20260709 13:03:21.549857  1556 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:21.542358  7855 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:21.543380  7878 raft_consensus.cc:740] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:21.544433  7791 raft_consensus.cc:740] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:21.547428  7930 raft_consensus.cc:2749] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:21.549230  8064 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:21.556993  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 83527.4us
I20260709 13:03:21.558496  1705 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:21.559672  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:21.560190  1705 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:21.560359  1587 raft_consensus.cc:2376] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 16. Re-sending same reply.
I20260709 13:03:21.561306  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:21.562120  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:21.562811  7855 raft_consensus.cc:2749] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:21.562932  8075 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.563555  8071 raft_consensus.cc:2804] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:21.563979  8071 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.564311  8071 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:21.565639  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:21.566238  1590 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 16.
I20260709 13:03:21.568024  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:21.568907  1590 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 16.
I20260709 13:03:21.573304  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:21.574085  7976 consensus_queue.cc:237] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:21.574137  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:21.577700  1633 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:21.578518  7930 raft_consensus.cc:2749] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:21.578666  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:21.578963  1633 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:21.579767  7930 raft_consensus.cc:2749] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:21.563585  8075 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:21.580240  1633 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:21.550091  7719 consensus_queue.cc:1048] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:03:21.581064  7930 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:21.581849  8075 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:21.582592  1589 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 14.
I20260709 13:03:21.584512  7791 consensus_queue.cc:260] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:21.585611  7791 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:21.589112  8064 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:21.591588  8064 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:21.595134  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 45402.5us
I20260709 13:03:21.563026  8062 raft_consensus.cc:2804] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:21.597164  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:21.597955  1589 raft_consensus.cc:2376] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 19. Re-sending same reply.
W20260709 13:03:21.603119  2425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.603551  1705 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
W20260709 13:03:21.605684  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 52396.9us
I20260709 13:03:21.597856  8062 raft_consensus.cc:697] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 16 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:21.607712  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:21.611440  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:21.610387  1705 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:21.612174  1586 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15.
I20260709 13:03:21.615126  1633 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:21.614008  8072 raft_consensus.cc:2804] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:21.617354  8072 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.618376  8079 consensus_queue.cc:1059] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:03:21.618793  8072 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:21.625213  1659 raft_consensus.cc:1275] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:03:21.627686  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:21.628448  1659 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16.
I20260709 13:03:21.608692  7878 consensus_queue.cc:260] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:21.630360  7878 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:21.631536  1659 raft_consensus.cc:1240] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:21.637660  8033 raft_consensus.cc:3055] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:21.638268  8033 raft_consensus.cc:740] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:21.639225  8033 consensus_queue.cc:260] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:21.640561  8033 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:21.648533  1658 raft_consensus.cc:1240] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 17. Current term is 18. Ops: []
W20260709 13:03:21.649580  1474 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b37805060ac444b6b6e9e7da8164233c with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7e839e91a1314c2f9a99b25b17c916a6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:21.651651  8079 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:21.652164  8079 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:21.655279  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:21.618047  1587 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15.
I20260709 13:03:21.619568  1707 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:21.621199  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:21.620983  8062 consensus_queue.cc:237] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:21.621950  1664 raft_consensus.cc:1240] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:21.622526  1660 raft_consensus.cc:1275] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:03:21.622871  1667 raft_consensus.cc:1275] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 13:03:21.666309  1667 pending_rounds.cc:85] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 11
I20260709 13:03:21.673863  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:03:21.680629  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.674549  1658 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 14.
W20260709 13:03:21.683921  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 74721.6us
I20260709 13:03:21.668956  1667 pending_rounds.cc:107] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 13:03:21.685263  1667 raft_consensus.cc:2889] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:21.685665  1707 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:21.665510  8077 raft_consensus.cc:2804] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:21.686673  8077 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:21.686733  8078 raft_consensus.cc:2749] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:21.688489  7866 raft_consensus.cc:2749] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:21.665580  8079 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:21.687132  8077 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:21.698593  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:21.699281  1741 raft_consensus.cc:2468] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 10.
I20260709 13:03:21.670387  8064 raft_consensus.cc:2749] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:21.652825  8061 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:21.698984  1556 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:03:21.702638  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 87595.4us
I20260709 13:03:21.704945  8079 consensus_queue.cc:1048] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:03:21.718710  1587 raft_consensus.cc:1275] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:21.726523  1556 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:21.707504  7866 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:21.735558  1556 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:21.740298  7855 consensus_queue.cc:1048] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:21.724079  8080 raft_consensus.cc:2804] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:21.738319  8079 raft_consensus.cc:2749] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:21.741544  7875 raft_consensus.cc:2804] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:21.749922  7875 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.750312  7875 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:21.750146  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:21.751678  1587 raft_consensus.cc:2410] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:03:21.753343  7976 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:21.791440  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 121359us
I20260709 13:03:21.795886  2426 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:21.796788  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:21.798024  1587 raft_consensus.cc:2410] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 25 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 13:03:21.754279  8080 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.742192  7866 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:21.809171  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 69936.5us
I20260709 13:03:21.733469  8075 consensus_queue.cc:1059] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:03:21.811030  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:21.744065  8081 consensus_queue.cc:1048] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:03:21.823990  1633 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:21.828521  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.808590  8084 raft_consensus.cc:2804] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:21.813248  8080 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:21.839570  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:21.841032  1587 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 16.
I20260709 13:03:21.815230  7719 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.826071  1488 catalog_manager.cc:5697] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:21.862857  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:03:21.864948  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 48304.4us
I20260709 13:03:21.802192  7976 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:21.838472  8084 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.874687  7866 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:21.874899  8084 raft_consensus.cc:3060] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:21.877698  8061 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:21.878051  1488 catalog_manager.cc:5697] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:21.882071  1633 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:21.884063  8066 raft_consensus.cc:2804] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:21.884476  8066 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:21.884850  8066 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:21.859851  7719 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:21.855312  7985 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:21.880134  1488 catalog_manager.cc:5697] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 15 to 17, leader changed from 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 17 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:21.868077  1587 raft_consensus.cc:2393] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 10: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:21.918458  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:21.919152  1589 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 14.
I20260709 13:03:21.920079  1633 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:21.923375  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:21.923708  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:21.902787  7855 raft_consensus.cc:3055] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:21.897048  7719 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:21.923389  8086 log.cc:927] Time spent T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.174s	user 0.004s	sys 0.000s
I20260709 13:03:21.939738  7875 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:21.942901  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:21.945542  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:21.946631  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:21.949343  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:21.949985  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:21.951310  1586 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 20.
W20260709 13:03:21.951406  1707 leader_election.cc:336] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.980s (SENT)
W20260709 13:03:21.911334  1485 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51168 (request call id 135) took 31788 ms (client timeout 15000 ms). Trace:
I20260709 13:03:21.930924  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:21.954255  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:21.954581  8072 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:21.953307  1485 rpcz_store.cc:269] 0709 13:02:49.926616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.926902 (+   286us) service_pool.cc:224] Handling call
0709 13:03:21.681146 (+31754244us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:20.053207 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:20.053738 (+   531us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:20.053776 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:03:20.053793 (+    17us) tablet.cc:662] Decoding operations
0709 13:03:20.054567 (+   774us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:20.054621 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:20.054659 (+    38us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:03:20.055299 (+   640us) tablet.cc:701] Row locks acquired
0709 13:03:20.055314 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:03:20.055462 (+   148us) write_op.cc:270] Start()
0709 13:03:20.055561 (+    99us) write_op.cc:276] Timestamp: P: 1783602200055412 usec, L: 0
0709 13:03:20.055580 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:03:20.056258 (+   678us) log.cc:844] Serialized 2835 byte log entry
0709 13:03:20.613529 (+557271us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b4400022b4c. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7ddc8c85 00007f1b7ddc96a2 00007f1b80b3b1db 00007f1b80b36aaf 00007f1b80b2a86e 00007f1b80b29bb6 00007f1b80b297d8 00007f1b80b33221 00007f1b80b331d9 00007f1b80b33169
0709 13:03:20.710715 (+ 97186us) op_driver.cc:464] REPLICATION: finished
0709 13:03:20.769254 (+ 58539us) write_op.cc:301] APPLY: starting
0709 13:03:20.769398 (+   144us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:21.135902 (+366504us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:21.135952 (+    50us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:21.323033 (+187081us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:21.323358 (+   325us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 13:03:21.323422 (+    64us) write_op.cc:312] APPLY: finished
0709 13:03:21.324177 (+   755us) log.cc:844] Serialized 73 byte log entry
0709 13:03:21.324429 (+   252us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:21.324773 (+   344us) write_op.cc:454] Released schema lock
0709 13:03:21.324976 (+   203us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:21.433458 (+108482us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:21.433489 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1423676,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":58029,"apply.run_cpu_time_us":26108,"apply.run_wall_time_us":664309,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33387,"num_ops":7,"prepare.queue_time_us":531523,"prepare.run_cpu_time_us":10878,"prepare.run_wall_time_us":253696,"raft.queue_time_us":27926,"raft.run_cpu_time_us":10893,"raft.run_wall_time_us":76822,"replication_time_us":645271,"spinlock_wait_cycles":47076096,"thread_start_us":486231,"threads_started":4,"wal-append.queue_time_us":288242}]]}
I20260709 13:03:21.958164  8072 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:21.959221  8071 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:21.931137  1488 catalog_manager.cc:5697] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:21.961640  1488 catalog_manager.cc:5697] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:21.962574  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:21.963697  1583 raft_consensus.cc:2393] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 15: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:21.963434  1488 catalog_manager.cc:5697] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:21.965238  7976 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:21.965466  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:21.966185  1589 raft_consensus.cc:2393] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 18: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:21.949931  1587 raft_consensus.cc:3060] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:21.969530  1707 leader_election.cc:336] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 2.162s (SENT)
W20260709 13:03:21.982829  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 152234us
W20260709 13:03:21.983896  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.984835  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:21.985517  1658 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 24.
I20260709 13:03:21.987077  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:21.987756  1584 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 18.
I20260709 13:03:21.992688  1587 raft_consensus.cc:2468] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10.
I20260709 13:03:21.964916  1488 catalog_manager.cc:5697] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 11 to 12, leader changed from 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:03:21.990779  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 49523.3us
W20260709 13:03:21.999347  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:22.010628  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 151218us
I20260709 13:03:22.017272  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:22.017910  1661 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:21.993248  8075 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.023665  1556 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:21.929071  7855 raft_consensus.cc:740] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:21.997794  7825 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:03:22.030707  1633 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:22.026803  1488 catalog_manager.cc:5697] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:22.042862  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:22.043411  1587 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:22.044699  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:22.045512  1591 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:22.022864  8040 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.021711  7880 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.055995  7855 consensus_queue.cc:260] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:22.057385  7855 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:22.063997  7875 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:22.065479  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:22.052197  8071 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:22.037591  7825 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.072878  7825 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:03:22.076169  1591 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 17.
I20260709 13:03:22.042218  8064 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:22.070730  8040 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:22.092448  8040 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:22.093739  7791 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:03:22.094177  7791 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.094503  7791 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:03:22.098934  1590 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15.
I20260709 13:03:22.078068  1488 catalog_manager.cc:5697] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:22.101439  8093 log.cc:927] Time spent T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:03:22.137951  1584 raft_consensus.cc:1275] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:03:22.142120  1558 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:22.042477  8075 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:22.008821  8080 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:22.138862  1587 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 17.
I20260709 13:03:22.108180  8065 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:22.101058  7880 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:22.162689  7880 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:22.163429  8080 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:22.142590  8066 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:22.081489  8077 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:22.173118  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:22.173929  1587 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 19.
W20260709 13:03:22.168370  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 126518us
I20260709 13:03:22.174872  1558 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:22.177747  1661 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 15.
I20260709 13:03:22.179070  1556 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:22.179528  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:22.180096  1667 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:22.183400  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:22.183995  1658 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 18.
I20260709 13:03:22.175979  1633 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:22.185050  2424 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:22.183717  1488 catalog_manager.cc:5697] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 19 to 22, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 22 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:03:22.167320  7878 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:22.187650  1666 raft_consensus.cc:1240] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:22.153132  8033 consensus_queue.cc:1059] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:03:22.188934   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:22.168329  8065 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:22.203233  1488 catalog_manager.cc:5697] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:22.201251  8099 raft_consensus.cc:2804] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:22.206768  8099 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:22.207168  8099 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:22.207931  8077 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:22.210259  8066 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:22.213009  8084 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:22.215325  8084 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:22.218290  7825 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:22.221340  7825 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 25 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:22.210355  8083 raft_consensus.cc:2804] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:22.194825  8076 raft_consensus.cc:2804] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:22.193883  8080 raft_consensus.cc:2749] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:22.228878  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:22.234935  1733 raft_consensus.cc:3060] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:22.225917  8067 consensus_queue.cc:1048] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.008s
I20260709 13:03:22.240970  8102 consensus_queue.cc:1048] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:22.248162  8076 raft_consensus.cc:697] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:22.249280  8076 consensus_queue.cc:237] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:22.250347  8065 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:22.232692  8083 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.252082  1488 catalog_manager.cc:5697] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:22.257987  8083 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:22.266933  8075 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:22.268491  7791 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:22.277055  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:22.277729  2550 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 15.
I20260709 13:03:22.280370  1667 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
I20260709 13:03:22.234102  8090 consensus_queue.cc:1048] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:03:22.284057  7875 raft_consensus.cc:3055] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:22.285930  7875 raft_consensus.cc:740] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:03:22.289304  8096 log.cc:927] Time spent T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.200s	user 0.003s	sys 0.000s
I20260709 13:03:22.281527  1556 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:22.286826  7875 consensus_queue.cc:260] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:22.294169  1488 catalog_manager.cc:5697] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:22.300436  1630 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:03:22.308720  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 123793us
I20260709 13:03:22.322091  8040 raft_consensus.cc:2804] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:22.322587  8040 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:22.322957  8040 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:22.325289  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 115202us
I20260709 13:03:22.326061  1558 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:22.328855  1488 catalog_manager.cc:5697] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 9 to 12, leader changed from 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 12 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:22.330359  1488 catalog_manager.cc:5697] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:22.331700  1488 catalog_manager.cc:5697] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:22.333196  8107 raft_consensus.cc:2749] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:22.333010  1488 catalog_manager.cc:5697] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 10 to 12, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:22.304253  8090 raft_consensus.cc:2804] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:22.342192  1733 raft_consensus.cc:2468] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 11.
I20260709 13:03:22.354506  2426 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:22.367854  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:22.351040  8090 raft_consensus.cc:697] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:22.372782  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:22.378233  1587 raft_consensus.cc:3060] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:22.360020  1488 catalog_manager.cc:5697] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:22.389984  1587 raft_consensus.cc:2468] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 11.
I20260709 13:03:22.365057  8092 raft_consensus.cc:2804] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:22.350662  8079 consensus_queue.cc:1059] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:03:22.413975  8092 raft_consensus.cc:697] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
W20260709 13:03:22.418406  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 49553.9us
I20260709 13:03:22.358063  8075 consensus_queue.cc:1048] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:03:22.393579  7875 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:22.425256  1488 catalog_manager.cc:5697] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:22.446581  1488 catalog_manager.cc:5697] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 13 to 16, leader changed from 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 16 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:22.450230  1488 catalog_manager.cc:5697] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 7 to 15, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:22.424962  8080 consensus_queue.cc:1059] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:03:22.454046  1488 catalog_manager.cc:5697] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:22.452450  1558 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:22.435946  7878 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:22.450839  8107 raft_consensus.cc:3055] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:22.489626  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:22.492707  1664 raft_consensus.cc:2393] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 25: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:22.492954  1488 catalog_manager.cc:5697] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:22.494974  1488 catalog_manager.cc:5697] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:22.499039  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 46684.6us
I20260709 13:03:22.498978  1488 catalog_manager.cc:5697] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 9 to 12, leader changed from 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:22.501242  1707 leader_election.cc:336] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 2.032s (SENT)
I20260709 13:03:22.500972  1488 catalog_manager.cc:5697] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 7 to 8, leader changed from 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 8 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:22.501663  1707 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:22.502890  1488 catalog_manager.cc:5697] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 13 to 18, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 18 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:03:22.504140  1488 catalog_manager.cc:5697] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:22.505460  1488 catalog_manager.cc:5697] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:22.506681  8116 raft_consensus.cc:2764] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won
I20260709 13:03:22.507215  8062 raft_consensus.cc:2749] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:22.508471  8083 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:22.497192  7878 consensus_queue.cc:1059] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:03:22.510917  8116 raft_consensus.cc:3055] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:22.511009  8083 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 20 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:22.511337  8116 raft_consensus.cc:740] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:22.485978  7791 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 25 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:22.512161  8116 consensus_queue.cc:260] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:22.513585  8116 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:22.491658  8107 raft_consensus.cc:740] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:22.515266  8107 consensus_queue.cc:260] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:22.516626  8107 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:22.527302  1707 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.705s (SENT) [suppressed 39 similar messages]
I20260709 13:03:22.448868  8099 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:22.546154  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 46011.1us
I20260709 13:03:22.571383  1741 raft_consensus.cc:1275] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:22.574100  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:22.578012  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:22.578101  1741 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
W20260709 13:03:22.578841  1705 leader_election.cc:336] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.534s (SENT)
W20260709 13:03:22.567477  8113 log.cc:927] Time spent T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.223s	user 0.002s	sys 0.000s
I20260709 13:03:22.586249  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:22.589383  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:22.589952  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:22.590605  1737 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 24.
I20260709 13:03:22.586948  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:22.592085  1735 raft_consensus.cc:1275] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:03:22.585983  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:22.594247  1658 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:03:22.450147  8090 consensus_queue.cc:237] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:22.596657  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:22.597795  1733 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:03:22.491611  8092 consensus_queue.cc:237] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:22.608336  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:22.609171  1734 raft_consensus.cc:2393] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 11: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:03:22.613437  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:22.614604  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:22.615284  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:22.615875  1589 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15.
I20260709 13:03:22.617326  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:22.617785  1590 raft_consensus.cc:3060] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:22.620937  1733 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 15.
I20260709 13:03:22.622314  1586 raft_consensus.cc:1275] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:22.615204  1588 raft_consensus.cc:2376] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 17. Re-sending same reply.
I20260709 13:03:22.624331  7855 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:22.633431  7855 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:22.624624  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:03:22.627640  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 44502.8us
I20260709 13:03:22.647369  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:22.648059  1737 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:03:22.628932  1558 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:22.625252  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:22.634231  8099 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:22.627418  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:22.659062  1587 raft_consensus.cc:2376] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 17. Re-sending same reply.
I20260709 13:03:22.625415  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:22.647264  1584 raft_consensus.cc:2376] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15. Re-sending same reply.
W20260709 13:03:22.653510  1707 leader_election.cc:336] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Timed out: RequestConsensusVote RPC to 127.0.107.193:33325 timed out after 1.534s (SENT)
I20260709 13:03:22.660567  1707 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:22.653290  8098 consensus_queue.cc:1048] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:03:22.622602  8115 log.cc:927] Time spent T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:03:22.666041  8094 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:22.657092  8111 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.667333  8094 consensus_queue.cc:1048] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:22.667447  8111 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:22.668970  1707 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:22.671641  8071 raft_consensus.cc:2804] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:22.670331  8111 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:22.671531  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:22.672607  1584 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 16.
I20260709 13:03:22.672091  8071 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:22.673454  8071 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:22.675956  1591 raft_consensus.cc:1275] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:03:22.677166  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 48309.5us
I20260709 13:03:22.679116  1558 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:22.697794  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:22.698593  1591 raft_consensus.cc:2393] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 25: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:22.715508  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:22.720135  2426 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:22.734243  1590 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 20.
I20260709 13:03:22.736159  2426 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:22.738281  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:22.701592  8098 raft_consensus.cc:2749] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:22.713670  8079 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:22.754654  1667 raft_consensus.cc:1275] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:22.751078  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:22.719018  8077 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.762413  8033 consensus_queue.cc:1048] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:22.776126  8040 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:22.778200  8124 raft_consensus.cc:2804] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:22.759706  1660 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 15.
I20260709 13:03:22.724797  8075 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.741667  7880 raft_consensus.cc:2804] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:22.800493  1732 raft_consensus.cc:1240] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 17. Current term is 18. Ops: []
W20260709 13:03:22.807729  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 132584us
I20260709 13:03:22.713852  8123 consensus_queue.cc:1048] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.080s
I20260709 13:03:22.820291  1707 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:22.808830  8124 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.816461  8075 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:22.838435  1707 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:22.804975  8077 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:22.840023  1707 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:22.824595  7880 raft_consensus.cc:697] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 20 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:22.837445  8124 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:22.841010  8098 consensus_queue.cc:1059] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:03:22.859366  8094 raft_consensus.cc:2749] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:22.860149  8094 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:22.866425  1590 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:03:22.867245  1590 raft_consensus.cc:606] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:22.867586  1590 raft_consensus.cc:614] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:22.872876  8077 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:22.879201  8075 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:22.880738  1658 raft_consensus.cc:2468] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 20.
I20260709 13:03:22.860996  8094 raft_consensus.cc:2804] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:03:22.927495  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 87514us
I20260709 13:03:22.920274  8094 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:22.931300  1707 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:22.944301  1590 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:03:22.945153  1590 raft_consensus.cc:606] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:22.934368  8094 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:22.940778  8077 raft_consensus.cc:2804] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:22.961019  1707 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:22.946589  8040 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:22.929694  7880 consensus_queue.cc:237] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:22.966729  8134 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:22.982954  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:22.983701  1736 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16.
I20260709 13:03:22.985150  1558 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:22.986012  8098 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.986560  8098 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:22.987142  7878 raft_consensus.cc:2804] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:22.987680  7878 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.988137  7878 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:22.990821  1555 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:22.991822  8076 raft_consensus.cc:2749] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:22.994678  8083 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:23.005878  1633 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.809s	user 0.011s	sys 0.022s
W20260709 13:03:23.006352  1633 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.011s	sys 0.022s
W20260709 13:03:23.006685  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 812315us
I20260709 13:03:23.008301  1737 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 25.
I20260709 13:03:22.995838  8134 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:22.998078  8062 raft_consensus.cc:2764] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:03:22.998921  1707 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:23.009895  1558 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:23.034520  1705 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:22.961493  8077 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:23.025229  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:23.021628  1735 raft_consensus.cc:1275] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:23.047542  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:23.046564  1740 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
I20260709 13:03:23.048681  1737 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 16.
I20260709 13:03:23.043320  7935 raft_consensus.cc:2804] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:23.056361  1707 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:23.042438  8077 raft_consensus.cc:3060] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:23.041771  8079 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.042130  8081 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:03:23.050755  7935 raft_consensus.cc:697] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 17 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:23.074928  8134 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:23.079845  8079 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:23.097057  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:23.097368  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:23.097808  1666 raft_consensus.cc:2376] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15. Re-sending same reply.
I20260709 13:03:23.098271  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:23.099254  8079 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:23.099506  8117 raft_consensus.cc:3055] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:23.086572  8062 raft_consensus.cc:2749] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:23.099942  8117 raft_consensus.cc:740] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:23.097368  8138 raft_consensus.cc:2804] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:23.101302  8081 raft_consensus.cc:697] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 25 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:23.101830  8138 raft_consensus.cc:697] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 15 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:23.102597  8081 consensus_queue.cc:237] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:23.086823  8120 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.103003  8138 consensus_queue.cc:237] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:23.103785  8120 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:23.106050  8120 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:23.098291  1667 raft_consensus.cc:2393] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 20: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:23.100867  8117 consensus_queue.cc:260] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:23.109452  8117 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:23.110244  7855 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:23.110898  8124 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:23.114051  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:23.114650  1591 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:23.118618  8071 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:23.084581  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:23.055197  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:23.089797  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:23.090209  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:23.093375  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:03:23.095265  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 51211.6us
I20260709 13:03:23.033674  8083 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:23.123287  1707 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:23.130656  1659 raft_consensus.cc:2393] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 20: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:23.134791  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:23.136693  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:23.132457  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:23.143110  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:23.143937  1667 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:23.052295  8133 consensus_queue.cc:1048] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.089s
I20260709 13:03:23.144899  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:23.145620  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:23.146943  1658 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15.
I20260709 13:03:23.178660  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:03:23.157055  1591 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 17.
W20260709 13:03:23.165966  1474 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b37805060ac444b6b6e9e7da8164233c with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7e839e91a1314c2f9a99b25b17c916a6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:23.154078  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:23.184895  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:23.185782  1660 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:23.156219  1658 raft_consensus.cc:1275] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:03:23.139755  8124 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 17 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:23.194988  1658 raft_consensus.cc:1275] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:03:23.208194  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 115986us
I20260709 13:03:23.198137  7878 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:23.245819  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:23.246798  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:23.248157  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:23.269567  1587 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 19.
I20260709 13:03:23.251955  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:23.269539  1584 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 10.
I20260709 13:03:23.279290  1740 raft_consensus.cc:1240] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:23.278543  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:23.280839  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:23.310923  1658 raft_consensus.cc:2376] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15. Re-sending same reply.
I20260709 13:03:23.284667  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:23.152079  7935 consensus_queue.cc:237] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:23.311826  1592 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:23.310281  1739 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 19.
I20260709 13:03:23.211374  8134 raft_consensus.cc:2804] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:23.209384  8071 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:23.291347  1591 raft_consensus.cc:2393] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 17: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:23.289033  1583 raft_consensus.cc:1240] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:03:23.298831  1740 raft_consensus.cc:1240] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:23.301303  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:03:23.304073  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 180828us
I20260709 13:03:23.307693  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:23.286653  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:23.314059  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:23.328922  1707 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:23.326038  1659 raft_consensus.cc:2376] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 10. Re-sending same reply.
I20260709 13:03:23.283663  1660 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 17.
I20260709 13:03:23.341424  1667 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 17.
I20260709 13:03:23.343900  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:03:23.349997  8147 log.cc:927] Time spent T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:03:23.351706  8140 log.cc:927] Time spent T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:03:23.355283  1633 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:23.356405  8120 raft_consensus.cc:2749] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:23.356570  1633 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:23.357736  1707 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:23.358970  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:23.360108  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:23.360852  1667 raft_consensus.cc:2393] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 25: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:23.361724  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:23.363757  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:23.366956  1592 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 17.
I20260709 13:03:23.367831  1592 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:03:23.365411  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:23.370281  1738 raft_consensus.cc:2393] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 25: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:23.371193  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:23.388991  1733 raft_consensus.cc:2393] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 15: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:23.371639  1739 raft_consensus.cc:2393] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 20: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:23.373318  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:23.388075  2550 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 15.
I20260709 13:03:23.390626  1592 raft_consensus.cc:606] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:23.391506  1592 raft_consensus.cc:614] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:23.410459  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:23.320609  8132 consensus_queue.cc:1048] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.230s
I20260709 13:03:23.341766  8134 raft_consensus.cc:697] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 17 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:23.344847  8149 raft_consensus.cc:2749] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:23.414352  1583 raft_consensus.cc:2368] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 16. Current term is 17.
I20260709 13:03:23.418534  1659 raft_consensus.cc:1275] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:03:23.419337  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 52812.3us
I20260709 13:03:23.461305  8134 consensus_queue.cc:237] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:23.462419  1707 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:23.463584  8149 raft_consensus.cc:2749] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:23.412846  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:23.456135  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:23.465394  1732 raft_consensus.cc:2393] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 15: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:23.458151  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:23.459229  8081 consensus_queue.cc:1048] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:23.364727  8094 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:23.427574  8120 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:23.463326  8138 consensus_queue.cc:1048] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:23.467978  8120 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:23.382084  8133 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:23.420009  1630 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:03:23.489805  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 69881.7us
W20260709 13:03:23.473253  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 116751us
I20260709 13:03:23.499429  1733 raft_consensus.cc:3055] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:23.499850  1733 raft_consensus.cc:740] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:23.501948  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:23.502588  1737 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:23.493755  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:03:23.524027  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 50409.4us
I20260709 13:03:23.527964  1707 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:23.541538  1737 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
I20260709 13:03:23.542816  1558 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:23.508912  1633 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:23.529604  1738 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:03:23.415922  8102 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.417984  8067 raft_consensus.cc:2749] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:23.532325  1732 raft_consensus.cc:1240] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:23.495929  8133 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:23.559365  1591 raft_consensus.cc:1240] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:03:23.469231  7878 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:23.488375  8149 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.523901  8150 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.505712  8099 raft_consensus.cc:2804] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:23.564206  1591 raft_consensus.cc:1240] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:23.565184  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:23.565455  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:23.473538  8077 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:23.573165  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:23.546137  8094 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:23.551862  8033 raft_consensus.cc:2804] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:23.574735  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:23.583775  1659 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
I20260709 13:03:23.578420  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:23.584764  1664 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16.
I20260709 13:03:23.562494  8133 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:23.566579  1558 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:23.577149  8150 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:23.588174  2595 heartbeater.cc:646] Failed to heartbeat to 127.0.107.254:37303 (3 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.254:37303 timed out after 15.000s (SENT)
I20260709 13:03:23.588416  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:23.581107  8099 raft_consensus.cc:697] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 15 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:23.589545  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:23.590477  8067 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.595033  8077 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:23.576153  8149 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:23.599452  1555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:23.614880  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 48386.4us
I20260709 13:03:23.627813  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:23.628633  1659 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:03:23.636502  7719 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.637122  7719 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:23.639468  7719 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:23.617251  8117 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.640350  8117 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:23.616492  8033 raft_consensus.cc:697] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:23.642467  8117 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:23.641963  8033 consensus_queue.cc:237] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:23.644369  8149 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:23.628213  8067 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:23.624444  7791 raft_consensus.cc:2804] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:23.584353  8120 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:23.646881  2426 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:23.637463  8150 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:23.558300  8102 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:23.654959  8102 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:23.656302  8151 log.cc:927] Time spent T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:03:23.652160  1739 raft_consensus.cc:1275] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 25 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:03:23.657267  8111 raft_consensus.cc:2804] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:23.657181  8130 consensus_queue.cc:1048] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.104s
I20260709 13:03:23.658020  8111 raft_consensus.cc:697] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:23.671262  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:23.626953  8040 raft_consensus.cc:2749] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:23.675418  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:23.676420  1737 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
I20260709 13:03:23.679188  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:23.646864  7791 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.651309  8071 raft_consensus.cc:2804] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:23.681759  1588 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 20.
I20260709 13:03:23.685348  1591 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 20.
I20260709 13:03:23.692900  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:23.693781  1591 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15.
I20260709 13:03:23.695887  1666 raft_consensus.cc:1275] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:23.646950  8067 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:23.702955  1707 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:23.678493  8120 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:23.721491  8120 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:23.724187  8120 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:23.726246  8099 consensus_queue.cc:237] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:23.727260  8116 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.727882  8116 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:23.714516  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:23.715667  8071 raft_consensus.cc:697] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 15 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:23.716253  8138 consensus_queue.cc:1059] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:23.717468  8160 raft_consensus.cc:2804] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:23.718182  1707 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:03:23.720208  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 228762us
I20260709 13:03:23.739585  1633 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:23.694841  7791 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:23.691628  8150 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.698366  8102 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.749423  1555 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:23.659139  8111 consensus_queue.cc:237] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:23.763741  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:23.764695  1739 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 14.
I20260709 13:03:23.772756  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:03:23.773102  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 339256us
I20260709 13:03:23.775961  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:23.776799  1666 raft_consensus.cc:3060] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:03:23.781332  8161 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:23.782196  8161 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.788076  1666 raft_consensus.cc:2468] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 17.
I20260709 13:03:23.732709  8149 consensus_queue.cc:1059] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:03:23.758219  7935 raft_consensus.cc:3055] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:03:23.795909  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 136205us
I20260709 13:03:23.796813  1633 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:23.760294  8081 raft_consensus.cc:2749] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:23.757812  8160 raft_consensus.cc:697] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 20 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:23.819525  1590 raft_consensus.cc:2468] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 18.
I20260709 13:03:23.768522  8116 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:23.794216  1705 leader_election.cc:336] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.709s (SENT)
I20260709 13:03:23.825567  1705 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:23.759178  8150 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:23.823922  1707 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:23.830016  1633 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:23.832316  1633 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:23.833487  1633 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:03:23.834017  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 47172.9us
I20260709 13:03:23.814209  7935 raft_consensus.cc:740] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:23.768110  8102 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:23.825322  8067 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:23.852768  8148 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.826081  8149 consensus_queue.cc:1243] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer 6d4de2ce0683442498244b9529127f91 log is divergent from this leader: its last log entry 17.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:03:23.836872  8134 raft_consensus.cc:2804] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:23.838440  8120 raft_consensus.cc:2804] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:23.864494  8083 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:23.854020  8138 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:23.864889  7791 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:23.876250  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 60190.2us
I20260709 13:03:23.842803  8040 raft_consensus.cc:2749] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:23.845640  8166 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:23.889344  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 95140.9us
W20260709 13:03:23.890604  1705 leader_election.cc:336] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.785s (SENT)
W20260709 13:03:23.891902  1705 leader_election.cc:336] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.791s (SENT)
I20260709 13:03:23.899039  1739 raft_consensus.cc:1275] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:03:23.782639  8161 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:23.877990  8120 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.878553  8148 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:23.915838  8148 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:23.901448  8166 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:23.917253  7878 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.918047  7878 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:23.918701  8166 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:23.919924  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:23.884305  8134 raft_consensus.cc:697] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 18 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:23.858712  8160 consensus_queue.cc:237] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:23.922138  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:23.950111  1737 raft_consensus.cc:2410] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
W20260709 13:03:23.925158  8155 log.cc:927] Time spent T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 13:03:23.843116  8071 consensus_queue.cc:237] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:23.876765  8067 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:23.910074  8120 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:23.955744  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 118257us
I20260709 13:03:23.920992  7878 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:23.945783  8040 raft_consensus.cc:2804] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:23.967937  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:23.968700  1584 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 15.
I20260709 13:03:23.964876  8040 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:23.963104  1705 leader_election.cc:336] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.789s (SENT)
I20260709 13:03:23.979017  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:23.965025  8002 consensus_queue.cc:1048] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:03:23.981395  2426 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:23.984550  8163 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:23.986521  8163 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.986397  8173 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:23.987066  8163 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:23.988291  8164 log.cc:927] Time spent T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:03:24.001928  7791 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:24.003918  8102 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:23.983314  8134 consensus_queue.cc:237] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:24.014678  8159 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:24.015365  8159 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:24.018074  8150 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:24.019639  8098 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:23.982370  8040 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:24.043340  8171 log.cc:927] Time spent T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.130s	user 0.000s	sys 0.004s
I20260709 13:03:24.056411  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:24.060289  1592 raft_consensus.cc:1275] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:03:24.063751  1733 consensus_queue.cc:260] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:24.064337  8144 consensus_queue.cc:1048] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:03:24.069778  8159 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:24.064831  1733 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:24.081629  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:24.082554  1666 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 20.
I20260709 13:03:24.083072  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:24.083915  1658 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:24.086226  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:24.087179  1660 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16.
I20260709 13:03:24.099743  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:24.100770  1667 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 15.
I20260709 13:03:24.094678  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:24.105647  1659 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 18.
I20260709 13:03:23.925348  7935 consensus_queue.cc:260] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:24.110626  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:24.114318  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:24.115020  1661 raft_consensus.cc:2468] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:03:24.117425  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:24.128090  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:24.129767  1664 raft_consensus.cc:1275] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 25 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:03:24.137257  1660 raft_consensus.cc:1275] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:03:24.138839  1556 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:24.159148  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:24.160060  1737 raft_consensus.cc:2468] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 10.
I20260709 13:03:24.163568  1589 raft_consensus.cc:1240] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 16. Current term is 17. Ops: [16.11-16.11]
W20260709 13:03:24.164238  1705 leader_election.cc:336] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.705s (SENT)
I20260709 13:03:24.164726  1705 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:24.168802  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 335383us
I20260709 13:03:24.134563  8098 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.172688  1558 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:03:24.169534  1705 leader_election.cc:336] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.895s (SENT)
I20260709 13:03:24.175686  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:24.175921  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:24.176965  1739 raft_consensus.cc:2410] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:03:24.134263  8067 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:24.179148  1733 raft_consensus.cc:1275] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 13:03:24.179771  1733 pending_rounds.cc:85] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 10
I20260709 13:03:24.180051  1733 pending_rounds.cc:107] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:03:24.181627  1733 raft_consensus.cc:2889] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:24.180706  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:24.180403  1633 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:24.177701  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:24.189879  1734 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:24.192147  1633 leader_election.cc:400] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 16. Current term is 17.
I20260709 13:03:24.192572  1633 leader_election.cc:403] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:03:24.189580  8166 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:24.193562  8166 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.193919  8166 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:24.180449  8138 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:24.192899  7855 consensus_queue.cc:1048] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:24.177009  8146 consensus_queue.cc:1048] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.032s
I20260709 13:03:24.170083  8117 raft_consensus.cc:2804] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:24.201071  1658 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
I20260709 13:03:24.195284  1558 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:03:24.230155  1705 leader_election.cc:336] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.587s (SENT)
I20260709 13:03:24.235248  1705 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:24.224426  1556 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:03:24.237049  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 59614.4us
I20260709 13:03:24.239512  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:03:24.240339  2543 raft_consensus.cc:2393] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 18: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:03:24.241955  8150 raft_consensus.cc:2749] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:24.245656  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:03:24.245792  1474 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b37805060ac444b6b6e9e7da8164233c with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7e839e91a1314c2f9a99b25b17c916a6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:24.246415  2543 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15.
W20260709 13:03:24.249562  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 54355.2us
I20260709 13:03:24.181154  8161 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:24.203583  8067 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:24.206228  8117 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.206832  8159 raft_consensus.cc:2749] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 16. Current term is 17.
I20260709 13:03:24.213101  8102 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.173491  8076 consensus_queue.cc:1059] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:03:24.180678  8098 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:24.269243  1556 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:03:24.280160  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 86248.8us
W20260709 13:03:24.285315  1705 leader_election.cc:336] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 2.184s (SENT)
I20260709 13:03:24.195938  8099 consensus_queue.cc:1059] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:03:24.287894  1705 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:24.287916  1585 raft_consensus.cc:1275] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:03:24.288244  1633 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:24.195660  8175 consensus_queue.cc:1048] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.087s
I20260709 13:03:24.260741  8033 raft_consensus.cc:2804] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:03:24.331703  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 44694.2us
I20260709 13:03:24.267562  8117 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:24.353065  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 64882.9us
I20260709 13:03:24.270169  8067 raft_consensus.cc:697] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 17 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:24.287546  7878 raft_consensus.cc:2804] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:24.359294  7878 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
W20260709 13:03:24.343086  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 73985.8us
I20260709 13:03:24.359529  1633 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:24.359606  8067 consensus_queue.cc:237] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:24.361572  1556 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:24.362658  7855 raft_consensus.cc:2804] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:24.363022  7855 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.363376  7855 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:24.363826  1556 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:24.364635  8081 raft_consensus.cc:2804] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:24.364787  1556 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:24.365047  8081 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.365643  8081 raft_consensus.cc:3060] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:24.352619  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 105217us
W20260709 13:03:24.358170  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 72919.9us
I20260709 13:03:24.359849  7878 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:24.356423  8174 raft_consensus.cc:2804] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:24.357437  8033 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.287513  8102 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:24.391924  8099 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.411828  8150 consensus_queue.cc:1048] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:24.414014  8081 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:24.405725  8076 consensus_queue.cc:1048] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 13:03:24.416500  8081 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:24.395047  8075 raft_consensus.cc:2749] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:24.405320  8166 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:24.419430  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 46117.2us
I20260709 13:03:24.422102  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:03:24.425239  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 59224.5us
I20260709 13:03:24.429328  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:24.430320  1732 raft_consensus.cc:3060] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:24.431710  8176 consensus_queue.cc:1048] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:03:24.434720  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.435204  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:24.409194  8138 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:24.397253  8174 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:24.454542  8174 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:24.456380  1732 raft_consensus.cc:2468] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
W20260709 13:03:24.462308  8170 log.cc:927] Time spent T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.513s	user 0.006s	sys 0.004s
W20260709 13:03:24.464056  8169 log.cc:927] Time spent T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.551s	user 0.005s	sys 0.001s
I20260709 13:03:24.406315  8033 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:24.450630  8190 raft_consensus.cc:2804] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:24.450435  8054 consensus_queue.cc:1048] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:03:24.409224  8161 raft_consensus.cc:3055] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:24.445724  1705 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:24.409494  8099 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:24.451478  1704 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:03:24.451884  8188 log.cc:927] Time spent T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:03:24.452637  8179 log.cc:927] Time spent T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.275s	user 0.000s	sys 0.001s
W20260709 13:03:24.452814  8187 log.cc:927] Time spent T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:03:24.453733  8138 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:24.499913  8138 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:24.409281  8195 raft_consensus.cc:2804] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:24.501430  8195 raft_consensus.cc:697] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 20 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:24.502424  8195 consensus_queue.cc:237] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:24.502807  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:03:24.435804  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.472977  1705 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:24.475899  8176 raft_consensus.cc:2804] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:24.469723  8190 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.468775  8161 raft_consensus.cc:740] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:24.490975  8099 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:24.493387  8098 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:24.514572  8190 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:24.523073  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 50192us
I20260709 13:03:24.524334  1705 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:24.525430  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:24.525676  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:24.526396  1592 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 21.
I20260709 13:03:24.527819  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:24.521018  8174 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:24.472126  7878 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:24.530171  8161 consensus_queue.cc:260] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:24.531518  8161 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:24.531749  8174 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:24.532522  8148 consensus_queue.cc:1048] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:24.513896  8176 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.533427  8176 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:24.488718  8117 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:24.534900  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:24.535616  1732 raft_consensus.cc:2393] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 13: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:24.536022  8117 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:24.537240  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 152723us
I20260709 13:03:24.538703  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:24.539908  1586 raft_consensus.cc:2393] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 18: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:24.539741  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:24.541071  1739 raft_consensus.cc:2393] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 21: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:24.541031  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:03:24.521719  8133 consensus_meta.cc:287] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.891s	user 0.012s	sys 0.003s
I20260709 13:03:24.532584  7878 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 21 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:24.547891  1734 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:03:24.549033  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:24.549966  1587 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 13.
I20260709 13:03:24.540126  8160 raft_consensus.cc:2749] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:24.553865  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:24.540472  8204 raft_consensus.cc:2749] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:24.555236  7855 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:24.547210  8163 consensus_meta.cc:287] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.559s	user 0.030s	sys 0.012s
W20260709 13:03:24.560974  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.524276  1633 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:24.563344  8194 raft_consensus.cc:2764] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:03:24.565325  1667 raft_consensus.cc:1275] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:03:24.565356  8202 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:24.566190  8202 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:24.566766  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:24.567397  1667 raft_consensus.cc:3060] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:24.568382  8202 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:24.569247  8146 consensus_queue.cc:1048] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:24.572340  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:24.574688  1661 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:24.577827  7935 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:24.579135  1667 raft_consensus.cc:2468] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:03:24.551753  8094 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:03:24.607682  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 83446.7us
I20260709 13:03:24.614289  1633 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:24.691351  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 77163.8us
I20260709 13:03:24.704710  1661 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 19.
W20260709 13:03:24.603103  8040 consensus_meta.cc:287] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.575s	user 0.012s	sys 0.000s
W20260709 13:03:24.608897  8120 consensus_meta.cc:287] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.637s	user 0.007s	sys 0.004s
I20260709 13:03:24.758184  1633 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:24.551705  8133 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:24.590876  8163 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:24.761230  8159 consensus_queue.cc:1059] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.088s
I20260709 13:03:24.776331  7855 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:24.785437  8202 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:03:24.770049  8040 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:24.812489  7719 raft_consensus.cc:3055] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:24.772548  8120 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:24.800541  8102 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:24.822679  8176 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:24.833599  1662 raft_consensus.cc:2393] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 11: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:24.836285  1666 raft_consensus.cc:2393] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 16: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:24.817881  7719 raft_consensus.cc:740] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:24.851262  2543 raft_consensus.cc:1275] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:03:24.863524  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 80556.5us
I20260709 13:03:24.858893  8185 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:24.844799  8190 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:24.892181  8040 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:24.893652  8163 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:24.897979  8033 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:24.900178  8033 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:24.876792  8206 consensus_queue.cc:1048] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 13:03:24.885457  8132 raft_consensus.cc:2749] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:24.911029  8190 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:24.907922  8176 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:24.914059  1663 raft_consensus.cc:1240] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 17 LEADER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:24.914673  1660 raft_consensus.cc:1240] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:03:24.923511  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:24.915266  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:24.924742  1658 raft_consensus.cc:2393] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 20: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:24.921763  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:24.925475  1665 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15.
I20260709 13:03:24.931047  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:24.932257  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:24.932844  1663 raft_consensus.cc:2376] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 17. Re-sending same reply.
I20260709 13:03:24.933750  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:24.934288  1663 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 17.
I20260709 13:03:24.934999  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:24.935216  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:24.938782  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:24.937594  1663 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:24.939807  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:03:24.942389  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.944259  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:24.944798  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:24.945467  1658 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:24.944367  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:24.947988  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:03:24.948801  2550 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:24.885872  7719 consensus_queue.cc:260] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:24.951411  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:24.953368  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:24.952041  1660 raft_consensus.cc:2376] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 17. Re-sending same reply.
I20260709 13:03:24.956071  1660 raft_consensus.cc:1240] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:24.961784  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:24.962210  1658 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 21.
I20260709 13:03:24.969755  7719 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:24.981581  2550 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 16.
I20260709 13:03:24.985755  1584 raft_consensus.cc:1275] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:03:25.001271  1658 raft_consensus.cc:1275] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:03:25.013866  1663 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 13.
W20260709 13:03:25.039696  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.082940  1658 raft_consensus.cc:1275] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:03:25.100694  1704 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:25.124327  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:25.125597  1583 raft_consensus.cc:1240] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:25.126833  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:25.127103  1589 raft_consensus.cc:1275] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:03:25.127447  1585 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:25.128849  1590 raft_consensus.cc:1275] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:03:25.133438  1584 raft_consensus.cc:1275] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:03:25.133903  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:25.134580  1739 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:03:25.135473  1732 raft_consensus.cc:1240] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:25.145740  1740 raft_consensus.cc:1275] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:25.119385  7875 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:25.013698  8120 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:25.180557  1705 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:25.196787  1705 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:25.199559  1705 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:25.199991  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:25.200845  1733 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:03:25.199877  1667 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 18.
I20260709 13:03:25.206079  1705 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:25.138581  8130 raft_consensus.cc:2804] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:25.210570  1705 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:25.212159  8138 raft_consensus.cc:2749] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:25.212482  8200 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:25.213018  8200 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:25.189291  7875 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:25.214800  8217 log.cc:927] Time spent T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
I20260709 13:03:25.197068  8081 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.215906  8081 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:25.218039  8081 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:25.221359  8134 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:25.232529  8134 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:25.251240  8134 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:25.253157  8130 raft_consensus.cc:697] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 16 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:25.216852  7875 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:25.203397  8160 raft_consensus.cc:2749] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:25.274580  8150 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.278764  8120 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:25.279397  8195 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:25.194041  8054 consensus_queue.cc:1048] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.066s
I20260709 13:03:25.209355  8149 raft_consensus.cc:2804] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:25.306959  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:03:25.304864  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 94382.7us
I20260709 13:03:25.326285  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:25.339723  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:25.302590  8185 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:25.305351  8138 raft_consensus.cc:2749] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:25.305528  8175 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.327306  1705 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:25.325524  8149 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:25.315172  8178 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:25.390784  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:25.367390  1705 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:25.397727  1705 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:25.399024  1585 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 16.
I20260709 13:03:25.401288  1739 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 19.
I20260709 13:03:25.405429  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:25.406437  1739 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 21.
I20260709 13:03:25.326342  8120 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:25.315485  8150 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:25.420897  7935 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:03:25.418687  8227 log.cc:927] Time spent T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.206s	user 0.003s	sys 0.000s
I20260709 13:03:25.382957  7875 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.434659  2553 raft_consensus.cc:1240] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:25.335552  8208 consensus_queue.cc:1059] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:03:25.391222  8149 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:25.389426  8160 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:25.383033  8134 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:25.395426  8081 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.445789  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:25.479964  1732 raft_consensus.cc:2393] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 17: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:25.449018  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:25.481987  1737 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 19.
W20260709 13:03:25.450389  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 146829us
I20260709 13:03:25.330088  8195 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:25.462529  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:25.383309  8185 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:25.383519  8175 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:25.457509  1633 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:25.480921  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:25.515003  1732 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:03:25.506296  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:25.506345  1666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39146 (request call id 4398) took 1389 ms. Trace:
W20260709 13:03:25.504128  1662 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39146 (request call id 4403) took 1399 ms (client timeout 1736 ms). Trace:
I20260709 13:03:25.464049  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:25.500670  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:25.509629  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:25.517319  1737 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:25.519550  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 62151.5us
I20260709 13:03:25.515868  1666 rpcz_store.cc:276] 0709 13:03:24.094129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:24.110256 (+ 16127us) service_pool.cc:224] Handling call
0709 13:03:25.483108 (+1372852us) spinlock_profiling.cc:243] Waited 724 ms on lock 0x7b54003f9154. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:03:25.483234 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1666077440}
W20260709 13:03:25.516498  1662 rpcz_store.cc:269] 0709 13:03:24.104211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:24.116115 (+ 11904us) service_pool.cc:224] Handling call
0709 13:03:25.503781 (+1387666us) spinlock_profiling.cc:243] Waited 703 ms on lock 0x7b5400359654. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:03:25.503980 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1616738048}
W20260709 13:03:25.533231  8229 log.cc:927] Time spent T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:03:25.535006  8225 log.cc:927] Time spent T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:03:25.450567  7875 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:25.540087  7875 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:25.541929  8200 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:25.546531  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:25.547621  1734 raft_consensus.cc:2393] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 11: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
W20260709 13:03:25.504366  8224 log.cc:927] Time spent T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.275s	user 0.000s	sys 0.001s
I20260709 13:03:25.557406  1736 raft_consensus.cc:1240] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:25.560518  1736 raft_consensus.cc:1240] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:25.564371  8120 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:25.569773  1741 raft_consensus.cc:2393] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 15: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:25.572204  8150 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:25.401762  8178 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:25.577534  8178 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:25.581215  1734 raft_consensus.cc:1275] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:03:25.586424  8133 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:25.590811  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:25.591203  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:25.591572  1590 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:25.592548  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:25.593413  1589 raft_consensus.cc:2393] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 16: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:25.592974  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:25.595103  1584 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 15.
I20260709 13:03:25.594460  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:25.608142  1589 raft_consensus.cc:2393] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 16: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:25.596863  1584 raft_consensus.cc:1275] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:03:25.614614  1587 raft_consensus.cc:2393] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 11: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:25.592343  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:25.626297  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:25.616108  1583 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 15.
W20260709 13:03:25.631176  1586 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59112 (request call id 3454) took 1462 ms (client timeout 1912 ms). Trace:
I20260709 13:03:25.632752  1589 raft_consensus.cc:1240] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:25.401439  8130 consensus_queue.cc:237] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:25.506139  8081 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:25.639247  8081 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:25.640763  8099 raft_consensus.cc:3055] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:25.616545  8040 raft_consensus.cc:2749] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:25.641331  8195 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:25.513165  8134 raft_consensus.cc:2749] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:25.487989  8166 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:25.643904  8175 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:25.632534  1586 rpcz_store.cc:269] 0709 13:03:24.154759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:24.154884 (+   125us) service_pool.cc:224] Handling call
0709 13:03:25.616550 (+1461666us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b54000370d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:03:25.616711 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":828970752}
I20260709 13:03:25.646274  1590 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 20.
I20260709 13:03:25.656185  1592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 2677) took 1107 ms. Trace:
I20260709 13:03:25.662994  1732 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 16.
I20260709 13:03:25.656713  1592 rpcz_store.cc:276] 0709 13:03:24.550093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.625938 (+1075845us) service_pool.cc:224] Handling call
0709 13:03:25.656100 (+ 30162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:25.677106  1737 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 20.
I20260709 13:03:25.580945  8185 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:25.748145  1633 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:25.804286  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 56278.7us
I20260709 13:03:25.805447  1633 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:25.641299  8099 raft_consensus.cc:740] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:25.853456  8099 consensus_queue.cc:260] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:25.854948  8099 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:25.857199  8183 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:25.857959  8183 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:25.877705  1586 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:03:25.878676  1586 raft_consensus.cc:606] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 18 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:25.644970  8216 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.631049  8161 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:03:25.905246  1733 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.002s	sys 0.057s
W20260709 13:03:25.905843  1733 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.002s	sys 0.057s
I20260709 13:03:25.860744  8183 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:25.906539  1555 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.023s	sys 0.029s
I20260709 13:03:25.657313  8067 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:03:25.910086  1555 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.023s	sys 0.029s
W20260709 13:03:25.910573  1658 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.082s	sys 0.178s
W20260709 13:03:25.910967  1658 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.082s	sys 0.178s
W20260709 13:03:25.940938  1591 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.022s	sys 0.026s
W20260709 13:03:25.948240  1591 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.022s	sys 0.027s
I20260709 13:03:25.930670  8161 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:25.907784  8216 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:25.944960  8190 raft_consensus.cc:2764] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
W20260709 13:03:25.943362  8206 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.006s	sys 0.045s
W20260709 13:03:25.950454  8206 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.006s	sys 0.045s
I20260709 13:03:25.951300  8216 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:25.946684  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:25.951694  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:03:25.932991  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 127662us
W20260709 13:03:25.937183  1705 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.018s	sys 0.019s
W20260709 13:03:25.963364  1705 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.018s	sys 0.019s
W20260709 13:03:25.964025  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 566401us
I20260709 13:03:25.964835  1705 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:25.958984  1558 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.018s	sys 0.024s
W20260709 13:03:25.967059  1558 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.018s	sys 0.024s
I20260709 13:03:25.968525  1591 raft_consensus.cc:1240] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:25.969564  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:25.975394  1633 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:25.976835  1705 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
W20260709 13:03:25.978214  1660 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.021s	sys 0.037s
W20260709 13:03:25.979406  1660 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.022s	sys 0.037s
I20260709 13:03:25.980289  1586 raft_consensus.cc:1240] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:25.981912  8099 raft_consensus.cc:2749] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:25.946882  8067 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:25.956703  8185 consensus_queue.cc:1059] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
W20260709 13:03:25.984700  1704 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.018s	sys 0.036s
W20260709 13:03:26.002707  1704 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.018s	sys 0.036s
I20260709 13:03:25.974119  8236 raft_consensus.cc:2749] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:25.979779  8206 consensus_queue.cc:1048] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:03:25.980571  1633 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:25.966581  7935 raft_consensus.cc:697] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 21 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:25.984850  8194 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:26.006815  7935 consensus_queue.cc:237] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:26.007421  8133 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:26.008015  8133 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:26.010694  8133 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:26.011343  8083 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:26.011507  1705 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:26.011910  8083 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:25.987501  1558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.988906  1660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39162 (request call id 3351) took 1069 ms. Trace:
I20260709 13:03:26.014503  1660 rpcz_store.cc:276] 0709 13:03:24.918977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:24.958269 (+ 39292us) service_pool.cc:224] Handling call
0709 13:03:24.958599 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:24.958919 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:24.958947 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:24.959534 (+   587us) log.cc:844] Serialized 26 byte log entry
0709 13:03:25.393679 (+434145us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:25.983852 (+590173us) log.cc:844] Serialized 14 byte log entry
0709 13:03:25.984652 (+   800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:25.985383 (+   731us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:25.985459 (+    76us) raft_consensus.cc:1685] finished
0709 13:03:25.985478 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:25.988785 (+  3307us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16226,"raft.queue_time_us":6279,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":1591,"thread_start_us":798742,"threads_started":2,"wal-append.queue_time_us":415211}
I20260709 13:03:26.015601  8132 raft_consensus.cc:2804] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:26.016237  1558 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:26.016716  7719 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:26.017225  8117 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.017311  7719 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:26.017809  8117 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:26.018209  8075 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.018867  8237 consensus_queue.cc:1048] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:26.021220  8081 raft_consensus.cc:993] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:03:26.021687  8081 raft_consensus.cc:1081] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 18 LEADER]: Signalling peer 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:03:26.004616  8239 consensus_queue.cc:1048] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 13:03:26.020889  8237 raft_consensus.cc:2804] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:26.024863  8237 raft_consensus.cc:697] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:26.025800  8237 consensus_queue.cc:237] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:26.019614  7719 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:26.018916  8075 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:26.031721  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:26.032047  8185 raft_consensus.cc:3055] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:26.032644  8185 raft_consensus.cc:740] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:26.033696  8185 consensus_queue.cc:260] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:26.035411  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:26.059005  2537 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
I20260709 13:03:26.034090  1558 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:26.060456  7791 raft_consensus.cc:2804] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:26.060988  7791 raft_consensus.cc:697] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:26.061830  7791 consensus_queue.cc:237] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:26.037575  8161 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:26.044180  8133 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:26.044835  8077 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.016238  8132 raft_consensus.cc:697] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 18 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:26.064131  8166 consensus_queue.cc:1048] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:26.064851  8077 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:26.065506  8132 consensus_queue.cc:237] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:26.047816  8150 consensus_queue.cc:1048] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:26.047035  1707 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:03:25.994737  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.983234  8134 raft_consensus.cc:2804] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:26.070459  8150 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:26.049311  8071 consensus_queue.cc:1048] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:26.070775  8134 raft_consensus.cc:697] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 13 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:26.071103  8150 raft_consensus.cc:697] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 16 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:26.071758  8134 consensus_queue.cc:237] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:26.071987  8150 consensus_queue.cc:237] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:26.048902  8206 consensus_queue.cc:1048] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:26.073678  8166 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.064196  1558 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:26.074185  8166 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:26.075054  8175 raft_consensus.cc:2804] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:26.075460  8175 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:26.068064  8161 raft_consensus.cc:2749] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:26.067310  8205 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:26.057627  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:26.076304  8205 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:26.075793  8175 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:26.078373  8083 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:03:26.078344  8205 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:26.081710  1556 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:26.079130  8077 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:26.080122  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 99647us
I20260709 13:03:26.094030  1633 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:26.095438  1633 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:26.096695  1633 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:26.087550  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:26.100836  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:26.102582  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:26.078313  8166 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:26.088828  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:26.066422  8133 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:26.081826  1704 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:26.097754  8163 raft_consensus.cc:2764] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:03:26.098397  8194 raft_consensus.cc:2804] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:26.105413  1633 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:26.106128  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:26.128978  1633 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:26.112006  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:26.131559  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:26.099105  7719 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:26.115864  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:26.111160  1558 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:26.100745  8071 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:26.099752  8206 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:26.122867  8075 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:26.110239  8117 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:26.123999  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:26.131323  8216 raft_consensus.cc:2749] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:26.093523  8176 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:26.145907  8190 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:26.179842  8176 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:26.180284  8190 raft_consensus.cc:697] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 20 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:26.099143  8185 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:26.181674  8190 consensus_queue.cc:237] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:26.114176  8161 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.113279  8205 consensus_queue.cc:1048] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:03:26.126340  8067 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:26.187515  8149 consensus_meta.cc:287] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.704s	user 0.013s	sys 0.000s
I20260709 13:03:26.188051  8149 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:26.184480  8161 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:26.191102  8161 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:26.088449  1632 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.034s	sys 0.039s
W20260709 13:03:26.192047  1632 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.034s	sys 0.039s
I20260709 13:03:26.100649  7875 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:26.133695  1633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:26.193380  7875 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:26.194124  1633 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:26.115739  8099 consensus_queue.cc:1059] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.079s
I20260709 13:03:26.149948  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:26.195747  7875 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:26.150566  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:26.196362  8040 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:26.197351  8163 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:26.196943  8040 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:26.149338  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:26.199105  1633 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:26.199492  8040 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:26.200006  8040 consensus_queue.cc:1059] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:26.128374  8194 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:26.155994  1733 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 17.
I20260709 13:03:26.200902  8194 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:26.196540  8195 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:26.148633  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:03:26.156919  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 45864.7us
I20260709 13:03:26.201921  8195 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:26.201244  8205 raft_consensus.cc:2749] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:26.202907  1558 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:26.203500  8205 consensus_queue.cc:1048] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:26.204243  8075 raft_consensus.cc:2764] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:03:26.196534  8099 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:26.205273  8099 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:26.201009  1633 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
W20260709 13:03:26.193022  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:26.208495  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:26.115118  8077 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:26.157445  1738 raft_consensus.cc:1275] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:26.210359  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:26.116940  8202 raft_consensus.cc:2804] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:03:26.213429  1631 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.805s	user 0.021s	sys 0.048s
W20260709 13:03:26.213829  1631 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.021s	sys 0.048s
I20260709 13:03:26.162407  8166 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:26.162837  7719 raft_consensus.cc:697] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:26.165130  8071 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:26.218717  7719 consensus_queue.cc:237] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:26.219758  8071 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:26.197389  8067 raft_consensus.cc:3055] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:26.220885  8067 raft_consensus.cc:740] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:26.221242  1734 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 18.
I20260709 13:03:26.221973  8067 consensus_queue.cc:260] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:26.174325  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:26.174561  2543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78"
dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:33568
I20260709 13:03:26.224227  2543 raft_consensus.cc:606] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:26.226115  2543 raft_consensus.cc:614] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:26.177366  8133 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:26.213984  1740 raft_consensus.cc:2393] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 18: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:26.244570  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:26.246557  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:26.247408  1737 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 20.
I20260709 13:03:26.247889  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:26.248608  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:26.249528  1737 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 18.
I20260709 13:03:26.259441  1588 raft_consensus.cc:1275] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:03:26.153434  8208 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.013s	sys 0.011s
W20260709 13:03:26.153306  8124 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.860s	user 0.012s	sys 0.012s
I20260709 13:03:26.280011  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:26.193015  8239 raft_consensus.cc:2804] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:26.217761  8166 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:26.281981  8227 log.cc:927] Time spent T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:03:26.287238  8166 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:26.225282  8077 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:26.291486  8077 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:26.293300  1736 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 14.
I20260709 13:03:26.295897  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:26.296072  1558 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:26.223667  8067 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:26.279968  8208 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.013s	sys 0.012s
W20260709 13:03:26.282759  8124 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.004s	user 0.013s	sys 0.012s
I20260709 13:03:26.276175  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:26.265054  8099 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:26.216138  8202 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:26.284510  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:26.322122  1591 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 17.
I20260709 13:03:26.285984  8244 consensus_queue.cc:1059] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:26.216216  8163 raft_consensus.cc:2804] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:26.297013  1558 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:26.236752  8071 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.224167  8195 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:26.230187  8161 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.316517  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:26.258018  8216 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:26.269459  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:26.215422  8206 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:26.279512  1741 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:43678
I20260709 13:03:26.326439  1741 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:26.326787  1741 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:26.283147  8239 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:26.329142  1737 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
I20260709 13:03:26.340687  7875 raft_consensus.cc:2804] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:26.341301  7875 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:26.341784  7875 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:26.346032  8176 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:26.349040  8206 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:26.350692  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:26.352667  8149 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:26.329712  8163 raft_consensus.cc:697] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 16 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:26.321708  8138 consensus_queue.cc:1059] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:03:26.354152  8163 consensus_queue.cc:237] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:26.317248  8117 raft_consensus.cc:2804] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:26.356642  8117 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:26.362619  1558 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:26.357028  8117 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:26.325474  8202 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:26.357110  8160 raft_consensus.cc:3055] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:26.332813  8239 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:26.376434  1558 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:26.358640  8040 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
W20260709 13:03:26.397891  1474 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b37805060ac444b6b6e9e7da8164233c with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7e839e91a1314c2f9a99b25b17c916a6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:26.394486  1741 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:26.374006  8238 raft_consensus.cc:2749] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:26.331073  8161 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:26.330427  8071 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:26.330922  8216 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:26.379966  8160 raft_consensus.cc:740] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:26.362545  8077 consensus_queue.cc:1059] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:03:26.395639  8200 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:26.459532  1741 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:26.428453  1585 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.838s	user 0.012s	sys 0.013s
W20260709 13:03:26.465734  1585 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.012s	sys 0.013s
I20260709 13:03:26.465140  8200 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:26.411507  8040 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:26.470682  8206 raft_consensus.cc:3055] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:26.428227  8175 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:26.572312  1735 raft_consensus.cc:1240] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 16 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 15. Current term is 16. Ops: []
W20260709 13:03:26.572698  7935 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.013s	sys 0.012s
W20260709 13:03:26.579581  7791 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.009s	sys 0.035s
I20260709 13:03:26.572408  8200 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:26.573453  8206 raft_consensus.cc:740] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:26.617376  1741 raft_consensus.cc:1240] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 18. Current term is 19. Ops: []
W20260709 13:03:26.603534  7791 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.010s	sys 0.036s
W20260709 13:03:26.598237  7935 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.014s	sys 0.012s
W20260709 13:03:26.624732  2537 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.009s	sys 0.014s
W20260709 13:03:26.626379  8134 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.012s	sys 0.012s
I20260709 13:03:26.606896  8248 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:26.626466  8208 raft_consensus.cc:3055] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:03:26.648701  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 417215us
I20260709 13:03:26.621217  8246 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.621582  8176 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
W20260709 13:03:26.651511  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 383069us
W20260709 13:03:26.644722  8134 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.013s	sys 0.012s
I20260709 13:03:26.582751  8160 consensus_queue.cc:260] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:26.659410  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:26.636654  8238 consensus_queue.cc:1059] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:03:26.664614  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:03:26.655860  8249 log.cc:927] Time spent T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:03:26.654942  1633 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:26.665509  1590 raft_consensus.cc:2393] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 18: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
W20260709 13:03:26.653563  8132 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.011s	sys 0.019s
I20260709 13:03:26.666067  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:26.666491  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:03:26.667488  1705 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.007s	sys 0.019s
W20260709 13:03:26.668774  1705 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.007s	sys 0.019s
W20260709 13:03:26.658294  8237 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.014s	sys 0.016s
I20260709 13:03:26.647853  7791 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:26.653831  8208 raft_consensus.cc:740] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:26.671283  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:03:26.676527  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:26.669070  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 535512us
W20260709 13:03:26.679808  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:26.673398  1633 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:26.683414  1633 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:26.683544  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:03:26.660910  8236 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.016s	sys 0.043s
W20260709 13:03:26.684623  8236 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.016s	sys 0.043s
I20260709 13:03:26.685540  1585 raft_consensus.cc:1240] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:26.687974  1633 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
W20260709 13:03:26.670720  8132 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.011s	sys 0.019s
W20260709 13:03:26.672729  8237 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.014s	sys 0.016s
I20260709 13:03:26.651994  8248 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:26.674974  8149 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.672667  8205 raft_consensus.cc:2804] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:26.659811  8246 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:26.675107  8242 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:26.659793  8176 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:26.702123  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 304240us
I20260709 13:03:26.686923  8099 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:26.658270  8206 consensus_queue.cc:260] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:26.708474  8205 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:26.697526  8216 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:26.733294  1735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43686 (request call id 2817) took 1253 ms. Trace:
I20260709 13:03:26.694559  8161 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:26.697045  8071 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:26.681979  7791 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:26.704118  8190 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:26.741827  1735 rpcz_store.cc:276] 0709 13:03:25.463864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.472679 (+  8815us) service_pool.cc:224] Handling call
0709 13:03:25.518375 (+ 45696us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:26.581129 (+1062754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:26.716702 (+135573us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400184a54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:03:26.716931 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2411875584}
I20260709 13:03:26.717247  8163 raft_consensus.cc:2749] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:26.741428  8247 log.cc:927] Time spent T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 13:03:26.695015  8240 consensus_queue.cc:1048] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:03:26.755856  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:03:26.763981  1556 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.005s	sys 0.007s
W20260709 13:03:26.768337  1556 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.005s	sys 0.007s
W20260709 13:03:26.768994  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 674576us
I20260709 13:03:26.741892  8205 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:26.742448  8185 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:03:26.817348  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 48557.1us
I20260709 13:03:26.708433  8149 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:26.753516  8161 raft_consensus.cc:2804] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:26.747677  8099 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:26.751227  8206 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:26.819490  8134 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:26.754607  8175 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:26.756044  8190 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:26.754665  8040 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:03:26.912962  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:26.731696  8242 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:26.848685  8161 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:26.961288  8161 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:26.965804  8250 log.cc:927] Time spent T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.267s	user 0.000s	sys 0.001s
I20260709 13:03:26.942369  8149 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:26.942754  8166 consensus_meta.cc:287] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.655s	user 0.011s	sys 0.001s
I20260709 13:03:26.967212  1592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46836 (request call id 1019) took 1054 ms. Trace:
I20260709 13:03:26.967628  1592 rpcz_store.cc:276] 0709 13:03:25.937629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.943252 (+  5623us) service_pool.cc:224] Handling call
0709 13:03:25.943710 (+   458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:25.944161 (+   451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:25.944197 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:25.956828 (+ 12631us) log.cc:844] Serialized 26 byte log entry
0709 13:03:26.421504 (+464676us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:26.421567 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:26.421682 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:26.966976 (+545294us) raft_consensus.cc:1685] finished
0709 13:03:26.967003 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:26.967135 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":107,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"thread_start_us":464221,"threads_started":1,"wal-append.queue_time_us":716264}
I20260709 13:03:26.947350  8040 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:26.880929  8185 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:26.969455  8040 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:26.970314  8253 log.cc:927] Time spent T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.209s	user 0.000s	sys 0.000s
I20260709 13:03:26.971513  8185 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:26.935125  8190 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:26.971813  8040 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:26.973579  7875 consensus_meta.cc:287] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.631s	user 0.009s	sys 0.004s
I20260709 13:03:26.974013  7875 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:26.975956  7875 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:26.958433  8255 log.cc:927] Time spent T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
W20260709 13:03:26.980866  8251 log.cc:927] Time spent T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
W20260709 13:03:26.959554  8261 log.cc:927] Time spent T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:03:26.952963  8248 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:26.942369  8099 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:26.737545  8208 consensus_queue.cc:260] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:26.982857  8246 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:26.989373  8205 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:26.993489  8175 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:26.966848  8166 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:26.994086  8175 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:26.995433  8176 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:26.995986  8166 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 22 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:26.996587  8166 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:26.996891  8175 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:26.997071  8166 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:27.007016  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:27.001843  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:26.999814  8205 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:27.004474  8144 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.009428  8144 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:27.008623  8166 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:03:26.982699  8239 consensus_meta.cc:287] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.578s	user 0.010s	sys 0.001s
I20260709 13:03:27.010939  8237 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.011008  8239 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:27.011638  8237 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:27.013783  8239 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:27.014407  8144 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:27.005020  8168 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:27.005961  8190 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:27.015280  8168 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:27.018007  8264 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.018528  8264 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:27.019951  8168 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:27.020860  8264 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:27.022465  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:27.024899  8190 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:27.025216  1584 raft_consensus.cc:3055] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:27.025723  1584 raft_consensus.cc:740] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:27.025769  8242 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:27.026885  1584 consensus_queue.cc:260] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:27.028375  1584 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:26.994012  7791 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:26.997255  1586 raft_consensus.cc:1240] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 21. Current term is 22. Ops: []
I20260709 13:03:26.997867  1588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:03:27.035970  1588 raft_consensus.cc:606] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:27.036455  1588 raft_consensus.cc:614] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:26.998612  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:27.043008  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:27.009917  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:03:27.047787  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 368681us
W20260709 13:03:27.000202  8067 consensus_meta.cc:287] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.676s	user 0.004s	sys 0.004s
W20260709 13:03:27.076871  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 388872us
I20260709 13:03:27.079172  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:27.079912  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:27.080880  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:27.081115  1666 raft_consensus.cc:1275] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:03:27.081188  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:27.082525  1667 raft_consensus.cc:2410] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:03:27.080022  1664 raft_consensus.cc:2468] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 11.
I20260709 13:03:27.081496  1659 raft_consensus.cc:2468] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
W20260709 13:03:27.086537  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.084221   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:03:27.093590  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:03:27.089160  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 178635us
I20260709 13:03:27.096540  1662 raft_consensus.cc:2410] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
W20260709 13:03:27.097280  1558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.105800  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:03:27.109145  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.105006  1661 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 16.
I20260709 13:03:27.114018  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:27.112746  1664 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 14.
I20260709 13:03:27.122682   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:26.937747  8134 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:27.135036  1584 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 19.
I20260709 13:03:27.085587  8077 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:27.083272  8239 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
W20260709 13:03:27.138898  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 228146us
I20260709 13:03:27.139020  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:27.143982  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:27.144922  1662 raft_consensus.cc:2410] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:03:27.145475  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:03:27.147403  8273 log.cc:927] Time spent T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:03:27.148216  8194 consensus_meta.cc:287] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.947s	user 0.011s	sys 0.002s
I20260709 13:03:27.148648  8194 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:27.142038  1707 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:27.161368  8238 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.161639  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:27.162019  8238 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:27.144786  8077 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:27.164244  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:27.165309  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:27.162544  1662 raft_consensus.cc:2393] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 19: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:27.168869  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:27.171500  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:27.172189  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:27.172504  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:03:27.144817  7719 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 13:03:27.176128  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:27.220750  1667 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:27.205873  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:27.207813  1589 raft_consensus.cc:1275] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:03:27.211460  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:27.211669  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:27.207829  2424 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:27.217304  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:27.217504  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:27.219835  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:03:27.242262  1662 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:27.176478  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:27.228745  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:27.244462  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:27.244796  1585 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 16.
I20260709 13:03:27.250265  2537 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:27.252107  1705 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:27.252991  1737 raft_consensus.cc:2393] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 18: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:27.176322  8149 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:27.254024  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:27.176131  8242 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:27.145579  8248 consensus_queue.cc:1048] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:03:27.240088  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:27.255479  1739 raft_consensus.cc:1240] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:27.176301  1664 raft_consensus.cc:2393] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 18: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:27.256631  1705 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:27.259935  1667 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
I20260709 13:03:27.175823  8265 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:27.207870  8238 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:27.261436  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:27.215334  8283 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:27.150343  8239 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:27.241636  8117 consensus_meta.cc:287] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.863s	user 0.008s	sys 0.004s
I20260709 13:03:27.266681  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:27.283751  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:27.264268  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:27.303470  1735 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 17.
I20260709 13:03:27.303747  1737 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 15.
I20260709 13:03:27.283643  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:27.267865  2424 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:27.303778  1736 raft_consensus.cc:2393] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 19: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
W20260709 13:03:27.280221  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.273298  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:27.271777  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:27.266431  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:27.269605  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:27.266024  8264 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:27.311766  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:27.276973  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:27.265820  8071 raft_consensus.cc:2749] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:27.311013  2543 raft_consensus.cc:1275] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:03:27.254285  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:27.308287  8246 raft_consensus.cc:2804] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:27.316761  8246 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:27.316906  1658 raft_consensus.cc:2393] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 16: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:27.317296  8246 raft_consensus.cc:3060] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:27.318027  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:27.319960  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:27.319169  1658 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
I20260709 13:03:27.321547  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:27.322304  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:27.322695  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:27.322924  1658 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:03:27.323887  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:27.278239  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:27.278518  8205 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.279815  8283 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:27.272289  8067 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.323900  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:03:27.401553  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 66386us
I20260709 13:03:27.402283  1664 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
I20260709 13:03:27.403503  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:27.313751  1633 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:27.326895  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:27.405063  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:03:27.327502  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 70980.7us
I20260709 13:03:27.266146  8290 raft_consensus.cc:2804] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:27.272053  8033 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.327915  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:03:27.281315  8284 log.cc:927] Time spent T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 13:03:27.271842  8242 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:27.330425  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:03:27.303274  8200 consensus_meta.cc:287] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.695s	user 0.011s	sys 0.003s
I20260709 13:03:27.429288  8200 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:27.430524  8242 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:27.311070  8117 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:27.431491  8200 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:27.433262  8117 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 21 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:27.410710  8067 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:27.331473  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:27.435343  1587 raft_consensus.cc:2393] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 19: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:27.325555  8194 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:27.330717  1662 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 18.
I20260709 13:03:27.436594  1590 raft_consensus.cc:1240] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:03:27.254926  8161 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:27.262159  8176 consensus_queue.cc:1048] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:03:27.451292  1741 raft_consensus.cc:1275] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:03:27.281975  8291 log.cc:927] Time spent T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:03:27.407717  8075 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.282899  8239 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:27.457453  1592 raft_consensus.cc:1275] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:03:27.405763  1658 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 21.
I20260709 13:03:27.274848  8077 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:27.328131  8144 raft_consensus.cc:2804] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:27.473784  8144 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:27.474253  8144 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:27.459095  8075 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:27.482336  1740 raft_consensus.cc:1275] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:03:27.483935  8300 log.cc:927] Time spent T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:03:27.484212  8075 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:27.484558  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:27.485663  1740 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:27.401321  8205 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:27.487711  8302 log.cc:927] Time spent T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
W20260709 13:03:27.413535  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 99848.3us
I20260709 13:03:27.494413  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:27.511514  1633 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:27.511998  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:27.417757  8033 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:27.513130  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:27.514201  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:27.514904  8033 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:27.515262  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:27.515511  1589 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 18.
I20260709 13:03:27.421186  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:27.517170  8208 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:27.512734  1633 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:27.517506  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:27.517829  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:27.518368  1659 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
I20260709 13:03:27.518821  1633 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:27.519135  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:27.520217  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:27.520727  1659 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 15.
I20260709 13:03:27.422004  8237 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:27.501498  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:27.495594  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:27.522042  1735 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 15.
I20260709 13:03:27.501904  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:27.523260  1735 raft_consensus.cc:1275] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:03:27.503803  1740 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 19.
I20260709 13:03:27.517556  8242 raft_consensus.cc:2749] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:27.524545  8285 raft_consensus.cc:2749] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:03:27.494436  8202 consensus_meta.cc:287] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 1.101s	user 0.014s	sys 0.000s
I20260709 13:03:27.525449  8202 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:27.491578  2548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:27.526566  1666 raft_consensus.cc:1240] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:03:27.492066  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:27.423870  8282 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:27.425263  8134 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:27.279060  8265 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:27.518823  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:27.528355  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:27.528779  1665 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:03:27.529027  1659 raft_consensus.cc:2393] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 11: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:27.496383  8205 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:27.529973  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:27.530270  8265 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:27.269194  8149 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:27.532361  8149 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:27.434511  8190 raft_consensus.cc:2749] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:27.532546  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:27.528043  8282 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:27.533720  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:27.534894  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:27.503073  1592 raft_consensus.cc:1275] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:03:27.535337  2552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:27.437288  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:27.536002  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:27.536510  1659 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:27.438027  1583 raft_consensus.cc:1240] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:27.439800  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:27.442415  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:27.325484  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:27.450152  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:27.525219  8285 raft_consensus.cc:2749] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:27.546185  8160 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:27.449287  2537 raft_consensus.cc:2468] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12.
I20260709 13:03:27.454890  1663 raft_consensus.cc:2393] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 15: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:27.548130  2553 raft_consensus.cc:1240] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:27.401063  8283 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:27.410004  8290 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:27.549116  8290 raft_consensus.cc:3060] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:27.551606  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.559047  8290 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:27.400092  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:27.458010  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:27.536535  1662 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 17.
I20260709 13:03:27.436115  8194 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.561903  1659 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 14.
I20260709 13:03:27.562259  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:27.562383  8194 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:27.562870  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:27.460606  8161 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:27.436024  8132 consensus_queue.cc:1048] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:03:27.448487  1707 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:27.564687  8132 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:27.332691  8264 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:27.491873  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:27.527565  8202 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:27.472471  8206 consensus_meta.cc:287] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.556s	user 0.011s	sys 0.000s
I20260709 13:03:27.436308  8067 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:27.507378  1556 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:27.567381  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:27.528034  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:27.488993  8303 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:27.564821  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 116441us
I20260709 13:03:27.571867  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:27.575598  2550 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 16.
I20260709 13:03:27.520944  1633 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:27.565634  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:27.564874  8194 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:27.563042  1662 raft_consensus.cc:2393] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 16: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
W20260709 13:03:27.572587  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 65309us
I20260709 13:03:27.584677  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:03:27.585412  1556 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.831s (SENT) [suppressed 13 similar messages]
I20260709 13:03:27.586323  1556 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:27.546506  8246 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:27.571640  1666 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 15.
I20260709 13:03:27.568804  1704 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:27.577957  1630 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:27.580010  8206 consensus_queue.cc:1059] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:27.580911  8202 raft_consensus.cc:2749] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:27.576983  1664 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
I20260709 13:03:27.601503  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:03:27.578925  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 58038.1us
I20260709 13:03:27.602720  1633 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:27.582150  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:27.603677  1591 raft_consensus.cc:2368] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 18. Current term is 19.
I20260709 13:03:27.412375  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:27.583333  1667 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 24.
I20260709 13:03:27.588702  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:27.607062  1556 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:27.607455  1661 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:27.590101  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:27.576150  8237 raft_consensus.cc:2804] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:27.604838  1664 raft_consensus.cc:2410] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:03:27.575023  8282 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:27.606292  1633 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:27.607870  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:27.590066  1707 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:27.608946  1662 raft_consensus.cc:2393] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 18: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:27.609141  1736 raft_consensus.cc:1240] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:27.610812  1556 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:27.594975  8150 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.622928  1633 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:27.623796  1659 raft_consensus.cc:1240] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:27.624577  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:27.600768  8132 raft_consensus.cc:2804] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:27.626394  1663 raft_consensus.cc:1275] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:03:27.601133  8194 raft_consensus.cc:2804] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:27.643987  1658 raft_consensus.cc:2468] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
I20260709 13:03:27.657790  1662 raft_consensus.cc:1275] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:27.613334  8161 raft_consensus.cc:2749] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:27.583288  8303 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:27.607982  8289 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
W20260709 13:03:27.657902  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 47170.4us
I20260709 13:03:27.660936  1661 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 21.
I20260709 13:03:27.677413  1556 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:27.677817  1633 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:27.663262  1662 raft_consensus.cc:1240] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:27.627103  8202 raft_consensus.cc:2749] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:27.617730  8149 raft_consensus.cc:3055] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:03:27.664438  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 74463.8us
I20260709 13:03:27.622254  8200 raft_consensus.cc:2804] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:27.609375  8075 raft_consensus.cc:2749] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:27.660161  8242 raft_consensus.cc:2749] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:27.686419  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 67223.1us
I20260709 13:03:27.689792  8285 consensus_queue.cc:1059] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:27.690266  1661 raft_consensus.cc:1240] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:27.690631  8190 consensus_queue.cc:1059] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:27.695194  1662 raft_consensus.cc:1240] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:27.768311  1662 raft_consensus.cc:1275] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:03:27.769630  1662 raft_consensus.cc:1275] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:03:27.770856  1662 raft_consensus.cc:1275] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:03:27.779476  8246 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:27.747455  8270 log.cc:927] Time spent T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:03:27.786971  8264 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:27.789742  8283 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:27.793327  1734 raft_consensus.cc:1240] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:03:27.680581  8195 consensus_queue.cc:1048] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.121s
I20260709 13:03:27.667269  8238 consensus_queue.cc:1048] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 13:03:27.724233  8149 raft_consensus.cc:740] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:27.818049  8149 consensus_queue.cc:260] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:27.819413  8149 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:27.743409  8117 raft_consensus.cc:2749] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:27.724713  8265 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:27.823187  8265 raft_consensus.cc:697] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 19 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:27.653398  8150 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:27.827841  8150 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:27.695874  8303 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:27.696585  8205 raft_consensus.cc:2749] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:27.612460  7791 consensus_queue.cc:1048] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:03:27.652664  8288 raft_consensus.cc:2749] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:27.696964  1633 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:03:27.709744  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 51550.4us
I20260709 13:03:27.838177  1705 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:27.710939  8132 raft_consensus.cc:697] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 12 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:27.712441  8294 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:27.843967  8294 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:27.714479  8144 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:27.844528  8132 consensus_queue.cc:237] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:27.846231  8294 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:27.716058  8290 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 12 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:27.847520  8144 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 15 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:03:27.847973  2554 raft_consensus.cc:1240] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:27.716658  8292 consensus_queue.cc:1059] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:27.625999  8237 raft_consensus.cc:697] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:27.849851  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:27.850474  8237 consensus_queue.cc:237] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:27.852036  8033 consensus_queue.cc:1059] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:27.718385  1556 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:27.853118  8033 raft_consensus.cc:3055] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:27.853478  8033 raft_consensus.cc:740] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:03:27.853677  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 135370us
I20260709 13:03:27.854274  8033 consensus_queue.cc:260] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:27.855419  8033 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:27.722534  1665 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 19.
I20260709 13:03:27.654584  8194 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:27.758838  8285 raft_consensus.cc:3055] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:27.856370  8194 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:27.856484  8285 raft_consensus.cc:740] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:27.857270  8241 raft_consensus.cc:2749] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:27.857759  8285 consensus_queue.cc:260] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:27.859195  8285 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:03:27.697019  8268 log.cc:927] Time spent T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:03:27.862808  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:27.746783  1707 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:27.758888  8190 raft_consensus.cc:3055] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:27.864522  8194 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:27.874540  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:27.875219  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 128550us
W20260709 13:03:27.878970  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 182100us
I20260709 13:03:27.884621  1633 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:27.886089  1707 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:27.876653  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:27.855655  1556 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:27.888548  1556 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:03:27.885802  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 140072us
I20260709 13:03:27.891099  1707 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:27.890986  1558 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:27.744966  8200 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:27.893584  1558 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:03:27.913458  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 257779us
I20260709 13:03:27.878571  8202 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.917109  1556 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:27.917634  8288 raft_consensus.cc:2804] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:27.874253  8190 raft_consensus.cc:740] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:27.918226  8195 raft_consensus.cc:3055] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:27.920379  1707 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:27.924387  1558 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:27.921716  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:27.926028  1734 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 12.
I20260709 13:03:27.874423  8160 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:27.927379  1660 raft_consensus.cc:1240] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:27.929015  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:27.929453  1558 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:27.884199  7935 raft_consensus.cc:2749] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:27.938452  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 53964.7us
I20260709 13:03:27.948987  1633 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:27.937716  2554 raft_consensus.cc:1240] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:27.939965  1556 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:27.949450  1558 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:27.883777  8264 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:27.946811  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.824453  8265 consensus_queue.cc:237] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:27.954262  1633 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:27.889181  8283 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:27.918721  8246 raft_consensus.cc:2749] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:27.719300  8289 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:27.923871  8200 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:27.919147  8117 raft_consensus.cc:2749] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:27.969269  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:27.954205  8241 raft_consensus.cc:2749] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:27.962165  1633 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:27.928968  7719 raft_consensus.cc:2749] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:27.923748  8071 raft_consensus.cc:2804] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:27.927938  8195 raft_consensus.cc:740] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:27.927644  8288 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:27.972332  1633 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:27.934759  8206 raft_consensus.cc:2749] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:27.944535  8081 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:27.953488  8075 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:27.954717  8295 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:03:27.957854  8205 raft_consensus.cc:2749] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:27.963821  8244 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.927382  8150 consensus_queue.cc:1048] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:03:27.968477  8161 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:27.940496  8202 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:27.972414  8303 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.980926  1633 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:27.972084  8237 raft_consensus.cc:2804] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:27.957634  8242 consensus_queue.cc:1059] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:03:27.954098  8160 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:27.973829  8071 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:27.981426  8264 raft_consensus.cc:2804] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:27.977314  8288 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:27.978526  7791 raft_consensus.cc:2749] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:27.985839  8240 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:27.963821  8312 consensus_queue.cc:1048] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:03:28.023166  8237 raft_consensus.cc:697] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:28.024546  8194 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:28.031041  8202 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:27.994102  8161 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:28.074040  8161 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:28.074158  8237 consensus_queue.cc:237] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:28.037175  8160 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:27.987249  8190 consensus_queue.cc:260] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:27.988874  7935 consensus_queue.cc:1059] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:03:28.022629  8071 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:28.054572  8289 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:27.998867  8244 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:28.017686  8205 raft_consensus.cc:2749] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:28.065627  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:03:28.015780  8303 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:28.023146  8264 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:03:28.077760  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 128366us
I20260709 13:03:28.102265  8264 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:28.111416  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:03:28.120249  1558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:28.120908  1558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.122187  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:28.048628  8195 consensus_queue.cc:260] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:28.126323  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:28.130110  1591 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 20.
I20260709 13:03:28.109192  8190 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:28.123474  8206 consensus_queue.cc:1059] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:03:28.110098  8292 raft_consensus.cc:2749] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:28.137230  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:28.152901  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:28.153355  1592 raft_consensus.cc:2393] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 18: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:28.154569  1587 raft_consensus.cc:1240] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:03:28.156062  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:28.119701  8075 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.156646  1585 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 16.
I20260709 13:03:28.123332  8081 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:28.169446  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:03:28.142938  8317 log.cc:927] Time spent T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:03:28.171766  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:28.144830  8303 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:28.174764  1587 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 16.
I20260709 13:03:28.129997  8208 consensus_queue.cc:1048] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:03:28.121186  8295 consensus_queue.cc:1059] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:03:28.149067  8206 raft_consensus.cc:3055] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:03:28.149915  8195 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:28.151027  8244 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:28.177955  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:28.141352  8160 raft_consensus.cc:3055] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:28.180770  1707 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:28.188019  1707 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:03:28.188417  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.190121  1707 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:28.202817  8303 raft_consensus.cc:2804] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:28.203428  8303 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.204035  8303 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:28.168723  8075 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:28.181246  8206 raft_consensus.cc:740] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
W20260709 13:03:28.220244  8316 log.cc:927] Time spent T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.187s	user 0.001s	sys 0.001s
I20260709 13:03:28.252535   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:28.190721  8160 raft_consensus.cc:740] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
W20260709 13:03:28.136441  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 155605us
I20260709 13:03:28.197474  7935 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:28.197752  8149 raft_consensus.cc:2804] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:28.175698  8081 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:28.219368  1484 catalog_manager.cc:5697] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:28.273029  1484 catalog_manager.cc:5697] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 12 to 16, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 16 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:03:28.276304  1488 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55132 (request call id 309) took 23635 ms (client timeout 15000 ms). Trace:
I20260709 13:03:28.277230  1734 raft_consensus.cc:1275] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:03:28.276837  1488 rpcz_store.cc:269] 0709 13:03:04.641252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.644271 (+  3019us) service_pool.cc:224] Handling call
0709 13:03:28.276207 (+23631936us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:23.135463 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:23.179061 (+ 43598us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:23.179118 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:03:23.179146 (+    28us) tablet.cc:662] Decoding operations
0709 13:03:23.469911 (+290765us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:23.470043 (+   132us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:23.470101 (+    58us) tablet.cc:685] Acquiring locks for 29 operations
0709 13:03:23.681713 (+211612us) tablet.cc:701] Row locks acquired
0709 13:03:23.700162 (+ 18449us) write_op.cc:260] PREPARE: finished
0709 13:03:23.748501 (+ 48339us) write_op.cc:270] Start()
0709 13:03:23.790674 (+ 42173us) write_op.cc:276] Timestamp: P: 1783602203736957 usec, L: 0
0709 13:03:23.790717 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 13:03:23.965921 (+175204us) log.cc:844] Serialized 11368 byte log entry
0709 13:03:24.604726 (+638805us) op_driver.cc:464] REPLICATION: finished
0709 13:03:24.841721 (+236995us) write_op.cc:301] APPLY: starting
0709 13:03:24.846852 (+  5131us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:26.120764 (+1273912us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:26.120871 (+   107us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:26.991852 (+870981us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:26.992298 (+   446us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=58,key_file_lookups=58,delta_file_lookups=58,mrs_lookups=0
0709 13:03:26.992352 (+    54us) write_op.cc:312] APPLY: finished
0709 13:03:26.993251 (+   899us) log.cc:844] Serialized 252 byte log entry
0709 13:03:27.083331 (+ 90080us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:27.106463 (+ 23132us) write_op.cc:454] Released schema lock
0709 13:03:27.106645 (+   182us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:27.107478 (+   833us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:27.107535 (+    57us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3170305,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":221314,"apply.run_cpu_time_us":62720,"apply.run_wall_time_us":2272056,"cfile_cache_hit":118,"cfile_cache_hit_bytes":125347,"num_ops":29,"prepare.queue_time_us":189807,"prepare.run_cpu_time_us":34147,"prepare.run_wall_time_us":1171074,"raft.queue_time_us":188500,"raft.run_cpu_time_us":160078,"raft.run_wall_time_us":183209,"replication_time_us":808719,"thread_start_us":800119,"threads_started":5,"wal-append.queue_time_us":527759,"wal-append.run_cpu_time_us":9746,"wal-append.run_wall_time_us":2270020}]]}
W20260709 13:03:28.296703  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 356842us
I20260709 13:03:28.302654  1556 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:03:28.309660  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 51364us
I20260709 13:03:28.260953  7935 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.313325  1556 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:28.270658  8149 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.323050  1584 raft_consensus.cc:2468] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 15.
I20260709 13:03:28.332665  1556 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:28.301210  8133 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.342142  1556 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:28.353525  1556 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:28.360361  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:28.363636  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:28.364436  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 26 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:28.365172  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:28.365844  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:28.373337  1556 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:28.369532  1734 raft_consensus.cc:2393] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 15: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:28.343258  8033 raft_consensus.cc:2804] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:28.366511  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:28.331341  7935 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:28.339586  8149 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:28.381469  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 398277us
W20260709 13:03:28.369472  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 301124us
I20260709 13:03:28.385063  1556 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:28.390684  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:28.338032  8241 raft_consensus.cc:2749] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:28.403503  2426 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:28.407635  2426 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:28.374975  8323 raft_consensus.cc:2804] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:28.414314  1705 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:28.424235  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:28.429313  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:28.436718  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:28.448230  1556 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:28.452994  1705 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:28.451412  2426 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:28.403075  8283 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.401816  8033 raft_consensus.cc:697] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:28.362877  8133 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:28.380136  7791 consensus_queue.cc:1048] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
W20260709 13:03:28.423465  8321 log.cc:927] Time spent T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
W20260709 13:03:28.459479  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.480880  1666 raft_consensus.cc:1275] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:03:28.460649  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:28.461982  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:28.416429  8168 raft_consensus.cc:2749] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:28.459311  8130 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:28.487902  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:28.445161  8238 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:28.416778  8323 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:28.472146  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:03:28.455720  8329 log.cc:927] Time spent T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:03:28.450248  8237 raft_consensus.cc:2749] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:28.480403  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:28.404911  8264 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:28.469913  8167 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:28.496274  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:28.482566  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:28.483075  1659 raft_consensus.cc:1275] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:03:28.375401  8206 consensus_queue.cc:260] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:28.420079  8289 raft_consensus.cc:2804] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:28.461427  8117 raft_consensus.cc:2804] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:28.383365  8160 consensus_queue.cc:260] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:28.499240  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:28.502962  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:28.455094  7719 consensus_queue.cc:1048] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:03:28.485069  8322 raft_consensus.cc:3055] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:28.509773  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:28.511993  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:28.512168  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:28.513108  1661 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 16.
I20260709 13:03:28.514425  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:28.487236  8295 raft_consensus.cc:2749] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:28.515027  1666 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 19.
I20260709 13:03:28.521857  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:28.493772  8132 raft_consensus.cc:2804] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:28.494067  8294 raft_consensus.cc:2749] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 19 LEADER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:28.466017  8283 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:28.498732  8323 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:28.483317  8071 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:28.560631  1633 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:28.593338  8292 raft_consensus.cc:2749] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:03:28.563427  8331 log.cc:927] Time spent T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:03:28.564198  8161 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:28.565275  8081 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:28.567763  8264 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:28.569025  2543 raft_consensus.cc:1275] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:03:28.420539  1484 catalog_manager.cc:5697] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:28.511343  8322 raft_consensus.cc:740] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:28.574255  8075 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:28.582635  8200 consensus_meta.cc:287] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.607s	user 0.011s	sys 0.000s
W20260709 13:03:28.587661  8288 consensus_meta.cc:287] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.538s	user 0.010s	sys 0.000s
I20260709 13:03:28.504084  8289 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:28.556864  8206 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:28.524468  8117 raft_consensus.cc:697] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 21 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:28.537856  8033 consensus_queue.cc:237] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:28.614051  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 158112us
I20260709 13:03:28.569505  7935 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:28.626576  8312 raft_consensus.cc:2804] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:03:28.668125  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 215244us
W20260709 13:03:28.676645  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 226552us
I20260709 13:03:28.654289  8289 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:28.696527  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.724893  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:03:28.725524  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 48095.5us
I20260709 13:03:28.727136  2426 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:28.654783  8288 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:28.696909  7791 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:28.732861  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.733108  7791 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:28.734368  8288 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:28.735136  8288 consensus_queue.cc:1059] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:28.735458  7791 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:28.737519  8161 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:28.738066  8288 raft_consensus.cc:3055] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:28.738514  8288 raft_consensus.cc:740] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:28.739532  8288 consensus_queue.cc:260] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:28.741166  8288 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:28.742847  8071 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:28.743654  8071 consensus_queue.cc:1048] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:03:28.751484  8339 log.cc:927] Time spent T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:03:28.752473  8144 raft_consensus.cc:2804] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:28.753177  8144 raft_consensus.cc:697] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:28.753902  8283 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:28.754168  8144 consensus_queue.cc:237] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:28.770402  7935 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:28.791355  8133 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:28.794139  1484 catalog_manager.cc:5697] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 12 to 13, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 13 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:28.794955  8117 consensus_queue.cc:237] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:28.653362  8200 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:28.750224  8303 consensus_meta.cc:287] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.544s	user 0.008s	sys 0.008s
W20260709 13:03:28.809612  1558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.818943  1735 raft_consensus.cc:1240] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:28.820510  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:28.823427  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:28.824047  1739 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:28.830564  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:28.840463  8312 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:28.841220  8312 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:28.842201  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 385276us
I20260709 13:03:28.843502  1705 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:28.855552  8160 raft_consensus.cc:3060] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:28.862372  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:28.862648  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:28.863817  1733 raft_consensus.cc:1240] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:28.884059  8132 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:28.884856  8132 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:28.887173  8312 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:28.889628  8312 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:28.796525  1484 catalog_manager.cc:5697] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:28.928411  1739 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16.
W20260709 13:03:28.935084  8334 log.cc:927] Time spent T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.342s	user 0.001s	sys 0.003s
I20260709 13:03:28.937016  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:28.937412  1588 raft_consensus.cc:1275] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:03:28.938285  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:28.938874  1587 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:28.939044  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:28.939800  1590 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:28.941413  8246 raft_consensus.cc:2804] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:28.942122  8246 raft_consensus.cc:697] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 18 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:28.943193  8246 consensus_queue.cc:237] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:28.948169  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 50717.6us
I20260709 13:03:28.937475  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:28.967077  1590 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 21.
I20260709 13:03:28.904894  8325 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:28.931764  8190 consensus_meta.cc:287] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.766s	user 0.013s	sys 0.000s
I20260709 13:03:28.986698  8282 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:28.995139  1558 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:28.820145  8303 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:28.923573  8238 raft_consensus.cc:2749] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:29.005446  1658 raft_consensus.cc:2410] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:03:29.007025  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:29.009433  1587 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 18.
W20260709 13:03:28.973637  8343 log.cc:927] Time spent T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
W20260709 13:03:29.003252  8149 consensus_meta.cc:287] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.596s	user 0.013s	sys 0.000s
W20260709 13:03:29.026134  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 295185us
I20260709 13:03:29.004639  8283 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:29.004606  7719 consensus_queue.cc:1059] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
W20260709 13:03:29.042863  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 173528us
I20260709 13:03:29.005684  8325 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:29.031422  8353 raft_consensus.cc:2804] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:29.011322  8282 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:29.052088  1707 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:29.056289  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:29.030010  8149 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:29.033164  8132 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:29.065899  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 222473us
I20260709 13:03:29.048763  8071 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:03:29.070293  8130 consensus_meta.cc:287] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.574s	user 0.007s	sys 0.007s
I20260709 13:03:29.061105  8205 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.041672  8283 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:29.070200  8033 consensus_queue.cc:1059] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:29.073999  1738 raft_consensus.cc:1240] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:29.073371  1705 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:29.079702  1705 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:29.081620  1705 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:29.094771  8355 consensus_queue.cc:1048] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:29.074364  8294 consensus_queue.cc:1059] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:03:29.053486  8306 consensus_queue.cc:1048] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:03:29.103248  1555 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:29.072124  8244 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:03:29.178501  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 75395.6us
I20260709 13:03:29.129601  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:03:29.176990  8206 consensus_meta.cc:287] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.508s	user 0.005s	sys 0.006s
I20260709 13:03:29.096709  8355 consensus_queue.cc:1048] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
W20260709 13:03:29.276043  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.102330  8325 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:29.132859  8033 raft_consensus.cc:3055] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:29.128397  8265 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:29.223125  8323 consensus_meta.cc:287] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.609s	user 0.007s	sys 0.004s
I20260709 13:03:29.230584  8208 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:03:29.078045  8130 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:29.162654  8190 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.072247  8161 consensus_queue.cc:1059] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.200s
I20260709 13:03:29.073961  8071 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:29.183418  8295 raft_consensus.cc:2749] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:29.101212  8200 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:29.289160  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 207618us
I20260709 13:03:29.098122  8346 consensus_queue.cc:1048] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.198s
I20260709 13:03:29.272451  8202 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:03:29.342324  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 290189us
I20260709 13:03:29.097985  8322 consensus_queue.cc:260] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:29.276965  8244 raft_consensus.cc:697] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 21 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:29.112914  8205 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:29.315172  8208 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 24 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:29.325798  1705 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:29.295440  8033 raft_consensus.cc:740] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:03:29.329126  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.061957  1484 catalog_manager.cc:5697] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 9 to 13, leader changed from 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 13 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:29.338100  8282 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:29.315842  8323 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:29.297673  8353 raft_consensus.cc:697] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 16 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:29.288010  8176 raft_consensus.cc:2804] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:29.318377  8242 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.349128  1583 raft_consensus.cc:1275] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:03:29.230180  8285 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:29.343228  1707 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:03:29.366134  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 307127us
I20260709 13:03:29.365047  8208 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:03:29.383018  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 57297.4us
I20260709 13:03:29.402437  8285 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:29.404764  8285 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:29.348484  8294 consensus_queue.cc:1059] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:03:29.348804  8364 consensus_queue.cc:1048] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:03:29.409269  8167 consensus_queue.cc:1048] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:29.394254  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:29.406149  8071 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:29.413369  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 70290.4us
I20260709 13:03:29.412946  1734 raft_consensus.cc:2368] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for earlier term 17. Current term is 18.
I20260709 13:03:29.413488  8244 consensus_queue.cc:237] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:29.414750  8071 raft_consensus.cc:2804] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:29.415508  8071 raft_consensus.cc:697] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 18 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:29.407863  8322 raft_consensus.cc:3060] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:29.412132  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:29.321669  8190 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:29.349391  8202 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:29.395412  1705 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:29.386725  8033 consensus_queue.cc:260] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:29.427116  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:03:29.425582  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 330474us
I20260709 13:03:29.433437  1633 leader_election.cc:400] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 18. Current term is 19.
I20260709 13:03:29.433804  1633 leader_election.cc:403] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:29.436208  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:29.438827  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:29.439671  1663 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16.
I20260709 13:03:29.388209  8282 raft_consensus.cc:2749] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:29.440764  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 45518.3us
I20260709 13:03:29.412689  8285 consensus_queue.cc:1059] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
W20260709 13:03:29.417548  8358 log.cc:927] Time spent T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:03:29.388720  8176 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:29.418682  8294 consensus_queue.cc:1243] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer 5bb87fe07da2414e84ee578c3b176ede log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:03:29.419333  8205 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:29.418246  8306 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.452051  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:29.443604  1705 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:29.454540  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:29.500274  1658 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:29.459312  8208 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:29.453934  8176 raft_consensus.cc:3060] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:29.466465  1558 leader_election.cc:400] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 election: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for earlier term 17. Current term is 18.
I20260709 13:03:29.470695  8202 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:29.471895  8283 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:29.472898  8323 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:29.474066  8353 consensus_queue.cc:237] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:29.488101  8264 raft_consensus.cc:3055] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:03:29.532600  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 89092.5us
W20260709 13:03:29.443368  8288 consensus_meta.cc:287] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.702s	user 0.012s	sys 0.000s
I20260709 13:03:29.394398  8242 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:29.417061  8071 consensus_queue.cc:237] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:29.445184  8206 raft_consensus.cc:2749] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:29.488101  8033 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:29.489893  8190 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:29.490772  8132 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:29.499092  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:29.497905  1659 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 19.
I20260709 13:03:29.504468  1558 leader_election.cc:403] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:03:29.505367  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:29.567314  1663 raft_consensus.cc:3060] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:29.506831  1667 raft_consensus.cc:1240] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 17. Current term is 18. Ops: []
W20260709 13:03:29.507880  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 398783us
I20260709 13:03:29.508042  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:29.518749  1665 raft_consensus.cc:1275] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:29.449617  8368 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:29.522346  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:29.522683  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:29.579948  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:29.523108  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 26 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:29.581883  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:29.523681  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:29.525017  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:29.528024  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:29.529104  1738 raft_consensus.cc:2393] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 25: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:29.481948  1484 catalog_manager.cc:5697] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:29.529415  1584 raft_consensus.cc:1240] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:03:29.587528  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:29.531034  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:29.533528  1705 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:29.501855  8282 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:29.501789  8161 raft_consensus.cc:2749] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 18. Current term is 19.
I20260709 13:03:29.543679  1658 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16.
I20260709 13:03:29.520509  8202 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:29.584738  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 118483us
I20260709 13:03:29.595085  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:29.531623  8264 raft_consensus.cc:740] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:29.610157  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:29.532241  8364 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:29.596086  1589 raft_consensus.cc:1275] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:29.540141  8150 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:29.598752  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:29.599522  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:29.600642  1588 raft_consensus.cc:1240] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 20. Current term is 21. Ops: [18.12-20.13]
I20260709 13:03:29.629022  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:29.629979  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:03:29.599318  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 65922.9us
I20260709 13:03:29.537860  8367 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:29.505074  8306 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:29.539929  8246 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:29.609165  1739 raft_consensus.cc:1240] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:29.632901  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:29.566047  8205 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:29.598176  8288 raft_consensus.cc:2749] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for earlier term 17. Current term is 18.
I20260709 13:03:29.633747  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:29.655793  1586 raft_consensus.cc:1240] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:29.631891  1705 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:29.627475  1556 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:29.616729  1660 raft_consensus.cc:1275] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:03:29.606253  8373 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.598558  8190 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:29.663614  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:29.673538  1590 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:29.674928  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 50086.7us
I20260709 13:03:29.675268  1734 raft_consensus.cc:1275] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:03:29.675606  1734 pending_rounds.cc:85] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 8
I20260709 13:03:29.675815  1734 pending_rounds.cc:107] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:03:29.676030  1734 raft_consensus.cc:2889] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:29.646266  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:03:29.680919  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 49108.3us
I20260709 13:03:29.632537  8364 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:29.592365  8368 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:29.615526  8202 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:29.607939  8282 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:29.663252  8246 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:29.693164  8373 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:29.696466  8246 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:03:29.697588  8289 consensus_meta.cc:287] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6: Time spent flushing consensus metadata: real 0.950s	user 0.009s	sys 0.006s
I20260709 13:03:29.664351  8205 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:29.698222  8289 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:29.701342  8295 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:29.701954  8295 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:29.702518  8295 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:29.704262  8306 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:29.708473  8354 raft_consensus.cc:2749] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:29.667088  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:29.609812  8133 raft_consensus.cc:2749] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:29.668767  1588 raft_consensus.cc:1240] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:29.670961  1733 raft_consensus.cc:1240] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 25 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 24. Current term is 25. Ops: []
I20260709 13:03:29.714342  1592 raft_consensus.cc:1240] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:29.671087  1663 raft_consensus.cc:1275] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:03:29.714987  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:29.716687  1592 raft_consensus.cc:1275] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:03:29.654450  8134 raft_consensus.cc:3055] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:29.713505  1556 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:03:29.726908  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 45072.2us
I20260709 13:03:29.718680  2543 raft_consensus.cc:1240] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:29.679544  8244 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.672879  8149 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:29.733794  1556 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:29.711681  8265 raft_consensus.cc:2749] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:29.746495  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:29.748088  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:29.652539  8367 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:29.723990  8202 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:29.752343  8237 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:29.754599  8376 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:29.755784  8323 consensus_queue.cc:1059] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:03:29.756491  8375 log.cc:927] Time spent T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:03:29.757028  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:29.720605  7719 consensus_queue.cc:1059] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:03:29.693203  8190 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:29.726990  8285 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:29.776176  8382 log.cc:927] Time spent T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:03:29.720340  8368 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:29.776342  1666 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
I20260709 13:03:29.777423  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:29.731838  8283 consensus_queue.cc:1048] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 13:03:29.742321  8282 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:29.784845  1590 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 17.
I20260709 13:03:29.791716  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:29.726346  8134 raft_consensus.cc:740] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:29.811918  8206 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.825843  8134 consensus_queue.cc:260] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:29.825954  8206 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:29.827116  8134 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:29.787849  8289 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:29.829480  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:29.728052  1705 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:29.759997  8364 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:29.745757  8355 consensus_queue.cc:1059] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.045s
I20260709 13:03:29.818910  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:29.748250  8244 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:29.834082  8208 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 25 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:29.835032  8244 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:29.836879  8367 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:29.789686  8376 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:29.839931  8376 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:03:29.840828  8378 log.cc:927] Time spent T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:03:29.789134  8205 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:29.805418  1484 catalog_manager.cc:5697] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 10 to 15, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 15 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:29.845500  8206 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:03:29.847136  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.769822  8241 consensus_queue.cc:1048] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
W20260709 13:03:29.864121  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 47471.3us
I20260709 13:03:29.816983  8385 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.870306  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:29.870321  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:29.898823  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:29.821516  8237 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:29.901057  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:29.902590  1585 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:29.902954  2537 raft_consensus.cc:2468] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12.
W20260709 13:03:29.905586  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 177631us
I20260709 13:03:29.906970  8364 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:29.814160  8285 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:29.861619  8288 raft_consensus.cc:3055] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:29.844949  8295 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:29.922075  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 48760.4us
I20260709 13:03:29.926518  1704 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:29.858094  8242 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:29.926782  1585 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 17.
W20260709 13:03:29.921259  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 169341us
I20260709 13:03:29.857030  8303 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:29.933254  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:29.939868  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:29.941460  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:29.941067  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:29.952616  1735 raft_consensus.cc:2393] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 12: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:29.948386  1556 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:03:29.954988  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 48691.3us
I20260709 13:03:29.956823  1733 raft_consensus.cc:2393] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 12: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:29.940152  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:29.967839  1660 raft_consensus.cc:1240] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:29.968287  1705 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:29.974774  1588 raft_consensus.cc:1240] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:29.927822  8288 raft_consensus.cc:740] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:29.977452  1705 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:29.945676  8348 raft_consensus.cc:3055] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:29.942481  8134 raft_consensus.cc:2804] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:29.942317  8149 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.906555  8237 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:29.986814  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:29.987509  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:29.967317  7719 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:29.969532  8075 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:29.844825  1484 catalog_manager.cc:5697] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:29.938537  8202 consensus_queue.cc:1059] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:03:29.898393  8385 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:29.997764  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:30.013325  1585 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 21.
I20260709 13:03:30.005892  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:30.001506  1705 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:29.986748  8242 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.988360  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:29.982398  8282 raft_consensus.cc:2749] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:29.985163  8303 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:29.986277  8134 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.984968  8348 raft_consensus.cc:740] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:30.017218  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:03:30.048116  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 46731us
I20260709 13:03:30.012363  8190 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:30.051357  1590 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 18.
I20260709 13:03:30.082954  1705 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:29.992058  8149 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:30.076113  1667 raft_consensus.cc:1275] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:30.076416  1585 raft_consensus.cc:2393] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 18: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:30.054634  8285 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:30.010206  7719 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:30.050891  8265 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:03:30.055140  8130 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:30.074501  8134 raft_consensus.cc:3060] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:30.074071  8303 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
W20260709 13:03:30.087690  8380 log.cc:927] Time spent T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.267s	user 0.000s	sys 0.001s
W20260709 13:03:30.104944  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 92086us
I20260709 13:03:30.107077  1633 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:30.108317  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:30.093972  8282 raft_consensus.cc:2749] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:30.112850  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:30.113679  1667 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:30.101722  8202 raft_consensus.cc:3055] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:30.104357  8303 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:30.042289  8288 consensus_queue.cc:260] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:30.057327  8242 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:30.123324  8373 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:30.105971  8285 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:30.127616  1633 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:30.144999  8389 log.cc:927] Time spent T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:03:30.149646  8402 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:30.153263  8322 consensus_meta.cc:287] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.723s	user 0.013s	sys 0.002s
W20260709 13:03:30.156607  8033 consensus_meta.cc:287] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.594s	user 0.001s	sys 0.010s
I20260709 13:03:30.164005  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:30.119506  8202 raft_consensus.cc:740] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:30.182400  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:30.168336  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:30.103452  8130 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:30.187862  1667 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
I20260709 13:03:30.194845  1592 raft_consensus.cc:2468] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 12.
W20260709 13:03:30.166282  8387 log.cc:927] Time spent T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.214s	user 0.001s	sys 0.001s
I20260709 13:03:30.125931  8369 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:30.206218  8149 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:30.164445  1484 catalog_manager.cc:5697] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:30.173213  8373 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.209542  8373 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:30.212216  8202 consensus_queue.cc:260] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:30.214529  8237 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:30.163213  8410 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:30.216359  8410 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:30.219676  8325 raft_consensus.cc:3055] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:30.220206  8325 raft_consensus.cc:740] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:30.222211  8396 consensus_queue.cc:1059] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:30.222293  8150 consensus_queue.cc:1059] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:30.223860  8150 raft_consensus.cc:3055] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:30.223526  8264 consensus_queue.cc:260] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:30.117655  8348 consensus_queue.cc:260] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:30.224531  8150 raft_consensus.cc:740] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:30.192199  8402 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:30.223861  8149 raft_consensus.cc:3055] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:30.162406  7719 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:30.169874  8295 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:30.208635  1484 catalog_manager.cc:5697] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 8 to 10, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 10 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:30.159034  8134 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:30.203109  8403 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:03:30.238672  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 111365us
I20260709 13:03:30.278709  1591 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 15.
I20260709 13:03:30.295917  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:30.299330  1667 raft_consensus.cc:1275] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:03:30.306823  1733 raft_consensus.cc:1275] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:03:30.312460  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:03:30.333668  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:30.428925  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 114077us
I20260709 13:03:30.281060  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:30.432303  1588 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 22.
I20260709 13:03:30.431505  1633 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:30.367925  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:03:30.437435  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 122632us
I20260709 13:03:30.251964  1587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46836 (request call id 1056) took 1174 ms. Trace:
I20260709 13:03:30.433439  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:30.239400  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:03:30.390595  1632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.297837  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:30.280300  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:03:30.441709  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 97129.8us
I20260709 13:03:30.317977  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:30.443483  1587 rpcz_store.cc:276] 0709 13:03:29.077976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.078152 (+   176us) service_pool.cc:224] Handling call
0709 13:03:29.489532 (+411380us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b5800002798. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7de6ab71 00007f1b7de6aa22 00007f1b86d83c09 00007f1b85eddee0 00007f1b85fa70ab 00007f1b85fa7131 00007f1b85f68fc0 00007f1b85f53929 00007f1b85f533d2 00007f1b7f4cabd4
0709 13:03:29.489800 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:29.711872 (+222072us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:29.711921 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:29.711982 (+    61us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:29.712029 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.251710 (+539681us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b54003cfd54. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:03:30.251755 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:30.251860 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":512969856}
I20260709 13:03:30.276257  2426 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:30.490123  1740 raft_consensus.cc:1275] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:03:30.247684  8176 consensus_meta.cc:287] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.726s	user 0.006s	sys 0.009s
W20260709 13:03:30.266271  8383 log.cc:927] Time spent T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.491s	user 0.002s	sys 0.000s
I20260709 13:03:30.162278  8408 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:30.258709  8373 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:30.227252  8149 raft_consensus.cc:740] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:30.516254  8149 consensus_queue.cc:260] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:30.518020  8149 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:30.192895  8285 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:30.521944  1664 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
I20260709 13:03:30.514129   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:30.526031  1591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59106 (request call id 2714) took 1002 ms. Trace:
I20260709 13:03:30.225018  8264 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:30.497008  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:30.526710  8381 raft_consensus.cc:2749] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:30.527598  8349 raft_consensus.cc:3055] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:03:30.528163  8349 raft_consensus.cc:740] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:30.246398  8130 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:30.225979  8348 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:30.441390  7719 consensus_queue.cc:1059] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:03:30.526536  1591 rpcz_store.cc:276] 0709 13:03:29.523078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.523409 (+   331us) service_pool.cc:224] Handling call
0709 13:03:30.525790 (+1002381us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b54002ee354. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f932fa 00007f1b85f54b17 00007f1b7f4cf6d4 00007f1b7f4cf662 00007f1b7f4cf591 00007f1b7f4cf50c 00007f1b7f4ce7c2 00007f1b7f2ca48c 00007f1b7f2c98c6 00007f1b7f2c926f
0709 13:03:30.525904 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1405181824}
I20260709 13:03:30.533602  8242 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:30.512756  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 236570us
I20260709 13:03:30.258837  8202 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:30.237546  8313 consensus_queue.cc:1048] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.261s
I20260709 13:03:30.441598  8295 consensus_queue.cc:1048] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 13:03:30.240499  8241 consensus_queue.cc:1048] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.264s
W20260709 13:03:30.247143  8392 log.cc:927] Time spent T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.244s	user 0.001s	sys 0.004s
I20260709 13:03:30.440965  7791 consensus_queue.cc:1048] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:03:30.251267  7935 consensus_queue.cc:1048] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.294s
I20260709 13:03:30.260599  8402 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:30.312659  8355 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.263267  8369 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:30.566982  2426 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:30.260722  8288 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:30.259580  8385 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:30.520928  8172 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:30.533048  8349 consensus_queue.cc:260] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:30.493947  1739 raft_consensus.cc:1240] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:30.250455  1707 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:30.264138  8410 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:30.491272  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 59856.6us
I20260709 13:03:30.583418  1633 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:30.548614  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:30.558385  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 46129.2us
I20260709 13:03:30.499181  1556 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:30.506565  8354 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:30.526558  8285 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:30.572858  8369 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:30.581692  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 331336us
W20260709 13:03:30.584785  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 85806.9us
I20260709 13:03:30.488608  8325 consensus_queue.cc:260] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:30.226634  8150 consensus_queue.cc:260] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:30.585988  1558 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:30.512204  8176 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:30.589181  1633 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:30.574887  8345 raft_consensus.cc:2749] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:30.593468  8265 raft_consensus.cc:2749] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:30.593382  8241 consensus_queue.cc:1048] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:03:30.614708  8237 consensus_queue.cc:1048] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:30.597900  8134 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:30.591490  7719 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:30.571781  8397 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.616955  7719 raft_consensus.cc:697] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:30.617132  8397 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:30.617978  7719 consensus_queue.cc:237] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:30.596868  8295 raft_consensus.cc:3055] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:30.608866  1633 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:30.608865  1707 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:30.612752  8172 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:30.626784  1707 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:30.611883  1558 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:03:30.612406  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.614864  8176 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:30.608371  1556 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:30.622135  1732 raft_consensus.cc:1240] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:30.274765  1484 catalog_manager.cc:5697] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: config changed from index 5 to 8, VOTER 6d4de2ce0683442498244b9529127f91 (127.0.107.193) evicted. New cstate: current_term: 9 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:30.573091  8355 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:30.602345  8346 raft_consensus.cc:3055] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:30.603552  8410 raft_consensus.cc:2749] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:03:30.651640  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 149215us
W20260709 13:03:30.661506  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 53198.7us
I20260709 13:03:30.675473  1707 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:30.676815  1707 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:03:30.652455  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 43666us
I20260709 13:03:30.661304  8172 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:30.674386  8346 raft_consensus.cc:740] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:30.669308  8237 raft_consensus.cc:2804] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:30.604882  8354 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:30.661798  8303 consensus_meta.cc:287] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.518s	user 0.001s	sys 0.010s
I20260709 13:03:30.673813  8265 raft_consensus.cc:2749] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:30.678051  1633 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:30.684805  1664 raft_consensus.cc:1275] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:03:30.621866  8238 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:30.686195  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:03:30.652498  8397 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:30.689595  8354 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:30.703675  1732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 4416) took 1309 ms. Trace:
I20260709 13:03:30.683777  8237 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:30.690316  8303 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:30.679817  8132 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:30.709066  8241 raft_consensus.cc:2749] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:30.627480  8325 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:30.621635  8285 raft_consensus.cc:2749] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:30.694573  2554 raft_consensus.cc:3060] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:30.689349  8172 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:30.695608  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 83783.1us
I20260709 13:03:30.697822  1633 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:30.663393  8134 raft_consensus.cc:2804] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:30.662719  8161 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:30.623731  8385 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:30.704178  1732 rpcz_store.cc:276] 0709 13:03:29.394207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.394585 (+   378us) service_pool.cc:224] Handling call
0709 13:03:29.394888 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:30.653675 (+1258787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.703424 (+ 49749us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b5400438fd4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:03:30.703606 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2821874560}
I20260709 13:03:30.729714  1633 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:30.684059  7935 raft_consensus.cc:2804] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:30.625846  8295 raft_consensus.cc:740] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:03:30.721334  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 44616.7us
I20260709 13:03:30.731616  1633 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:30.732479  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:30.735324  1735 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 18.
I20260709 13:03:30.718328  8237 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:30.733296  1734 raft_consensus.cc:1240] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:30.733494  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:30.736814  1740 raft_consensus.cc:1275] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:03:30.737272  1667 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 18.
W20260709 13:03:30.739692  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.742762  1633 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:30.760054  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.767064  1633 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:30.740708  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 245982us
I20260709 13:03:30.771327  1633 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:30.772272  8190 raft_consensus.cc:2749] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:30.772984  1633 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:30.774245  1633 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:30.775063  8408 raft_consensus.cc:2804] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:30.775372  1633 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:30.775486  8408 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:30.775995  8408 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:30.776278  1633 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:30.776463  8190 raft_consensus.cc:2804] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:30.776830  8190 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:30.777190  8190 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:30.777526  1633 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:30.777769  8403 raft_consensus.cc:2804] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:30.778404  8403 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:30.778868  8403 raft_consensus.cc:3060] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:30.780604  8412 raft_consensus.cc:2804] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:30.781232  8412 raft_consensus.cc:697] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 15 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:30.781430  8242 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:03:30.784543  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 46252.6us
I20260709 13:03:30.786330  1633 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:30.736382  8410 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:30.736658  8409 raft_consensus.cc:2749] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:30.789892  1707 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:30.793114  1633 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:30.750718  8385 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:30.803766  8385 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:30.730202  8117 consensus_queue.cc:1048] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.053s
I20260709 13:03:30.746109  8134 raft_consensus.cc:697] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 17 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:30.810065  8134 consensus_queue.cc:237] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:30.811182  1707 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:30.812399  1707 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:30.813248  8381 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:30.815008  8071 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:30.815416  8071 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:30.815757  8071 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:30.818639  8176 raft_consensus.cc:2749] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:30.819319  8176 raft_consensus.cc:2749] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:30.782122  8412 consensus_queue.cc:237] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:30.769591  8402 raft_consensus.cc:2749] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:30.794301  8417 consensus_queue.cc:1059] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:03:30.825059  8132 raft_consensus.cc:3055] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:30.825218  8404 raft_consensus.cc:3060] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:30.825489  8132 raft_consensus.cc:740] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:30.826511  8132 consensus_queue.cc:260] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:30.827842  8132 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:30.768724  8285 raft_consensus.cc:2749] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:30.723218  8346 consensus_queue.cc:260] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:30.929394  8355 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:30.976847  1474 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b37805060ac444b6b6e9e7da8164233c with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7e839e91a1314c2f9a99b25b17c916a6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:30.982722  1484 catalog_manager.cc:5697] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 16 to 18, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 18 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:31.045604  7935 raft_consensus.cc:697] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 17 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
W20260709 13:03:31.089671  1474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 113200us
I20260709 13:03:31.049328  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:31.091269  8303 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:31.091526  1741 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 17.
W20260709 13:03:31.055460  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.061468  8149 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.066244  8205 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:30.942238  8404 raft_consensus.cc:2749] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:30.948839  8403 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:30.945613  8408 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:31.077272  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:31.085994  8428 raft_consensus.cc:476] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 19 LEADER]: Not starting pre-election -- already a leader
I20260709 13:03:31.093349  7935 consensus_queue.cc:237] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:30.858996  8241 consensus_queue.cc:1175] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5ced62816f8545cd9b63a27e9055e42d" responder_term: 12 status { last_received { term: 11 index: 6 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:03:31.099246  8149 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:31.121281  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 328094us
I20260709 13:03:31.105027  8417 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.112427  8408 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 22 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:31.124605  8149 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:31.128494  8417 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:31.142596  8417 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:31.143401  8403 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:31.173910  8355 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:31.175161  8355 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:31.193598  2554 raft_consensus.cc:2468] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 13.
I20260709 13:03:31.193121  8295 consensus_queue.cc:260] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:31.195367  1704 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:31.196085  8295 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:31.203438  1665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 4477) took 1012 ms. Trace:
I20260709 13:03:31.208595  8355 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:31.159350  8403 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:31.233676  1592 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:03:31.234936  1592 raft_consensus.cc:606] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:31.235531  1592 raft_consensus.cc:614] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:31.237385  8403 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:31.240386  8403 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:31.205720  8371 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:31.204108  1665 rpcz_store.cc:276] 0709 13:03:30.190770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.190913 (+   143us) service_pool.cc:224] Handling call
0709 13:03:30.191246 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:30.555385 (+364139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:30.555419 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:30.555464 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:30.555498 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:31.202805 (+647307us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b54002701d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:03:31.202884 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:31.203190 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":836943744}
I20260709 13:03:31.241640  8371 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:31.244545  8371 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:31.253201  1662 raft_consensus.cc:1240] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:31.254276  8353 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:31.255113  8353 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:31.258311  8346 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:31.260557  8161 raft_consensus.cc:2749] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:31.262041  8150 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:31.262790  8396 raft_consensus.cc:2804] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:31.263409  8396 raft_consensus.cc:697] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 13 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:31.267166  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:31.269973  1661 raft_consensus.cc:2410] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:03:31.264616  8396 consensus_queue.cc:237] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:31.281677  8325 consensus_meta.cc:287] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.558s	user 0.006s	sys 0.014s
I20260709 13:03:31.283560  8353 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:31.222136  8312 consensus_queue.cc:1048] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.064s
W20260709 13:03:31.285665  8242 consensus_meta.cc:287] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.503s	user 0.010s	sys 0.007s
I20260709 13:03:31.286303  8242 raft_consensus.cc:2749] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:31.287950  1556 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:31.288201  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:31.289314  8323 raft_consensus.cc:2804] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:31.289795  8323 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.290230  8323 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:31.280706  8349 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:03:31.293922  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 45231.4us
W20260709 13:03:31.295022  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.295738  2426 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:31.290460  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:31.204787  8071 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:31.297159  8374 raft_consensus.cc:2804] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:31.318409  1659 raft_consensus.cc:2393] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 in current term 17: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
W20260709 13:03:31.324689  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:31.325682  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.311408  8374 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:31.334589  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:31.331471  8374 raft_consensus.cc:3060] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:31.337536  8369 consensus_meta.cc:287] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.715s	user 0.013s	sys 0.010s
I20260709 13:03:31.370458  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:31.371239  1739 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 18.
W20260709 13:03:31.376468  8288 consensus_meta.cc:287] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.800s	user 0.019s	sys 0.000s
I20260709 13:03:31.382470  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:31.383325  1739 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 20.
I20260709 13:03:31.391148  1741 raft_consensus.cc:1240] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 17 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:03:31.397495  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:31.399588  1739 raft_consensus.cc:1240] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 21 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 20. Current term is 21. Ops: [18.12-20.13]
I20260709 13:03:31.401867  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:31.402673  1741 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 18.
I20260709 13:03:31.403656  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:03:31.404769  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.405580  8071 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:31.411175  8381 consensus_meta.cc:287] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.597s	user 0.013s	sys 0.005s
I20260709 13:03:31.412822  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:31.357998  8369 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:31.420755  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:31.421003  8323 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:31.475656  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.540197  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:03:31.479647  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.481243  8381 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:03:31.422246  8190 consensus_meta.cc:287] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede: Time spent flushing consensus metadata: real 0.644s	user 0.012s	sys 0.010s
I20260709 13:03:31.433331  8205 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.524528  8071 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:31.524755  1740 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 16.
I20260709 13:03:31.526225  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:31.527624  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:31.527946  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:31.528280  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:31.528141  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:31.557257  1735 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 18.
W20260709 13:03:31.530149  8237 consensus_meta.cc:287] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.778s	user 0.007s	sys 0.010s
I20260709 13:03:31.531618  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:31.532946  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:31.533149  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:31.534675  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:31.535362  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:31.536396  8242 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.539237  1666 raft_consensus.cc:1240] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 25 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 24. Current term is 25. Ops: []
I20260709 13:03:31.539880  8288 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.572739  8288 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:31.478971  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:31.458387  8353 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.548058  8241 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.450141  8371 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:31.555038  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:03:31.565994  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.542398  8396 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:31.568081  1587 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 18.
I20260709 13:03:31.567770  8071 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:31.594568  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:31.595871  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:31.569288  8323 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:31.570350  1586 raft_consensus.cc:2393] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 16: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:31.570528  1584 raft_consensus.cc:2393] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 19: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:31.598587  1661 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 18.
I20260709 13:03:31.599675  8353 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:31.571327  1591 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:31.602209  8205 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:31.604707  8205 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:31.571852  8242 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:31.542387  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 60980.2us
I20260709 13:03:31.608081  1587 raft_consensus.cc:1240] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:31.566694  8190 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:31.577275  8237 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:31.578342  8374 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:31.583511  1739 raft_consensus.cc:1275] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:03:31.556380  7935 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.595957  8071 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:31.569473  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:31.573565  1583 raft_consensus.cc:2393] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 22: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:31.580346  8161 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.617202  1588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:03:31.619153  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:31.620374  8161 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:31.622926  8161 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:31.625155  8371 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:31.625684  1584 raft_consensus.cc:1275] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:03:31.590046  8325 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.629340  1592 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 20.
I20260709 13:03:31.633917  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:31.618096  8242 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:31.645292  1556 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:31.631932  1588 raft_consensus.cc:606] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:31.657538  1591 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 22.
I20260709 13:03:31.614228  7935 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:31.660566  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 78826.1us
I20260709 13:03:31.616813  8396 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:31.666522  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:31.649150  8161 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:31.634684  8241 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:31.671267  1585 raft_consensus.cc:2468] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 12.
I20260709 13:03:31.671801  1666 raft_consensus.cc:1275] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:03:31.652565  8295 raft_consensus.cc:2804] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:31.634666  8325 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:31.683681  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:31.686645  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:31.687337  1734 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:03:31.695642  1667 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:31.696041  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:31.697204  1661 raft_consensus.cc:1275] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:03:31.685367  8295 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:31.698544  8295 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:31.684414  8431 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.714847  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:31.716451  1585 raft_consensus.cc:1275] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:03:31.719628  8437 log.cc:927] Time spent T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.133s	user 0.001s	sys 0.001s
I20260709 13:03:31.720705  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:31.728377  1587 raft_consensus.cc:1240] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:31.734097  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:31.736763  8241 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:31.735389  1734 raft_consensus.cc:1240] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 25 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 24. Current term is 25. Ops: []
I20260709 13:03:31.737402  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:31.742551  8241 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.749531  8265 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.750241  8265 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:31.752987  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:31.752533  8265 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:31.753829  1734 raft_consensus.cc:2368] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 22. Current term is 23.
I20260709 13:03:31.756845  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:31.757453  1741 raft_consensus.cc:3060] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:03:31.705006  8161 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:31.762497  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:31.763011  8117 consensus_queue.cc:1048] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:03:31.771451  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:31.768836  1667 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 19.
W20260709 13:03:31.775950  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.775966  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:03:31.778034  8442 log.cc:927] Time spent T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:03:31.781848  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:31.782887  1666 raft_consensus.cc:2410] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:03:31.792953  1734 raft_consensus.cc:2393] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 12: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:31.713579  8431 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:31.837944  8325 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:31.838799  1705 leader_election.cc:336] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.641s (SENT)
W20260709 13:03:31.839740  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 58711.2us
I20260709 13:03:31.842162  8374 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 17 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:31.844590  8396 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:31.845894  1556 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:31.826922  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:31.846746  1589 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 16.
I20260709 13:03:31.786943  8190 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:31.795607  8237 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:31.865485  8312 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.868996  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:31.775600  8241 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:31.869858  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:31.877034  1741 raft_consensus.cc:2468] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 22.
W20260709 13:03:31.869042  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 149778us
I20260709 13:03:31.866055  8352 raft_consensus.cc:2804] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:31.888899  2543 raft_consensus.cc:1275] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:03:31.890965  8396 consensus_queue.cc:1048] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:31.900985  2554 raft_consensus.cc:2393] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 13: Already voted for candidate 7e839e91a1314c2f9a99b25b17c916a6 in this term.
I20260709 13:03:31.904196  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:31.905695  1666 raft_consensus.cc:2393] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 in current term 17: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:31.905170  8352 raft_consensus.cc:697] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:03:31.912858  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.913605  1585 raft_consensus.cc:1275] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:31.914839  8353 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:31.921546  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:31.922350  1666 raft_consensus.cc:1813] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Handling vote request from an unknown peer 6d4de2ce0683442498244b9529127f91
I20260709 13:03:31.922926  1666 raft_consensus.cc:2410] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:03:31.925554  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:31.927265  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:31.922228  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:31.930336  1667 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 20.
I20260709 13:03:31.931579  8371 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:31.933786  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.876689  8312 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:31.934751  1586 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:03:31.935348  1586 raft_consensus.cc:606] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:31.935696  1586 raft_consensus.cc:614] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:03:31.935822  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.908605  8352 consensus_queue.cc:237] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:31.940862  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:31.941633  1586 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:31.921674  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:31.945926  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:03:31.951757  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.954275  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:31.958447  1666 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16.
I20260709 13:03:31.958976  8161 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:31.960227  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:31.965126  1664 raft_consensus.cc:1275] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:03:31.972898  1585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:03:31.975574  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:31.976265  1590 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12.
I20260709 13:03:31.976536  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:31.977329  1583 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 15.
I20260709 13:03:31.977528  8369 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 20 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:31.935847  8312 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:31.978716  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:31.979229  8431 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:31.980973  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:31.982280  2537 raft_consensus.cc:2410] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
W20260709 13:03:32.000427  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.007448  1583 raft_consensus.cc:1275] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:31.997725  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:03:32.016587  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 140532us
I20260709 13:03:32.017278  1556 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:32.023015  1556 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:32.021064  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:32.001710  8288 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:32.026916  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:32.025653  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:32.025782  1663 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 18.
I20260709 13:03:32.042912  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:32.037314  1556 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:32.049290  1661 raft_consensus.cc:2393] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 18: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:32.025298  8352 raft_consensus.cc:3060] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:32.053203  1667 raft_consensus.cc:1240] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:32.052520  8353 raft_consensus.cc:2804] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:32.056564  8353 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.057071  8353 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:32.036597  8371 raft_consensus.cc:2804] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:32.058506  8371 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:32.059062  8371 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:32.065192  8349 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.065970  1659 raft_consensus.cc:1240] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:03:32.072906  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:32.065914  8349 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:32.078508  8241 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:32.040496  8295 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:32.089672  7935 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:32.090519  8295 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:32.091143  8449 log.cc:927] Time spent T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:03:32.093544  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:32.094249  1660 raft_consensus.cc:2468] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 11.
I20260709 13:03:32.095134  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:32.095674  1660 raft_consensus.cc:3060] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:03:32.096048  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:32.033716  8369 consensus_queue.cc:1059] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:03:32.101307  8323 consensus_queue.cc:1059] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 19.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:32.069847  1665 raft_consensus.cc:1240] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:03:32.069430  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:32.069631  8200 consensus_queue.cc:1048] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:32.109112  1664 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12.
I20260709 13:03:32.109177  1586 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 23.
I20260709 13:03:32.111701  1740 raft_consensus.cc:2468] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 17.
I20260709 13:03:32.113162  1659 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 25.
I20260709 13:03:32.114394  1663 raft_consensus.cc:2410] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:03:32.115367  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:32.116554  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:32.120069  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:32.120872  1663 raft_consensus.cc:2368] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 21. Current term is 22.
W20260709 13:03:32.121260  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 71200.9us
I20260709 13:03:32.122879  1556 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:32.102815  8323 raft_consensus.cc:3055] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:32.123476  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:32.123833  8323 raft_consensus.cc:740] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:32.124683  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:32.125298  8241 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:32.125799  8241 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.126247  8241 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:32.126631  1558 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:32.130213  8346 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:32.130606  8346 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.130954  8346 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:32.131891  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:32.124886  8323 consensus_queue.cc:260] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:32.140079  8323 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:32.141662  8288 raft_consensus.cc:3055] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:32.142103  8288 raft_consensus.cc:740] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:32.142995  8288 consensus_queue.cc:260] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:32.144726  8288 raft_consensus.cc:3060] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:32.135265  8349 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:32.146700  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:32.148099  1663 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:32.111690  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:32.150517  1665 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 21.
I20260709 13:03:32.151459  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:32.154405  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:32.155876  1661 raft_consensus.cc:1217] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Deduplicated request from leader. Original: 15.12->[16.13-16.13]   Dedup: 16.13->[]
I20260709 13:03:32.152874  1665 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
I20260709 13:03:32.156388  1661 raft_consensus.cc:1240] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:03:32.158305  1666 raft_consensus.cc:1275] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 12. (term mismatch)
I20260709 13:03:32.158653  1666 pending_rounds.cc:85] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 11
I20260709 13:03:32.158931  1666 pending_rounds.cc:107] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 13:03:32.159215  1666 raft_consensus.cc:2889] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:32.159555  1666 pending_rounds.cc:107] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 13:03:32.159809  1666 raft_consensus.cc:2889] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:32.161720  1662 raft_consensus.cc:2468] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 18.
I20260709 13:03:32.137810  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:32.167057  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:32.168433  1664 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 16.
I20260709 13:03:32.164261  1667 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16.
I20260709 13:03:32.170208  1556 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:32.174649  1659 raft_consensus.cc:1275] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:03:32.175140  1659 pending_rounds.cc:85] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 9
I20260709 13:03:32.175446  1659 pending_rounds.cc:107] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:03:32.175709  1659 raft_consensus.cc:2889] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:32.184285  8117 consensus_queue.cc:1048] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:03:32.191406  8241 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:32.198716  1556 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:32.195318  1661 raft_consensus.cc:1275] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:03:32.199370  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 70957.9us
I20260709 13:03:32.201926  1660 raft_consensus.cc:2468] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 13.
I20260709 13:03:32.203696  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:32.204178  1667 raft_consensus.cc:3060] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:03:32.177495  8349 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.194756  8312 raft_consensus.cc:2804] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:32.214388  8312 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.214609  7791 raft_consensus.cc:993] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:03:32.214988  8312 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:32.209018  8295 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.217496  8295 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:32.220400  8295 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:32.221825  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.222141  8323 raft_consensus.cc:2804] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:32.216835  8150 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.222663  8323 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.220501  2426 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:32.223747  8323 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:32.245918  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:32.250571  7935 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.223367  8150 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:32.251169  7935 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:32.254097  7935 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:32.254422  1661 raft_consensus.cc:1275] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:03:32.255494  1663 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 17.
I20260709 13:03:32.234788  8295 raft_consensus.cc:1081] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:03:32.264843  8150 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:32.270593  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:32.272722  8458 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.273335  8458 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:32.281204  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:32.282336  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:32.271605  1663 raft_consensus.cc:2376] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12. Re-sending same reply.
I20260709 13:03:32.284155  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:32.286128  1586 raft_consensus.cc:1275] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:32.286551  8289 raft_consensus.cc:2804] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:32.291450  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:32.290603  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:32.290254  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:32.292274  1558 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:32.293138  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:32.294224  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:32.294988  1587 raft_consensus.cc:2393] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 20: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:32.294996  1739 raft_consensus.cc:1275] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:32.298651  8353 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:32.224584  8349 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:32.300976  1659 raft_consensus.cc:1275] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:32.302031  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:32.302593  1659 raft_consensus.cc:2376] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 13. Re-sending same reply.
I20260709 13:03:32.303426  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:32.303992  1659 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 13.
I20260709 13:03:32.305363  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:32.307747  8289 raft_consensus.cc:697] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:32.308763  8289 consensus_queue.cc:237] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:32.309314  8323 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:32.309705  8371 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:32.310602  8295 raft_consensus.cc:2804] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:32.311168  8295 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:32.311579  8295 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:32.293638  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:32.292349  1583 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 21.
I20260709 13:03:32.314473  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:32.315107  1663 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 21.
I20260709 13:03:32.304913  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:32.317212  1667 raft_consensus.cc:2468] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 23.
I20260709 13:03:32.319957  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:03:32.322261  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.324090  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:32.324883  1660 raft_consensus.cc:2393] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 18: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:32.330304  1558 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:32.338364  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:32.280758  8458 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:32.346347  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:32.346719  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:32.347368  1734 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16.
I20260709 13:03:32.325634  1663 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39146
I20260709 13:03:32.349129  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:32.349489  1663 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:32.349733  1740 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:32.349968  1663 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:32.343866  8369 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:32.357336  1740 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 19.
I20260709 13:03:32.370692  8241 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:32.339695  8352 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:32.372948  8323 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:32.373421  7935 consensus_queue.cc:1048] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:32.375758  7935 consensus_queue.cc:1048] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:32.382212  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:03:32.383225  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.280911  8346 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:32.386623  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:32.394518  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:32.360993  1663 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:32.396641  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:32.399531  8150 consensus_queue.cc:1059] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:32.400487  8150 raft_consensus.cc:3055] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:32.401335  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:32.401654  8396 consensus_queue.cc:1048] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:32.402114  8349 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:32.402355  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:32.405594  8396 consensus_queue.cc:1059] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:32.406435  8346 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:32.407227  8371 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 21 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:32.407407  1705 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:32.401959  1734 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 18.
W20260709 13:03:32.411885  1633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:32.412329  1633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.400822  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:32.400820  8150 raft_consensus.cc:740] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:32.448362  1740 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
I20260709 13:03:32.451481  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:32.452359  1664 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:32.463711  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:32.464545  1739 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 16.
I20260709 13:03:32.464749  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:32.465737  1556 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:32.466248  1660 raft_consensus.cc:1240] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 17. Current term is 18. Ops: []
W20260709 13:03:32.466897  8455 log.cc:927] Time spent T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:03:32.467458  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:32.468180  1667 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:03:32.445477  8349 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.473608  8349 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:32.475945  8349 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:32.477394  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:32.478142  1666 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:32.480762  1585 raft_consensus.cc:606] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 21 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:32.482731  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:32.484318  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:32.485400  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:32.485961  1661 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:32.490926  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:32.491729  1659 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:32.494769  1663 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:32.490115  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 84627.3us
I20260709 13:03:32.507813  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:03:32.509459  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 43790.7us
I20260709 13:03:32.518088  1664 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
I20260709 13:03:32.520447  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:32.522388  1633 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:32.524334  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:32.525866  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:32.526695  1583 raft_consensus.cc:2468] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 12.
W20260709 13:03:32.549983  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 142637us
I20260709 13:03:32.550009  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:32.551714  1740 raft_consensus.cc:2410] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:03:32.554687  1705 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:32.555637  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:32.557279  1556 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:32.567952  1558 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:32.551440  8396 raft_consensus.cc:3055] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:32.537333  8371 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:32.579072  1556 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:32.581624  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:32.584556  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:32.590626  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:32.591612  1663 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
I20260709 13:03:32.595647  1583 raft_consensus.cc:2393] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 17: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
W20260709 13:03:32.595747  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 73480.3us
I20260709 13:03:32.554919  8352 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.601711  1558 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:32.557623  8403 raft_consensus.cc:2749] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:32.605362  1633 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:32.561513  8468 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:32.621668  1558 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:32.580099  8371 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.623492  1556 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:32.576689  8396 raft_consensus.cc:740] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:32.629479  1662 raft_consensus.cc:1275] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:03:32.599936  8288 raft_consensus.cc:2804] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:32.561779  8150 consensus_queue.cc:260] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:32.563073  8241 consensus_queue.cc:1059] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:03:32.639124  1633 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:32.609592  8356 raft_consensus.cc:2804] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:32.644968  1633 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:32.616469  8117 raft_consensus.cc:2749] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:32.649436  1633 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:32.650148  8469 consensus_queue.cc:1048] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.137s
I20260709 13:03:32.650988  1633 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:32.628450  8371 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:32.604987  8352 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:32.632299  8288 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.661306  8288 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:32.662429  8352 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:32.633481  8457 raft_consensus.cc:2749] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:32.665506  8312 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:32.667359  7791 raft_consensus.cc:3055] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:32.667865  7791 raft_consensus.cc:740] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:32.659636  8150 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:32.668467  8403 raft_consensus.cc:2804] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:32.660014  8205 raft_consensus.cc:2804] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:32.647620  8242 raft_consensus.cc:2804] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:32.667891  8312 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:32.640024  8167 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.670153  1587 raft_consensus.cc:2393] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 19: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
W20260709 13:03:32.659353  8466 log.cc:927] Time spent T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:03:32.647089  8200 raft_consensus.cc:2804] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:32.647253  8349 raft_consensus.cc:2749] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:32.682456  8200 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.682955  8200 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:32.685591  1659 raft_consensus.cc:2410] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
W20260709 13:03:32.691445  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 138010us
W20260709 13:03:32.692694  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:32.693249  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 138664us
I20260709 13:03:32.692824  7791 consensus_queue.cc:260] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:32.694546  1705 leader_election.cc:400] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Vote denied by peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683) with higher term. Message: Invalid argument: T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 21. Current term is 22.
I20260709 13:03:32.695127  1705 leader_election.cc:403] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:32.669332  8161 consensus_queue.cc:1048] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:03:32.671608  8469 raft_consensus.cc:2749] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:32.656040  8356 raft_consensus.cc:697] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:32.684593  8381 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:03:32.710376  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 69191.6us
I20260709 13:03:32.685168  8403 raft_consensus.cc:697] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 12 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:32.684921  8242 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:32.689774  8190 raft_consensus.cc:2764] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:03:32.712231  8381 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.702032  8205 raft_consensus.cc:697] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 22 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:32.720340  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:32.721504  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:32.702965  7791 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:32.691190  8167 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:32.722389  1659 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 25.
I20260709 13:03:32.704264  8472 raft_consensus.cc:2749] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683) with higher term. Message: Invalid argument: T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 21. Current term is 22.
I20260709 13:03:32.699486  8295 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:32.723546  1707 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:32.717906  8381 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:03:32.737169  8474 log.cc:927] Time spent T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:03:32.737249  8478 raft_consensus.cc:2804] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:32.740998  1666 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
I20260709 13:03:32.716349  8242 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:32.761300  1586 raft_consensus.cc:1240] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 12. Current term is 13. Ops: []
W20260709 13:03:32.764254  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 46471.5us
I20260709 13:03:32.766572  1705 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:32.737766  8478 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.723578  8458 consensus_queue.cc:1048] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
W20260709 13:03:32.776265  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 154695us
I20260709 13:03:32.777247  1558 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:32.772009  8478 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:32.780802  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 129873us
I20260709 13:03:32.779115  1707 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:32.736254  8471 consensus_queue.cc:1059] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.122s
I20260709 13:03:32.728119  8396 consensus_queue.cc:260] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:32.785946  1558 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:32.787490  1707 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:32.774406  8469 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:32.785295  1705 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:32.786247  8470 consensus_queue.cc:1048] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:03:32.795708  8470 raft_consensus.cc:2804] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:32.796128  8470 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.796444  8470 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:32.797909  8295 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:32.800019  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:32.801497  8167 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:32.803093  8484 raft_consensus.cc:2749] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:32.788447  8205 consensus_queue.cc:237] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:32.791286  8312 raft_consensus.cc:2749] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:32.790294  8477 raft_consensus.cc:2804] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:32.812173  8477 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:32.812361  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:32.812577  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:32.812638  8477 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:32.813192  1734 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:03:32.813753  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:32.814046  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:32.814320  1739 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:32.816502  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:32.817106  1740 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:03:32.819146  8465 raft_consensus.cc:3055] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:32.819574  8465 raft_consensus.cc:740] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:32.781893  8403 consensus_queue.cc:237] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:32.786139  8483 raft_consensus.cc:2804] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:32.829726  8483 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.829780  8353 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:32.830219  8483 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:32.844638  1556 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:32.845726  1556 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:32.846836  7791 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:03:32.847148  8346 raft_consensus.cc:2804] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:32.848028  8346 raft_consensus.cc:697] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:32.848927  8346 consensus_queue.cc:237] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:32.851961  8312 raft_consensus.cc:993] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:03:32.852500  8312 raft_consensus.cc:1081] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 21 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:03:32.847221  7791 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.854136  7791 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:03:32.860463  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:32.872814  1661 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 19.
I20260709 13:03:32.872601  1740 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 19.
I20260709 13:03:32.800814  8288 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:32.894879  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.895264  1558 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:32.896013  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:32.896369  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:32.897588  1660 raft_consensus.cc:1275] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:03:32.896947  1741 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 25.
I20260709 13:03:32.903339  8288 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:32.905351  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:32.906051  1734 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:32.913698  8481 log.cc:927] Time spent T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:03:32.914115  8242 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:32.916257  8242 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 21 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:32.785072  8356 consensus_queue.cc:237] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:32.917263  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.917771  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:32.927114  1661 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 13.
I20260709 13:03:32.917274  1587 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3d6305e583540c895021f5a180689f7"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:03:32.918951  8323 raft_consensus.cc:2749] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:32.919586  1558 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:32.793498  1633 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:32.925355  1665 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39146
I20260709 13:03:32.928845  1665 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:32.929214  1665 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:32.820590  8465 consensus_queue.cc:260] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:32.932461  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 151670us
I20260709 13:03:32.933811  1558 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:32.935880  1739 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 19.
I20260709 13:03:32.936151  1587 raft_consensus.cc:606] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:32.942757  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:32.937670  8353 raft_consensus.cc:2749] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:32.940009  2424 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:03:32.945194  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 157770us
I20260709 13:03:32.919853  8200 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:32.949065  1707 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:32.876289  8371 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:32.953040  1734 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 19.
I20260709 13:03:32.953310  1558 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:32.938006  8288 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:32.957214  8479 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:32.957785  8475 raft_consensus.cc:2804] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:03:33.001503  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 78412.7us
I20260709 13:03:32.967089  8200 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:32.968209  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 174785us
I20260709 13:03:32.957280  1736 raft_consensus.cc:1275] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:03:32.969544  8478 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:32.964291  8381 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:32.972349  8447 consensus_queue.cc:1048] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:03:32.953820  7935 consensus_queue.cc:1048] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:03:33.007952  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:03:33.005736  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 56760.3us
I20260709 13:03:33.008637  1666 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:33.010224  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 57001.8us
I20260709 13:03:33.008872  1707 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:33.011834  1558 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:32.994095  1665 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:33.003194  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:33.013863  1661 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:32.964840  7791 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:33.020787  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:33.004678  8475 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.029713  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:33.030517  1734 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:33.009486  8471 consensus_queue.cc:1048] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:03:33.007208  8288 raft_consensus.cc:697] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:33.009600  8472 raft_consensus.cc:2804] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:03:33.013350  8447 consensus_queue.cc:1243] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Peer 5bb87fe07da2414e84ee578c3b176ede log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:03:33.058053  1663 raft_consensus.cc:1240] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 21. Current term is 22. Ops: []
I20260709 13:03:33.032409  1738 raft_consensus.cc:2393] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 17: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
W20260709 13:03:33.035949  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.018626  8323 raft_consensus.cc:2804] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:33.003968  8150 consensus_queue.cc:1048] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:03:33.040917  1661 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:03:33.030493  1665 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 22 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:33.045938  1585 raft_consensus.cc:1240] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:33.046522  8487 raft_consensus.cc:2764] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:03:33.046813  1588 raft_consensus.cc:1240] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 21. Current term is 22. Ops: [21.12-21.12]
W20260709 13:03:33.046952  8491 log.cc:927] Time spent T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:03:33.047739  8483 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:33.048540  1633 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:33.049010  1590 raft_consensus.cc:1240] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:33.053464   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:33.028931  8469 raft_consensus.cc:2804] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:33.026096  8475 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:33.063140  1734 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:03:33.041321  8486 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:33.008072  8477 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:33.078020  1666 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 18.
I20260709 13:03:33.032469  8484 consensus_queue.cc:1048] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:03:33.036579  8312 consensus_queue.cc:1048] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:03:33.034806  8468 consensus_queue.cc:1048] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:03:33.109419  8288 consensus_queue.cc:237] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:33.091315  8369 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:33.110700  8369 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:33.086813  8381 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 22 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:33.087001  8478 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:33.015357  8479 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:33.084619  1558 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:03:33.096238  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 47791.6us
I20260709 13:03:33.104058  7791 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 26 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:33.105275  8396 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:33.078871  8323 raft_consensus.cc:697] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:33.085548  8472 raft_consensus.cc:697] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 23 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:33.078620  8469 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.084069  8190 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:33.107777   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:33.122916  8477 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:33.124389  8483 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:33.125447  8458 raft_consensus.cc:2804] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:33.151731  8458 raft_consensus.cc:697] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:33.151933  1666 pending_rounds.cc:85] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 12
I20260709 13:03:33.152405  1666 pending_rounds.cc:107] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:03:33.152102  8323 consensus_queue.cc:237] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:33.152725  8458 consensus_queue.cc:237] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:33.130781  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:33.156141  1732 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:33.156433  1633 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:33.147773  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:33.157532  1736 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 19.
I20260709 13:03:33.152704  1666 raft_consensus.cc:2889] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:33.118496  8369 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:33.164887  1558 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:03:33.162472  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 70756.2us
I20260709 13:03:33.115079  8486 raft_consensus.cc:697] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:33.148034  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:33.171695  1734 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:03:33.157665  1633 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:33.164884  1732 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 17.
I20260709 13:03:33.168934  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:33.175159  1665 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:03:33.176919  1558 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:33.145598  8469 raft_consensus.cc:3060] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:33.180560  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:33.189755  1659 raft_consensus.cc:2393] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 19: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:33.097395  8457 consensus_queue.cc:1059] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.070s
I20260709 13:03:33.183558  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:03:33.184995  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.183558  1556 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:33.146970  8352 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:33.198738  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:33.199489  1659 raft_consensus.cc:2393] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 22: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:33.165596  8487 raft_consensus.cc:2749] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:33.176447  8356 raft_consensus.cc:2804] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:03:33.204236  1704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.206128  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:33.200826  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:33.207193  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:33.181188  8205 raft_consensus.cc:2749] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:33.216086  1583 raft_consensus.cc:2393] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 13: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
W20260709 13:03:33.222898  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 65291.6us
I20260709 13:03:33.224115  1633 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:33.193809  8483 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:33.200906  8295 raft_consensus.cc:2804] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:33.212018  8349 raft_consensus.cc:2804] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:33.212303  8371 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 22 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:33.216861  8356 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:33.242169  1734 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 26.
I20260709 13:03:33.235293  8487 raft_consensus.cc:2804] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:33.215951  8352 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:33.257397  1633 leader_election.cc:400] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 22 pre-election: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 22. Current term is 23.
I20260709 13:03:33.259004  1633 leader_election.cc:403] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:33.202776  8470 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:33.238932  8496 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:33.233656  8478 consensus_queue.cc:1059] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:03:33.252040  8349 raft_consensus.cc:697] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 18 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:33.278208  1583 raft_consensus.cc:1240] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:33.238564  8295 raft_consensus.cc:697] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:33.248554  8356 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:33.277163  1665 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 26.
I20260709 13:03:33.235922  8484 consensus_queue.cc:1059] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:03:33.239118  8483 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:33.256436  8487 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:33.286029  1633 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:33.281749  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 70758.3us
I20260709 13:03:33.230366  8472 consensus_queue.cc:237] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:33.314983  8493 log.cc:927] Time spent T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.194s	user 0.003s	sys 0.000s
I20260709 13:03:33.293342  8487 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:33.318428  8352 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:03:33.325768  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.327100  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:33.294941  1633 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:33.296614  8349 consensus_queue.cc:237] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:33.302628  8312 raft_consensus.cc:3055] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:03:33.306514  8479 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:33.307427  8484 raft_consensus.cc:3055] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:33.349195  8484 raft_consensus.cc:740] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:33.283828  8205 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 22. Current term is 23.
I20260709 13:03:33.311741  8200 raft_consensus.cc:993] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:03:33.352711  8200 raft_consensus.cc:1081] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
W20260709 13:03:33.339053  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 44514.2us
I20260709 13:03:33.336192  1558 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
W20260709 13:03:33.340359  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 126886us
I20260709 13:03:33.342285  8325 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:33.342993  8465 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:33.329917  7935 consensus_queue.cc:1059] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.014s
I20260709 13:03:33.294937  8190 raft_consensus.cc:2749] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:33.282635  8496 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:33.345757  8295 consensus_queue.cc:237] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:33.256609  8486 consensus_queue.cc:237] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:33.340417  8312 raft_consensus.cc:740] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:33.350111  8484 consensus_queue.cc:260] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:33.373270  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:33.367548  1734 raft_consensus.cc:1275] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:03:33.357372  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:33.417505  1633 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:33.417898  1736 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 12.
W20260709 13:03:33.415838  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 79717.9us
I20260709 13:03:33.355232  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:33.421144  1633 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:33.370620  1705 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:41683 timed out after 1.547s (SENT) [suppressed 16 similar messages]
I20260709 13:03:33.428047  1556 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:33.431849  1633 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:33.371721  8150 raft_consensus.cc:3055] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:03:33.456102  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:33.464697  1662 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3d6305e583540c895021f5a180689f7"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39146
I20260709 13:03:33.354348  8483 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:33.463419  1633 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:33.465291  1662 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:33.374300  8470 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:33.470525  1662 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:33.472273  8190 raft_consensus.cc:2749] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:33.422175  8457 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:03:33.478349  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:33.480628  1633 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:33.449945  8403 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:33.481524  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:33.450507  8352 raft_consensus.cc:2749] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:03:33.488960  1589 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:33.455364  8381 raft_consensus.cc:2749] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:33.411659  8487 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:33.484730  8484 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:33.353037  8469 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:33.498922  8469 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:33.500226  8431 raft_consensus.cc:2749] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:33.501034  8425 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.501617  8425 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:33.502725  1586 raft_consensus.cc:1240] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 18 LEADER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 17. Current term is 18. Ops: [15.12-17.13]
I20260709 13:03:33.503831  8425 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:33.431013  8205 consensus_queue.cc:1048] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:03:33.464097  8150 raft_consensus.cc:740] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:33.483253  8325 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:33.484380  8458 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:33.518174  8150 consensus_queue.cc:260] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:33.432503  8475 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:33.524545  1662 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:33.530646  8150 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:33.534104  1556 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:33.543416  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:33.537400  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:33.544025  1585 raft_consensus.cc:3060] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:33.544634  1663 raft_consensus.cc:2468] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 11.
I20260709 13:03:33.538378  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:33.540252  1590 raft_consensus.cc:1240] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:03:33.508773  8457 raft_consensus.cc:697] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 26 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:33.549477  1736 raft_consensus.cc:2468] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 12.
I20260709 13:03:33.552958  1662 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:33.545214  8241 raft_consensus.cc:2749] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:33.520108  8458 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:33.566882  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 196298us
W20260709 13:03:33.572316  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.586012  8457 consensus_queue.cc:237] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:33.590462  8312 consensus_queue.cc:260] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:33.591745  8312 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:33.594621  8458 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:33.596277  8356 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:33.598322  8356 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:33.615877  1585 raft_consensus.cc:2468] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 13.
I20260709 13:03:33.620182  1705 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:33.630808  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.632483  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:33.640919  8479 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:33.667853  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 97450.7us
I20260709 13:03:33.668838  1705 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:33.679171  8475 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:33.681955  8487 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:33.685491  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:33.686136  1662 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:33.687685  1732 raft_consensus.cc:1240] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:33.689708  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:33.691347  1741 raft_consensus.cc:1275] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:03:33.691736  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:33.689343  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:33.692847  1738 raft_consensus.cc:3060] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:33.693898  8496 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:33.689249  8499 raft_consensus.cc:2764] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
W20260709 13:03:33.695489  8513 log.cc:927] Time spent T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:03:33.698063  8124 consensus_queue.cc:1048] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:33.704632  1738 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 22.
I20260709 13:03:33.705582  8396 raft_consensus.cc:3055] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:33.736932  8396 raft_consensus.cc:740] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:33.737864  8396 consensus_queue.cc:260] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:33.738849  8396 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:33.706648  1661 raft_consensus.cc:1275] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:33.743633  1558 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:33.743813  1589 raft_consensus.cc:2468] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 16.
I20260709 13:03:33.741807  1707 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:33.710834  1733 raft_consensus.cc:2410] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 22 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:03:33.746013  1558 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:33.710865  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:33.710891  8487 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
W20260709 13:03:33.717247  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 48449.8us
W20260709 13:03:33.722209  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.727032  8325 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:33.753369  8325 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:33.753631  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:33.754949  1587 raft_consensus.cc:2393] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 21: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:33.727532  8381 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:33.755407  1583 raft_consensus.cc:1240] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:03:33.755710  8381 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:33.730698  8349 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.772033  8349 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:33.773988  8381 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:33.774405  8349 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:33.730981  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:33.755434  8325 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:33.775207  1666 raft_consensus.cc:2376] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 23. Re-sending same reply.
I20260709 13:03:33.776172  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:33.731699  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:33.732550  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:33.778275  1665 raft_consensus.cc:2393] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 18: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:33.733215  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:33.733860  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:33.733951  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:33.735611  1659 raft_consensus.cc:1275] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:33.744377  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:33.707552  8403 raft_consensus.cc:2749] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:33.747226  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:33.747148  1734 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:33.781447  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:33.748802  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:33.750021  1662 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 14.
I20260709 13:03:33.781471  1660 raft_consensus.cc:2368] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 21. Current term is 22.
I20260709 13:03:33.782176  1667 raft_consensus.cc:2376] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 18. Re-sending same reply.
I20260709 13:03:33.748248  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:33.752568  8487 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:33.728210  8242 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.797962  8242 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:33.763059  8465 consensus_queue.cc:1059] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:03:33.803452  1667 raft_consensus.cc:1240] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:03:33.756523  8507 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:33.757797  8486 raft_consensus.cc:2804] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:33.757995  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:33.807926  8486 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.808547  8486 raft_consensus.cc:3060] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:33.809567  1736 raft_consensus.cc:1275] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:03:33.811111  1736 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:03:33.759259  1732 raft_consensus.cc:1275] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:33.759351  1740 raft_consensus.cc:1275] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:03:33.759496  1739 raft_consensus.cc:1240] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 21. Current term is 22. Ops: []
I20260709 13:03:33.760143  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:33.814055  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:33.815080  1664 raft_consensus.cc:2368] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 17. Current term is 18.
I20260709 13:03:33.763927  1705 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:33.766913  1585 raft_consensus.cc:1240] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:33.767613  1586 raft_consensus.cc:1275] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:03:33.819044  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:33.820062  1665 raft_consensus.cc:2393] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 17: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:33.768407  1707 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:33.769528  8499 raft_consensus.cc:2804] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:03:33.834059  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 65787.3us
I20260709 13:03:33.784541  1662 raft_consensus.cc:1240] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:03:33.835561  1588 raft_consensus.cc:2468] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 22.
I20260709 13:03:33.784528  1589 raft_consensus.cc:2393] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 22: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:33.786896  1663 raft_consensus.cc:2393] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 19: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:33.787174  1658 raft_consensus.cc:2368] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 25. Current term is 26.
I20260709 13:03:33.784912  2424 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:33.787509  1660 raft_consensus.cc:1240] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:33.797209  1592 raft_consensus.cc:1240] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:33.826946  1741 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 19.
I20260709 13:03:33.831319  1583 raft_consensus.cc:1275] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
W20260709 13:03:33.832640  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 47307.4us
I20260709 13:03:33.817972  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:03:33.838506  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 53686.1us
I20260709 13:03:33.770711  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:33.844025  1734 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 18.
I20260709 13:03:33.847395  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:33.848153  1737 raft_consensus.cc:1275] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:03:33.800812  8242 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:33.850041  1741 raft_consensus.cc:2410] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 23 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:03:33.828320  8465 consensus_queue.cc:1243] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer 6d4de2ce0683442498244b9529127f91 log is divergent from this leader: its last log entry 18.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:03:33.854485  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:33.858570  1741 raft_consensus.cc:1240] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:33.850960  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:33.855963  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:33.859781  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:33.860467  1732 raft_consensus.cc:2368] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 16. Current term is 17.
I20260709 13:03:33.860637  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:33.861874  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:33.860757  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:33.863799  1741 raft_consensus.cc:2368] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 18. Current term is 19.
I20260709 13:03:33.864930  1740 raft_consensus.cc:2393] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 20: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:33.858224  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:33.876187  1737 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:33.876142  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 112324us
I20260709 13:03:33.848484  8287 raft_consensus.cc:2804] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:33.849453  8150 raft_consensus.cc:2749] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:33.851163  8477 raft_consensus.cc:2804] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:33.865542  1633 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:33.851028  8484 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.891607  1660 raft_consensus.cc:1275] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:03:33.890638  1633 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:33.894703  1658 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:03:33.900315  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:33.898002  1558 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:33.907903  1665 raft_consensus.cc:1275] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:03:33.862973  8499 raft_consensus.cc:697] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 13 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:33.924284  1633 leader_election.cc:400] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 election: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 16. Current term is 17.
I20260709 13:03:33.865120  8242 consensus_queue.cc:1059] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:03:33.930058  1633 leader_election.cc:403] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:03:33.901407  8205 raft_consensus.cc:2804] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:33.878018  8381 consensus_queue.cc:1059] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:03:33.878275  8325 consensus_queue.cc:1048] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:03:33.911842  8465 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:33.925590  8403 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:33.907763  8287 raft_consensus.cc:697] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:33.907135  8353 raft_consensus.cc:2749] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:33.937258  1558 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:33.942037  1590 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 18.
I20260709 13:03:33.925864  8323 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.946043  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:33.901345  8458 consensus_queue.cc:1048] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:03:33.949542  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:33.901687  8295 consensus_queue.cc:1048] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:03:33.906001  7935 consensus_queue.cc:1048] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:03:33.958280  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:33.961233  1659 raft_consensus.cc:1240] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:33.954490  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:33.956382  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:33.957288  8356 consensus_queue.cc:1048] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:03:33.935499  8477 raft_consensus.cc:697] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 16 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:33.919317  8346 consensus_queue.cc:1048] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:03:33.925468  8425 consensus_queue.cc:1048] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:03:33.906447  8484 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:33.962260  1587 raft_consensus.cc:3055] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:03:33.967760  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 84632.6us
I20260709 13:03:33.968849  1665 raft_consensus.cc:1275] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:03:33.953266  8369 raft_consensus.cc:2804] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:03:33.979288  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 69908.1us
I20260709 13:03:33.981709  1705 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:33.981803  1633 leader_election.cc:400] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 18. Current term is 19.
I20260709 13:03:33.983505  1633 leader_election.cc:403] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:03:33.973380  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 138383us
I20260709 13:03:33.981614  1587 raft_consensus.cc:740] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:33.992403  1705 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:33.972806  8403 raft_consensus.cc:697] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 18 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:33.962803  8190 consensus_queue.cc:1059] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:03:33.956519  8323 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:33.951491  8465 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:34.033299  1736 raft_consensus.cc:1275] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:33.972983  8352 consensus_queue.cc:1048] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:03:34.012320  8150 consensus_queue.cc:1048] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 13:03:34.005422  8287 consensus_queue.cc:237] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:34.009850  1587 consensus_queue.cc:260] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:33.991402  8369 raft_consensus.cc:697] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
W20260709 13:03:34.061956  8522 log.cc:927] Time spent T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:03:34.062400  8521 log.cc:927] Time spent T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:03:34.098557  1737 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 20.
W20260709 13:03:34.062474  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 75936.3us
I20260709 13:03:34.101727  1705 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:34.102883  7935 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:34.103493  1705 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:34.010341  8205 raft_consensus.cc:697] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 22 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:34.012111  8469 raft_consensus.cc:2749] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:34.104876  8205 consensus_queue.cc:237] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:34.105685  8469 raft_consensus.cc:2749] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:34.062933  8477 consensus_queue.cc:237] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:34.107401  1658 raft_consensus.cc:1275] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:03:34.108067  8527 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 18. Current term is 19.
W20260709 13:03:34.109812  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 128163us
I20260709 13:03:34.067898  8514 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:33.994360  8499 consensus_queue.cc:237] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:34.069752  8484 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:03:34.069782  8520 log.cc:927] Time spent T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:03:34.070649  8403 consensus_queue.cc:237] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:34.073305  8496 raft_consensus.cc:3055] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:34.072764  8486 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:34.077013  1590 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 20.
I20260709 13:03:34.060070  8472 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:34.090318  8431 raft_consensus.cc:3055] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:34.095144  1587 raft_consensus.cc:3060] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:33.991456  8468 raft_consensus.cc:2804] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:34.101553  8369 consensus_queue.cc:237] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:34.068593  8487 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:34.111523  1633 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:34.112655  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:34.117997  1705 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:34.125895  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 166243us
I20260709 13:03:34.127519  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:34.115432  8496 raft_consensus.cc:740] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:34.128170  1736 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 19.
W20260709 13:03:34.129212  1707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.131920  8486 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:34.121857  8472 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:34.119285  8431 raft_consensus.cc:740] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:34.119465  8468 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:34.133767  8496 consensus_queue.cc:260] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:34.127616  8484 raft_consensus.cc:2749] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:34.128898  1633 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:34.150091  8529 raft_consensus.cc:2804] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:34.150295  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:34.152697  8371 consensus_queue.cc:1048] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:34.140956  8468 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:34.188315  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 61378.9us
I20260709 13:03:34.189667  1556 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:34.191046  8538 raft_consensus.cc:2749] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:34.191987  8530 consensus_queue.cc:1059] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:34.192468  1633 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:34.187208  8190 raft_consensus.cc:2749] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:34.184026  8529 raft_consensus.cc:697] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 20 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
W20260709 13:03:34.214339  1706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.219259  1664 raft_consensus.cc:1275] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 13:03:34.219686  1664 pending_rounds.cc:85] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 9
I20260709 13:03:34.219870  1664 pending_rounds.cc:107] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:03:34.219712  1705 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:34.220083  1664 raft_consensus.cc:2889] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:34.220882  1705 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:34.208004  8150 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:34.222627  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:34.224979  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:34.226562  1666 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 19.
I20260709 13:03:34.229803  1633 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:34.232889  1705 leader_election.cc:400] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 election: Vote denied by peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683) with higher term. Message: Invalid argument: T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 21. Current term is 22.
I20260709 13:03:34.237407  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:34.240419  1665 raft_consensus.cc:3060] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:03:34.241552  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:34.242473  1592 raft_consensus.cc:2393] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 19: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:34.246932  8531 raft_consensus.cc:2749] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:34.249467  8529 consensus_queue.cc:237] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:34.222640  8484 raft_consensus.cc:2749] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:34.221692  8465 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:34.209452  8487 consensus_queue.cc:1048] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:03:34.233403  8530 raft_consensus.cc:2749] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:03:34.217701  8486 consensus_queue.cc:1048] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:03:34.217286  8346 consensus_queue.cc:1048] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:03:34.287240  1587 raft_consensus.cc:2468] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 20.
I20260709 13:03:34.222175  8205 consensus_queue.cc:1059] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:03:34.292484  1665 raft_consensus.cc:2468] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:03:34.268169  1705 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:34.269776  8539 log.cc:927] Time spent T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:03:34.270812  8458 consensus_queue.cc:1048] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:03:34.274999  8472 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:34.209681  8538 consensus_queue.cc:1048] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:03:34.231670  8150 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:34.260196  1556 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:34.278420  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:34.304544  1588 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 20.
I20260709 13:03:34.236770  8431 consensus_queue.cc:260] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:34.293355  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:34.302066  1741 raft_consensus.cc:1275] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:03:34.305828  1733 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 20.
W20260709 13:03:34.310355  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 50248.6us
I20260709 13:03:34.299846  8403 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:34.313614  8403 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:34.316452  8496 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:34.307327  1707 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:34.294150  8190 raft_consensus.cc:2749] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:34.327600  8346 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:34.328548  8346 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:34.329110  8346 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:34.332513  8150 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:34.333310  8488 raft_consensus.cc:2749] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:34.323580  1707 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:34.338850  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:34.339421  1588 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 18.
I20260709 13:03:34.341472  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:34.342285  1738 raft_consensus.cc:3060] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:34.342222  1707 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:34.300650  8465 raft_consensus.cc:2749] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:34.257783   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:34.345175  1556 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:34.348690  8457 raft_consensus.cc:2804] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:34.352123  8457 raft_consensus.cc:697] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:34.352811  1665 raft_consensus.cc:1275] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 26 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:03:34.353358  8242 raft_consensus.cc:3055] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:34.352998  8457 consensus_queue.cc:237] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:34.353730  8242 raft_consensus.cc:740] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:34.348819  8150 raft_consensus.cc:2804] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:34.358333  8150 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:34.358722  8150 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:34.362710  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 94630.7us
I20260709 13:03:34.363188  8526 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:34.363598  1705 leader_election.cc:400] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 election: Vote denied by peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683) with higher term. Message: Invalid argument: T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 17. Current term is 18.
I20260709 13:03:34.364499  1705 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:34.365213  8488 raft_consensus.cc:2749] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:34.363623  8526 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:34.369657  8526 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:34.371079  8381 raft_consensus.cc:3055] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:34.371495  8381 raft_consensus.cc:740] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:34.372361  8381 consensus_queue.cc:260] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:34.378656  1705 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:34.376739  8403 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:34.389727  1738 raft_consensus.cc:2468] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:03:34.402973  8469 raft_consensus.cc:2749] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:34.419574  8381 raft_consensus.cc:3060] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:34.354547  8242 consensus_queue.cc:260] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:34.413322  8483 consensus_queue.cc:1048] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.015s
W20260709 13:03:34.434010  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 55414.2us
I20260709 13:03:34.446197  8150 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:34.447899  1739 raft_consensus.cc:1240] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 16 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:03:34.435730  8514 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843) with higher term. Message: Invalid argument: T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for earlier term 16. Current term is 17.
I20260709 13:03:34.478438  1705 leader_election.cc:400] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 25 election: Vote denied by peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683) with higher term. Message: Invalid argument: T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 25. Current term is 26.
I20260709 13:03:34.478871  1705 leader_election.cc:403] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
I20260709 13:03:34.480792  1659 raft_consensus.cc:1275] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:34.487978  8469 raft_consensus.cc:2749] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683) with higher term. Message: Invalid argument: T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 25. Current term is 26.
I20260709 13:03:34.492132  1705 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:34.448462  8507 consensus_queue.cc:1048] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
W20260709 13:03:34.494530  8534 log.cc:927] Time spent T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:03:34.496296  7935 raft_consensus.cc:2749] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:34.497803  8468 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:34.500152  8468 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:03:34.507376  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 48595.4us
I20260709 13:03:34.508852  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:03:34.511965  1733 raft_consensus.cc:1275] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 26 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
W20260709 13:03:34.484326  8536 log.cc:927] Time spent T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:03:34.515455  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:34.516134  1735 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:34.515580  1633 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:34.521303  1732 raft_consensus.cc:1275] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:34.521407  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:34.523672  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:34.524269  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:34.524791  1663 raft_consensus.cc:2368] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 16. Current term is 17.
I20260709 13:03:34.525413  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
W20260709 13:03:34.525858  1705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.525907  1663 raft_consensus.cc:2376] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 23. Re-sending same reply.
I20260709 13:03:34.527019  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:34.527391  1592 raft_consensus.cc:1275] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:03:34.527747  1663 raft_consensus.cc:2368] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 13. Current term is 14.
I20260709 13:03:34.529206  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:34.529377  1705 leader_election.cc:400] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Vote denied by peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683) with higher term. Message: Invalid argument: T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 16. Current term is 17.
I20260709 13:03:34.530714  1705 leader_election.cc:403] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:34.534368  8483 consensus_queue.cc:1048] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:34.535720  8526 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:34.538007  8526 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:34.542965  1705 leader_election.cc:400] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: Vote denied by peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683) with higher term. Message: Invalid argument: T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 13. Current term is 14.
I20260709 13:03:34.543052  1663 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 17.
I20260709 13:03:34.543422  1705 leader_election.cc:403] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:03:34.544181  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:34.544643  1633 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:34.548049  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:34.547519  7935 raft_consensus.cc:2749] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683) with higher term. Message: Invalid argument: T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 16. Current term is 17.
W20260709 13:03:34.574715  1630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.583442  8323 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:34.589458  8533 consensus_queue.cc:1048] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.067s
W20260709 13:03:34.592463  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.547359  8527 raft_consensus.cc:2749] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:34.617532  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 74694.3us
I20260709 13:03:34.642138  1661 raft_consensus.cc:1275] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:03:34.557461  8543 raft_consensus.cc:2804] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:34.569802  1667 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 20.
I20260709 13:03:34.654435  1735 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 14.
I20260709 13:03:34.654706  1705 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:34.655615  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:34.656195  1583 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:03:34.646564  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 98417.7us
I20260709 13:03:34.662930  1736 raft_consensus.cc:1275] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 13:03:34.663442  1736 pending_rounds.cc:85] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d: Aborting all ops after (but not including) 11
I20260709 13:03:34.663746  1736 pending_rounds.cc:107] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:03:34.664060  1736 raft_consensus.cc:2889] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:34.664463  1736 pending_rounds.cc:107] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:03:34.664770  1736 raft_consensus.cc:2889] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:34.653756  8545 log.cc:927] Time spent T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.229s	user 0.000s	sys 0.007s
I20260709 13:03:34.672077  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:34.676118  1592 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:34.660851  8556 log.cc:927] Time spent T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.114s	user 0.000s	sys 0.007s
I20260709 13:03:34.657562  8477 raft_consensus.cc:2749] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683) with higher term. Message: Invalid argument: T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 13. Current term is 14.
I20260709 13:03:34.682030  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:34.688405  1661 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:34.653810  8543 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:34.660621  8526 consensus_queue.cc:1048] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:03:34.661298  8346 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:34.682713  8150 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:34.698009  8543 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:34.751904  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 66524.7us
I20260709 13:03:34.759179  1661 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 21.
W20260709 13:03:34.785455  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 130829us
I20260709 13:03:34.789301  1662 raft_consensus.cc:1275] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:03:34.789688  1662 pending_rounds.cc:85] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 8
I20260709 13:03:34.789887  1662 pending_rounds.cc:107] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:03:34.790143  1662 raft_consensus.cc:2889] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:34.789305  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:34.791896  1660 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:03:34.794131  8566 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:34.794476  1633 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:34.794741  8566 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:34.797379  8546 log.cc:927] Time spent T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.246s	user 0.002s	sys 0.007s
I20260709 13:03:34.797271  8325 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:34.834517  8325 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:34.835074  8325 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:34.844667  1583 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 21.
I20260709 13:03:34.848905  1592 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 19.
I20260709 13:03:34.857810  1666 raft_consensus.cc:1275] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:03:34.858914  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:34.859638  1662 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 21.
I20260709 13:03:34.861471  1739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43686 (request call id 2913) took 1002 ms. Trace:
I20260709 13:03:34.861862  1739 rpcz_store.cc:276] 0709 13:03:33.858560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.859010 (+   450us) service_pool.cc:224] Handling call
0709 13:03:33.859312 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:34.448384 (+589072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:34.861232 (+412848us) spinlock_profiling.cc:243] Waited 588 ms on lock 0x7b54000ff0d4. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8fe01 00007f1b80f8e83e 00007f1b85f53419 00007f1b7f4cabd4 00007f1b7f4cab62 00007f1b7f4caa91 00007f1b7f4caa0c 00007f1b7f4c9cc2 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:03:34.861415 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1353079168}
I20260709 13:03:34.797047  8566 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:34.873322  1660 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 19.
I20260709 13:03:34.879390  8446 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:34.880129  8446 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:34.882459  8543 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:34.883116  8446 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:34.888846  1662 raft_consensus.cc:1275] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:03:34.887921  8431 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:34.982663  8568 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:34.983402  8568 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:34.992216  8543 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:34.979051  8325 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:35.000576  8325 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:35.006583  8312 consensus_queue.cc:1048] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:35.053997  8313 consensus_queue.cc:1048] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.116s
I20260709 13:03:35.057792  8568 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:35.060544  8554 log.cc:927] Time spent T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.461s	user 0.004s	sys 0.017s
I20260709 13:03:35.064013  1663 raft_consensus.cc:1240] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 17. Current term is 18. Ops: [15.12-17.13]
I20260709 13:03:35.106568  1589 raft_consensus.cc:1275] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:03:35.093914  7935 raft_consensus.cc:2749] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:35.116335  8496 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:35.117462  8496 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:35.120915  8496 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:03:35.166028  8545 log.cc:927] Time spent T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
W20260709 13:03:35.228303  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:35.241523  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 157169us
W20260709 13:03:35.257341  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 174202us
I20260709 13:03:35.258234  1707 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:35.277305  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:35.219724  8543 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.325580  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:35.272318  8205 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:35.276541  8528 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:35.333968  8528 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:35.338420  8346 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 21 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:35.318259  8543 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:35.339772  8287 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:35.340874  8287 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:35.352676  8287 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:35.331661  8205 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:35.356199  8242 raft_consensus.cc:3060] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:35.357553  8205 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:35.358392  8205 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
W20260709 13:03:35.359073  8579 log.cc:927] Time spent T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.258s	user 0.000s	sys 0.002s
I20260709 13:03:35.359244  8205 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:35.292634  8487 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:35.361663  8487 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:35.364987  8543 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:35.370952  8528 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:35.383764  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 593746us
I20260709 13:03:35.407272  1735 raft_consensus.cc:1275] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:03:35.407770  1734 raft_consensus.cc:1240] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 13 LEADER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:03:35.408468  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:35.409365  1736 raft_consensus.cc:1275] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:03:35.409969  1739 raft_consensus.cc:1275] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
W20260709 13:03:35.410331  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 152506us
I20260709 13:03:35.410923  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:35.414592  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:35.415694  1736 raft_consensus.cc:2410] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:03:35.416278  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:35.418583  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:35.419422  1732 raft_consensus.cc:2393] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 20: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
W20260709 13:03:35.426419  1484 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51168 (request call id 136) took 26931 ms (client timeout 15000 ms). Trace:
W20260709 13:03:35.432667  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 46940.5us
W20260709 13:03:35.437574  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 179465us
I20260709 13:03:35.438671  1707 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:35.455641  1736 raft_consensus.cc:1275] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:03:35.413980  8496 consensus_queue.cc:1048] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:03:35.445199  8470 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:35.470338  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:35.445647  8431 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.440908  8150 consensus_queue.cc:1048] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:03:35.471071  1739 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 21.
I20260709 13:03:35.473141  1736 raft_consensus.cc:1275] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:03:35.426991  1484 rpcz_store.cc:269] 0709 13:03:08.495281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.495596 (+   315us) service_pool.cc:224] Handling call
0709 13:03:35.426297 (+26930701us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:31.663873 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:31.726030 (+ 62157us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:31.726085 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:03:31.726121 (+    36us) tablet.cc:662] Decoding operations
0709 13:03:31.765596 (+ 39475us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:31.792224 (+ 26628us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:31.800263 (+  8039us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:03:31.971948 (+171685us) tablet.cc:701] Row locks acquired
0709 13:03:31.972005 (+    57us) write_op.cc:260] PREPARE: finished
0709 13:03:31.972230 (+   225us) write_op.cc:270] Start()
0709 13:03:31.972399 (+   169us) write_op.cc:276] Timestamp: P: 1783602211972154 usec, L: 0
0709 13:03:31.972438 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:03:32.067931 (+ 95493us) log.cc:844] Serialized 5133 byte log entry
0709 13:03:32.606535 (+538604us) op_driver.cc:464] REPLICATION: finished
0709 13:03:32.618852 (+ 12317us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b5400119254. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef8571 00007f1b80f8ae28 00007f1b849c5581 00007f1b849c4d58 00007f1b849c99f1 00007f1b849c99a9 00007f1b849c9939 00007f1b849c9901 00007f1b849c8b2d 000000000038f354 000000000038f199
0709 13:03:32.788767 (+169915us) write_op.cc:301] APPLY: starting
0709 13:03:32.792809 (+  4042us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:32.974476 (+181667us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:32.974538 (+    62us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:33.311933 (+337395us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:33.312287 (+   354us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 13:03:33.312366 (+    79us) write_op.cc:312] APPLY: finished
0709 13:03:33.312782 (+   416us) log.cc:844] Serialized 121 byte log entry
0709 13:03:33.339440 (+ 26658us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:33.364517 (+ 25077us) write_op.cc:454] Released schema lock
0709 13:03:33.364598 (+    81us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:33.380971 (+ 16373us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:33.381011 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":960686,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":163499,"apply.run_cpu_time_us":25102,"apply.run_wall_time_us":583428,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58467,"num_ops":13,"prepare.queue_time_us":214240,"prepare.run_cpu_time_us":24189,"prepare.run_wall_time_us":997629,"raft.queue_time_us":190057,"raft.run_cpu_time_us":31070,"raft.run_wall_time_us":165413,"replication_time_us":602667,"spinlock_wait_cycles":33886976,"thread_start_us":419138,"threads_started":4,"wal-append.queue_time_us":284803,"wal-append.run_cpu_time_us":25456,"wal-append.run_wall_time_us":1961657}]]}
I20260709 13:03:35.470935  1733 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 19.
I20260709 13:03:35.500255  8431 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:35.518713  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:35.522424  1736 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
W20260709 13:03:35.526046  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 121141us
W20260709 13:03:35.532799  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 122306us
I20260709 13:03:35.516525  8325 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.546780  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:35.548601  1736 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:35.548614  8559 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.554203  8559 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:35.555670  8200 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:35.547907  8205 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:35.538203  8325 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:35.594929  8588 log.cc:927] Time spent T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.132s	user 0.002s	sys 0.000s
I20260709 13:03:35.610776  1736 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 21.
W20260709 13:03:35.601289  8547 log.cc:927] Time spent T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 1.171s	user 0.006s	sys 0.016s
I20260709 13:03:35.613371  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:03:35.619560  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:35.619982  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 74712.8us
I20260709 13:03:35.625095  8529 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.625927  8529 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:35.629806  8325 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:35.639528  1633 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:35.639778  1558 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:35.641633  8288 consensus_queue.cc:1048] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:03:35.640515  8205 consensus_queue.cc:1048] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.003s
I20260709 13:03:35.646271  8559 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:35.649403  1558 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:35.593724  8200 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:35.651808  8325 raft_consensus.cc:2804] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:35.651741  8346 raft_consensus.cc:2804] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:35.663403  1740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43678 (request call id 4526) took 1375 ms. Trace:
I20260709 13:03:35.663574  8352 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.660213  1558 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:35.664218  8352 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:35.664944  8558 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:35.665514  8558 raft_consensus.cc:697] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 21 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:35.666404  8558 consensus_queue.cc:237] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:35.666872  8352 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:35.657294  8591 log.cc:927] Time spent T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:03:35.657598  8596 log.cc:927] Time spent T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:03:35.663846  1740 rpcz_store.cc:276] 0709 13:03:34.288131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:34.288278 (+   147us) service_pool.cc:224] Handling call
0709 13:03:34.288602 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:34.288926 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:34.288955 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:34.294653 (+  5698us) log.cc:844] Serialized 26 byte log entry
0709 13:03:34.343934 (+ 49281us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:34.343996 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:34.344084 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:35.585347 (+1241263us) spinlock_profiling.cc:243] Waited 3.79 ms on lock 0x7b2400250988. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7dd289c4 00007f1b7dd26acb 00007f1b7dee1dc9 00007f1b7dee1a55 00007f1b7dee109d 00007f1b80b1310e 00007f1b80b2a88c 00007f1b80b29bb6 00007f1b80b297d8 00007f1b80b33221
0709 13:03:35.662127 (+ 76780us) raft_consensus.cc:1685] finished
0709 13:03:35.662150 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:35.663313 (+  1163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2382,"raft.queue_time_us":3414,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":2719,"spinlock_wait_cycles":8712064,"thread_start_us":10361,"threads_started":1,"wal-append.queue_time_us":91287}
I20260709 13:03:35.658114  8346 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:35.659780  8288 raft_consensus.cc:2804] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:35.658877  8325 raft_consensus.cc:697] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 19 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:35.650000  8242 consensus_queue.cc:1048] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:03:35.648394  8528 consensus_queue.cc:1048] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:03:35.655548  8312 consensus_queue.cc:1048] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:03:35.674017  8559 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.657508  8541 consensus_queue.cc:1048] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 13:03:35.688047  2543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:35.676977  8346 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:35.677126  8288 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:35.706990  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:35.704041  8559 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:35.730634  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:35.747723  1667 raft_consensus.cc:1275] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:03:35.677305  8431 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:35.751502  1664 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:35.753508  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:35.754290  1667 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 13.
I20260709 13:03:35.760543  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:35.763444  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:35.765736  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:35.766069  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:35.718029  8325 consensus_queue.cc:237] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:35.772761  1587 raft_consensus.cc:1275] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:03:35.767558  1630 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:35.752921  8371 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.753450  8288 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:35.771291  1592 raft_consensus.cc:1275] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:03:35.774839  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:35.770478  8486 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.780184  1664 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 21.
I20260709 13:03:35.767489  8200 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:35.789515  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:35.791330  1591 raft_consensus.cc:1275] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:03:35.792825  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:35.793035  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:35.796665  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 24 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:35.781009  8431 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:35.799213  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:35.784888  8486 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:35.803678  8486 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:35.805892  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:03:35.809732  8600 log.cc:927] Time spent T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:03:35.815301  8559 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:35.781291  8371 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:35.825256  8288 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:35.826709  1585 raft_consensus.cc:2393] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 14: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:35.827564  8371 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:35.827788  1586 raft_consensus.cc:2393] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 19: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:35.827839  8288 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:35.848167  8486 consensus_queue.cc:1048] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:03:35.869531  8352 consensus_queue.cc:1048] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:03:35.873713  8538 consensus_queue.cc:1048] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 13:03:35.916733  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 478183us
W20260709 13:03:35.920447  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 473926us
I20260709 13:03:35.940718  8470 raft_consensus.cc:697] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 21 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:35.939291  8499 raft_consensus.cc:2804] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:36.006973  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 24 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:36.007774  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:36.011229  1735 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 13.
I20260709 13:03:36.014041  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:36.019842  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:36.016415  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:36.034303  1633 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
W20260709 13:03:36.031713  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 169804us
I20260709 13:03:36.013427  8479 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.009665  8469 consensus_queue.cc:1048] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:03:36.037819  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:36.038965  1633 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:36.060102  8472 raft_consensus.cc:493] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:36.014133  8190 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:36.060626  8529 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:36.057624  1556 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:36.009613  8325 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:36.075675  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:36.040256  8559 raft_consensus.cc:2804] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:36.075685  8431 raft_consensus.cc:2749] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:36.110283  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:36.114691  1662 raft_consensus.cc:2410] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:03:36.111214  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:36.110967  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:36.093698  8559 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:36.091784  8288 raft_consensus.cc:2749] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:36.125854  1633 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:36.125275  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:36.042541  8470 consensus_queue.cc:237] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:36.127846  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:36.075511  8479 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:36.103870  8499 raft_consensus.cc:697] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 19 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
W20260709 13:03:36.125301  8616 log.cc:927] Time spent T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:03:36.089814  8190 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:36.094321  8472 raft_consensus.cc:515] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:36.128193  8458 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:36.126374  8559 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:36.092979  8325 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:36.119184  8381 consensus_queue.cc:1048] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:03:36.127717  8496 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:36.156144  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:36.148073  8458 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:36.170924  1630 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:36.129591  8527 consensus_queue.cc:1048] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 13:03:36.145064  8487 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:36.181972  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:36.156994  7935 raft_consensus.cc:493] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:36.138055  8346 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:36.183291  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:36.149051  8543 consensus_queue.cc:1048] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 13:03:36.182154  1740 raft_consensus.cc:1275] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:03:36.182747  8529 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:36.178766  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 47898.5us
I20260709 13:03:36.194680  1633 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:36.197360  1633 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:36.201212  8486 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.201768  8403 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:36.201843  8486 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:36.202690  8403 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:36.189350  8538 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:36.211025  8538 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:36.214416  8458 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:36.160558  8496 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:36.188845  8499 consensus_queue.cc:237] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:36.204312  8486 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:36.221402  8190 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:36.196681  7935 raft_consensus.cc:515] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:36.185926  8150 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.229693  8325 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:36.185570  8469 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:36.175864  8396 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:36.236140  8150 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:36.245041  8629 log.cc:927] Time spent T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:03:36.246681  8396 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:36.253957  8396 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:36.252107  8150 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:36.246806  8469 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:36.248301  8346 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 22 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:36.248791  8472 leader_election.cc:290] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:36.245909  7935 leader_election.cc:290] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:36.260329  8469 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:36.231927  1633 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:36.264513  8541 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:36.264793  8612 log.cc:927] Time spent T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.324s	user 0.006s	sys 0.000s
I20260709 13:03:36.265573  2426 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:36.266470  7935 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.267143  7935 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:36.267563  8289 raft_consensus.cc:2749] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:36.267778  8469 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:36.269133  8593 consensus_queue.cc:1048] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:36.270195  8469 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:36.252977  8624 log.cc:927] Time spent T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:03:36.272292  8538 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:36.274605  1633 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:36.287796  8469 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:36.288532  8538 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:36.291108  2553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:36.292630  8538 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:36.295634  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:36.296142  1555 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:36.297607  8538 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:36.298206  8346 raft_consensus.cc:2749] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:36.272869  7935 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:36.298861  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:36.300120  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:36.300675  8526 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:36.301438  8526 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:36.301954  8542 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:36.302547  8542 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:36.304131  1633 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:36.304338  8526 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:36.305696  8205 raft_consensus.cc:2749] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:36.305914  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:36.306432  8205 raft_consensus.cc:2749] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:36.311071  8625 log.cc:927] Time spent T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.186s	user 0.002s	sys 0.000s
I20260709 13:03:36.304559  8542 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:36.312714  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:36.313434  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:36.313635  1735 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 17.
I20260709 13:03:36.317536  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:36.325652  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:36.326843  2426 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:36.332911  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:36.344520  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fb069a8f6e4d0c885835eee0132b00" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:36.279650  8472 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:36.346997  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:36.259078  8559 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:36.357205  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:36.357810  1633 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:36.359103  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:36.346179  8631 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.364189  1705 leader_election.cc:304] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:36.355568  8325 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:36.369550  8242 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:36.381628  8242 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:36.383886  8242 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:36.372538  8472 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:36.386765  8472 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:36.349535  8205 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.388541  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:36.389048  8205 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:36.390133  1658 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 22.
I20260709 13:03:36.370007  8529 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:36.391201  8205 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:36.391052  8529 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:36.392539  1663 raft_consensus.cc:2393] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 14: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:36.393396  8559 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:36.375946  8403 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:36.395423  8403 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:36.397732  8526 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:36.398378  8526 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:36.400005  8496 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:36.373204  8487 raft_consensus.cc:2804] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:36.400815  8526 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:36.406942  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 23 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:36.412688  1735 raft_consensus.cc:2410] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede for term 23 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:03:36.407909  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:36.408211  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:36.342985  8602 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:36.345829  8527 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:36.404898  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:03:36.410722  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 46647.9us
I20260709 13:03:36.424178  8527 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:36.425695  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:36.426558  8527 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:36.427423  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a149db07824e3fb3c1f721b61d6c20" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:36.429121  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:36.432698  1705 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:36.413630  1740 raft_consensus.cc:3060] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:36.409090  8631 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:36.439169  8631 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:36.440038  1661 raft_consensus.cc:1275] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:03:36.440399  1661 pending_rounds.cc:85] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede: Aborting all ops after (but not including) 8
I20260709 13:03:36.440601  1661 pending_rounds.cc:107] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:03:36.440820  1661 raft_consensus.cc:2889] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:36.442456  8526 raft_consensus.cc:2749] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:36.414376   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:36.443184  8529 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:36.376025  8381 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:36.378822  8325 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:36.369716  8543 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:36.410509  8487 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:36.415732  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:36.448872  1705 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:36.455356  1740 raft_consensus.cc:2468] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 14.
I20260709 13:03:36.410260  8431 raft_consensus.cc:2749] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:36.461663  1738 raft_consensus.cc:1275] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:03:36.412510  8242 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:36.463663  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:36.414516  8472 raft_consensus.cc:2749] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:36.466599  1705 leader_election.cc:304] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:36.471356  8150 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:36.476374  8325 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:36.476415  8472 raft_consensus.cc:2749] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:36.465679  8487 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:36.481531  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:36.485567  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:36.487109  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:36.445719  8381 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:36.483470  8486 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:36.494083  8486 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:36.482841  8528 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.496363  8486 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:36.496516  8528 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:36.483640  8538 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:36.473515  8621 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:36.511031  1558 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:36.465412  8543 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:36.514189  8288 raft_consensus.cc:2749] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:36.519644  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:36.533069  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:36.474192  8242 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:36.550784  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:36.559094  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:36.561021  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:36.545921  8472 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.569496  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:36.574602  1588 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 22.
W20260709 13:03:36.586212  8632 log.cc:927] Time spent T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:03:36.588775  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:36.590025  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:36.591017  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:36.591519  1664 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:36.609769  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:36.611898  1485 catalog_manager.cc:5697] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:36.614552  1485 catalog_manager.cc:5697] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:36.617874  8528 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:36.620764  1705 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:36.579998  8403 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:36.623384  8584 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:36.623816  8584 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:36.624177  8584 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:03:36.627075  8628 log.cc:927] Time spent T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.490s	user 0.002s	sys 0.000s
I20260709 13:03:36.511345  8538 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:36.636345  8538 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:36.632052  1633 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:36.637741  8431 raft_consensus.cc:2804] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:36.638468  8431 raft_consensus.cc:697] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 14 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:36.639599  8431 consensus_queue.cc:237] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:36.582052  8472 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:36.644622  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:36.646344  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:36.647049  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:36.648952  1737 raft_consensus.cc:2393] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 in current term 14: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:36.649302  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:36.647013  1739 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 19.
I20260709 13:03:36.650408  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:03:36.650779  8626 log.cc:927] Time spent T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.517s	user 0.000s	sys 0.002s
I20260709 13:03:36.651321  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:36.655193  8381 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:36.512634  8621 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:36.665495  1707 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:36.666188  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:36.666523  1707 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:36.666864  1583 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 18.
I20260709 13:03:36.616174  1485 catalog_manager.cc:5697] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:36.693698  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:36.692781  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:36.675822  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:36.694725  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:36.699038  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:36.700235  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:36.701505  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:36.702085  1732 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:36.702956  8472 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:36.703946  1558 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:36.704732  8478 raft_consensus.cc:2749] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:36.706620  1581 tablet_service.cc:1558] Processing DeleteTablet for tablet b37805060ac444b6b6e9e7da8164233c with delete_type TABLET_DATA_TOMBSTONED (TS 6d4de2ce0683442498244b9529127f91 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:45194
W20260709 13:03:36.711160  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 44715us
I20260709 13:03:36.751880  1707 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:36.753214  1707 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:36.711938  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:36.750576  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:36.749130  1664 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 22.
I20260709 13:03:36.658221  8543 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:36.770407  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 53253.3us
I20260709 13:03:36.770918  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:03:36.772699  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 76308.2us
I20260709 13:03:36.774403  7935 consensus_queue.cc:1048] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:36.777853  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:36.776535  1732 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 22.
W20260709 13:03:36.782630  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 109136us
I20260709 13:03:36.664948  8325 consensus_queue.cc:1048] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.107s
I20260709 13:03:36.763641  8479 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:36.781606  8484 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:36.772931  8532 raft_consensus.cc:2749] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:36.811298  1558 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:36.826709  1558 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:36.790292  8242 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:36.820502  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:36.784826  8543 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.835589  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:36.826779  1707 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:36.830396  1558 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:36.839673  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:36.828560  8488 raft_consensus.cc:2749] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:36.830852  8425 raft_consensus.cc:2804] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:36.831041  8371 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:36.858163  1558 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:36.844146  8538 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:36.861474  1558 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:36.840817  8543 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:36.877249  8604 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:36.889535  8543 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:36.890969  8621 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:36.865192  8528 raft_consensus.cc:2804] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:36.892150  8528 raft_consensus.cc:697] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 22 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:36.856678  8487 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:36.857719  8425 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:36.935716  1660 raft_consensus.cc:2393] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 18: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:36.913915  8425 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:36.911870  8458 raft_consensus.cc:2749] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:36.893399  8528 consensus_queue.cc:237] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:36.849519  1485 catalog_manager.cc:5697] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 12 to 18. New cstate: current_term: 18 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:37.013610  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:03:37.073742  8640 log.cc:927] Time spent T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
W20260709 13:03:37.075050  8639 log.cc:927] Time spent T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:03:37.106652  1658 raft_consensus.cc:1240] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:37.107776  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:03:37.110780  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 249275us
I20260709 13:03:37.132149  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:37.156034  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:37.156608  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:37.134056  8487 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:37.159512  8649 log.cc:927] Time spent T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:03:37.160929  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:37.161813  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:37.166887  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 23 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:37.167696  1587 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 22.
W20260709 13:03:37.173811  8647 log.cc:927] Time spent T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
W20260709 13:03:37.174978  8650 log.cc:927] Time spent T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
W20260709 13:03:37.177070  8648 log.cc:927] Time spent T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 13:03:37.179100  8651 log.cc:927] Time spent T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:03:37.133862  1485 catalog_manager.cc:5697] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:37.181401  1485 catalog_manager.cc:5697] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:03:37.182611  8656 log.cc:927] Time spent T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:03:37.174804  8533 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:37.184444  8533 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:37.185586  8644 log.cc:927] Time spent T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
W20260709 13:03:37.187155  8645 log.cc:927] Time spent T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:03:37.194097  8533 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:03:37.198596  8584 consensus_meta.cc:287] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d: Time spent flushing consensus metadata: real 0.574s	user 0.009s	sys 0.003s
I20260709 13:03:37.199137  8584 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:37.205431  8637 log.cc:927] Time spent T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.497s	user 0.006s	sys 0.000s
W20260709 13:03:37.215375  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 388725us
I20260709 13:03:37.216325  1707 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:37.217686  1707 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:37.218930  8396 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:37.219609  8396 raft_consensus.cc:2749] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:37.221926  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:37.222213  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:37.223856  1590 raft_consensus.cc:2393] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 14: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:37.224762  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:37.194028  8661 tablet_replica.cc:333] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:37.226060  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:37.226361  8661 raft_consensus.cc:2243] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:37.227129  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:37.227375  8661 raft_consensus.cc:2272] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:37.228181  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:37.229468  1586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:37.229504  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:37.231220  8584 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:37.232409  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:37.233095  1588 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 19.
I20260709 13:03:37.227452  1583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
W20260709 13:03:37.234215  8658 log.cc:927] Time spent T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:03:37.223315  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:37.184288  1485 catalog_manager.cc:5697] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:37.238729  1485 catalog_manager.cc:5697] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 18 to 24. New cstate: current_term: 24 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:37.255295  1705 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:37.263474  1556 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:37.266119  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:37.287806  1658 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:37.287834  1556 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:37.289603  1556 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:37.302103  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:37.259249  8499 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:37.263384  8396 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:37.312978  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 54749.3us
I20260709 13:03:37.258793  8532 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:37.315912  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:37.315922  1589 raft_consensus.cc:1275] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:03:37.286998  8190 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:37.303182  8621 raft_consensus.cc:2749] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:37.303421  8431 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.287389  8484 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:37.326891  8661 ts_tablet_manager.cc:1916] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:37.303370  8487 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:37.321748  1591 raft_consensus.cc:3060] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:37.318320  8458 raft_consensus.cc:2749] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:37.307717  8533 raft_consensus.cc:2749] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:37.385156  1658 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 23.
I20260709 13:03:37.240811  1485 catalog_manager.cc:5697] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 12 to 13, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 13 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:37.325212  8532 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:37.395203  1485 catalog_manager.cc:5697] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:37.372838  8484 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:37.399295  8484 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:37.402724  8499 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:37.403263  8499 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:37.396843  8532 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:37.410041  1591 raft_consensus.cc:2468] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 23.
W20260709 13:03:37.422739  8666 log.cc:927] Time spent T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:03:37.308873  8425 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:37.432382  1587 raft_consensus.cc:1240] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:37.380012  8487 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:37.435515  8487 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:37.383960  8371 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
W20260709 13:03:37.438161  8665 log.cc:927] Time spent T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.112s	user 0.000s	sys 0.002s
I20260709 13:03:37.438411  8371 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:37.340888  8190 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:37.459206  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 202410us
I20260709 13:03:37.460358  1705 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:37.344703  8431 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:37.402768  8396 raft_consensus.cc:2749] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:37.481434  1588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:37.467226  8659 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.471436  8584 raft_consensus.cc:2804] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:03:37.491587  8671 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:37.492723  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:37.504664  8431 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:37.478475  8371 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:37.517794  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 195140us
I20260709 13:03:37.518283  8671 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:37.534744  8671 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:37.535948  1659 raft_consensus.cc:1275] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:03:37.517583  8584 raft_consensus.cc:697] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 23 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:37.537880  8584 consensus_queue.cc:237] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:37.538414  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:37.539341  1659 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 19.
I20260709 13:03:37.493446  8659 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:37.541965  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:37.543169  8659 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:37.499441  8472 consensus_queue.cc:1048] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:03:37.545501  1659 raft_consensus.cc:1275] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:03:37.396970  1485 catalog_manager.cc:5697] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:37.547235  1485 catalog_manager.cc:5697] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:37.549963  8190 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:37.554345  8425 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 20 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:37.559052  1485 catalog_manager.cc:5697] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:37.559900  8499 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:37.571326  8499 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:37.583700  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:37.560755  1485 catalog_manager.cc:5697] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 15 to 19, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 19 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:37.587524  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:37.587822  1485 catalog_manager.cc:5697] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 11 to 15, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 15 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
W20260709 13:03:37.598143  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 66770.8us
I20260709 13:03:37.601568  8150 consensus_queue.cc:1048] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:37.603240  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:37.603497  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:37.608332  1556 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:37.609095  8621 raft_consensus.cc:2749] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:37.611446  1705 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:37.612306  1485 catalog_manager.cc:5697] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:37.614188  8621 consensus_queue.cc:1059] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:37.614346  1485 catalog_manager.cc:5697] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:37.616201  1485 catalog_manager.cc:5697] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 8 to 9, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 9 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:37.618021  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:37.617936  1485 catalog_manager.cc:5697] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:37.615397  8371 raft_consensus.cc:3055] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:37.619064  8371 raft_consensus.cc:740] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:37.619418  1485 catalog_manager.cc:5697] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:37.620132  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:37.620628  8371 consensus_queue.cc:260] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:37.621740  1485 catalog_manager.cc:5697] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 18 to 20, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 20 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:37.622709  8371 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:37.623764  8190 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:37.624311  8190 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:37.624588  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:37.625445  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:37.626084  1741 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 19.
I20260709 13:03:37.626384  8190 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:37.627481  1739 raft_consensus.cc:1275] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:37.627635  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:37.629251  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:37.632869  1633 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:37.633764  8190 raft_consensus.cc:2749] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:03:37.635149  8190 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:37.635704  8190 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:37.637861  8190 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:37.646703  1633 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:37.646872  1538 auto_rebalancer.cc:629] Failed to schedule move for tablet 53c3c6ae566d4afda95ffc509772bca1: Illegal state: Replica 6d4de2ce0683442498244b9529127f91 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:03:37.651031  8190 raft_consensus.cc:2749] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:37.652673  1633 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:37.654006  1633 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:37.654596  8190 raft_consensus.cc:2764] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 13:03:37.647581  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:37.656332  1662 raft_consensus.cc:1275] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
W20260709 13:03:37.658850  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 56177.4us
W20260709 13:03:37.666520  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 65069us
I20260709 13:03:37.668299  8150 consensus_queue.cc:1048] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:37.668612  1633 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:37.666636  8526 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:37.671931  8526 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:37.672361  8526 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:37.673727  8190 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:37.675118  1704 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:37.676970  8431 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:37.677736  8472 raft_consensus.cc:2749] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:37.686865  1592 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:03:37.687638  1592 raft_consensus.cc:606] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:37.688689  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:37.691640  1592 raft_consensus.cc:1275] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:37.670572  1707 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:37.671325  1633 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:37.692992  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:37.695354  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:37.695511  1633 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:37.697031  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:37.697506  1633 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:37.699282  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:37.699523  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:37.700546  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:37.701366  1664 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 21.
I20260709 13:03:37.703581  1556 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:37.704557  1633 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:37.709263  1707 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:37.711952  1707 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:37.712908  7935 raft_consensus.cc:2749] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:37.714125  1633 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:37.712709  1556 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:37.716490  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:37.729043  1633 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:37.732822  1556 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:37.702270  8431 raft_consensus.cc:2749] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:37.705588  8190 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:03:37.706097  8487 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:37.710422  8676 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:37.764952  1556 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:37.718338  8670 raft_consensus.cc:2749] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:37.717881  8529 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:37.730803  8672 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:37.730315  8621 raft_consensus.cc:2749] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:37.766085  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 63204.9us
I20260709 13:03:37.730928  8403 raft_consensus.cc:2749] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:37.783080  1735 raft_consensus.cc:1240] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:37.766131  8604 raft_consensus.cc:2749] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:37.789533  1590 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:03:37.793753  1590 raft_consensus.cc:606] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:37.794126  1590 raft_consensus.cc:614] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:37.797499  1735 raft_consensus.cc:1275] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 13:03:37.781958  8538 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:37.800441  8431 raft_consensus.cc:2804] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:03:37.818884  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 89953.4us
I20260709 13:03:37.827806  1633 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:37.831959  8403 raft_consensus.cc:2749] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:37.832648  1633 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:37.834309  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:37.807147  8538 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:37.842409  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:37.768647  8674 consensus_queue.cc:1048] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 13:03:37.831329  8431 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.849328  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:37.841360  8538 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:37.838164  8631 raft_consensus.cc:2749] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:37.880264  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:37.881691  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:37.852680  8431 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:37.944708  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 58494.2us
I20260709 13:03:37.946461  8696 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:37.966531  8685 log.cc:927] Time spent T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:03:37.967568  8691 log.cc:927] Time spent T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
W20260709 13:03:37.982085  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 92013.1us
W20260709 13:03:37.989379  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 122570us
I20260709 13:03:37.843930  8403 consensus_queue.cc:1059] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:03:37.890247  8631 consensus_queue.cc:1048] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.129s
I20260709 13:03:37.889528  8526 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:38.043860  1558 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:38.045738  8604 consensus_queue.cc:1048] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:38.048437  8604 raft_consensus.cc:2749] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:03:38.053936  8690 log.cc:927] Time spent T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:03:38.071333  8526 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:38.072543  1739 raft_consensus.cc:1240] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 19. Current term is 20. Ops: []
W20260709 13:03:38.102537  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 58776.1us
I20260709 13:03:38.029155  8696 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:38.107857  1558 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:38.130088  1735 raft_consensus.cc:1275] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
W20260709 13:03:38.136765  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 108280us
I20260709 13:03:38.103273  8661 ts_tablet_manager.cc:1929] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.7
I20260709 13:03:38.137636  1633 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:38.117651  8702 raft_consensus.cc:2749] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:38.154853  8696 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:38.155400  8661 log.cc:1199] T b37805060ac444b6b6e9e7da8164233c P 6d4de2ce0683442498244b9529127f91: Deleting WAL directory at /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-0-root/wals/b37805060ac444b6b6e9e7da8164233c
I20260709 13:03:38.156919  8661 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45194 (request call id 0) took 1493 ms. Trace:
I20260709 13:03:38.157321  8661 rpcz_store.cc:276] 0709 13:03:36.703503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.706326 (+  2823us) service_pool.cc:224] Handling call
0709 13:03:37.193608 (+487282us) ts_tablet_manager.cc:1151] Deleting tablet b37805060ac444b6b6e9e7da8164233c
0709 13:03:37.193716 (+   108us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:03:37.574618 (+380902us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:38.094062 (+519444us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:38.156823 (+ 62761us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":410331,"thread_start_us":290386,"threads_started":1}
I20260709 13:03:38.163153  8698 raft_consensus.cc:3055] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:03:38.163451  8371 consensus_meta.cc:287] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91: Time spent flushing consensus metadata: real 0.540s	user 0.006s	sys 0.006s
I20260709 13:03:38.163659  8698 raft_consensus.cc:740] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:38.168187  8707 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:38.172811  1477 catalog_manager.cc:5028] TS 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): tablet b37805060ac444b6b6e9e7da8164233c (table test-workload [id=8a8e3153ff4e476f890a0820215f177a]) successfully deleted
W20260709 13:03:38.173558  8688 log.cc:927] Time spent T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:03:38.173465  8604 consensus_queue.cc:1048] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:03:38.177006  8698 consensus_queue.cc:260] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:38.202940  8698 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:38.195928  8529 raft_consensus.cc:2749] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:38.168849  8707 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:38.229350  1662 raft_consensus.cc:1275] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:03:38.238233  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
W20260709 13:03:38.254422  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 113983us
I20260709 13:03:38.255295  1633 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:38.211916  8670 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:38.260520  8707 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:38.261716  8696 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:38.262121  8696 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:38.262492  8696 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:38.265878  1585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:03:38.266544  1585 raft_consensus.cc:606] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:38.266938  1585 raft_consensus.cc:614] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:38.246605  8705 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:38.317152  8705 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:38.319576  8705 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:38.299201  8670 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:38.303974  8707 consensus_queue.cc:1048] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:03:38.304132  8431 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:38.307781  8646 consensus_queue.cc:1048] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
W20260709 13:03:38.357548  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 75541.9us
I20260709 13:03:38.367535  8538 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:38.368773  1591 raft_consensus.cc:1240] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 21. Current term is 22. Ops: []
I20260709 13:03:38.369875  8538 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 22 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:38.371552  8670 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:38.373353  1538 auto_rebalancer.cc:629] Failed to schedule move for tablet 58f7cd3ac9254bdb9fb62ab42597f15b: Illegal state: Replica 5ced62816f8545cd9b63a27e9055e42d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 22 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
W20260709 13:03:38.425786  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 169040us
I20260709 13:03:38.427887  1633 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:38.439467  8529 raft_consensus.cc:2749] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:38.440922  1633 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:38.444940  8529 raft_consensus.cc:2749] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:38.446738  1633 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:38.450377  8529 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:38.451934  1633 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:38.455413  8529 raft_consensus.cc:2749] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:38.460188  1665 raft_consensus.cc:1240] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Rejecting Update request from peer 5ced62816f8545cd9b63a27e9055e42d for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:03:38.463004  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:38.456465  8696 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:38.467084  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:38.469837  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:38.474591  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:38.483032  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:38.485231  1588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:03:38.485944  1588 raft_consensus.cc:606] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:38.485985  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:38.489007  8431 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:38.494442  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:38.495390  8696 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:38.491263  1592 consensus_queue.cc:237] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:03:38.537737  1633 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:38.545883  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:38.554417  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:38.554843  1633 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:38.558229  2537 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b37805060ac444b6b6e9e7da8164233c"
dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:33568
I20260709 13:03:38.558766  2537 raft_consensus.cc:606] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:38.559140  2537 raft_consensus.cc:614] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:38.557818  1633 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:38.561580  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:38.544005  8696 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:38.567796  1739 raft_consensus.cc:1240] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:38.558367  8631 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:38.573318  8707 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:38.585548  8431 consensus_queue.cc:1059] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.012s
I20260709 13:03:38.602401  8431 raft_consensus.cc:3055] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:38.602810  8431 raft_consensus.cc:740] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:38.603684  8431 consensus_queue.cc:260] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:38.612031  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:38.617587  8431 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:38.625571  1633 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:38.695314  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 69885.7us
I20260709 13:03:38.698297  8695 raft_consensus.cc:2749] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:03:38.825287  1555 consensus_peers.cc:597] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 -> Peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157): Couldn't send request to peer 7e839e91a1314c2f9a99b25b17c916a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c03a2285eaff45a6a236c5eae38fb06f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:38.844203  1660 raft_consensus.cc:1240] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:38.840965  1741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:38.836567  8532 consensus_queue.cc:1059] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 13:03:38.848022  8532 raft_consensus.cc:3055] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:03:38.848415  8532 raft_consensus.cc:740] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
W20260709 13:03:38.843143  1633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.850862  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:38.851641  1736 raft_consensus.cc:2393] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 20: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:38.853541  1665 raft_consensus.cc:1275] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:03:38.841579  1740 raft_consensus.cc:1275] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:03:38.857152  8478 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:38.857738  8478 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:38.870900  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:38.871676  1705 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:38.871996  1592 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3d6305e583540c895021f5a180689f7"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:03:38.878415  1660 raft_consensus.cc:1275] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:03:38.885479  8472 consensus_queue.cc:1059] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:38.886356  8526 raft_consensus.cc:2749] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:38.886672  8472 raft_consensus.cc:3055] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:38.887040  8472 raft_consensus.cc:740] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:38.887856  8472 consensus_queue.cc:260] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:38.889056  8472 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:38.890204  8532 consensus_queue.cc:260] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:38.891189  8538 consensus_queue.cc:1059] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:03:38.895996  8538 raft_consensus.cc:3055] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:38.896375  8538 raft_consensus.cc:740] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:38.897267  8538 consensus_queue.cc:260] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:38.898409  8538 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:38.904493  1558 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:38.905726  8288 raft_consensus.cc:2749] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:03:38.904790  8478 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:38.892200  1633 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:38.907320  8288 consensus_queue.cc:1048] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:38.914032  1591 raft_consensus.cc:1275] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:03:38.934377  8486 raft_consensus.cc:993] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:03:38.934916  8486 raft_consensus.cc:1081] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:03:38.960677  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:38.929783  8529 raft_consensus.cc:2749] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:38.975791  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:38.978561  8670 consensus_queue.cc:1048] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:38.980991  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:38.976581  1660 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39146
I20260709 13:03:38.983304  1660 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:38.983814  1660 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:38.972172  8425 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.969355  8532 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:38.973955  8486 consensus_queue.cc:1048] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:03:39.022217  8715 consensus_queue.cc:1048] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:03:38.996482  8425 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:39.031338  1660 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:39.055704  1660 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:39.058264  1592 raft_consensus.cc:606] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:39.058815  1592 raft_consensus.cc:614] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:39.060933  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:39.061555  1732 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:39.063023  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:39.084906  8371 raft_consensus.cc:993] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:03:39.117578  1732 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 20.
I20260709 13:03:39.119448  1633 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:39.136282   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:03:39.138554   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:39.135844  8706 raft_consensus.cc:2804] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:39.146925  8706 raft_consensus.cc:697] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 20 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:39.073803  8717 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
W20260709 13:03:39.159929  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 137443us
I20260709 13:03:39.139724  8486 raft_consensus.cc:1081] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
W20260709 13:03:39.177650  8732 log.cc:927] Time spent T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:03:39.166653  8717 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:39.197216  1591 raft_consensus.cc:3055] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:39.197587  1591 raft_consensus.cc:740] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:39.201762  1707 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:39.197470  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:39.207224  1663 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39146
I20260709 13:03:39.207755  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:39.207950  1663 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:39.208624  1663 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:39.213220  1556 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:39.198532  1591 consensus_queue.cc:260] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:39.224502  1591 raft_consensus.cc:3060] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:39.249784  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:39.250445  1662 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 18.
I20260709 13:03:39.251492  1707 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:39.209502  8717 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:39.236897  8659 raft_consensus.cc:2749] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:39.263229  1663 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:39.272636  8736 log.cc:927] Time spent T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:03:39.273626  8425 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:39.261850  8526 raft_consensus.cc:2749] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:39.277199  1591 raft_consensus.cc:2468] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 20.
W20260709 13:03:39.273658  8737 log.cc:927] Time spent T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:03:39.162123  8706 consensus_queue.cc:237] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:39.265373  1556 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:39.291275  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:39.292042  1740 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 18.
I20260709 13:03:39.249382  8670 raft_consensus.cc:2749] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:39.309482  1474 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet b37805060ac444b6b6e9e7da8164233c with cas_config_opid_index 5: aborting the task: latest config opid_index 8; task opid_index 5
W20260709 13:03:39.321532  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 56253us
I20260709 13:03:39.338786  1591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:39.339459  1591 raft_consensus.cc:3055] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:39.339783  1591 raft_consensus.cc:740] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:39.340363  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:39.340973  1740 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:39.329205  8675 raft_consensus.cc:2804] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:39.354137  1591 consensus_queue.cc:260] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:39.355995  1663 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:39.357779  1591 raft_consensus.cc:3060] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:39.366091  1740 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 18.
W20260709 13:03:39.367362  1556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:39.343410  8670 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:39.372502  1591 raft_consensus.cc:2468] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 18.
I20260709 13:03:39.357262  8675 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.369324  1633 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:39.394583  8675 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:39.399492  8529 raft_consensus.cc:2804] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:39.416767  8748 ts_tablet_manager.cc:933] T c03a2285eaff45a6a236c5eae38fb06f P 7e839e91a1314c2f9a99b25b17c916a6: Initiating tablet copy from peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:03:39.390704  8670 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:39.420737  8529 raft_consensus.cc:697] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 18 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:39.421936  8529 consensus_queue.cc:237] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:39.422746  8670 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:39.442162  1557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:39.411777  8739 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.457574  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:39.465973  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:39.471625  1667 raft_consensus.cc:2955] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
W20260709 13:03:39.574076  8747 log.cc:927] Time spent T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
W20260709 13:03:39.579123  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 138778us
I20260709 13:03:39.464475  8739 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:39.551272  8431 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:39.592703  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 116487us
W20260709 13:03:39.601495  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 128407us
I20260709 13:03:39.589658  8748 tablet_copy_client.cc:323] T c03a2285eaff45a6a236c5eae38fb06f P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:33325
W20260709 13:03:39.636185  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 86081.4us
I20260709 13:03:39.651578  8739 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:39.652959  8675 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:39.655891  8675 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:39.612052  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 155115us
I20260709 13:03:39.663710  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:39.668942  1660 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:39.612576  8746 raft_consensus.cc:493] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:39.608812  8431 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:39.678135  8431 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:39.688051  8746 raft_consensus.cc:515] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:39.691012  8746 leader_election.cc:290] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:39.691798  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:39.694417  1707 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:39.697022  8740 raft_consensus.cc:2749] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:39.705365  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:39.706126  1737 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:39.711824  1585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:39.712632  1660 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 19.
I20260709 13:03:39.728690  1737 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 19.
I20260709 13:03:39.715230  1556 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:39.748201  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:39.751631  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:39.752350  1590 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 20.
I20260709 13:03:39.757248  1601 tablet_copy_service.cc:140] P 6d4de2ce0683442498244b9529127f91: Received BeginTabletCopySession request for tablet c03a2285eaff45a6a236c5eae38fb06f from peer 7e839e91a1314c2f9a99b25b17c916a6 ({username='slave'} at 127.0.0.1:46836)
I20260709 13:03:39.761751  1601 tablet_copy_service.cc:161] P 6d4de2ce0683442498244b9529127f91: Beginning new tablet copy session on tablet c03a2285eaff45a6a236c5eae38fb06f from peer 7e839e91a1314c2f9a99b25b17c916a6 at {username='slave'} at 127.0.0.1:46836: session id = 7e839e91a1314c2f9a99b25b17c916a6-c03a2285eaff45a6a236c5eae38fb06f
I20260709 13:03:39.758131  8763 raft_consensus.cc:2804] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:39.765358  1666 raft_consensus.cc:1240] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 20 LEADER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:39.768448  8763 raft_consensus.cc:697] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:39.770229  8763 consensus_queue.cc:237] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:39.774000  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:39.774657  1665 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 19.
I20260709 13:03:39.777271  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9f5135e0d4c0091fe4ba5bed83ffd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:39.785193  1705 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:39.786044  8746 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:39.786429  8746 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.786769  8746 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:39.787302  1601 tablet_copy_source_session.cc:215] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:39.795171  1633 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:39.796408  1705 leader_election.cc:304] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:39.797251  8526 raft_consensus.cc:2749] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:39.804137  8746 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:39.803826  8659 raft_consensus.cc:2955] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:03:39.807039  8697 raft_consensus.cc:2804] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:39.807529  8697 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.807871  8697 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:39.829842  8697 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:39.830511  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 44111.1us
I20260709 13:03:39.832042  8697 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 21 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:39.833736  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:39.837852  1735 raft_consensus.cc:1275] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:03:39.811295  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 68210.3us
I20260709 13:03:39.836325  1483 catalog_manager.cc:5697] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 10 to 11, leader changed from 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 11 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:39.841261  8746 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:39.841888  8706 consensus_queue.cc:1048] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:39.857494  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:39.848001  1738 raft_consensus.cc:2955] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:03:39.862633  1483 catalog_manager.cc:5697] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 12 to 18, leader changed from 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 18 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:39.867089  1483 catalog_manager.cc:5697] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:39.868160  8748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c03a2285eaff45a6a236c5eae38fb06f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:39.870198  1483 catalog_manager.cc:5697] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 18 to 19, leader changed from 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 19 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:39.872895  1483 catalog_manager.cc:5697] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:39.876312  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:39.877142  1592 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:39.880411  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:39.881059  1660 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:39.886067  1592 raft_consensus.cc:2468] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 21.
I20260709 13:03:39.874992  1483 catalog_manager.cc:5697] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 11 to 12, leader changed from 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 12 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:39.910202  1589 raft_consensus.cc:1275] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:03:39.906427  1740 raft_consensus.cc:1275] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 13:03:39.910765  1485 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55132 (request call id 310) took 17857 ms (client timeout 15000 ms). Trace:
W20260709 13:03:39.916086  1485 rpcz_store.cc:269] 0709 13:03:22.053544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.061204 (+  7660us) service_pool.cc:224] Handling call
0709 13:03:39.910696 (+17849492us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:37.811073 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:38.381453 (+570380us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b5c0023070c. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b87181331 00007f1b87181221 00007f1b8717bf6c 00007f1b849d9d69 00007f1b849c50a6 00007f1b849c4d58 00007f1b849c99f1 00007f1b849c99a9 00007f1b849c9939 00007f1b849c9901 00007f1b849c8b2d
0709 13:03:38.381558 (+   105us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:38.381594 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:03:38.381614 (+    20us) tablet.cc:662] Decoding operations
0709 13:03:38.439846 (+ 58232us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:38.439910 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:38.439935 (+    25us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:03:38.441774 (+  1839us) tablet.cc:701] Row locks acquired
0709 13:03:38.441811 (+    37us) write_op.cc:260] PREPARE: finished
0709 13:03:38.442032 (+   221us) write_op.cc:270] Start()
0709 13:03:38.442278 (+   246us) write_op.cc:276] Timestamp: P: 1783602218441965 usec, L: 0
0709 13:03:38.442310 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:03:38.505301 (+ 62991us) log.cc:844] Serialized 8263 byte log entry
0709 13:03:38.791975 (+286674us) op_driver.cc:464] REPLICATION: finished
0709 13:03:39.177129 (+385154us) write_op.cc:301] APPLY: starting
0709 13:03:39.177271 (+   142us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:39.279997 (+102726us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:39.280028 (+    31us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:39.540140 (+260112us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:39.540682 (+   542us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 13:03:39.540758 (+    76us) write_op.cc:312] APPLY: finished
0709 13:03:39.541429 (+   671us) log.cc:844] Serialized 188 byte log entry
0709 13:03:39.541699 (+   270us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:39.541988 (+   289us) write_op.cc:454] Released schema lock
0709 13:03:39.542065 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:39.571624 (+ 29559us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:39.571658 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":31360,"reported_tablets":52,"spinlock_wait_cycles":3328,"child_traces":[["op",{"apply.queue_time_us":372783,"apply.run_cpu_time_us":30724,"apply.run_wall_time_us":399681,"cfile_cache_hit":86,"cfile_cache_hit_bytes":91907,"num_ops":21,"prepare.queue_time_us":153122,"prepare.run_cpu_time_us":67836,"prepare.run_wall_time_us":897623,"raft.queue_time_us":77151,"raft.run_cpu_time_us":115614,"raft.run_wall_time_us":273576,"replication_time_us":349496,"spinlock_wait_cycles":5740800,"thread_start_us":447670,"threads_started":4,"wal-append.queue_time_us":175216}]]}
I20260709 13:03:39.911851  1483 catalog_manager.cc:5697] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:39.897037  1660 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 20.
W20260709 13:03:39.923774  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 43782.1us
I20260709 13:03:39.925886  1633 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:39.929929  8706 raft_consensus.cc:2804] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:39.935762  8697 consensus_queue.cc:1048] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:39.936157  8706 raft_consensus.cc:697] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 21 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:39.937518  8659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:45196 (request call id 1) took 1450 ms. Trace:
I20260709 13:03:39.937145  8706 consensus_queue.cc:237] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:39.939880  1581 tablet_service.cc:1558] Processing DeleteTablet for tablet b37805060ac444b6b6e9e7da8164233c with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:45194
I20260709 13:03:39.943928  8659 rpcz_store.cc:276] 0709 13:03:38.487374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.487860 (+   486us) service_pool.cc:224] Handling call
0709 13:03:38.552943 (+ 65083us) log.cc:844] Serialized 506 byte log entry
0709 13:03:38.815812 (+262869us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b18002f6e00. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7de1cc0a 00007f1b8755c219 00007f1b7dea4a40 00007f1b7de9f4e4 00007f1b7de9f455 00007f1b80ee8b0b 00007f1b80f6db63 00007f1b80f95752 00007f1b85f55d29
0709 13:03:39.935051 (+1119239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":241805,"raft.queue_time_us":240578,"raft.run_cpu_time_us":1986,"raft.run_wall_time_us":10734,"spinlock_wait_cycles":2819968,"thread_start_us":34120,"threads_started":1,"wal-append.queue_time_us":35888,"wal-append.run_cpu_time_us":1678,"wal-append.run_wall_time_us":1002994}
I20260709 13:03:39.952739  1705 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:39.954243  8715 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:39.954733  8715 raft_consensus.cc:697] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 20 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:39.955574  8715 consensus_queue.cc:237] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:39.957489  1590 consensus_queue.cc:237] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:03:39.961114  8403 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:39.961804  8403 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:39.964383  8403 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:39.971251  8756 consensus_queue.cc:1048] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:39.977531  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:39.978560  1738 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 22.
I20260709 13:03:39.984354  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:39.983419  1633 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:39.987787  1584 raft_consensus.cc:2393] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 22: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:39.990983  8756 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:39.993273  8756 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:39.993721  8756 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:40.007766  8708 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:40.008387  8708 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:40.010486  8708 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:40.018415  1555 consensus_peers.cc:597] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 -> Peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157): Couldn't send request to peer 7e839e91a1314c2f9a99b25b17c916a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ef1be054223a4d3f90725c570db24bf5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:40.024055  1666 raft_consensus.cc:1275] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:03:40.028301  8756 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:40.032703  8646 consensus_queue.cc:1048] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:40.038931  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
W20260709 13:03:40.040598  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 52779.2us
I20260709 13:03:40.040676  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:40.041630  1590 raft_consensus.cc:2393] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 22: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:40.039810  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:40.043473  1660 raft_consensus.cc:2368] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for earlier term 19. Current term is 20.
I20260709 13:03:40.044994  1556 leader_election.cc:400] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683) with higher term. Message: Invalid argument: T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for earlier term 19. Current term is 20.
I20260709 13:03:40.046205  1556 leader_election.cc:403] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:40.048799  1477 catalog_manager.cc:5028] TS 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): tablet b37805060ac444b6b6e9e7da8164233c (table test-workload [id=8a8e3153ff4e476f890a0820215f177a]) successfully deleted
I20260709 13:03:40.053519  1740 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 22.
I20260709 13:03:40.054332  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:40.055814  1633 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:40.059101  1735 raft_consensus.cc:1275] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:03:40.066949  8706 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:40.067759  8706 raft_consensus.cc:697] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 22 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
W20260709 13:03:40.068626  8771 log.cc:927] Time spent T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.063s	user 0.001s	sys 0.002s
I20260709 13:03:40.063647  8646 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:03:40.069519  8748 tablet_copy_client.cc:806] T c03a2285eaff45a6a236c5eae38fb06f P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:40.043869  8756 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 22 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:40.068979  8706 consensus_queue.cc:237] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:40.083276  8768 log.cc:927] Time spent T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:03:40.088063  8150 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:40.088696  8150 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:40.091423  8150 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:40.090615  1483 catalog_manager.cc:5697] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 9 to 11, leader changed from 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 11 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
W20260709 13:03:40.092831  8772 log.cc:927] Time spent T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:03:40.093148  1483 catalog_manager.cc:5697] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:40.100075  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:40.073740  8748 tablet_copy_client.cc:670] T c03a2285eaff45a6a236c5eae38fb06f P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:40.110611  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:40.111406  1592 raft_consensus.cc:2368] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 20. Current term is 21.
I20260709 13:03:40.105929  8538 consensus_queue.cc:1048] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
W20260709 13:03:40.126161  8767 log.cc:927] Time spent T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.121s	user 0.002s	sys 0.000s
I20260709 13:03:40.128897  1707 leader_election.cc:400] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 20. Current term is 21.
I20260709 13:03:40.129410  1707 leader_election.cc:403] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:40.133236  8715 raft_consensus.cc:3060] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:03:40.140686   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:40.163338  8748 tablet_copy_client.cc:538] T c03a2285eaff45a6a236c5eae38fb06f P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:03:40.212036  8773 log.cc:927] Time spent T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:03:40.247176  1667 raft_consensus.cc:2955] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index -1 to 13, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:03:40.244482  8538 raft_consensus.cc:2955] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index -1 to 13, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:03:40.260023  8478 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.268375  8478 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:40.270004  8777 log.cc:927] Time spent T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:03:40.271145  8478 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:40.275435  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:40.273020  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:40.276106  1666 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 20.
I20260709 13:03:40.287026  1660 raft_consensus.cc:1275] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:03:40.294507  8646 raft_consensus.cc:2749] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683) with higher term. Message: Invalid argument: T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for earlier term 19. Current term is 20.
I20260709 13:03:40.290410  8738 consensus_queue.cc:1048] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:03:40.300978  8715 raft_consensus.cc:2749] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325) with higher term. Message: Invalid argument: T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d for earlier term 20. Current term is 21.
I20260709 13:03:40.302641  1705 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:40.303503  8715 raft_consensus.cc:2804] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:40.303934  8715 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.304358  8715 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:40.309791  1740 raft_consensus.cc:2955] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index -1 to 13, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:03:40.312085  8715 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:40.314857  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:40.317338  8715 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:40.355597  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:40.356232  1662 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:40.357362  8748 tablet_bootstrap.cc:492] T c03a2285eaff45a6a236c5eae38fb06f P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap starting.
I20260709 13:03:40.372108  1662 raft_consensus.cc:2468] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 21.
I20260709 13:03:40.373592  1705 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:40.390084  8478 raft_consensus.cc:2804] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:40.390642  8478 raft_consensus.cc:697] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 21 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:40.391513  8478 consensus_queue.cc:237] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:40.407511  1740 raft_consensus.cc:1275] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:03:40.413561  1665 raft_consensus.cc:1275] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:03:40.416002  8706 consensus_queue.cc:1048] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:40.418208  8150 consensus_queue.cc:1048] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:03:40.423949  8703 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:40.424568  8703 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:40.426720  8703 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:40.433017  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:40.435873  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:40.436789  1662 raft_consensus.cc:2368] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for earlier term 20. Current term is 21.
I20260709 13:03:40.443715  1556 leader_election.cc:400] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683) with higher term. Message: Invalid argument: T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for earlier term 20. Current term is 21.
I20260709 13:03:40.444204  1556 leader_election.cc:403] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:40.464303  8785 ts_tablet_manager.cc:933] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6: Initiating tablet copy from peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:03:40.469952  1737 raft_consensus.cc:1275] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:03:40.456662  8646 raft_consensus.cc:3060] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Advancing to term 21
W20260709 13:03:40.510949  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 58715.7us
I20260709 13:03:40.477404  8738 consensus_queue.cc:1048] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:03:40.511591  8621 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.518785  8621 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:40.528676  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:40.529590  8621 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:40.540122  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:40.540916  1738 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 22.
I20260709 13:03:40.548700  1589 raft_consensus.cc:1275] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:03:40.550101  1558 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:40.567833  1589 raft_consensus.cc:1275] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:03:40.545253  8621 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.560642  8718 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:40.589725  8718 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.559513  8785 tablet_copy_client.cc:323] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:33325
I20260709 13:03:40.590127  8718 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:40.590808  8621 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:40.597818  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:40.598670  1666 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 20.
I20260709 13:03:40.600625  1556 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:40.614742  8717 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:40.635076  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:40.637931  1732 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 20.
I20260709 13:03:40.654505  1590 raft_consensus.cc:1275] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:03:40.612164  8403 consensus_queue.cc:1048] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:03:40.673563  8756 consensus_queue.cc:1048] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:40.633594  8786 consensus_queue.cc:1048] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.049s
I20260709 13:03:40.680163  1601 tablet_copy_service.cc:140] P 6d4de2ce0683442498244b9529127f91: Received BeginTabletCopySession request for tablet ef1be054223a4d3f90725c570db24bf5 from peer 7e839e91a1314c2f9a99b25b17c916a6 ({username='slave'} at 127.0.0.1:46836)
I20260709 13:03:40.640566  8717 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.680897  1601 tablet_copy_service.cc:161] P 6d4de2ce0683442498244b9529127f91: Beginning new tablet copy session on tablet ef1be054223a4d3f90725c570db24bf5 from peer 7e839e91a1314c2f9a99b25b17c916a6 at {username='slave'} at 127.0.0.1:46836: session id = 7e839e91a1314c2f9a99b25b17c916a6-ef1be054223a4d3f90725c570db24bf5
I20260709 13:03:40.688905  8717 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:40.748493  8621 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:40.764758  8646 raft_consensus.cc:2749] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683) with higher term. Message: Invalid argument: T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for earlier term 20. Current term is 21.
I20260709 13:03:40.809837  1601 tablet_copy_source_session.cc:215] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:03:40.822117  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 126413us
W20260709 13:03:40.845672  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 74297.2us
I20260709 13:03:40.870954  1732 raft_consensus.cc:1275] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:03:40.882853  8785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef1be054223a4d3f90725c570db24bf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:40.890693  8798 consensus_queue.cc:1048] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:40.874581  8718 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:40.927774  8718 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 23 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:40.928462  1584 raft_consensus.cc:1240] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Rejecting Update request from peer 5bb87fe07da2414e84ee578c3b176ede for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 13:03:40.930827  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:40.920912  8717 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:40.963183  1666 raft_consensus.cc:1275] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:03:40.964856  8717 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 21 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:40.973892  1584 raft_consensus.cc:1275] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:03:40.978611  1483 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51168 (request call id 137) took 15416 ms (client timeout 15000 ms). Trace:
I20260709 13:03:40.987836  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:41.026607  8715 consensus_queue.cc:1048] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:40.997524  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:41.027968  1732 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:40.997524  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:41.021678  8804 consensus_queue.cc:1059] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:41.038746  1666 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:41.039005  8695 raft_consensus.cc:3055] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:03:41.039414  8695 raft_consensus.cc:740] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:41.040238  8695 consensus_queue.cc:260] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:41.041554  8695 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:41.051111  1732 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 21.
I20260709 13:03:41.054418  1558 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:03:41.052287  1483 rpcz_store.cc:269] 0709 13:03:25.562367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.562627 (+   260us) service_pool.cc:224] Handling call
0709 13:03:40.978500 (+15415873us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:40.219830 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:40.220665 (+   835us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:40.220727 (+    62us) write_op.cc:435] Acquired schema lock
0709 13:03:40.220758 (+    31us) tablet.cc:662] Decoding operations
0709 13:03:40.222141 (+  1383us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:40.222223 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:40.222276 (+    53us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:03:40.251192 (+ 28916us) tablet.cc:701] Row locks acquired
0709 13:03:40.253186 (+  1994us) write_op.cc:260] PREPARE: finished
0709 13:03:40.262377 (+  9191us) write_op.cc:270] Start()
0709 13:03:40.266040 (+  3663us) write_op.cc:276] Timestamp: P: 1783602220262319 usec, L: 0
0709 13:03:40.267719 (+  1679us) op_driver.cc:348] REPLICATION: starting
0709 13:03:40.308849 (+ 41130us) log.cc:844] Serialized 3601 byte log entry
0709 13:03:40.484204 (+175355us) op_driver.cc:464] REPLICATION: finished
0709 13:03:40.633249 (+149045us) write_op.cc:301] APPLY: starting
0709 13:03:40.641245 (+  7996us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:40.893271 (+252026us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:40.893390 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:40.901684 (+  8294us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:40.901922 (+   238us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:03:40.901966 (+    44us) write_op.cc:312] APPLY: finished
0709 13:03:40.902239 (+   273us) log.cc:844] Serialized 89 byte log entry
0709 13:03:40.903042 (+   803us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:40.903173 (+   131us) write_op.cc:454] Released schema lock
0709 13:03:40.903222 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:40.923750 (+ 20528us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:40.923780 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":27639,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":137834,"apply.run_cpu_time_us":13826,"apply.run_wall_time_us":299541,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41747,"num_ops":9,"prepare.queue_time_us":87923,"prepare.run_cpu_time_us":5588,"prepare.run_wall_time_us":112047,"replication_time_us":216242,"thread_start_us":134008,"threads_started":2}]]}
I20260709 13:03:41.028079  1482 catalog_manager.cc:5697] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 19 to 22. New cstate: current_term: 22 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:41.060716  8715 consensus_queue.cc:1048] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:41.060516  1482 catalog_manager.cc:5697] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 14 to 18, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 18 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:03:41.062372  1482 catalog_manager.cc:5697] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 11 to 13, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 13 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:03:41.067210  1666 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 21.
I20260709 13:03:41.068027  1482 catalog_manager.cc:5697] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:41.069295  8288 raft_consensus.cc:2749] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:03:41.072750  1556 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:41.073549  8538 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:41.074097  8538 raft_consensus.cc:697] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 21 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:41.075060  8538 consensus_queue.cc:237] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:41.087880  1482 catalog_manager.cc:5697] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 11 to 19. New cstate: current_term: 19 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:41.090408  1482 catalog_manager.cc:5697] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 14 to 16, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 16 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:03:41.114058  1482 catalog_manager.cc:5697] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 14 to 15, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 15 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:41.115830  1482 catalog_manager.cc:5697] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:41.137773  8748 tablet_bootstrap.cc:492] T c03a2285eaff45a6a236c5eae38fb06f P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:03:41.101795  8785 tablet_copy_client.cc:806] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:41.147931  8785 tablet_copy_client.cc:670] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:41.151104  1482 catalog_manager.cc:5697] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:41.152086  8748 tablet_bootstrap.cc:492] T c03a2285eaff45a6a236c5eae38fb06f P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap complete.
I20260709 13:03:41.153188  8785 tablet_copy_client.cc:538] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:41.167070  8748 ts_tablet_manager.cc:1403] T c03a2285eaff45a6a236c5eae38fb06f P 7e839e91a1314c2f9a99b25b17c916a6: Time spent bootstrapping tablet: real 0.862s	user 0.057s	sys 0.020s
I20260709 13:03:41.185159  1482 catalog_manager.cc:5697] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:41.205452   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:41.205029  1482 catalog_manager.cc:5697] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:41.206674  1482 catalog_manager.cc:5697] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 11 to 17. New cstate: current_term: 17 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:41.208213  1482 catalog_manager.cc:5697] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 22 to 25, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 25 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:41.227639  1482 catalog_manager.cc:5697] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:41.235106  8748 raft_consensus.cc:359] T c03a2285eaff45a6a236c5eae38fb06f P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:41.236435  8748 raft_consensus.cc:740] T c03a2285eaff45a6a236c5eae38fb06f P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Initialized, Role: LEARNER
I20260709 13:03:41.246845  8785 tablet_bootstrap.cc:492] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap starting.
I20260709 13:03:41.248500  8748 consensus_queue.cc:260] T c03a2285eaff45a6a236c5eae38fb06f P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:03:41.263538  8748 ts_tablet_manager.cc:1434] T c03a2285eaff45a6a236c5eae38fb06f P 7e839e91a1314c2f9a99b25b17c916a6: Time spent starting tablet: real 0.060s	user 0.003s	sys 0.006s
I20260709 13:03:41.229362  1482 catalog_manager.cc:5697] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:41.305420  1601 tablet_copy_service.cc:342] P 6d4de2ce0683442498244b9529127f91: Request end of tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-c03a2285eaff45a6a236c5eae38fb06f received from {username='slave'} at 127.0.0.1:46836
I20260709 13:03:41.306658  1601 tablet_copy_service.cc:434] P 6d4de2ce0683442498244b9529127f91: ending tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-c03a2285eaff45a6a236c5eae38fb06f on tablet c03a2285eaff45a6a236c5eae38fb06f with peer 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:41.309000  1482 catalog_manager.cc:5697] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 14 to 19, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 19 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:03:41.357580  1482 catalog_manager.cc:5697] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 13 to 17, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 17 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:03:41.360589  1482 catalog_manager.cc:5697] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:41.422302  2537 raft_consensus.cc:1217] T c03a2285eaff45a6a236c5eae38fb06f P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.12->[18.13-18.13]   Dedup: 18.13->[]
I20260709 13:03:41.443517  2537 raft_consensus.cc:2955] T c03a2285eaff45a6a236c5eae38fb06f P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 LEARNER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:03:41.484557  1740 raft_consensus.cc:1275] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:03:41.488584  8288 consensus_queue.cc:1048] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:03:41.546208  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 115477us
I20260709 13:03:41.566056  1482 catalog_manager.cc:5697] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 6 to 19, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 19 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:41.569832  1482 catalog_manager.cc:5697] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:41.572053  1482 catalog_manager.cc:5697] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:41.641214  1704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 170652us
I20260709 13:03:41.664458  1482 catalog_manager.cc:5697] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:41.680572  1482 catalog_manager.cc:5697] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 19 to 22, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 22 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:03:41.682297  1482 catalog_manager.cc:5697] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:03:41.692044  1667 raft_consensus.cc:1275] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:03:41.744441  8718 consensus_queue.cc:1048] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:03:41.749291  1585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:03:41.750136  1585 raft_consensus.cc:606] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:41.683753  1482 catalog_manager.cc:5697] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 18 to 22, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 22 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:03:41.794643  1482 catalog_manager.cc:5697] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 17 to 21. New cstate: current_term: 21 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:41.815837  1590 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:03:41.816486  1590 raft_consensus.cc:606] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:41.816849  1590 raft_consensus.cc:614] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:41.823678  1585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:03:41.824270  1585 raft_consensus.cc:606] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:41.824609  1585 raft_consensus.cc:614] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:41.832930  1589 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:03:41.833820  1589 raft_consensus.cc:606] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 22 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:41.850265  1590 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:03:41.851032  1590 raft_consensus.cc:606] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 26 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:41.858789   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:41.862088   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:41.864954  1482 catalog_manager.cc:5697] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 11 to 17. New cstate: current_term: 17 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:41.874629  1482 catalog_manager.cc:5697] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 17 to 20, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 20 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:03:41.907234  8818 raft_consensus.cc:993] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:03:41.908629  8802 raft_consensus.cc:1081] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 22 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:03:41.916432  1660 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39146
I20260709 13:03:41.918181  1660 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:41.918651  1660 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:41.950045  1660 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:41.945370  1482 catalog_manager.cc:5697] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 20 to 23, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 23 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:03:41.970643  1482 catalog_manager.cc:5697] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:42.002624  1660 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 23 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:42.011822  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:42.012482  1732 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:42.021505  1590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:42.022260  1590 raft_consensus.cc:3055] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:03:42.021785  8818 raft_consensus.cc:1064] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91: attempting to promote NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 to VOTER
I20260709 13:03:42.023537  1590 raft_consensus.cc:740] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:42.024500  1590 consensus_queue.cc:260] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:42.026095  1590 raft_consensus.cc:3060] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:42.031286  1732 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 23.
I20260709 13:03:42.040489  8785 tablet_bootstrap.cc:492] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=1 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:42.043926  8818 consensus_queue.cc:237] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 11, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:42.048650  8802 raft_consensus.cc:993] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:03:42.068186  1633 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:42.079937  8798 raft_consensus.cc:2804] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:03:42.080518  8798 raft_consensus.cc:697] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 23 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:42.081470  8798 consensus_queue.cc:237] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:42.084649  8815 raft_consensus.cc:1081] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Signalling peer 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:03:42.095986  8785 tablet_bootstrap.cc:492] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap complete.
I20260709 13:03:42.096243  1737 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:43678
I20260709 13:03:42.096868  1737 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:42.097208  8785 ts_tablet_manager.cc:1403] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent bootstrapping tablet: real 0.851s	user 0.059s	sys 0.011s
I20260709 13:03:42.097237  1737 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:42.124433  8785 raft_consensus.cc:359] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:03:42.125541  8785 raft_consensus.cc:740] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Initialized, Role: LEARNER
I20260709 13:03:42.126932  8785 consensus_queue.cc:260] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:03:42.132141  1590 raft_consensus.cc:2468] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 23.
I20260709 13:03:42.132133  8785 ts_tablet_manager.cc:1434] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:03:42.154692  8802 raft_consensus.cc:993] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:03:42.182358  8802 raft_consensus.cc:1081] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 26 LEADER]: Signalling peer 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:03:42.184412  1601 tablet_copy_service.cc:342] P 6d4de2ce0683442498244b9529127f91: Request end of tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-ef1be054223a4d3f90725c570db24bf5 received from {username='slave'} at 127.0.0.1:46836
I20260709 13:03:42.184973  1601 tablet_copy_service.cc:434] P 6d4de2ce0683442498244b9529127f91: ending tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-ef1be054223a4d3f90725c570db24bf5 on tablet ef1be054223a4d3f90725c570db24bf5 with peer 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:42.164043  1737 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:42.187577  1737 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:42.191250  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:42.191797  1666 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:42.198698  1737 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:43678
I20260709 13:03:42.199299  1737 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 26 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:42.199656  1737 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:03:42.255226  2537 raft_consensus.cc:1275] T c03a2285eaff45a6a236c5eae38fb06f P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 LEARNER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:03:42.256328  1666 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 18.
I20260709 13:03:42.259249  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:42.260613  1589 raft_consensus.cc:3055] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:42.261612  1662 raft_consensus.cc:1275] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:03:42.260908  1589 raft_consensus.cc:740] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:42.265555  1732 raft_consensus.cc:1275] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:03:42.276818  1737 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 27 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:42.261737  8802 consensus_queue.cc:1048] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 13:03:42.265054  1589 consensus_queue.cc:260] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:42.285203  1589 raft_consensus.cc:3060] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:42.280303  8815 consensus_queue.cc:1048] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 13:03:42.291755  1705 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:42.300293  1737 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 27 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:42.302343  8788 raft_consensus.cc:2804] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:42.302991  8788 raft_consensus.cc:697] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 18 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:42.304047  8788 consensus_queue.cc:237] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:42.320641  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:42.321388  1667 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:03:42.338160  8738 consensus_queue.cc:1048] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 13:03:42.339587  1584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:42.340245  1584 raft_consensus.cc:3055] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:03:42.340608  1584 raft_consensus.cc:740] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:42.341606  1584 consensus_queue.cc:260] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:42.343333  1584 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:03:42.404280  8817 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:42.405011  8817 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:42.411363  1589 raft_consensus.cc:2468] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 18.
I20260709 13:03:42.411729  1667 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 27.
I20260709 13:03:42.413303  1705 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:42.422415  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91" is_pre_election: true
I20260709 13:03:42.423097  8715 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:03:42.420728  8288 raft_consensus.cc:2955] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index 13 to 14, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:42.424052  8715 raft_consensus.cc:697] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 27 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:42.418669  8817 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:42.426260  1589 raft_consensus.cc:2393] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 23: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:42.570518  8715 consensus_queue.cc:237] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:42.579233  1584 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 27.
I20260709 13:03:42.590400  1667 raft_consensus.cc:2955] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:42.599638  1732 raft_consensus.cc:1275] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:03:42.627027  1584 raft_consensus.cc:1275] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:03:42.613884  8798 consensus_queue.cc:1048] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.026s
W20260709 13:03:42.644510  8838 log.cc:927] Time spent T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da: Append to log took a long time: real 0.125s	user 0.003s	sys 0.000s
I20260709 13:03:42.660816  8834 consensus_queue.cc:1048] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.011s
W20260709 13:03:42.718397  8832 log.cc:927] Time spent T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d: Append to log took a long time: real 0.118s	user 0.000s	sys 0.004s
W20260709 13:03:42.751917  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 338738us
I20260709 13:03:42.755961  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:42.757411  1667 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 23.
I20260709 13:03:42.779318  2537 raft_consensus.cc:1217] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [term 19 LEARNER]: Deduplicated request from leader. Original: 19.12->[19.13-19.13]   Dedup: 19.13->[]
I20260709 13:03:42.788340  2554 raft_consensus.cc:2955] T c03a2285eaff45a6a236c5eae38fb06f P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:42.805689  1665 raft_consensus.cc:1275] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:03:42.812850  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 81457.1us
I20260709 13:03:42.863876   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:42.871621  1592 raft_consensus.cc:1275] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:03:42.883543  1737 raft_consensus.cc:2955] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:42.892436  1705 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:42.892710  8817 consensus_queue.cc:1048] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:42.893472  8715 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:42.894024  8715 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:42.894470  8715 raft_consensus.cc:3060] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:42.901314  8788 consensus_queue.cc:1048] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:42.938688  8715 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:43.047906  1589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:43.048767  1589 raft_consensus.cc:2393] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 23: Already voted for candidate 6d4de2ce0683442498244b9529127f91 in this term.
I20260709 13:03:43.066841  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:43.075013  1584 raft_consensus.cc:1275] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 27 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 13:03:43.076757  8840 consensus_queue.cc:1048] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:03:43.084159  1662 raft_consensus.cc:2468] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 23.
I20260709 13:03:43.085570  1705 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:43.086442  8840 raft_consensus.cc:2804] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:03:43.087446  8840 raft_consensus.cc:697] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 23 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:43.091924  8840 consensus_queue.cc:237] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:43.087570  8715 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:43.148355  8802 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.148926  8802 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:43.151978  8802 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:43.154222  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:43.155167  1665 raft_consensus.cc:2410] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4de2ce0683442498244b9529127f91 for term 24 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
I20260709 13:03:43.155784  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:43.158304  1556 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:43.160611  8846 raft_consensus.cc:2749] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:43.163414  1665 raft_consensus.cc:1275] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 27 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 13:03:43.164942  8840 consensus_queue.cc:1048] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:03:43.179493  8848 raft_consensus.cc:1064] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91: attempting to promote NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 to VOTER
W20260709 13:03:43.203979  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 44509.3us
I20260709 13:03:43.203089  8848 consensus_queue.cc:237] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 11, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:43.359877  1482 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55132 (request call id 311) took 3985 ms. Trace:
I20260709 13:03:43.360102  2554 raft_consensus.cc:1275] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [term 19 LEARNER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:03:43.361635  1740 raft_consensus.cc:1275] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:03:43.361945  8846 consensus_queue.cc:1048] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:43.366457  1665 raft_consensus.cc:1275] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:03:43.367476  8846 consensus_queue.cc:1048] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:43.368462  8818 consensus_queue.cc:1048] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:43.360410  1482 rpcz_store.cc:276] 0709 13:03:39.374491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.374976 (+   485us) service_pool.cc:224] Handling call
0709 13:03:43.359733 (+3984757us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:42.271438 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:42.286343 (+ 14905us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:42.292272 (+  5929us) write_op.cc:435] Acquired schema lock
0709 13:03:42.294494 (+  2222us) tablet.cc:662] Decoding operations
0709 13:03:42.386179 (+ 91685us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:42.386269 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:42.386313 (+    44us) tablet.cc:685] Acquiring locks for 30 operations
0709 13:03:42.388855 (+  2542us) tablet.cc:701] Row locks acquired
0709 13:03:42.388904 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:03:42.410587 (+ 21683us) write_op.cc:270] Start()
0709 13:03:42.418541 (+  7954us) write_op.cc:276] Timestamp: P: 1783602222389009 usec, L: 0
0709 13:03:42.419905 (+  1364us) op_driver.cc:348] REPLICATION: starting
0709 13:03:42.424081 (+  4176us) log.cc:844] Serialized 11781 byte log entry
0709 13:03:42.828621 (+404540us) op_driver.cc:464] REPLICATION: finished
0709 13:03:42.898446 (+ 69825us) write_op.cc:301] APPLY: starting
0709 13:03:42.898551 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:43.063823 (+165272us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:43.063940 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:43.163374 (+ 99434us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:43.163844 (+   470us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=60,key_file_lookups=60,delta_file_lookups=60,mrs_lookups=0
0709 13:03:43.163908 (+    64us) write_op.cc:312] APPLY: finished
0709 13:03:43.164487 (+   579us) log.cc:844] Serialized 260 byte log entry
0709 13:03:43.164691 (+   204us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:43.164930 (+   239us) write_op.cc:454] Released schema lock
0709 13:03:43.165032 (+   102us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:43.165575 (+   543us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:43.165603 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":153195,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":69484,"apply.run_cpu_time_us":40508,"apply.run_wall_time_us":267111,"cfile_cache_hit":122,"cfile_cache_hit_bytes":129527,"num_ops":30,"prepare.queue_time_us":82201,"prepare.run_cpu_time_us":17245,"prepare.run_wall_time_us":259355,"raft.queue_time_us":165055,"raft.run_cpu_time_us":1469,"raft.run_wall_time_us":1470,"replication_time_us":408482,"thread_start_us":314759,"threads_started":4,"wal-append.queue_time_us":95115}]]}
I20260709 13:03:43.443073  1665 raft_consensus.cc:2955] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:43.445631  2554 raft_consensus.cc:2955] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:43.431980  8846 raft_consensus.cc:2955] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Committing config change with OpId 19.14: config changed from index 13 to 14, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:43.452211  1490 catalog_manager.cc:5697] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:03:43.493614  1740 raft_consensus.cc:2955] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:43.580653  1589 raft_consensus.cc:1275] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:03:43.591028  8715 consensus_queue.cc:1048] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 13:03:43.722184  1487 catalog_manager.cc:5697] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 12 to 13, leader changed from 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 13 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:43.791750  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 82114.4us
W20260709 13:03:43.793008  1490 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55154 (request call id 308) took 42733 ms (client timeout 15000 ms). Trace:
I20260709 13:03:43.798847  1665 raft_consensus.cc:1275] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
W20260709 13:03:43.796155  1490 rpcz_store.cc:269] 0709 13:03:01.057837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.058176 (+   339us) service_pool.cc:224] Handling call
0709 13:03:01.495977 (+437801us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b5400119254. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef9090 00007f1b80f97f3a 00007f1b86d4e1cc 00007f1b86e4c37e 00007f1b8530d2a4 00007f1b8530d232 00007f1b8530d161 00007f1b8530d0dc 00007f1b8530c392 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:03:43.790936 (+42294959us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:43.523976 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:43.537386 (+ 13410us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:43.537427 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:03:43.537449 (+    22us) tablet.cc:662] Decoding operations
0709 13:03:43.537892 (+   443us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:43.537978 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:43.538014 (+    36us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:03:43.538202 (+   188us) tablet.cc:701] Row locks acquired
0709 13:03:43.538225 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:03:43.538374 (+   149us) write_op.cc:270] Start()
0709 13:03:43.538486 (+   112us) write_op.cc:276] Timestamp: P: 1783602223538321 usec, L: 0
0709 13:03:43.538508 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:03:43.539235 (+   727us) log.cc:844] Serialized 541 byte log entry
0709 13:03:43.602971 (+ 63736us) op_driver.cc:464] REPLICATION: finished
0709 13:03:43.603353 (+   382us) write_op.cc:301] APPLY: starting
0709 13:03:43.603445 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:43.604426 (+   981us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:43.604529 (+   103us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:43.607979 (+  3450us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:43.608152 (+   173us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:03:43.608203 (+    51us) write_op.cc:312] APPLY: finished
0709 13:03:43.608410 (+   207us) log.cc:844] Serialized 25 byte log entry
0709 13:03:43.608606 (+   196us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:43.608695 (+    89us) write_op.cc:454] Released schema lock
0709 13:03:43.608748 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:43.618739 (+  9991us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:43.618770 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":52,"spinlock_wait_cycles":320208640,"child_traces":[["op",{"apply.queue_time_us":107,"apply.run_cpu_time_us":3222,"apply.run_wall_time_us":15335,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4180,"num_ops":1,"prepare.queue_time_us":11862,"prepare.run_cpu_time_us":2845,"prepare.run_wall_time_us":15590,"replication_time_us":64297,"thread_start_us":12464,"threads_started":1}]]}
I20260709 13:03:43.816727  8840 consensus_queue.cc:1048] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 13:03:43.873517  1482 catalog_manager.cc:5697] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 17 to 18, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 18 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:03:43.875069  1482 catalog_manager.cc:5697] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 14 to 21, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 21 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:03:43.876308  1482 catalog_manager.cc:5697] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 19 to 20, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 20 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
W20260709 13:03:43.889451  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 82934us
I20260709 13:03:43.903338  1482 catalog_manager.cc:5697] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 18 to 20, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 20 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:03:43.908018  1482 catalog_manager.cc:5697] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 22 to 23, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 23 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:03:43.909677  1482 catalog_manager.cc:5697] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 reported cstate change: config changed from index -1 to 13, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added, now has a pending config: VOTER 6d4de2ce0683442498244b9529127f91 (127.0.107.193), VOTER 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194), VOTER 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195), VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 19 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:43.912290  1482 catalog_manager.cc:5697] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 reported cstate change: config changed from index -1 to 14, VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New cstate: current_term: 18 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:43.914424  1482 catalog_manager.cc:5697] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 17 to 18, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 18 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:03:43.915714  1482 catalog_manager.cc:5697] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 17 to 23, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 23 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:03:43.949994  1482 catalog_manager.cc:5697] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:43.961328  1482 catalog_manager.cc:5697] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 26 to 27, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 27 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:03:43.975100  1482 catalog_manager.cc:5697] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:03:43.981745  1482 catalog_manager.cc:5697] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 10 to 14, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 14 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:03:43.983215  1482 catalog_manager.cc:5697] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 13 to 19. New cstate: current_term: 19 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:44.043623  1487 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55138 (request call id 321) took 32126 ms (client timeout 15000 ms). Trace:
W20260709 13:03:44.044111  1487 rpcz_store.cc:269] 0709 13:03:11.989595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.002233 (+ 12638us) service_pool.cc:224] Handling call
0709 13:03:12.432485 (+430252us) spinlock_profiling.cc:243] Waited 37.1 ms on lock 0x7b5400119254. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b80ef9090 00007f1b80f97f3a 00007f1b86d4e1cc 00007f1b86e4c37e 00007f1b8530d2a4 00007f1b8530d232 00007f1b8530d161 00007f1b8530d0dc 00007f1b8530c392 00007f1b7f2ca48c 00007f1b7f2c98c6
0709 13:03:44.043526 (+31611041us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:43.824069 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:43.824585 (+   516us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:43.824618 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:03:43.824648 (+    30us) tablet.cc:662] Decoding operations
0709 13:03:43.825001 (+   353us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:43.825053 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:43.836257 (+ 11204us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:03:43.843180 (+  6923us) tablet.cc:701] Row locks acquired
0709 13:03:43.843206 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:03:43.843365 (+   159us) write_op.cc:270] Start()
0709 13:03:43.843493 (+   128us) write_op.cc:276] Timestamp: P: 1783602223843315 usec, L: 0
0709 13:03:43.843518 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:03:43.844084 (+   566us) log.cc:844] Serialized 536 byte log entry
0709 13:03:43.846221 (+  2137us) op_driver.cc:464] REPLICATION: finished
0709 13:03:43.846720 (+   499us) write_op.cc:301] APPLY: starting
0709 13:03:43.846937 (+   217us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:43.847902 (+   965us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:43.848006 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:43.848701 (+   695us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:43.848860 (+   159us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:03:43.848908 (+    48us) write_op.cc:312] APPLY: finished
0709 13:03:43.849183 (+   275us) log.cc:844] Serialized 25 byte log entry
0709 13:03:43.849345 (+   162us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:43.849418 (+    73us) write_op.cc:454] Released schema lock
0709 13:03:43.849460 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:43.849799 (+   339us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:43.849827 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":660918,"reported_tablets":51,"spinlock_wait_cycles":85287296,"child_traces":[["op",{"apply.queue_time_us":253,"apply.run_cpu_time_us":3018,"apply.run_wall_time_us":3046,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4180,"num_ops":1,"prepare.queue_time_us":131,"prepare.run_cpu_time_us":2614,"prepare.run_wall_time_us":20347,"replication_time_us":2514}]]}
I20260709 13:03:44.104080   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:44.202446  1587 consensus_queue.cc:237] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:44.268265  2537 raft_consensus.cc:1275] T c03a2285eaff45a6a236c5eae38fb06f P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:03:44.271963  8818 consensus_queue.cc:1048] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:03:44.236418  1484 catalog_manager.cc:5697] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 11 to 12, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 12 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:44.280572  1484 catalog_manager.cc:5697] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 12 to 14, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 14 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:44.315402  1740 raft_consensus.cc:1275] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:03:44.322795  8846 consensus_queue.cc:1048] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 13:03:44.323307  1484 catalog_manager.cc:5697] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:44.340534  1484 catalog_manager.cc:5697] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 13 to 17, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 17 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:44.342725  1484 catalog_manager.cc:5697] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 18 to 21, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 21 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:44.358210  8846 raft_consensus.cc:2955] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 18 LEADER]: Committing config change with OpId 18.15: config changed from index 14 to 15, VOTER 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:44.376088  1734 raft_consensus.cc:2955] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Committing config change with OpId 18.15: config changed from index 14 to 15, VOTER 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:44.383980  2537 raft_consensus.cc:2955] T c03a2285eaff45a6a236c5eae38fb06f P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Committing config change with OpId 18.15: config changed from index 14 to 15, VOTER 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:44.423655  1477 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c03a2285eaff45a6a236c5eae38fb06f with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:44.432523  1482 catalog_manager.cc:5697] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:03:44.434305  1482 catalog_manager.cc:5697] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 reported cstate change: config changed from index 13 to 14, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 6d4de2ce0683442498244b9529127f91 (127.0.107.193), VOTER 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194), VOTER 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195), VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 19 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:44.445408  1587 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:03:44.446090  1587 raft_consensus.cc:606] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:44.461656  1587 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:03:44.462321  1587 raft_consensus.cc:606] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:44.475049  1587 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:03:44.475694  1587 raft_consensus.cc:606] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:44.488276  1592 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:03:44.488972  1592 raft_consensus.cc:606] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 21 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:44.493683  1592 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
mode: GRACEFUL
new_leader_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:47714
I20260709 13:03:44.494349  1592 raft_consensus.cc:606] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Received request to transfer leadership to TS 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:44.496318   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:44.498358   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:44.522195  1587 consensus_queue.cc:237] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:44.550318  2537 raft_consensus.cc:1275] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [term 19 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:03:44.552034  8818 consensus_queue.cc:1048] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:03:44.558419  1665 raft_consensus.cc:1275] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:03:44.560312  8855 consensus_queue.cc:1048] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:03:44.578402  1484 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55154 (request call id 310) took 6430 ms. Trace:
I20260709 13:03:44.584790  8818 raft_consensus.cc:993] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:03:44.586910  8818 raft_consensus.cc:1081] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:03:44.589279  8846 raft_consensus.cc:993] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:03:44.589890  8846 raft_consensus.cc:1081] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:03:44.592531  1665 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39146
I20260709 13:03:44.593178  1665 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:44.593559  1665 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:44.588042  1484 rpcz_store.cc:276] 0709 13:03:38.148368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.149223 (+   855us) service_pool.cc:224] Handling call
0709 13:03:44.578300 (+6429077us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:44.352565 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:44.353108 (+   543us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:44.353142 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:03:44.353157 (+    15us) tablet.cc:662] Decoding operations
0709 13:03:44.353803 (+   646us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:44.353875 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:44.353905 (+    30us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:03:44.354445 (+   540us) tablet.cc:701] Row locks acquired
0709 13:03:44.354466 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:03:44.354646 (+   180us) write_op.cc:270] Start()
0709 13:03:44.354845 (+   199us) write_op.cc:276] Timestamp: P: 1783602224354567 usec, L: 0
0709 13:03:44.354869 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:03:44.355504 (+   635us) log.cc:844] Serialized 2074 byte log entry
0709 13:03:44.361434 (+  5930us) op_driver.cc:464] REPLICATION: finished
0709 13:03:44.362724 (+  1290us) write_op.cc:301] APPLY: starting
0709 13:03:44.362803 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:44.371304 (+  8501us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:44.371390 (+    86us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:44.374244 (+  2854us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:44.374426 (+   182us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:03:44.374469 (+    43us) write_op.cc:312] APPLY: finished
0709 13:03:44.374701 (+   232us) log.cc:844] Serialized 57 byte log entry
0709 13:03:44.389253 (+ 14552us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:44.389365 (+   112us) write_op.cc:454] Released schema lock
0709 13:03:44.389416 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:44.389845 (+   429us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:44.389874 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":28736,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":1042,"apply.run_cpu_time_us":7023,"apply.run_wall_time_us":27081,"cfile_cache_hit":20,"cfile_cache_hit_bytes":20900,"num_ops":5,"prepare.queue_time_us":989,"prepare.run_cpu_time_us":3228,"prepare.run_wall_time_us":7223,"replication_time_us":6411}]]}
I20260709 13:03:44.606211  1660 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39146
I20260709 13:03:44.605429  8848 raft_consensus.cc:2955] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Committing config change with OpId 19.15: config changed from index 14 to 15, VOTER 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:44.607290  1660 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:44.618626  1660 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:44.614719  1662 raft_consensus.cc:2955] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, VOTER 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:44.630019  1477 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ef1be054223a4d3f90725c570db24bf5 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:44.656764  1660 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:44.665216  1660 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:44.667672  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:44.669117  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:44.671278  1740 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:44.677939  1587 raft_consensus.cc:3055] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:44.678575  1587 raft_consensus.cc:740] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:44.679538  1587 consensus_queue.cc:260] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:44.690644  1587 raft_consensus.cc:3060] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:44.693136  1740 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 15.
I20260709 13:03:44.698904  1633 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:44.701719  8798 raft_consensus.cc:2804] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:44.707640  8818 raft_consensus.cc:993] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:03:44.708350  8818 raft_consensus.cc:1081] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:03:44.710276  1660 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39146
I20260709 13:03:44.710984  1660 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:44.711486  1660 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:44.729295  8798 raft_consensus.cc:697] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 15 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:44.731263  1665 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:44.732195  8798 consensus_queue.cc:237] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:44.733991  1482 catalog_manager.cc:5697] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 reported cstate change: config changed from index 14 to 15, VOTER 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) evicted. New cstate: current_term: 18 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:44.748494  1665 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:44.749806  1587 raft_consensus.cc:2468] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 15.
I20260709 13:03:44.751022  2537 raft_consensus.cc:2955] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, VOTER 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:44.754560  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:44.755293  1587 raft_consensus.cc:3055] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:44.755663  1587 raft_consensus.cc:740] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:44.756481  1660 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:44.759512  1587 consensus_queue.cc:260] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:44.763626  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:44.764199  1740 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:44.768515  1660 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:44.777523  1587 raft_consensus.cc:3060] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:44.779640  1740 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 14.
W20260709 13:03:44.819947  1489 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55138 (request call id 320) took 55189 ms (client timeout 15000 ms). Trace:
W20260709 13:03:44.820580  1489 rpcz_store.cc:269] 0709 13:02:49.630475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.638012 (+  7537us) service_pool.cc:224] Handling call
0709 13:03:44.819698 (+55181686us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":116101,"reported_tablets":51}
I20260709 13:03:44.823521  1587 raft_consensus.cc:2468] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 14.
W20260709 13:03:44.850960  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 92069.2us
I20260709 13:03:44.880028  8898 raft_consensus.cc:993] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:03:44.880535  8898 raft_consensus.cc:1081] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Signalling peer 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:03:44.883297  1734 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:43678
I20260709 13:03:44.883821  1734 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:44.884155  1734 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:44.888181  8883 raft_consensus.cc:993] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91: : Instructing follower 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:03:44.888732  8883 raft_consensus.cc:1081] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 21 LEADER]: Signalling peer 5ced62816f8545cd9b63a27e9055e42d to start an election
I20260709 13:03:44.895793  1734 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:44.897786  1734 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:44.911535  1482 catalog_manager.cc:5697] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 reported cstate change: config changed from index 14 to 15, VOTER 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) evicted. New cstate: current_term: 19 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:03:44.952771  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 189814us
I20260709 13:03:44.964015  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:44.964663  1587 raft_consensus.cc:3055] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:44.964988  1587 raft_consensus.cc:740] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:44.965775  1587 consensus_queue.cc:260] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:44.968705  1633 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:44.969473  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:44.969631  8894 raft_consensus.cc:2804] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:44.970126  1665 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:44.970254  8894 raft_consensus.cc:697] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 14 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:44.971274  8894 consensus_queue.cc:237] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:44.982010  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:44.982687  1734 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:44.986538  8855 consensus_queue.cc:1175] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5ced62816f8545cd9b63a27e9055e42d" responder_term: 19 status { last_received { term: 19 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 19 index: 11 } }
I20260709 13:03:44.989120  1587 raft_consensus.cc:3060] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:44.998513  1587 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 20.
I20260709 13:03:45.002173  1665 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 20.
I20260709 13:03:45.010308  1734 raft_consensus.cc:2468] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 20.
I20260709 13:03:45.020885  1705 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:45.028676  1587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:45.029615  1587 raft_consensus.cc:3055] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:45.030027  1587 raft_consensus.cc:740] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:45.031009  1587 consensus_queue.cc:260] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:45.037205  8896 raft_consensus.cc:2804] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:45.044430  8896 raft_consensus.cc:697] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 20 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:45.044956  1734 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
 from {username='slave'} at 127.0.0.1:43678
I20260709 13:03:45.045677  1734 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:45.045456  8896 consensus_queue.cc:237] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:45.046084  1734 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:03:45.048593  1488 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55138 (request call id 322) took 12797 ms (client timeout 15000 ms). Trace:
I20260709 13:03:45.061847  1734 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:45.064489  1587 raft_consensus.cc:3060] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:45.059907  1488 rpcz_store.cc:269] 0709 13:03:32.251072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:32.258171 (+  7099us) service_pool.cc:224] Handling call
0709 13:03:45.048351 (+12790180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11551,"reported_tablets":51}
W20260709 13:03:45.087913  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 68850.8us
I20260709 13:03:45.089109  1633 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:45.089947  8904 raft_consensus.cc:2804] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:45.090494  8904 raft_consensus.cc:697] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 20 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:45.088289  1734 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:45.091581  8904 consensus_queue.cc:237] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:45.094265  1587 raft_consensus.cc:2468] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 20.
I20260709 13:03:45.099290  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:45.100144  1662 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:45.110668  1662 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 22.
W20260709 13:03:45.193506  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 94694.7us
I20260709 13:03:45.195439  1705 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:45.198323  8840 raft_consensus.cc:2804] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:45.228991  8840 raft_consensus.cc:697] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 22 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:45.230108  8840 consensus_queue.cc:237] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:45.253839  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 45791.6us
I20260709 13:03:45.258181  1650 tablet_service.cc:1558] Processing DeleteTablet for tablet c03a2285eaff45a6a236c5eae38fb06f with delete_type TABLET_DATA_TOMBSTONED (TS 5bb87fe07da2414e84ee578c3b176ede not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:43146
I20260709 13:03:45.286371  1725 tablet_service.cc:1558] Processing DeleteTablet for tablet ef1be054223a4d3f90725c570db24bf5 with delete_type TABLET_DATA_TOMBSTONED (TS 5ced62816f8545cd9b63a27e9055e42d not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:35756
I20260709 13:03:45.310633  1584 raft_consensus.cc:1275] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:45.315033  8913 consensus_queue.cc:1048] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:45.330792  1736 raft_consensus.cc:1275] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:45.331975  1662 raft_consensus.cc:1240] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Rejecting Update request from peer 6d4de2ce0683442498244b9529127f91 for earlier term 21. Current term is 22. Ops: []
I20260709 13:03:45.333871  8920 consensus_queue.cc:1048] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:45.333911  8906 consensus_queue.cc:1059] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:45.335176  8906 raft_consensus.cc:3055] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:03:45.335495  8906 raft_consensus.cc:740] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:45.336304  8906 consensus_queue.cc:260] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:45.337771  8906 raft_consensus.cc:3060] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:03:45.358549  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 56243.5us
I20260709 13:03:45.364894  8925 tablet_replica.cc:333] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:03:45.364923  8923 tablet_replica.cc:333] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:45.366629  8925 raft_consensus.cc:2243] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:45.372262  1485 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51168 (request call id 138) took 4391 ms. Trace:
I20260709 13:03:45.384078  1485 rpcz_store.cc:276] 0709 13:03:40.981296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.981473 (+   177us) service_pool.cc:224] Handling call
0709 13:03:45.372066 (+4390593us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63629,"reported_tablets":23}
I20260709 13:03:45.396353  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:45.406740  1589 raft_consensus.cc:1275] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:45.429147  8894 consensus_queue.cc:1048] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:03:45.433216  8923 raft_consensus.cc:2243] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:45.452397  1484 catalog_manager.cc:5697] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 19 to 20, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 20 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:45.454835  1484 catalog_manager.cc:5697] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 21 to 22, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 22 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:45.456168  1736 raft_consensus.cc:1275] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:45.456503  1484 catalog_manager.cc:5697] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 14 to 15, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 15 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } }
I20260709 13:03:45.469537  8904 consensus_queue.cc:1048] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:45.470448  8925 raft_consensus.cc:2272] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:45.484448  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 76248.6us
W20260709 13:03:45.485836  1486 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55154 (request call id 309) took 24229 ms (client timeout 15000 ms). Trace:
W20260709 13:03:45.486359  1486 rpcz_store.cc:269] 0709 13:03:21.222236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:21.223537 (+  1301us) service_pool.cc:224] Handling call
0709 13:03:45.445905 (+24222368us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27949,"reported_tablets":52,"spinlock_wait_cycles":14208}
I20260709 13:03:45.499418   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:45.502662  8925 ts_tablet_manager.cc:1916] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:45.541270  8923 raft_consensus.cc:2272] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:45.544991  8923 ts_tablet_manager.cc:1916] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:45.589550  1661 raft_consensus.cc:1275] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:03:45.594167  1592 raft_consensus.cc:2468] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 22.
W20260709 13:03:45.609493  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 89673.5us
I20260709 13:03:45.636860  8840 consensus_queue.cc:1048] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:45.657959  1592 raft_consensus.cc:1275] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:03:45.692282  1662 raft_consensus.cc:1275] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:03:45.686570  8917 consensus_queue.cc:1048] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 13:03:45.720319  8896 consensus_queue.cc:1048] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:45.721604  8923 ts_tablet_manager.cc:1929] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.14
I20260709 13:03:45.724265  8923 log.cc:1199] T c03a2285eaff45a6a236c5eae38fb06f P 5bb87fe07da2414e84ee578c3b176ede: Deleting WAL directory at /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-1-root/wals/c03a2285eaff45a6a236c5eae38fb06f
I20260709 13:03:45.729390  1734 raft_consensus.cc:1275] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:03:45.732870  1475 catalog_manager.cc:5028] TS 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): tablet c03a2285eaff45a6a236c5eae38fb06f (table test-workload [id=8a8e3153ff4e476f890a0820215f177a]) successfully deleted
W20260709 13:03:45.738875  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 54419.1us
I20260709 13:03:45.736251  8925 ts_tablet_manager.cc:1929] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.14
I20260709 13:03:45.753907  8925 log.cc:1199] T ef1be054223a4d3f90725c570db24bf5 P 5ced62816f8545cd9b63a27e9055e42d: Deleting WAL directory at /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601979855482-431-0/minicluster-data/ts-2-root/wals/ef1be054223a4d3f90725c570db24bf5
I20260709 13:03:45.767043  1477 catalog_manager.cc:5028] TS 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): tablet ef1be054223a4d3f90725c570db24bf5 (table test-workload [id=8a8e3153ff4e476f890a0820215f177a]) successfully deleted
I20260709 13:03:45.778802  8920 consensus_queue.cc:1048] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:45.791482  1584 raft_consensus.cc:1275] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:03:45.830974  1584 raft_consensus.cc:1275] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:03:45.833474  8938 consensus_queue.cc:1048] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:45.839046  8798 consensus_queue.cc:1048] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:45.952651  1485 catalog_manager.cc:5697] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 19 to 20, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 20 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:46.014149  1485 catalog_manager.cc:5697] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 13 to 14, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 14 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:46.244553  1650 tablet_service.cc:1558] Processing DeleteTablet for tablet c03a2285eaff45a6a236c5eae38fb06f with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 14 (current committed config index is 15)) from {username='slave'} at 127.0.0.1:43146
I20260709 13:03:46.277410  1475 catalog_manager.cc:5028] TS 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): tablet c03a2285eaff45a6a236c5eae38fb06f (table test-workload [id=8a8e3153ff4e476f890a0820215f177a]) successfully deleted
I20260709 13:03:46.461369  1584 consensus_queue.cc:237] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:03:46.500072  1734 raft_consensus.cc:1275] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 25 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
W20260709 13:03:46.502880  1555 consensus_peers.cc:597] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 -> Peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157): Couldn't send request to peer 7e839e91a1314c2f9a99b25b17c916a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b51b235c777d4de2876dfd783998c83f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:46.504077  8906 consensus_queue.cc:1048] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:03:46.509759  1661 raft_consensus.cc:1275] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 25 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:03:46.513356  8906 consensus_queue.cc:1048] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:03:46.555083  8902 raft_consensus.cc:2955] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 25 LEADER]: Committing config change with OpId 25.16: config changed from index -1 to 16, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
W20260709 13:03:46.623615  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 63842us
I20260709 13:03:46.627730  1662 raft_consensus.cc:2955] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 25 FOLLOWER]: Committing config change with OpId 25.16: config changed from index -1 to 16, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:03:46.636488  1734 raft_consensus.cc:2955] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 25 FOLLOWER]: Committing config change with OpId 25.16: config changed from index -1 to 16, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:03:46.691573  1486 catalog_manager.cc:5697] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: config changed from index -1 to 16, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New cstate: current_term: 25 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:03:46.695920  1740 consensus_queue.cc:237] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:03:46.696473   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:03:46.736756  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 82098.5us
W20260709 13:03:46.788920  1704 consensus_peers.cc:597] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157): Couldn't send request to peer 7e839e91a1314c2f9a99b25b17c916a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 17b4f0abad654424ae8d47e63dbf2067. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:46.815946  1591 raft_consensus.cc:1275] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:03:46.844012  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 113079us
I20260709 13:03:46.850682  8958 consensus_queue.cc:1048] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:46.853926  1661 raft_consensus.cc:1275] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:03:46.872766  8958 consensus_queue.cc:1048] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:46.906015  1734 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:35770
I20260709 13:03:46.906721  1734 raft_consensus.cc:606] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 17 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:46.905802  8938 raft_consensus.cc:2955] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:03:46.916077  1734 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
mode: GRACEFUL
new_leader_uuid: "6d4de2ce0683442498244b9529127f91"
 from {username='slave'} at 127.0.0.1:35770
I20260709 13:03:46.916899  1734 raft_consensus.cc:606] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 20 LEADER]: Received request to transfer leadership to TS 6d4de2ce0683442498244b9529127f91
I20260709 13:03:46.916198  1589 raft_consensus.cc:2955] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:03:46.920398  1734 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1"
dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
mode: GRACEFUL
new_leader_uuid: "6d4de2ce0683442498244b9529127f91"
 from {username='slave'} at 127.0.0.1:35770
I20260709 13:03:46.921070  1734 raft_consensus.cc:606] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 27 LEADER]: Received request to transfer leadership to TS 6d4de2ce0683442498244b9529127f91
I20260709 13:03:46.925621  2554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a"
dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
mode: GRACEFUL
new_leader_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:33568
I20260709 13:03:46.926239  2554 raft_consensus.cc:606] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 LEADER]: Received request to transfer leadership to TS 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:46.928010  1661 raft_consensus.cc:2955] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:03:46.930895   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:03:46.932708   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:46.950048  1591 consensus_queue.cc:237] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:03:46.970536  1484 catalog_manager.cc:5697] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: config changed from index -1 to 13, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New cstate: current_term: 18 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:47.015740  1555 consensus_peers.cc:597] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 -> Peer 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157): Couldn't send request to peer 7e839e91a1314c2f9a99b25b17c916a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bd728f93afb447e384035fae1af6b006. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:47.016800  1661 raft_consensus.cc:1275] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:03:47.017232  1734 raft_consensus.cc:1275] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:03:47.018656  8906 consensus_queue.cc:1048] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:47.027062  8952 consensus_queue.cc:1048] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:47.053997  8916 raft_consensus.cc:993] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:03:47.054831  8916 raft_consensus.cc:1081] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 17 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:03:47.072381  1665 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:39162
I20260709 13:03:47.073004  1665 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:47.073374  1665 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:47.080711  1665 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:47.084297  8970 ts_tablet_manager.cc:933] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6: Initiating tablet copy from peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:03:47.088554  1592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "6d4de2ce0683442498244b9529127f91"
I20260709 13:03:47.090423  1592 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:47.090996  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:47.091591  1740 raft_consensus.cc:3055] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:47.091868  1740 raft_consensus.cc:740] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:47.092649  1740 consensus_queue.cc:260] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:47.096352  1740 raft_consensus.cc:3060] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:47.097033  8938 raft_consensus.cc:993] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d: : Instructing follower 6d4de2ce0683442498244b9529127f91 to start an election
I20260709 13:03:47.097594  8958 raft_consensus.cc:1081] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 20 LEADER]: Signalling peer 6d4de2ce0683442498244b9529127f91 to start an election
I20260709 13:03:47.100039  1591 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
 from {username='slave'} at 127.0.0.1:59112
I20260709 13:03:47.100661  1591 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:47.101215  1591 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:47.084335  1665 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:47.105345  1592 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 18.
I20260709 13:03:47.107270  1633 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:47.158763  8970 tablet_copy_client.cc:323] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:33325
I20260709 13:03:47.116660  1591 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:47.179401  1591 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 21 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:47.121829  8894 raft_consensus.cc:2804] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:47.180187  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:47.180855  1665 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:47.181212  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:47.181870  1736 raft_consensus.cc:3055] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:47.182178  1736 raft_consensus.cc:740] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:47.182921  1736 consensus_queue.cc:260] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:47.184182  1736 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:47.176270  1601 tablet_copy_service.cc:140] P 6d4de2ce0683442498244b9529127f91: Received BeginTabletCopySession request for tablet b51b235c777d4de2876dfd783998c83f from peer 7e839e91a1314c2f9a99b25b17c916a6 ({username='slave'} at 127.0.0.1:46836)
I20260709 13:03:47.186424  1601 tablet_copy_service.cc:161] P 6d4de2ce0683442498244b9529127f91: Beginning new tablet copy session on tablet b51b235c777d4de2876dfd783998c83f from peer 7e839e91a1314c2f9a99b25b17c916a6 at {username='slave'} at 127.0.0.1:46836: session id = 7e839e91a1314c2f9a99b25b17c916a6-b51b235c777d4de2876dfd783998c83f
I20260709 13:03:47.189826  8894 raft_consensus.cc:697] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 18 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:47.191260  8894 consensus_queue.cc:237] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:47.150758  1661 raft_consensus.cc:2955] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:03:47.127027  8938 raft_consensus.cc:993] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d: : Instructing follower 6d4de2ce0683442498244b9529127f91 to start an election
I20260709 13:03:47.206353  8958 raft_consensus.cc:1081] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 27 LEADER]: Signalling peer 6d4de2ce0683442498244b9529127f91 to start an election
I20260709 13:03:47.140125  1740 raft_consensus.cc:2468] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 18.
I20260709 13:03:47.210541  1584 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1"
dest_uuid: "6d4de2ce0683442498244b9529127f91"
 from {username='slave'} at 127.0.0.1:59112
I20260709 13:03:47.211263  1584 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 27 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:47.211659  1584 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:03:47.216063  8900 raft_consensus.cc:993] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6: : Instructing follower 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:03:47.216641  8900 raft_consensus.cc:1081] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 LEADER]: Signalling peer 5bb87fe07da2414e84ee578c3b176ede to start an election
I20260709 13:03:47.218848  1660 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a"
dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
 from {username='slave'} at 127.0.0.1:58814
I20260709 13:03:47.219376  1660 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:47.219679  1660 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:47.223762  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 45853.1us
I20260709 13:03:47.226600  1665 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 21.
I20260709 13:03:47.228222  1556 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:47.230691  8952 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:47.231855  8952 raft_consensus.cc:697] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 21 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:47.162189  1734 raft_consensus.cc:2955] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:03:47.121941  8906 raft_consensus.cc:2955] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:03:47.237934  1601 tablet_copy_source_session.cc:215] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:47.238157  8952 consensus_queue.cc:237] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:47.242565  8970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b51b235c777d4de2876dfd783998c83f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.246979  1736 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 21.
I20260709 13:03:47.231549  1584 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 28 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:47.253367  1660 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:47.255880  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: true dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:47.256510  1662 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:03:47.259193  1584 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 28 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:47.260279  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:47.266134  1736 raft_consensus.cc:3055] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:03:47.266506  1736 raft_consensus.cc:740] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:47.267284  1736 consensus_queue.cc:260] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.16, Last appended by leader: 16, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:47.268510  1736 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:03:47.269421  1662 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 28.
I20260709 13:03:47.271587  1556 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91; no voters: 
I20260709 13:03:47.273432  8957 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:03:47.273958  8957 raft_consensus.cc:697] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 28 LEADER]: Becoming Leader. State: Replica: 6d4de2ce0683442498244b9529127f91, State: Running, Role: LEADER
I20260709 13:03:47.274777  8957 consensus_queue.cc:237] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.16, Last appended by leader: 16, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:47.300539  1736 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4de2ce0683442498244b9529127f91 in term 28.
I20260709 13:03:47.310880  1660 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 election: Requested vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:47.313989  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:47.314874  1736 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:47.325727  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:03:47.326422  2537 raft_consensus.cc:3055] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:47.326717  2537 raft_consensus.cc:740] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:47.327481  2537 consensus_queue.cc:260] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:47.328681  2537 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:47.328795  1485 catalog_manager.cc:5697] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: config changed from index -1 to 12, NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) added. New cstate: current_term: 17 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } }
I20260709 13:03:47.312734  1486 catalog_manager.cc:5697] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 17 to 18, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 18 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:47.334069  1484 catalog_manager.cc:5697] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 20 to 21, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 21 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:47.361449  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 48256.9us
W20260709 13:03:47.363657  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 61655.4us
I20260709 13:03:47.388949  2537 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 15.
I20260709 13:03:47.390386  1630 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:47.391269  8920 raft_consensus.cc:2804] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:47.391752  8920 raft_consensus.cc:697] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 15 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:47.396803  1736 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 15.
I20260709 13:03:47.397511  1734 raft_consensus.cc:1240] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Rejecting Update request from peer 7e839e91a1314c2f9a99b25b17c916a6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:47.392802  8920 consensus_queue.cc:237] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:47.420032  1555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 79685.5us
I20260709 13:03:47.438854  8970 tablet_copy_client.cc:806] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:47.439666  8970 tablet_copy_client.cc:670] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:47.437445  8975 ts_tablet_manager.cc:933] T 17b4f0abad654424ae8d47e63dbf2067 P 7e839e91a1314c2f9a99b25b17c916a6: Initiating tablet copy from peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:47.449636  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 77851.2us
W20260709 13:03:47.459074  1538 auto_rebalancer.cc:629] Failed to schedule move for tablet 67258bf3ca484bd099fd3ec7923aee78: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:03:47.531633  8970 tablet_copy_client.cc:538] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:03:47.544976  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 74957.4us
I20260709 13:03:47.534978  8975 tablet_copy_client.cc:323] T 17b4f0abad654424ae8d47e63dbf2067 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:32843
I20260709 13:03:47.557586  1486 catalog_manager.cc:5697] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 reported cstate change: term changed from 27 to 28, leader changed from 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195) to 6d4de2ce0683442498244b9529127f91 (127.0.107.193). New cstate: current_term: 28 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:47.594570  1485 catalog_manager.cc:5697] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 14 to 15, leader changed from 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 15 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:47.597904  1751 tablet_copy_service.cc:140] P 5ced62816f8545cd9b63a27e9055e42d: Received BeginTabletCopySession request for tablet 17b4f0abad654424ae8d47e63dbf2067 from peer 7e839e91a1314c2f9a99b25b17c916a6 ({username='slave'} at 127.0.0.1:35672)
I20260709 13:03:47.598582  1751 tablet_copy_service.cc:161] P 5ced62816f8545cd9b63a27e9055e42d: Beginning new tablet copy session on tablet 17b4f0abad654424ae8d47e63dbf2067 from peer 7e839e91a1314c2f9a99b25b17c916a6 at {username='slave'} at 127.0.0.1:35672: session id = 7e839e91a1314c2f9a99b25b17c916a6-17b4f0abad654424ae8d47e63dbf2067
I20260709 13:03:47.628326  1751 tablet_copy_source_session.cc:215] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:47.632115  8975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17b4f0abad654424ae8d47e63dbf2067. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.635327  8989 ts_tablet_manager.cc:933] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6: Initiating tablet copy from peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325)
I20260709 13:03:47.661883  8970 tablet_bootstrap.cc:492] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap starting.
I20260709 13:03:47.685544  8989 tablet_copy_client.cc:323] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:33325
I20260709 13:03:47.687696  1601 tablet_copy_service.cc:140] P 6d4de2ce0683442498244b9529127f91: Received BeginTabletCopySession request for tablet bd728f93afb447e384035fae1af6b006 from peer 7e839e91a1314c2f9a99b25b17c916a6 ({username='slave'} at 127.0.0.1:46836)
I20260709 13:03:47.688297  1601 tablet_copy_service.cc:161] P 6d4de2ce0683442498244b9529127f91: Beginning new tablet copy session on tablet bd728f93afb447e384035fae1af6b006 from peer 7e839e91a1314c2f9a99b25b17c916a6 at {username='slave'} at 127.0.0.1:46836: session id = 7e839e91a1314c2f9a99b25b17c916a6-bd728f93afb447e384035fae1af6b006
I20260709 13:03:47.688630  1660 raft_consensus.cc:1275] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 28 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
I20260709 13:03:47.690618  8982 consensus_queue.cc:1048] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:03:47.698000  1601 tablet_copy_source_session.cc:215] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:47.704453  8989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd728f93afb447e384035fae1af6b006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.732803  1736 raft_consensus.cc:1275] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:03:47.734506  1591 raft_consensus.cc:1275] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:03:47.749027  1665 raft_consensus.cc:1275] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:03:47.751132  8952 consensus_queue.cc:1048] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:03:47.754560  8979 consensus_queue.cc:1048] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:47.769309  8979 consensus_queue.cc:1048] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:47.782027  1740 raft_consensus.cc:1275] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 28 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
I20260709 13:03:47.784435  8952 consensus_queue.cc:1048] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:03:47.822448  8975 tablet_copy_client.cc:806] T 17b4f0abad654424ae8d47e63dbf2067 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:47.824455  1734 raft_consensus.cc:1275] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:03:47.826256  8952 consensus_queue.cc:1048] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:03:47.839986  8975 tablet_copy_client.cc:670] T 17b4f0abad654424ae8d47e63dbf2067 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:47.853574  8989 tablet_copy_client.cc:806] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:47.861025  8989 tablet_copy_client.cc:670] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:47.866034  8975 tablet_copy_client.cc:538] T 17b4f0abad654424ae8d47e63dbf2067 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:47.883011  8989 tablet_copy_client.cc:538] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:47.934301   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:48.027801  2554 raft_consensus.cc:1275] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:03:48.043213  8975 tablet_bootstrap.cc:492] T 17b4f0abad654424ae8d47e63dbf2067 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap starting.
I20260709 13:03:48.066397  8989 tablet_bootstrap.cc:492] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap starting.
I20260709 13:03:48.055819  8894 consensus_queue.cc:1048] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 13:03:48.131517  1740 raft_consensus.cc:1275] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:03:48.147833  8894 consensus_queue.cc:1048] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 13:03:48.242285   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:03:48.258713  2426 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:48.351711  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 60525.2us
W20260709 13:03:48.352665  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 94008.2us
I20260709 13:03:48.365527  8970 tablet_bootstrap.cc:492] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=0 applied=16 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:03:48.365896  9005 log.cc:927] Time spent T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:03:48.366675  8970 tablet_bootstrap.cc:492] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap complete.
I20260709 13:03:48.367612  8970 ts_tablet_manager.cc:1403] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6: Time spent bootstrapping tablet: real 0.706s	user 0.040s	sys 0.022s
W20260709 13:03:48.368531  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 90345us
W20260709 13:03:48.415055  1707 consensus_peers.cc:597] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:48.415263  1633 consensus_peers.cc:597] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:48.432548  1633 consensus_peers.cc:597] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:48.429169  1707 consensus_peers.cc:597] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:48.439106  1707 consensus_peers.cc:597] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:48.452754  1707 consensus_peers.cc:597] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:48.460088  1707 consensus_peers.cc:597] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:48.540956  2426 consensus_peers.cc:597] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:48.553493  2426 consensus_peers.cc:597] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:48.564357  2426 consensus_peers.cc:597] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:48.583038  1633 consensus_peers.cc:597] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:48.578539  1707 consensus_peers.cc:597] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:48.467427  8970 raft_consensus.cc:359] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [term 25 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
W20260709 13:03:48.590937  1633 consensus_peers.cc:597] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:48.600587  1633 consensus_peers.cc:597] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:48.599992  8970 raft_consensus.cc:740] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [term 25 LEARNER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Initialized, Role: LEARNER
W20260709 13:03:48.741124  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 147063us
W20260709 13:03:48.748296  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 74078.8us
I20260709 13:03:48.658644  8970 consensus_queue.cc:260] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
W20260709 13:03:48.789577  1707 consensus_peers.cc:597] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:48.791651  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 188273us
W20260709 13:03:48.790228  1707 consensus_peers.cc:597] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:48.796993  1707 consensus_peers.cc:597] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:48.805557  1707 consensus_peers.cc:597] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:48.838008  8970 ts_tablet_manager.cc:1434] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6: Time spent starting tablet: real 0.470s	user 0.014s	sys 0.000s
W20260709 13:03:48.917333  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 88468.2us
W20260709 13:03:48.924413  1707 consensus_peers.cc:597] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:48.927719  1707 consensus_peers.cc:597] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:48.928457  1707 consensus_peers.cc:597] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:48.949223  2426 consensus_peers.cc:597] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:48.957610  2426 consensus_peers.cc:597] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:48.962958  2550 raft_consensus.cc:1217] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [term 25 LEARNER]: Deduplicated request from leader. Original: 25.15->[25.16-25.16]   Dedup: 25.16->[]
W20260709 13:03:49.001299  2426 consensus_peers.cc:597] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:49.002022  2426 consensus_peers.cc:597] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:49.002668  2426 consensus_peers.cc:597] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:49.041826   431 tablet_copy_service.cc:362] P 6d4de2ce0683442498244b9529127f91: Destroying tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-bd728f93afb447e384035fae1af6b006 due to service shutdown
I20260709 13:03:49.050118   431 tablet_copy_service.cc:434] P 6d4de2ce0683442498244b9529127f91: ending tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-bd728f93afb447e384035fae1af6b006 on tablet bd728f93afb447e384035fae1af6b006 with peer 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:49.050868   431 tablet_copy_service.cc:362] P 6d4de2ce0683442498244b9529127f91: Destroying tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-b51b235c777d4de2876dfd783998c83f due to service shutdown
I20260709 13:03:49.051218   431 tablet_copy_service.cc:434] P 6d4de2ce0683442498244b9529127f91: ending tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-b51b235c777d4de2876dfd783998c83f on tablet b51b235c777d4de2876dfd783998c83f with peer 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:03:49.055899  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 52723.3us
I20260709 13:03:49.065047  8989 tablet_bootstrap.cc:492] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:49.068624  8989 tablet_bootstrap.cc:492] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap complete.
W20260709 13:03:49.089207  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 339595us
I20260709 13:03:49.110891  8989 ts_tablet_manager.cc:1403] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent bootstrapping tablet: real 1.045s	user 0.077s	sys 0.024s
W20260709 13:03:49.204910  2426 consensus_peers.cc:597] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:49.205544  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 84620.3us
I20260709 13:03:49.190960  8989 raft_consensus.cc:359] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
W20260709 13:03:49.209685  2426 consensus_peers.cc:597] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:49.209693  8989 raft_consensus.cc:740] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Initialized, Role: LEARNER
W20260709 13:03:49.210642  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 101148us
I20260709 13:03:49.225524  8989 consensus_queue.cc:260] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:03:49.236630  8989 ts_tablet_manager.cc:1434] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent starting tablet: real 0.092s	user 0.006s	sys 0.000s
W20260709 13:03:49.239297  2426 consensus_peers.cc:597] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:49.249238  1633 consensus_peers.cc:597] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:49.268903  1633 consensus_peers.cc:597] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:49.264361  9023 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:49.290336  9033 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:49.290972  9033 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:49.271030  9020 raft_consensus.cc:493] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:49.320775  9025 raft_consensus.cc:493] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:49.321461  9025 raft_consensus.cc:515] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:49.323678  9025 leader_election.cc:290] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:49.288506  9023 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:49.328228  9023 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:49.318252  9020 raft_consensus.cc:515] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:49.331139  9020 leader_election.cc:290] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:49.345219  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:49.345237  9020 raft_consensus.cc:493] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:49.346216  9020 raft_consensus.cc:515] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:49.345435  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:49.348397  9020 leader_election.cc:290] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:49.337026  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:49.350374  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:49.376776  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6305e583540c895021f5a180689f7" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:49.382568  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c784821c4a84bc7ba32cb6e34fbb225" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:49.379818  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81635b0a041d4e6da9f7499ecb70dcc2" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:49.386298  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fbae81e504a9b9671de42f0e75aea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:49.391294  9033 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:49.400983  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:49.403424  9024 raft_consensus.cc:493] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:49.404086  9024 raft_consensus.cc:515] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:49.413283  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:03:49.413550  1633 consensus_peers.cc:597] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:49.414203  1633 consensus_peers.cc:597] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:49.415114  1556 leader_election.cc:304] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:03:49.414722  1633 consensus_peers.cc:597] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:49.416461  1633 consensus_peers.cc:597] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:49.407531  8952 raft_consensus.cc:493] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
W20260709 13:03:49.425313  1633 consensus_peers.cc:597] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:49.426491  1633 consensus_peers.cc:597] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:49.421706  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aff654153ad4acfa774f838f37c0604" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:49.407682  9020 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:49.434468  9020 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:49.434924  8906 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:49.435537  8906 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:49.432605  8952 raft_consensus.cc:515] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:49.439028  8906 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:49.439320  9024 leader_election.cc:290] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:49.440121  8952 leader_election.cc:290] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:49.436853  9020 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:49.450886  8975 tablet_bootstrap.cc:492] T 17b4f0abad654424ae8d47e63dbf2067 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=1 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:49.423322  9033 raft_consensus.cc:493] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:49.451952  8975 tablet_bootstrap.cc:492] T 17b4f0abad654424ae8d47e63dbf2067 P 7e839e91a1314c2f9a99b25b17c916a6: Bootstrap complete.
I20260709 13:03:49.451736  9033 raft_consensus.cc:515] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:49.452792  8975 ts_tablet_manager.cc:1403] T 17b4f0abad654424ae8d47e63dbf2067 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent bootstrapping tablet: real 1.410s	user 0.061s	sys 0.017s
I20260709 13:03:49.454006  9033 leader_election.cc:290] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:49.455416  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8e576fb1634970b28a86f720e85f9a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:49.461302  9023 raft_consensus.cc:493] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:49.467165  9023 raft_consensus.cc:515] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:49.469069  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:49.480455  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:03:49.486843  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 71824.4us
I20260709 13:03:49.487552  1556 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:49.493729  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:49.490777  9033 raft_consensus.cc:2749] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:49.503455  8951 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:49.514552  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:49.504037  9029 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:49.522543  9029 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:49.528048  9033 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:49.528724  9033 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:49.504110  8951 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:49.538554  9025 raft_consensus.cc:493] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:49.539196  9025 raft_consensus.cc:515] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:49.543447  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 55964.7us
I20260709 13:03:49.544157  1556 leader_election.cc:304] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:49.544153  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9831da869404fb79a22d3887701ca69" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:49.545559  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f75a0ee5c184536abc81f5a366016fb" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:49.553200  8952 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:49.553584  9020 raft_consensus.cc:2749] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:49.553838  8952 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:49.555642  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2782217725024e159b9536d03808a3ea" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:49.556718  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:49.551915  1556 leader_election.cc:304] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:49.557791  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:49.531507  9033 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:49.561316  1556 leader_election.cc:304] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:49.566537  8952 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:49.566808  9020 raft_consensus.cc:2749] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:49.558378  8957 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:49.568100  9029 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:49.567879  8957 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:49.562561  9023 leader_election.cc:290] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:49.554272  8906 raft_consensus.cc:2749] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:49.569855  9033 raft_consensus.cc:493] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:49.570303  8957 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:49.570415  9033 raft_consensus.cc:515] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:49.572584  9033 leader_election.cc:290] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:49.550935  8951 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:49.579027  9025 leader_election.cc:290] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:49.585435  1556 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:49.586546  8906 raft_consensus.cc:2749] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:49.589114  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1633c35f1cea4228894a2e7872612d9e" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:49.590854  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:49.592278  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:49.593039  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:49.593693  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:49.599094  9025 raft_consensus.cc:1064] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91: attempting to promote NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 to VOTER
I20260709 13:03:49.609660  9025 consensus_queue.cc:237] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 14, Current term: 25, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:49.615142  8975 raft_consensus.cc:359] T 17b4f0abad654424ae8d47e63dbf2067 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:03:49.616389  8975 raft_consensus.cc:740] T 17b4f0abad654424ae8d47e63dbf2067 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Initialized, Role: LEARNER
I20260709 13:03:49.617254  8975 consensus_queue.cc:260] T 17b4f0abad654424ae8d47e63dbf2067 P 7e839e91a1314c2f9a99b25b17c916a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:03:49.626258  8975 ts_tablet_manager.cc:1434] T 17b4f0abad654424ae8d47e63dbf2067 P 7e839e91a1314c2f9a99b25b17c916a6: Time spent starting tablet: real 0.161s	user 0.007s	sys 0.000s
I20260709 13:03:49.636093  8906 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:49.639986  8906 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:49.641968  1556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 56628.8us
I20260709 13:03:49.643110  9020 raft_consensus.cc:2749] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:49.645694  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4490828942174c3c9092820cf3a81fe3" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:49.654891  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:49.657151  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbe5a86d7bd4880843e631ffca572ce" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:49.605329  1558 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:49.658622  9023 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:49.659510  1558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 54271.7us
I20260709 13:03:49.660399  1558 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:49.657941  8906 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:49.661374  9023 raft_consensus.cc:2749] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:49.670094  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07e22e745346fa98096d8b909dc7f5" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:49.671869  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5935c74e00334979a51afdc704e3b06f" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:49.672885  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:49.673184  2550 raft_consensus.cc:1275] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [term 25 LEARNER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:03:49.673784  1660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52de8c1489f4f9aabb361c6c02bb3de" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:49.673419  1751 tablet_copy_service.cc:342] P 5ced62816f8545cd9b63a27e9055e42d: Request end of tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-17b4f0abad654424ae8d47e63dbf2067 received from {username='slave'} at 127.0.0.1:35672
I20260709 13:03:49.675040  1751 tablet_copy_service.cc:434] P 5ced62816f8545cd9b63a27e9055e42d: ending tablet copy session 7e839e91a1314c2f9a99b25b17c916a6-17b4f0abad654424ae8d47e63dbf2067 on tablet 17b4f0abad654424ae8d47e63dbf2067 with peer 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:49.676220  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:49.676417  8906 raft_consensus.cc:493] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:49.677299  9029 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:49.677217  8906 raft_consensus.cc:515] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:49.677603  9023 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:49.677954  9029 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:49.678347  9023 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:49.687965  9023 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:49.681386  9020 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:49.694538  9020 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:49.695901  1558 leader_election.cc:304] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:49.682746  8957 raft_consensus.cc:493] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:49.697376  8957 raft_consensus.cc:515] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:49.698591  8951 raft_consensus.cc:2749] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:49.699628  8957 leader_election.cc:290] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:49.700156  8957 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:49.696866  9020 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:49.700647  8957 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:49.707276  8957 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:49.711948  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:49.713893  1558 leader_election.cc:304] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:49.714605  2550 raft_consensus.cc:1217] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.11->[17.12-17.12]   Dedup: 17.12->[]
I20260709 13:03:49.714905  8951 consensus_queue.cc:1048] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:03:49.716192  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:49.720964  9025 raft_consensus.cc:493] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:49.722856  9025 raft_consensus.cc:515] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:49.716885  8951 raft_consensus.cc:2749] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:49.680127  9029 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:49.727701  1734 raft_consensus.cc:1275] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 25 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:03:49.728293  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:49.730029  9025 leader_election.cc:290] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:49.726228  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f7cd3ac9254bdb9fb62ab42597f15b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:49.726593  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c3c6ae566d4afda95ffc509772bca1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:49.693886  8906 leader_election.cc:290] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:49.734048  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:49.734469  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb113e0e7c440b4911f4c09a86e2591" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:49.736677  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:49.740770  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26b89190fef4c8199109d4bbabf2395" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:49.741285  1660 raft_consensus.cc:1275] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 25 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:03:49.742498  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:49.742586  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8e0ac7d1de40fdb93dc3a4e799e876" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:49.740340  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f40f76410ee41d696f4427ca4903962" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:49.767616   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:49.735797  9023 raft_consensus.cc:493] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:49.770887  9023 raft_consensus.cc:515] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:49.773777  9029 raft_consensus.cc:493] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:49.784027  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:49.784606  9029 raft_consensus.cc:515] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:49.786955   431 tablet_replica.cc:333] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:49.787072  9029 leader_election.cc:290] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:49.788491  1556 leader_election.cc:304] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:49.766767  8906 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:49.793761   431 raft_consensus.cc:2243] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:03:49.781540  8951 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:49.781769  9024 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:49.803730  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:49.790236  9025 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:49.808682  8957 raft_consensus.cc:2749] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:49.806066  8952 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:49.810289  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f62b0e67804bcba2b2f2b49e0b7623" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:49.810757  8952 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:49.804873  9024 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:49.813381  8952 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:49.814281  9024 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:49.806191  8951 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:49.819332  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:49.810339  9025 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:03:49.823418  9025 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:49.824652  9023 leader_election.cc:290] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:49.805015  8906 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:49.824995  2550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:49.827090  8906 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:49.801244  9029 raft_consensus.cc:493] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:49.835852   431 pending_rounds.cc:70] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91: Trying to abort 1 pending ops.
I20260709 13:03:49.835696  9020 raft_consensus.cc:493] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:49.836108  9029 raft_consensus.cc:515] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:49.836582  9020 raft_consensus.cc:515] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:49.836316   431 pending_rounds.cc:77] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91: Aborting op as it isn't in flight: id { term: 25 index: 17 } timestamp: 7305634732475396096 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "b51b235c777d4de2876dfd783998c83f" old_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } } } new_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } } }
I20260709 13:03:49.837708   431 raft_consensus.cc:2917] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 25 LEADER]: Aborting config change with OpId 25.17: Aborted: Op aborted
I20260709 13:03:49.838112   431 raft_consensus.cc:2889] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 25 LEADER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:03:49.838454   431 raft_consensus.cc:2272] T b51b235c777d4de2876dfd783998c83f P 6d4de2ce0683442498244b9529127f91 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:49.839682  1556 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:49.841199  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc0eeb87e24045a897daa0ad5c400b" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:49.842875   431 tablet_replica.cc:333] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:49.838769  9020 leader_election.cc:290] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:49.843897   431 raft_consensus.cc:2243] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:49.844597  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:49.817010  8951 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:49.851145  1556 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:49.854029  8951 raft_consensus.cc:2749] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:49.854869  1556 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:49.856423  1556 leader_election.cc:304] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:49.851709  9031 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:49.852396  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:49.838771  9029 leader_election.cc:290] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:49.856882  8906 raft_consensus.cc:2749] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:49.859413  9023 raft_consensus.cc:2706] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Received pre-election callback for term 18 while not running: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 13:03:49.860980  1556 leader_election.cc:304] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:49.863819  8906 raft_consensus.cc:2749] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:49.869115   431 raft_consensus.cc:2272] T f52de8c1489f4f9aabb361c6c02bb3de P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:49.874208  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b5a70a2de54935b60554301e6de808" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:49.876407  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:49.878049  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:49.884421  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:49.886696  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:49.887984  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:49.890725   431 tablet_replica.cc:333] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:49.891363  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161aba2b69844461b9d8ed3cdf147919" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:49.892093  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:49.894994   431 raft_consensus.cc:2243] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:49.896347   431 raft_consensus.cc:2272] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:49.904048  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eee8a552b4244ad8089de6467edd0d8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:49.910120   431 tablet_replica.cc:333] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:49.910996  8951 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:49.925534  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd803bfc7504e98806ec4a5030c66b1" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:49.925843   431 raft_consensus.cc:2243] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:49.925686  8951 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:49.911136  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5248b829f494452a558e65e2342b6f0" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:49.926636   431 raft_consensus.cc:2272] T 5935c74e00334979a51afdc704e3b06f P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:49.917464  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47af644bb6145d7bf8d0aaa1d74000d" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:49.918954  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6e8a8a10c144f1bd64e638805e7a5a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:49.918949  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:49.928297  8951 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:49.930097  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:49.939495  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d14bd0bd4204ece94fb1bfe29d407f8" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:49.930092   431 tablet_replica.cc:333] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:49.942867   431 raft_consensus.cc:2243] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:49.950968  1556 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:49.954466  1665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:49.958199  1558 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:49.959853   431 raft_consensus.cc:2272] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:49.960219  1558 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:49.960597  9031 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:49.961450  9023 raft_consensus.cc:2749] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:49.957240  9029 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:49.963733  9029 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:49.965884  9029 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:49.966176  2554 raft_consensus.cc:1217] T 17b4f0abad654424ae8d47e63dbf2067 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.12->[18.13-18.13]   Dedup: 18.13->[]
I20260709 13:03:49.967895  1556 leader_election.cc:304] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
W20260709 13:03:49.972334  1558 raft_consensus.cc:2686] T 58f7cd3ac9254bdb9fb62ab42597f15b P 6d4de2ce0683442498244b9529127f91: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:03:49.974334  1558 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:49.975773  1558 leader_election.cc:304] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:49.979154  9025 raft_consensus.cc:2749] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:50.001539  8906 raft_consensus.cc:2749] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:50.003083   431 tablet_replica.cc:333] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.006553  1558 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:50.005771   431 raft_consensus.cc:2243] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.009888  9020 raft_consensus.cc:2749] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:50.008432  1558 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:50.009925  8951 raft_consensus.cc:2749] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:50.012365   431 raft_consensus.cc:2272] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.012557  1558 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:50.014281  1558 leader_election.cc:304] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:50.015125  9031 raft_consensus.cc:2749] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:50.016368  1558 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:50.012718  9029 raft_consensus.cc:2749] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:50.013537  9025 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:50.017587   431 tablet_replica.cc:333] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.019512   431 raft_consensus.cc:2243] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.026471  1558 leader_election.cc:304] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:50.029922  9020 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:50.030611  9020 raft_consensus.cc:2749] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:50.032019  1558 leader_election.cc:304] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:03:50.032820  1558 raft_consensus.cc:2686] T 9eee8a552b4244ad8089de6467edd0d8 P 6d4de2ce0683442498244b9529127f91: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:03:50.033748  1558 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:50.034614   431 raft_consensus.cc:2272] T 4490828942174c3c9092820cf3a81fe3 P 6d4de2ce0683442498244b9529127f91 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.035012  1558 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:50.035651  9031 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:50.037674   431 tablet_replica.cc:333] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.037706  9031 raft_consensus.cc:2749] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:50.038795   431 raft_consensus.cc:2243] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:03:50.039096  1558 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:50.039847  9031 raft_consensus.cc:2749] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:50.041052  1558 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:50.041968  9031 raft_consensus.cc:2749] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:50.043166  1558 leader_election.cc:304] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:50.044003  9031 raft_consensus.cc:2749] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:50.044304  1558 leader_election.cc:304] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
W20260709 13:03:50.045121  1558 raft_consensus.cc:2686] T efd803bfc7504e98806ec4a5030c66b1 P 6d4de2ce0683442498244b9529127f91: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:03:50.045270   431 raft_consensus.cc:2272] T 075c70e81e41467491c4134e5e9fd03a P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.048558   431 tablet_replica.cc:333] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.049762   431 raft_consensus.cc:2243] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.056629   431 raft_consensus.cc:2272] T c9831da869404fb79a22d3887701ca69 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.050714  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:50.059762   431 tablet_replica.cc:333] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.060683   431 raft_consensus.cc:2243] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.061414   431 raft_consensus.cc:2272] T 6bb113e0e7c440b4911f4c09a86e2591 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.053264  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:50.071909  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed1f59ae1624d7ca7a1694c18500e49" candidate_uuid: "6d4de2ce0683442498244b9529127f91" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:50.073199   431 tablet_replica.cc:333] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.074281   431 raft_consensus.cc:2243] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.077683   431 raft_consensus.cc:2272] T c3d6305e583540c895021f5a180689f7 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.080855   431 tablet_replica.cc:333] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.081764   431 raft_consensus.cc:2243] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.085592   431 raft_consensus.cc:2272] T 619fbae81e504a9b9671de42f0e75aea P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.088433   431 tablet_replica.cc:333] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.094113   431 raft_consensus.cc:2243] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.094941   431 raft_consensus.cc:2272] T 81635b0a041d4e6da9f7499ecb70dcc2 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.102135  1558 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:50.105502  9031 raft_consensus.cc:2749] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:50.109191  1558 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4de2ce0683442498244b9529127f91; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:50.110054  9031 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:50.111416   431 tablet_replica.cc:333] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.112310   431 raft_consensus.cc:2243] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.117136   431 raft_consensus.cc:2272] T c5248b829f494452a558e65e2342b6f0 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.121037   431 tablet_replica.cc:333] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.128886   431 raft_consensus.cc:2243] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.129781   431 raft_consensus.cc:2272] T 3aff654153ad4acfa774f838f37c0604 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.132570   431 tablet_replica.cc:333] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.133261   431 raft_consensus.cc:2243] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.133891   431 raft_consensus.cc:2272] T bd6e8a8a10c144f1bd64e638805e7a5a P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.136888   431 tablet_replica.cc:333] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.137873   431 raft_consensus.cc:2243] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:50.138975   431 raft_consensus.cc:2272] T c03a2285eaff45a6a236c5eae38fb06f P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.141666   431 tablet_replica.cc:333] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.142633   431 raft_consensus.cc:2243] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.147802   431 raft_consensus.cc:2272] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.160449   431 tablet_replica.cc:333] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.161577   431 raft_consensus.cc:2243] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.162725   431 raft_consensus.cc:2272] T 161aba2b69844461b9d8ed3cdf147919 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.166208   431 tablet_replica.cc:333] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.173460   431 raft_consensus.cc:2243] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.174270   431 raft_consensus.cc:2272] T 7e07e22e745346fa98096d8b909dc7f5 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.187407   431 tablet_replica.cc:333] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.188412   431 raft_consensus.cc:2243] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.190527   431 raft_consensus.cc:2272] T 35fc0eeb87e24045a897daa0ad5c400b P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.195549   431 tablet_replica.cc:333] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.199311   431 raft_consensus.cc:2243] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.201432   431 raft_consensus.cc:2272] T 5b8e576fb1634970b28a86f720e85f9a P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.216379   431 tablet_replica.cc:333] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.217515   431 raft_consensus.cc:2243] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.218330   431 raft_consensus.cc:2272] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.221895   431 tablet_replica.cc:333] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.222889   431 raft_consensus.cc:2243] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.227527   431 raft_consensus.cc:2272] T 2782217725024e159b9536d03808a3ea P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.228127  9025 raft_consensus.cc:1064] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91: attempting to promote NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 to VOTER
I20260709 13:03:50.231317   431 tablet_replica.cc:333] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.232498   431 raft_consensus.cc:2243] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.245838   431 raft_consensus.cc:2272] T 67b5a70a2de54935b60554301e6de808 P 6d4de2ce0683442498244b9529127f91 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.258224   431 tablet_replica.cc:333] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.259243   431 raft_consensus.cc:2243] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:50.262786   431 raft_consensus.cc:2272] T 906dda27b6f84a53b2365339db2e3652 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.231694  9025 consensus_queue.cc:237] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 10, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:50.284399   431 tablet_replica.cc:333] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.285606   431 raft_consensus.cc:2243] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.286451   431 raft_consensus.cc:2272] T 3f75a0ee5c184536abc81f5a366016fb P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.290103   431 tablet_replica.cc:333] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.310031   431 raft_consensus.cc:2243] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.314072   431 raft_consensus.cc:2272] T 8c784821c4a84bc7ba32cb6e34fbb225 P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.322093  2554 raft_consensus.cc:1275] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 LEARNER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:50.324673  9029 consensus_queue.cc:1048] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:50.327813   431 tablet_replica.cc:333] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.328717   431 raft_consensus.cc:2243] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.329680  1740 raft_consensus.cc:1275] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:50.334830   431 raft_consensus.cc:2272] T 0fbe5a86d7bd4880843e631ffca572ce P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.336908  1661 raft_consensus.cc:1275] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Refusing update from remote peer 6d4de2ce0683442498244b9529127f91: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:50.338165  9031 consensus_queue.cc:1048] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:50.350200  8906 consensus_queue.cc:1048] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:03:50.366624   431 tablet_replica.cc:333] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.373821   431 raft_consensus.cc:2243] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:03:50.409335   431 raft_consensus.cc:2272] T 90426dc5094b4f3c855ea9d2a43bc452 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.412206   431 tablet_replica.cc:333] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.413379   431 raft_consensus.cc:2243] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:50.419627  8916 raft_consensus.cc:1064] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d: attempting to promote NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 to VOTER
I20260709 13:03:50.430455   431 raft_consensus.cc:2272] T 390554a5bb3c4780b61e0fc806cea161 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.433674   431 tablet_replica.cc:333] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.445040  8916 consensus_queue.cc:237] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 11, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:50.449277  9029 raft_consensus.cc:2955] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:50.465977  1733 raft_consensus.cc:2955] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:50.488468  2554 raft_consensus.cc:2955] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:50.502296   431 raft_consensus.cc:2243] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:50.503017  1661 raft_consensus.cc:2955] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:50.505795   431 raft_consensus.cc:2272] T bd728f93afb447e384035fae1af6b006 P 6d4de2ce0683442498244b9529127f91 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.511080   431 tablet_replica.cc:333] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.511986   431 raft_consensus.cc:2243] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:50.513568   431 raft_consensus.cc:2272] T 67258bf3ca484bd099fd3ec7923aee78 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.516387   431 tablet_replica.cc:333] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.581020   431 raft_consensus.cc:2243] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.581811   431 raft_consensus.cc:2272] T c26b89190fef4c8199109d4bbabf2395 P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.609239  1486 catalog_manager.cc:5697] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: config changed from index 12 to 13, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "6d4de2ce0683442498244b9529127f91" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:50.619468  2537 raft_consensus.cc:1275] T 17b4f0abad654424ae8d47e63dbf2067 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 LEARNER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:03:50.622185  8917 consensus_queue.cc:1048] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:50.627286   431 tablet_replica.cc:333] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.637768   431 raft_consensus.cc:2243] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:50.641220  1707 consensus_peers.cc:597] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:50.641443   431 raft_consensus.cc:2272] T 3b16912bb6d94c80b8ff8e641268e238 P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.669792   431 tablet_replica.cc:333] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.670761   431 raft_consensus.cc:2243] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.671540   431 raft_consensus.cc:2272] T 17b4f0abad654424ae8d47e63dbf2067 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.680099   431 tablet_replica.cc:333] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.690335   431 raft_consensus.cc:2243] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:03:50.692040   431 raft_consensus.cc:2272] T ef1be054223a4d3f90725c570db24bf5 P 6d4de2ce0683442498244b9529127f91 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.700800   431 tablet_replica.cc:333] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.701805   431 raft_consensus.cc:2243] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 28 LEADER]: Raft consensus shutting down.
W20260709 13:03:50.711100  1707 consensus_peers.cc:597] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:50.717839   431 raft_consensus.cc:2272] T d1883da16ec44d2a8304d3909471b4b1 P 6d4de2ce0683442498244b9529127f91 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.720662   431 tablet_replica.cc:333] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.723050   431 raft_consensus.cc:2243] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.729540   431 raft_consensus.cc:2272] T 06d03acc62b5400ebdca03680f553818 P 6d4de2ce0683442498244b9529127f91 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.735559  1661 raft_consensus.cc:1275] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:03:50.742933   431 tablet_replica.cc:333] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.743884   431 raft_consensus.cc:2243] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.744493   431 raft_consensus.cc:2272] T 53c3c6ae566d4afda95ffc509772bca1 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.748680   431 tablet_replica.cc:333] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.749661   431 raft_consensus.cc:2243] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:50.751140   431 raft_consensus.cc:2272] T 7cf5139331dd452b8c2a035da1db88dc P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.780972  8916 consensus_queue.cc:1048] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:50.804049   431 tablet_replica.cc:333] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.828431   431 raft_consensus.cc:2243] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Raft consensus shutting down.
W20260709 13:03:50.816116  2426 consensus_peers.cc:597] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:50.829989   431 raft_consensus.cc:2272] T 99151421d7f641c2b26a05af014a9dc1 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:50.810721  1707 consensus_peers.cc:597] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:50.833385   431 tablet_replica.cc:333] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.845825   431 raft_consensus.cc:2243] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.846580   431 raft_consensus.cc:2272] T 1633c35f1cea4228894a2e7872612d9e P 6d4de2ce0683442498244b9529127f91 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.850003   431 tablet_replica.cc:333] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.857633  9011 raft_consensus.cc:2955] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index 13 to 14, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:50.860522  1665 raft_consensus.cc:2955] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:50.882622   431 raft_consensus.cc:2243] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.891741   431 raft_consensus.cc:2272] T ae1310c9ee464797a39b786c1d932941 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.905642  1484 catalog_manager.cc:5697] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: config changed from index 13 to 14, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:50.919248   431 tablet_replica.cc:333] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.924423  2537 raft_consensus.cc:2955] T 17b4f0abad654424ae8d47e63dbf2067 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } attrs { replace: true } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:50.944061   431 raft_consensus.cc:2243] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.948283   431 raft_consensus.cc:2272] T 3ed1f59ae1624d7ca7a1694c18500e49 P 6d4de2ce0683442498244b9529127f91 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.951440   431 tablet_replica.cc:333] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.956364  1739 consensus_queue.cc:237] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:50.958949  1707 consensus_peers.cc:597] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:50.971136  1667 raft_consensus.cc:1275] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 13:03:50.971777  1707 consensus_peers.cc:597] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:50.972159  2537 raft_consensus.cc:1275] T 17b4f0abad654424ae8d47e63dbf2067 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:03:50.972506  8959 consensus_queue.cc:1048] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:03:50.974610   431 raft_consensus.cc:2243] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.978188   431 raft_consensus.cc:2272] T c47af644bb6145d7bf8d0aaa1d74000d P 6d4de2ce0683442498244b9529127f91 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.982578   431 tablet_replica.cc:333] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:50.983300  8959 consensus_queue.cc:1048] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:03:51.001925  9050 raft_consensus.cc:2955] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 18 LEADER]: Committing config change with OpId 18.15: config changed from index 14 to 15, VOTER 6d4de2ce0683442498244b9529127f91 (127.0.107.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
W20260709 13:03:50.994398  2426 consensus_peers.cc:597] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:50.998711   431 raft_consensus.cc:2243] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.010207  1667 raft_consensus.cc:2955] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Committing config change with OpId 18.15: config changed from index 14 to 15, VOTER 6d4de2ce0683442498244b9529127f91 (127.0.107.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:51.013294   431 raft_consensus.cc:2272] T d8f6e5a8ef2b453189832346af645cd8 P 6d4de2ce0683442498244b9529127f91 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.018136   431 tablet_replica.cc:333] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:51.019027   431 raft_consensus.cc:2243] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:51.019891  1707 consensus_peers.cc:597] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:51.021765   431 raft_consensus.cc:2272] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 6d4de2ce0683442498244b9529127f91 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.024936   431 tablet_replica.cc:333] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
W20260709 13:03:51.029419  2426 consensus_peers.cc:597] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:51.034942   431 raft_consensus.cc:2243] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.030411  2537 raft_consensus.cc:2955] T 17b4f0abad654424ae8d47e63dbf2067 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Committing config change with OpId 18.15: config changed from index 14 to 15, VOTER 6d4de2ce0683442498244b9529127f91 (127.0.107.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:51.046056   431 raft_consensus.cc:2272] T 7b0a975df857466d9daf2f71f1c98623 P 6d4de2ce0683442498244b9529127f91 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.047360  1477 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 17b4f0abad654424ae8d47e63dbf2067 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:03:51.037451  2426 consensus_peers.cc:597] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:51.056615   431 tablet_replica.cc:333] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:51.056807  1485 catalog_manager.cc:5697] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: config changed from index 14 to 15, VOTER 6d4de2ce0683442498244b9529127f91 (127.0.107.193) evicted. New cstate: current_term: 18 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:03:51.067912  1707 consensus_peers.cc:597] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:51.060218  9050 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:51.061271   431 raft_consensus.cc:2243] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.070382   431 raft_consensus.cc:2272] T f6f62b0e67804bcba2b2f2b49e0b7623 P 6d4de2ce0683442498244b9529127f91 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.070156  9050 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:03:51.072398  9050 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:51.076416  1707 leader_election.cc:336] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:51.079501  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:51.084103  1705 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:51.087399  2426 consensus_peers.cc:597] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:51.088825  9011 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:03:51.093333   431 tablet_replica.cc:333] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91: stopping tablet replica
I20260709 13:03:51.094244   431 raft_consensus.cc:2243] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.097465   431 raft_consensus.cc:2272] T 3f40f76410ee41d696f4427ca4903962 P 6d4de2ce0683442498244b9529127f91 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:51.119154  1477 catalog_manager.cc:4755] TS 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 17b4f0abad654424ae8d47e63dbf2067: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
W20260709 13:03:51.137393  1707 consensus_peers.cc:597] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:51.155647  8961 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:51.156337  8961 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:03:51.159260  8961 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:51.163630  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:51.164398  1739 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 25.
I20260709 13:03:51.170921  1633 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:51.173342  9045 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 13:03:51.176911  1707 consensus_peers.cc:597] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:51.178273  9045 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 25 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:51.178809  9045 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:03:51.211213  1633 leader_election.cc:336] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:51.212474  1633 consensus_peers.cc:597] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:51.213176  1633 consensus_peers.cc:597] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:51.214159  9045 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 26 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
W20260709 13:03:51.219758  1707 consensus_peers.cc:597] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:51.239179  2426 consensus_peers.cc:597] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:51.249310  9045 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 26 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:51.250245  1633 consensus_peers.cc:597] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:51.261312  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:51.262077  1739 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:03:51.270345  8917 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:51.271001  8917 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:51.277609  8917 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:51.279259  2426 consensus_peers.cc:597] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:51.280278  1707 leader_election.cc:336] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:51.295785  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
W20260709 13:03:51.301707  2426 consensus_peers.cc:597] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:51.302832  1633 consensus_peers.cc:597] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:51.293220  1739 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 26.
W20260709 13:03:51.311307  1707 consensus_peers.cc:597] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:51.349330  1705 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:51.351714  8917 raft_consensus.cc:2749] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:03:51.397164  2426 consensus_peers.cc:597] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:51.409855  9030 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:51.411140  9030 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:51.415894  9030 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:51.423972  1633 leader_election.cc:336] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:51.453909  1633 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:51.458123  8961 raft_consensus.cc:2804] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:03:51.458752  8961 raft_consensus.cc:697] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 26 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:51.454998  9045 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:51.463024  9045 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:51.465248  9045 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:51.459702  8961 consensus_queue.cc:237] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:03:51.468712  9030 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:51.469542  9030 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:51.477423  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:51.480970  9030 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:51.526814  1633 connection.cc:769] client connection to 127.0.107.193:33325 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 13:03:51.527667  1558 connection.cc:466] server connection from 127.0.0.1:45194 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45194 (request call id 12) could send its response
W20260709 13:03:51.494086  2426 leader_election.cc:336] T c03a2285eaff45a6a236c5eae38fb06f P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:51.549005  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:03:51.572233  2426 leader_election.cc:336] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:51.573109  2426 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:51.582062  8917 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:51.583243  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:51.584245  1739 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 19.
I20260709 13:03:51.582983  9053 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:03:51.583310  8917 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:51.588558  8917 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:51.595413  8959 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:51.596349  8959 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:51.599902  8959 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:51.596696  9011 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:51.601964  9011 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:51.602738  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:51.603586  2537 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 18.
I20260709 13:03:51.604527  9011 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:51.600901  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:51.634639  1740 raft_consensus.cc:2393] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e839e91a1314c2f9a99b25b17c916a6 in current term 26: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:51.610119  1704 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:51.639146  8917 raft_consensus.cc:2804] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:51.639606  8917 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:51.640060  8917 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:51.640285  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:51.642606  9011 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:51.643517  9011 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:51.650381  2426 consensus_peers.cc:597] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:51.650682  8970 tablet_copy_client.cc:1131] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Unable to close tablet copy session: Network error: failure ending tablet copy session: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:51.651729  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:51.652215  1633 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:51.669539  9055 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:51.670410  9055 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:51.685269  9055 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:51.686172  9055 raft_consensus.cc:2804] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:51.698609  8917 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:51.704862  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03a2285eaff45a6a236c5eae38fb06f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:03:51.705894  2537 raft_consensus.cc:3060] T c03a2285eaff45a6a236c5eae38fb06f P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:51.709919  9011 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:51.710598  2426 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:51.691367  9055 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:51.717244  9055 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:51.742486  1485 catalog_manager.cc:5697] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 25 to 26, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 26 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:51.726192  8917 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:03:51.749220  1707 leader_election.cc:336] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:51.767109  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 49439.2us
W20260709 13:03:51.767961  1707 leader_election.cc:336] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:51.768904  1707 consensus_peers.cc:597] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:51.761302  2537 raft_consensus.cc:2468] T c03a2285eaff45a6a236c5eae38fb06f P 7e839e91a1314c2f9a99b25b17c916a6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 19.
I20260709 13:03:51.777318  9053 raft_consensus.cc:2749] T c03a2285eaff45a6a236c5eae38fb06f P 7e839e91a1314c2f9a99b25b17c916a6 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:51.775274  1633 consensus_peers.cc:597] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:51.783123  1704 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:03:51.785940  1707 leader_election.cc:336] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:51.785121  1705 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:51.787599  8917 raft_consensus.cc:2804] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:51.788192  8917 raft_consensus.cc:697] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 19 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:51.788815  9050 raft_consensus.cc:2749] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:51.789458  8917 consensus_queue.cc:237] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:51.790544  9055 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:51.797200  1707 consensus_peers.cc:597] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:51.806340  8989 tablet_copy_client.cc:1131] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6: tablet copy: Unable to close tablet copy session: Network error: failure ending tablet copy session: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:51.813102  1705 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:51.812091  9055 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:51.816252  9050 raft_consensus.cc:2749] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:51.819667  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:51.820538  1733 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 17.
I20260709 13:03:51.824798  8979 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:51.825719  8979 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:51.828626  8979 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:51.832082  1707 leader_election.cc:336] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:51.832944  1707 leader_election.cc:336] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:51.848536  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:51.849421  1662 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 19.
W20260709 13:03:51.858312  1633 leader_election.cc:336] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:51.865273  8959 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:51.866252  8959 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:51.868358  1633 consensus_peers.cc:597] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:51.871601  1633 consensus_peers.cc:597] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:51.879858  1707 leader_election.cc:336] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:51.891429  1484 catalog_manager.cc:5697] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 18 to 19, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 19 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:51.897423  8959 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:51.872541  1633 consensus_peers.cc:597] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:51.903517  8979 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:51.911355  8979 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:51.925596  8979 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:51.939077  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075c70e81e41467491c4134e5e9fd03a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:51.939821  1733 raft_consensus.cc:3060] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:51.943111  8959 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:51.943897  8959 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:51.946581  8959 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:51.966503  8917 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:51.967557  8917 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:51.980566  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:51.982571  8917 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:03:51.984500  1707 leader_election.cc:336] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:51.989809  8985 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:51.990764  8985 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:51.993959  8985 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:51.995743  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:52.003719  8979 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:52.004791  8979 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:52.008383  8979 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:52.009228  8959 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:52.009709  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:52.009912  8959 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:52.010578  2537 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 17.
I20260709 13:03:52.013571  8917 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:52.014194  8917 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:52.016198  8917 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:52.026772  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:52.027755  1739 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 19.
W20260709 13:03:52.052803  1707 leader_election.cc:336] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:52.053680  1707 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:52.062409  8959 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:52.065784  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 58865us
I20260709 13:03:52.071527  1733 raft_consensus.cc:2468] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 20.
I20260709 13:03:52.075250  8979 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:52.076009  8979 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:52.078286  8979 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:52.081405  8979 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:52.082078  8979 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:52.084123  8979 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:52.087682  2537 raft_consensus.cc:3060] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:03:52.089993  2426 consensus_peers.cc:597] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:52.098905  2537 raft_consensus.cc:1275] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [term 26 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 26 index: 17. (term mismatch)
I20260709 13:03:52.099510  2537 pending_rounds.cc:85] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6: Aborting all ops after (but not including) 16
I20260709 13:03:52.099810  2537 pending_rounds.cc:107] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 25.17
I20260709 13:03:52.100034  1633 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:52.100325  2537 raft_consensus.cc:2917] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [term 26 FOLLOWER]: Aborting config change with OpId 25.17: Aborted: Op aborted by new leader
I20260709 13:03:52.105505  8917 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:52.122784  2537 raft_consensus.cc:2889] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [term 26 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:52.122887  2426 leader_election.cc:336] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:52.123524  2426 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:52.135313  1705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 98212.4us
I20260709 13:03:52.137657  9062 raft_consensus.cc:2804] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:52.138162  9062 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:52.137933  9055 consensus_queue.cc:1048] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:03:52.138578  9062 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:52.147992  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 48057.5us
I20260709 13:03:52.152120  9053 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:52.152909  9053 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:52.153263  1633 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:52.154484  9063 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:52.156790  1667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:52.161496  9062 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:52.163252  9053 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:52.163406  9055 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:52.164283  8961 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:52.174140  9055 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:52.174763  9055 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:52.174468  8961 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:52.178215  8961 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:52.164762  8979 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:52.188355  8979 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:52.190032  9062 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:52.190642  8979 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:52.165576  9045 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:52.191489  9045 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:52.187463  9061 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:52.193830  9061 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:52.196066  9061 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:52.197984  9045 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:52.203835  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:52.164423  1633 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:52.207201  8961 raft_consensus.cc:2804] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:52.208148  8961 raft_consensus.cc:697] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 20 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:52.209370  8961 consensus_queue.cc:237] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:52.204689  1733 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 17.
W20260709 13:03:52.213292  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 160562us
I20260709 13:03:52.224097  9070 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:52.225107  9070 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:52.230834  9070 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:52.232817  8917 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:52.233564  8917 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:52.236135  8917 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:52.236729  1705 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:52.248720  8959 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:52.249225  8959 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:52.249667  8959 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:52.266162  8959 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:52.266695  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 102368us
W20260709 13:03:52.295284  1633 leader_election.cc:336] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:52.296208  1633 consensus_peers.cc:597] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:52.276750  9055 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:52.279757  2426 leader_election.cc:336] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:52.351374  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:52.483215  1666 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 28.
W20260709 13:03:52.353163  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 99218.2us
W20260709 13:03:52.353787  1633 leader_election.cc:336] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:52.485311  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 131571us
W20260709 13:03:52.485929  1633 consensus_peers.cc:597] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:52.486392  1633 leader_election.cc:336] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:52.487071  1633 consensus_peers.cc:597] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:52.487466  1633 leader_election.cc:336] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:52.489943  1737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:52.490667  1737 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 17.
I20260709 13:03:52.364501  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:52.493285  2426 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:52.367285  1740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:52.499415  1740 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 17.
I20260709 13:03:52.369446  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:52.500543  1738 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 21.
I20260709 13:03:52.307607  8959 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:52.371752  1735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:52.518261  1735 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 16.
I20260709 13:03:52.373068  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390554a5bb3c4780b61e0fc806cea161" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:52.519376  1732 raft_consensus.cc:3060] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:52.346362  9045 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:52.542745  9045 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:52.543995  1661 raft_consensus.cc:2468] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 13.
I20260709 13:03:52.315014  9055 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:52.382575  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:52.548028  1736 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 28.
I20260709 13:03:52.386579  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:52.549198  1739 raft_consensus.cc:2468] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 13.
I20260709 13:03:52.392911  1659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:52.550428  1659 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 17.
I20260709 13:03:52.396870  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:52.551448  1658 raft_consensus.cc:2468] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 13.
W20260709 13:03:52.402644  1630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39157, user_credentials={real_user=slave}} blocked reactor thread for 214919us
I20260709 13:03:52.404388  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:52.420686  1733 raft_consensus.cc:1275] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 26 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:03:52.555285  1663 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 21.
I20260709 13:03:52.366770  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:52.556207  1734 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 21.
I20260709 13:03:52.562222  9076 raft_consensus.cc:1064] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede: attempting to promote NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 to VOTER
W20260709 13:03:52.562872  9076 raft_consensus.cc:1068] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede: Unable to promote non-voter 7e839e91a1314c2f9a99b25b17c916a6: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:03:52.506819  2537 raft_consensus.cc:1275] T c03a2285eaff45a6a236c5eae38fb06f P 7e839e91a1314c2f9a99b25b17c916a6 [term 19 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:03:52.508078  9053 raft_consensus.cc:2749] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:03:52.510082  1707 leader_election.cc:336] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:52.566666  1707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 56642.3us
W20260709 13:03:52.567860  1707 leader_election.cc:336] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:52.569569   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 1613)
I20260709 13:03:52.580363  8959 consensus_queue.cc:1048] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:03:52.537768  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 49982.8us
W20260709 13:03:52.540381  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 51306.9us
I20260709 13:03:52.588454  1705 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:52.591169  9011 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:03:52.591598  9011 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 28 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:52.591948  9011 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:03:52.562817  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:52.594446  2554 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 19.
I20260709 13:03:52.595820  1630 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:52.597294  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:52.598114  1734 raft_consensus.cc:2393] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 20: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:52.599928  9062 raft_consensus.cc:2804] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:52.600375  9062 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:52.600759  9062 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:52.602159  9045 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:52.505576  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 225862us
W20260709 13:03:52.607878  1707 leader_election.cc:336] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:52.616561  1705 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:52.641139  9069 raft_consensus.cc:2804] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:52.641628  9069 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:52.641999  9069 raft_consensus.cc:3060] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:52.643064  1707 leader_election.cc:336] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:52.645220  1705 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:52.647382  8959 raft_consensus.cc:2804] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:52.647903  8959 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:52.648518  8959 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:52.653734  9069 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:52.655130  1705 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:52.674204  9050 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:52.674750  9050 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:52.675230  9050 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:52.674937  1485 catalog_manager.cc:5697] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 19 to 20, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 20 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:52.681269  9069 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:52.656886  1707 leader_election.cc:336] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:52.685040  1707 consensus_peers.cc:597] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:52.692394  1732 raft_consensus.cc:2468] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 18.
I20260709 13:03:52.707835  9050 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:52.739135  9050 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:52.715202  9062 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:52.742591  9062 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:52.721294  9011 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:52.724254  1707 leader_election.cc:336] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:52.733522  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 46970us
I20260709 13:03:52.745316  9011 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 29 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:52.746189  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1be054223a4d3f90725c570db24bf5" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:03:52.746938  2554 raft_consensus.cc:3060] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:52.762265  1707 leader_election.cc:336] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:52.763156  1707 leader_election.cc:336] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:52.769011  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:52.772874  1663 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 21.
I20260709 13:03:52.772948  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:52.773744  1662 raft_consensus.cc:3060] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:52.769979  1661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:52.774778  1661 raft_consensus.cc:2393] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 20: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:52.772104  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:52.776079  1666 raft_consensus.cc:3060] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:52.779687  2554 raft_consensus.cc:2468] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 20.
I20260709 13:03:52.769435  1658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:52.780936  1658 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 16.
I20260709 13:03:52.781556  1630 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:52.782524  9062 raft_consensus.cc:2804] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:52.783038  9062 raft_consensus.cc:697] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 20 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:52.784089  9062 consensus_queue.cc:237] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:52.790505  8959 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:52.795339  1666 raft_consensus.cc:2468] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 14.
I20260709 13:03:52.784109  1662 raft_consensus.cc:2468] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 22.
I20260709 13:03:52.801916  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:52.802740  1662 raft_consensus.cc:3060] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 28 FOLLOWER]: Advancing to term 29
W20260709 13:03:52.805953  1707 leader_election.cc:336] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:52.815939  1662 raft_consensus.cc:2468] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 29.
I20260709 13:03:52.816816  1633 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:52.819257  1633 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:52.820340  1633 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
W20260709 13:03:52.823745  1477 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 268632us
I20260709 13:03:52.826805  8959 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:52.829300  9075 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:52.829769  9075 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:52.830154  9075 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:52.823256  1633 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:52.834600  9045 raft_consensus.cc:2804] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:52.835057  9045 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:52.835500  9045 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:52.821382  8961 raft_consensus.cc:2804] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:52.837716  8961 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:52.838097  8961 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:52.844348  1633 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:52.846576  9061 raft_consensus.cc:2764] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 29 FOLLOWER]: Leader pre-election decision vote started in defunct term 28: won
I20260709 13:03:52.821656  8979 raft_consensus.cc:2804] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:52.848829  8979 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:52.849267  8979 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:52.850030  1477 catalog_manager.cc:4755] TS 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 17b4f0abad654424ae8d47e63dbf2067: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:52.850231  1633 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:52.853506  9061 raft_consensus.cc:2804] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:52.854032  9061 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:52.854445  9061 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:52.861249  8959 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.861994  8959 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: true } }
I20260709 13:03:52.868621  1633 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:52.869686  9074 consensus_queue.cc:1048] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:03:52.871085  9074 raft_consensus.cc:2764] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:03:52.883343  8959 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:52.884277  1707 leader_election.cc:336] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:52.888366  1485 catalog_manager.cc:5697] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 19 to 20, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 20 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:52.895838  1633 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:52.900790  9062 raft_consensus.cc:2804] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:52.901607  9062 raft_consensus.cc:697] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 18 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:52.903075  9062 consensus_queue.cc:237] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:52.941223  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 45485.1us
W20260709 13:03:52.944810  1633 leader_election.cc:336] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:52.949043  8979 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:52.945731  9061 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:52.892584  9045 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:52.951395  8979 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:52.952409  8961 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:52.953394  1633 leader_election.cc:336] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:52.956527  1633 consensus_peers.cc:597] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:52.957799  1633 leader_election.cc:336] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:52.959735  1633 consensus_peers.cc:597] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:52.955529  9061 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:52.957571  9075 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:52.956598  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
I20260709 13:03:52.966781  2554 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:52.953070  9045 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:52.965131  1633 leader_election.cc:336] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:52.974336  1633 leader_election.cc:336] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:52.975450  1633 leader_election.cc:336] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:52.976269  9075 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 22 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:52.976792  1633 leader_election.cc:336] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:52.966068  8961 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:03:52.977842  1633 leader_election.cc:336] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:52.998246  2554 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 18.
I20260709 13:03:52.999709  1485 catalog_manager.cc:5697] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 17 to 18, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 18 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:53.009852  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:53.010931  1734 raft_consensus.cc:2393] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 14: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:53.074507  1705 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:53.075817  9011 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:53.076341  9011 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:53.076823  9011 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:53.089123  1705 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:53.091393  9070 raft_consensus.cc:2749] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:53.100059  1705 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:53.101311  8959 raft_consensus.cc:2804] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:53.101934  8959 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6d4de2ce0683442498244b9529127f91)
I20260709 13:03:53.102469  8959 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:53.110729  1705 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:53.111863  9050 raft_consensus.cc:2804] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:53.112391  9050 raft_consensus.cc:697] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 14 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:53.113341  9050 consensus_queue.cc:237] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:53.114516  1705 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:53.115830  9077 raft_consensus.cc:2804] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:53.116631  1732 raft_consensus.cc:1275] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:03:53.122190  8961 raft_consensus.cc:1064] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede: attempting to promote NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 to VOTER
W20260709 13:03:53.122768  8961 raft_consensus.cc:1068] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede: Unable to promote non-voter 7e839e91a1314c2f9a99b25b17c916a6: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:03:53.125249  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:53.126124  1662 raft_consensus.cc:2393] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 14: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:53.127849  9077 raft_consensus.cc:697] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 22 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:53.128916  9077 consensus_queue.cc:237] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:53.136442  1662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede" is_pre_election: true
I20260709 13:03:53.144227  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906dda27b6f84a53b2365339db2e3652" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:53.145131  1732 raft_consensus.cc:3060] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:53.146874  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:53.149121  9011 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:53.151749  9011 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:53.153573  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:53.154217  1733 raft_consensus.cc:3060] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:53.156492  1705 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:53.160529  1734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:53.161582  1734 raft_consensus.cc:2393] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 14: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:53.164816  9070 raft_consensus.cc:2804] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:03:53.165527  9070 raft_consensus.cc:697] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 29 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:53.166726  9070 consensus_queue.cc:237] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.17, Last appended by leader: 17, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:53.167479  1733 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 18.
I20260709 13:03:53.173702  1733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:53.174671  1733 raft_consensus.cc:2393] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 22: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
W20260709 13:03:53.175370  1707 leader_election.cc:336] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:53.172739  1732 raft_consensus.cc:2468] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 18.
I20260709 13:03:53.153271  8959 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:53.181766  1739 raft_consensus.cc:2393] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb87fe07da2414e84ee578c3b176ede in current term 17: Already voted for candidate 5ced62816f8545cd9b63a27e9055e42d in this term.
I20260709 13:03:53.190865  8959 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:53.200749  1633 leader_election.cc:336] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:53.201859  1633 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:53.206171  1485 catalog_manager.cc:5697] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 13 to 14, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 14 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:53.209600  8979 raft_consensus.cc:2749] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:03:53.208495  1707 leader_election.cc:336] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:53.210716  1707 consensus_peers.cc:597] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:53.210788  1633 consensus_peers.cc:597] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:53.238497  1633 leader_election.cc:336] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:53.260185  1707 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111) [suppressed 374 similar messages]
I20260709 13:03:53.268182  1705 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:53.269137  8959 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:53.272221  1633 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:53.270375  1707 consensus_peers.cc:597] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:53.275202  1705 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:53.277855  9070 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:03:53.275111  1485 catalog_manager.cc:5697] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 21 to 22, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 22 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:53.279063  8979 raft_consensus.cc:2749] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:53.279377  1485 catalog_manager.cc:5697] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 28 to 29, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 29 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:53.299467  9075 consensus_queue.cc:1048] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:53.312258  1633 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:53.321317  9075 raft_consensus.cc:2804] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:53.321905  9075 raft_consensus.cc:697] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 18 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:53.322890  9075 consensus_queue.cc:237] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:53.330905  1633 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:53.337286  9061 raft_consensus.cc:2804] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:53.337828  9061 raft_consensus.cc:697] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 18 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:53.338791  9061 consensus_queue.cc:237] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:53.366050  1485 catalog_manager.cc:5697] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 17 to 18, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 18 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:53.371299  2591 debug-util.cc:398] Leaking SignalData structure 0x7b08002a6800 after lost signal to thread 434
W20260709 13:03:53.372587  2591 debug-util.cc:398] Leaking SignalData structure 0x7b0800334f20 after lost signal to thread 1524
W20260709 13:03:53.374046  2591 debug-util.cc:398] Leaking SignalData structure 0x7b0800234460 after lost signal to thread 1691
I20260709 13:03:53.378134   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:03:53.379343  2591 debug-util.cc:398] Leaking SignalData structure 0x7b080035e240 after lost signal to thread 1765
W20260709 13:03:53.384006  2591 debug-util.cc:398] Leaking SignalData structure 0x7b0800074a60 after lost signal to thread 2594
I20260709 13:03:53.420543  1485 catalog_manager.cc:5697] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede reported cstate change: term changed from 17 to 18, leader changed from 6d4de2ce0683442498244b9529127f91 (127.0.107.193) to 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194). New cstate: current_term: 18 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:53.422745  1707 consensus_peers.cc:597] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:53.427542  8961 raft_consensus.cc:1064] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede: attempting to promote NON_VOTER 7e839e91a1314c2f9a99b25b17c916a6 to VOTER
W20260709 13:03:53.448211  1707 consensus_peers.cc:597] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:53.430842  8961 consensus_queue.cc:237] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 16, Current term: 26, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:53.478969  2426 consensus_peers.cc:597] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:53.484103  1633 leader_election.cc:336] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:53.485209  1633 leader_election.cc:336] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:53.488538  2537 raft_consensus.cc:1275] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [term 26 LEARNER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
W20260709 13:03:53.494046  1633 leader_election.cc:336] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:53.497804  1633 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:53.495712  8961 consensus_queue.cc:1048] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 13:03:53.518472  1707 consensus_peers.cc:597] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:53.521804  9075 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:03:53.523074  2426 consensus_peers.cc:597] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:53.522584  1633 leader_election.cc:336] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:53.533854  2426 consensus_peers.cc:597] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:53.535213  1633 leader_election.cc:336] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:53.546383  1633 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:53.554340  9062 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:03:53.554579  1633 leader_election.cc:336] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:53.555147  1633 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:53.560405  9075 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:03:53.559651  1707 consensus_peers.cc:597] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:53.568663  2426 consensus_peers.cc:597] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:53.642139  1732 raft_consensus.cc:1275] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:03:53.647152  1707 consensus_peers.cc:597] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:53.669262  2537 raft_consensus.cc:1275] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [term 20 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:03:53.672518  9061 consensus_queue.cc:1048] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:03:53.657665  1707 consensus_peers.cc:597] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:53.685928  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:53.686790  1666 raft_consensus.cc:2393] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 22: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
I20260709 13:03:53.692026  1666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5bb87fe07da2414e84ee578c3b176ede"
I20260709 13:03:53.692865  1666 raft_consensus.cc:2393] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ced62816f8545cd9b63a27e9055e42d in current term 17: Already voted for candidate 5bb87fe07da2414e84ee578c3b176ede in this term.
W20260709 13:03:53.706210  1707 consensus_peers.cc:597] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:53.759663  1658 raft_consensus.cc:1275] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:53.763415  2537 raft_consensus.cc:1275] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:03:53.765218  9062 consensus_queue.cc:1048] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:53.770573  1658 raft_consensus.cc:1275] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:03:53.773926  1733 raft_consensus.cc:1275] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 26 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:03:53.774488  1666 raft_consensus.cc:1275] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 29 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 28 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
W20260709 13:03:53.778393  1707 consensus_peers.cc:597] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:53.780113  1633 consensus_peers.cc:597] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:53.808491  1705 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:53.810318  9070 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:03:53.814430  1631 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.823088  1705 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:53.824499  9070 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:53.837929  9070 consensus_queue.cc:1048] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:03:53.843286  1707 consensus_peers.cc:597] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:53.870915  2426 consensus_peers.cc:597] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:53.871054  9062 consensus_queue.cc:1048] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:03:53.898952  1707 consensus_peers.cc:597] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:53.938273  9062 consensus_queue.cc:1048] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.018s
I20260709 13:03:53.980259   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:03:53.995601  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 57202.8us
I20260709 13:03:54.003106  9070 consensus_queue.cc:1048] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:03:54.004598  1739 raft_consensus.cc:1275] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:03:54.006789  1633 consensus_peers.cc:597] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:54.007337  1633 consensus_peers.cc:597] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:54.001528  9050 consensus_queue.cc:1048] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.008s
W20260709 13:03:54.001983  2426 consensus_peers.cc:597] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:54.019647  2426 consensus_peers.cc:597] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:54.019820  1633 consensus_peers.cc:597] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:54.020530  1633 consensus_peers.cc:597] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:54.026870  1707 consensus_peers.cc:597] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:54.029492  8961 consensus_queue.cc:1048] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:54.032539  1734 raft_consensus.cc:1275] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Refusing update from remote peer 5bb87fe07da2414e84ee578c3b176ede: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:03:54.041054  1705 consensus_peers.cc:597] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:54.042088  1705 consensus_peers.cc:597] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:54.037369  1477 catalog_manager.cc:4755] TS 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 17b4f0abad654424ae8d47e63dbf2067: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:54.044142  1705 consensus_peers.cc:597] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:54.047758  8979 consensus_queue.cc:1048] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:03:54.047957  1705 consensus_peers.cc:597] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:54.054536  1705 consensus_peers.cc:597] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:54.055198  1705 consensus_peers.cc:597] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:54.057185  2424 consensus_peers.cc:597] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:54.069296  2426 consensus_peers.cc:597] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:54.082794  1633 consensus_peers.cc:597] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:54.088430  2426 consensus_peers.cc:597] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:54.128520  2424 consensus_peers.cc:597] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:54.152288  2426 consensus_peers.cc:597] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:54.167606  2424 consensus_peers.cc:597] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:54.177518  1707 consensus_peers.cc:597] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:54.187942  8961 raft_consensus.cc:2955] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 26 LEADER]: Committing config change with OpId 26.18: config changed from index 16 to 18, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
I20260709 13:03:54.196081  2554 raft_consensus.cc:2955] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [term 26 FOLLOWER]: Committing config change with OpId 26.18: config changed from index 16 to 18, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
W20260709 13:03:54.220281  2424 consensus_peers.cc:597] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:54.272787  2424 consensus_peers.cc:597] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:54.298161  1486 catalog_manager.cc:5697] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: config changed from index 16 to 18, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 26 leader_uuid: "5bb87fe07da2414e84ee578c3b176ede" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
W20260709 13:03:54.359943  2424 consensus_peers.cc:597] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:54.383240  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 191080us
W20260709 13:03:54.385483  2424 consensus_peers.cc:597] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:54.424391  1733 raft_consensus.cc:2955] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 26 FOLLOWER]: Committing config change with OpId 26.18: config changed from index 16 to 18, 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } } }
W20260709 13:03:54.440233  1705 consensus_peers.cc:597] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:54.435043  2424 consensus_peers.cc:597] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:54.446864  2424 consensus_peers.cc:597] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:54.488029  2424 consensus_peers.cc:597] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:54.550034  2426 consensus_peers.cc:597] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:54.614612  1707 consensus_peers.cc:597] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:54.616838  1633 consensus_peers.cc:597] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:54.643878   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:54.650817   431 tablet_replica.cc:333] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:54.652288   431 raft_consensus.cc:2243] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:54.657298   431 raft_consensus.cc:2272] T f52de8c1489f4f9aabb361c6c02bb3de P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:54.671027   431 tablet_replica.cc:333] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
W20260709 13:03:54.671612  1633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 53613.3us
I20260709 13:03:54.672181   431 raft_consensus.cc:2243] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:03:54.673369   431 raft_consensus.cc:2272] T 7552d3c613c34834a3a9c7ce844572fd P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:54.690802   431 tablet_replica.cc:333] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:54.691797   431 raft_consensus.cc:2243] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:03:54.695726   431 raft_consensus.cc:2272] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:54.702111  1705 consensus_peers.cc:597] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:54.702608   431 tablet_replica.cc:333] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
W20260709 13:03:54.703445  1705 consensus_peers.cc:597] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:54.704094  1705 consensus_peers.cc:597] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:54.704686  1705 consensus_peers.cc:597] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:54.706370  1705 consensus_peers.cc:597] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:54.717583  1705 consensus_peers.cc:597] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:54.717736   431 raft_consensus.cc:2243] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:54.718564  1705 consensus_peers.cc:597] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:54.719413  1705 consensus_peers.cc:597] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:54.725589   431 raft_consensus.cc:2272] T efd803bfc7504e98806ec4a5030c66b1 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:54.729282   431 tablet_replica.cc:333] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:54.743023   431 raft_consensus.cc:2243] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:54.743827   431 raft_consensus.cc:2272] T 9eee8a552b4244ad8089de6467edd0d8 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:54.746711   431 tablet_replica.cc:333] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:54.747753   431 raft_consensus.cc:2243] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:54.773485  9061 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.774102  9061 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:54.776156  9061 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:54.777529   431 raft_consensus.cc:2272] T 5935c74e00334979a51afdc704e3b06f P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:54.794647   431 tablet_replica.cc:333] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:54.795647   431 raft_consensus.cc:2243] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:03:54.820354   431 raft_consensus.cc:2272] T b51b235c777d4de2876dfd783998c83f P 5bb87fe07da2414e84ee578c3b176ede [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:54.827504  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:54.828181  1736 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 20.
I20260709 13:03:54.835055   431 tablet_replica.cc:333] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:54.840130   431 raft_consensus.cc:2243] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:54.842290   431 raft_consensus.cc:2272] T 075c70e81e41467491c4134e5e9fd03a P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:54.840962  1633 consensus_peers.cc:597] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:54.869926   431 tablet_replica.cc:333] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:54.878925   431 raft_consensus.cc:2243] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:54.883333   431 raft_consensus.cc:2272] T 4490828942174c3c9092820cf3a81fe3 P 5bb87fe07da2414e84ee578c3b176ede [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:54.888685   431 tablet_replica.cc:333] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:54.889714   431 raft_consensus.cc:2243] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:03:54.885422  1633 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:54.890532  9075 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:54.891033  9075 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.891373  9075 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:03:54.909821  1633 consensus_peers.cc:597] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:54.910490  1633 leader_election.cc:336] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:54.913163   431 raft_consensus.cc:2272] T 3f40f76410ee41d696f4427ca4903962 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:54.924085   431 tablet_replica.cc:333] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
W20260709 13:03:54.932258  1633 consensus_peers.cc:597] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:54.904883  9075 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:54.935319  9075 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 21 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:54.936231   431 raft_consensus.cc:2243] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:54.937131   431 raft_consensus.cc:2272] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:54.940346   431 tablet_replica.cc:333] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:54.943018  9062 raft_consensus.cc:493] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.943831  9062 raft_consensus.cc:515] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:54.946461  9062 leader_election.cc:290] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:54.953526   431 raft_consensus.cc:2243] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:54.954758   431 raft_consensus.cc:2272] T c3d6305e583540c895021f5a180689f7 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:54.957500   431 tablet_replica.cc:333] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:54.958314   431 raft_consensus.cc:2243] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:54.958899   431 raft_consensus.cc:2272] T 40fb069a8f6e4d0c885835eee0132b00 P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:54.962493  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0a975df857466d9daf2f71f1c98623" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:54.965490  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90426dc5094b4f3c855ea9d2a43bc452" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:54.966230  1739 raft_consensus.cc:3060] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:03:54.984285  1633 leader_election.cc:336] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:54.984952  1633 leader_election.cc:336] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:54.985761   431 tablet_replica.cc:333] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:54.986990   431 raft_consensus.cc:2243] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:54.987108  1633 leader_election.cc:304] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:54.987643   431 raft_consensus.cc:2272] T 619fbae81e504a9b9671de42f0e75aea P 5bb87fe07da2414e84ee578c3b176ede [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:54.988680  9075 raft_consensus.cc:2749] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:54.990728   431 tablet_replica.cc:333] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:54.991740   431 raft_consensus.cc:2243] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.000299  1739 raft_consensus.cc:2468] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 21.
I20260709 13:03:54.992925   431 raft_consensus.cc:2272] T c5248b829f494452a558e65e2342b6f0 P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.019374   431 tablet_replica.cc:333] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:55.020238   431 raft_consensus.cc:2243] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.021457   431 raft_consensus.cc:2272] T 3aff654153ad4acfa774f838f37c0604 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.024413   431 tablet_replica.cc:333] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:55.033648   431 raft_consensus.cc:2243] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.034935   431 raft_consensus.cc:2272] T d1fb6d43d14545a9872b287d4096ff1a P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.036325  1633 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:55.037632  9075 raft_consensus.cc:2804] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:55.038177  9075 raft_consensus.cc:697] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 21 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:55.039074  9075 consensus_queue.cc:237] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:55.046473  9062 raft_consensus.cc:493] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.046937   431 tablet_replica.cc:333] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:55.047137  9062 raft_consensus.cc:515] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:55.048640   431 raft_consensus.cc:2243] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.049824  9062 leader_election.cc:290] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:55.053841   431 raft_consensus.cc:2272] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.054131  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1883da16ec44d2a8304d3909471b4b1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:55.056833   431 tablet_replica.cc:333] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:55.057971   431 raft_consensus.cc:2243] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 23 LEADER]: Raft consensus shutting down.
W20260709 13:03:55.058590  1633 leader_election.cc:336] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:55.059104  1633 leader_election.cc:304] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:55.059441   431 raft_consensus.cc:2272] T bd6e8a8a10c144f1bd64e638805e7a5a P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.060025  9062 raft_consensus.cc:2749] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:03:55.070072  9062 raft_consensus.cc:493] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.070655  9062 raft_consensus.cc:515] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:55.076768  9062 leader_election.cc:290] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:55.078841  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67258bf3ca484bd099fd3ec7923aee78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:03:55.080417  1633 leader_election.cc:336] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:55.081284  1633 leader_election.cc:304] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:55.084794  9075 raft_consensus.cc:2749] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:55.092159   431 tablet_replica.cc:333] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:55.092985   431 raft_consensus.cc:2243] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.093585   431 raft_consensus.cc:2272] T b37805060ac444b6b6e9e7da8164233c P 5bb87fe07da2414e84ee578c3b176ede [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.095772  9075 raft_consensus.cc:493] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:55.096293  9075 raft_consensus.cc:515] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:55.098448  9062 raft_consensus.cc:493] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e839e91a1314c2f9a99b25b17c916a6)
I20260709 13:03:55.098989  9062 raft_consensus.cc:515] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:55.100651  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1310c9ee464797a39b786c1d932941" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:55.101047  9062 leader_election.cc:290] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:03:55.101159  1707 consensus_peers.cc:597] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:55.102810  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:55.098496  9075 leader_election.cc:290] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:55.109532  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f63738689324ca9a4caa66b9aee2a78" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:55.096315   431 tablet_replica.cc:333] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:55.112573   431 raft_consensus.cc:2243] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.112534  1633 leader_election.cc:304] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:55.117000   431 raft_consensus.cc:2272] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.119750  9062 raft_consensus.cc:2749] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:55.126528   431 tablet_replica.cc:333] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:55.127390   431 raft_consensus.cc:2243] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.128125   431 raft_consensus.cc:2272] T 35fc0eeb87e24045a897daa0ad5c400b P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.130739   431 tablet_replica.cc:333] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:55.131449   431 raft_consensus.cc:2243] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:55.120844  1633 leader_election.cc:336] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:55.136189  1633 leader_election.cc:304] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:55.144217  9062 raft_consensus.cc:2749] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:55.132191   431 raft_consensus.cc:2272] T 5b8e576fb1634970b28a86f720e85f9a P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.153151   431 tablet_replica.cc:333] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:55.153986   431 raft_consensus.cc:2243] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.162714   431 raft_consensus.cc:2272] T 7e07e22e745346fa98096d8b909dc7f5 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.165529   431 tablet_replica.cc:333] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:55.166304   431 raft_consensus.cc:2243] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.167086   431 raft_consensus.cc:2272] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.167528  9062 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.167955  9062 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:55.170189  9062 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:55.174759   431 tablet_replica.cc:333] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:55.175486  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:55.175693   431 raft_consensus.cc:2243] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.176192  1736 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 17.
I20260709 13:03:55.189759   431 raft_consensus.cc:2272] T 0fbe5a86d7bd4880843e631ffca572ce P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.197603   431 tablet_replica.cc:333] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:55.197800  9075 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:55.198431   431 raft_consensus.cc:2243] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.198336  9075 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:55.199137   431 raft_consensus.cc:2272] T 8f63738689324ca9a4caa66b9aee2a78 P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.200569  9075 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:55.202437  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:55.211298  1633 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:55.212383  9075 raft_consensus.cc:2804] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:55.212810  9075 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.213176  9075 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:55.214638  9062 raft_consensus.cc:493] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:55.215276  9062 raft_consensus.cc:515] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:55.217762  9062 leader_election.cc:290] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:55.214471   431 tablet_replica.cc:333] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:55.219216   431 raft_consensus.cc:2243] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.220237  9062 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:55.220821  9062 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:55.224534  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:55.225893  9118 raft_consensus.cc:493] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:55.226511  9118 raft_consensus.cc:515] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:55.228830  9118 leader_election.cc:290] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:55.230173  9062 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:55.220033   431 raft_consensus.cc:2272] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5bb87fe07da2414e84ee578c3b176ede [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.238797  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b4f0abad654424ae8d47e63dbf2067" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:55.241022   431 tablet_replica.cc:333] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:55.242038   431 raft_consensus.cc:2243] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.243433   431 raft_consensus.cc:2272] T ef1be054223a4d3f90725c570db24bf5 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:55.248095  1633 leader_election.cc:336] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:55.236450  9075 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:55.251376  9075 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:55.253455   431 tablet_replica.cc:333] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:55.254419   431 raft_consensus.cc:2243] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.255486  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed05ccb8c31f47b18b3bdea87b5b2e3a" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:55.256362  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500c740c1014c08b4ea992c888446ed" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:55.262563  1732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d03acc62b5400ebdca03680f553818" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:55.264271  9075 raft_consensus.cc:493] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:03:55.264889  9075 raft_consensus.cc:515] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:55.267234  9075 leader_election.cc:290] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:55.273535   431 pending_rounds.cc:70] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede: Trying to abort 1 pending ops.
I20260709 13:03:55.275853   431 pending_rounds.cc:77] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede: Aborting op as it isn't in flight: id { term: 21 index: 13 } timestamp: 7305634754744188928 op_type: NO_OP noop_request { }
I20260709 13:03:55.277045   431 raft_consensus.cc:2889] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 21 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:55.278851   431 raft_consensus.cc:2272] T 90426dc5094b4f3c855ea9d2a43bc452 P 5bb87fe07da2414e84ee578c3b176ede [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.279001  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5139331dd452b8c2a035da1db88dc" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:55.279613  1736 raft_consensus.cc:3060] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:55.286621  9125 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.287403  9125 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:55.296917   431 tablet_replica.cc:333] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:55.298298  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b16912bb6d94c80b8ff8e641268e238" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:55.299872  9125 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:55.303170  1736 raft_consensus.cc:2468] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 18.
W20260709 13:03:55.305903  1707 leader_election.cc:336] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:55.316459   431 raft_consensus.cc:2243] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.308911  1633 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:55.324630  9075 raft_consensus.cc:2749] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:55.326195  1633 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:55.326992  9075 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:55.327144   431 raft_consensus.cc:2272] T 390554a5bb3c4780b61e0fc806cea161 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.329921   431 tablet_replica.cc:333] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:55.330677   431 raft_consensus.cc:2243] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.331089  1633 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:55.332068  9075 raft_consensus.cc:2804] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:55.332283   431 raft_consensus.cc:2272] T bd728f93afb447e384035fae1af6b006 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.332544  9075 raft_consensus.cc:697] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 18 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:55.333448  9075 consensus_queue.cc:237] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:55.335170  9118 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.335727  9118 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:55.338020  9118 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:55.339234  1633 leader_election.cc:336] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:55.340648  1633 leader_election.cc:304] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:55.342228  9118 raft_consensus.cc:2749] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:03:55.343449  1633 leader_election.cc:336] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:55.344679  1633 leader_election.cc:304] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:55.346405  9118 raft_consensus.cc:2749] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:03:55.347524  1633 leader_election.cc:336] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:55.355005   431 tablet_replica.cc:333] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:55.355109  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:55.355751  1736 raft_consensus.cc:2468] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 14.
I20260709 13:03:55.355948   431 raft_consensus.cc:2243] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:55.363374  1633 leader_election.cc:336] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:55.363931  1633 leader_election.cc:304] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:55.364737  9075 raft_consensus.cc:2749] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:55.368047   431 raft_consensus.cc:2272] T 0500c740c1014c08b4ea992c888446ed P 5bb87fe07da2414e84ee578c3b176ede [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.370966   431 tablet_replica.cc:333] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:55.371784   431 raft_consensus.cc:2243] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.372844   431 raft_consensus.cc:2272] T c26b89190fef4c8199109d4bbabf2395 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.375696   431 tablet_replica.cc:333] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:55.376502   431 raft_consensus.cc:2243] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.376645  1633 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:55.377759  9075 raft_consensus.cc:2804] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:55.378180  9075 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.378537  9075 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:55.387014  9075 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:55.387574  1633 leader_election.cc:336] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:55.398154   431 raft_consensus.cc:2272] T 67258bf3ca484bd099fd3ec7923aee78 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.398154  9075 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:55.400992   431 tablet_replica.cc:333] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:55.401799   431 raft_consensus.cc:2243] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.402417   431 raft_consensus.cc:2272] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:55.406488  1705 leader_election.cc:336] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:55.406952  1705 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:55.408126  8959 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:55.412406  9075 raft_consensus.cc:670] T 75a149db07824e3fb3c1f721b61d6c20 P 5bb87fe07da2414e84ee578c3b176ede: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopped [suppressed 1 similar messages]
I20260709 13:03:55.412290  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99151421d7f641c2b26a05af014a9dc1" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:55.413131  1736 raft_consensus.cc:3060] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:55.417878  1633 leader_election.cc:336] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:55.430274  1736 raft_consensus.cc:2468] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 15.
I20260709 13:03:55.431690  1633 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:55.435524   431 tablet_replica.cc:333] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:55.436486   431 raft_consensus.cc:2243] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.437849   431 raft_consensus.cc:2272] T 906dda27b6f84a53b2365339db2e3652 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.441278  9075 raft_consensus.cc:2804] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:55.447263  9075 raft_consensus.cc:697] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 15 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:55.450950  9075 consensus_queue.cc:237] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:55.456277   431 tablet_replica.cc:333] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:55.457439   431 raft_consensus.cc:2243] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.486893   431 raft_consensus.cc:2272] T 53c3c6ae566d4afda95ffc509772bca1 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.499218  9075 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.499732  9075 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:55.501804  9075 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:55.504112  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:55.504907  1736 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 22.
I20260709 13:03:55.506234  1633 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 
I20260709 13:03:55.514487   431 tablet_replica.cc:333] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:55.516521   431 raft_consensus.cc:2243] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.520787   431 pending_rounds.cc:70] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede: Trying to abort 1 pending ops.
I20260709 13:03:55.521133   431 pending_rounds.cc:77] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede: Aborting op as it isn't in flight: id { term: 18 index: 10 } timestamp: 7305634755936276480 op_type: NO_OP noop_request { }
I20260709 13:03:55.521526   431 raft_consensus.cc:2889] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 18 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:55.521320  9075 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:55.522051   431 raft_consensus.cc:2272] T 7cf5139331dd452b8c2a035da1db88dc P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.522132  9075 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.524152  9075 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:03:55.525295  1633 leader_election.cc:336] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:55.538810  1707 consensus_peers.cc:597] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:03:55.547217   431 tablet_replica.cc:333] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:55.573148   431 raft_consensus.cc:2243] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.576155   431 pending_rounds.cc:70] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede: Trying to abort 1 pending ops.
I20260709 13:03:55.576563   431 pending_rounds.cc:77] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede: Aborting op as it isn't in flight: id { term: 15 index: 9 } timestamp: 7305634756509220864 op_type: NO_OP noop_request { }
I20260709 13:03:55.577464   431 raft_consensus.cc:2889] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 15 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:55.580199   431 raft_consensus.cc:2272] T 99151421d7f641c2b26a05af014a9dc1 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.579309  9075 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:55.597783   431 tablet_replica.cc:333] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:55.604658   431 raft_consensus.cc:2243] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.605311   431 raft_consensus.cc:2272] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5bb87fe07da2414e84ee578c3b176ede [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.608359   431 tablet_replica.cc:333] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:55.609133   431 raft_consensus.cc:2243] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.612483  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f6e5a8ef2b453189832346af645cd8" candidate_uuid: "5bb87fe07da2414e84ee578c3b176ede" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:55.613137  1736 raft_consensus.cc:3060] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:03:55.621430  1633 leader_election.cc:336] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:55.621707   431 raft_consensus.cc:2272] T 7b0a975df857466d9daf2f71f1c98623 P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.622219  1736 raft_consensus.cc:2468] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb87fe07da2414e84ee578c3b176ede in term 23.
I20260709 13:03:55.623378  1633 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91
I20260709 13:03:55.624130  9118 raft_consensus.cc:2804] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:03:55.624585   431 tablet_replica.cc:333] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:55.624636  9118 raft_consensus.cc:697] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 23 LEADER]: Becoming Leader. State: Replica: 5bb87fe07da2414e84ee578c3b176ede, State: Running, Role: LEADER
I20260709 13:03:55.625533   431 raft_consensus.cc:2243] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.626293   431 raft_consensus.cc:2272] T 3b16912bb6d94c80b8ff8e641268e238 P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.627487  9118 consensus_queue.cc:237] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:55.632192  9075 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [CANDIDATE]: Term 23 election: Requested vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:55.649885   431 tablet_replica.cc:333] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:55.650806   431 raft_consensus.cc:2243] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.651736   431 raft_consensus.cc:2272] T 17b4f0abad654424ae8d47e63dbf2067 P 5bb87fe07da2414e84ee578c3b176ede [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.666555   431 tablet_replica.cc:333] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:55.667428   431 raft_consensus.cc:2243] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.668315   431 raft_consensus.cc:2272] T d1883da16ec44d2a8304d3909471b4b1 P 5bb87fe07da2414e84ee578c3b176ede [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.671074   431 tablet_replica.cc:333] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:55.671813   431 raft_consensus.cc:2243] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.672384   431 raft_consensus.cc:2272] T 06d03acc62b5400ebdca03680f553818 P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.675176   431 tablet_replica.cc:333] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:55.675890   431 raft_consensus.cc:2243] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.688751   431 raft_consensus.cc:2272] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5bb87fe07da2414e84ee578c3b176ede [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.691854   431 tablet_replica.cc:333] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:55.692801   431 raft_consensus.cc:2243] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.693605   431 raft_consensus.cc:2272] T ae1310c9ee464797a39b786c1d932941 P 5bb87fe07da2414e84ee578c3b176ede [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.696832   431 tablet_replica.cc:333] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:55.697006  9127 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:55.697482   431 raft_consensus.cc:2243] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.697602  9127 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:55.698660   431 raft_consensus.cc:2272] T c47af644bb6145d7bf8d0aaa1d74000d P 5bb87fe07da2414e84ee578c3b176ede [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.701822   431 tablet_replica.cc:333] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede: stopping tablet replica
I20260709 13:03:55.702523   431 raft_consensus.cc:2243] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.703680   431 pending_rounds.cc:70] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede: Trying to abort 1 pending ops.
I20260709 13:03:55.703986   431 pending_rounds.cc:77] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede: Aborting op as it isn't in flight: id { term: 23 index: 11 } timestamp: 7305634757140787200 op_type: NO_OP noop_request { }
I20260709 13:03:55.704375   431 raft_consensus.cc:2889] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 23 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:55.704789   431 raft_consensus.cc:2272] T d8f6e5a8ef2b453189832346af645cd8 P 5bb87fe07da2414e84ee578c3b176ede [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:55.711488  2424 leader_election.cc:336] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:55.720393  2426 leader_election.cc:336] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:55.721097  2426 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:55.748588  9127 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:55.749329  9127 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:03:55.750468  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:03:55.816176  1707 consensus_peers.cc:597] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:55.862082  1707 consensus_peers.cc:597] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:55.893337  1707 consensus_peers.cc:597] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:03:55.938885  8959 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:55.939488  8959 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:55.949672  1705 leader_election.cc:336] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:03:55.941668  8959 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:55.968423  1707 leader_election.cc:336] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:55.969007  1707 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:55.970472  9125 raft_consensus.cc:2749] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:03:55.978914  1707 consensus_peers.cc:597] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:55.989017  1707 consensus_peers.cc:597] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:56.005105  9125 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:56.005795  9125 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:56.008437  9125 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:56.014536  1705 leader_election.cc:336] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:03:56.015676  8959 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:56.016387  9136 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:56.016219  8959 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:56.016983  9136 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:56.018631  8959 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:56.019111  9136 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:56.019330  1707 leader_election.cc:336] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:56.019774  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:56.019866  1707 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:56.025099  9125 raft_consensus.cc:2749] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:56.029392  9125 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:56.030011  9125 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:56.032653  9125 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:56.035284  1705 leader_election.cc:336] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:03:56.035842  1705 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:56.036643  9136 raft_consensus.cc:2749] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:56.036923  1705 leader_election.cc:336] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:03:56.038246  9133 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:56.038760  9133 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:56.042451  1707 leader_election.cc:336] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:56.042944  1707 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:56.046478  9136 raft_consensus.cc:2749] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:03:56.047613  1707 leader_election.cc:336] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:56.040942  9133 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:56.056775  2426 consensus_peers.cc:597] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:03:56.063001  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:03:56.068008  1705 leader_election.cc:336] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:03:56.068427  1705 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:56.069198  9136 raft_consensus.cc:2749] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:56.075382  1707 consensus_peers.cc:597] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:56.087586  2424 leader_election.cc:336] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:03:56.088119  2424 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:03:56.088948  9133 raft_consensus.cc:2749] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:56.095594  9133 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:56.096161  9133 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:56.099929  9133 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:56.103242  2426 leader_election.cc:336] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:56.109108  9133 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:56.109807  9133 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:56.111308  2426 consensus_peers.cc:597] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:03:56.112187  9133 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:56.113411  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:56.117489  1736 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 15.
I20260709 13:03:56.118655  2426 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
I20260709 13:03:56.121068  9133 raft_consensus.cc:2804] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:56.121603  9133 raft_consensus.cc:493] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:56.122344  9133 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:56.125324  2424 leader_election.cc:336] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:03:56.126839  2424 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:56.129849  9078 raft_consensus.cc:2749] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:56.146921  2424 leader_election.cc:336] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
W20260709 13:03:56.172447  1707 consensus_peers.cc:597] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:03:56.175557  9125 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:56.176198  9125 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:56.179947  9125 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:56.185308  1705 leader_election.cc:336] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
W20260709 13:03:56.187031  1707 leader_election.cc:336] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:56.187496  1707 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:56.191316  9125 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:56.199241  2426 consensus_peers.cc:597] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:03:56.201707  9133 raft_consensus.cc:515] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:56.205103  9133 leader_election.cc:290] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 16 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:56.209344  1477 catalog_manager.cc:4755] TS 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 17b4f0abad654424ae8d47e63dbf2067: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:56.209482  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fb6d43d14545a9872b287d4096ff1a" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d"
I20260709 13:03:56.210189  1736 raft_consensus.cc:3060] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:56.211429  1707 consensus_peers.cc:597] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:56.213481  1707 consensus_peers.cc:597] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:03:56.225939  1736 raft_consensus.cc:2468] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 16.
W20260709 13:03:56.226861  2426 consensus_peers.cc:597] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:56.234632  1707 consensus_peers.cc:597] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:56.236052  2424 leader_election.cc:336] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:03:56.237237  9134 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:56.237876  9134 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:56.240592  9134 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:56.246064  2426 leader_election.cc:336] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:56.250254  2426 leader_election.cc:304] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:56.253273  9127 raft_consensus.cc:2804] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:56.253803  9127 raft_consensus.cc:697] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 LEADER]: Becoming Leader. State: Replica: 7e839e91a1314c2f9a99b25b17c916a6, State: Running, Role: LEADER
I20260709 13:03:56.254689  9127 consensus_queue.cc:237] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:56.275861  9136 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:56.276464  9136 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:56.280352  9136 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:56.280263  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:03:56.281241  2554 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 19.
I20260709 13:03:56.282656  1704 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 
W20260709 13:03:56.280230  2424 leader_election.cc:336] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:03:56.283743  9136 raft_consensus.cc:2804] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:56.284746  9136 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:56.285157  9136 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:56.285763  2424 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:56.287932  9133 raft_consensus.cc:2749] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:56.295043  1705 leader_election.cc:336] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:03:56.305258  9136 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:56.306582  2426 consensus_peers.cc:597] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:56.311558  1705 leader_election.cc:336] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:03:56.314953  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7552d3c613c34834a3a9c7ce844572fd" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6"
W20260709 13:03:56.315308  2426 consensus_peers.cc:597] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:03:56.315528  2554 raft_consensus.cc:3060] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:56.323776  2554 raft_consensus.cc:2468] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 20.
I20260709 13:03:56.323661  1485 catalog_manager.cc:5697] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 reported cstate change: term changed from 15 to 16, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196). New cstate: current_term: 16 leader_uuid: "7e839e91a1314c2f9a99b25b17c916a6" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.324951  1704 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede
I20260709 13:03:56.325832  8959 raft_consensus.cc:2804] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:56.332791  9136 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 20 election: Requested vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:56.340899  9136 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:56.341450  9136 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:56.345265  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:03:56.348982  1705 consensus_peers.cc:597] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:56.358794  1707 leader_election.cc:336] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:56.359216  1707 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 6d4de2ce0683442498244b9529127f91, 7e839e91a1314c2f9a99b25b17c916a6
I20260709 13:03:56.353240  9136 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:56.360613  9136 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:56.362028  9136 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:56.366267  2426 consensus_peers.cc:597] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:03:56.366969  9125 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:56.367875  9136 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:03:56.369349  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
W20260709 13:03:56.372668  1705 leader_election.cc:336] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:03:56.374328  2554 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 26.
W20260709 13:03:56.374426  1705 leader_election.cc:336] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:03:56.393802  8959 raft_consensus.cc:697] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 20 LEADER]: Becoming Leader. State: Replica: 5ced62816f8545cd9b63a27e9055e42d, State: Running, Role: LEADER
I20260709 13:03:56.394817  8959 consensus_queue.cc:237] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:56.401623  1705 consensus_peers.cc:597] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:56.405685  1707 leader_election.cc:336] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:56.406189  1707 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:56.406950  9143 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:03:56.433976  1486 catalog_manager.cc:5697] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d reported cstate change: term changed from 19 to 20, leader changed from 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194) to 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195). New cstate: current_term: 20 leader_uuid: "5ced62816f8545cd9b63a27e9055e42d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.436931  8959 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:56.437463  8959 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:56.444823  8959 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:56.445603  1705 leader_election.cc:336] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
W20260709 13:03:56.446280  1707 leader_election.cc:336] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:56.446691  1707 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:56.447726  8959 raft_consensus.cc:2749] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:03:56.466689  1707 consensus_peers.cc:597] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:56.475004  2424 consensus_peers.cc:597] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:56.478152  9143 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:56.478718  9143 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:56.483625  9143 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:56.486943  1705 leader_election.cc:336] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
W20260709 13:03:56.487788  1707 leader_election.cc:336] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:56.488097  2426 consensus_peers.cc:597] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:03:56.488251  1707 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:56.489655  9143 raft_consensus.cc:2749] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:56.490151  1705 consensus_peers.cc:597] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:56.512446  2426 consensus_peers.cc:597] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:03:56.516322  9143 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:56.516968  9143 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:56.526036  1705 leader_election.cc:336] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
W20260709 13:03:56.528841  2426 consensus_peers.cc:597] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:03:56.533790  9143 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:56.534880  2424 consensus_peers.cc:597] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:56.536818  1707 leader_election.cc:336] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:56.537323  1707 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:56.538789  9143 raft_consensus.cc:2749] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:03:56.547955  2424 consensus_peers.cc:597] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:56.550585  1705 consensus_peers.cc:597] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:56.563668  1705 consensus_peers.cc:597] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:56.567091  1705 consensus_peers.cc:597] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:56.606318  9143 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:56.607025  9143 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:56.612383  9143 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:56.618254  1707 leader_election.cc:336] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:56.619087  1705 leader_election.cc:336] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:03:56.619517  1705 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:56.620275  9143 raft_consensus.cc:2749] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:56.631788  2424 consensus_peers.cc:597] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:56.649973  2424 consensus_peers.cc:597] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:56.650153  1705 consensus_peers.cc:597] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:56.651618  9143 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:56.652185  9143 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:56.654407  9143 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:56.660463  1707 leader_election.cc:336] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:56.664019  1705 leader_election.cc:336] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:03:56.664449  1705 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:56.668036  9143 raft_consensus.cc:2749] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:56.669896  1707 consensus_peers.cc:597] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:56.685130  1705 consensus_peers.cc:597] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:56.696455  8959 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:56.696959  8959 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:56.698961  8959 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:56.710217  1707 leader_election.cc:336] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:56.714542  1705 consensus_peers.cc:597] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:56.715112  1705 consensus_peers.cc:597] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:56.715518  1705 leader_election.cc:336] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:03:56.715942  1705 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:56.717420  8959 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:56.731455  2424 consensus_peers.cc:597] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:56.740969  2424 consensus_peers.cc:597] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:56.750774  9127 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:56.751459  9127 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:56.752287  1739 raft_consensus.cc:1275] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Refusing update from remote peer 7e839e91a1314c2f9a99b25b17c916a6: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:03:56.753942  9134 consensus_queue.cc:1048] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:56.756917  9127 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:56.760850  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:56.765129  8959 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
W20260709 13:03:56.768520  2426 leader_election.cc:336] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:56.769799  1736 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 18.
I20260709 13:03:56.769799  8959 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:56.772260  8959 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:56.776705  2424 leader_election.cc:336] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
W20260709 13:03:56.778244  1707 leader_election.cc:336] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:56.781958  1705 leader_election.cc:336] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:03:56.782990  1705 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:56.785254  9143 raft_consensus.cc:2749] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:56.791656  1707 consensus_peers.cc:597] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:56.813223  1705 consensus_peers.cc:597] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:56.781844  2424 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:56.816768  9133 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:56.823683  2554 raft_consensus.cc:1275] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 20 FOLLOWER]: Refusing update from remote peer 5ced62816f8545cd9b63a27e9055e42d: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:03:56.825489  8959 consensus_queue.cc:1048] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:03:56.850137  2424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41683, user_credentials={real_user=slave}} blocked reactor thread for 80787.5us
I20260709 13:03:56.851780  8959 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:56.852545  8959 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:56.857705  8959 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:56.865037  2424 consensus_peers.cc:597] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:56.865134  1705 leader_election.cc:336] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
W20260709 13:03:56.867061  2424 consensus_peers.cc:597] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:56.867961  2424 consensus_peers.cc:597] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:56.869164  1707 leader_election.cc:336] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:56.870075  1707 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:56.872956  9143 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:56.884775  2426 consensus_peers.cc:597] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:56.910909  1705 consensus_peers.cc:597] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:56.925698  2424 consensus_peers.cc:597] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:56.929101  1705 consensus_peers.cc:597] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:56.930528  9143 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:56.931124  9143 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:56.934826  9143 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:56.940765  1705 leader_election.cc:336] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
W20260709 13:03:56.943418  1707 leader_election.cc:336] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:56.943928  1707 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:56.944677  9143 raft_consensus.cc:2749] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:56.945914   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 1688)
W20260709 13:03:56.986052  1705 consensus_peers.cc:597] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:56.989298  9143 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:56.989900  9143 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:56.992199  9143 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:57.005791  1707 leader_election.cc:336] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:57.013059  1705 leader_election.cc:336] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:03:57.013712  1705 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:57.015192  9143 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:57.016085  1707 consensus_peers.cc:597] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:57.227587  1705 consensus_peers.cc:597] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:57.263299  1705 consensus_peers.cc:597] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:57.268361  9141 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.268973  9141 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:57.271257  9141 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:57.277472  1707 leader_election.cc:336] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:57.281872  1705 leader_election.cc:336] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:03:57.282356  1705 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:57.285393  9141 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:57.552223  9155 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:57.552868  9155 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:57.555325  9155 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:57.567335  1705 leader_election.cc:336] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
W20260709 13:03:57.568279  1707 leader_election.cc:336] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:57.568729  1707 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:57.575400  9155 raft_consensus.cc:2749] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:57.607342  9155 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:57.607905  9155 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:57.610107  9155 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:57.616592  1705 leader_election.cc:336] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
W20260709 13:03:57.620683  1707 leader_election.cc:336] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:57.621220  1707 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:57.622653  9155 raft_consensus.cc:2749] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:03:57.646241  1707 consensus_peers.cc:597] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:57.845857  9141 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:57.846483  9141 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:57.853423  9141 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:57.861881  1707 leader_election.cc:336] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:57.864635  1705 leader_election.cc:336] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:03:57.865165  1705 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:57.865954  9141 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:57.929404  1707 consensus_peers.cc:597] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:57.946390   431 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 1688)
I20260709 13:03:57.964613  9151 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:57.965302  9151 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:57.967558  9151 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:57.983536  2426 leader_election.cc:336] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:57.995131  2424 leader_election.cc:336] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:03:57.995708  2424 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:57.998868  9127 raft_consensus.cc:2749] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:58.041811  9155 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:58.042498  9155 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:58.044782  9155 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:58.049786  9141 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:58.050345  9141 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:58.052613  9141 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:58.081771  1707 leader_election.cc:336] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:58.085122  1707 leader_election.cc:336] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:58.086195  9141 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.086719  9141 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:58.090943  9155 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.091495  9155 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:58.093710  1705 leader_election.cc:336] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:03:58.095086  1705 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:58.095216  9141 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:58.095758  9155 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:58.096029  9141 raft_consensus.cc:2749] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:03:58.097157  1705 leader_election.cc:336] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:03:58.097596  1705 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:58.102567  9141 raft_consensus.cc:2749] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:58.107406  1707 leader_election.cc:336] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:58.108006  1707 leader_election.cc:336] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:58.155212  9141 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:58.155874  9141 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:58.157267  9127 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:58.158023  9127 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:58.158514  9141 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:58.159250  1707 consensus_peers.cc:597] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:03:58.160363  9141 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.160876  9141 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:58.161746  9127 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:58.163058  9141 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:58.164759  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
W20260709 13:03:58.164907  1705 leader_election.cc:336] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:03:58.165413  1736 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 26.
I20260709 13:03:58.165354  1705 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:58.171373  2426 leader_election.cc:336] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:58.172174  9141 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:03:58.172245  2424 leader_election.cc:336] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:03:58.172967  2424 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:58.173753  9127 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:03:58.174911  1705 leader_election.cc:336] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:03:58.175400  1705 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:58.179159  9155 raft_consensus.cc:2749] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:03:58.177886  1707 leader_election.cc:336] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:58.182236  1707 leader_election.cc:336] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:58.213040  1705 leader_election.cc:336] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:03:58.213610  1705 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:58.224037  9141 raft_consensus.cc:2749] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:58.234858  1705 leader_election.cc:336] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:03:58.235365  1705 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:58.236117  9141 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:58.268110  2424 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111) [suppressed 647 similar messages]
I20260709 13:03:58.339066  9151 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:58.339620  9151 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:58.346273  2426 leader_election.cc:336] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:58.347795  9151 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:58.376973  1707 consensus_peers.cc:597] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:58.434710  2426 consensus_peers.cc:597] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:03:58.475843  9155 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:58.476580  9155 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:58.477937  9141 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:58.478514  9141 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:58.480885  9141 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:58.487071  1707 consensus_peers.cc:597] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:03:58.495702  9155 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:58.496371  1707 leader_election.cc:336] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:58.497656  1707 leader_election.cc:336] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:58.498349  1705 leader_election.cc:336] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:03:58.499876  1705 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:58.503572  9155 raft_consensus.cc:2749] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:03:58.523183  1707 consensus_peers.cc:597] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:58.532222  2426 consensus_peers.cc:597] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:58.533222  1705 leader_election.cc:336] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:03:58.544232  1705 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:58.547149  9155 raft_consensus.cc:2749] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:58.551934  2426 consensus_peers.cc:597] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:03:58.559857  9155 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:58.560490  9155 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:58.562814  9155 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:58.568611  1707 leader_election.cc:336] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:58.579208  9141 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:58.579849  9141 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:58.582003  9141 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:58.578862  9155 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:58.583119  9155 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:58.591500  9155 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:58.604043  1705 leader_election.cc:336] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:03:58.604696  1705 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:58.609665  9141 raft_consensus.cc:2749] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:58.621721  9151 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:58.622321  9151 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:03:58.621166  1707 consensus_peers.cc:597] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:58.623917  1707 consensus_peers.cc:597] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:03:58.634013  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:58.634774  1739 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 18.
I20260709 13:03:58.625541  9151 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:03:58.630645  2426 leader_election.cc:336] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:58.633848  1705 leader_election.cc:336] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
W20260709 13:03:58.636126  1705 leader_election.cc:336] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
W20260709 13:03:58.636653  1707 leader_election.cc:336] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:58.638161  1707 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:58.640734  1707 leader_election.cc:336] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:03:58.642082  1707 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:58.641299  9141 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:58.647735  9141 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:58.655650  2426 consensus_peers.cc:597] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:58.671105  1707 consensus_peers.cc:597] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:58.690131  1707 consensus_peers.cc:597] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:58.708576  1707 consensus_peers.cc:597] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:03:58.714751  9141 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:58.715445  9141 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:58.717957  9141 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:58.739645  1707 consensus_peers.cc:597] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:03:58.742341  9141 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:58.743091  9141 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:58.747704  9141 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:58.756397  1707 leader_election.cc:336] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:58.764209  1705 leader_election.cc:336] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:03:58.767767  1705 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:58.768682  9141 raft_consensus.cc:2749] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:58.771425  1707 leader_election.cc:336] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:58.787796  1705 consensus_peers.cc:597] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:58.794637  1705 leader_election.cc:336] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:03:58.795149  1705 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:58.797698  9141 raft_consensus.cc:2749] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:58.838281  1705 consensus_peers.cc:597] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:58.864168  1707 consensus_peers.cc:597] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:58.874292  2426 consensus_peers.cc:597] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:58.888662  2426 consensus_peers.cc:597] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:03:58.905572  9155 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:58.906247  9155 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:58.913141  1707 leader_election.cc:336] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:58.920147  1705 leader_election.cc:336] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:03:58.920622  1705 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:58.924291  9157 raft_consensus.cc:2749] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:58.933214  9155 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:58.942600  1705 consensus_peers.cc:597] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:58.944192  2426 consensus_peers.cc:597] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:58.949142   431 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 1688)
I20260709 13:03:58.960132  9141 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:58.960779  9141 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:58.963450  9141 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:58.975987  1707 leader_election.cc:336] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:58.987668  2426 consensus_peers.cc:597] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:58.992635  1705 consensus_peers.cc:597] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:58.999991  1705 leader_election.cc:336] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:03:59.010728  1705 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:59.011652  9141 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:59.030323  1705 consensus_peers.cc:597] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:59.045053  1705 consensus_peers.cc:597] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:59.063205  1707 consensus_peers.cc:597] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:59.068653  1705 consensus_peers.cc:597] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:59.092559  2426 consensus_peers.cc:597] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:59.193249  1705 consensus_peers.cc:597] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:59.206146  9155 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:59.206804  9155 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:59.209070  9155 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:59.225462  1707 leader_election.cc:336] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:03:59.228056  1705 leader_election.cc:336] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:03:59.228844  1705 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:59.230110  1705 consensus_peers.cc:597] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:59.230648  9155 raft_consensus.cc:2749] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:03:59.259148  2426 consensus_peers.cc:597] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:59.298794  2424 leader_election.cc:336] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:03:59.299351  2424 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:03:59.301046  2424 leader_election.cc:336] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:03:59.302035  2424 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:03:59.301249  9158 raft_consensus.cc:2749] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:59.303606  9159 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:59.299322  1705 consensus_peers.cc:597] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:59.312152  1705 consensus_peers.cc:597] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:59.318471  2424 consensus_peers.cc:597] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:59.331277  2424 consensus_peers.cc:597] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:59.343437  1705 consensus_peers.cc:597] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:59.388573  2424 consensus_peers.cc:597] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:59.437271  9155 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:59.437923  9155 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:03:59.440469  9155 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:59.443877  2424 consensus_peers.cc:597] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:59.445736  1705 leader_election.cc:336] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
W20260709 13:03:59.482362  2424 consensus_peers.cc:597] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:59.521896  1705 consensus_peers.cc:597] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:59.567839  1705 consensus_peers.cc:597] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:59.588385  2424 consensus_peers.cc:597] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:59.605324  1705 consensus_peers.cc:597] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:59.610833  1705 consensus_peers.cc:597] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:59.680162  9155 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:59.680806  9155 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:59.693145  1705 leader_election.cc:336] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
W20260709 13:03:59.694240  2424 consensus_peers.cc:597] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:59.695461  9155 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:03:59.740525  9159 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:59.741132  9159 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:03:59.744127  9159 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:03:59.747610  1736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:03:59.748369  1736 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 26.
W20260709 13:03:59.751598  2424 leader_election.cc:336] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
W20260709 13:03:59.776563  2424 consensus_peers.cc:597] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:59.847656  9141 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:59.848279  9141 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:59.852682  2424 consensus_peers.cc:597] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:59.859179  9141 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:59.880864  2424 consensus_peers.cc:597] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:59.869735  1705 leader_election.cc:336] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
W20260709 13:03:59.914427  2424 consensus_peers.cc:597] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:59.947145  9160 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:03:59.947983  9160 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:03:59.950201   431 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 1688)
I20260709 13:03:59.975530  9160 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:03:59.992415  1705 leader_election.cc:336] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:04:00.079032  9158 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:04:00.079707  9158 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:04:00.091871  9158 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:04:00.094700  2424 leader_election.cc:336] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:04:00.106197  9160 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.106886  9160 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:04:00.109498  9160 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:04:00.124058  1705 leader_election.cc:336] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
W20260709 13:04:00.287092  1707 consensus_peers.cc:597] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:00.320111  1707 leader_election.cc:336] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:04:00.321130  1707 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:00.322113  9160 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:00.323154  9160 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:04:00.323767  9160 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:04:00.327883  2554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:04:00.328581  2554 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 18.
I20260709 13:04:00.331773  9160 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
W20260709 13:04:00.335002  1705 leader_election.cc:336] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
W20260709 13:04:00.336990  1707 consensus_peers.cc:597] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:00.341622  1707 leader_election.cc:336] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:04:00.343060  1707 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:00.343938  9160 raft_consensus.cc:2749] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:04:00.350790  2426 consensus_peers.cc:597] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:00.352391  2426 leader_election.cc:336] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:04:00.352901  2426 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:00.356523  9162 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:04:00.354045  2426 leader_election.cc:336] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:04:00.362927  2426 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:00.374223  9162 raft_consensus.cc:2749] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:04:00.345268  1707 leader_election.cc:336] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:04:00.376365  1707 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:00.380802  9160 raft_consensus.cc:2749] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:04:00.380975  1477 catalog_manager.cc:4755] TS 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 17b4f0abad654424ae8d47e63dbf2067: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:04:00.382198  1707 leader_election.cc:336] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:04:00.383483  1707 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:00.385828  9160 raft_consensus.cc:2749] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:04:00.387066  1707 leader_election.cc:336] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:04:00.389022  1707 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:00.389918  9160 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:04:00.427222  1707 leader_election.cc:336] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:04:00.428083  1707 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:00.428990  9160 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:00.531759  9160 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:04:00.532596  9160 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:04:00.536031  9160 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:04:00.570854  1705 leader_election.cc:336] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
W20260709 13:04:00.587136  1707 leader_election.cc:336] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:04:00.598176  1707 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:00.603137  9160 raft_consensus.cc:2749] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:04:00.654987  1707 consensus_peers.cc:597] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:00.669153  9160 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.669795  9160 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:04:00.673418  9160 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:04:00.683562  1705 leader_election.cc:336] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
W20260709 13:04:00.692428  1707 leader_election.cc:336] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:04:00.696406  1707 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:00.708647  9160 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:00.721310  9160 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:04:00.722018  9160 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:04:00.724669  9160 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:04:00.747960  1705 leader_election.cc:336] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
W20260709 13:04:00.774313  1707 leader_election.cc:336] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:04:00.775125  1707 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:00.777213  9160 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:00.804539  9160 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:04:00.805359  9160 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:04:00.826764  1705 leader_election.cc:336] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:04:00.830979  9141 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:04:00.831629  9141 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:04:00.833837  9141 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:04:00.834478  1707 leader_election.cc:336] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:04:00.835403  1707 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:00.837208  9160 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:04:00.839198  9160 raft_consensus.cc:2749] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:00.860044  9155 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.860625  9155 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:04:00.863092  9155 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:04:00.879642  1707 leader_election.cc:336] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:04:00.887267  1707 leader_election.cc:336] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:04:00.890326  1705 leader_election.cc:336] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:04:00.890918  1705 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:00.891798  9155 raft_consensus.cc:2749] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:04:00.897624  1705 leader_election.cc:336] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:04:00.898164  1705 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:00.899051  9155 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:00.915112  9162 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:04:00.915764  9162 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:04:00.919179  9162 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:04:00.926694  2426 leader_election.cc:336] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:04:00.931208  2424 leader_election.cc:336] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:04:00.931761  2424 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:00.932603  9165 raft_consensus.cc:2749] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:00.940969  9155 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:04:00.941586  9155 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:04:00.944416  9155 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:04:00.949734  1707 leader_election.cc:336] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:04:00.951953   431 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 1688)
W20260709 13:04:00.954941  1705 leader_election.cc:336] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:04:00.955492  1705 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:00.956338  9155 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:01.011195  9155 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:04:01.011741  9155 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:04:01.020009  1707 leader_election.cc:336] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:04:01.021425  9155 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:04:01.026408  1705 leader_election.cc:336] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:04:01.027189  1705 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:01.028553  9155 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:01.151578  9141 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.152123  9141 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:04:01.161845  1705 leader_election.cc:336] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
W20260709 13:04:01.167030  1707 leader_election.cc:336] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:04:01.167590  1707 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:01.168134  9141 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:04:01.169716  9155 raft_consensus.cc:2749] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:01.171089  9141 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:04:01.171773  9141 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:04:01.178548  1705 leader_election.cc:336] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
W20260709 13:04:01.195436  1707 leader_election.cc:336] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:04:01.196118  9141 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:04:01.207858  1707 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:01.208719  9155 raft_consensus.cc:2749] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:04:01.231761  1707 consensus_peers.cc:597] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:01.255352  1705 consensus_peers.cc:597] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:01.300004  1707 consensus_peers.cc:597] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:01.309455  1705 consensus_peers.cc:597] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:01.370317  1705 consensus_peers.cc:597] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:01.408074  1707 consensus_peers.cc:597] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:01.420903  2426 consensus_peers.cc:597] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:01.434779  1707 consensus_peers.cc:597] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:04:01.483773  9141 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:04:01.484372  9141 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:04:01.486470  9141 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:04:01.519654  9141 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:04:01.520342  9141 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:04:01.522532  9141 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:04:01.534704  1707 leader_election.cc:336] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:04:01.541502  1705 leader_election.cc:336] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:04:01.543090  1705 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:01.542107  9141 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:04:01.549412  9141 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:04:01.551739  9141 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:04:01.552249  1707 leader_election.cc:336] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:04:01.552788  9155 raft_consensus.cc:2749] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:04:01.548426  2426 consensus_peers.cc:597] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:01.591173  1705 leader_election.cc:336] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:04:01.599386  1705 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:01.600755  9155 raft_consensus.cc:2749] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:04:01.598578  1707 leader_election.cc:336] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:04:01.602656  1707 consensus_peers.cc:597] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:01.635527  1705 leader_election.cc:336] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:04:01.636323  1705 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:01.638260  9155 raft_consensus.cc:2749] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:04:01.672468  1705 consensus_peers.cc:597] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:01.703262  1705 consensus_peers.cc:597] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:01.703776  1705 consensus_peers.cc:597] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:01.706099  1705 consensus_peers.cc:597] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:01.718228  1707 consensus_peers.cc:597] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:01.722760  1707 consensus_peers.cc:597] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:01.729905  1707 consensus_peers.cc:597] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:01.738227  1707 consensus_peers.cc:597] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:01.752738  2426 consensus_peers.cc:597] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:01.758181  1707 consensus_peers.cc:597] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:01.759485  1705 consensus_peers.cc:597] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:01.803776  1705 consensus_peers.cc:597] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:01.824029  9160 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:04:01.825536  9160 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:04:01.834791  9160 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:04:01.836309  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:04:01.837750  2537 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 26.
W20260709 13:04:01.839200  1707 leader_election.cc:336] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:04:01.846527  1705 leader_election.cc:336] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:04:01.847011  1705 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:01.849305  9160 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:04:01.850739  1705 consensus_peers.cc:597] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:01.852229  2424 consensus_peers.cc:597] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:01.938700  1705 consensus_peers.cc:597] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:01.942826  2424 consensus_peers.cc:597] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:01.945806  1705 consensus_peers.cc:597] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:01.953332   431 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 1688)
W20260709 13:04:01.975261  2426 consensus_peers.cc:597] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:04:01.976295  9141 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:04:01.977247  9141 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:04:01.982663  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:04:01.982899  9141 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:04:01.983596  2537 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 18.
W20260709 13:04:01.987200  1705 consensus_peers.cc:597] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:01.989411  1707 leader_election.cc:336] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:04:01.991201  1705 leader_election.cc:336] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
W20260709 13:04:01.991508  2426 consensus_peers.cc:597] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:04:01.991698  1705 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:01.992844  9141 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:04:02.019646  1707 consensus_peers.cc:597] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:02.030357  1705 consensus_peers.cc:597] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:02.050191  2424 consensus_peers.cc:597] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:02.062532  2426 consensus_peers.cc:597] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:02.073563  1707 consensus_peers.cc:597] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:02.084964  2424 consensus_peers.cc:597] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:02.107591  2424 consensus_peers.cc:597] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:02.108512  1705 consensus_peers.cc:597] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:02.154378  2426 consensus_peers.cc:597] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:02.158448  1707 consensus_peers.cc:597] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:02.182684  2426 consensus_peers.cc:597] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:02.234818  2424 consensus_peers.cc:597] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:02.247812  2424 consensus_peers.cc:597] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:02.284401  2426 consensus_peers.cc:597] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:02.310974  2424 consensus_peers.cc:597] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:02.332120  2426 consensus_peers.cc:597] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:04:02.345729  9167 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:04:02.346518  9167 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:04:02.348937  9167 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:04:02.354080  1705 leader_election.cc:336] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
W20260709 13:04:02.355885  1707 leader_election.cc:336] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:04:02.356329  1707 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:02.357199  9167 raft_consensus.cc:2749] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:04:02.365336  2424 consensus_peers.cc:597] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:02.374969  1705 consensus_peers.cc:597] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:02.378248  2424 consensus_peers.cc:597] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:02.411278  1707 consensus_peers.cc:597] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:04:02.560253  9167 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:04:02.560999  9167 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:04:02.565244  9167 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:04:02.570467  1707 leader_election.cc:336] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:04:02.571002  1705 leader_election.cc:336] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:04:02.571597  1705 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:02.572582  9167 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:02.598553  9167 raft_consensus.cc:493] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:04:02.599341  9167 raft_consensus.cc:515] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:04:02.606376  9167 leader_election.cc:290] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:04:02.614084  1705 leader_election.cc:336] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
W20260709 13:04:02.616430  2424 consensus_peers.cc:597] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:02.630513  1707 leader_election.cc:336] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:04:02.631026  1707 leader_election.cc:304] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:02.631762  9167 raft_consensus.cc:2749] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:04:02.748509  1707 consensus_peers.cc:597] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:02.914037  1707 consensus_peers.cc:597] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:02.927935  2426 consensus_peers.cc:597] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:02.953889   431 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 1688)
I20260709 13:04:03.099169  9167 raft_consensus.cc:493] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.099754  9167 raft_consensus.cc:515] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:04:03.120694  9167 leader_election.cc:290] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:04:03.125731  1707 leader_election.cc:336] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:04:03.136950  1705 leader_election.cc:336] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:04:03.137532  1705 leader_election.cc:304] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:03.138988  9167 raft_consensus.cc:2749] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:03.164250  9167 raft_consensus.cc:493] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:04:03.164937  9167 raft_consensus.cc:515] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:04:03.167328  9167 leader_election.cc:290] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:04:03.175098  1705 leader_election.cc:336] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
W20260709 13:04:03.186447  1707 leader_election.cc:336] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:04:03.187666  1707 leader_election.cc:304] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:03.191874  9167 raft_consensus.cc:2749] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:04:03.273051  2424 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111) [suppressed 571 similar messages]
I20260709 13:04:03.479943  9173 raft_consensus.cc:493] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:04:03.480721  9173 raft_consensus.cc:515] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:04:03.495896  2424 leader_election.cc:336] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:04:03.497036  9160 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:04:03.497752  9160 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:04:03.500263  9160 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:04:03.506207  1707 leader_election.cc:336] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:04:03.512670  9173 leader_election.cc:290] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:04:03.535405  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32843, user_credentials={real_user=slave}} blocked reactor thread for 46654.5us
W20260709 13:04:03.542631  2426 leader_election.cc:336] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:04:03.543272  2426 leader_election.cc:304] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:03.572628  9173 raft_consensus.cc:2749] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:04:03.546535  1705 leader_election.cc:336] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:04:03.574410  1705 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:03.576166  9167 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:03.578485  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b235c777d4de2876dfd783998c83f" candidate_uuid: "7e839e91a1314c2f9a99b25b17c916a6" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "5ced62816f8545cd9b63a27e9055e42d" is_pre_election: true
I20260709 13:04:03.579160  1739 raft_consensus.cc:2468] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e839e91a1314c2f9a99b25b17c916a6 in term 26.
W20260709 13:04:03.587668  2426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33325, user_credentials={real_user=slave}} blocked reactor thread for 45076.6us
W20260709 13:04:03.670281  1707 consensus_peers.cc:597] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:03.681033  1707 consensus_peers.cc:597] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:03.737334  1707 consensus_peers.cc:597] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:04:03.749457  9160 raft_consensus.cc:493] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.750329  9160 raft_consensus.cc:515] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:04:03.753319  9160 leader_election.cc:290] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:04:03.816697  1705 leader_election.cc:336] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
W20260709 13:04:03.820497  1707 leader_election.cc:336] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:04:03.821661  1707 leader_election.cc:304] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:03.825946  9160 raft_consensus.cc:2749] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:04:03.828064  1705 consensus_peers.cc:597] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:03.838438  1705 consensus_peers.cc:597] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:03.847678  9160 raft_consensus.cc:493] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:04:03.848483  9160 raft_consensus.cc:515] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:04:03.855679  1707 leader_election.cc:336] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:04:03.850870  9160 leader_election.cc:290] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:04:03.860736  9160 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:04:03.861500  9160 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:04:03.868432  1707 leader_election.cc:336] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:04:03.880761  9160 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:04:03.881980  1705 leader_election.cc:336] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:04:03.882781  1705 leader_election.cc:304] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:03.884617  9160 raft_consensus.cc:2749] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:04:03.890041  1705 leader_election.cc:336] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:04:03.890825  1705 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:03.891614  9160 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:04:03.945351  1705 consensus_peers.cc:597] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:03.946015  1705 consensus_peers.cc:597] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:03.954600   431 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 1688)
W20260709 13:04:04.010443  1705 consensus_peers.cc:597] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:04.043154  1707 consensus_peers.cc:597] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:04.074524  1707 consensus_peers.cc:597] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:04.091653  9155 raft_consensus.cc:493] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:04:04.092262  9155 raft_consensus.cc:515] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:04:04.094396  9155 leader_election.cc:290] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:04:04.100780  1705 leader_election.cc:336] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
W20260709 13:04:04.101760  1707 leader_election.cc:336] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:04:04.102210  1707 leader_election.cc:304] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:04.103070  9155 raft_consensus.cc:2749] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:04:04.107594  1707 consensus_peers.cc:597] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:04.140954  2426 consensus_peers.cc:597] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:04.173554  1707 consensus_peers.cc:597] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:04.199129  1707 consensus_peers.cc:597] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:04:04.212613  9155 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:04:04.213199  9155 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:04:04.216957  9155 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 7e839e91a1314c2f9a99b25b17c916a6 (127.0.107.196:39157)
I20260709 13:04:04.217072  2537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd728f93afb447e384035fae1af6b006" candidate_uuid: "5ced62816f8545cd9b63a27e9055e42d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7e839e91a1314c2f9a99b25b17c916a6" is_pre_election: true
I20260709 13:04:04.217872  2537 raft_consensus.cc:2468] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ced62816f8545cd9b63a27e9055e42d in term 18.
W20260709 13:04:04.222754  1707 leader_election.cc:336] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:04:04.228189  2426 consensus_peers.cc:597] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:04.229252  1705 leader_election.cc:336] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:04:04.229683  1705 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d, 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:04.230367  9155 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:04:04.232328  1705 consensus_peers.cc:597] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:04.243533  1705 consensus_peers.cc:597] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:04.252995  1707 consensus_peers.cc:597] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:04.261143  2426 consensus_peers.cc:597] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:04.435084  1707 consensus_peers.cc:597] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:04.436928  9155 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.438169  9155 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:04:04.447145  2426 consensus_peers.cc:597] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:04.448604  2424 consensus_peers.cc:597] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:04.453208  2424 consensus_peers.cc:597] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:04.463912  9155 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:04:04.465971  1707 leader_election.cc:336] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:04:04.473866  1705 consensus_peers.cc:597] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:04.474409  1705 consensus_peers.cc:597] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:04.474824  1705 consensus_peers.cc:597] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:04.475487  1705 leader_election.cc:336] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:04:04.475908  1705 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:04:04.476646  1707 consensus_peers.cc:597] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:04:04.486097  9180 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:04:04.495250  1705 consensus_peers.cc:597] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:04.498226  1705 consensus_peers.cc:597] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:04.503230  9155 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:04:04.503995  9155 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:04:04.506258  9155 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:04:04.522491  2426 consensus_peers.cc:597] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:04.524978  2424 consensus_peers.cc:597] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:04.526028  1705 leader_election.cc:336] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
W20260709 13:04:04.527140  1707 leader_election.cc:336] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:04:04.527675  1707 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:04.532785  9155 raft_consensus.cc:2749] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:04:04.533677  2426 consensus_peers.cc:597] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:04.537169  1707 consensus_peers.cc:597] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:04.549537  1705 consensus_peers.cc:597] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:04.558022  1707 consensus_peers.cc:597] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:04.572379  2426 consensus_peers.cc:597] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:04.591361  1705 consensus_peers.cc:597] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:04.596607  1705 consensus_peers.cc:597] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:04.619225  2424 consensus_peers.cc:597] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:04.729147  2424 consensus_peers.cc:597] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:04.738545  2424 consensus_peers.cc:597] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:04.747195  2424 consensus_peers.cc:597] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:04.817276  2426 consensus_peers.cc:597] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:04:04.846771  9180 raft_consensus.cc:493] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:04:04.847608  9180 raft_consensus.cc:515] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:04:04.856268  1707 leader_election.cc:336] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:04:04.863415  1705 leader_election.cc:336] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:04:04.864051  1705 leader_election.cc:304] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:04.864933  9180 leader_election.cc:290] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
I20260709 13:04:04.865579  9155 raft_consensus.cc:2749] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:04:04.917690  2426 consensus_peers.cc:597] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:04:04.920065  9174 raft_consensus.cc:493] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
W20260709 13:04:04.921205  2424 consensus_peers.cc:597] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:04.920987  9174 raft_consensus.cc:515] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:04:04.923802  9174 leader_election.cc:290] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:04:04.928292  2424 leader_election.cc:336] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
W20260709 13:04:04.940830  2426 leader_election.cc:336] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:04:04.941412  2426 leader_election.cc:304] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:04.942407  9174 raft_consensus.cc:2749] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:04:04.955153   431 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 1688)
W20260709 13:04:04.968416  2424 consensus_peers.cc:597] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:04.972400  9155 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:04:04.984917  9155 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:04:04.986913  9155 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:04:04.987092  2426 consensus_peers.cc:597] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:05.001379  2424 consensus_peers.cc:597] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:05.002456  1707 leader_election.cc:336] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:04:05.028833  1705 consensus_peers.cc:597] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:05.039673  2424 consensus_peers.cc:597] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:05.089922  1707 consensus_peers.cc:597] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:05.246273  1705 leader_election.cc:336] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:04:05.247735  1705 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:05.249703  9182 raft_consensus.cc:2749] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:05.254346  9182 raft_consensus.cc:493] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:04:05.255000  9182 raft_consensus.cc:515] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:04:05.263957  9182 leader_election.cc:290] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:04:05.297394  1707 leader_election.cc:336] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:04:05.298270  1707 consensus_peers.cc:597] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:04:05.299232  9175 raft_consensus.cc:493] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:04:05.299968  9175 raft_consensus.cc:515] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:04:05.303390  9175 leader_election.cc:290] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:04:05.307163  1705 leader_election.cc:336] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:04:05.317531  1705 leader_election.cc:304] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
W20260709 13:04:05.316675  2424 leader_election.cc:336] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:04:05.319511  9180 raft_consensus.cc:2749] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:04:05.395287  2591 debug-util.cc:398] Leaking SignalData structure 0x7b080003f200 after lost signal to thread 434
W20260709 13:04:05.396457  2591 debug-util.cc:398] Leaking SignalData structure 0x7b080024b740 after lost signal to thread 1524
W20260709 13:04:05.397692  2591 debug-util.cc:398] Leaking SignalData structure 0x7b080026a240 after lost signal to thread 1765
W20260709 13:04:05.398722  2591 debug-util.cc:398] Leaking SignalData structure 0x7b080015fb20 after lost signal to thread 2594
I20260709 13:04:05.432902  9182 raft_consensus.cc:493] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:04:05.433517  9182 raft_consensus.cc:515] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:04:05.435915  9182 leader_election.cc:290] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:04:05.451109  1707 leader_election.cc:336] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:04:05.457719  1707 consensus_peers.cc:597] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:05.458307  1705 leader_election.cc:336] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:04:05.458837  1705 leader_election.cc:304] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:05.459635  9182 raft_consensus.cc:2749] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:05.551127  9182 raft_consensus.cc:493] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:04:05.551673  9182 raft_consensus.cc:515] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:04:05.555540  9182 leader_election.cc:290] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:04:05.564391  1705 leader_election.cc:336] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
W20260709 13:04:05.566427  1707 leader_election.cc:336] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:04:05.568260  1707 leader_election.cc:304] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:05.571003  9182 raft_consensus.cc:2749] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:05.675907  9182 raft_consensus.cc:493] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:04:05.677239  9182 raft_consensus.cc:515] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
W20260709 13:04:05.688422  1707 leader_election.cc:336] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:04:05.690243  9182 leader_election.cc:290] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:04:05.698562  1705 leader_election.cc:336] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:04:05.699122  1705 leader_election.cc:304] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:05.699977  9182 raft_consensus.cc:2749] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:05.902649  9182 raft_consensus.cc:493] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:04:05.903348  9182 raft_consensus.cc:515] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:04:05.905663  9182 leader_election.cc:290] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:04:05.913590  1707 leader_election.cc:336] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:04:05.917260  1705 leader_election.cc:336] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:04:05.917716  1705 leader_election.cc:304] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:05.919157  9180 raft_consensus.cc:2749] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:04:05.955693   431 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 1688)
I20260709 13:04:05.988734  9182 raft_consensus.cc:493] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:04:05.989485  9182 raft_consensus.cc:515] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:04:05.991742  9182 leader_election.cc:290] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:04:05.996760  1707 leader_election.cc:336] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:04:06.002357  1705 leader_election.cc:336] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:04:06.002806  1705 leader_election.cc:304] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:06.003538  9182 raft_consensus.cc:2749] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:04:06.084407  2426 leader_election.cc:336] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:04:06.084923  2426 leader_election.cc:304] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:06.088197  9184 raft_consensus.cc:2749] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:04:06.092859  1705 consensus_peers.cc:597] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:06.129007  1705 consensus_peers.cc:597] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:06.183781  1762 debug-util.cc:398] Leaking SignalData structure 0x7b08000bd2c0 after lost signal to thread 434
W20260709 13:04:06.185004  1762 debug-util.cc:398] Leaking SignalData structure 0x7b0800230b00 after lost signal to thread 1524
W20260709 13:04:06.186499  1762 debug-util.cc:398] Leaking SignalData structure 0x7b08002669e0 after lost signal to thread 1765
W20260709 13:04:06.187852  1762 debug-util.cc:398] Leaking SignalData structure 0x7b080038ffa0 after lost signal to thread 2594
W20260709 13:04:06.263338  1707 consensus_peers.cc:597] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:04:06.284418  9182 raft_consensus.cc:493] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:04:06.285185  9182 raft_consensus.cc:515] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:04:06.287815  9182 leader_election.cc:290] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:04:06.296219  1705 leader_election.cc:336] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
W20260709 13:04:06.304714  2426 consensus_peers.cc:597] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:04:06.308293  9182 raft_consensus.cc:493] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:04:06.308900  9182 raft_consensus.cc:515] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:04:06.311172  9182 leader_election.cc:290] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:04:06.322822  1705 leader_election.cc:336] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
W20260709 13:04:06.324090  1707 leader_election.cc:336] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:04:06.324584  1707 leader_election.cc:304] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:06.325544  9182 raft_consensus.cc:2749] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:04:06.337113  1707 consensus_peers.cc:597] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:06.368762  1705 consensus_peers.cc:597] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:06.372605  1707 leader_election.cc:336] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:04:06.373139  1707 leader_election.cc:304] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:06.373972  9182 raft_consensus.cc:2749] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:04:06.375015  1707 consensus_peers.cc:597] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:06.384842  1707 consensus_peers.cc:597] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:06.397728  1705 consensus_peers.cc:597] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:04:06.405965  9182 raft_consensus.cc:493] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.406558  9182 raft_consensus.cc:515] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:04:06.408797  9182 leader_election.cc:290] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:04:06.448402  1705 leader_election.cc:336] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
W20260709 13:04:06.526453  1707 leader_election.cc:336] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:04:06.527153  1707 leader_election.cc:304] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:06.532125  9186 raft_consensus.cc:2749] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:04:06.533432  1707 consensus_peers.cc:597] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:04:06.570211  9180 raft_consensus.cc:493] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.570786  9180 raft_consensus.cc:515] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:04:06.576205  9180 leader_election.cc:290] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:04:06.592648  2424 consensus_peers.cc:597] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:06.595849  1705 leader_election.cc:336] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:04:06.597210  9180 raft_consensus.cc:493] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
W20260709 13:04:06.597442  1707 leader_election.cc:336] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:04:06.597916  1707 leader_election.cc:304] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:06.598706  9182 raft_consensus.cc:2749] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:06.597843  9180 raft_consensus.cc:515] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:04:06.601658  9180 leader_election.cc:290] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:04:06.611413  1707 leader_election.cc:336] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:04:06.618680  1705 leader_election.cc:336] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:04:06.621513  1705 leader_election.cc:304] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:06.622417  9180 raft_consensus.cc:2749] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:04:06.671913  2426 consensus_peers.cc:597] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:06.675108  1707 consensus_peers.cc:597] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:06.678391  1707 consensus_peers.cc:597] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:06.744225  1705 consensus_peers.cc:597] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:06.747776  1707 consensus_peers.cc:597] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:06.752070  1705 consensus_peers.cc:597] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:06.762365  1705 consensus_peers.cc:597] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:06.830819  1707 consensus_peers.cc:597] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:06.846388  1705 consensus_peers.cc:597] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:06.877341  1707 consensus_peers.cc:597] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:04:06.886612   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:04:06.909490  1707 consensus_peers.cc:597] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:04:06.913630  9186 raft_consensus.cc:493] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:04:06.914196  9186 raft_consensus.cc:515] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } }
I20260709 13:04:06.917968  9186 leader_election.cc:290] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683)
W20260709 13:04:06.964349  2424 consensus_peers.cc:597] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:06.971630  2424 consensus_peers.cc:597] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:06.981007  1705 leader_election.cc:336] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
W20260709 13:04:07.006079  1705 consensus_peers.cc:597] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:07.011962  1705 consensus_peers.cc:597] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:07.023648  1705 consensus_peers.cc:597] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:07.038151  1705 consensus_peers.cc:597] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:07.038360  2424 consensus_peers.cc:597] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:07.034577  1707 leader_election.cc:336] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:04:07.040429  1707 leader_election.cc:304] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ced62816f8545cd9b63a27e9055e42d; no voters: 5bb87fe07da2414e84ee578c3b176ede, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:07.041391  9186 raft_consensus.cc:2749] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:04:07.045347  1707 consensus_peers.cc:597] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:07.055199  1705 consensus_peers.cc:597] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:04:07.084728   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:04:07.094228  2426 consensus_peers.cc:597] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Couldn't send request to peer 5ced62816f8545cd9b63a27e9055e42d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:07.105386  2424 consensus_peers.cc:597] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:07.132853  2426 consensus_peers.cc:597] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:07.145402  1705 consensus_peers.cc:597] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:07.188611  2424 consensus_peers.cc:597] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:07.196633  2426 consensus_peers.cc:597] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Couldn't send request to peer 5ced62816f8545cd9b63a27e9055e42d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:07.197353   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:04:07.197425  2426 consensus_peers.cc:597] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Couldn't send request to peer 5ced62816f8545cd9b63a27e9055e42d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:07.198662   431 tablet_replica.cc:333] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.199750   431 raft_consensus.cc:2243] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.200906   431 raft_consensus.cc:2272] T b51b235c777d4de2876dfd783998c83f P 5ced62816f8545cd9b63a27e9055e42d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.204214   431 tablet_replica.cc:333] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.205363   431 raft_consensus.cc:2243] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:04:07.206725   431 raft_consensus.cc:2272] T efd803bfc7504e98806ec4a5030c66b1 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:07.206949  2424 consensus_peers.cc:597] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:04:07.209616   431 tablet_replica.cc:333] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.210680   431 raft_consensus.cc:2243] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:04:07.211901   431 raft_consensus.cc:2272] T 7552d3c613c34834a3a9c7ce844572fd P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.214938   431 tablet_replica.cc:333] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.215879   431 raft_consensus.cc:2243] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.216502   431 raft_consensus.cc:2272] T 075c70e81e41467491c4134e5e9fd03a P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.219707   431 tablet_replica.cc:333] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.220631   431 raft_consensus.cc:2243] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:04:07.222061   431 raft_consensus.cc:2272] T 9eee8a552b4244ad8089de6467edd0d8 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.224989   431 tablet_replica.cc:333] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.225939   431 raft_consensus.cc:2243] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:04:07.227324   431 raft_consensus.cc:2272] T 5935c74e00334979a51afdc704e3b06f P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.230386   431 tablet_replica.cc:333] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.231268   431 raft_consensus.cc:2243] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:07.231369  2426 consensus_peers.cc:597] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Couldn't send request to peer 5ced62816f8545cd9b63a27e9055e42d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:07.232545   431 raft_consensus.cc:2272] T 58f7cd3ac9254bdb9fb62ab42597f15b P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.235545   431 tablet_replica.cc:333] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.236431   431 raft_consensus.cc:2243] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:04:07.237706   431 raft_consensus.cc:2272] T c9831da869404fb79a22d3887701ca69 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:07.238174  2426 consensus_peers.cc:597] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Couldn't send request to peer 5ced62816f8545cd9b63a27e9055e42d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:07.240622   431 tablet_replica.cc:333] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.241586   431 raft_consensus.cc:2243] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.242507   431 raft_consensus.cc:2272] T 6bb113e0e7c440b4911f4c09a86e2591 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.245322   431 tablet_replica.cc:333] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.246184   431 raft_consensus.cc:2243] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.247108   431 raft_consensus.cc:2272] T 40fb069a8f6e4d0c885835eee0132b00 P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.250020   431 tablet_replica.cc:333] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.250891   431 raft_consensus.cc:2243] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.251530   431 raft_consensus.cc:2272] T c3d6305e583540c895021f5a180689f7 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.254496   431 tablet_replica.cc:333] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.255386   431 raft_consensus.cc:2243] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.256557   431 raft_consensus.cc:2272] T 3aff654153ad4acfa774f838f37c0604 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.259487   431 tablet_replica.cc:333] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.260406   431 raft_consensus.cc:2243] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:04:07.261742   431 raft_consensus.cc:2272] T 81635b0a041d4e6da9f7499ecb70dcc2 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.264631   431 tablet_replica.cc:333] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.265551   431 raft_consensus.cc:2243] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.266254   431 raft_consensus.cc:2272] T d1fb6d43d14545a9872b287d4096ff1a P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.269405   431 tablet_replica.cc:333] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.270255   431 raft_consensus.cc:2243] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:04:07.272639   431 raft_consensus.cc:2272] T c03a2285eaff45a6a236c5eae38fb06f P 5ced62816f8545cd9b63a27e9055e42d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.275333   431 tablet_replica.cc:333] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.276201   431 raft_consensus.cc:2243] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.277220   431 raft_consensus.cc:2272] T 2c8e0ac7d1de40fdb93dc3a4e799e876 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.279927   431 tablet_replica.cc:333] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.280766   431 raft_consensus.cc:2243] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.281410   431 raft_consensus.cc:2272] T 161aba2b69844461b9d8ed3cdf147919 P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.284260   431 tablet_replica.cc:333] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.285154   431 raft_consensus.cc:2243] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.285991   431 raft_consensus.cc:2272] T 7e07e22e745346fa98096d8b909dc7f5 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.288666   431 tablet_replica.cc:333] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.289551   431 raft_consensus.cc:2243] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.290283   431 raft_consensus.cc:2272] T bd6e8a8a10c144f1bd64e638805e7a5a P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.293006   431 tablet_replica.cc:333] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.293992   431 raft_consensus.cc:2243] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:04:07.295322   431 raft_consensus.cc:2272] T b37805060ac444b6b6e9e7da8164233c P 5ced62816f8545cd9b63a27e9055e42d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.298066   431 tablet_replica.cc:333] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.298944   431 raft_consensus.cc:2243] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 13 LEADER]: Raft consensus shutting down.
W20260709 13:04:07.299449  2424 consensus_peers.cc:597] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:04:07.300336   431 raft_consensus.cc:2272] T 35fc0eeb87e24045a897daa0ad5c400b P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.303282   431 tablet_replica.cc:333] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.304229   431 raft_consensus.cc:2243] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.305127   431 raft_consensus.cc:2272] T 8f63738689324ca9a4caa66b9aee2a78 P 5ced62816f8545cd9b63a27e9055e42d [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:07.307998  2424 consensus_peers.cc:597] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:04:07.308223   431 tablet_replica.cc:333] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.309315   431 raft_consensus.cc:2243] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:04:07.311530   431 raft_consensus.cc:2272] T 8c784821c4a84bc7ba32cb6e34fbb225 P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.315809   431 tablet_replica.cc:333] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.316840   431 raft_consensus.cc:2243] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.317729   431 raft_consensus.cc:2272] T 0fbe5a86d7bd4880843e631ffca572ce P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.321007   431 tablet_replica.cc:333] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.321861   431 raft_consensus.cc:2243] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.322885   431 raft_consensus.cc:2272] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.326536   431 tablet_replica.cc:333] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.327436   431 raft_consensus.cc:2243] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.328256   431 raft_consensus.cc:2272] T 2782217725024e159b9536d03808a3ea P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.331125   431 tablet_replica.cc:333] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.331969   431 raft_consensus.cc:2243] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:07.332371  1705 consensus_peers.cc:597] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:04:07.332609   431 raft_consensus.cc:2272] T 67b5a70a2de54935b60554301e6de808 P 5ced62816f8545cd9b63a27e9055e42d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.335562   431 tablet_replica.cc:333] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.336472   431 raft_consensus.cc:2243] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.337364   431 raft_consensus.cc:2272] T c26b89190fef4c8199109d4bbabf2395 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.340107   431 tablet_replica.cc:333] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.340938   431 raft_consensus.cc:2243] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:04:07.342199   431 pending_rounds.cc:70] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d: Trying to abort 1 pending ops.
I20260709 13:04:07.342499   431 pending_rounds.cc:77] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d: Aborting op as it isn't in flight: id { term: 22 index: 18 } timestamp: 7305634746905513984 op_type: NO_OP noop_request { }
I20260709 13:04:07.343096   431 raft_consensus.cc:2889] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 22 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:04:07.343492   431 raft_consensus.cc:2272] T 67258bf3ca484bd099fd3ec7923aee78 P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:07.343804  1707 consensus_peers.cc:597] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:04:07.346393   431 tablet_replica.cc:333] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.347306   431 raft_consensus.cc:2243] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.348527   431 raft_consensus.cc:2272] T 75a149db07824e3fb3c1f721b61d6c20 P 5ced62816f8545cd9b63a27e9055e42d [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:07.349752  2426 consensus_peers.cc:597] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Couldn't send request to peer 5ced62816f8545cd9b63a27e9055e42d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:07.351389   431 tablet_replica.cc:333] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.352324   431 raft_consensus.cc:2243] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.353191   431 raft_consensus.cc:2272] T 90426dc5094b4f3c855ea9d2a43bc452 P 5ced62816f8545cd9b63a27e9055e42d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.355942   431 tablet_replica.cc:333] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.356801   431 raft_consensus.cc:2243] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.357534   431 raft_consensus.cc:2272] T 390554a5bb3c4780b61e0fc806cea161 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.360510   431 tablet_replica.cc:333] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.361413   431 raft_consensus.cc:2243] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.362655   431 raft_consensus.cc:2272] T bd728f93afb447e384035fae1af6b006 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.365511   431 tablet_replica.cc:333] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.366433   431 raft_consensus.cc:2243] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:04:07.367882   431 raft_consensus.cc:2272] T 0500c740c1014c08b4ea992c888446ed P 5ced62816f8545cd9b63a27e9055e42d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.370688   431 tablet_replica.cc:333] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.371466   431 raft_consensus.cc:2243] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:04:07.372766   431 raft_consensus.cc:2272] T f6f62b0e67804bcba2b2f2b49e0b7623 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.375520   431 tablet_replica.cc:333] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.376395   431 raft_consensus.cc:2243] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.377185   431 raft_consensus.cc:2272] T 3f40f76410ee41d696f4427ca4903962 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.380105   431 tablet_replica.cc:333] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.380937   431 raft_consensus.cc:2243] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:04:07.382097   431 raft_consensus.cc:2272] T ed05ccb8c31f47b18b3bdea87b5b2e3a P 5ced62816f8545cd9b63a27e9055e42d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.384414   431 tablet_replica.cc:333] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.385002   431 raft_consensus.cc:2243] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 14 LEADER]: Raft consensus shutting down.
W20260709 13:04:07.385267  2426 consensus_peers.cc:597] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Couldn't send request to peer 5ced62816f8545cd9b63a27e9055e42d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:07.386561   431 pending_rounds.cc:70] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d: Trying to abort 1 pending ops.
I20260709 13:04:07.386842   431 pending_rounds.cc:77] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d: Aborting op as it isn't in flight: id { term: 14 index: 8 } timestamp: 7305634746841247744 op_type: NO_OP noop_request { }
I20260709 13:04:07.387219   431 raft_consensus.cc:2889] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 14 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:04:07.387565   431 raft_consensus.cc:2272] T 7b0a975df857466d9daf2f71f1c98623 P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.390450   431 tablet_replica.cc:333] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.391321   431 raft_consensus.cc:2243] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.391990   431 raft_consensus.cc:2272] T 1633c35f1cea4228894a2e7872612d9e P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:07.393913  2426 consensus_peers.cc:597] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Couldn't send request to peer 5ced62816f8545cd9b63a27e9055e42d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:07.394660   431 tablet_replica.cc:333] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.395660   431 raft_consensus.cc:2243] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.396346   431 raft_consensus.cc:2272] T 53c3c6ae566d4afda95ffc509772bca1 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.399173   431 tablet_replica.cc:333] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.400115   431 raft_consensus.cc:2243] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.400931   431 raft_consensus.cc:2272] T 7cf5139331dd452b8c2a035da1db88dc P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.403882   431 tablet_replica.cc:333] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.404661   431 raft_consensus.cc:2243] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.405314   431 raft_consensus.cc:2272] T 99151421d7f641c2b26a05af014a9dc1 P 5ced62816f8545cd9b63a27e9055e42d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.408130   431 tablet_replica.cc:333] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.408986   431 raft_consensus.cc:2243] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.409713   431 raft_consensus.cc:2272] T 3ed1f59ae1624d7ca7a1694c18500e49 P 5ced62816f8545cd9b63a27e9055e42d [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:07.411635  2426 consensus_peers.cc:597] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Couldn't send request to peer 5ced62816f8545cd9b63a27e9055e42d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:07.412499   431 tablet_replica.cc:333] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.413408   431 raft_consensus.cc:2243] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:04:07.414779   431 raft_consensus.cc:2272] T 3b16912bb6d94c80b8ff8e641268e238 P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.417614   431 tablet_replica.cc:333] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.418396   431 raft_consensus.cc:2243] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:04:07.419741   431 raft_consensus.cc:2272] T 17b4f0abad654424ae8d47e63dbf2067 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.422626   431 tablet_replica.cc:333] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.423556   431 raft_consensus.cc:2243] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:04:07.424762   431 pending_rounds.cc:70] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d: Trying to abort 1 pending ops.
I20260709 13:04:07.425010   431 pending_rounds.cc:77] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d: Aborting op as it isn't in flight: id { term: 29 index: 18 } timestamp: 7305634747064049664 op_type: NO_OP noop_request { }
I20260709 13:04:07.425427   431 raft_consensus.cc:2889] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 29 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:04:07.425805   431 raft_consensus.cc:2272] T d1883da16ec44d2a8304d3909471b4b1 P 5ced62816f8545cd9b63a27e9055e42d [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.428483   431 tablet_replica.cc:333] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.429240   431 raft_consensus.cc:2243] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:04:07.430472   431 raft_consensus.cc:2272] T 06d03acc62b5400ebdca03680f553818 P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:07.433007  2426 consensus_peers.cc:597] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:04:07.433243   431 tablet_replica.cc:333] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.434104   431 raft_consensus.cc:2243] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.435014   431 raft_consensus.cc:2272] T c47af644bb6145d7bf8d0aaa1d74000d P 5ced62816f8545cd9b63a27e9055e42d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.437834   431 tablet_replica.cc:333] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.438541   431 raft_consensus.cc:2243] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.439628   431 raft_consensus.cc:2272] T d8f6e5a8ef2b453189832346af645cd8 P 5ced62816f8545cd9b63a27e9055e42d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.442560   431 tablet_replica.cc:333] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.443297   431 raft_consensus.cc:2243] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.443944   431 raft_consensus.cc:2272] T 906dda27b6f84a53b2365339db2e3652 P 5ced62816f8545cd9b63a27e9055e42d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.446635   431 tablet_replica.cc:333] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d: stopping tablet replica
I20260709 13:04:07.447335   431 raft_consensus.cc:2243] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:04:07.448680   431 raft_consensus.cc:2272] T 3f75a0ee5c184536abc81f5a366016fb P 5ced62816f8545cd9b63a27e9055e42d [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:07.461386  2426 consensus_peers.cc:597] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Couldn't send request to peer 5ced62816f8545cd9b63a27e9055e42d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:07.464285  2426 consensus_peers.cc:597] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:07.486534  2424 consensus_peers.cc:597] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:07.540925  2424 consensus_peers.cc:597] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:07.947153  2426 consensus_peers.cc:597] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:07.952755  2426 consensus_peers.cc:597] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:08.009438  2426 consensus_peers.cc:597] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:08.031761  2426 consensus_peers.cc:597] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:08.112776  2426 consensus_peers.cc:597] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:08.190734  2426 consensus_peers.cc:597] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:04:08.242895  9184 raft_consensus.cc:493] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:04:08.243512  9184 raft_consensus.cc:515] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:04:08.245532  9184 leader_election.cc:290] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:04:08.250603  2426 leader_election.cc:336] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:04:08.251372  2426 leader_election.cc:336] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Network error: Client connection negotiation failed: client connection to 127.0.107.195:32843: connect: Connection refused (error 111)
I20260709 13:04:08.251708  2426 leader_election.cc:304] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:08.252313  9184 raft_consensus.cc:2749] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:04:08.274240  2426 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111) [suppressed 536 similar messages]
I20260709 13:04:08.369493  9185 raft_consensus.cc:493] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:04:08.370043  9185 raft_consensus.cc:515] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:04:08.372256  9185 leader_election.cc:290] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:04:08.383891  2426 leader_election.cc:336] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:04:08.385250  2426 leader_election.cc:336] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Network error: Client connection negotiation failed: client connection to 127.0.107.195:32843: connect: Connection refused (error 111)
I20260709 13:04:08.385950  2426 leader_election.cc:304] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:08.387686  9185 raft_consensus.cc:2749] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:08.491820  9184 raft_consensus.cc:493] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:04:08.492452  9184 raft_consensus.cc:515] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:04:08.494388  9184 leader_election.cc:290] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:04:08.499411  2424 leader_election.cc:336] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
W20260709 13:04:08.500910  2426 leader_election.cc:336] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Network error: Client connection negotiation failed: client connection to 127.0.107.195:32843: connect: Connection refused (error 111)
I20260709 13:04:08.501555  2426 leader_election.cc:304] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:04:08.502322  9184 raft_consensus.cc:2749] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:08.524753  9184 raft_consensus.cc:493] T c03a2285eaff45a6a236c5eae38fb06f P 7e839e91a1314c2f9a99b25b17c916a6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:04:08.525394  9184 raft_consensus.cc:515] T c03a2285eaff45a6a236c5eae38fb06f P 7e839e91a1314c2f9a99b25b17c916a6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:04:08.527477  9184 leader_election.cc:290] T c03a2285eaff45a6a236c5eae38fb06f P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:04:08.534523  2426 leader_election.cc:336] T c03a2285eaff45a6a236c5eae38fb06f P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:04:08.535177  2426 leader_election.cc:336] T c03a2285eaff45a6a236c5eae38fb06f P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Network error: Client connection negotiation failed: client connection to 127.0.107.195:32843: connect: Connection refused (error 111)
I20260709 13:04:08.535508  2426 leader_election.cc:304] T c03a2285eaff45a6a236c5eae38fb06f P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:08.536114  9185 raft_consensus.cc:2749] T c03a2285eaff45a6a236c5eae38fb06f P 7e839e91a1314c2f9a99b25b17c916a6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:08.578474  9185 raft_consensus.cc:493] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5bb87fe07da2414e84ee578c3b176ede)
I20260709 13:04:08.579073  9185 raft_consensus.cc:515] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:04:08.581964  9185 leader_election.cc:290] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:04:08.588968  2426 leader_election.cc:336] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:04:08.590011  2426 leader_election.cc:336] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Network error: Client connection negotiation failed: client connection to 127.0.107.195:32843: connect: Connection refused (error 111)
I20260709 13:04:08.590438  2426 leader_election.cc:304] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:08.591248  9185 raft_consensus.cc:2749] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:04:08.593274  2424 leader_election.cc:336] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:04:08.595206  9185 raft_consensus.cc:493] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:04:08.595808  9185 raft_consensus.cc:515] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:04:08.597946  9185 leader_election.cc:290] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:04:08.598862  1477 catalog_manager.cc:4755] TS 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 17b4f0abad654424ae8d47e63dbf2067: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
W20260709 13:04:08.601498  2426 leader_election.cc:336] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Network error: Client connection negotiation failed: client connection to 127.0.107.195:32843: connect: Connection refused (error 111)
W20260709 13:04:08.604897  2424 leader_election.cc:336] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:04:08.605340  2424 leader_election.cc:304] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:04:08.605973  9185 raft_consensus.cc:2749] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:08.631131  9185 raft_consensus.cc:493] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:04:08.631706  9185 raft_consensus.cc:515] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:04:08.633698  9185 leader_election.cc:290] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:04:08.639864  2426 leader_election.cc:336] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Network error: Client connection negotiation failed: client connection to 127.0.107.195:32843: connect: Connection refused (error 111)
W20260709 13:04:08.640913  2424 leader_election.cc:336] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
I20260709 13:04:08.641352  2424 leader_election.cc:304] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:04:08.641988  9185 raft_consensus.cc:2749] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:08.790580   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:04:08.856467  9191 raft_consensus.cc:493] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:04:08.857196  9191 raft_consensus.cc:515] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6d4de2ce0683442498244b9529127f91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33325 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
I20260709 13:04:08.859591  9191 leader_election.cc:290] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
I20260709 13:04:08.859970  9185 raft_consensus.cc:493] T 17b4f0abad654424ae8d47e63dbf2067 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ced62816f8545cd9b63a27e9055e42d)
I20260709 13:04:08.860654  9185 raft_consensus.cc:515] T 17b4f0abad654424ae8d47e63dbf2067 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5bb87fe07da2414e84ee578c3b176ede" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41683 } } peers { permanent_uuid: "5ced62816f8545cd9b63a27e9055e42d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32843 } } peers { permanent_uuid: "7e839e91a1314c2f9a99b25b17c916a6" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39157 } attrs { promote: false } }
W20260709 13:04:08.869295  2426 leader_election.cc:336] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Network error: Client connection negotiation failed: client connection to 127.0.107.195:32843: connect: Connection refused (error 111)
W20260709 13:04:08.870178  2426 leader_election.cc:336] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:04:08.870616  2426 leader_election.cc:304] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5ced62816f8545cd9b63a27e9055e42d, 6d4de2ce0683442498244b9529127f91
I20260709 13:04:08.873319  9191 raft_consensus.cc:2749] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:08.873919  9185 leader_election.cc:290] T 17b4f0abad654424ae8d47e63dbf2067 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683), 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843)
W20260709 13:04:08.876788  2424 leader_election.cc:336] T 17b4f0abad654424ae8d47e63dbf2067 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111)
W20260709 13:04:08.879560  2426 leader_election.cc:336] T 17b4f0abad654424ae8d47e63dbf2067 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5ced62816f8545cd9b63a27e9055e42d (127.0.107.195:32843): Network error: Client connection negotiation failed: client connection to 127.0.107.195:32843: connect: Connection refused (error 111)
I20260709 13:04:08.880051  2426 leader_election.cc:304] T 17b4f0abad654424ae8d47e63dbf2067 P 7e839e91a1314c2f9a99b25b17c916a6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e839e91a1314c2f9a99b25b17c916a6; no voters: 5bb87fe07da2414e84ee578c3b176ede, 5ced62816f8545cd9b63a27e9055e42d
I20260709 13:04:08.880903  9185 raft_consensus.cc:2749] T 17b4f0abad654424ae8d47e63dbf2067 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:04:08.906970  2424 consensus_peers.cc:597] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 5bb87fe07da2414e84ee578c3b176ede (127.0.107.194:41683): Couldn't send request to peer 5bb87fe07da2414e84ee578c3b176ede. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41683: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:04:08.908586   431 tablet_server.cc:179] TabletServer@127.0.107.196:0 shutting down...
I20260709 13:04:08.966696   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:08.967691   431 tablet_replica.cc:333] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6: stopping tablet replica
I20260709 13:04:08.968895   431 raft_consensus.cc:2243] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:08.969957   431 raft_consensus.cc:2272] T bd728f93afb447e384035fae1af6b006 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:08.973675   431 tablet_replica.cc:333] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6: stopping tablet replica
I20260709 13:04:08.974530   431 raft_consensus.cc:2243] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:08.975283   431 raft_consensus.cc:2272] T b51b235c777d4de2876dfd783998c83f P 7e839e91a1314c2f9a99b25b17c916a6 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:08.978796   431 tablet_replica.cc:333] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6: stopping tablet replica
I20260709 13:04:08.979691   431 raft_consensus.cc:2243] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:08.980283   431 raft_consensus.cc:2272] T ef1be054223a4d3f90725c570db24bf5 P 7e839e91a1314c2f9a99b25b17c916a6 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:08.983778   431 tablet_replica.cc:333] T c03a2285eaff45a6a236c5eae38fb06f P 7e839e91a1314c2f9a99b25b17c916a6: stopping tablet replica
I20260709 13:04:08.984584   431 raft_consensus.cc:2243] T c03a2285eaff45a6a236c5eae38fb06f P 7e839e91a1314c2f9a99b25b17c916a6 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:08.985206   431 raft_consensus.cc:2272] T c03a2285eaff45a6a236c5eae38fb06f P 7e839e91a1314c2f9a99b25b17c916a6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:08.988420   431 tablet_replica.cc:333] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6: stopping tablet replica
I20260709 13:04:08.989336   431 raft_consensus.cc:2243] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:08.989979   431 raft_consensus.cc:2272] T 7552d3c613c34834a3a9c7ce844572fd P 7e839e91a1314c2f9a99b25b17c916a6 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:08.993224   431 tablet_replica.cc:333] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6: stopping tablet replica
I20260709 13:04:08.994102   431 raft_consensus.cc:2243] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 LEADER]: Raft consensus shutting down.
W20260709 13:04:08.994501  2426 consensus_peers.cc:597] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 -> Peer 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): Couldn't send request to peer 6d4de2ce0683442498244b9529127f91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:04:08.995219   431 raft_consensus.cc:2272] T 40fb069a8f6e4d0c885835eee0132b00 P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:08.998169   431 tablet_replica.cc:333] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6: stopping tablet replica
I20260709 13:04:08.999025   431 raft_consensus.cc:2243] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:08.999625   431 raft_consensus.cc:2272] T 3f75a0ee5c184536abc81f5a366016fb P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.002466   431 tablet_replica.cc:333] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6: stopping tablet replica
I20260709 13:04:09.003409   431 raft_consensus.cc:2243] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.004015   431 raft_consensus.cc:2272] T c9831da869404fb79a22d3887701ca69 P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.007408   431 tablet_replica.cc:333] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6: stopping tablet replica
I20260709 13:04:09.008239   431 raft_consensus.cc:2243] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:04:09.009640   431 raft_consensus.cc:2272] T ae1310c9ee464797a39b786c1d932941 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.012866   431 tablet_replica.cc:333] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6: stopping tablet replica
I20260709 13:04:09.013931   431 raft_consensus.cc:2243] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:04:09.015074   431 raft_consensus.cc:2272] T 67b5a70a2de54935b60554301e6de808 P 7e839e91a1314c2f9a99b25b17c916a6 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.017982   431 tablet_replica.cc:333] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6: stopping tablet replica
I20260709 13:04:09.018877   431 raft_consensus.cc:2243] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:04:09.020074   431 raft_consensus.cc:2272] T 2782217725024e159b9536d03808a3ea P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.025484   431 tablet_replica.cc:333] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6: stopping tablet replica
I20260709 13:04:09.026300   431 raft_consensus.cc:2243] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:04:09.027467   431 raft_consensus.cc:2272] T 6bb113e0e7c440b4911f4c09a86e2591 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.030877   431 tablet_replica.cc:333] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6: stopping tablet replica
I20260709 13:04:09.031709   431 raft_consensus.cc:2243] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.032394   431 raft_consensus.cc:2272] T 0500c740c1014c08b4ea992c888446ed P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.035413   431 tablet_replica.cc:333] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6: stopping tablet replica
I20260709 13:04:09.036206   431 raft_consensus.cc:2243] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:04:09.037266   431 raft_consensus.cc:2272] T 03d9f5135e0d4c0091fe4ba5bed83ffd P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.040307   431 tablet_replica.cc:333] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6: stopping tablet replica
I20260709 13:04:09.041043   431 raft_consensus.cc:2243] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:04:09.042203   431 raft_consensus.cc:2272] T 8f63738689324ca9a4caa66b9aee2a78 P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.045233   431 tablet_replica.cc:333] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6: stopping tablet replica
I20260709 13:04:09.046011   431 raft_consensus.cc:2243] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:04:09.047109   431 raft_consensus.cc:2272] T 1633c35f1cea4228894a2e7872612d9e P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.050283   431 tablet_replica.cc:333] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6: stopping tablet replica
I20260709 13:04:09.051045   431 raft_consensus.cc:2243] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:04:09.052158   431 raft_consensus.cc:2272] T 619fbae81e504a9b9671de42f0e75aea P 7e839e91a1314c2f9a99b25b17c916a6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.055207   431 tablet_replica.cc:333] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6: stopping tablet replica
I20260709 13:04:09.055999   431 raft_consensus.cc:2243] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.056623   431 raft_consensus.cc:2272] T f6f62b0e67804bcba2b2f2b49e0b7623 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.059608   431 tablet_replica.cc:333] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6: stopping tablet replica
I20260709 13:04:09.060460   431 raft_consensus.cc:2243] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:04:09.061682   431 raft_consensus.cc:2272] T 5b8e576fb1634970b28a86f720e85f9a P 7e839e91a1314c2f9a99b25b17c916a6 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.064911   431 tablet_replica.cc:333] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6: stopping tablet replica
I20260709 13:04:09.065721   431 raft_consensus.cc:2243] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:04:09.066861   431 raft_consensus.cc:2272] T 0d14bd0bd4204ece94fb1bfe29d407f8 P 7e839e91a1314c2f9a99b25b17c916a6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.069594   431 tablet_replica.cc:333] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6: stopping tablet replica
I20260709 13:04:09.070415   431 raft_consensus.cc:2243] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.071060   431 raft_consensus.cc:2272] T c5248b829f494452a558e65e2342b6f0 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.074054   431 tablet_replica.cc:333] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6: stopping tablet replica
I20260709 13:04:09.074803   431 raft_consensus.cc:2243] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:04:09.075928   431 raft_consensus.cc:2272] T f52de8c1489f4f9aabb361c6c02bb3de P 7e839e91a1314c2f9a99b25b17c916a6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.078883   431 tablet_replica.cc:333] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6: stopping tablet replica
I20260709 13:04:09.079648   431 raft_consensus.cc:2243] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:04:09.080757   431 raft_consensus.cc:2272] T 161aba2b69844461b9d8ed3cdf147919 P 7e839e91a1314c2f9a99b25b17c916a6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.083830   431 tablet_replica.cc:333] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6: stopping tablet replica
I20260709 13:04:09.084529   431 raft_consensus.cc:2243] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:04:09.085846   431 raft_consensus.cc:2272] T 4490828942174c3c9092820cf3a81fe3 P 7e839e91a1314c2f9a99b25b17c916a6 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.088569   431 tablet_replica.cc:333] T 17b4f0abad654424ae8d47e63dbf2067 P 7e839e91a1314c2f9a99b25b17c916a6: stopping tablet replica
I20260709 13:04:09.089524   431 raft_consensus.cc:2243] T 17b4f0abad654424ae8d47e63dbf2067 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.090633   431 raft_consensus.cc:2272] T 17b4f0abad654424ae8d47e63dbf2067 P 7e839e91a1314c2f9a99b25b17c916a6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.093909   431 tablet_replica.cc:333] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6: stopping tablet replica
I20260709 13:04:09.094719   431 raft_consensus.cc:2243] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:04:09.095920   431 raft_consensus.cc:2272] T d1fb6d43d14545a9872b287d4096ff1a P 7e839e91a1314c2f9a99b25b17c916a6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.098869   431 tablet_replica.cc:333] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6: stopping tablet replica
I20260709 13:04:09.099586   431 raft_consensus.cc:2243] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.100245   431 raft_consensus.cc:2272] T b37805060ac444b6b6e9e7da8164233c P 7e839e91a1314c2f9a99b25b17c916a6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.103209   431 tablet_replica.cc:333] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6: stopping tablet replica
I20260709 13:04:09.103814   431 raft_consensus.cc:2243] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:04:09.104856   431 raft_consensus.cc:2272] T 75a149db07824e3fb3c1f721b61d6c20 P 7e839e91a1314c2f9a99b25b17c916a6 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.395486   431 tablet_server.cc:196] TabletServer@127.0.107.196:0 shutdown complete.
I20260709 13:04:09.462478   431 master.cc:562] Master@127.0.107.254:37303 shutting down...
W20260709 13:04:09.501727  1538 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:04:09.502092  1538 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:04:09.502326  1538 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:04:25.023072  1477 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111) [suppressed 68 similar messages]
W20260709 13:04:25.029415  1477 catalog_manager.cc:4755] TS 6d4de2ce0683442498244b9529127f91 (127.0.107.193:33325): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 17b4f0abad654424ae8d47e63dbf2067: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33325: connect: Connection refused (error 111)
I20260709 13:04:26.515905   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:26.517251   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.517608   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5b36a7ca64a64fb998a5720e2ed486da: stopping tablet replica
I20260709 13:04:26.798771   431 master.cc:584] Master@127.0.107.254:37303 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (259403 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:04:26.938616   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:39947
I20260709 13:04:26.939900   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:26.948395  9199 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:26.948472   431 server_base.cc:1061] running on GCE node
W20260709 13:04:26.948566  9197 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:26.948637  9196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:26.952242   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:26.952507   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:26.952703   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602266952675 us; error 0 us; skew 500 ppm
I20260709 13:04:26.953492   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:26.956656   431 webserver.cc:533] Webserver started at http://127.0.107.254:35281/ using document root <none> and password file <none>
I20260709 13:04:26.957320   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:26.957542   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:26.957844   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:26.959215   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601979855482-431-0/minicluster-data/master-0-root/instance:
uuid: "c7bbf8b42238465898b968984e058005"
format_stamp: "Formatted at 2026-07-09 13:04:26 on dist-test-slave-g4pn"
I20260709 13:04:26.964164   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:04:26.968048  9204 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:26.968900   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:04:26.969242   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601979855482-431-0/minicluster-data/master-0-root
uuid: "c7bbf8b42238465898b968984e058005"
format_stamp: "Formatted at 2026-07-09 13:04:26 on dist-test-slave-g4pn"
I20260709 13:04:26.969558   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601979855482-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601979855482-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601979855482-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:26.988977   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:26.990363   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:27.038897   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:39947
I20260709 13:04:27.039011  9255 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:39947 every 8 connection(s)
I20260709 13:04:27.043691  9256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.057278  9256 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7bbf8b42238465898b968984e058005: Bootstrap starting.
I20260709 13:04:27.062994  9256 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c7bbf8b42238465898b968984e058005: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.067723  9256 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7bbf8b42238465898b968984e058005: No bootstrap required, opened a new log
I20260709 13:04:27.070147  9256 raft_consensus.cc:359] T 00000000000000000000000000000000 P c7bbf8b42238465898b968984e058005 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7bbf8b42238465898b968984e058005" member_type: VOTER }
I20260709 13:04:27.070643  9256 raft_consensus.cc:385] T 00000000000000000000000000000000 P c7bbf8b42238465898b968984e058005 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.070865  9256 raft_consensus.cc:740] T 00000000000000000000000000000000 P c7bbf8b42238465898b968984e058005 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bbf8b42238465898b968984e058005, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.071516  9256 consensus_queue.cc:260] T 00000000000000000000000000000000 P c7bbf8b42238465898b968984e058005 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7bbf8b42238465898b968984e058005" member_type: VOTER }
I20260709 13:04:27.072005  9256 raft_consensus.cc:399] T 00000000000000000000000000000000 P c7bbf8b42238465898b968984e058005 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:27.072211  9256 raft_consensus.cc:493] T 00000000000000000000000000000000 P c7bbf8b42238465898b968984e058005 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:27.072438  9256 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c7bbf8b42238465898b968984e058005 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:27.077479  9256 raft_consensus.cc:515] T 00000000000000000000000000000000 P c7bbf8b42238465898b968984e058005 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7bbf8b42238465898b968984e058005" member_type: VOTER }
I20260709 13:04:27.078037  9256 leader_election.cc:304] T 00000000000000000000000000000000 P c7bbf8b42238465898b968984e058005 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c7bbf8b42238465898b968984e058005; no voters: 
I20260709 13:04:27.079298  9256 leader_election.cc:290] T 00000000000000000000000000000000 P c7bbf8b42238465898b968984e058005 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:27.079723  9259 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c7bbf8b42238465898b968984e058005 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:27.081262  9259 raft_consensus.cc:697] T 00000000000000000000000000000000 P c7bbf8b42238465898b968984e058005 [term 1 LEADER]: Becoming Leader. State: Replica: c7bbf8b42238465898b968984e058005, State: Running, Role: LEADER
I20260709 13:04:27.082223  9259 consensus_queue.cc:237] T 00000000000000000000000000000000 P c7bbf8b42238465898b968984e058005 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7bbf8b42238465898b968984e058005" member_type: VOTER }
I20260709 13:04:27.082492  9256 sys_catalog.cc:565] T 00000000000000000000000000000000 P c7bbf8b42238465898b968984e058005 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:27.090931  9260 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7bbf8b42238465898b968984e058005 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c7bbf8b42238465898b968984e058005" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7bbf8b42238465898b968984e058005" member_type: VOTER } }
I20260709 13:04:27.091109  9261 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7bbf8b42238465898b968984e058005 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c7bbf8b42238465898b968984e058005. Latest consensus state: current_term: 1 leader_uuid: "c7bbf8b42238465898b968984e058005" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7bbf8b42238465898b968984e058005" member_type: VOTER } }
I20260709 13:04:27.091573  9260 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7bbf8b42238465898b968984e058005 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:27.091871  9261 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7bbf8b42238465898b968984e058005 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:27.093673  9269 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:27.101325  9269 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:27.102394   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:27.111023  9269 catalog_manager.cc:1383] Generated new cluster ID: 7638afbb2d13414db6121140cbd70a03
I20260709 13:04:27.111356  9269 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:27.138213  9269 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:27.139557  9269 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:27.156219  9269 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c7bbf8b42238465898b968984e058005: Generated new TSK 0
I20260709 13:04:27.156844  9269 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:27.169975   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:27.176782  9277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:27.177989  9278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:27.180039  9280 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:27.181046   431 server_base.cc:1061] running on GCE node
I20260709 13:04:27.183988   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:27.184244   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:27.184406   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602267184392 us; error 0 us; skew 500 ppm
I20260709 13:04:27.184960   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:27.187659   431 webserver.cc:533] Webserver started at http://127.0.107.193:34135/ using document root <none> and password file <none>
I20260709 13:04:27.188119   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:27.188284   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:27.188516   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:27.189935   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601979855482-431-0/minicluster-data/ts-0-root/instance:
uuid: "932245f14aac417f913cc7330a1833b8"
format_stamp: "Formatted at 2026-07-09 13:04:27 on dist-test-slave-g4pn"
I20260709 13:04:27.194736   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:04:27.198349  9285 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:27.199299   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:04:27.199643   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601979855482-431-0/minicluster-data/ts-0-root
uuid: "932245f14aac417f913cc7330a1833b8"
format_stamp: "Formatted at 2026-07-09 13:04:27 on dist-test-slave-g4pn"
I20260709 13:04:27.199906   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601979855482-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601979855482-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601979855482-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:27.227658   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:27.229040   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:27.230787   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:27.233353   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:27.233543   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:27.233842   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:27.233999   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:27.281486   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:37633
I20260709 13:04:27.281666  9347 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:37633 every 8 connection(s)
I20260709 13:04:27.287017   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:27.296399  9352 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:27.298415  9353 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:27.300096  9355 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:27.301156   431 server_base.cc:1061] running on GCE node
I20260709 13:04:27.303459   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:27.303776   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:27.304020   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602267303982 us; error 0 us; skew 500 ppm
I20260709 13:04:27.304811   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:27.307629   431 webserver.cc:533] Webserver started at http://127.0.107.194:44697/ using document root <none> and password file <none>
I20260709 13:04:27.307894  9348 heartbeater.cc:344] Connected to a master server at 127.0.107.254:39947
I20260709 13:04:27.308137   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:27.308301  9348 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:27.308418   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:27.308876   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:27.309510  9348 heartbeater.cc:507] Master 127.0.107.254:39947 requested a full tablet report, sending...
I20260709 13:04:27.310266   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601979855482-431-0/minicluster-data/ts-1-root/instance:
uuid: "a91e8b10a5984dec9d3777a7275cef49"
format_stamp: "Formatted at 2026-07-09 13:04:27 on dist-test-slave-g4pn"
I20260709 13:04:27.312206  9221 ts_manager.cc:194] Registered new tserver with Master: 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:27.315071  9221 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33168
I20260709 13:04:27.316648   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:04:27.321210  9360 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:27.322187   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:04:27.322538   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601979855482-431-0/minicluster-data/ts-1-root
uuid: "a91e8b10a5984dec9d3777a7275cef49"
format_stamp: "Formatted at 2026-07-09 13:04:27 on dist-test-slave-g4pn"
I20260709 13:04:27.322885   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601979855482-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601979855482-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601979855482-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:27.335698   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:27.337167   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:27.338667   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:27.340970   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:27.341300   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:27.341548   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:27.341725   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:27.393582   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:33607
I20260709 13:04:27.393703  9422 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:33607 every 8 connection(s)
I20260709 13:04:27.399143   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:27.410364  9426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:27.412329  9427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:27.413445   431 server_base.cc:1061] running on GCE node
W20260709 13:04:27.415403  9429 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:27.415827  9423 heartbeater.cc:344] Connected to a master server at 127.0.107.254:39947
I20260709 13:04:27.416373  9423 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:27.416641   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:27.416952   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:27.417161   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602267417138 us; error 0 us; skew 500 ppm
I20260709 13:04:27.417336  9423 heartbeater.cc:507] Master 127.0.107.254:39947 requested a full tablet report, sending...
I20260709 13:04:27.417793   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:27.419914  9221 ts_manager.cc:194] Registered new tserver with Master: a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:27.420595   431 webserver.cc:533] Webserver started at http://127.0.107.195:40413/ using document root <none> and password file <none>
I20260709 13:04:27.421234   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:27.421452   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:27.421725   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:27.422443  9221 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33182
I20260709 13:04:27.423235   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601979855482-431-0/minicluster-data/ts-2-root/instance:
uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
format_stamp: "Formatted at 2026-07-09 13:04:27 on dist-test-slave-g4pn"
I20260709 13:04:27.429741   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.001s	sys 0.006s
I20260709 13:04:27.434844  9434 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:27.435863   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 13:04:27.436299   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601979855482-431-0/minicluster-data/ts-2-root
uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
format_stamp: "Formatted at 2026-07-09 13:04:27 on dist-test-slave-g4pn"
I20260709 13:04:27.436625   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601979855482-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601979855482-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601979855482-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:27.453285   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:27.454927   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:27.456856   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:27.459863   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:27.460067   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:27.460373   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:27.460530   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:27.519529   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:38559
I20260709 13:04:27.519650  9496 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:38559 every 8 connection(s)
I20260709 13:04:27.527791   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:27.539232  9500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:27.541849  9501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:27.543340  9497 heartbeater.cc:344] Connected to a master server at 127.0.107.254:39947
I20260709 13:04:27.544054  9497 heartbeater.cc:461] Registering TS with master...
W20260709 13:04:27.544198  9503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:27.546319  9497 heartbeater.cc:507] Master 127.0.107.254:39947 requested a full tablet report, sending...
I20260709 13:04:27.549110   431 server_base.cc:1061] running on GCE node
I20260709 13:04:27.549937  9221 ts_manager.cc:194] Registered new tserver with Master: ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:27.551196   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:27.551888   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:27.552253   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602267552227 us; error 0 us; skew 500 ppm
I20260709 13:04:27.553416   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:27.553722  9221 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33198
I20260709 13:04:27.557714   431 webserver.cc:533] Webserver started at http://127.0.107.196:41593/ using document root <none> and password file <none>
I20260709 13:04:27.558290   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:27.558456   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:27.558658   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:27.559935   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601979855482-431-0/minicluster-data/ts-3-root/instance:
uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
format_stamp: "Formatted at 2026-07-09 13:04:27 on dist-test-slave-g4pn"
I20260709 13:04:27.565169   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.002s
I20260709 13:04:27.569139  9508 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:27.570892   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:04:27.571285   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601979855482-431-0/minicluster-data/ts-3-root
uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
format_stamp: "Formatted at 2026-07-09 13:04:27 on dist-test-slave-g4pn"
I20260709 13:04:27.571593   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601979855482-431-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601979855482-431-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601979855482-431-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:27.602640   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:27.604036   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:27.606184   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:27.608831   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:27.609138   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:27.609457   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:27.609632   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:27.665701   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.196:37995
I20260709 13:04:27.665827  9570 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.196:37995 every 8 connection(s)
I20260709 13:04:27.682192  9571 heartbeater.cc:344] Connected to a master server at 127.0.107.254:39947
I20260709 13:04:27.682613  9571 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:27.683853  9571 heartbeater.cc:507] Master 127.0.107.254:39947 requested a full tablet report, sending...
I20260709 13:04:27.686189  9221 ts_manager.cc:194] Registered new tserver with Master: dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:27.686708   431 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.017198698s
I20260709 13:04:27.688169  9221 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33210
I20260709 13:04:27.733412  9221 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33222:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:04:28.022509  9388 tablet_service.cc:1511] Processing CreateTablet for tablet a8fbcbebcf87468f821e14a079bf305d (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:04:28.025125  9385 tablet_service.cc:1511] Processing CreateTablet for tablet 9b34d97496514d29a27c52d749609084 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:04:28.027406  9385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b34d97496514d29a27c52d749609084. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.027053  9387 tablet_service.cc:1511] Processing CreateTablet for tablet 879fbf42aa3c4c21a58f094d1a2b91e7 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:04:28.028551  9387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 879fbf42aa3c4c21a58f094d1a2b91e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.031510  9386 tablet_service.cc:1511] Processing CreateTablet for tablet 99fc4b4b16d0432390a92d5c04149ce1 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:04:28.034708  9535 tablet_service.cc:1511] Processing CreateTablet for tablet e7d162d34de74e47895dac207e265059 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:04:28.036309  9535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7d162d34de74e47895dac207e265059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.037730  9384 tablet_service.cc:1511] Processing CreateTablet for tablet 5cfc1f2582a64d8dbc3f127e15024ec0 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:04:28.038632  9533 tablet_service.cc:1511] Processing CreateTablet for tablet 5cfc1f2582a64d8dbc3f127e15024ec0 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:04:28.040177  9533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cfc1f2582a64d8dbc3f127e15024ec0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.044200  9536 tablet_service.cc:1511] Processing CreateTablet for tablet a8fbcbebcf87468f821e14a079bf305d (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:04:28.046083  9536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8fbcbebcf87468f821e14a079bf305d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.031543  9534 tablet_service.cc:1511] Processing CreateTablet for tablet 99fc4b4b16d0432390a92d5c04149ce1 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:04:28.049538  9383 tablet_service.cc:1511] Processing CreateTablet for tablet 120581d9b8ba40dd854cec64a671e394 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:04:28.050697  9534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99fc4b4b16d0432390a92d5c04149ce1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.060462  9382 tablet_service.cc:1511] Processing CreateTablet for tablet 73b8fed487d54513b9256d4c1a39cfa0 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:04:28.061199  9386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99fc4b4b16d0432390a92d5c04149ce1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.063031  9383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 120581d9b8ba40dd854cec64a671e394. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.065811  9532 tablet_service.cc:1511] Processing CreateTablet for tablet 225ca60d9645490dbcdcf6d4d127d955 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:04:28.067771  9532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 225ca60d9645490dbcdcf6d4d127d955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.073760  9382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73b8fed487d54513b9256d4c1a39cfa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.072736  9531 tablet_service.cc:1511] Processing CreateTablet for tablet 120581d9b8ba40dd854cec64a671e394 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:04:28.083847  9531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 120581d9b8ba40dd854cec64a671e394. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.094939  9384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cfc1f2582a64d8dbc3f127e15024ec0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:28.096704  9268 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:28.098168  9388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8fbcbebcf87468f821e14a079bf305d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.099035  9313 tablet_service.cc:1511] Processing CreateTablet for tablet a8fbcbebcf87468f821e14a079bf305d (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:04:28.100620  9313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8fbcbebcf87468f821e14a079bf305d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.107064  9312 tablet_service.cc:1511] Processing CreateTablet for tablet 879fbf42aa3c4c21a58f094d1a2b91e7 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:04:28.108736  9312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 879fbf42aa3c4c21a58f094d1a2b91e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.114603  9311 tablet_service.cc:1511] Processing CreateTablet for tablet e7d162d34de74e47895dac207e265059 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:04:28.116405  9311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7d162d34de74e47895dac207e265059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.120955  9310 tablet_service.cc:1511] Processing CreateTablet for tablet 9b34d97496514d29a27c52d749609084 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:04:28.122802  9310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b34d97496514d29a27c52d749609084. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.126943  9462 tablet_service.cc:1511] Processing CreateTablet for tablet 879fbf42aa3c4c21a58f094d1a2b91e7 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:04:28.129444  9459 tablet_service.cc:1511] Processing CreateTablet for tablet 9b34d97496514d29a27c52d749609084 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:04:28.130355  9530 tablet_service.cc:1511] Processing CreateTablet for tablet ad58816d959840df923159e870cf4ad8 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:04:28.133025  9530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad58816d959840df923159e870cf4ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.133898  9460 tablet_service.cc:1511] Processing CreateTablet for tablet 99fc4b4b16d0432390a92d5c04149ce1 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:04:28.134549  9456 tablet_service.cc:1511] Processing CreateTablet for tablet 73b8fed487d54513b9256d4c1a39cfa0 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:04:28.138438  9461 tablet_service.cc:1511] Processing CreateTablet for tablet e7d162d34de74e47895dac207e265059 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:04:28.143191  9381 tablet_service.cc:1511] Processing CreateTablet for tablet ad58816d959840df923159e870cf4ad8 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:04:28.138454  9457 tablet_service.cc:1511] Processing CreateTablet for tablet 120581d9b8ba40dd854cec64a671e394 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:04:28.136621  9458 tablet_service.cc:1511] Processing CreateTablet for tablet 225ca60d9645490dbcdcf6d4d127d955 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:04:28.128472  9462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 879fbf42aa3c4c21a58f094d1a2b91e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.160969  9456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73b8fed487d54513b9256d4c1a39cfa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.160593  9455 tablet_service.cc:1511] Processing CreateTablet for tablet 331d1446396c45ce9486793ecb5de7f7 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:04:28.162303  9381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad58816d959840df923159e870cf4ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.163479  9455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 331d1446396c45ce9486793ecb5de7f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.164539  9461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7d162d34de74e47895dac207e265059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.165434  9460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99fc4b4b16d0432390a92d5c04149ce1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.169448  9459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b34d97496514d29a27c52d749609084. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.170164  9458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 225ca60d9645490dbcdcf6d4d127d955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.172283  9457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 120581d9b8ba40dd854cec64a671e394. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.235251  9592 tablet_bootstrap.cc:492] T e7d162d34de74e47895dac207e265059 P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:28.245335  9535 tablet_service.cc:1511] Processing CreateTablet for tablet 331d1446396c45ce9486793ecb5de7f7 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:04:28.246886  9535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 331d1446396c45ce9486793ecb5de7f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.273161  9590 tablet_bootstrap.cc:492] T e7d162d34de74e47895dac207e265059 P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
I20260709 13:04:28.274747  9593 tablet_bootstrap.cc:492] T 120581d9b8ba40dd854cec64a671e394 P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:28.250733  9309 tablet_service.cc:1511] Processing CreateTablet for tablet 225ca60d9645490dbcdcf6d4d127d955 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:04:28.282251  9593 tablet_bootstrap.cc:654] T 120581d9b8ba40dd854cec64a671e394 P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.282356  9309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 225ca60d9645490dbcdcf6d4d127d955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.285619  9313 tablet_service.cc:1511] Processing CreateTablet for tablet 5cfc1f2582a64d8dbc3f127e15024ec0 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:04:28.287259  9313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cfc1f2582a64d8dbc3f127e15024ec0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.288805  9592 tablet_bootstrap.cc:654] T e7d162d34de74e47895dac207e265059 P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.305930  9386 tablet_service.cc:1511] Processing CreateTablet for tablet 24abd32dde1f44c7af83b9344e632ab0 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:04:28.307888  9386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24abd32dde1f44c7af83b9344e632ab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.312861  9308 tablet_service.cc:1511] Processing CreateTablet for tablet 73b8fed487d54513b9256d4c1a39cfa0 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:04:28.314711  9308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73b8fed487d54513b9256d4c1a39cfa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.318871  9348 heartbeater.cc:499] Master 127.0.107.254:39947 was elected leader, sending a full tablet report...
I20260709 13:04:28.319010  9307 tablet_service.cc:1511] Processing CreateTablet for tablet ad58816d959840df923159e870cf4ad8 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:04:28.321928  9306 tablet_service.cc:1511] Processing CreateTablet for tablet 331d1446396c45ce9486793ecb5de7f7 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:04:28.324352  9306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 331d1446396c45ce9486793ecb5de7f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.330201  9591 tablet_bootstrap.cc:492] T 879fbf42aa3c4c21a58f094d1a2b91e7 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:28.331241  9307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad58816d959840df923159e870cf4ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.339157  9461 tablet_service.cc:1511] Processing CreateTablet for tablet 24abd32dde1f44c7af83b9344e632ab0 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:04:28.340863  9461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24abd32dde1f44c7af83b9344e632ab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.341573  9533 tablet_service.cc:1511] Processing CreateTablet for tablet 24abd32dde1f44c7af83b9344e632ab0 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:04:28.342955  9533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24abd32dde1f44c7af83b9344e632ab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.308733  9590 tablet_bootstrap.cc:654] T e7d162d34de74e47895dac207e265059 P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.370990  9381 tablet_service.cc:1511] Processing CreateTablet for tablet 8c1e5b4bc1bc437884e6835b61227d4d (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:04:28.372649  9381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c1e5b4bc1bc437884e6835b61227d4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.390389  9593 tablet_bootstrap.cc:492] T 120581d9b8ba40dd854cec64a671e394 P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:28.391022  9593 ts_tablet_manager.cc:1403] T 120581d9b8ba40dd854cec64a671e394 P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.117s	user 0.016s	sys 0.007s
I20260709 13:04:28.404884  9592 tablet_bootstrap.cc:492] T e7d162d34de74e47895dac207e265059 P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:28.405881  9592 ts_tablet_manager.cc:1403] T e7d162d34de74e47895dac207e265059 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.171s	user 0.026s	sys 0.018s
I20260709 13:04:28.410359  9310 tablet_service.cc:1511] Processing CreateTablet for tablet 8c1e5b4bc1bc437884e6835b61227d4d (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:04:28.411798  9310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c1e5b4bc1bc437884e6835b61227d4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.414179  9532 tablet_service.cc:1511] Processing CreateTablet for tablet b31d08e4168243f08eb2a31031a039ed (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:04:28.414798  9592 raft_consensus.cc:359] T e7d162d34de74e47895dac207e265059 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:28.415659  9532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b31d08e4168243f08eb2a31031a039ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.415741  9592 raft_consensus.cc:385] T e7d162d34de74e47895dac207e265059 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.416193  9592 raft_consensus.cc:740] T e7d162d34de74e47895dac207e265059 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.417099  9592 consensus_queue.cc:260] T e7d162d34de74e47895dac207e265059 P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:28.420120  9461 tablet_service.cc:1511] Processing CreateTablet for tablet 8c1e5b4bc1bc437884e6835b61227d4d (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:04:28.421895  9461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c1e5b4bc1bc437884e6835b61227d4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.426653  9423 heartbeater.cc:499] Master 127.0.107.254:39947 was elected leader, sending a full tablet report...
I20260709 13:04:28.427044  9591 tablet_bootstrap.cc:654] T 879fbf42aa3c4c21a58f094d1a2b91e7 P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.432490  9593 raft_consensus.cc:359] T 120581d9b8ba40dd854cec64a671e394 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:28.433457  9593 raft_consensus.cc:385] T 120581d9b8ba40dd854cec64a671e394 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.433776  9593 raft_consensus.cc:740] T 120581d9b8ba40dd854cec64a671e394 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.437508  9385 tablet_service.cc:1511] Processing CreateTablet for tablet b31d08e4168243f08eb2a31031a039ed (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:04:28.438920  9385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b31d08e4168243f08eb2a31031a039ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.446552  9311 tablet_service.cc:1511] Processing CreateTablet for tablet b31d08e4168243f08eb2a31031a039ed (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:04:28.448029  9311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b31d08e4168243f08eb2a31031a039ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.452129  9458 tablet_service.cc:1511] Processing CreateTablet for tablet 93877deb770d41a6ba34cefdea146d54 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:04:28.453675  9533 tablet_service.cc:1511] Processing CreateTablet for tablet 93877deb770d41a6ba34cefdea146d54 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:04:28.453994  9593 consensus_queue.cc:260] T 120581d9b8ba40dd854cec64a671e394 P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:28.454556  9458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93877deb770d41a6ba34cefdea146d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.455075  9533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93877deb770d41a6ba34cefdea146d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.466188  9310 tablet_service.cc:1511] Processing CreateTablet for tablet 93877deb770d41a6ba34cefdea146d54 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:04:28.474627  9381 tablet_service.cc:1511] Processing CreateTablet for tablet 01a5f4a59c5e47bc8b7b11db44d80006 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:04:28.477010  9310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93877deb770d41a6ba34cefdea146d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.477429  9456 tablet_service.cc:1511] Processing CreateTablet for tablet 01a5f4a59c5e47bc8b7b11db44d80006 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:04:28.478164  9381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01a5f4a59c5e47bc8b7b11db44d80006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.478844  9456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01a5f4a59c5e47bc8b7b11db44d80006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.484251  9590 tablet_bootstrap.cc:492] T e7d162d34de74e47895dac207e265059 P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:28.485590  9590 ts_tablet_manager.cc:1403] T e7d162d34de74e47895dac207e265059 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.267s	user 0.021s	sys 0.000s
I20260709 13:04:28.502074  9590 raft_consensus.cc:359] T e7d162d34de74e47895dac207e265059 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:28.503005  9590 raft_consensus.cc:385] T e7d162d34de74e47895dac207e265059 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.503374  9590 raft_consensus.cc:740] T e7d162d34de74e47895dac207e265059 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.504487  9590 consensus_queue.cc:260] T e7d162d34de74e47895dac207e265059 P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:28.519160  9571 heartbeater.cc:499] Master 127.0.107.254:39947 was elected leader, sending a full tablet report...
I20260709 13:04:28.522539  9593 ts_tablet_manager.cc:1434] T 120581d9b8ba40dd854cec64a671e394 P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.131s	user 0.010s	sys 0.001s
I20260709 13:04:28.523744  9593 tablet_bootstrap.cc:492] T 5cfc1f2582a64d8dbc3f127e15024ec0 P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:28.526559  9592 ts_tablet_manager.cc:1434] T e7d162d34de74e47895dac207e265059 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.120s	user 0.028s	sys 0.024s
I20260709 13:04:28.527727  9592 tablet_bootstrap.cc:492] T 99fc4b4b16d0432390a92d5c04149ce1 P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:28.527830  9497 heartbeater.cc:499] Master 127.0.107.254:39947 was elected leader, sending a full tablet report...
W20260709 13:04:28.534932  9498 tablet.cc:2406] T e7d162d34de74e47895dac207e265059 P ef5fe58eb3e04ae18fda957b4d507eff: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:04:28.535250  9597 raft_consensus.cc:493] T e7d162d34de74e47895dac207e265059 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.535791  9597 raft_consensus.cc:515] T e7d162d34de74e47895dac207e265059 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:28.544057  9590 ts_tablet_manager.cc:1434] T e7d162d34de74e47895dac207e265059 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.058s	user 0.011s	sys 0.004s
I20260709 13:04:28.545415  9590 tablet_bootstrap.cc:492] T 5cfc1f2582a64d8dbc3f127e15024ec0 P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
I20260709 13:04:28.545498  9310 tablet_service.cc:1511] Processing CreateTablet for tablet 7937a8107df4458ebd48b5ce1589d788 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:04:28.547298  9310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7937a8107df4458ebd48b5ce1589d788. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.553370  9590 tablet_bootstrap.cc:654] T 5cfc1f2582a64d8dbc3f127e15024ec0 P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.542941  9535 tablet_service.cc:1511] Processing CreateTablet for tablet 01a5f4a59c5e47bc8b7b11db44d80006 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:04:28.555485  9535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01a5f4a59c5e47bc8b7b11db44d80006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.555866  9591 tablet_bootstrap.cc:492] T 879fbf42aa3c4c21a58f094d1a2b91e7 P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:28.556452  9591 ts_tablet_manager.cc:1403] T 879fbf42aa3c4c21a58f094d1a2b91e7 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.227s	user 0.018s	sys 0.005s
I20260709 13:04:28.559123  9597 leader_election.cc:290] T e7d162d34de74e47895dac207e265059 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:28.562492  9386 tablet_service.cc:1511] Processing CreateTablet for tablet 7937a8107df4458ebd48b5ce1589d788 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:04:28.563901  9386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7937a8107df4458ebd48b5ce1589d788. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.566679  9461 tablet_service.cc:1511] Processing CreateTablet for tablet 7937a8107df4458ebd48b5ce1589d788 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:04:28.568729  9461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7937a8107df4458ebd48b5ce1589d788. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.566761  9534 tablet_service.cc:1511] Processing CreateTablet for tablet a55798aa4230462f9befe5d7fc9bd3ce (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:04:28.574108  9534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a55798aa4230462f9befe5d7fc9bd3ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.570118  9592 tablet_bootstrap.cc:654] T 99fc4b4b16d0432390a92d5c04149ce1 P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.579627  9308 tablet_service.cc:1511] Processing CreateTablet for tablet a55798aa4230462f9befe5d7fc9bd3ce (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:04:28.581102  9308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a55798aa4230462f9befe5d7fc9bd3ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.586819  9591 raft_consensus.cc:359] T 879fbf42aa3c4c21a58f094d1a2b91e7 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:28.591979  9599 raft_consensus.cc:493] T e7d162d34de74e47895dac207e265059 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.592885  9593 tablet_bootstrap.cc:654] T 5cfc1f2582a64d8dbc3f127e15024ec0 P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.592625  9599 raft_consensus.cc:515] T e7d162d34de74e47895dac207e265059 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:28.597669  9591 raft_consensus.cc:385] T 879fbf42aa3c4c21a58f094d1a2b91e7 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.600914  9591 raft_consensus.cc:740] T 879fbf42aa3c4c21a58f094d1a2b91e7 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.601882  9591 consensus_queue.cc:260] T 879fbf42aa3c4c21a58f094d1a2b91e7 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:28.603004  9599 leader_election.cc:290] T e7d162d34de74e47895dac207e265059 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:28.620039  9385 tablet_service.cc:1511] Processing CreateTablet for tablet a55798aa4230462f9befe5d7fc9bd3ce (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:04:28.626550  9385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a55798aa4230462f9befe5d7fc9bd3ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.627774  9590 tablet_bootstrap.cc:492] T 5cfc1f2582a64d8dbc3f127e15024ec0 P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:28.628325  9590 ts_tablet_manager.cc:1403] T 5cfc1f2582a64d8dbc3f127e15024ec0 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.083s	user 0.011s	sys 0.007s
I20260709 13:04:28.630652  9456 tablet_service.cc:1511] Processing CreateTablet for tablet 9a8ed4502cb447c7b2cb94c96dcb7daf (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:04:28.632047  9456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a8ed4502cb447c7b2cb94c96dcb7daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.631712  9590 raft_consensus.cc:359] T 5cfc1f2582a64d8dbc3f127e15024ec0 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:28.632470  9590 raft_consensus.cc:385] T 5cfc1f2582a64d8dbc3f127e15024ec0 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.632805  9590 raft_consensus.cc:740] T 5cfc1f2582a64d8dbc3f127e15024ec0 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.661393  9591 ts_tablet_manager.cc:1434] T 879fbf42aa3c4c21a58f094d1a2b91e7 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.105s	user 0.013s	sys 0.007s
I20260709 13:04:28.661350  9387 tablet_service.cc:1511] Processing CreateTablet for tablet faf56b218e614e51962171088f3c4f63 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:04:28.662930  9387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faf56b218e614e51962171088f3c4f63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.665891  9591 tablet_bootstrap.cc:492] T a8fbcbebcf87468f821e14a079bf305d P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:28.673867  9592 tablet_bootstrap.cc:492] T 99fc4b4b16d0432390a92d5c04149ce1 P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:28.674546  9592 ts_tablet_manager.cc:1403] T 99fc4b4b16d0432390a92d5c04149ce1 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.147s	user 0.016s	sys 0.007s
I20260709 13:04:28.637913  9590 consensus_queue.cc:260] T 5cfc1f2582a64d8dbc3f127e15024ec0 P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:28.680639  9546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7d162d34de74e47895dac207e265059" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:28.681501  9546 raft_consensus.cc:2468] T e7d162d34de74e47895dac207e265059 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 0.
I20260709 13:04:28.681811  9458 tablet_service.cc:1511] Processing CreateTablet for tablet faf56b218e614e51962171088f3c4f63 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:04:28.683236  9458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faf56b218e614e51962171088f3c4f63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.683039  9438 leader_election.cc:304] T e7d162d34de74e47895dac207e265059 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:28.684234  9597 raft_consensus.cc:2804] T e7d162d34de74e47895dac207e265059 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:28.684770  9597 raft_consensus.cc:493] T e7d162d34de74e47895dac207e265059 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:28.685137  9597 raft_consensus.cc:3060] T e7d162d34de74e47895dac207e265059 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.687687  9311 tablet_service.cc:1511] Processing CreateTablet for tablet 9a8ed4502cb447c7b2cb94c96dcb7daf (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:04:28.686813  9590 ts_tablet_manager.cc:1434] T 5cfc1f2582a64d8dbc3f127e15024ec0 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.058s	user 0.003s	sys 0.008s
I20260709 13:04:28.689922  9592 raft_consensus.cc:359] T 99fc4b4b16d0432390a92d5c04149ce1 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:28.693037  9591 tablet_bootstrap.cc:654] T a8fbcbebcf87468f821e14a079bf305d P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.695971  9592 raft_consensus.cc:385] T 99fc4b4b16d0432390a92d5c04149ce1 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.698796  9592 raft_consensus.cc:740] T 99fc4b4b16d0432390a92d5c04149ce1 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.699786  9592 consensus_queue.cc:260] T 99fc4b4b16d0432390a92d5c04149ce1 P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:28.700320  9590 tablet_bootstrap.cc:492] T 120581d9b8ba40dd854cec64a671e394 P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
I20260709 13:04:28.715260  9590 tablet_bootstrap.cc:654] T 120581d9b8ba40dd854cec64a671e394 P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.716034  9600 raft_consensus.cc:493] T 120581d9b8ba40dd854cec64a671e394 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.716603  9600 raft_consensus.cc:515] T 120581d9b8ba40dd854cec64a671e394 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:28.722226  9310 tablet_service.cc:1511] Processing CreateTablet for tablet 63d5c2ea967a4c1586216c60202c5514 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:04:28.723011  9600 leader_election.cc:290] T 120581d9b8ba40dd854cec64a671e394 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:28.736909  9386 tablet_service.cc:1511] Processing CreateTablet for tablet 63d5c2ea967a4c1586216c60202c5514 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:04:28.738513  9386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63d5c2ea967a4c1586216c60202c5514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.733664  9611 raft_consensus.cc:493] T 99fc4b4b16d0432390a92d5c04149ce1 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.747607  9611 raft_consensus.cc:515] T 99fc4b4b16d0432390a92d5c04149ce1 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:28.748406  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7d162d34de74e47895dac207e265059" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
W20260709 13:04:28.750277  9438 leader_election.cc:343] T e7d162d34de74e47895dac207e265059 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:28.746899  9311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a8ed4502cb447c7b2cb94c96dcb7daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.756342  9593 tablet_bootstrap.cc:492] T 5cfc1f2582a64d8dbc3f127e15024ec0 P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:28.756949  9593 ts_tablet_manager.cc:1403] T 5cfc1f2582a64d8dbc3f127e15024ec0 P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.233s	user 0.019s	sys 0.005s
I20260709 13:04:28.725770  9597 raft_consensus.cc:515] T e7d162d34de74e47895dac207e265059 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:28.759604  9597 leader_election.cc:290] T e7d162d34de74e47895dac207e265059 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Requested vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:28.759838  9611 leader_election.cc:290] T 99fc4b4b16d0432390a92d5c04149ce1 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:28.760361  9546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7d162d34de74e47895dac207e265059" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
I20260709 13:04:28.762607  9545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99fc4b4b16d0432390a92d5c04149ce1" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:28.762737  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7d162d34de74e47895dac207e265059" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8"
I20260709 13:04:28.757525  9310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63d5c2ea967a4c1586216c60202c5514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.772346  9546 raft_consensus.cc:3060] T e7d162d34de74e47895dac207e265059 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.773978  9532 tablet_service.cc:1511] Processing CreateTablet for tablet faf56b218e614e51962171088f3c4f63 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:04:28.775502  9532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faf56b218e614e51962171088f3c4f63. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:28.775352  9438 leader_election.cc:343] T e7d162d34de74e47895dac207e265059 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:28.776204  9438 leader_election.cc:343] T 99fc4b4b16d0432390a92d5c04149ce1 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:28.771380  9535 tablet_service.cc:1511] Processing CreateTablet for tablet 9a8ed4502cb447c7b2cb94c96dcb7daf (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:04:28.777491  9535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a8ed4502cb447c7b2cb94c96dcb7daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.790388  9534 tablet_service.cc:1511] Processing CreateTablet for tablet b94916f0e1e340a38f4a100f451fdaba (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:04:28.805975  9534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b94916f0e1e340a38f4a100f451fdaba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.804713  9308 tablet_service.cc:1511] Processing CreateTablet for tablet b94916f0e1e340a38f4a100f451fdaba (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:04:28.815335  9546 raft_consensus.cc:2468] T e7d162d34de74e47895dac207e265059 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 1.
I20260709 13:04:28.815771  9308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b94916f0e1e340a38f4a100f451fdaba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.817028  9593 raft_consensus.cc:359] T 5cfc1f2582a64d8dbc3f127e15024ec0 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:28.824645  9593 raft_consensus.cc:385] T 5cfc1f2582a64d8dbc3f127e15024ec0 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.825187  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7d162d34de74e47895dac207e265059" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:28.833518  9593 raft_consensus.cc:740] T 5cfc1f2582a64d8dbc3f127e15024ec0 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.833948  9472 raft_consensus.cc:2393] T e7d162d34de74e47895dac207e265059 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dfbbb80ab8e345e0ae1684fafefceccf in current term 1: Already voted for candidate ef5fe58eb3e04ae18fda957b4d507eff in this term.
I20260709 13:04:28.822299  9438 leader_election.cc:304] T e7d162d34de74e47895dac207e265059 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 932245f14aac417f913cc7330a1833b8
I20260709 13:04:28.832515  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7d162d34de74e47895dac207e265059" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:28.832662  9398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99fc4b4b16d0432390a92d5c04149ce1" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
W20260709 13:04:28.837517  9512 leader_election.cc:343] T e7d162d34de74e47895dac207e265059 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:28.837625  9436 leader_election.cc:343] T 99fc4b4b16d0432390a92d5c04149ce1 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:28.838306  9436 leader_election.cc:304] T 99fc4b4b16d0432390a92d5c04149ce1 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef5fe58eb3e04ae18fda957b4d507eff; no voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:28.839939  9597 raft_consensus.cc:2804] T e7d162d34de74e47895dac207e265059 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:28.840680  9597 raft_consensus.cc:697] T e7d162d34de74e47895dac207e265059 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Becoming Leader. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Running, Role: LEADER
I20260709 13:04:28.840948  9512 leader_election.cc:304] T e7d162d34de74e47895dac207e265059 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf; no voters: 932245f14aac417f913cc7330a1833b8, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:28.842247  9599 raft_consensus.cc:2749] T e7d162d34de74e47895dac207e265059 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:28.839538  9461 tablet_service.cc:1511] Processing CreateTablet for tablet 63d5c2ea967a4c1586216c60202c5514 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:04:28.841962  9597 consensus_queue.cc:237] T e7d162d34de74e47895dac207e265059 P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:28.844491  9611 raft_consensus.cc:2749] T 99fc4b4b16d0432390a92d5c04149ce1 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:28.845112  9592 ts_tablet_manager.cc:1434] T 99fc4b4b16d0432390a92d5c04149ce1 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.170s	user 0.004s	sys 0.012s
I20260709 13:04:28.846109  9599 raft_consensus.cc:493] T 5cfc1f2582a64d8dbc3f127e15024ec0 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.846642  9599 raft_consensus.cc:515] T 5cfc1f2582a64d8dbc3f127e15024ec0 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:28.842823  9593 consensus_queue.cc:260] T 5cfc1f2582a64d8dbc3f127e15024ec0 P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:28.855311  9606 raft_consensus.cc:493] T 879fbf42aa3c4c21a58f094d1a2b91e7 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.856019  9606 raft_consensus.cc:515] T 879fbf42aa3c4c21a58f094d1a2b91e7 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:28.815821  9385 tablet_service.cc:1511] Processing CreateTablet for tablet b94916f0e1e340a38f4a100f451fdaba (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:04:28.858551  9592 tablet_bootstrap.cc:492] T 120581d9b8ba40dd854cec64a671e394 P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:28.858821  9606 leader_election.cc:290] T 879fbf42aa3c4c21a58f094d1a2b91e7 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:28.859207  9533 tablet_service.cc:1511] Processing CreateTablet for tablet 17d57808c20741cd85b0e175935cdab7 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:04:28.875022  9533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d57808c20741cd85b0e175935cdab7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.877210  9385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b94916f0e1e340a38f4a100f451fdaba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.877506  9591 tablet_bootstrap.cc:492] T a8fbcbebcf87468f821e14a079bf305d P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:28.878085  9591 ts_tablet_manager.cc:1403] T a8fbcbebcf87468f821e14a079bf305d P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.212s	user 0.011s	sys 0.009s
I20260709 13:04:28.879791  9221 catalog_manager.cc:5697] T e7d162d34de74e47895dac207e265059 P ef5fe58eb3e04ae18fda957b4d507eff reported cstate change: term changed from 0 to 1, leader changed from <none> to ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:28.881256  9590 tablet_bootstrap.cc:492] T 120581d9b8ba40dd854cec64a671e394 P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:28.881953  9590 ts_tablet_manager.cc:1403] T 120581d9b8ba40dd854cec64a671e394 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.182s	user 0.013s	sys 0.015s
I20260709 13:04:28.882118  9599 leader_election.cc:290] T 5cfc1f2582a64d8dbc3f127e15024ec0 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:28.900678  9593 ts_tablet_manager.cc:1434] T 5cfc1f2582a64d8dbc3f127e15024ec0 P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.143s	user 0.004s	sys 0.005s
I20260709 13:04:28.902308  9593 tablet_bootstrap.cc:492] T a8fbcbebcf87468f821e14a079bf305d P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:28.894163  9461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63d5c2ea967a4c1586216c60202c5514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.915416  9591 raft_consensus.cc:359] T a8fbcbebcf87468f821e14a079bf305d P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:28.916288  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "120581d9b8ba40dd854cec64a671e394" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:28.916608  9591 raft_consensus.cc:385] T a8fbcbebcf87468f821e14a079bf305d P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.931842  9313 tablet_service.cc:1511] Processing CreateTablet for tablet 17d57808c20741cd85b0e175935cdab7 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
W20260709 13:04:28.933149  9364 leader_election.cc:343] T 120581d9b8ba40dd854cec64a671e394 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:28.933969  9313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d57808c20741cd85b0e175935cdab7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.932217  9456 tablet_service.cc:1511] Processing CreateTablet for tablet 85d647b0abf74fbebc7e9a9bfe14b8ea (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:04:28.911154  9458 tablet_service.cc:1511] Processing CreateTablet for tablet 17d57808c20741cd85b0e175935cdab7 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:04:28.937300  9456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85d647b0abf74fbebc7e9a9bfe14b8ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.938095  9458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d57808c20741cd85b0e175935cdab7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.943641  9546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "120581d9b8ba40dd854cec64a671e394" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
W20260709 13:04:28.945648  9364 leader_election.cc:343] T 120581d9b8ba40dd854cec64a671e394 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:28.946199  9364 leader_election.cc:304] T 120581d9b8ba40dd854cec64a671e394 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49; no voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:28.947248  9600 raft_consensus.cc:2749] T 120581d9b8ba40dd854cec64a671e394 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:28.948360  9592 tablet_bootstrap.cc:654] T 120581d9b8ba40dd854cec64a671e394 P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.952348  9535 tablet_service.cc:1511] Processing CreateTablet for tablet 85d647b0abf74fbebc7e9a9bfe14b8ea (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:04:28.952787  9309 tablet_service.cc:1511] Processing CreateTablet for tablet 2d5b6e6fcfb04bc3bb6cc0270e14e0cd (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:04:28.954226  9387 tablet_service.cc:1511] Processing CreateTablet for tablet 2d5b6e6fcfb04bc3bb6cc0270e14e0cd (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:04:28.964358  9593 tablet_bootstrap.cc:654] T a8fbcbebcf87468f821e14a079bf305d P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.957857  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cfc1f2582a64d8dbc3f127e15024ec0" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:28.965591  9387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d5b6e6fcfb04bc3bb6cc0270e14e0cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.922752  9591 raft_consensus.cc:740] T a8fbcbebcf87468f821e14a079bf305d P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.966706  9591 consensus_queue.cc:260] T a8fbcbebcf87468f821e14a079bf305d P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:28.926354  9386 tablet_service.cc:1511] Processing CreateTablet for tablet 85d647b0abf74fbebc7e9a9bfe14b8ea (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:04:28.960676  9398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879fbf42aa3c4c21a58f094d1a2b91e7" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:28.970084  9386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85d647b0abf74fbebc7e9a9bfe14b8ea. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:28.970382  9512 leader_election.cc:343] T 5cfc1f2582a64d8dbc3f127e15024ec0 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:28.970993  9309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d5b6e6fcfb04bc3bb6cc0270e14e0cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.971521  9455 tablet_service.cc:1511] Processing CreateTablet for tablet 2d5b6e6fcfb04bc3bb6cc0270e14e0cd (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
W20260709 13:04:28.972379  9287 leader_election.cc:343] T 879fbf42aa3c4c21a58f094d1a2b91e7 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:28.972860  9455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d5b6e6fcfb04bc3bb6cc0270e14e0cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.968904  9591 ts_tablet_manager.cc:1434] T a8fbcbebcf87468f821e14a079bf305d P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.090s	user 0.006s	sys 0.001s
I20260709 13:04:28.958968  9590 raft_consensus.cc:359] T 120581d9b8ba40dd854cec64a671e394 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:28.988358  9398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cfc1f2582a64d8dbc3f127e15024ec0" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:28.989137  9398 raft_consensus.cc:2468] T 5cfc1f2582a64d8dbc3f127e15024ec0 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 0.
I20260709 13:04:28.990638  9510 leader_election.cc:304] T 5cfc1f2582a64d8dbc3f127e15024ec0 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 932245f14aac417f913cc7330a1833b8
I20260709 13:04:28.991896  9599 raft_consensus.cc:2804] T 5cfc1f2582a64d8dbc3f127e15024ec0 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:28.992301  9599 raft_consensus.cc:493] T 5cfc1f2582a64d8dbc3f127e15024ec0 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:28.992645  9599 raft_consensus.cc:3060] T 5cfc1f2582a64d8dbc3f127e15024ec0 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.002516  9532 tablet_service.cc:1511] Processing CreateTablet for tablet 774befa616254c02901f28edde6ab758 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:04:29.012696  9591 tablet_bootstrap.cc:492] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:29.013482  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879fbf42aa3c4c21a58f094d1a2b91e7" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
W20260709 13:04:29.015322  9289 leader_election.cc:343] T 879fbf42aa3c4c21a58f094d1a2b91e7 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.015897  9289 leader_election.cc:304] T 879fbf42aa3c4c21a58f094d1a2b91e7 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 932245f14aac417f913cc7330a1833b8; no voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:29.016834  9606 raft_consensus.cc:2749] T 879fbf42aa3c4c21a58f094d1a2b91e7 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:28.985397  9590 raft_consensus.cc:385] T 120581d9b8ba40dd854cec64a671e394 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.024750  9590 raft_consensus.cc:740] T 120581d9b8ba40dd854cec64a671e394 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.026408  9590 consensus_queue.cc:260] T 120581d9b8ba40dd854cec64a671e394 P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:29.031607  9311 tablet_service.cc:1511] Processing CreateTablet for tablet 774befa616254c02901f28edde6ab758 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:04:29.033363  9381 tablet_service.cc:1511] Processing CreateTablet for tablet 774befa616254c02901f28edde6ab758 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:04:29.033720  9311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 774befa616254c02901f28edde6ab758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.034770  9381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 774befa616254c02901f28edde6ab758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.037058  9535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85d647b0abf74fbebc7e9a9bfe14b8ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.041754  9532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 774befa616254c02901f28edde6ab758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.043975  9599 raft_consensus.cc:515] T 5cfc1f2582a64d8dbc3f127e15024ec0 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:29.049726  9459 tablet_service.cc:1511] Processing CreateTablet for tablet f3a3d4fd34924b7c8ed0df6709391329 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:04:29.051625  9459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3a3d4fd34924b7c8ed0df6709391329. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.067734  9533 tablet_service.cc:1511] Processing CreateTablet for tablet f3a3d4fd34924b7c8ed0df6709391329 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:04:29.069213  9533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3a3d4fd34924b7c8ed0df6709391329. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.070322  9606 raft_consensus.cc:493] T a8fbcbebcf87468f821e14a079bf305d P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.070860  9606 raft_consensus.cc:515] T a8fbcbebcf87468f821e14a079bf305d P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:29.075333  9599 leader_election.cc:290] T 5cfc1f2582a64d8dbc3f127e15024ec0 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Requested vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:29.078233  9398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cfc1f2582a64d8dbc3f127e15024ec0" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:29.078931  9398 raft_consensus.cc:3060] T 5cfc1f2582a64d8dbc3f127e15024ec0 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.079998  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cfc1f2582a64d8dbc3f127e15024ec0" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8"
I20260709 13:04:29.080300  9606 leader_election.cc:290] T a8fbcbebcf87468f821e14a079bf305d P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:29.081414  9593 tablet_bootstrap.cc:492] T a8fbcbebcf87468f821e14a079bf305d P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:29.081954  9593 ts_tablet_manager.cc:1403] T a8fbcbebcf87468f821e14a079bf305d P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.180s	user 0.019s	sys 0.022s
W20260709 13:04:29.082449  9512 leader_election.cc:343] T 5cfc1f2582a64d8dbc3f127e15024ec0 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.083833  9397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fbcbebcf87468f821e14a079bf305d" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
W20260709 13:04:29.087137  9287 leader_election.cc:343] T a8fbcbebcf87468f821e14a079bf305d P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.088313  9593 raft_consensus.cc:359] T a8fbcbebcf87468f821e14a079bf305d P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:29.091862  9313 tablet_service.cc:1511] Processing CreateTablet for tablet f3a3d4fd34924b7c8ed0df6709391329 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:04:29.093500  9313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3a3d4fd34924b7c8ed0df6709391329. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.096698  9546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fbcbebcf87468f821e14a079bf305d" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:29.097958  9591 tablet_bootstrap.cc:654] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:29.100060  9268 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:29.100240  9593 raft_consensus.cc:385] T a8fbcbebcf87468f821e14a079bf305d P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:04:29.100797  9289 leader_election.cc:343] T a8fbcbebcf87468f821e14a079bf305d P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.101727  9593 raft_consensus.cc:740] T a8fbcbebcf87468f821e14a079bf305d P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.101919  9289 leader_election.cc:304] T a8fbcbebcf87468f821e14a079bf305d P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 932245f14aac417f913cc7330a1833b8; no voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:29.102861  9593 consensus_queue.cc:260] T a8fbcbebcf87468f821e14a079bf305d P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:29.103580  9606 raft_consensus.cc:2749] T a8fbcbebcf87468f821e14a079bf305d P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:29.105748  9593 ts_tablet_manager.cc:1434] T a8fbcbebcf87468f821e14a079bf305d P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 13:04:29.107677  9593 tablet_bootstrap.cc:492] T 73b8fed487d54513b9256d4c1a39cfa0 P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:29.109426  9534 tablet_service.cc:1511] Processing CreateTablet for tablet ab069642e354446db85dabd0cedd7eec (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:04:29.110873  9534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab069642e354446db85dabd0cedd7eec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.104457  9383 tablet_service.cc:1511] Processing CreateTablet for tablet ab069642e354446db85dabd0cedd7eec (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:04:29.113139  9383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab069642e354446db85dabd0cedd7eec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.113795  9456 tablet_service.cc:1511] Processing CreateTablet for tablet ab069642e354446db85dabd0cedd7eec (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:04:29.115285  9456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab069642e354446db85dabd0cedd7eec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.120658  9593 tablet_bootstrap.cc:654] T 73b8fed487d54513b9256d4c1a39cfa0 P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.157462  9398 raft_consensus.cc:2468] T 5cfc1f2582a64d8dbc3f127e15024ec0 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 1.
I20260709 13:04:29.158936  9510 leader_election.cc:304] T 5cfc1f2582a64d8dbc3f127e15024ec0 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 932245f14aac417f913cc7330a1833b8
I20260709 13:04:29.160331  9599 raft_consensus.cc:2804] T 5cfc1f2582a64d8dbc3f127e15024ec0 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:29.160830  9599 raft_consensus.cc:697] T 5cfc1f2582a64d8dbc3f127e15024ec0 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Becoming Leader. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Running, Role: LEADER
I20260709 13:04:29.161788  9599 consensus_queue.cc:237] T 5cfc1f2582a64d8dbc3f127e15024ec0 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:29.173457  9308 tablet_service.cc:1511] Processing CreateTablet for tablet 64bc8ad603604e0d9c8eb9d37ef4aed5 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:04:29.174420  9592 tablet_bootstrap.cc:492] T 120581d9b8ba40dd854cec64a671e394 P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:29.175061  9592 ts_tablet_manager.cc:1403] T 120581d9b8ba40dd854cec64a671e394 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.317s	user 0.021s	sys 0.029s
I20260709 13:04:29.176174  9308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64bc8ad603604e0d9c8eb9d37ef4aed5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.178635  9592 raft_consensus.cc:359] T 120581d9b8ba40dd854cec64a671e394 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:29.179663  9592 raft_consensus.cc:385] T 120581d9b8ba40dd854cec64a671e394 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.193235  9592 raft_consensus.cc:740] T 120581d9b8ba40dd854cec64a671e394 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.194898  9592 consensus_queue.cc:260] T 120581d9b8ba40dd854cec64a671e394 P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:29.203567  9593 tablet_bootstrap.cc:492] T 73b8fed487d54513b9256d4c1a39cfa0 P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:29.204349  9593 ts_tablet_manager.cc:1403] T 73b8fed487d54513b9256d4c1a39cfa0 P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.097s	user 0.027s	sys 0.029s
I20260709 13:04:29.208384  9593 raft_consensus.cc:359] T 73b8fed487d54513b9256d4c1a39cfa0 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:29.189472  9590 ts_tablet_manager.cc:1434] T 120581d9b8ba40dd854cec64a671e394 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.307s	user 0.009s	sys 0.009s
I20260709 13:04:29.191262  9459 tablet_service.cc:1511] Processing CreateTablet for tablet 64bc8ad603604e0d9c8eb9d37ef4aed5 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:04:29.185796  9383 tablet_service.cc:1511] Processing CreateTablet for tablet 64bc8ad603604e0d9c8eb9d37ef4aed5 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:04:29.212220  9590 tablet_bootstrap.cc:492] T a8fbcbebcf87468f821e14a079bf305d P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
I20260709 13:04:29.212926  9459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64bc8ad603604e0d9c8eb9d37ef4aed5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.209936  9593 raft_consensus.cc:385] T 73b8fed487d54513b9256d4c1a39cfa0 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.215000  9593 raft_consensus.cc:740] T 73b8fed487d54513b9256d4c1a39cfa0 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.212895  9383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64bc8ad603604e0d9c8eb9d37ef4aed5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.219219  9535 tablet_service.cc:1511] Processing CreateTablet for tablet 3c53f31a2697499cb5ad2d5bb6715f02 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:04:29.217535  9593 consensus_queue.cc:260] T 73b8fed487d54513b9256d4c1a39cfa0 P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:29.228109  9593 ts_tablet_manager.cc:1434] T 73b8fed487d54513b9256d4c1a39cfa0 P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.006s
I20260709 13:04:29.229713  9593 tablet_bootstrap.cc:492] T 9b34d97496514d29a27c52d749609084 P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:29.231029  9535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c53f31a2697499cb5ad2d5bb6715f02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.231767  9381 tablet_service.cc:1511] Processing CreateTablet for tablet 3c53f31a2697499cb5ad2d5bb6715f02 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:04:29.233372  9381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c53f31a2697499cb5ad2d5bb6715f02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.236105  9592 ts_tablet_manager.cc:1434] T 120581d9b8ba40dd854cec64a671e394 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.061s	user 0.005s	sys 0.005s
I20260709 13:04:29.236334  9590 tablet_bootstrap.cc:654] T a8fbcbebcf87468f821e14a079bf305d P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.237411  9592 tablet_bootstrap.cc:492] T 879fbf42aa3c4c21a58f094d1a2b91e7 P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:29.237452  9591 tablet_bootstrap.cc:492] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:29.238325  9591 ts_tablet_manager.cc:1403] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.226s	user 0.015s	sys 0.008s
I20260709 13:04:29.241497  9456 tablet_service.cc:1511] Processing CreateTablet for tablet 6f213937fc9b4030a228a8e56ed80f52 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:04:29.243083  9456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f213937fc9b4030a228a8e56ed80f52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.243614  9591 raft_consensus.cc:359] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:29.244491  9591 raft_consensus.cc:385] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.244809  9591 raft_consensus.cc:740] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.245587  9591 consensus_queue.cc:260] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
W20260709 13:04:29.246188  9438 consensus_peers.cc:597] T e7d162d34de74e47895dac207e265059 P ef5fe58eb3e04ae18fda957b4d507eff -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:29.249276  9593 tablet_bootstrap.cc:654] T 9b34d97496514d29a27c52d749609084 P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.237357  9313 tablet_service.cc:1511] Processing CreateTablet for tablet 3c53f31a2697499cb5ad2d5bb6715f02 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:04:29.250882  9313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c53f31a2697499cb5ad2d5bb6715f02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.252885  9592 tablet_bootstrap.cc:654] T 879fbf42aa3c4c21a58f094d1a2b91e7 P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.267804  9219 catalog_manager.cc:5697] T 5cfc1f2582a64d8dbc3f127e15024ec0 P dfbbb80ab8e345e0ae1684fafefceccf reported cstate change: term changed from 0 to 1, leader changed from <none> to dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196). New cstate: current_term: 1 leader_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:29.282503  9591 ts_tablet_manager.cc:1434] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.044s	user 0.009s	sys 0.000s
I20260709 13:04:29.289593  9534 tablet_service.cc:1511] Processing CreateTablet for tablet 6f213937fc9b4030a228a8e56ed80f52 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:04:29.291327  9534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f213937fc9b4030a228a8e56ed80f52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.291481  9308 tablet_service.cc:1511] Processing CreateTablet for tablet 6f213937fc9b4030a228a8e56ed80f52 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:04:29.295708  9308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f213937fc9b4030a228a8e56ed80f52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.296450  9387 tablet_service.cc:1511] Processing CreateTablet for tablet 47b7a6191c374a6a84d8223c573fa318 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:04:29.297928  9387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47b7a6191c374a6a84d8223c573fa318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.298074  9458 tablet_service.cc:1511] Processing CreateTablet for tablet 47b7a6191c374a6a84d8223c573fa318 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:04:29.299503  9458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47b7a6191c374a6a84d8223c573fa318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.300473  9591 tablet_bootstrap.cc:492] T 331d1446396c45ce9486793ecb5de7f7 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:29.313308  9593 tablet_bootstrap.cc:492] T 9b34d97496514d29a27c52d749609084 P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:29.313896  9593 ts_tablet_manager.cc:1403] T 9b34d97496514d29a27c52d749609084 P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.084s	user 0.014s	sys 0.014s
I20260709 13:04:29.328413  9533 tablet_service.cc:1511] Processing CreateTablet for tablet 47b7a6191c374a6a84d8223c573fa318 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:04:29.332448  9311 tablet_service.cc:1511] Processing CreateTablet for tablet 58d4c6d168b449f98425d091c54cddb9 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:04:29.333254  9591 tablet_bootstrap.cc:654] T 331d1446396c45ce9486793ecb5de7f7 P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.333959  9311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58d4c6d168b449f98425d091c54cddb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.338195  9386 tablet_service.cc:1511] Processing CreateTablet for tablet 58d4c6d168b449f98425d091c54cddb9 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:04:29.339612  9386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58d4c6d168b449f98425d091c54cddb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.332947  9533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47b7a6191c374a6a84d8223c573fa318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.348814  9590 tablet_bootstrap.cc:492] T a8fbcbebcf87468f821e14a079bf305d P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:29.349488  9590 ts_tablet_manager.cc:1403] T a8fbcbebcf87468f821e14a079bf305d P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.137s	user 0.012s	sys 0.010s
I20260709 13:04:29.352725  9590 raft_consensus.cc:359] T a8fbcbebcf87468f821e14a079bf305d P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:29.353487  9590 raft_consensus.cc:385] T a8fbcbebcf87468f821e14a079bf305d P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.353785  9590 raft_consensus.cc:740] T a8fbcbebcf87468f821e14a079bf305d P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.354564  9590 consensus_queue.cc:260] T a8fbcbebcf87468f821e14a079bf305d P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:29.358412  9590 ts_tablet_manager.cc:1434] T a8fbcbebcf87468f821e14a079bf305d P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 13:04:29.358717  9592 tablet_bootstrap.cc:492] T 879fbf42aa3c4c21a58f094d1a2b91e7 P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:29.359335  9592 ts_tablet_manager.cc:1403] T 879fbf42aa3c4c21a58f094d1a2b91e7 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.122s	user 0.015s	sys 0.030s
I20260709 13:04:29.359521  9590 tablet_bootstrap.cc:492] T ad58816d959840df923159e870cf4ad8 P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
I20260709 13:04:29.359052  9593 raft_consensus.cc:359] T 9b34d97496514d29a27c52d749609084 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:29.362236  9593 raft_consensus.cc:385] T 9b34d97496514d29a27c52d749609084 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.372545  9597 consensus_queue.cc:1048] T e7d162d34de74e47895dac207e265059 P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:29.366366  9593 raft_consensus.cc:740] T 9b34d97496514d29a27c52d749609084 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.374150  9593 consensus_queue.cc:260] T 9b34d97496514d29a27c52d749609084 P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:29.379045  9456 tablet_service.cc:1511] Processing CreateTablet for tablet 58d4c6d168b449f98425d091c54cddb9 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:04:29.381889  9456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58d4c6d168b449f98425d091c54cddb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.383875  9593 ts_tablet_manager.cc:1434] T 9b34d97496514d29a27c52d749609084 P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.002s
I20260709 13:04:29.386615  9599 raft_consensus.cc:493] T 120581d9b8ba40dd854cec64a671e394 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.384037  9532 tablet_service.cc:1511] Processing CreateTablet for tablet b305803a339e40f99c1a6af7f6f84f7c (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:04:29.392302  9599 raft_consensus.cc:515] T 120581d9b8ba40dd854cec64a671e394 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:29.393720  9532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b305803a339e40f99c1a6af7f6f84f7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.396409  9398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "120581d9b8ba40dd854cec64a671e394" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:29.397156  9398 raft_consensus.cc:2468] T 120581d9b8ba40dd854cec64a671e394 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 0.
I20260709 13:04:29.391685  9593 tablet_bootstrap.cc:492] T 99fc4b4b16d0432390a92d5c04149ce1 P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:29.402503  9510 leader_election.cc:304] T 120581d9b8ba40dd854cec64a671e394 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 
I20260709 13:04:29.386149  9592 raft_consensus.cc:359] T 879fbf42aa3c4c21a58f094d1a2b91e7 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:29.391615  9383 tablet_service.cc:1511] Processing CreateTablet for tablet b305803a339e40f99c1a6af7f6f84f7c (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:04:29.399017  9590 tablet_bootstrap.cc:654] T ad58816d959840df923159e870cf4ad8 P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.400285  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "120581d9b8ba40dd854cec64a671e394" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:29.413478  9592 raft_consensus.cc:385] T 879fbf42aa3c4c21a58f094d1a2b91e7 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.413926  9472 raft_consensus.cc:2468] T 120581d9b8ba40dd854cec64a671e394 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 0.
I20260709 13:04:29.403518  9627 raft_consensus.cc:2804] T 120581d9b8ba40dd854cec64a671e394 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:29.415150  9627 raft_consensus.cc:493] T 120581d9b8ba40dd854cec64a671e394 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:29.415560  9627 raft_consensus.cc:3060] T 120581d9b8ba40dd854cec64a671e394 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.417248  9383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b305803a339e40f99c1a6af7f6f84f7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.419188  9593 tablet_bootstrap.cc:654] T 99fc4b4b16d0432390a92d5c04149ce1 P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.396117  9599 leader_election.cc:290] T 120581d9b8ba40dd854cec64a671e394 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:29.387619  9313 tablet_service.cc:1511] Processing CreateTablet for tablet b305803a339e40f99c1a6af7f6f84f7c (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:04:29.411173  9458 tablet_service.cc:1511] Processing CreateTablet for tablet b2a7ad91c8474397bae23c993b89fca4 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:04:29.429378  9458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2a7ad91c8474397bae23c993b89fca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.413940  9592 raft_consensus.cc:740] T 879fbf42aa3c4c21a58f094d1a2b91e7 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.429371  9313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b305803a339e40f99c1a6af7f6f84f7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.442380  9627 raft_consensus.cc:515] T 120581d9b8ba40dd854cec64a671e394 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:29.447093  9398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "120581d9b8ba40dd854cec64a671e394" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:29.447909  9398 raft_consensus.cc:3060] T 120581d9b8ba40dd854cec64a671e394 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.425287  9591 tablet_bootstrap.cc:492] T 331d1446396c45ce9486793ecb5de7f7 P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:29.478529  9590 tablet_bootstrap.cc:492] T ad58816d959840df923159e870cf4ad8 P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:29.479183  9590 ts_tablet_manager.cc:1403] T ad58816d959840df923159e870cf4ad8 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.120s	user 0.010s	sys 0.005s
I20260709 13:04:29.479616  9600 raft_consensus.cc:493] T a8fbcbebcf87468f821e14a079bf305d P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.480274  9600 raft_consensus.cc:515] T a8fbcbebcf87468f821e14a079bf305d P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:29.485343  9591 ts_tablet_manager.cc:1403] T 331d1446396c45ce9486793ecb5de7f7 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.185s	user 0.004s	sys 0.011s
I20260709 13:04:29.473225  9627 leader_election.cc:290] T 120581d9b8ba40dd854cec64a671e394 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Requested vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:29.494593  9592 consensus_queue.cc:260] T 879fbf42aa3c4c21a58f094d1a2b91e7 P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:29.495070  9386 tablet_service.cc:1511] Processing CreateTablet for tablet 074269f6e5f843be8a85be8b70707304 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:04:29.496289  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "120581d9b8ba40dd854cec64a671e394" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:29.497779  9590 raft_consensus.cc:359] T ad58816d959840df923159e870cf4ad8 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:29.498692  9545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fbcbebcf87468f821e14a079bf305d" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:29.504926  9386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 074269f6e5f843be8a85be8b70707304. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.502029  9545 raft_consensus.cc:2468] T a8fbcbebcf87468f821e14a079bf305d P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 0.
W20260709 13:04:29.513429  9208 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.193:37633, user_credentials={real_user=slave}} blocked reactor thread for 60730.4us
I20260709 13:04:29.500193  9590 raft_consensus.cc:385] T ad58816d959840df923159e870cf4ad8 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.516997  9459 tablet_service.cc:1511] Processing CreateTablet for tablet 074269f6e5f843be8a85be8b70707304 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:04:29.517367  9590 raft_consensus.cc:740] T ad58816d959840df923159e870cf4ad8 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.516534  9532 tablet_service.cc:1511] Processing CreateTablet for tablet b2a7ad91c8474397bae23c993b89fca4 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:04:29.518648  9459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 074269f6e5f843be8a85be8b70707304. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.518410  9590 consensus_queue.cc:260] T ad58816d959840df923159e870cf4ad8 P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:29.518767  9534 tablet_service.cc:1511] Processing CreateTablet for tablet 074269f6e5f843be8a85be8b70707304 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:04:29.501565  9472 raft_consensus.cc:3060] T 120581d9b8ba40dd854cec64a671e394 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.500509  9600 leader_election.cc:290] T a8fbcbebcf87468f821e14a079bf305d P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:29.495623  9591 raft_consensus.cc:359] T 331d1446396c45ce9486793ecb5de7f7 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:29.518648  9532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2a7ad91c8474397bae23c993b89fca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.533681  9591 raft_consensus.cc:385] T 331d1446396c45ce9486793ecb5de7f7 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.536655  9591 raft_consensus.cc:740] T 331d1446396c45ce9486793ecb5de7f7 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.537748  9591 consensus_queue.cc:260] T 331d1446396c45ce9486793ecb5de7f7 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:29.541392  9591 ts_tablet_manager.cc:1434] T 331d1446396c45ce9486793ecb5de7f7 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.055s	user 0.009s	sys 0.001s
I20260709 13:04:29.542732  9591 tablet_bootstrap.cc:492] T e7d162d34de74e47895dac207e265059 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:29.548655  9534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 074269f6e5f843be8a85be8b70707304. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.552918  9591 tablet_bootstrap.cc:654] T e7d162d34de74e47895dac207e265059 P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.543954  9387 tablet_service.cc:1511] Processing CreateTablet for tablet 846ce8cad343420485af76370f029d54 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:04:29.558320  9387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 846ce8cad343420485af76370f029d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.568521  9593 tablet_bootstrap.cc:492] T 99fc4b4b16d0432390a92d5c04149ce1 P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:29.569967  9593 ts_tablet_manager.cc:1403] T 99fc4b4b16d0432390a92d5c04149ce1 P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.179s	user 0.023s	sys 0.019s
I20260709 13:04:29.570376  9627 raft_consensus.cc:493] T ad58816d959840df923159e870cf4ad8 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.570966  9627 raft_consensus.cc:515] T ad58816d959840df923159e870cf4ad8 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:29.576844  9397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad58816d959840df923159e870cf4ad8" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:29.579298  9606 raft_consensus.cc:493] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.579811  9606 raft_consensus.cc:515] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:29.577131  9627 leader_election.cc:290] T ad58816d959840df923159e870cf4ad8 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
W20260709 13:04:29.583688  9510 leader_election.cc:343] T ad58816d959840df923159e870cf4ad8 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.584739  9308 tablet_service.cc:1511] Processing CreateTablet for tablet b2a7ad91c8474397bae23c993b89fca4 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:04:29.585135  9606 leader_election.cc:290] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:29.585448  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad58816d959840df923159e870cf4ad8" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:29.586472  9308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2a7ad91c8474397bae23c993b89fca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.588066  9397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b34d97496514d29a27c52d749609084" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:29.588830  9397 raft_consensus.cc:2468] T 9b34d97496514d29a27c52d749609084 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 0.
W20260709 13:04:29.589857  9512 leader_election.cc:343] T ad58816d959840df923159e870cf4ad8 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.590395  9512 leader_election.cc:304] T ad58816d959840df923159e870cf4ad8 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf; no voters: 932245f14aac417f913cc7330a1833b8, a91e8b10a5984dec9d3777a7275cef49
I20260709 13:04:29.590726  9311 tablet_service.cc:1511] Processing CreateTablet for tablet 846ce8cad343420485af76370f029d54 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:04:29.592445  9311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 846ce8cad343420485af76370f029d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.592623  9627 raft_consensus.cc:2749] T ad58816d959840df923159e870cf4ad8 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:29.578491  9398 raft_consensus.cc:2468] T 120581d9b8ba40dd854cec64a671e394 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 1.
I20260709 13:04:29.575591  9593 raft_consensus.cc:359] T 99fc4b4b16d0432390a92d5c04149ce1 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:29.592469  9287 leader_election.cc:304] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, a91e8b10a5984dec9d3777a7275cef49; no voters: 
I20260709 13:04:29.596617  9364 leader_election.cc:304] T a8fbcbebcf87468f821e14a079bf305d P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 
I20260709 13:04:29.614005  9600 raft_consensus.cc:2804] T a8fbcbebcf87468f821e14a079bf305d P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:29.614454  9600 raft_consensus.cc:493] T a8fbcbebcf87468f821e14a079bf305d P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:29.614842  9381 tablet_service.cc:1511] Processing CreateTablet for tablet e97eecc3acdf46a5b5577416f7bfe336 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:04:29.616334  9381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e97eecc3acdf46a5b5577416f7bfe336. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.618191  9385 tablet_service.cc:1511] Processing CreateTablet for tablet a541a15041a3493dab6cbe921d81d1d7 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:04:29.619925  9385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a541a15041a3493dab6cbe921d81d1d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.621064  9606 raft_consensus.cc:2804] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:29.621523  9606 raft_consensus.cc:493] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:29.622035  9606 raft_consensus.cc:3060] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.614873  9471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b34d97496514d29a27c52d749609084" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:29.614851  9600 raft_consensus.cc:3060] T a8fbcbebcf87468f821e14a079bf305d P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:29.626230  9289 leader_election.cc:343] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.629875  9510 leader_election.cc:304] T 120581d9b8ba40dd854cec64a671e394 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 
I20260709 13:04:29.630488  9590 ts_tablet_manager.cc:1434] T ad58816d959840df923159e870cf4ad8 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.151s	user 0.012s	sys 0.000s
I20260709 13:04:29.630811  9627 raft_consensus.cc:2804] T 120581d9b8ba40dd854cec64a671e394 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:29.631184  9599 consensus_queue.cc:1048] T 5cfc1f2582a64d8dbc3f127e15024ec0 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:29.633895  9590 tablet_bootstrap.cc:492] T 99fc4b4b16d0432390a92d5c04149ce1 P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
I20260709 13:04:29.635898  9600 raft_consensus.cc:515] T a8fbcbebcf87468f821e14a079bf305d P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:29.630208  9592 ts_tablet_manager.cc:1434] T 879fbf42aa3c4c21a58f094d1a2b91e7 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.270s	user 0.014s	sys 0.014s
W20260709 13:04:29.638792  9364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37995, user_credentials={real_user=slave}} blocked reactor thread for 56573.1us
I20260709 13:04:29.606945  9593 raft_consensus.cc:385] T 99fc4b4b16d0432390a92d5c04149ce1 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.641636  9593 raft_consensus.cc:740] T 99fc4b4b16d0432390a92d5c04149ce1 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.642499  9593 consensus_queue.cc:260] T 99fc4b4b16d0432390a92d5c04149ce1 P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:29.645044  9606 raft_consensus.cc:515] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:29.652956  9647 raft_consensus.cc:493] T 879fbf42aa3c4c21a58f094d1a2b91e7 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.665038  9627 raft_consensus.cc:697] T 120581d9b8ba40dd854cec64a671e394 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Becoming Leader. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Running, Role: LEADER
I20260709 13:04:29.666491  9592 tablet_bootstrap.cc:492] T 24abd32dde1f44c7af83b9344e632ab0 P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:29.684872  9646 raft_consensus.cc:493] T 73b8fed487d54513b9256d4c1a39cfa0 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:29.704958  9512 consensus_peers.cc:597] T 5cfc1f2582a64d8dbc3f127e15024ec0 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:29.704998  9646 raft_consensus.cc:515] T 73b8fed487d54513b9256d4c1a39cfa0 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:29.707778  9600 leader_election.cc:290] T a8fbcbebcf87468f821e14a079bf305d P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Requested vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:29.674396  9647 raft_consensus.cc:515] T 879fbf42aa3c4c21a58f094d1a2b91e7 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:29.709473  9646 leader_election.cc:290] T 73b8fed487d54513b9256d4c1a39cfa0 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:29.695122  9535 tablet_service.cc:1511] Processing CreateTablet for tablet e97eecc3acdf46a5b5577416f7bfe336 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:04:29.710856  9535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e97eecc3acdf46a5b5577416f7bfe336. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.711884  9470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b8fed487d54513b9256d4c1a39cfa0" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:29.697026  9382 tablet_service.cc:1511] Processing CreateTablet for tablet 93a7d590cbac4b6da413dd8ea2a26225 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:04:29.698020  9546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fbcbebcf87468f821e14a079bf305d" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
I20260709 13:04:29.701956  9606 leader_election.cc:290] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 election: Requested vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:29.702319  9309 tablet_service.cc:1511] Processing CreateTablet for tablet e97eecc3acdf46a5b5577416f7bfe336 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:04:29.703866  9471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b34d97496514d29a27c52d749609084" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:29.719105  9309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e97eecc3acdf46a5b5577416f7bfe336. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.714061  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879fbf42aa3c4c21a58f094d1a2b91e7" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:29.721195  9382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93a7d590cbac4b6da413dd8ea2a26225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.721621  9323 raft_consensus.cc:2468] T 879fbf42aa3c4c21a58f094d1a2b91e7 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 0.
I20260709 13:04:29.721729  9455 tablet_service.cc:1511] Processing CreateTablet for tablet 846ce8cad343420485af76370f029d54 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:04:29.723119  9455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 846ce8cad343420485af76370f029d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.725224  9546 raft_consensus.cc:3060] T a8fbcbebcf87468f821e14a079bf305d P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.726102  9438 leader_election.cc:304] T 879fbf42aa3c4c21a58f094d1a2b91e7 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:29.704588  9592 tablet_bootstrap.cc:654] T 24abd32dde1f44c7af83b9344e632ab0 P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.709658  9593 ts_tablet_manager.cc:1434] T 99fc4b4b16d0432390a92d5c04149ce1 P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.139s	user 0.012s	sys 0.001s
I20260709 13:04:29.730115  9647 leader_election.cc:290] T 879fbf42aa3c4c21a58f094d1a2b91e7 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:29.730335  9593 tablet_bootstrap.cc:492] T 879fbf42aa3c4c21a58f094d1a2b91e7 P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:29.730515  9398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879fbf42aa3c4c21a58f094d1a2b91e7" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
W20260709 13:04:29.732710  9436 leader_election.cc:343] T 879fbf42aa3c4c21a58f094d1a2b91e7 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.695313  9591 tablet_bootstrap.cc:492] T e7d162d34de74e47895dac207e265059 P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
W20260709 13:04:29.739539  9364 leader_election.cc:343] T 73b8fed487d54513b9256d4c1a39cfa0 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.743713  9591 ts_tablet_manager.cc:1403] T e7d162d34de74e47895dac207e265059 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.201s	user 0.025s	sys 0.024s
W20260709 13:04:29.748652  9289 leader_election.cc:343] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.747145  9388 tablet_service.cc:1511] Processing CreateTablet for tablet a25f8459a3644bfcaf8f9d71705b1c33 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:04:29.754711  9388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a25f8459a3644bfcaf8f9d71705b1c33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.765349  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fbcbebcf87468f821e14a079bf305d" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:29.766145  9323 raft_consensus.cc:2468] T a8fbcbebcf87468f821e14a079bf305d P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 0.
I20260709 13:04:29.768095  9590 tablet_bootstrap.cc:654] T 99fc4b4b16d0432390a92d5c04149ce1 P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.767855  9322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b8fed487d54513b9256d4c1a39cfa0" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:29.769953  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fbcbebcf87468f821e14a079bf305d" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8"
I20260709 13:04:29.770862  9321 raft_consensus.cc:3060] T a8fbcbebcf87468f821e14a079bf305d P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.774551  9398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b34d97496514d29a27c52d749609084" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:29.775425  9398 raft_consensus.cc:3060] T 9b34d97496514d29a27c52d749609084 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.740038  9627 consensus_queue.cc:237] T 120581d9b8ba40dd854cec64a671e394 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:29.740382  9472 raft_consensus.cc:2468] T 120581d9b8ba40dd854cec64a671e394 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 1.
I20260709 13:04:29.780345  9642 raft_consensus.cc:2804] T 879fbf42aa3c4c21a58f094d1a2b91e7 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:29.780836  9642 raft_consensus.cc:493] T 879fbf42aa3c4c21a58f094d1a2b91e7 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:29.781250  9642 raft_consensus.cc:3060] T 879fbf42aa3c4c21a58f094d1a2b91e7 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.784775  9546 raft_consensus.cc:2468] T a8fbcbebcf87468f821e14a079bf305d P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 1.
W20260709 13:04:29.794198  9364 leader_election.cc:343] T 73b8fed487d54513b9256d4c1a39cfa0 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.796522  9364 leader_election.cc:304] T 73b8fed487d54513b9256d4c1a39cfa0 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49; no voters: 932245f14aac417f913cc7330a1833b8, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:29.798090  9364 leader_election.cc:304] T a8fbcbebcf87468f821e14a079bf305d P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 
I20260709 13:04:29.805583  9458 tablet_service.cc:1511] Processing CreateTablet for tablet ff040bb60327424d8aeec71e3bf58a0a (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:04:29.805590  9310 tablet_service.cc:1511] Processing CreateTablet for tablet ff040bb60327424d8aeec71e3bf58a0a (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:04:29.807300  9310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff040bb60327424d8aeec71e3bf58a0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.803973  9530 tablet_service.cc:1511] Processing CreateTablet for tablet a25f8459a3644bfcaf8f9d71705b1c33 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:04:29.808797  9530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a25f8459a3644bfcaf8f9d71705b1c33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.807314  9307 tablet_service.cc:1511] Processing CreateTablet for tablet 93a7d590cbac4b6da413dd8ea2a26225 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:04:29.810389  9307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93a7d590cbac4b6da413dd8ea2a26225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.811097  9533 tablet_service.cc:1511] Processing CreateTablet for tablet a541a15041a3493dab6cbe921d81d1d7 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:04:29.806756  9306 tablet_service.cc:1511] Processing CreateTablet for tablet a25f8459a3644bfcaf8f9d71705b1c33 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:04:29.814291  9306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a25f8459a3644bfcaf8f9d71705b1c33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.814455  9650 raft_consensus.cc:2749] T 73b8fed487d54513b9256d4c1a39cfa0 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:29.815663  9650 raft_consensus.cc:2804] T a8fbcbebcf87468f821e14a079bf305d P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:29.816263  9650 raft_consensus.cc:697] T a8fbcbebcf87468f821e14a079bf305d P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Becoming Leader. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Running, Role: LEADER
I20260709 13:04:29.818856  9459 tablet_service.cc:1511] Processing CreateTablet for tablet 93a7d590cbac4b6da413dd8ea2a26225 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:04:29.820890  9459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93a7d590cbac4b6da413dd8ea2a26225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.827049  9458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff040bb60327424d8aeec71e3bf58a0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.831882  9533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a541a15041a3493dab6cbe921d81d1d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.834494  9593 tablet_bootstrap.cc:654] T 879fbf42aa3c4c21a58f094d1a2b91e7 P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.842123  9532 tablet_service.cc:1511] Processing CreateTablet for tablet ff040bb60327424d8aeec71e3bf58a0a (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:04:29.844184  9532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff040bb60327424d8aeec71e3bf58a0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.844058  9461 tablet_service.cc:1511] Processing CreateTablet for tablet 65ba9982e9bd4177995544e13394911a (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:04:29.844993  9536 tablet_service.cc:1511] Processing CreateTablet for tablet 65ba9982e9bd4177995544e13394911a (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:04:29.846351  9536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65ba9982e9bd4177995544e13394911a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.846530  9456 tablet_service.cc:1511] Processing CreateTablet for tablet a541a15041a3493dab6cbe921d81d1d7 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:04:29.850003  9650 consensus_queue.cc:237] T a8fbcbebcf87468f821e14a079bf305d P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:29.854966  9461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65ba9982e9bd4177995544e13394911a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.863198  9312 tablet_service.cc:1511] Processing CreateTablet for tablet 65ba9982e9bd4177995544e13394911a (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:04:29.864701  9312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65ba9982e9bd4177995544e13394911a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.865355  9398 raft_consensus.cc:2468] T 9b34d97496514d29a27c52d749609084 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 1.
I20260709 13:04:29.867077  9287 leader_election.cc:304] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, a91e8b10a5984dec9d3777a7275cef49; no voters: ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:29.868722  9606 raft_consensus.cc:2804] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:29.752830  9591 raft_consensus.cc:359] T e7d162d34de74e47895dac207e265059 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:29.881577  9591 raft_consensus.cc:385] T e7d162d34de74e47895dac207e265059 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.891009  9591 raft_consensus.cc:740] T e7d162d34de74e47895dac207e265059 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.894253  9646 raft_consensus.cc:493] T 99fc4b4b16d0432390a92d5c04149ce1 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.894955  9646 raft_consensus.cc:515] T 99fc4b4b16d0432390a92d5c04149ce1 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:29.898020  9591 consensus_queue.cc:260] T e7d162d34de74e47895dac207e265059 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:29.842147  9642 raft_consensus.cc:515] T 879fbf42aa3c4c21a58f094d1a2b91e7 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:29.886404  9456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a541a15041a3493dab6cbe921d81d1d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.900954  9646 leader_election.cc:290] T 99fc4b4b16d0432390a92d5c04149ce1 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:29.915185  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99fc4b4b16d0432390a92d5c04149ce1" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:29.922025  9472 raft_consensus.cc:2468] T 99fc4b4b16d0432390a92d5c04149ce1 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 0.
I20260709 13:04:29.923156  9592 tablet_bootstrap.cc:492] T 24abd32dde1f44c7af83b9344e632ab0 P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:29.923748  9592 ts_tablet_manager.cc:1403] T 24abd32dde1f44c7af83b9344e632ab0 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.286s	user 0.022s	sys 0.044s
I20260709 13:04:29.915845  9462 tablet_service.cc:1511] Processing CreateTablet for tablet 03c7fe8d164d4b2c9015337d9b4b7081 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:04:29.916980  9220 catalog_manager.cc:5697] T 120581d9b8ba40dd854cec64a671e394 P dfbbb80ab8e345e0ae1684fafefceccf reported cstate change: term changed from 0 to 1, leader changed from <none> to dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196). New cstate: current_term: 1 leader_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:29.918725  9545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99fc4b4b16d0432390a92d5c04149ce1" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:29.938608  9642 leader_election.cc:290] T 879fbf42aa3c4c21a58f094d1a2b91e7 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Requested vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:29.941032  9397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879fbf42aa3c4c21a58f094d1a2b91e7" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:29.941510  9322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879fbf42aa3c4c21a58f094d1a2b91e7" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8"
I20260709 13:04:29.942163  9462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03c7fe8d164d4b2c9015337d9b4b7081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.942224  9322 raft_consensus.cc:3060] T 879fbf42aa3c4c21a58f094d1a2b91e7 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:29.942803  9436 leader_election.cc:343] T 879fbf42aa3c4c21a58f094d1a2b91e7 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.928521  9592 raft_consensus.cc:359] T 24abd32dde1f44c7af83b9344e632ab0 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:29.948910  9381 tablet_service.cc:1511] Processing CreateTablet for tablet 03c7fe8d164d4b2c9015337d9b4b7081 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:04:29.968483  9381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03c7fe8d164d4b2c9015337d9b4b7081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.968844  9591 ts_tablet_manager.cc:1434] T e7d162d34de74e47895dac207e265059 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.220s	user 0.007s	sys 0.010s
I20260709 13:04:29.970326  9591 tablet_bootstrap.cc:492] T ad58816d959840df923159e870cf4ad8 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:29.970034  9531 tablet_service.cc:1511] Processing CreateTablet for tablet 03c7fe8d164d4b2c9015337d9b4b7081 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:04:29.964401  9606 raft_consensus.cc:697] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8 [term 1 LEADER]: Becoming Leader. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Running, Role: LEADER
I20260709 13:04:29.971462  9657 raft_consensus.cc:493] T 331d1446396c45ce9486793ecb5de7f7 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.972146  9657 raft_consensus.cc:515] T 331d1446396c45ce9486793ecb5de7f7 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:29.972342  9606 consensus_queue.cc:237] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:29.975733  9593 tablet_bootstrap.cc:492] T 879fbf42aa3c4c21a58f094d1a2b91e7 P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:29.976437  9593 ts_tablet_manager.cc:1403] T 879fbf42aa3c4c21a58f094d1a2b91e7 P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.246s	user 0.016s	sys 0.009s
I20260709 13:04:29.971753  9531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03c7fe8d164d4b2c9015337d9b4b7081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.979794  9593 raft_consensus.cc:359] T 879fbf42aa3c4c21a58f094d1a2b91e7 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:29.983634  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "331d1446396c45ce9486793ecb5de7f7" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:29.956636  9592 raft_consensus.cc:385] T 24abd32dde1f44c7af83b9344e632ab0 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.998667  9545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "331d1446396c45ce9486793ecb5de7f7" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
W20260709 13:04:29.999477  9289 leader_election.cc:343] T 331d1446396c45ce9486793ecb5de7f7 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:30.000263  9289 leader_election.cc:343] T 331d1446396c45ce9486793ecb5de7f7 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:30.000685  9289 leader_election.cc:304] T 331d1446396c45ce9486793ecb5de7f7 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 932245f14aac417f913cc7330a1833b8; no voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:29.985713  9657 leader_election.cc:290] T 331d1446396c45ce9486793ecb5de7f7 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:30.011063  9657 raft_consensus.cc:2749] T 331d1446396c45ce9486793ecb5de7f7 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:29.995014  9593 raft_consensus.cc:385] T 879fbf42aa3c4c21a58f094d1a2b91e7 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.012967  9593 raft_consensus.cc:740] T 879fbf42aa3c4c21a58f094d1a2b91e7 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.014642  9593 consensus_queue.cc:260] T 879fbf42aa3c4c21a58f094d1a2b91e7 P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:30.017598  9593 ts_tablet_manager.cc:1434] T 879fbf42aa3c4c21a58f094d1a2b91e7 P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.041s	user 0.003s	sys 0.005s
I20260709 13:04:30.018853  9593 tablet_bootstrap.cc:492] T ad58816d959840df923159e870cf4ad8 P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:30.019172  9590 tablet_bootstrap.cc:492] T 99fc4b4b16d0432390a92d5c04149ce1 P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:30.019824  9590 ts_tablet_manager.cc:1403] T 99fc4b4b16d0432390a92d5c04149ce1 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.386s	user 0.024s	sys 0.020s
I20260709 13:04:29.964448  9321 raft_consensus.cc:2468] T a8fbcbebcf87468f821e14a079bf305d P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 1.
I20260709 13:04:30.026342  9322 raft_consensus.cc:2468] T 879fbf42aa3c4c21a58f094d1a2b91e7 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 1.
I20260709 13:04:29.957722  9364 leader_election.cc:304] T 99fc4b4b16d0432390a92d5c04149ce1 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:30.028139  9438 leader_election.cc:304] T 879fbf42aa3c4c21a58f094d1a2b91e7 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, ef5fe58eb3e04ae18fda957b4d507eff; no voters: a91e8b10a5984dec9d3777a7275cef49
I20260709 13:04:30.029323  9650 raft_consensus.cc:2804] T 99fc4b4b16d0432390a92d5c04149ce1 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:30.029804  9650 raft_consensus.cc:493] T 99fc4b4b16d0432390a92d5c04149ce1 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:30.030429  9642 raft_consensus.cc:2804] T 879fbf42aa3c4c21a58f094d1a2b91e7 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:30.031057  9642 raft_consensus.cc:697] T 879fbf42aa3c4c21a58f094d1a2b91e7 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Becoming Leader. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Running, Role: LEADER
I20260709 13:04:30.032002  9642 consensus_queue.cc:237] T 879fbf42aa3c4c21a58f094d1a2b91e7 P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:30.037072  9593 tablet_bootstrap.cc:654] T ad58816d959840df923159e870cf4ad8 P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:30.033726  9591 tablet_bootstrap.cc:654] T ad58816d959840df923159e870cf4ad8 P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:30.034927  9219 catalog_manager.cc:5697] T a8fbcbebcf87468f821e14a079bf305d P a91e8b10a5984dec9d3777a7275cef49 reported cstate change: term changed from 0 to 1, leader changed from <none> to a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "a91e8b10a5984dec9d3777a7275cef49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:30.030244  9650 raft_consensus.cc:3060] T 99fc4b4b16d0432390a92d5c04149ce1 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.030120  9308 tablet_service.cc:1511] Processing CreateTablet for tablet a792fefbeb0c4eb79e87501fb6dbe780 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:04:30.041030  9383 tablet_service.cc:1511] Processing CreateTablet for tablet a792fefbeb0c4eb79e87501fb6dbe780 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
W20260709 13:04:30.041424  9364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38559, user_credentials={real_user=slave}} blocked reactor thread for 90872.2us
I20260709 13:04:30.009343  9592 raft_consensus.cc:740] T 24abd32dde1f44c7af83b9344e632ab0 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.052186  9383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a792fefbeb0c4eb79e87501fb6dbe780. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:30.097499  9510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33607, user_credentials={real_user=slave}} blocked reactor thread for 43924.7us
I20260709 13:04:30.109033  9457 tablet_service.cc:1511] Processing CreateTablet for tablet a792fefbeb0c4eb79e87501fb6dbe780 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:04:30.110544  9457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a792fefbeb0c4eb79e87501fb6dbe780. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:30.115175  9364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37633, user_credentials={real_user=slave}} blocked reactor thread for 58282.4us
W20260709 13:04:30.136377  9364 leader_election.cc:343] T 99fc4b4b16d0432390a92d5c04149ce1 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:30.138917  9650 raft_consensus.cc:515] T 99fc4b4b16d0432390a92d5c04149ce1 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:30.141108  9650 leader_election.cc:290] T 99fc4b4b16d0432390a92d5c04149ce1 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Requested vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:30.142674  9590 raft_consensus.cc:359] T 99fc4b4b16d0432390a92d5c04149ce1 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:30.143340  9590 raft_consensus.cc:385] T 99fc4b4b16d0432390a92d5c04149ce1 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.143618  9590 raft_consensus.cc:740] T 99fc4b4b16d0432390a92d5c04149ce1 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.144332  9590 consensus_queue.cc:260] T 99fc4b4b16d0432390a92d5c04149ce1 P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:30.146312  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99fc4b4b16d0432390a92d5c04149ce1" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:30.146574  9545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99fc4b4b16d0432390a92d5c04149ce1" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
I20260709 13:04:30.147137  9472 raft_consensus.cc:3060] T 99fc4b4b16d0432390a92d5c04149ce1 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.147289  9545 raft_consensus.cc:3060] T 99fc4b4b16d0432390a92d5c04149ce1 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.133005  9308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a792fefbeb0c4eb79e87501fb6dbe780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.159194  9590 ts_tablet_manager.cc:1434] T 99fc4b4b16d0432390a92d5c04149ce1 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.139s	user 0.007s	sys 0.000s
W20260709 13:04:30.159780  9268 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:30.160545  9590 tablet_bootstrap.cc:492] T 225ca60d9645490dbcdcf6d4d127d955 P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
I20260709 13:04:30.161892  9221 catalog_manager.cc:5697] T 879fbf42aa3c4c21a58f094d1a2b91e7 P ef5fe58eb3e04ae18fda957b4d507eff reported cstate change: term changed from 0 to 1, leader changed from <none> to ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:30.168052  9472 raft_consensus.cc:2468] T 99fc4b4b16d0432390a92d5c04149ce1 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 1.
I20260709 13:04:30.170231  9313 tablet_service.cc:1511] Processing CreateTablet for tablet 1a5145e5f9a64fe0acdd74d909e841fc (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:04:30.172372  9536 tablet_service.cc:1511] Processing CreateTablet for tablet 1a5145e5f9a64fe0acdd74d909e841fc (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:04:30.183210  9313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a5145e5f9a64fe0acdd74d909e841fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.183923  9536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a5145e5f9a64fe0acdd74d909e841fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.131677  9592 consensus_queue.cc:260] T 24abd32dde1f44c7af83b9344e632ab0 P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:30.177582  9590 tablet_bootstrap.cc:654] T 225ca60d9645490dbcdcf6d4d127d955 P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:30.164565  9218 catalog_manager.cc:5697] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 932245f14aac417f913cc7330a1833b8 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "932245f14aac417f913cc7330a1833b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:30.184886  9364 leader_election.cc:304] T 99fc4b4b16d0432390a92d5c04149ce1 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:30.186375  9592 ts_tablet_manager.cc:1434] T 24abd32dde1f44c7af83b9344e632ab0 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.262s	user 0.011s	sys 0.002s
I20260709 13:04:30.179890  9545 raft_consensus.cc:2468] T 99fc4b4b16d0432390a92d5c04149ce1 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 1.
I20260709 13:04:30.187682  9592 tablet_bootstrap.cc:492] T 9b34d97496514d29a27c52d749609084 P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:30.189993  9593 tablet_bootstrap.cc:492] T ad58816d959840df923159e870cf4ad8 P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:30.190521  9593 ts_tablet_manager.cc:1403] T ad58816d959840df923159e870cf4ad8 P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.172s	user 0.012s	sys 0.029s
I20260709 13:04:30.192471  9456 tablet_service.cc:1511] Processing CreateTablet for tablet 3bd9c3f12cc546ff905df61c5a9028f6 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:04:30.194247  9456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bd9c3f12cc546ff905df61c5a9028f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.195230  9650 raft_consensus.cc:2804] T 99fc4b4b16d0432390a92d5c04149ce1 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:30.197544  9650 raft_consensus.cc:697] T 99fc4b4b16d0432390a92d5c04149ce1 P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Becoming Leader. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Running, Role: LEADER
I20260709 13:04:30.198470  9650 consensus_queue.cc:237] T 99fc4b4b16d0432390a92d5c04149ce1 P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:30.210150  9388 tablet_service.cc:1511] Processing CreateTablet for tablet 1a5145e5f9a64fe0acdd74d909e841fc (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:04:30.211541  9388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a5145e5f9a64fe0acdd74d909e841fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.213116  9532 tablet_service.cc:1511] Processing CreateTablet for tablet 3bd9c3f12cc546ff905df61c5a9028f6 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:04:30.217670  9532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bd9c3f12cc546ff905df61c5a9028f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.217830  9591 tablet_bootstrap.cc:492] T ad58816d959840df923159e870cf4ad8 P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:30.218410  9591 ts_tablet_manager.cc:1403] T ad58816d959840df923159e870cf4ad8 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.248s	user 0.022s	sys 0.006s
I20260709 13:04:30.216171  9310 tablet_service.cc:1511] Processing CreateTablet for tablet 3bd9c3f12cc546ff905df61c5a9028f6 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:04:30.226250  9593 raft_consensus.cc:359] T ad58816d959840df923159e870cf4ad8 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:30.227031  9593 raft_consensus.cc:385] T ad58816d959840df923159e870cf4ad8 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.227456  9381 tablet_service.cc:1511] Processing CreateTablet for tablet 890ffb7e0f6b463f8d8771d5cd9481c9 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:04:30.228587  9310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bd9c3f12cc546ff905df61c5a9028f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.229059  9381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 890ffb7e0f6b463f8d8771d5cd9481c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.227433  9593 raft_consensus.cc:740] T ad58816d959840df923159e870cf4ad8 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.231817  9593 consensus_queue.cc:260] T ad58816d959840df923159e870cf4ad8 P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:30.234655  9593 ts_tablet_manager.cc:1434] T ad58816d959840df923159e870cf4ad8 P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.000s
I20260709 13:04:30.235685  9593 tablet_bootstrap.cc:492] T 24abd32dde1f44c7af83b9344e632ab0 P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:30.236145  9591 raft_consensus.cc:359] T ad58816d959840df923159e870cf4ad8 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:30.236996  9591 raft_consensus.cc:385] T ad58816d959840df923159e870cf4ad8 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.237350  9591 raft_consensus.cc:740] T ad58816d959840df923159e870cf4ad8 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.240175  9457 tablet_service.cc:1511] Processing CreateTablet for tablet 890ffb7e0f6b463f8d8771d5cd9481c9 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:04:30.241739  9457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 890ffb7e0f6b463f8d8771d5cd9481c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.247303  9592 tablet_bootstrap.cc:654] T 9b34d97496514d29a27c52d749609084 P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:30.248303  9593 tablet_bootstrap.cc:654] T 24abd32dde1f44c7af83b9344e632ab0 P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:30.243278  9591 consensus_queue.cc:260] T ad58816d959840df923159e870cf4ad8 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:30.257346  9590 tablet_bootstrap.cc:492] T 225ca60d9645490dbcdcf6d4d127d955 P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:30.265486  9535 tablet_service.cc:1511] Processing CreateTablet for tablet 890ffb7e0f6b463f8d8771d5cd9481c9 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:04:30.273135  9591 ts_tablet_manager.cc:1434] T ad58816d959840df923159e870cf4ad8 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.054s	user 0.004s	sys 0.005s
I20260709 13:04:30.274981  9535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 890ffb7e0f6b463f8d8771d5cd9481c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.277961  9591 tablet_bootstrap.cc:492] T 225ca60d9645490dbcdcf6d4d127d955 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:30.284228  9313 tablet_service.cc:1511] Processing CreateTablet for tablet 8f602c194d1c445ba1851f0a2272b40b (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:04:30.289412  9387 tablet_service.cc:1511] Processing CreateTablet for tablet 8f602c194d1c445ba1851f0a2272b40b (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:04:30.293445  9387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f602c194d1c445ba1851f0a2272b40b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.291543  9321 raft_consensus.cc:3060] T e7d162d34de74e47895dac207e265059 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.269385  9590 ts_tablet_manager.cc:1403] T 225ca60d9645490dbcdcf6d4d127d955 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.108s	user 0.015s	sys 0.004s
I20260709 13:04:30.308139  9593 tablet_bootstrap.cc:492] T 24abd32dde1f44c7af83b9344e632ab0 P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:30.308738  9593 ts_tablet_manager.cc:1403] T 24abd32dde1f44c7af83b9344e632ab0 P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.073s	user 0.007s	sys 0.011s
I20260709 13:04:30.311712  9593 raft_consensus.cc:359] T 24abd32dde1f44c7af83b9344e632ab0 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:30.312407  9593 raft_consensus.cc:385] T 24abd32dde1f44c7af83b9344e632ab0 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.312839  9593 raft_consensus.cc:740] T 24abd32dde1f44c7af83b9344e632ab0 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.321224  9593 consensus_queue.cc:260] T 24abd32dde1f44c7af83b9344e632ab0 P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:30.323803  9313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f602c194d1c445ba1851f0a2272b40b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.327504  9593 ts_tablet_manager.cc:1434] T 24abd32dde1f44c7af83b9344e632ab0 P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 13:04:30.329608  9456 tablet_service.cc:1511] Processing CreateTablet for tablet 8f602c194d1c445ba1851f0a2272b40b (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:04:30.330886  9456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f602c194d1c445ba1851f0a2272b40b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.334388  9590 raft_consensus.cc:359] T 225ca60d9645490dbcdcf6d4d127d955 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:30.335150  9590 raft_consensus.cc:385] T 225ca60d9645490dbcdcf6d4d127d955 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.335431  9590 raft_consensus.cc:740] T 225ca60d9645490dbcdcf6d4d127d955 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.336184  9590 consensus_queue.cc:260] T 225ca60d9645490dbcdcf6d4d127d955 P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:30.343209  9591 tablet_bootstrap.cc:654] T 225ca60d9645490dbcdcf6d4d127d955 P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:30.345662  9592 tablet_bootstrap.cc:492] T 9b34d97496514d29a27c52d749609084 P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:30.346437  9592 ts_tablet_manager.cc:1403] T 9b34d97496514d29a27c52d749609084 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.159s	user 0.020s	sys 0.003s
I20260709 13:04:30.349901  9592 raft_consensus.cc:359] T 9b34d97496514d29a27c52d749609084 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:30.354856  9650 consensus_queue.cc:1048] T a8fbcbebcf87468f821e14a079bf305d P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:30.359691  9646 raft_consensus.cc:493] T ad58816d959840df923159e870cf4ad8 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.360282  9646 raft_consensus.cc:515] T ad58816d959840df923159e870cf4ad8 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:30.360775  9590 ts_tablet_manager.cc:1434] T 225ca60d9645490dbcdcf6d4d127d955 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.001s
I20260709 13:04:30.362622  9646 leader_election.cc:290] T ad58816d959840df923159e870cf4ad8 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:30.363853  9645 consensus_queue.cc:1048] T 120581d9b8ba40dd854cec64a671e394 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:30.365042  9545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad58816d959840df923159e870cf4ad8" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:30.365792  9545 raft_consensus.cc:2468] T ad58816d959840df923159e870cf4ad8 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 0.
W20260709 13:04:30.366609  9289 consensus_peers.cc:597] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8 -> Peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Couldn't send request to peer ef5fe58eb3e04ae18fda957b4d507eff. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:30.366950  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad58816d959840df923159e870cf4ad8" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:30.367664  9323 raft_consensus.cc:2468] T ad58816d959840df923159e870cf4ad8 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 0.
I20260709 13:04:30.369701  9593 tablet_bootstrap.cc:492] T 8c1e5b4bc1bc437884e6835b61227d4d P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:30.369508  9383 tablet_service.cc:1511] Processing CreateTablet for tablet 8dfdb24cbc824b95ac65712323103e2a (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:04:30.370966  9383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dfdb24cbc824b95ac65712323103e2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.373996  9590 tablet_bootstrap.cc:492] T 24abd32dde1f44c7af83b9344e632ab0 P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
I20260709 13:04:30.374275  9535 tablet_service.cc:1511] Processing CreateTablet for tablet 8dfdb24cbc824b95ac65712323103e2a (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:04:30.375635  9535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dfdb24cbc824b95ac65712323103e2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.376086  9593 tablet_bootstrap.cc:654] T 8c1e5b4bc1bc437884e6835b61227d4d P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:30.377996  9364 leader_election.cc:304] T ad58816d959840df923159e870cf4ad8 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 
I20260709 13:04:30.379256  9592 raft_consensus.cc:385] T 9b34d97496514d29a27c52d749609084 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.397294  9592 raft_consensus.cc:740] T 9b34d97496514d29a27c52d749609084 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.397294  9650 raft_consensus.cc:2804] T ad58816d959840df923159e870cf4ad8 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:30.398581  9650 raft_consensus.cc:493] T ad58816d959840df923159e870cf4ad8 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:30.398193  9592 consensus_queue.cc:260] T 9b34d97496514d29a27c52d749609084 P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:30.398919  9650 raft_consensus.cc:3060] T ad58816d959840df923159e870cf4ad8 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.399860  9310 tablet_service.cc:1511] Processing CreateTablet for tablet 8dfdb24cbc824b95ac65712323103e2a (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:04:30.400660  9592 ts_tablet_manager.cc:1434] T 9b34d97496514d29a27c52d749609084 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.000s
I20260709 13:04:30.408810  9590 tablet_bootstrap.cc:654] T 24abd32dde1f44c7af83b9344e632ab0 P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:30.410429  9457 tablet_service.cc:1511] Processing CreateTablet for tablet b90aae84687f41e99e58dada706ae2d7 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:04:30.416457  9457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b90aae84687f41e99e58dada706ae2d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.416785  9387 tablet_service.cc:1511] Processing CreateTablet for tablet 8e017796f5c643859d8a0e1916ab3f05 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:04:30.418221  9646 consensus_queue.cc:1048] T a8fbcbebcf87468f821e14a079bf305d P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:30.418895  9532 tablet_service.cc:1511] Processing CreateTablet for tablet b90aae84687f41e99e58dada706ae2d7 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:04:30.420099  9532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b90aae84687f41e99e58dada706ae2d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.401343  9310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dfdb24cbc824b95ac65712323103e2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.432168  9592 tablet_bootstrap.cc:492] T 73b8fed487d54513b9256d4c1a39cfa0 P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:30.432446  9456 tablet_service.cc:1511] Processing CreateTablet for tablet 8e017796f5c643859d8a0e1916ab3f05 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:04:30.434312  9456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e017796f5c643859d8a0e1916ab3f05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.450137  9398 raft_consensus.cc:3060] T 879fbf42aa3c4c21a58f094d1a2b91e7 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.450662  9645 consensus_queue.cc:1048] T 120581d9b8ba40dd854cec64a671e394 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:30.455440  9535 tablet_service.cc:1511] Processing CreateTablet for tablet 8e017796f5c643859d8a0e1916ab3f05 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:04:30.457052  9535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e017796f5c643859d8a0e1916ab3f05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.461562  9313 tablet_service.cc:1511] Processing CreateTablet for tablet b90aae84687f41e99e58dada706ae2d7 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:04:30.463826  9593 tablet_bootstrap.cc:492] T 8c1e5b4bc1bc437884e6835b61227d4d P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:30.467130  9593 ts_tablet_manager.cc:1403] T 8c1e5b4bc1bc437884e6835b61227d4d P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.098s	user 0.014s	sys 0.003s
I20260709 13:04:30.467877  9313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b90aae84687f41e99e58dada706ae2d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.464602  9387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e017796f5c643859d8a0e1916ab3f05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.500696  9381 tablet_service.cc:1511] Processing CreateTablet for tablet a99d222cbc8341f7ac9a4b2e7eb7e5f0 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:04:30.502180  9381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a99d222cbc8341f7ac9a4b2e7eb7e5f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.507135  9459 tablet_service.cc:1511] Processing CreateTablet for tablet a99d222cbc8341f7ac9a4b2e7eb7e5f0 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:04:30.508607  9459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a99d222cbc8341f7ac9a4b2e7eb7e5f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.509063  9592 tablet_bootstrap.cc:654] T 73b8fed487d54513b9256d4c1a39cfa0 P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:30.510105  9308 tablet_service.cc:1511] Processing CreateTablet for tablet a99d222cbc8341f7ac9a4b2e7eb7e5f0 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:04:30.510957  9606 consensus_queue.cc:1048] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:30.511404  9308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a99d222cbc8341f7ac9a4b2e7eb7e5f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.508921  9219 catalog_manager.cc:5697] T 99fc4b4b16d0432390a92d5c04149ce1 P a91e8b10a5984dec9d3777a7275cef49 reported cstate change: term changed from 0 to 1, leader changed from <none> to a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "a91e8b10a5984dec9d3777a7275cef49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:30.513482  9593 raft_consensus.cc:359] T 8c1e5b4bc1bc437884e6835b61227d4d P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:30.515192  9593 raft_consensus.cc:385] T 8c1e5b4bc1bc437884e6835b61227d4d P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.515770  9593 raft_consensus.cc:740] T 8c1e5b4bc1bc437884e6835b61227d4d P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.532781  9593 consensus_queue.cc:260] T 8c1e5b4bc1bc437884e6835b61227d4d P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:30.553515  9642 raft_consensus.cc:493] T 24abd32dde1f44c7af83b9344e632ab0 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.554131  9642 raft_consensus.cc:515] T 24abd32dde1f44c7af83b9344e632ab0 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:30.561244  9650 raft_consensus.cc:515] T ad58816d959840df923159e870cf4ad8 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:30.569278  9395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24abd32dde1f44c7af83b9344e632ab0" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:30.570484  9535 tablet_service.cc:1511] Processing CreateTablet for tablet 02c431d6db7643adbb4b26a3c7e38b76 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:04:30.571764  9535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02c431d6db7643adbb4b26a3c7e38b76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.576987  9647 consensus_queue.cc:1048] T 879fbf42aa3c4c21a58f094d1a2b91e7 P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Connected to new peer: Peer: permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:30.577843  9388 tablet_service.cc:1511] Processing CreateTablet for tablet 02c431d6db7643adbb4b26a3c7e38b76 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:04:30.579241  9388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02c431d6db7643adbb4b26a3c7e38b76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.584328  9546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad58816d959840df923159e870cf4ad8" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
I20260709 13:04:30.585215  9546 raft_consensus.cc:3060] T ad58816d959840df923159e870cf4ad8 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.590405  9395 raft_consensus.cc:2468] T 24abd32dde1f44c7af83b9344e632ab0 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 0.
I20260709 13:04:30.590535  9457 tablet_service.cc:1511] Processing CreateTablet for tablet 803c43e83ee5487590c9d922559adc0f (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:04:30.592054  9457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 803c43e83ee5487590c9d922559adc0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.592257  9436 leader_election.cc:304] T 24abd32dde1f44c7af83b9344e632ab0 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:30.595131  9650 leader_election.cc:290] T ad58816d959840df923159e870cf4ad8 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Requested vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:30.597337  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad58816d959840df923159e870cf4ad8" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8"
I20260709 13:04:30.598058  9321 raft_consensus.cc:3060] T ad58816d959840df923159e870cf4ad8 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.582026  9311 tablet_service.cc:1511] Processing CreateTablet for tablet 02c431d6db7643adbb4b26a3c7e38b76 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:04:30.603477  9311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02c431d6db7643adbb4b26a3c7e38b76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.605044  9591 tablet_bootstrap.cc:492] T 225ca60d9645490dbcdcf6d4d127d955 P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:30.605713  9591 ts_tablet_manager.cc:1403] T 225ca60d9645490dbcdcf6d4d127d955 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.328s	user 0.037s	sys 0.001s
I20260709 13:04:30.608481  9647 raft_consensus.cc:2804] T 24abd32dde1f44c7af83b9344e632ab0 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:30.608979  9647 raft_consensus.cc:493] T 24abd32dde1f44c7af83b9344e632ab0 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:30.609396  9647 raft_consensus.cc:3060] T 24abd32dde1f44c7af83b9344e632ab0 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.632561  9642 leader_election.cc:290] T 24abd32dde1f44c7af83b9344e632ab0 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:30.633575  9545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24abd32dde1f44c7af83b9344e632ab0" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:30.609593  9591 raft_consensus.cc:359] T 225ca60d9645490dbcdcf6d4d127d955 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:30.636292  9591 raft_consensus.cc:385] T 225ca60d9645490dbcdcf6d4d127d955 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.636828  9591 raft_consensus.cc:740] T 225ca60d9645490dbcdcf6d4d127d955 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
W20260709 13:04:30.667670  9438 leader_election.cc:343] T 24abd32dde1f44c7af83b9344e632ab0 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:30.706892  9592 tablet_bootstrap.cc:492] T 73b8fed487d54513b9256d4c1a39cfa0 P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:30.707049  9590 tablet_bootstrap.cc:492] T 24abd32dde1f44c7af83b9344e632ab0 P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:30.707520  9592 ts_tablet_manager.cc:1403] T 73b8fed487d54513b9256d4c1a39cfa0 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.276s	user 0.041s	sys 0.034s
I20260709 13:04:30.707624  9590 ts_tablet_manager.cc:1403] T 24abd32dde1f44c7af83b9344e632ab0 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.334s	user 0.050s	sys 0.012s
I20260709 13:04:30.674636  9591 consensus_queue.cc:260] T 225ca60d9645490dbcdcf6d4d127d955 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
W20260709 13:04:30.697043  9438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37995, user_credentials={real_user=slave}} blocked reactor thread for 47816.5us
I20260709 13:04:30.711594  9650 raft_consensus.cc:493] T 879fbf42aa3c4c21a58f094d1a2b91e7 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.723215  9650 raft_consensus.cc:515] T 879fbf42aa3c4c21a58f094d1a2b91e7 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:30.725523  9647 raft_consensus.cc:515] T 24abd32dde1f44c7af83b9344e632ab0 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:30.728613  9590 raft_consensus.cc:359] T 24abd32dde1f44c7af83b9344e632ab0 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:30.729418  9590 raft_consensus.cc:385] T 24abd32dde1f44c7af83b9344e632ab0 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.729701  9590 raft_consensus.cc:740] T 24abd32dde1f44c7af83b9344e632ab0 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.730396  9647 leader_election.cc:290] T 24abd32dde1f44c7af83b9344e632ab0 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Requested vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:30.731606  9646 raft_consensus.cc:493] T 8c1e5b4bc1bc437884e6835b61227d4d P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.732139  9646 raft_consensus.cc:515] T 8c1e5b4bc1bc437884e6835b61227d4d P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:30.730463  9590 consensus_queue.cc:260] T 24abd32dde1f44c7af83b9344e632ab0 P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:30.734490  9646 leader_election.cc:290] T 8c1e5b4bc1bc437884e6835b61227d4d P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:30.735623  9590 ts_tablet_manager.cc:1434] T 24abd32dde1f44c7af83b9344e632ab0 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 13:04:30.735909  9471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c1e5b4bc1bc437884e6835b61227d4d" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:30.736712  9590 tablet_bootstrap.cc:492] T 331d1446396c45ce9486793ecb5de7f7 P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
I20260709 13:04:30.737766  9593 ts_tablet_manager.cc:1434] T 8c1e5b4bc1bc437884e6835b61227d4d P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.270s	user 0.020s	sys 0.018s
I20260709 13:04:30.743544  9593 tablet_bootstrap.cc:492] T b31d08e4168243f08eb2a31031a039ed P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:30.755363  9320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c1e5b4bc1bc437884e6835b61227d4d" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:30.756206  9650 leader_election.cc:290] T 879fbf42aa3c4c21a58f094d1a2b91e7 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:30.758880  9535 tablet_service.cc:1511] Processing CreateTablet for tablet 803c43e83ee5487590c9d922559adc0f (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:04:30.760756  9535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 803c43e83ee5487590c9d922559adc0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.759440  9627 raft_consensus.cc:493] T 225ca60d9645490dbcdcf6d4d127d955 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.762223  9627 raft_consensus.cc:515] T 225ca60d9645490dbcdcf6d4d127d955 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
W20260709 13:04:30.764518  9364 leader_election.cc:343] T 8c1e5b4bc1bc437884e6835b61227d4d P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:30.748837  9545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24abd32dde1f44c7af83b9344e632ab0" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
I20260709 13:04:30.776059  9647 consensus_queue.cc:1048] T 879fbf42aa3c4c21a58f094d1a2b91e7 P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:30.779119  9383 tablet_service.cc:1511] Processing CreateTablet for tablet 9b19e51cda7e44e5a1f02a736e555ac4 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:04:30.780521  9383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b19e51cda7e44e5a1f02a736e555ac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.783306  9381 tablet_service.cc:1511] Processing CreateTablet for tablet 8528ae822cb04615a9dbd1166b7d7328 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:04:30.784061  9321 raft_consensus.cc:2468] T ad58816d959840df923159e870cf4ad8 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 1.
I20260709 13:04:30.784595  9381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8528ae822cb04615a9dbd1166b7d7328. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.786456  9546 raft_consensus.cc:2468] T ad58816d959840df923159e870cf4ad8 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 1.
W20260709 13:04:30.793041  9364 leader_election.cc:343] T 8c1e5b4bc1bc437884e6835b61227d4d P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:30.793826  9364 leader_election.cc:304] T 8c1e5b4bc1bc437884e6835b61227d4d P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49; no voters: 932245f14aac417f913cc7330a1833b8, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:30.795459  9471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879fbf42aa3c4c21a58f094d1a2b91e7" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:30.796784  9364 leader_election.cc:304] T ad58816d959840df923159e870cf4ad8 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, a91e8b10a5984dec9d3777a7275cef49; no voters: 
I20260709 13:04:30.798208  9591 ts_tablet_manager.cc:1434] T 225ca60d9645490dbcdcf6d4d127d955 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.192s	user 0.005s	sys 0.005s
I20260709 13:04:30.798329  9382 tablet_service.cc:1511] Processing CreateTablet for tablet a6f012a5e95f4006871d83f7b18e356b (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:04:30.799794  9382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6f012a5e95f4006871d83f7b18e356b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.804291  9536 tablet_service.cc:1511] Processing CreateTablet for tablet 9b19e51cda7e44e5a1f02a736e555ac4 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:04:30.806711  9532 tablet_service.cc:1511] Processing CreateTablet for tablet a6f012a5e95f4006871d83f7b18e356b (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:04:30.823238  9532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6f012a5e95f4006871d83f7b18e356b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.822840  9592 raft_consensus.cc:359] T 73b8fed487d54513b9256d4c1a39cfa0 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:30.824059  9592 raft_consensus.cc:385] T 73b8fed487d54513b9256d4c1a39cfa0 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.807132  9531 tablet_service.cc:1511] Processing CreateTablet for tablet d8bd3f903abb4dd99431dbf597c0d462 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:04:30.824632  9592 raft_consensus.cc:740] T 73b8fed487d54513b9256d4c1a39cfa0 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.825860  9531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8bd3f903abb4dd99431dbf597c0d462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.808420  9456 tablet_service.cc:1511] Processing CreateTablet for tablet 9b19e51cda7e44e5a1f02a736e555ac4 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:04:30.828500  9456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b19e51cda7e44e5a1f02a736e555ac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.811944  9458 tablet_service.cc:1511] Processing CreateTablet for tablet d8bd3f903abb4dd99431dbf597c0d462 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:04:30.774489  9545 raft_consensus.cc:3060] T 24abd32dde1f44c7af83b9344e632ab0 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:30.773377  9436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33607, user_credentials={real_user=slave}} blocked reactor thread for 56509.8us
I20260709 13:04:30.817319  9650 raft_consensus.cc:2804] T ad58816d959840df923159e870cf4ad8 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:30.820151  9320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879fbf42aa3c4c21a58f094d1a2b91e7" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:30.820750  9687 raft_consensus.cc:2749] T 8c1e5b4bc1bc437884e6835b61227d4d P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:30.825472  9592 consensus_queue.cc:260] T 73b8fed487d54513b9256d4c1a39cfa0 P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:30.810295  9461 tablet_service.cc:1511] Processing CreateTablet for tablet 8528ae822cb04615a9dbd1166b7d7328 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:04:30.829227  9642 raft_consensus.cc:493] T 9b34d97496514d29a27c52d749609084 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.849813  9313 tablet_service.cc:1511] Processing CreateTablet for tablet 803c43e83ee5487590c9d922559adc0f (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:04:30.844890  9650 raft_consensus.cc:697] T ad58816d959840df923159e870cf4ad8 P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Becoming Leader. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Running, Role: LEADER
I20260709 13:04:30.870014  9313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 803c43e83ee5487590c9d922559adc0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.870131  9650 consensus_queue.cc:237] T ad58816d959840df923159e870cf4ad8 P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:30.852074  9310 tablet_service.cc:1511] Processing CreateTablet for tablet 8528ae822cb04615a9dbd1166b7d7328 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:04:30.874203  9310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8528ae822cb04615a9dbd1166b7d7328. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.838135  9627 leader_election.cc:290] T 225ca60d9645490dbcdcf6d4d127d955 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:30.853856  9312 tablet_service.cc:1511] Processing CreateTablet for tablet a6f012a5e95f4006871d83f7b18e356b (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:04:30.855580  9307 tablet_service.cc:1511] Processing CreateTablet for tablet d8bd3f903abb4dd99431dbf597c0d462 (DEFAULT_TABLE table=test-workload [id=18b384aa17224ea5b2988cf0f42218cc]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:04:30.856232  9591 tablet_bootstrap.cc:492] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:30.859443  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225ca60d9645490dbcdcf6d4d127d955" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:30.860261  9398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24abd32dde1f44c7af83b9344e632ab0" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:30.860555  9689 consensus_queue.cc:1048] T 99fc4b4b16d0432390a92d5c04149ce1 P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:30.864274  9458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8bd3f903abb4dd99431dbf597c0d462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.865722  9471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225ca60d9645490dbcdcf6d4d127d955" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:30.880476  9312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6f012a5e95f4006871d83f7b18e356b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.891566  9398 raft_consensus.cc:3060] T 24abd32dde1f44c7af83b9344e632ab0 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:30.898546  9512 leader_election.cc:343] T 225ca60d9645490dbcdcf6d4d127d955 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:30.900326  9545 raft_consensus.cc:2468] T 24abd32dde1f44c7af83b9344e632ab0 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 1.
I20260709 13:04:30.903345  9536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b19e51cda7e44e5a1f02a736e555ac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.903832  9438 leader_election.cc:304] T 24abd32dde1f44c7af83b9344e632ab0 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:30.896256  9323 raft_consensus.cc:2468] T 225ca60d9645490dbcdcf6d4d127d955 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 0.
I20260709 13:04:30.901500  9461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8528ae822cb04615a9dbd1166b7d7328. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.901866  9689 consensus_queue.cc:1048] T 99fc4b4b16d0432390a92d5c04149ce1 P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:30.920339  9692 raft_consensus.cc:2804] T 24abd32dde1f44c7af83b9344e632ab0 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:30.921047  9692 raft_consensus.cc:697] T 24abd32dde1f44c7af83b9344e632ab0 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Becoming Leader. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Running, Role: LEADER
I20260709 13:04:30.922029  9692 consensus_queue.cc:237] T 24abd32dde1f44c7af83b9344e632ab0 P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:30.889735  9642 raft_consensus.cc:515] T 9b34d97496514d29a27c52d749609084 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:30.927927  9642 leader_election.cc:290] T 9b34d97496514d29a27c52d749609084 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:30.902252  9307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8bd3f903abb4dd99431dbf597c0d462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.928088  9396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b34d97496514d29a27c52d749609084" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:30.920248  9512 leader_election.cc:304] T 225ca60d9645490dbcdcf6d4d127d955 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, dfbbb80ab8e345e0ae1684fafefceccf; no voters: ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:30.911216  9592 ts_tablet_manager.cc:1434] T 73b8fed487d54513b9256d4c1a39cfa0 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.203s	user 0.009s	sys 0.000s
I20260709 13:04:30.933198  9593 tablet_bootstrap.cc:654] T b31d08e4168243f08eb2a31031a039ed P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:30.931223  9627 raft_consensus.cc:2804] T 225ca60d9645490dbcdcf6d4d127d955 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:30.934047  9627 raft_consensus.cc:493] T 225ca60d9645490dbcdcf6d4d127d955 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:30.934404  9627 raft_consensus.cc:3060] T 225ca60d9645490dbcdcf6d4d127d955 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.941038  9590 tablet_bootstrap.cc:654] T 331d1446396c45ce9486793ecb5de7f7 P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:30.911257  9591 tablet_bootstrap.cc:654] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:30.941058  9364 leader_election.cc:304] T 879fbf42aa3c4c21a58f094d1a2b91e7 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49; no voters: 932245f14aac417f913cc7330a1833b8, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:30.979293  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b34d97496514d29a27c52d749609084" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:30.979293  9650 raft_consensus.cc:2749] T 879fbf42aa3c4c21a58f094d1a2b91e7 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:30.996181  9438 leader_election.cc:304] T 9b34d97496514d29a27c52d749609084 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef5fe58eb3e04ae18fda957b4d507eff; no voters: 932245f14aac417f913cc7330a1833b8, a91e8b10a5984dec9d3777a7275cef49
I20260709 13:04:30.990212  9472 raft_consensus.cc:3060] T 9b34d97496514d29a27c52d749609084 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.001622  9398 raft_consensus.cc:2468] T 24abd32dde1f44c7af83b9344e632ab0 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 1.
I20260709 13:04:30.992885  9592 tablet_bootstrap.cc:492] T 225ca60d9645490dbcdcf6d4d127d955 P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:30.996876  9627 raft_consensus.cc:515] T 225ca60d9645490dbcdcf6d4d127d955 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:31.012053  9221 catalog_manager.cc:5697] T 24abd32dde1f44c7af83b9344e632ab0 P ef5fe58eb3e04ae18fda957b4d507eff reported cstate change: term changed from 0 to 1, leader changed from <none> to ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:31.013161  9470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225ca60d9645490dbcdcf6d4d127d955" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:31.015219  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225ca60d9645490dbcdcf6d4d127d955" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8"
W20260709 13:04:31.027515  9512 leader_election.cc:343] T 225ca60d9645490dbcdcf6d4d127d955 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.025867  9323 raft_consensus.cc:3060] T 225ca60d9645490dbcdcf6d4d127d955 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.044615  9220 catalog_manager.cc:5697] T ad58816d959840df923159e870cf4ad8 P a91e8b10a5984dec9d3777a7275cef49 reported cstate change: term changed from 0 to 1, leader changed from <none> to a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "a91e8b10a5984dec9d3777a7275cef49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:31.022238  9627 leader_election.cc:290] T 225ca60d9645490dbcdcf6d4d127d955 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Requested vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:31.054724  9642 raft_consensus.cc:493] T 73b8fed487d54513b9256d4c1a39cfa0 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.055335  9642 raft_consensus.cc:515] T 73b8fed487d54513b9256d4c1a39cfa0 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:31.061002  9642 leader_election.cc:290] T 73b8fed487d54513b9256d4c1a39cfa0 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:31.062584  9395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b8fed487d54513b9256d4c1a39cfa0" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:31.064519  9395 raft_consensus.cc:2468] T 73b8fed487d54513b9256d4c1a39cfa0 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 0.
I20260709 13:04:31.067822  9436 leader_election.cc:304] T 73b8fed487d54513b9256d4c1a39cfa0 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:31.069350  9592 tablet_bootstrap.cc:654] T 225ca60d9645490dbcdcf6d4d127d955 P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.076339  9642 raft_consensus.cc:2804] T 73b8fed487d54513b9256d4c1a39cfa0 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:31.076817  9642 raft_consensus.cc:493] T 73b8fed487d54513b9256d4c1a39cfa0 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:31.077193  9642 raft_consensus.cc:3060] T 73b8fed487d54513b9256d4c1a39cfa0 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.079504  9323 raft_consensus.cc:2468] T 225ca60d9645490dbcdcf6d4d127d955 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 1.
I20260709 13:04:31.080963  9512 leader_election.cc:304] T 225ca60d9645490dbcdcf6d4d127d955 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, dfbbb80ab8e345e0ae1684fafefceccf; no voters: ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:31.083076  9599 raft_consensus.cc:2804] T 225ca60d9645490dbcdcf6d4d127d955 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:31.083719  9599 raft_consensus.cc:697] T 225ca60d9645490dbcdcf6d4d127d955 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Becoming Leader. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Running, Role: LEADER
I20260709 13:04:31.084576  9599 consensus_queue.cc:237] T 225ca60d9645490dbcdcf6d4d127d955 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:31.086911  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b8fed487d54513b9256d4c1a39cfa0" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
W20260709 13:04:31.088325  9438 leader_election.cc:343] T 73b8fed487d54513b9256d4c1a39cfa0 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.094890  9593 tablet_bootstrap.cc:492] T b31d08e4168243f08eb2a31031a039ed P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:31.095479  9593 ts_tablet_manager.cc:1403] T b31d08e4168243f08eb2a31031a039ed P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.352s	user 0.020s	sys 0.006s
I20260709 13:04:31.102365  9591 tablet_bootstrap.cc:492] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:31.103312  9591 ts_tablet_manager.cc:1403] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.247s	user 0.006s	sys 0.012s
I20260709 13:04:31.108201  9593 raft_consensus.cc:359] T b31d08e4168243f08eb2a31031a039ed P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:31.108783  9593 raft_consensus.cc:385] T b31d08e4168243f08eb2a31031a039ed P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.109009  9593 raft_consensus.cc:740] T b31d08e4168243f08eb2a31031a039ed P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.110316  9692 raft_consensus.cc:2749] T 9b34d97496514d29a27c52d749609084 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:31.109903  9593 consensus_queue.cc:260] T b31d08e4168243f08eb2a31031a039ed P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:31.103617  9592 tablet_bootstrap.cc:492] T 225ca60d9645490dbcdcf6d4d127d955 P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:31.110523  9591 raft_consensus.cc:359] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:31.118615  9591 raft_consensus.cc:385] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.118897  9591 raft_consensus.cc:740] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.119591  9591 consensus_queue.cc:260] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:31.117300  9219 catalog_manager.cc:5697] T 225ca60d9645490dbcdcf6d4d127d955 P dfbbb80ab8e345e0ae1684fafefceccf reported cstate change: term changed from 0 to 1, leader changed from <none> to dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196). New cstate: current_term: 1 leader_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:31.118134  9590 tablet_bootstrap.cc:492] T 331d1446396c45ce9486793ecb5de7f7 P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:31.122028  9591 ts_tablet_manager.cc:1434] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:04:31.122335  9590 ts_tablet_manager.cc:1403] T 331d1446396c45ce9486793ecb5de7f7 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.386s	user 0.018s	sys 0.005s
I20260709 13:04:31.123055  9591 tablet_bootstrap.cc:492] T 5cfc1f2582a64d8dbc3f127e15024ec0 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:31.126343  9590 raft_consensus.cc:359] T 331d1446396c45ce9486793ecb5de7f7 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:31.127210  9590 raft_consensus.cc:385] T 331d1446396c45ce9486793ecb5de7f7 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.127580  9590 raft_consensus.cc:740] T 331d1446396c45ce9486793ecb5de7f7 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.128377  9590 consensus_queue.cc:260] T 331d1446396c45ce9486793ecb5de7f7 P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:31.130033  9591 tablet_bootstrap.cc:654] T 5cfc1f2582a64d8dbc3f127e15024ec0 P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.131016  9590 ts_tablet_manager.cc:1434] T 331d1446396c45ce9486793ecb5de7f7 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:04:31.131235  9642 raft_consensus.cc:515] T 73b8fed487d54513b9256d4c1a39cfa0 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:31.132364  9590 tablet_bootstrap.cc:492] T 93877deb770d41a6ba34cefdea146d54 P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
I20260709 13:04:31.133746  9642 leader_election.cc:290] T 73b8fed487d54513b9256d4c1a39cfa0 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Requested vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:31.114504  9593 ts_tablet_manager.cc:1434] T b31d08e4168243f08eb2a31031a039ed P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:04:31.134481  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b8fed487d54513b9256d4c1a39cfa0" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8"
I20260709 13:04:31.134884  9395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b8fed487d54513b9256d4c1a39cfa0" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:31.135246  9593 tablet_bootstrap.cc:492] T 01a5f4a59c5e47bc8b7b11db44d80006 P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:31.135491  9395 raft_consensus.cc:3060] T 73b8fed487d54513b9256d4c1a39cfa0 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:31.136219  9438 leader_election.cc:343] T 73b8fed487d54513b9256d4c1a39cfa0 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.117841  9592 ts_tablet_manager.cc:1403] T 225ca60d9645490dbcdcf6d4d127d955 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.130s	user 0.007s	sys 0.008s
I20260709 13:04:31.141032  9592 raft_consensus.cc:359] T 225ca60d9645490dbcdcf6d4d127d955 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:31.151865  9592 raft_consensus.cc:385] T 225ca60d9645490dbcdcf6d4d127d955 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.152112  9593 tablet_bootstrap.cc:654] T 01a5f4a59c5e47bc8b7b11db44d80006 P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.152475  9599 raft_consensus.cc:493] T 331d1446396c45ce9486793ecb5de7f7 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.147732  9591 tablet_bootstrap.cc:492] T 5cfc1f2582a64d8dbc3f127e15024ec0 P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:31.153306  9591 ts_tablet_manager.cc:1403] T 5cfc1f2582a64d8dbc3f127e15024ec0 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.002s
I20260709 13:04:31.153015  9599 raft_consensus.cc:515] T 331d1446396c45ce9486793ecb5de7f7 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:31.155298  9599 leader_election.cc:290] T 331d1446396c45ce9486793ecb5de7f7 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:31.156193  9591 raft_consensus.cc:359] T 5cfc1f2582a64d8dbc3f127e15024ec0 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:31.156836  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "331d1446396c45ce9486793ecb5de7f7" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:31.157044  9591 raft_consensus.cc:385] T 5cfc1f2582a64d8dbc3f127e15024ec0 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.157539  9591 raft_consensus.cc:740] T 5cfc1f2582a64d8dbc3f127e15024ec0 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.158231  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "331d1446396c45ce9486793ecb5de7f7" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:31.158895  9321 raft_consensus.cc:2468] T 331d1446396c45ce9486793ecb5de7f7 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 0.
I20260709 13:04:31.143332  9395 raft_consensus.cc:2468] T 73b8fed487d54513b9256d4c1a39cfa0 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 1.
I20260709 13:04:31.152149  9592 raft_consensus.cc:740] T 225ca60d9645490dbcdcf6d4d127d955 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.158433  9591 consensus_queue.cc:260] T 5cfc1f2582a64d8dbc3f127e15024ec0 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:31.161332  9436 leader_election.cc:304] T 73b8fed487d54513b9256d4c1a39cfa0 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 932245f14aac417f913cc7330a1833b8
I20260709 13:04:31.162163  9642 raft_consensus.cc:2804] T 73b8fed487d54513b9256d4c1a39cfa0 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:31.160526  9512 leader_election.cc:304] T 331d1446396c45ce9486793ecb5de7f7 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 
I20260709 13:04:31.162870  9642 raft_consensus.cc:697] T 73b8fed487d54513b9256d4c1a39cfa0 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Becoming Leader. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Running, Role: LEADER
W20260709 13:04:31.163025  9512 leader_election.cc:343] T 331d1446396c45ce9486793ecb5de7f7 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.163177  9591 ts_tablet_manager.cc:1434] T 5cfc1f2582a64d8dbc3f127e15024ec0 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.004s
I20260709 13:04:31.164125  9599 raft_consensus.cc:2804] T 331d1446396c45ce9486793ecb5de7f7 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:31.163997  9642 consensus_queue.cc:237] T 73b8fed487d54513b9256d4c1a39cfa0 P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:31.164484  9591 tablet_bootstrap.cc:492] T 73b8fed487d54513b9256d4c1a39cfa0 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:31.165320  9592 consensus_queue.cc:260] T 225ca60d9645490dbcdcf6d4d127d955 P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:31.164541  9599 raft_consensus.cc:493] T 331d1446396c45ce9486793ecb5de7f7 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:31.166502  9599 raft_consensus.cc:3060] T 331d1446396c45ce9486793ecb5de7f7 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.167532  9592 ts_tablet_manager.cc:1434] T 225ca60d9645490dbcdcf6d4d127d955 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.003s
I20260709 13:04:31.168525  9592 tablet_bootstrap.cc:492] T 331d1446396c45ce9486793ecb5de7f7 P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:31.175635  9592 tablet_bootstrap.cc:654] T 331d1446396c45ce9486793ecb5de7f7 P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.148300  9590 tablet_bootstrap.cc:654] T 93877deb770d41a6ba34cefdea146d54 P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:31.181527  9268 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:31.185607  9593 tablet_bootstrap.cc:492] T 01a5f4a59c5e47bc8b7b11db44d80006 P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:31.186249  9593 ts_tablet_manager.cc:1403] T 01a5f4a59c5e47bc8b7b11db44d80006 P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.004s
I20260709 13:04:31.189208  9599 raft_consensus.cc:515] T 331d1446396c45ce9486793ecb5de7f7 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:31.189920  9687 raft_consensus.cc:493] T b31d08e4168243f08eb2a31031a039ed P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.189605  9593 raft_consensus.cc:359] T 01a5f4a59c5e47bc8b7b11db44d80006 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:31.190521  9593 raft_consensus.cc:385] T 01a5f4a59c5e47bc8b7b11db44d80006 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.191013  9593 raft_consensus.cc:740] T 01a5f4a59c5e47bc8b7b11db44d80006 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.190455  9687 raft_consensus.cc:515] T b31d08e4168243f08eb2a31031a039ed P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:31.192673  9591 tablet_bootstrap.cc:654] T 73b8fed487d54513b9256d4c1a39cfa0 P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.192840  9687 leader_election.cc:290] T b31d08e4168243f08eb2a31031a039ed P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:31.194051  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "331d1446396c45ce9486793ecb5de7f7" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:31.195406  9546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31d08e4168243f08eb2a31031a039ed" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:31.195883  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31d08e4168243f08eb2a31031a039ed" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
W20260709 13:04:31.197569  9364 leader_election.cc:343] T b31d08e4168243f08eb2a31031a039ed P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:31.198244  9512 leader_election.cc:343] T 331d1446396c45ce9486793ecb5de7f7 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:31.198580  9364 leader_election.cc:343] T b31d08e4168243f08eb2a31031a039ed P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.199210  9364 leader_election.cc:304] T b31d08e4168243f08eb2a31031a039ed P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49; no voters: 932245f14aac417f913cc7330a1833b8, dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:31.201370  9687 raft_consensus.cc:2749] T b31d08e4168243f08eb2a31031a039ed P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:31.201449  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "331d1446396c45ce9486793ecb5de7f7" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8"
I20260709 13:04:31.202373  9321 raft_consensus.cc:3060] T 331d1446396c45ce9486793ecb5de7f7 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.203361  9593 consensus_queue.cc:260] T 01a5f4a59c5e47bc8b7b11db44d80006 P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:31.210526  9593 ts_tablet_manager.cc:1434] T 01a5f4a59c5e47bc8b7b11db44d80006 P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:04:31.214154  9593 tablet_bootstrap.cc:492] T 7937a8107df4458ebd48b5ce1589d788 P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:31.216432  9599 leader_election.cc:290] T 331d1446396c45ce9486793ecb5de7f7 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Requested vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:31.219172  9590 tablet_bootstrap.cc:492] T 93877deb770d41a6ba34cefdea146d54 P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:31.219713  9590 ts_tablet_manager.cc:1403] T 93877deb770d41a6ba34cefdea146d54 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.088s	user 0.013s	sys 0.000s
I20260709 13:04:31.215234  9321 raft_consensus.cc:2468] T 331d1446396c45ce9486793ecb5de7f7 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 1.
I20260709 13:04:31.216059  9592 tablet_bootstrap.cc:492] T 331d1446396c45ce9486793ecb5de7f7 P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:31.221673  9592 ts_tablet_manager.cc:1403] T 331d1446396c45ce9486793ecb5de7f7 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.053s	user 0.023s	sys 0.019s
I20260709 13:04:31.224848  9592 raft_consensus.cc:359] T 331d1446396c45ce9486793ecb5de7f7 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:31.225579  9592 raft_consensus.cc:385] T 331d1446396c45ce9486793ecb5de7f7 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.225854  9592 raft_consensus.cc:740] T 331d1446396c45ce9486793ecb5de7f7 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.226655  9593 tablet_bootstrap.cc:654] T 7937a8107df4458ebd48b5ce1589d788 P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.226547  9592 consensus_queue.cc:260] T 331d1446396c45ce9486793ecb5de7f7 P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:31.228348  9512 leader_election.cc:304] T 331d1446396c45ce9486793ecb5de7f7 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, dfbbb80ab8e345e0ae1684fafefceccf; no voters: ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:31.229628  9590 raft_consensus.cc:359] T 93877deb770d41a6ba34cefdea146d54 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:31.233767  9590 raft_consensus.cc:385] T 93877deb770d41a6ba34cefdea146d54 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.234076  9590 raft_consensus.cc:740] T 93877deb770d41a6ba34cefdea146d54 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.234150  9591 tablet_bootstrap.cc:492] T 73b8fed487d54513b9256d4c1a39cfa0 P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:31.234699  9591 ts_tablet_manager.cc:1403] T 73b8fed487d54513b9256d4c1a39cfa0 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.070s	user 0.018s	sys 0.024s
I20260709 13:04:31.235232  9593 tablet_bootstrap.cc:492] T 7937a8107df4458ebd48b5ce1589d788 P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:31.234922  9590 consensus_queue.cc:260] T 93877deb770d41a6ba34cefdea146d54 P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:31.235743  9593 ts_tablet_manager.cc:1403] T 7937a8107df4458ebd48b5ce1589d788 P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.003s
I20260709 13:04:31.237263  9590 ts_tablet_manager.cc:1434] T 93877deb770d41a6ba34cefdea146d54 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:04:31.231339  9592 ts_tablet_manager.cc:1434] T 331d1446396c45ce9486793ecb5de7f7 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:04:31.237958  9591 raft_consensus.cc:359] T 73b8fed487d54513b9256d4c1a39cfa0 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:31.238670  9592 tablet_bootstrap.cc:492] T 93877deb770d41a6ba34cefdea146d54 P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:31.238920  9591 raft_consensus.cc:385] T 73b8fed487d54513b9256d4c1a39cfa0 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.231909  9220 catalog_manager.cc:5697] T 73b8fed487d54513b9256d4c1a39cfa0 P ef5fe58eb3e04ae18fda957b4d507eff reported cstate change: term changed from 0 to 1, leader changed from <none> to ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:31.238688  9593 raft_consensus.cc:359] T 7937a8107df4458ebd48b5ce1589d788 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:31.239331  9591 raft_consensus.cc:740] T 73b8fed487d54513b9256d4c1a39cfa0 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.239667  9593 raft_consensus.cc:385] T 7937a8107df4458ebd48b5ce1589d788 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.239770  9590 tablet_bootstrap.cc:492] T a55798aa4230462f9befe5d7fc9bd3ce P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
I20260709 13:04:31.239961  9593 raft_consensus.cc:740] T 7937a8107df4458ebd48b5ce1589d788 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.240226  9591 consensus_queue.cc:260] T 73b8fed487d54513b9256d4c1a39cfa0 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:31.240700  9593 consensus_queue.cc:260] T 7937a8107df4458ebd48b5ce1589d788 P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:31.232532  9599 raft_consensus.cc:2804] T 331d1446396c45ce9486793ecb5de7f7 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:31.241773  9599 raft_consensus.cc:697] T 331d1446396c45ce9486793ecb5de7f7 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Becoming Leader. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Running, Role: LEADER
I20260709 13:04:31.243044  9593 ts_tablet_manager.cc:1434] T 7937a8107df4458ebd48b5ce1589d788 P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:31.242697  9599 consensus_queue.cc:237] T 331d1446396c45ce9486793ecb5de7f7 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:31.244027  9593 tablet_bootstrap.cc:492] T faf56b218e614e51962171088f3c4f63 P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:31.246361  9591 ts_tablet_manager.cc:1434] T 73b8fed487d54513b9256d4c1a39cfa0 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 13:04:31.246706  9590 tablet_bootstrap.cc:654] T a55798aa4230462f9befe5d7fc9bd3ce P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.247391  9591 tablet_bootstrap.cc:492] T 93877deb770d41a6ba34cefdea146d54 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:31.250373  9593 tablet_bootstrap.cc:654] T faf56b218e614e51962171088f3c4f63 P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.254132  9591 tablet_bootstrap.cc:654] T 93877deb770d41a6ba34cefdea146d54 P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.255561  9592 tablet_bootstrap.cc:654] T 93877deb770d41a6ba34cefdea146d54 P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.267616  9592 tablet_bootstrap.cc:492] T 93877deb770d41a6ba34cefdea146d54 P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:31.268304  9592 ts_tablet_manager.cc:1403] T 93877deb770d41a6ba34cefdea146d54 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.001s
I20260709 13:04:31.271890  9687 consensus_queue.cc:1048] T ad58816d959840df923159e870cf4ad8 P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:31.272305  9592 raft_consensus.cc:359] T 93877deb770d41a6ba34cefdea146d54 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:31.273329  9592 raft_consensus.cc:385] T 93877deb770d41a6ba34cefdea146d54 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.273810  9592 raft_consensus.cc:740] T 93877deb770d41a6ba34cefdea146d54 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.274739  9592 consensus_queue.cc:260] T 93877deb770d41a6ba34cefdea146d54 P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:31.281783  9591 tablet_bootstrap.cc:492] T 93877deb770d41a6ba34cefdea146d54 P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:31.282563  9591 ts_tablet_manager.cc:1403] T 93877deb770d41a6ba34cefdea146d54 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.007s
I20260709 13:04:31.286692  9591 raft_consensus.cc:359] T 93877deb770d41a6ba34cefdea146d54 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:31.293615  9592 ts_tablet_manager.cc:1434] T 93877deb770d41a6ba34cefdea146d54 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.025s	user 0.012s	sys 0.000s
I20260709 13:04:31.287644  9591 raft_consensus.cc:385] T 93877deb770d41a6ba34cefdea146d54 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.295431  9591 raft_consensus.cc:740] T 93877deb770d41a6ba34cefdea146d54 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.295459  9592 tablet_bootstrap.cc:492] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:31.301039  9591 consensus_queue.cc:260] T 93877deb770d41a6ba34cefdea146d54 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:31.303316  9590 tablet_bootstrap.cc:492] T a55798aa4230462f9befe5d7fc9bd3ce P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:31.303910  9591 ts_tablet_manager.cc:1434] T 93877deb770d41a6ba34cefdea146d54 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 13:04:31.305892  9590 ts_tablet_manager.cc:1403] T a55798aa4230462f9befe5d7fc9bd3ce P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.066s	user 0.012s	sys 0.003s
I20260709 13:04:31.306618  9591 tablet_bootstrap.cc:492] T 7937a8107df4458ebd48b5ce1589d788 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:31.308869  9590 raft_consensus.cc:359] T a55798aa4230462f9befe5d7fc9bd3ce P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:31.309640  9590 raft_consensus.cc:385] T a55798aa4230462f9befe5d7fc9bd3ce P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.309964  9590 raft_consensus.cc:740] T a55798aa4230462f9befe5d7fc9bd3ce P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.312268  9590 consensus_queue.cc:260] T a55798aa4230462f9befe5d7fc9bd3ce P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:31.317277  9590 ts_tablet_manager.cc:1434] T a55798aa4230462f9befe5d7fc9bd3ce P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 13:04:31.318252  9590 tablet_bootstrap.cc:492] T b31d08e4168243f08eb2a31031a039ed P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
I20260709 13:04:31.319501  9591 tablet_bootstrap.cc:654] T 7937a8107df4458ebd48b5ce1589d788 P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.325977  9593 tablet_bootstrap.cc:492] T faf56b218e614e51962171088f3c4f63 P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:31.326532  9593 ts_tablet_manager.cc:1403] T faf56b218e614e51962171088f3c4f63 P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.083s	user 0.036s	sys 0.043s
I20260709 13:04:31.330300  9590 tablet_bootstrap.cc:654] T b31d08e4168243f08eb2a31031a039ed P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.329890  9593 raft_consensus.cc:359] T faf56b218e614e51962171088f3c4f63 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:31.330721  9593 raft_consensus.cc:385] T faf56b218e614e51962171088f3c4f63 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.331239  9592 tablet_bootstrap.cc:654] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.330992  9593 raft_consensus.cc:740] T faf56b218e614e51962171088f3c4f63 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.332278  9593 consensus_queue.cc:260] T faf56b218e614e51962171088f3c4f63 P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:31.334975  9593 ts_tablet_manager.cc:1434] T faf56b218e614e51962171088f3c4f63 P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:04:31.336195  9593 tablet_bootstrap.cc:492] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:31.338536  9642 raft_consensus.cc:493] T 93877deb770d41a6ba34cefdea146d54 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.339176  9642 raft_consensus.cc:515] T 93877deb770d41a6ba34cefdea146d54 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:31.341634  9642 leader_election.cc:290] T 93877deb770d41a6ba34cefdea146d54 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:31.345670  9545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93877deb770d41a6ba34cefdea146d54" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:31.346428  9545 raft_consensus.cc:2468] T 93877deb770d41a6ba34cefdea146d54 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 0.
I20260709 13:04:31.347460  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93877deb770d41a6ba34cefdea146d54" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:31.348246  9321 raft_consensus.cc:2468] T 93877deb770d41a6ba34cefdea146d54 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 0.
I20260709 13:04:31.349782  9438 leader_election.cc:304] T 93877deb770d41a6ba34cefdea146d54 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:31.350822  9692 raft_consensus.cc:2804] T 93877deb770d41a6ba34cefdea146d54 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:31.351200  9692 raft_consensus.cc:493] T 93877deb770d41a6ba34cefdea146d54 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:31.351558  9692 raft_consensus.cc:3060] T 93877deb770d41a6ba34cefdea146d54 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.351444  9642 raft_consensus.cc:493] T 225ca60d9645490dbcdcf6d4d127d955 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.352368  9642 raft_consensus.cc:515] T 225ca60d9645490dbcdcf6d4d127d955 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:31.354652  9599 raft_consensus.cc:493] T a55798aa4230462f9befe5d7fc9bd3ce P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.355195  9599 raft_consensus.cc:515] T a55798aa4230462f9befe5d7fc9bd3ce P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:31.357880  9599 leader_election.cc:290] T a55798aa4230462f9befe5d7fc9bd3ce P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:31.358749  9545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225ca60d9645490dbcdcf6d4d127d955" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:31.359961  9395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55798aa4230462f9befe5d7fc9bd3ce" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:31.360347  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55798aa4230462f9befe5d7fc9bd3ce" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
W20260709 13:04:31.361940  9512 leader_election.cc:343] T a55798aa4230462f9befe5d7fc9bd3ce P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.362389  9642 leader_election.cc:290] T 225ca60d9645490dbcdcf6d4d127d955 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
W20260709 13:04:31.363108  9510 leader_election.cc:343] T a55798aa4230462f9befe5d7fc9bd3ce P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.363621  9510 leader_election.cc:304] T a55798aa4230462f9befe5d7fc9bd3ce P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf; no voters: 932245f14aac417f913cc7330a1833b8, a91e8b10a5984dec9d3777a7275cef49
I20260709 13:04:31.364073  9593 tablet_bootstrap.cc:654] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.365173  9599 raft_consensus.cc:2749] T a55798aa4230462f9befe5d7fc9bd3ce P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:31.366842  9220 catalog_manager.cc:5697] T 331d1446396c45ce9486793ecb5de7f7 P dfbbb80ab8e345e0ae1684fafefceccf reported cstate change: term changed from 0 to 1, leader changed from <none> to dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196). New cstate: current_term: 1 leader_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:31.373118  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225ca60d9645490dbcdcf6d4d127d955" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:31.374202  9321 raft_consensus.cc:2393] T 225ca60d9645490dbcdcf6d4d127d955 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef5fe58eb3e04ae18fda957b4d507eff in current term 1: Already voted for candidate dfbbb80ab8e345e0ae1684fafefceccf in this term.
I20260709 13:04:31.380245  9692 raft_consensus.cc:515] T 93877deb770d41a6ba34cefdea146d54 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:31.381307  9689 consensus_queue.cc:1048] T ad58816d959840df923159e870cf4ad8 P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:31.383921  9590 tablet_bootstrap.cc:492] T b31d08e4168243f08eb2a31031a039ed P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:31.384582  9590 ts_tablet_manager.cc:1403] T b31d08e4168243f08eb2a31031a039ed P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.067s	user 0.013s	sys 0.000s
I20260709 13:04:31.386790  9438 leader_election.cc:304] T 225ca60d9645490dbcdcf6d4d127d955 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef5fe58eb3e04ae18fda957b4d507eff; no voters: 932245f14aac417f913cc7330a1833b8, dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:31.388378  9692 leader_election.cc:290] T 93877deb770d41a6ba34cefdea146d54 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Requested vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:31.388881  9642 raft_consensus.cc:3060] T 225ca60d9645490dbcdcf6d4d127d955 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.390750  9591 tablet_bootstrap.cc:492] T 7937a8107df4458ebd48b5ce1589d788 P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:31.391249  9591 ts_tablet_manager.cc:1403] T 7937a8107df4458ebd48b5ce1589d788 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.085s	user 0.008s	sys 0.005s
I20260709 13:04:31.392254  9692 consensus_queue.cc:1048] T 24abd32dde1f44c7af83b9344e632ab0 P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:31.399752  9321 raft_consensus.cc:3060] T 5cfc1f2582a64d8dbc3f127e15024ec0 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.403443  9546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93877deb770d41a6ba34cefdea146d54" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
I20260709 13:04:31.404218  9592 tablet_bootstrap.cc:492] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:31.405148  9546 raft_consensus.cc:3060] T 93877deb770d41a6ba34cefdea146d54 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.407930  9320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93877deb770d41a6ba34cefdea146d54" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8"
I20260709 13:04:31.408579  9320 raft_consensus.cc:3060] T 93877deb770d41a6ba34cefdea146d54 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.389480  9590 raft_consensus.cc:359] T b31d08e4168243f08eb2a31031a039ed P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:31.404018  9591 raft_consensus.cc:359] T 7937a8107df4458ebd48b5ce1589d788 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:31.409257  9590 raft_consensus.cc:385] T b31d08e4168243f08eb2a31031a039ed P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.409392  9591 raft_consensus.cc:385] T 7937a8107df4458ebd48b5ce1589d788 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.409880  9591 raft_consensus.cc:740] T 7937a8107df4458ebd48b5ce1589d788 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.409770  9590 raft_consensus.cc:740] T b31d08e4168243f08eb2a31031a039ed P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.410948  9591 consensus_queue.cc:260] T 7937a8107df4458ebd48b5ce1589d788 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:31.411962  9590 consensus_queue.cc:260] T b31d08e4168243f08eb2a31031a039ed P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:31.413841  9689 raft_consensus.cc:493] T 01a5f4a59c5e47bc8b7b11db44d80006 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.414491  9590 ts_tablet_manager.cc:1434] T b31d08e4168243f08eb2a31031a039ed P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:04:31.414659  9591 ts_tablet_manager.cc:1434] T 7937a8107df4458ebd48b5ce1589d788 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.001s
I20260709 13:04:31.415568  9590 tablet_bootstrap.cc:492] T 01a5f4a59c5e47bc8b7b11db44d80006 P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
I20260709 13:04:31.416010  9591 tablet_bootstrap.cc:492] T b31d08e4168243f08eb2a31031a039ed P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:31.419821  9642 raft_consensus.cc:2749] T 225ca60d9645490dbcdcf6d4d127d955 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:31.405848  9592 ts_tablet_manager.cc:1403] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.111s	user 0.041s	sys 0.025s
I20260709 13:04:31.414538  9689 raft_consensus.cc:515] T 01a5f4a59c5e47bc8b7b11db44d80006 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:31.431744  9689 leader_election.cc:290] T 01a5f4a59c5e47bc8b7b11db44d80006 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:31.432826  9702 consensus_queue.cc:1048] T 24abd32dde1f44c7af83b9344e632ab0 P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:31.433569  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a5f4a59c5e47bc8b7b11db44d80006" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:31.440055  9545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a5f4a59c5e47bc8b7b11db44d80006" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
W20260709 13:04:31.440649  9364 leader_election.cc:343] T 01a5f4a59c5e47bc8b7b11db44d80006 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:31.441593  9364 leader_election.cc:343] T 01a5f4a59c5e47bc8b7b11db44d80006 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.442142  9364 leader_election.cc:304] T 01a5f4a59c5e47bc8b7b11db44d80006 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49; no voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:31.443670  9650 raft_consensus.cc:2749] T 01a5f4a59c5e47bc8b7b11db44d80006 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:31.443804  9593 tablet_bootstrap.cc:492] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:31.445328  9591 tablet_bootstrap.cc:654] T b31d08e4168243f08eb2a31031a039ed P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.445565  9593 ts_tablet_manager.cc:1403] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.110s	user 0.039s	sys 0.000s
I20260709 13:04:31.446812  9592 raft_consensus.cc:359] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:31.447580  9592 raft_consensus.cc:385] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.447851  9592 raft_consensus.cc:740] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.448868  9593 raft_consensus.cc:359] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:31.449821  9593 raft_consensus.cc:385] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.450171  9593 raft_consensus.cc:740] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.451015  9593 consensus_queue.cc:260] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:31.454157  9593 ts_tablet_manager.cc:1434] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:31.448616  9592 consensus_queue.cc:260] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:31.457635  9592 ts_tablet_manager.cc:1434] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 13:04:31.456240  9320 raft_consensus.cc:2468] T 93877deb770d41a6ba34cefdea146d54 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 1.
I20260709 13:04:31.459362  9438 leader_election.cc:304] T 93877deb770d41a6ba34cefdea146d54 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:31.460175  9692 raft_consensus.cc:2804] T 93877deb770d41a6ba34cefdea146d54 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:31.460713  9692 raft_consensus.cc:697] T 93877deb770d41a6ba34cefdea146d54 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Becoming Leader. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Running, Role: LEADER
I20260709 13:04:31.461645  9593 tablet_bootstrap.cc:492] T 63d5c2ea967a4c1586216c60202c5514 P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:31.461632  9692 consensus_queue.cc:237] T 93877deb770d41a6ba34cefdea146d54 P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:31.470294  9593 tablet_bootstrap.cc:654] T 63d5c2ea967a4c1586216c60202c5514 P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.473511  9591 tablet_bootstrap.cc:492] T b31d08e4168243f08eb2a31031a039ed P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:31.473922  9689 raft_consensus.cc:493] T 7937a8107df4458ebd48b5ce1589d788 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.474154  9591 ts_tablet_manager.cc:1403] T b31d08e4168243f08eb2a31031a039ed P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.058s	user 0.013s	sys 0.007s
I20260709 13:04:31.474462  9689 raft_consensus.cc:515] T 7937a8107df4458ebd48b5ce1589d788 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:31.477149  9546 raft_consensus.cc:2468] T 93877deb770d41a6ba34cefdea146d54 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 1.
I20260709 13:04:31.478552  9592 tablet_bootstrap.cc:492] T 01a5f4a59c5e47bc8b7b11db44d80006 P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:31.479116  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7937a8107df4458ebd48b5ce1589d788" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
W20260709 13:04:31.480809  9364 leader_election.cc:343] T 7937a8107df4458ebd48b5ce1589d788 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.476984  9689 leader_election.cc:290] T 7937a8107df4458ebd48b5ce1589d788 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:31.483507  9320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7937a8107df4458ebd48b5ce1589d788" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:31.483626  9591 raft_consensus.cc:359] T b31d08e4168243f08eb2a31031a039ed P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:31.484512  9591 raft_consensus.cc:385] T b31d08e4168243f08eb2a31031a039ed P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.484599  9320 raft_consensus.cc:2468] T 7937a8107df4458ebd48b5ce1589d788 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 0.
I20260709 13:04:31.486066  9364 leader_election.cc:304] T 7937a8107df4458ebd48b5ce1589d788 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, a91e8b10a5984dec9d3777a7275cef49; no voters: ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:31.488171  9590 tablet_bootstrap.cc:654] T 01a5f4a59c5e47bc8b7b11db44d80006 P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.489303  9689 raft_consensus.cc:2804] T 7937a8107df4458ebd48b5ce1589d788 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:31.490062  9689 raft_consensus.cc:493] T 7937a8107df4458ebd48b5ce1589d788 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:31.490477  9689 raft_consensus.cc:3060] T 7937a8107df4458ebd48b5ce1589d788 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.493492  9592 tablet_bootstrap.cc:654] T 01a5f4a59c5e47bc8b7b11db44d80006 P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.498062  9590 tablet_bootstrap.cc:492] T 01a5f4a59c5e47bc8b7b11db44d80006 P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:31.503336  9221 catalog_manager.cc:5697] T 93877deb770d41a6ba34cefdea146d54 P ef5fe58eb3e04ae18fda957b4d507eff reported cstate change: term changed from 0 to 1, leader changed from <none> to ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:31.511684  9590 ts_tablet_manager.cc:1403] T 01a5f4a59c5e47bc8b7b11db44d80006 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.096s	user 0.010s	sys 0.003s
I20260709 13:04:31.515946  9590 raft_consensus.cc:359] T 01a5f4a59c5e47bc8b7b11db44d80006 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:31.516938  9590 raft_consensus.cc:385] T 01a5f4a59c5e47bc8b7b11db44d80006 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.527829  9590 raft_consensus.cc:740] T 01a5f4a59c5e47bc8b7b11db44d80006 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.530026  9590 consensus_queue.cc:260] T 01a5f4a59c5e47bc8b7b11db44d80006 P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:31.540102  9599 consensus_queue.cc:1048] T 225ca60d9645490dbcdcf6d4d127d955 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Connected to new peer: Peer: permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:31.542747  9590 ts_tablet_manager.cc:1434] T 01a5f4a59c5e47bc8b7b11db44d80006 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:04:31.543426  9606 raft_consensus.cc:493] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.543965  9606 raft_consensus.cc:515] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:31.544296  9590 tablet_bootstrap.cc:492] T 9a8ed4502cb447c7b2cb94c96dcb7daf P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
I20260709 13:04:31.545943  9650 raft_consensus.cc:493] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.546401  9606 leader_election.cc:290] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:31.546486  9650 raft_consensus.cc:515] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:31.548337  9395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c1e5b4bc1bc437884e6835b61227d4d" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:31.548781  9650 leader_election.cc:290] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:31.549024  9395 raft_consensus.cc:2468] T 8c1e5b4bc1bc437884e6835b61227d4d P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 0.
I20260709 13:04:31.550731  9287 leader_election.cc:304] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, a91e8b10a5984dec9d3777a7275cef49; no voters: 
I20260709 13:04:31.550776  9546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55798aa4230462f9befe5d7fc9bd3ce" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:31.551604  9546 raft_consensus.cc:2468] T a55798aa4230462f9befe5d7fc9bd3ce P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 0.
I20260709 13:04:31.552892  9364 leader_election.cc:304] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 
I20260709 13:04:31.553202  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c1e5b4bc1bc437884e6835b61227d4d" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:31.554391  9472 raft_consensus.cc:2468] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 0.
I20260709 13:04:31.554819  9322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55798aa4230462f9befe5d7fc9bd3ce" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:31.555536  9650 raft_consensus.cc:2804] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:31.555974  9650 raft_consensus.cc:493] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:31.556380  9650 raft_consensus.cc:3060] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:31.557878  9364 leader_election.cc:343] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.559123  9606 raft_consensus.cc:2804] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:31.559664  9606 raft_consensus.cc:493] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:31.560201  9606 raft_consensus.cc:3060] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.563063  9599 raft_consensus.cc:493] T b31d08e4168243f08eb2a31031a039ed P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.563731  9599 raft_consensus.cc:515] T b31d08e4168243f08eb2a31031a039ed P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:31.567481  9322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31d08e4168243f08eb2a31031a039ed" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:31.567767  9599 leader_election.cc:290] T b31d08e4168243f08eb2a31031a039ed P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:31.569494  9395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31d08e4168243f08eb2a31031a039ed" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:31.570590  9395 raft_consensus.cc:2468] T b31d08e4168243f08eb2a31031a039ed P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 0.
I20260709 13:04:31.572270  9510 leader_election.cc:304] T b31d08e4168243f08eb2a31031a039ed P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 
I20260709 13:04:31.574206  9599 raft_consensus.cc:2804] T b31d08e4168243f08eb2a31031a039ed P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:31.574780  9599 raft_consensus.cc:493] T b31d08e4168243f08eb2a31031a039ed P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:31.575269  9599 raft_consensus.cc:3060] T b31d08e4168243f08eb2a31031a039ed P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.577495  9709 consensus_queue.cc:1048] T 225ca60d9645490dbcdcf6d4d127d955 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:31.484848  9591 raft_consensus.cc:740] T b31d08e4168243f08eb2a31031a039ed P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.586236  9591 consensus_queue.cc:260] T b31d08e4168243f08eb2a31031a039ed P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:31.588058  9322 raft_consensus.cc:2468] T b31d08e4168243f08eb2a31031a039ed P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 0.
I20260709 13:04:31.592991  9591 ts_tablet_manager.cc:1434] T b31d08e4168243f08eb2a31031a039ed P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.119s	user 0.008s	sys 0.000s
I20260709 13:04:31.617502  9591 tablet_bootstrap.cc:492] T a55798aa4230462f9befe5d7fc9bd3ce P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:31.598914  9606 raft_consensus.cc:515] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:31.599364  9599 raft_consensus.cc:515] T b31d08e4168243f08eb2a31031a039ed P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:31.627009  9599 leader_election.cc:290] T b31d08e4168243f08eb2a31031a039ed P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Requested vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:31.627846  9599 raft_consensus.cc:493] T 01a5f4a59c5e47bc8b7b11db44d80006 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.606876  9590 tablet_bootstrap.cc:654] T 9a8ed4502cb447c7b2cb94c96dcb7daf P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.629724  9395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c1e5b4bc1bc437884e6835b61227d4d" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:31.630602  9395 raft_consensus.cc:3060] T 8c1e5b4bc1bc437884e6835b61227d4d P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.634649  9606 leader_election.cc:290] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 election: Requested vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:31.636143  9471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c1e5b4bc1bc437884e6835b61227d4d" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:31.636875  9471 raft_consensus.cc:3060] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.639950  9592 tablet_bootstrap.cc:492] T 01a5f4a59c5e47bc8b7b11db44d80006 P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:31.640556  9592 ts_tablet_manager.cc:1403] T 01a5f4a59c5e47bc8b7b11db44d80006 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.162s	user 0.030s	sys 0.023s
I20260709 13:04:31.643807  9689 raft_consensus.cc:515] T 7937a8107df4458ebd48b5ce1589d788 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:31.628481  9599 raft_consensus.cc:515] T 01a5f4a59c5e47bc8b7b11db44d80006 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:31.647641  9599 leader_election.cc:290] T 01a5f4a59c5e47bc8b7b11db44d80006 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:31.648186  9650 raft_consensus.cc:515] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:31.653779  9650 leader_election.cc:290] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Requested vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:31.654673  9590 tablet_bootstrap.cc:492] T 9a8ed4502cb447c7b2cb94c96dcb7daf P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:31.655480  9546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55798aa4230462f9befe5d7fc9bd3ce" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
I20260709 13:04:31.656716  9546 raft_consensus.cc:3060] T a55798aa4230462f9befe5d7fc9bd3ce P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.661952  9592 raft_consensus.cc:359] T 01a5f4a59c5e47bc8b7b11db44d80006 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:31.663033  9592 raft_consensus.cc:385] T 01a5f4a59c5e47bc8b7b11db44d80006 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.663448  9592 raft_consensus.cc:740] T 01a5f4a59c5e47bc8b7b11db44d80006 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.664395  9592 consensus_queue.cc:260] T 01a5f4a59c5e47bc8b7b11db44d80006 P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:31.655433  9590 ts_tablet_manager.cc:1403] T 9a8ed4502cb447c7b2cb94c96dcb7daf P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.111s	user 0.008s	sys 0.008s
I20260709 13:04:31.666236  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55798aa4230462f9befe5d7fc9bd3ce" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8"
I20260709 13:04:31.666923  9592 ts_tablet_manager.cc:1434] T 01a5f4a59c5e47bc8b7b11db44d80006 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.001s
I20260709 13:04:31.667971  9592 tablet_bootstrap.cc:492] T 7937a8107df4458ebd48b5ce1589d788 P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:31.668202  9590 raft_consensus.cc:359] T 9a8ed4502cb447c7b2cb94c96dcb7daf P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:31.668908  9590 raft_consensus.cc:385] T 9a8ed4502cb447c7b2cb94c96dcb7daf P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.669203  9590 raft_consensus.cc:740] T 9a8ed4502cb447c7b2cb94c96dcb7daf P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.669857  9590 consensus_queue.cc:260] T 9a8ed4502cb447c7b2cb94c96dcb7daf P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
W20260709 13:04:31.672441  9364 leader_election.cc:343] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.673640  9689 leader_election.cc:290] T 7937a8107df4458ebd48b5ce1589d788 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Requested vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:31.674855  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7937a8107df4458ebd48b5ce1589d788" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:31.675928  9592 tablet_bootstrap.cc:654] T 7937a8107df4458ebd48b5ce1589d788 P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.677062  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7937a8107df4458ebd48b5ce1589d788" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8"
I20260709 13:04:31.677814  9323 raft_consensus.cc:3060] T 7937a8107df4458ebd48b5ce1589d788 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.679502  9590 ts_tablet_manager.cc:1434] T 9a8ed4502cb447c7b2cb94c96dcb7daf P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:04:31.675925  9591 tablet_bootstrap.cc:654] T a55798aa4230462f9befe5d7fc9bd3ce P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.695245  9593 tablet_bootstrap.cc:492] T 63d5c2ea967a4c1586216c60202c5514 P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:31.696054  9593 ts_tablet_manager.cc:1403] T 63d5c2ea967a4c1586216c60202c5514 P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.238s	user 0.058s	sys 0.136s
I20260709 13:04:31.690742  9323 raft_consensus.cc:2468] T 7937a8107df4458ebd48b5ce1589d788 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 1.
W20260709 13:04:31.686772  9364 leader_election.cc:343] T 7937a8107df4458ebd48b5ce1589d788 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.698623  9364 leader_election.cc:304] T 7937a8107df4458ebd48b5ce1589d788 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, a91e8b10a5984dec9d3777a7275cef49; no voters: ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:31.700243  9689 raft_consensus.cc:2804] T 7937a8107df4458ebd48b5ce1589d788 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:31.701481  9546 raft_consensus.cc:2468] T a55798aa4230462f9befe5d7fc9bd3ce P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 1.
I20260709 13:04:31.702147  9689 raft_consensus.cc:697] T 7937a8107df4458ebd48b5ce1589d788 P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Becoming Leader. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Running, Role: LEADER
I20260709 13:04:31.703994  9590 tablet_bootstrap.cc:492] T faf56b218e614e51962171088f3c4f63 P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
W20260709 13:04:31.683813  9512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38559, user_credentials={real_user=slave}} blocked reactor thread for 62670.2us
I20260709 13:04:31.709652  9395 raft_consensus.cc:2468] T 8c1e5b4bc1bc437884e6835b61227d4d P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 1.
I20260709 13:04:31.690899  9471 raft_consensus.cc:2468] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 1.
I20260709 13:04:31.710609  9689 consensus_queue.cc:237] T 7937a8107df4458ebd48b5ce1589d788 P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:31.713340  9364 leader_election.cc:304] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 932245f14aac417f913cc7330a1833b8
I20260709 13:04:31.714815  9650 raft_consensus.cc:2804] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:31.715576  9650 raft_consensus.cc:697] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Becoming Leader. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Running, Role: LEADER
I20260709 13:04:31.717355  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a5f4a59c5e47bc8b7b11db44d80006" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:31.718148  9472 raft_consensus.cc:2468] T 01a5f4a59c5e47bc8b7b11db44d80006 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 0.
I20260709 13:04:31.716768  9650 consensus_queue.cc:237] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:31.722119  9692 raft_consensus.cc:493] T 331d1446396c45ce9486793ecb5de7f7 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.725741  9692 raft_consensus.cc:515] T 331d1446396c45ce9486793ecb5de7f7 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:31.729241  9692 leader_election.cc:290] T 331d1446396c45ce9486793ecb5de7f7 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:31.726616  9289 leader_election.cc:304] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:31.733117  9398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a5f4a59c5e47bc8b7b11db44d80006" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:31.733966  9398 raft_consensus.cc:2468] T 01a5f4a59c5e47bc8b7b11db44d80006 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 0.
I20260709 13:04:31.733186  9606 raft_consensus.cc:2804] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:31.735595  9606 raft_consensus.cc:697] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [term 1 LEADER]: Becoming Leader. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Running, Role: LEADER
I20260709 13:04:31.736492  9606 consensus_queue.cc:237] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:31.733345  9692 consensus_queue.cc:1048] T 73b8fed487d54513b9256d4c1a39cfa0 P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:04:31.733351  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "331d1446396c45ce9486793ecb5de7f7" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:31.739789  9593 raft_consensus.cc:359] T 63d5c2ea967a4c1586216c60202c5514 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:31.742405  9321 raft_consensus.cc:2393] T 331d1446396c45ce9486793ecb5de7f7 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef5fe58eb3e04ae18fda957b4d507eff in current term 1: Already voted for candidate dfbbb80ab8e345e0ae1684fafefceccf in this term.
I20260709 13:04:31.742611  9593 raft_consensus.cc:385] T 63d5c2ea967a4c1586216c60202c5514 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.742954  9593 raft_consensus.cc:740] T 63d5c2ea967a4c1586216c60202c5514 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.739127  9395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31d08e4168243f08eb2a31031a039ed" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:31.746709  9593 consensus_queue.cc:260] T 63d5c2ea967a4c1586216c60202c5514 P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:31.747499  9591 tablet_bootstrap.cc:492] T a55798aa4230462f9befe5d7fc9bd3ce P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:31.748230  9591 ts_tablet_manager.cc:1403] T a55798aa4230462f9befe5d7fc9bd3ce P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.131s	user 0.013s	sys 0.003s
I20260709 13:04:31.748135  9691 raft_consensus.cc:493] T faf56b218e614e51962171088f3c4f63 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.747745  9395 raft_consensus.cc:3060] T b31d08e4168243f08eb2a31031a039ed P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.740345  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31d08e4168243f08eb2a31031a039ed" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8"
I20260709 13:04:31.748304  9703 raft_consensus.cc:493] T 73b8fed487d54513b9256d4c1a39cfa0 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.759111  9703 raft_consensus.cc:515] T 73b8fed487d54513b9256d4c1a39cfa0 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:31.761597  9703 leader_election.cc:290] T 73b8fed487d54513b9256d4c1a39cfa0 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:31.749364  9691 raft_consensus.cc:515] T faf56b218e614e51962171088f3c4f63 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:31.762846  9470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b8fed487d54513b9256d4c1a39cfa0" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:31.763398  9592 tablet_bootstrap.cc:492] T 7937a8107df4458ebd48b5ce1589d788 P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:31.763875  9592 ts_tablet_manager.cc:1403] T 7937a8107df4458ebd48b5ce1589d788 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.096s	user 0.031s	sys 0.014s
I20260709 13:04:31.763584  9591 raft_consensus.cc:359] T a55798aa4230462f9befe5d7fc9bd3ce P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:31.764340  9591 raft_consensus.cc:385] T a55798aa4230462f9befe5d7fc9bd3ce P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.764642  9591 raft_consensus.cc:740] T a55798aa4230462f9befe5d7fc9bd3ce P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.768426  9593 ts_tablet_manager.cc:1434] T 63d5c2ea967a4c1586216c60202c5514 P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.072s	user 0.008s	sys 0.002s
I20260709 13:04:31.766597  9591 consensus_queue.cc:260] T a55798aa4230462f9befe5d7fc9bd3ce P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:31.769901  9593 tablet_bootstrap.cc:492] T b94916f0e1e340a38f4a100f451fdaba P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:31.742405  9510 leader_election.cc:304] T 01a5f4a59c5e47bc8b7b11db44d80006 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 
I20260709 13:04:31.776718  9397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b8fed487d54513b9256d4c1a39cfa0" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:31.777477  9599 raft_consensus.cc:2804] T 01a5f4a59c5e47bc8b7b11db44d80006 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:31.778033  9599 raft_consensus.cc:493] T 01a5f4a59c5e47bc8b7b11db44d80006 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:31.778335  9691 leader_election.cc:290] T faf56b218e614e51962171088f3c4f63 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:31.778412  9599 raft_consensus.cc:3060] T 01a5f4a59c5e47bc8b7b11db44d80006 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.767102  9323 raft_consensus.cc:3060] T b31d08e4168243f08eb2a31031a039ed P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.782193  9591 ts_tablet_manager.cc:1434] T a55798aa4230462f9befe5d7fc9bd3ce P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.002s
I20260709 13:04:31.784189  9591 tablet_bootstrap.cc:492] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:31.797348  9470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf56b218e614e51962171088f3c4f63" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:31.798671  9544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf56b218e614e51962171088f3c4f63" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
W20260709 13:04:31.799261  9364 leader_election.cc:343] T faf56b218e614e51962171088f3c4f63 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.794785  9546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "331d1446396c45ce9486793ecb5de7f7" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:31.793289  9689 raft_consensus.cc:493] T 63d5c2ea967a4c1586216c60202c5514 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:31.801697  9364 leader_election.cc:343] T faf56b218e614e51962171088f3c4f63 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.804097  9364 leader_election.cc:304] T faf56b218e614e51962171088f3c4f63 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49; no voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:31.805325  9691 raft_consensus.cc:2749] T faf56b218e614e51962171088f3c4f63 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:31.807957  9438 leader_election.cc:304] T 331d1446396c45ce9486793ecb5de7f7 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef5fe58eb3e04ae18fda957b4d507eff; no voters: 932245f14aac417f913cc7330a1833b8, dfbbb80ab8e345e0ae1684fafefceccf
W20260709 13:04:31.799654  9512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38559, user_credentials={real_user=slave}} blocked reactor thread for 53528.8us
I20260709 13:04:31.809264  9642 raft_consensus.cc:3060] T 331d1446396c45ce9486793ecb5de7f7 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.809448  9592 raft_consensus.cc:359] T 7937a8107df4458ebd48b5ce1589d788 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:31.810384  9592 raft_consensus.cc:385] T 7937a8107df4458ebd48b5ce1589d788 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.810719  9592 raft_consensus.cc:740] T 7937a8107df4458ebd48b5ce1589d788 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.811056  9709 consensus_queue.cc:1048] T 331d1446396c45ce9486793ecb5de7f7 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Connected to new peer: Peer: permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:31.813614  9592 consensus_queue.cc:260] T 7937a8107df4458ebd48b5ce1589d788 P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:31.815070  9599 raft_consensus.cc:515] T 01a5f4a59c5e47bc8b7b11db44d80006 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:31.807934  9689 raft_consensus.cc:515] T 63d5c2ea967a4c1586216c60202c5514 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:31.827647  9689 leader_election.cc:290] T 63d5c2ea967a4c1586216c60202c5514 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:31.819387  9599 leader_election.cc:290] T 01a5f4a59c5e47bc8b7b11db44d80006 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Requested vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:31.819777  9397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a5f4a59c5e47bc8b7b11db44d80006" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:31.821316  9590 tablet_bootstrap.cc:654] T faf56b218e614e51962171088f3c4f63 P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.829591  9397 raft_consensus.cc:3060] T 01a5f4a59c5e47bc8b7b11db44d80006 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.829802  9593 tablet_bootstrap.cc:654] T b94916f0e1e340a38f4a100f451fdaba P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.821663  9592 ts_tablet_manager.cc:1434] T 7937a8107df4458ebd48b5ce1589d788 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.057s	user 0.010s	sys 0.000s
I20260709 13:04:31.833237  9592 tablet_bootstrap.cc:492] T faf56b218e614e51962171088f3c4f63 P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:31.824266  9642 raft_consensus.cc:2749] T 331d1446396c45ce9486793ecb5de7f7 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:31.829190  9591 tablet_bootstrap.cc:654] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.883675  9287 leader_election.cc:304] T 73b8fed487d54513b9256d4c1a39cfa0 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 932245f14aac417f913cc7330a1833b8; no voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff
W20260709 13:04:31.887799  9287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33607, user_credentials={real_user=slave}} blocked reactor thread for 109164us
I20260709 13:04:31.892895  9322 raft_consensus.cc:3060] T 73b8fed487d54513b9256d4c1a39cfa0 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.824468  9471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a5f4a59c5e47bc8b7b11db44d80006" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:31.915050  9746 raft_consensus.cc:493] T a55798aa4230462f9befe5d7fc9bd3ce P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.927141  9471 raft_consensus.cc:3060] T 01a5f4a59c5e47bc8b7b11db44d80006 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.926240  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5c2ea967a4c1586216c60202c5514" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:31.927024  9746 raft_consensus.cc:515] T a55798aa4230462f9befe5d7fc9bd3ce P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
W20260709 13:04:31.930238  9364 leader_election.cc:343] T 63d5c2ea967a4c1586216c60202c5514 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.931396  9746 leader_election.cc:290] T a55798aa4230462f9befe5d7fc9bd3ce P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:31.915462  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5c2ea967a4c1586216c60202c5514" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:31.937251  9546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55798aa4230462f9befe5d7fc9bd3ce" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:31.938553  9546 raft_consensus.cc:2393] T a55798aa4230462f9befe5d7fc9bd3ce P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 932245f14aac417f913cc7330a1833b8 in current term 1: Already voted for candidate a91e8b10a5984dec9d3777a7275cef49 in this term.
I20260709 13:04:31.939642  9590 tablet_bootstrap.cc:492] T faf56b218e614e51962171088f3c4f63 P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:31.970093  9590 ts_tablet_manager.cc:1403] T faf56b218e614e51962171088f3c4f63 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.266s	user 0.012s	sys 0.004s
I20260709 13:04:31.971385  9471 raft_consensus.cc:2468] T 01a5f4a59c5e47bc8b7b11db44d80006 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 1.
I20260709 13:04:31.951750  9692 raft_consensus.cc:493] T 7937a8107df4458ebd48b5ce1589d788 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.974205  9692 raft_consensus.cc:515] T 7937a8107df4458ebd48b5ce1589d788 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
W20260709 13:04:31.974664  9364 leader_election.cc:343] T 63d5c2ea967a4c1586216c60202c5514 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.975399  9364 leader_election.cc:304] T 63d5c2ea967a4c1586216c60202c5514 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49; no voters: 932245f14aac417f913cc7330a1833b8, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:31.976886  9687 raft_consensus.cc:2749] T 63d5c2ea967a4c1586216c60202c5514 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:31.946755  9642 consensus_queue.cc:1048] T 93877deb770d41a6ba34cefdea146d54 P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Connected to new peer: Peer: permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 13:04:31.960819  9599 consensus_queue.cc:1048] T 331d1446396c45ce9486793ecb5de7f7 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:04:31.987646  9692 leader_election.cc:290] T 7937a8107df4458ebd48b5ce1589d788 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:31.988155  9219 catalog_manager.cc:5697] T 7937a8107df4458ebd48b5ce1589d788 P a91e8b10a5984dec9d3777a7275cef49 reported cstate change: term changed from 0 to 1, leader changed from <none> to a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "a91e8b10a5984dec9d3777a7275cef49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:31.990113  9592 tablet_bootstrap.cc:654] T faf56b218e614e51962171088f3c4f63 P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.005858  9512 leader_election.cc:304] T 01a5f4a59c5e47bc8b7b11db44d80006 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:32.006500  9396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55798aa4230462f9befe5d7fc9bd3ce" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:32.007330  9599 raft_consensus.cc:2804] T 01a5f4a59c5e47bc8b7b11db44d80006 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:32.008041  9599 raft_consensus.cc:697] T 01a5f4a59c5e47bc8b7b11db44d80006 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Becoming Leader. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Running, Role: LEADER
I20260709 13:04:32.008737  9323 raft_consensus.cc:2468] T b31d08e4168243f08eb2a31031a039ed P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 1.
I20260709 13:04:32.009899  9217 catalog_manager.cc:5697] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 932245f14aac417f913cc7330a1833b8 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "932245f14aac417f913cc7330a1833b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:32.013743  9599 consensus_queue.cc:237] T 01a5f4a59c5e47bc8b7b11db44d80006 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:32.002128  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7937a8107df4458ebd48b5ce1589d788" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:32.038633  9593 tablet_bootstrap.cc:492] T b94916f0e1e340a38f4a100f451fdaba P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:32.037848  9396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7937a8107df4458ebd48b5ce1589d788" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:32.041500  9606 raft_consensus.cc:2749] T 73b8fed487d54513b9256d4c1a39cfa0 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:32.040668  9590 raft_consensus.cc:359] T faf56b218e614e51962171088f3c4f63 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:32.042747  9590 raft_consensus.cc:385] T faf56b218e614e51962171088f3c4f63 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.043085  9590 raft_consensus.cc:740] T faf56b218e614e51962171088f3c4f63 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.044270  9512 leader_election.cc:304] T b31d08e4168243f08eb2a31031a039ed P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 
I20260709 13:04:32.044124  9590 consensus_queue.cc:260] T faf56b218e614e51962171088f3c4f63 P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:32.044482  9755 consensus_queue.cc:1048] T 73b8fed487d54513b9256d4c1a39cfa0 P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Connected to new peer: Peer: permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:32.045819  9739 raft_consensus.cc:2804] T b31d08e4168243f08eb2a31031a039ed P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:32.046057  9593 ts_tablet_manager.cc:1403] T b94916f0e1e340a38f4a100f451fdaba P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.277s	user 0.011s	sys 0.009s
I20260709 13:04:32.047092  9739 raft_consensus.cc:697] T b31d08e4168243f08eb2a31031a039ed P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Becoming Leader. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Running, Role: LEADER
I20260709 13:04:32.048779  9739 consensus_queue.cc:237] T b31d08e4168243f08eb2a31031a039ed P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:32.038223  9321 raft_consensus.cc:2393] T 7937a8107df4458ebd48b5ce1589d788 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef5fe58eb3e04ae18fda957b4d507eff in current term 1: Already voted for candidate a91e8b10a5984dec9d3777a7275cef49 in this term.
I20260709 13:04:32.032387  9287 leader_election.cc:304] T a55798aa4230462f9befe5d7fc9bd3ce P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 932245f14aac417f913cc7330a1833b8; no voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:32.055536  9606 raft_consensus.cc:3060] T a55798aa4230462f9befe5d7fc9bd3ce P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.055941  9395 raft_consensus.cc:2468] T b31d08e4168243f08eb2a31031a039ed P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 1.
I20260709 13:04:32.056595  9591 tablet_bootstrap.cc:492] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:32.057420  9591 ts_tablet_manager.cc:1403] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.274s	user 0.020s	sys 0.010s
I20260709 13:04:32.059620  9590 ts_tablet_manager.cc:1434] T faf56b218e614e51962171088f3c4f63 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.089s	user 0.005s	sys 0.004s
I20260709 13:04:32.061303  9590 tablet_bootstrap.cc:492] T b94916f0e1e340a38f4a100f451fdaba P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
I20260709 13:04:32.061894  9438 leader_election.cc:304] T 7937a8107df4458ebd48b5ce1589d788 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef5fe58eb3e04ae18fda957b4d507eff; no voters: 932245f14aac417f913cc7330a1833b8, a91e8b10a5984dec9d3777a7275cef49
I20260709 13:04:32.063548  9755 raft_consensus.cc:3060] T 7937a8107df4458ebd48b5ce1589d788 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.052381  9593 raft_consensus.cc:359] T b94916f0e1e340a38f4a100f451fdaba P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:32.067229  9593 raft_consensus.cc:385] T b94916f0e1e340a38f4a100f451fdaba P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.068743  9593 raft_consensus.cc:740] T b94916f0e1e340a38f4a100f451fdaba P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.100937  9593 consensus_queue.cc:260] T b94916f0e1e340a38f4a100f451fdaba P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:32.108963  9590 tablet_bootstrap.cc:654] T b94916f0e1e340a38f4a100f451fdaba P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.116616  9765 raft_consensus.cc:493] T 9a8ed4502cb447c7b2cb94c96dcb7daf P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.122256  9765 raft_consensus.cc:515] T 9a8ed4502cb447c7b2cb94c96dcb7daf P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:32.139462  9591 raft_consensus.cc:359] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:32.140405  9591 raft_consensus.cc:385] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.140763  9591 raft_consensus.cc:740] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.142894  9593 ts_tablet_manager.cc:1434] T b94916f0e1e340a38f4a100f451fdaba P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.096s	user 0.004s	sys 0.004s
I20260709 13:04:32.144552  9593 tablet_bootstrap.cc:492] T 85d647b0abf74fbebc7e9a9bfe14b8ea P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:32.146919  9765 leader_election.cc:290] T 9a8ed4502cb447c7b2cb94c96dcb7daf P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:32.117336  9397 raft_consensus.cc:2468] T 01a5f4a59c5e47bc8b7b11db44d80006 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 1.
I20260709 13:04:32.114563  9221 catalog_manager.cc:5697] T 01a5f4a59c5e47bc8b7b11db44d80006 P dfbbb80ab8e345e0ae1684fafefceccf reported cstate change: term changed from 0 to 1, leader changed from <none> to dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196). New cstate: current_term: 1 leader_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:32.150660  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8ed4502cb447c7b2cb94c96dcb7daf" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:32.151316  9702 consensus_queue.cc:1048] T 93877deb770d41a6ba34cefdea146d54 P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:32.154605  9592 tablet_bootstrap.cc:492] T faf56b218e614e51962171088f3c4f63 P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:32.155629  9592 ts_tablet_manager.cc:1403] T faf56b218e614e51962171088f3c4f63 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.323s	user 0.015s	sys 0.017s
W20260709 13:04:32.156543  9512 leader_election.cc:343] T 9a8ed4502cb447c7b2cb94c96dcb7daf P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.159631  9592 raft_consensus.cc:359] T faf56b218e614e51962171088f3c4f63 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:32.160601  9592 raft_consensus.cc:385] T faf56b218e614e51962171088f3c4f63 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.161286  9755 raft_consensus.cc:2749] T 7937a8107df4458ebd48b5ce1589d788 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:32.160928  9592 raft_consensus.cc:740] T faf56b218e614e51962171088f3c4f63 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.153234  9606 raft_consensus.cc:2749] T a55798aa4230462f9befe5d7fc9bd3ce P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:32.172582  9762 log.cc:927] Time spent T 01a5f4a59c5e47bc8b7b11db44d80006 P dfbbb80ab8e345e0ae1684fafefceccf: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:04:32.173770  9591 consensus_queue.cc:260] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:32.167431  9471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8ed4502cb447c7b2cb94c96dcb7daf" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:32.176409  9591 ts_tablet_manager.cc:1434] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.119s	user 0.007s	sys 0.001s
I20260709 13:04:32.177784  9591 tablet_bootstrap.cc:492] T 9a8ed4502cb447c7b2cb94c96dcb7daf P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
W20260709 13:04:32.178808  9512 leader_election.cc:343] T 9a8ed4502cb447c7b2cb94c96dcb7daf P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.187791  9591 tablet_bootstrap.cc:654] T 9a8ed4502cb447c7b2cb94c96dcb7daf P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.190243  9593 tablet_bootstrap.cc:654] T 85d647b0abf74fbebc7e9a9bfe14b8ea P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.192735  9590 tablet_bootstrap.cc:492] T b94916f0e1e340a38f4a100f451fdaba P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:32.193497  9590 ts_tablet_manager.cc:1403] T b94916f0e1e340a38f4a100f451fdaba P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.133s	user 0.026s	sys 0.003s
I20260709 13:04:32.179327  9512 leader_election.cc:304] T 9a8ed4502cb447c7b2cb94c96dcb7daf P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf; no voters: 932245f14aac417f913cc7330a1833b8, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:32.196595  9739 raft_consensus.cc:2749] T 9a8ed4502cb447c7b2cb94c96dcb7daf P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:32.168157  9592 consensus_queue.cc:260] T faf56b218e614e51962171088f3c4f63 P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:32.205116  9592 ts_tablet_manager.cc:1434] T faf56b218e614e51962171088f3c4f63 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.003s
I20260709 13:04:32.206444  9592 tablet_bootstrap.cc:492] T 9a8ed4502cb447c7b2cb94c96dcb7daf P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:32.206760  9590 raft_consensus.cc:359] T b94916f0e1e340a38f4a100f451fdaba P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:32.210242  9590 raft_consensus.cc:385] T b94916f0e1e340a38f4a100f451fdaba P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.210863  9590 raft_consensus.cc:740] T b94916f0e1e340a38f4a100f451fdaba P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.211833  9590 consensus_queue.cc:260] T b94916f0e1e340a38f4a100f451fdaba P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:32.209676  9593 tablet_bootstrap.cc:492] T 85d647b0abf74fbebc7e9a9bfe14b8ea P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:32.213188  9593 ts_tablet_manager.cc:1403] T 85d647b0abf74fbebc7e9a9bfe14b8ea P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.069s	user 0.009s	sys 0.006s
I20260709 13:04:32.214303  9592 tablet_bootstrap.cc:654] T 9a8ed4502cb447c7b2cb94c96dcb7daf P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.215034  9591 tablet_bootstrap.cc:492] T 9a8ed4502cb447c7b2cb94c96dcb7daf P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:32.215662  9591 ts_tablet_manager.cc:1403] T 9a8ed4502cb447c7b2cb94c96dcb7daf P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.008s
I20260709 13:04:32.216843  9593 raft_consensus.cc:359] T 85d647b0abf74fbebc7e9a9bfe14b8ea P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:32.219892  9591 raft_consensus.cc:359] T 9a8ed4502cb447c7b2cb94c96dcb7daf P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:32.220992  9591 raft_consensus.cc:385] T 9a8ed4502cb447c7b2cb94c96dcb7daf P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.220953  9593 raft_consensus.cc:385] T 85d647b0abf74fbebc7e9a9bfe14b8ea P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.222090  9593 raft_consensus.cc:740] T 85d647b0abf74fbebc7e9a9bfe14b8ea P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.223320  9593 consensus_queue.cc:260] T 85d647b0abf74fbebc7e9a9bfe14b8ea P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:32.221125  9590 ts_tablet_manager.cc:1434] T b94916f0e1e340a38f4a100f451fdaba P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.003s
I20260709 13:04:32.226837  9590 tablet_bootstrap.cc:492] T 17d57808c20741cd85b0e175935cdab7 P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
I20260709 13:04:32.221401  9591 raft_consensus.cc:740] T 9a8ed4502cb447c7b2cb94c96dcb7daf P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.229691  9591 consensus_queue.cc:260] T 9a8ed4502cb447c7b2cb94c96dcb7daf P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
W20260709 13:04:32.230299  9268 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:32.231256  9593 ts_tablet_manager.cc:1434] T 85d647b0abf74fbebc7e9a9bfe14b8ea P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:04:32.232347  9591 ts_tablet_manager.cc:1434] T 9a8ed4502cb447c7b2cb94c96dcb7daf P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:04:32.227888  9592 tablet_bootstrap.cc:492] T 9a8ed4502cb447c7b2cb94c96dcb7daf P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:32.233100  9592 ts_tablet_manager.cc:1403] T 9a8ed4502cb447c7b2cb94c96dcb7daf P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.005s
I20260709 13:04:32.236596  9592 raft_consensus.cc:359] T 9a8ed4502cb447c7b2cb94c96dcb7daf P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:32.237426  9592 raft_consensus.cc:385] T 9a8ed4502cb447c7b2cb94c96dcb7daf P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.237959  9592 raft_consensus.cc:740] T 9a8ed4502cb447c7b2cb94c96dcb7daf P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.238976  9590 tablet_bootstrap.cc:654] T 17d57808c20741cd85b0e175935cdab7 P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.238636  9592 consensus_queue.cc:260] T 9a8ed4502cb447c7b2cb94c96dcb7daf P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:32.232707  9593 tablet_bootstrap.cc:492] T ab069642e354446db85dabd0cedd7eec P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:32.241029  9592 ts_tablet_manager.cc:1434] T 9a8ed4502cb447c7b2cb94c96dcb7daf P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:04:32.242372  9592 tablet_bootstrap.cc:492] T 17d57808c20741cd85b0e175935cdab7 P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:32.240391  9218 catalog_manager.cc:5697] T b31d08e4168243f08eb2a31031a039ed P dfbbb80ab8e345e0ae1684fafefceccf reported cstate change: term changed from 0 to 1, leader changed from <none> to dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196). New cstate: current_term: 1 leader_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:32.245366  9217 catalog_manager.cc:5697] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49 reported cstate change: term changed from 0 to 1, leader changed from <none> to a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "a91e8b10a5984dec9d3777a7275cef49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:32.249414  9592 tablet_bootstrap.cc:654] T 17d57808c20741cd85b0e175935cdab7 P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.253122  9606 consensus_queue.cc:1048] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:32.255674  9687 consensus_queue.cc:1048] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:32.267251  9606 consensus_queue.cc:1048] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:32.274097  9593 tablet_bootstrap.cc:654] T ab069642e354446db85dabd0cedd7eec P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.275888  9650 consensus_queue.cc:1048] T 7937a8107df4458ebd48b5ce1589d788 P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:32.291251  9591 tablet_bootstrap.cc:492] T 17d57808c20741cd85b0e175935cdab7 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:32.297662  9592 tablet_bootstrap.cc:492] T 17d57808c20741cd85b0e175935cdab7 P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:32.298417  9592 ts_tablet_manager.cc:1403] T 17d57808c20741cd85b0e175935cdab7 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.007s
I20260709 13:04:32.293619  9590 tablet_bootstrap.cc:492] T 17d57808c20741cd85b0e175935cdab7 P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:32.301721  9590 ts_tablet_manager.cc:1403] T 17d57808c20741cd85b0e175935cdab7 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.076s	user 0.020s	sys 0.000s
I20260709 13:04:32.304387  9650 consensus_queue.cc:1048] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:32.313493  9590 raft_consensus.cc:359] T 17d57808c20741cd85b0e175935cdab7 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:32.314651  9590 raft_consensus.cc:385] T 17d57808c20741cd85b0e175935cdab7 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.315009  9590 raft_consensus.cc:740] T 17d57808c20741cd85b0e175935cdab7 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.316372  9593 tablet_bootstrap.cc:492] T ab069642e354446db85dabd0cedd7eec P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:32.316012  9590 consensus_queue.cc:260] T 17d57808c20741cd85b0e175935cdab7 P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:32.317147  9593 ts_tablet_manager.cc:1403] T ab069642e354446db85dabd0cedd7eec P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.085s	user 0.028s	sys 0.039s
I20260709 13:04:32.318179  9592 raft_consensus.cc:359] T 17d57808c20741cd85b0e175935cdab7 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:32.322335  9592 raft_consensus.cc:385] T 17d57808c20741cd85b0e175935cdab7 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.322606  9592 raft_consensus.cc:740] T 17d57808c20741cd85b0e175935cdab7 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.323913  9606 raft_consensus.cc:493] T 9a8ed4502cb447c7b2cb94c96dcb7daf P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.325588  9606 raft_consensus.cc:515] T 9a8ed4502cb447c7b2cb94c96dcb7daf P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:32.327111  9593 raft_consensus.cc:359] T ab069642e354446db85dabd0cedd7eec P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:32.327967  9606 leader_election.cc:290] T 9a8ed4502cb447c7b2cb94c96dcb7daf P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:32.328020  9593 raft_consensus.cc:385] T ab069642e354446db85dabd0cedd7eec P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.329643  9593 raft_consensus.cc:740] T ab069642e354446db85dabd0cedd7eec P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.330741  9592 consensus_queue.cc:260] T 17d57808c20741cd85b0e175935cdab7 P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:32.330921  9593 consensus_queue.cc:260] T ab069642e354446db85dabd0cedd7eec P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:32.333349  9592 ts_tablet_manager.cc:1434] T 17d57808c20741cd85b0e175935cdab7 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.001s
I20260709 13:04:32.334749  9592 tablet_bootstrap.cc:492] T 63d5c2ea967a4c1586216c60202c5514 P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:32.336802  9544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8ed4502cb447c7b2cb94c96dcb7daf" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:32.337679  9544 raft_consensus.cc:2468] T 9a8ed4502cb447c7b2cb94c96dcb7daf P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 0.
I20260709 13:04:32.337492  9687 consensus_queue.cc:1048] T 7937a8107df4458ebd48b5ce1589d788 P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:32.340220  9591 tablet_bootstrap.cc:654] T 17d57808c20741cd85b0e175935cdab7 P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.340407  9289 leader_election.cc:304] T 9a8ed4502cb447c7b2cb94c96dcb7daf P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 
I20260709 13:04:32.345376  9746 raft_consensus.cc:2804] T 9a8ed4502cb447c7b2cb94c96dcb7daf P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:32.345916  9746 raft_consensus.cc:493] T 9a8ed4502cb447c7b2cb94c96dcb7daf P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.346263  9746 raft_consensus.cc:3060] T 9a8ed4502cb447c7b2cb94c96dcb7daf P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.349895  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8ed4502cb447c7b2cb94c96dcb7daf" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:32.350728  9472 raft_consensus.cc:2468] T 9a8ed4502cb447c7b2cb94c96dcb7daf P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 0.
I20260709 13:04:32.357316  9593 ts_tablet_manager.cc:1434] T ab069642e354446db85dabd0cedd7eec P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.002s
I20260709 13:04:32.358714  9593 tablet_bootstrap.cc:492] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:32.370108  9746 raft_consensus.cc:515] T 9a8ed4502cb447c7b2cb94c96dcb7daf P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:32.373760  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8ed4502cb447c7b2cb94c96dcb7daf" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:32.374539  9472 raft_consensus.cc:3060] T 9a8ed4502cb447c7b2cb94c96dcb7daf P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.378054  9590 ts_tablet_manager.cc:1434] T 17d57808c20741cd85b0e175935cdab7 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.076s	user 0.009s	sys 0.000s
I20260709 13:04:32.379145  9592 tablet_bootstrap.cc:654] T 63d5c2ea967a4c1586216c60202c5514 P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.379309  9590 tablet_bootstrap.cc:492] T 774befa616254c02901f28edde6ab758 P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
I20260709 13:04:32.383414  9739 raft_consensus.cc:493] T 17d57808c20741cd85b0e175935cdab7 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.384004  9739 raft_consensus.cc:515] T 17d57808c20741cd85b0e175935cdab7 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:32.386727  9739 leader_election.cc:290] T 17d57808c20741cd85b0e175935cdab7 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:32.387208  9590 tablet_bootstrap.cc:654] T 774befa616254c02901f28edde6ab758 P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.385906  9746 leader_election.cc:290] T 9a8ed4502cb447c7b2cb94c96dcb7daf P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 election: Requested vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:32.388291  9470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d57808c20741cd85b0e175935cdab7" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:32.389516  9470 raft_consensus.cc:2468] T 17d57808c20741cd85b0e175935cdab7 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 0.
I20260709 13:04:32.389622  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d57808c20741cd85b0e175935cdab7" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:32.391252  9512 leader_election.cc:304] T 17d57808c20741cd85b0e175935cdab7 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:32.392169  9739 raft_consensus.cc:2804] T 17d57808c20741cd85b0e175935cdab7 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:04:32.392335  9512 leader_election.cc:343] T 17d57808c20741cd85b0e175935cdab7 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.392633  9739 raft_consensus.cc:493] T 17d57808c20741cd85b0e175935cdab7 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.396701  9544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8ed4502cb447c7b2cb94c96dcb7daf" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
I20260709 13:04:32.397416  9544 raft_consensus.cc:3060] T 9a8ed4502cb447c7b2cb94c96dcb7daf P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.402458  9593 tablet_bootstrap.cc:654] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.406042  9692 raft_consensus.cc:493] T faf56b218e614e51962171088f3c4f63 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.395190  9739 raft_consensus.cc:3060] T 17d57808c20741cd85b0e175935cdab7 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.406633  9692 raft_consensus.cc:515] T faf56b218e614e51962171088f3c4f63 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:32.409221  9692 leader_election.cc:290] T faf56b218e614e51962171088f3c4f63 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:32.411437  9397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf56b218e614e51962171088f3c4f63" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:32.412210  9397 raft_consensus.cc:2468] T faf56b218e614e51962171088f3c4f63 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 0.
I20260709 13:04:32.413858  9546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf56b218e614e51962171088f3c4f63" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:32.415275  9436 leader_election.cc:304] T faf56b218e614e51962171088f3c4f63 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:32.414635  9546 raft_consensus.cc:2468] T faf56b218e614e51962171088f3c4f63 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 0.
I20260709 13:04:32.418534  9692 raft_consensus.cc:2804] T faf56b218e614e51962171088f3c4f63 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:32.418936  9692 raft_consensus.cc:493] T faf56b218e614e51962171088f3c4f63 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.419310  9692 raft_consensus.cc:3060] T faf56b218e614e51962171088f3c4f63 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.419551  9591 tablet_bootstrap.cc:492] T 17d57808c20741cd85b0e175935cdab7 P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:32.420213  9591 ts_tablet_manager.cc:1403] T 17d57808c20741cd85b0e175935cdab7 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.129s	user 0.004s	sys 0.015s
I20260709 13:04:32.423328  9591 raft_consensus.cc:359] T 17d57808c20741cd85b0e175935cdab7 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:32.424304  9544 raft_consensus.cc:2468] T 9a8ed4502cb447c7b2cb94c96dcb7daf P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 1.
I20260709 13:04:32.425516  9591 raft_consensus.cc:385] T 17d57808c20741cd85b0e175935cdab7 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.426110  9591 raft_consensus.cc:740] T 17d57808c20741cd85b0e175935cdab7 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.426550  9289 leader_election.cc:304] T 9a8ed4502cb447c7b2cb94c96dcb7daf P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 
I20260709 13:04:32.426836  9591 consensus_queue.cc:260] T 17d57808c20741cd85b0e175935cdab7 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:32.427580  9746 raft_consensus.cc:2804] T 9a8ed4502cb447c7b2cb94c96dcb7daf P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:32.432094  9591 ts_tablet_manager.cc:1434] T 17d57808c20741cd85b0e175935cdab7 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:04:32.433701  9591 tablet_bootstrap.cc:492] T b94916f0e1e340a38f4a100f451fdaba P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:32.438652  9472 raft_consensus.cc:2468] T 9a8ed4502cb447c7b2cb94c96dcb7daf P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 1.
I20260709 13:04:32.439972  9591 tablet_bootstrap.cc:654] T b94916f0e1e340a38f4a100f451fdaba P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.430809  9746 raft_consensus.cc:697] T 9a8ed4502cb447c7b2cb94c96dcb7daf P 932245f14aac417f913cc7330a1833b8 [term 1 LEADER]: Becoming Leader. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Running, Role: LEADER
I20260709 13:04:32.457216  9592 tablet_bootstrap.cc:492] T 63d5c2ea967a4c1586216c60202c5514 P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:32.458024  9592 ts_tablet_manager.cc:1403] T 63d5c2ea967a4c1586216c60202c5514 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.124s	user 0.013s	sys 0.005s
I20260709 13:04:32.470188  9740 consensus_queue.cc:1048] T b31d08e4168243f08eb2a31031a039ed P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:32.470578  9606 raft_consensus.cc:493] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.471361  9606 raft_consensus.cc:515] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:32.477516  9739 raft_consensus.cc:515] T 17d57808c20741cd85b0e175935cdab7 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:32.480870  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d57808c20741cd85b0e175935cdab7" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:32.481774  9472 raft_consensus.cc:3060] T 17d57808c20741cd85b0e175935cdab7 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.484146  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d57808c20741cd85b0e175935cdab7" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8"
I20260709 13:04:32.485227  9323 raft_consensus.cc:3060] T 17d57808c20741cd85b0e175935cdab7 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.489059  9650 raft_consensus.cc:493] T b94916f0e1e340a38f4a100f451fdaba P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.489440  9740 consensus_queue.cc:1048] T 01a5f4a59c5e47bc8b7b11db44d80006 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:32.490031  9650 raft_consensus.cc:515] T b94916f0e1e340a38f4a100f451fdaba P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:32.493536  9323 raft_consensus.cc:2468] T 17d57808c20741cd85b0e175935cdab7 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 1.
I20260709 13:04:32.495146  9512 leader_election.cc:304] T 17d57808c20741cd85b0e175935cdab7 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 
I20260709 13:04:32.497262  9471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5c2ea967a4c1586216c60202c5514" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:32.498479  9709 raft_consensus.cc:2804] T 17d57808c20741cd85b0e175935cdab7 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:04:32.499050  9289 leader_election.cc:343] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.499398  9544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b94916f0e1e340a38f4a100f451fdaba" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:32.503019  9544 raft_consensus.cc:2468] T b94916f0e1e340a38f4a100f451fdaba P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 0.
I20260709 13:04:32.503328  9599 consensus_queue.cc:1048] T b31d08e4168243f08eb2a31031a039ed P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Connected to new peer: Peer: permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:32.499663  9606 leader_election.cc:290] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:32.506675  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b94916f0e1e340a38f4a100f451fdaba" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:32.501477  9650 leader_election.cc:290] T b94916f0e1e340a38f4a100f451fdaba P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:32.497357  9398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5c2ea967a4c1586216c60202c5514" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:32.510836  9592 raft_consensus.cc:359] T 63d5c2ea967a4c1586216c60202c5514 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:32.518388  9592 raft_consensus.cc:385] T 63d5c2ea967a4c1586216c60202c5514 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.518802  9592 raft_consensus.cc:740] T 63d5c2ea967a4c1586216c60202c5514 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.519850  9398 raft_consensus.cc:2468] T 63d5c2ea967a4c1586216c60202c5514 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 0.
I20260709 13:04:32.508944  9709 raft_consensus.cc:697] T 17d57808c20741cd85b0e175935cdab7 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Becoming Leader. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Running, Role: LEADER
I20260709 13:04:32.521417  9287 leader_election.cc:304] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, a91e8b10a5984dec9d3777a7275cef49; no voters: ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:32.521538  9709 consensus_queue.cc:237] T 17d57808c20741cd85b0e175935cdab7 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:32.522651  9606 raft_consensus.cc:2804] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:32.523167  9606 raft_consensus.cc:493] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.523566  9606 raft_consensus.cc:3060] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.532485  9592 consensus_queue.cc:260] T 63d5c2ea967a4c1586216c60202c5514 P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:32.516957  9739 leader_election.cc:290] T 17d57808c20741cd85b0e175935cdab7 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Requested vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:32.480859  9746 consensus_queue.cc:237] T 9a8ed4502cb447c7b2cb94c96dcb7daf P 932245f14aac417f913cc7330a1833b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:32.533725  9364 leader_election.cc:304] T b94916f0e1e340a38f4a100f451fdaba P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 
W20260709 13:04:32.548175  9364 leader_election.cc:343] T b94916f0e1e340a38f4a100f451fdaba P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.548766  9593 tablet_bootstrap.cc:492] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:32.549345  9593 ts_tablet_manager.cc:1403] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.191s	user 0.023s	sys 0.052s
I20260709 13:04:32.549281  9650 raft_consensus.cc:2804] T b94916f0e1e340a38f4a100f451fdaba P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:32.549875  9650 raft_consensus.cc:493] T b94916f0e1e340a38f4a100f451fdaba P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.551419  9650 raft_consensus.cc:3060] T b94916f0e1e340a38f4a100f451fdaba P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.552681  9593 raft_consensus.cc:359] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:32.553462  9593 raft_consensus.cc:385] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.553750  9593 raft_consensus.cc:740] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.554497  9593 consensus_queue.cc:260] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:32.557220  9593 ts_tablet_manager.cc:1434] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:32.558492  9593 tablet_bootstrap.cc:492] T 774befa616254c02901f28edde6ab758 P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:32.558414  9592 ts_tablet_manager.cc:1434] T 63d5c2ea967a4c1586216c60202c5514 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.100s	user 0.008s	sys 0.003s
I20260709 13:04:32.560032  9592 tablet_bootstrap.cc:492] T 85d647b0abf74fbebc7e9a9bfe14b8ea P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:32.565543  9593 tablet_bootstrap.cc:654] T 774befa616254c02901f28edde6ab758 P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.570461  9590 tablet_bootstrap.cc:492] T 774befa616254c02901f28edde6ab758 P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:32.578190  9590 ts_tablet_manager.cc:1403] T 774befa616254c02901f28edde6ab758 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.199s	user 0.025s	sys 0.033s
I20260709 13:04:32.591207  9472 raft_consensus.cc:2468] T 17d57808c20741cd85b0e175935cdab7 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 1.
I20260709 13:04:32.580749  9740 consensus_queue.cc:1048] T 01a5f4a59c5e47bc8b7b11db44d80006 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:04:32.599195  9592 tablet_bootstrap.cc:654] T 85d647b0abf74fbebc7e9a9bfe14b8ea P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.600301  9650 raft_consensus.cc:515] T b94916f0e1e340a38f4a100f451fdaba P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:32.592549  9606 raft_consensus.cc:515] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:32.603716  9606 leader_election.cc:290] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 election: Requested vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:32.605482  9470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5c2ea967a4c1586216c60202c5514" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:32.606331  9470 raft_consensus.cc:3060] T 63d5c2ea967a4c1586216c60202c5514 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.611464  9398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5c2ea967a4c1586216c60202c5514" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:32.615074  9591 tablet_bootstrap.cc:492] T b94916f0e1e340a38f4a100f451fdaba P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:32.615897  9591 ts_tablet_manager.cc:1403] T b94916f0e1e340a38f4a100f451fdaba P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.183s	user 0.004s	sys 0.021s
I20260709 13:04:32.612627  9691 raft_consensus.cc:493] T ab069642e354446db85dabd0cedd7eec P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.618167  9691 raft_consensus.cc:515] T ab069642e354446db85dabd0cedd7eec P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:32.622888  9471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab069642e354446db85dabd0cedd7eec" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
W20260709 13:04:32.624406  9364 leader_election.cc:343] T ab069642e354446db85dabd0cedd7eec P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.626189  9691 leader_election.cc:290] T ab069642e354446db85dabd0cedd7eec P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:32.628206  9544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab069642e354446db85dabd0cedd7eec" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
W20260709 13:04:32.630766  9364 leader_election.cc:343] T ab069642e354446db85dabd0cedd7eec P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.583284  9692 raft_consensus.cc:515] T faf56b218e614e51962171088f3c4f63 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:32.612391  9398 raft_consensus.cc:3060] T 63d5c2ea967a4c1586216c60202c5514 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.631517  9364 leader_election.cc:304] T ab069642e354446db85dabd0cedd7eec P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49; no voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:32.636242  9691 raft_consensus.cc:2749] T ab069642e354446db85dabd0cedd7eec P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:32.638106  9591 raft_consensus.cc:359] T b94916f0e1e340a38f4a100f451fdaba P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:32.638825  9591 raft_consensus.cc:385] T b94916f0e1e340a38f4a100f451fdaba P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.639081  9591 raft_consensus.cc:740] T b94916f0e1e340a38f4a100f451fdaba P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.632612  9218 catalog_manager.cc:5697] T 17d57808c20741cd85b0e175935cdab7 P dfbbb80ab8e345e0ae1684fafefceccf reported cstate change: term changed from 0 to 1, leader changed from <none> to dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196). New cstate: current_term: 1 leader_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:32.641180  9591 consensus_queue.cc:260] T b94916f0e1e340a38f4a100f451fdaba P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:32.645272  9590 raft_consensus.cc:359] T 774befa616254c02901f28edde6ab758 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:32.653267  9590 raft_consensus.cc:385] T 774befa616254c02901f28edde6ab758 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.653599  9590 raft_consensus.cc:740] T 774befa616254c02901f28edde6ab758 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.653672  9593 tablet_bootstrap.cc:492] T 774befa616254c02901f28edde6ab758 P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:32.655161  9650 leader_election.cc:290] T b94916f0e1e340a38f4a100f451fdaba P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Requested vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:32.655071  9397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf56b218e614e51962171088f3c4f63" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:32.657491  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b94916f0e1e340a38f4a100f451fdaba" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8"
I20260709 13:04:32.658700  9590 consensus_queue.cc:260] T 774befa616254c02901f28edde6ab758 P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:32.659801  9692 leader_election.cc:290] T faf56b218e614e51962171088f3c4f63 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Requested vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:32.662420  9691 raft_consensus.cc:493] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.662635  9546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf56b218e614e51962171088f3c4f63" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
I20260709 13:04:32.664424  9544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b94916f0e1e340a38f4a100f451fdaba" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
I20260709 13:04:32.682693  9544 raft_consensus.cc:3060] T b94916f0e1e340a38f4a100f451fdaba P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.672782  9591 ts_tablet_manager.cc:1434] T b94916f0e1e340a38f4a100f451fdaba P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.000s
I20260709 13:04:32.674517  9593 ts_tablet_manager.cc:1403] T 774befa616254c02901f28edde6ab758 P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.116s	user 0.010s	sys 0.017s
I20260709 13:04:32.678423  9590 ts_tablet_manager.cc:1434] T 774befa616254c02901f28edde6ab758 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.099s	user 0.007s	sys 0.000s
I20260709 13:04:32.674033  9321 raft_consensus.cc:3060] T b94916f0e1e340a38f4a100f451fdaba P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.681674  9592 tablet_bootstrap.cc:492] T 85d647b0abf74fbebc7e9a9bfe14b8ea P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:32.678867  9398 raft_consensus.cc:2468] T 63d5c2ea967a4c1586216c60202c5514 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 1.
I20260709 13:04:32.674139  9687 raft_consensus.cc:493] T 85d647b0abf74fbebc7e9a9bfe14b8ea P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.702805  9687 raft_consensus.cc:515] T 85d647b0abf74fbebc7e9a9bfe14b8ea P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:32.686120  9592 ts_tablet_manager.cc:1403] T 85d647b0abf74fbebc7e9a9bfe14b8ea P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.126s	user 0.018s	sys 0.012s
I20260709 13:04:32.685534  9546 raft_consensus.cc:3060] T faf56b218e614e51962171088f3c4f63 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.682183  9691 raft_consensus.cc:515] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:32.675637  9397 raft_consensus.cc:3060] T faf56b218e614e51962171088f3c4f63 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.691967  9593 raft_consensus.cc:359] T 774befa616254c02901f28edde6ab758 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:32.695048  9591 tablet_bootstrap.cc:492] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:32.692890  9590 tablet_bootstrap.cc:492] T 85d647b0abf74fbebc7e9a9bfe14b8ea P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
I20260709 13:04:32.700645  9220 catalog_manager.cc:5697] T 9a8ed4502cb447c7b2cb94c96dcb7daf P 932245f14aac417f913cc7330a1833b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 932245f14aac417f913cc7330a1833b8 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "932245f14aac417f913cc7330a1833b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:32.704968  9687 leader_election.cc:290] T 85d647b0abf74fbebc7e9a9bfe14b8ea P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:32.710147  9592 raft_consensus.cc:359] T 85d647b0abf74fbebc7e9a9bfe14b8ea P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:32.710675  9287 leader_election.cc:304] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, a91e8b10a5984dec9d3777a7275cef49; no voters: 
I20260709 13:04:32.707170  9471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85d647b0abf74fbebc7e9a9bfe14b8ea" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:32.710949  9592 raft_consensus.cc:385] T 85d647b0abf74fbebc7e9a9bfe14b8ea P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.709830  9593 raft_consensus.cc:385] T 774befa616254c02901f28edde6ab758 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.711992  9592 raft_consensus.cc:740] T 85d647b0abf74fbebc7e9a9bfe14b8ea P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.713871  9470 raft_consensus.cc:2468] T 63d5c2ea967a4c1586216c60202c5514 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 1.
I20260709 13:04:32.711685  9746 raft_consensus.cc:2804] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:32.715209  9746 raft_consensus.cc:697] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8 [term 1 LEADER]: Becoming Leader. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Running, Role: LEADER
I20260709 13:04:32.716130  9746 consensus_queue.cc:237] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:32.712018  9593 raft_consensus.cc:740] T 774befa616254c02901f28edde6ab758 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.705719  9544 raft_consensus.cc:2468] T b94916f0e1e340a38f4a100f451fdaba P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 1.
I20260709 13:04:32.720547  9592 consensus_queue.cc:260] T 85d647b0abf74fbebc7e9a9bfe14b8ea P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:32.722855  9545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85d647b0abf74fbebc7e9a9bfe14b8ea" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
W20260709 13:04:32.724608  9364 leader_election.cc:343] T 85d647b0abf74fbebc7e9a9bfe14b8ea P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.727052  9397 raft_consensus.cc:2468] T faf56b218e614e51962171088f3c4f63 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 1.
I20260709 13:04:32.730118  9364 leader_election.cc:304] T b94916f0e1e340a38f4a100f451fdaba P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 
I20260709 13:04:32.730692  9592 ts_tablet_manager.cc:1434] T 85d647b0abf74fbebc7e9a9bfe14b8ea P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:04:32.731228  9691 leader_election.cc:290] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:32.731362  9687 raft_consensus.cc:2804] T b94916f0e1e340a38f4a100f451fdaba P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:32.731829  9592 tablet_bootstrap.cc:492] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:32.732163  9687 raft_consensus.cc:697] T b94916f0e1e340a38f4a100f451fdaba P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Becoming Leader. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Running, Role: LEADER
I20260709 13:04:32.738361  9592 tablet_bootstrap.cc:654] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.732813  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5b6e6fcfb04bc3bb6cc0270e14e0cd" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
W20260709 13:04:32.740358  9364 leader_election.cc:343] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.727727  9471 raft_consensus.cc:2468] T 85d647b0abf74fbebc7e9a9bfe14b8ea P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 0.
I20260709 13:04:32.742720  9687 consensus_queue.cc:237] T b94916f0e1e340a38f4a100f451fdaba P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:32.721894  9593 consensus_queue.cc:260] T 774befa616254c02901f28edde6ab758 P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:32.734738  9546 raft_consensus.cc:2468] T faf56b218e614e51962171088f3c4f63 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 1.
I20260709 13:04:32.745684  9364 leader_election.cc:304] T 85d647b0abf74fbebc7e9a9bfe14b8ea P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:32.746692  9593 ts_tablet_manager.cc:1434] T 774befa616254c02901f28edde6ab758 P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.062s	user 0.005s	sys 0.001s
I20260709 13:04:32.747906  9593 tablet_bootstrap.cc:492] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:32.749394  9691 raft_consensus.cc:2804] T 85d647b0abf74fbebc7e9a9bfe14b8ea P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:32.751538  9691 raft_consensus.cc:493] T 85d647b0abf74fbebc7e9a9bfe14b8ea P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.751915  9691 raft_consensus.cc:3060] T 85d647b0abf74fbebc7e9a9bfe14b8ea P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.735565  9470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5b6e6fcfb04bc3bb6cc0270e14e0cd" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:32.759632  9436 leader_election.cc:304] T faf56b218e614e51962171088f3c4f63 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:32.760828  9702 raft_consensus.cc:2804] T faf56b218e614e51962171088f3c4f63 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:32.761407  9702 raft_consensus.cc:697] T faf56b218e614e51962171088f3c4f63 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Becoming Leader. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Running, Role: LEADER
W20260709 13:04:32.761745  9364 leader_election.cc:343] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.762279  9364 leader_election.cc:304] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49; no voters: 932245f14aac417f913cc7330a1833b8, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:32.762374  9702 consensus_queue.cc:237] T faf56b218e614e51962171088f3c4f63 P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:32.763706  9590 tablet_bootstrap.cc:654] T 85d647b0abf74fbebc7e9a9bfe14b8ea P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.765777  9650 raft_consensus.cc:2749] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:32.785003  9593 tablet_bootstrap.cc:654] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.788316  9739 raft_consensus.cc:493] T 774befa616254c02901f28edde6ab758 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.788903  9739 raft_consensus.cc:515] T 774befa616254c02901f28edde6ab758 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:32.791296  9591 tablet_bootstrap.cc:654] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.798687  9397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "774befa616254c02901f28edde6ab758" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:32.798969  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "774befa616254c02901f28edde6ab758" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:32.799556  9397 raft_consensus.cc:2468] T 774befa616254c02901f28edde6ab758 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 0.
W20260709 13:04:32.800557  9512 leader_election.cc:343] T 774befa616254c02901f28edde6ab758 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.801589  9510 leader_election.cc:304] T 774befa616254c02901f28edde6ab758 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 932245f14aac417f913cc7330a1833b8
I20260709 13:04:32.802595  9599 raft_consensus.cc:2804] T 774befa616254c02901f28edde6ab758 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:32.802992  9599 raft_consensus.cc:493] T 774befa616254c02901f28edde6ab758 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.803311  9599 raft_consensus.cc:3060] T 774befa616254c02901f28edde6ab758 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.805965  9691 raft_consensus.cc:515] T 85d647b0abf74fbebc7e9a9bfe14b8ea P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:32.808140  9691 leader_election.cc:290] T 85d647b0abf74fbebc7e9a9bfe14b8ea P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Requested vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:32.795133  9739 leader_election.cc:290] T 774befa616254c02901f28edde6ab758 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:32.812033  9592 tablet_bootstrap.cc:492] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:32.812651  9592 ts_tablet_manager.cc:1403] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.081s	user 0.009s	sys 0.016s
I20260709 13:04:32.804847  9321 raft_consensus.cc:2468] T b94916f0e1e340a38f4a100f451fdaba P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 1.
I20260709 13:04:32.816038  9470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85d647b0abf74fbebc7e9a9bfe14b8ea" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:32.821432  9544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85d647b0abf74fbebc7e9a9bfe14b8ea" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
I20260709 13:04:32.825496  9592 raft_consensus.cc:359] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:32.826129  9220 catalog_manager.cc:5697] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 932245f14aac417f913cc7330a1833b8 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "932245f14aac417f913cc7330a1833b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:32.828601  9599 raft_consensus.cc:515] T 774befa616254c02901f28edde6ab758 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:32.833503  9592 raft_consensus.cc:385] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.835197  9592 raft_consensus.cc:740] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.837584  9592 consensus_queue.cc:260] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:32.839267  9592 ts_tablet_manager.cc:1434] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:04:32.840132  9592 tablet_bootstrap.cc:492] T ab069642e354446db85dabd0cedd7eec P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:32.835479  9470 raft_consensus.cc:3060] T 85d647b0abf74fbebc7e9a9bfe14b8ea P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:32.842573  9364 leader_election.cc:343] T 85d647b0abf74fbebc7e9a9bfe14b8ea P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.849948  9590 tablet_bootstrap.cc:492] T 85d647b0abf74fbebc7e9a9bfe14b8ea P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:32.850947  9590 ts_tablet_manager.cc:1403] T 85d647b0abf74fbebc7e9a9bfe14b8ea P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.158s	user 0.011s	sys 0.006s
I20260709 13:04:32.854130  9470 raft_consensus.cc:2468] T 85d647b0abf74fbebc7e9a9bfe14b8ea P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 1.
I20260709 13:04:32.854286  9590 raft_consensus.cc:359] T 85d647b0abf74fbebc7e9a9bfe14b8ea P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:32.855350  9590 raft_consensus.cc:385] T 85d647b0abf74fbebc7e9a9bfe14b8ea P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.855655  9590 raft_consensus.cc:740] T 85d647b0abf74fbebc7e9a9bfe14b8ea P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.856490  9590 consensus_queue.cc:260] T 85d647b0abf74fbebc7e9a9bfe14b8ea P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:32.863610  9592 tablet_bootstrap.cc:654] T ab069642e354446db85dabd0cedd7eec P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.871447  9364 leader_election.cc:304] T 85d647b0abf74fbebc7e9a9bfe14b8ea P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:32.873135  9739 raft_consensus.cc:493] T 85d647b0abf74fbebc7e9a9bfe14b8ea P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.873378  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "774befa616254c02901f28edde6ab758" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8"
I20260709 13:04:32.873705  9397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "774befa616254c02901f28edde6ab758" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:32.874274  9397 raft_consensus.cc:3060] T 774befa616254c02901f28edde6ab758 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.873876  9739 raft_consensus.cc:515] T 85d647b0abf74fbebc7e9a9bfe14b8ea P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
W20260709 13:04:32.875234  9512 leader_election.cc:343] T 774befa616254c02901f28edde6ab758 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.876920  9739 leader_election.cc:290] T 85d647b0abf74fbebc7e9a9bfe14b8ea P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:32.877660  9650 raft_consensus.cc:2804] T 85d647b0abf74fbebc7e9a9bfe14b8ea P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:32.878214  9599 leader_election.cc:290] T 774befa616254c02901f28edde6ab758 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Requested vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:32.878415  9398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85d647b0abf74fbebc7e9a9bfe14b8ea" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:32.878464  9470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85d647b0abf74fbebc7e9a9bfe14b8ea" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:32.878218  9650 raft_consensus.cc:697] T 85d647b0abf74fbebc7e9a9bfe14b8ea P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Becoming Leader. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Running, Role: LEADER
I20260709 13:04:32.879487  9470 raft_consensus.cc:2393] T 85d647b0abf74fbebc7e9a9bfe14b8ea P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dfbbb80ab8e345e0ae1684fafefceccf in current term 1: Already voted for candidate a91e8b10a5984dec9d3777a7275cef49 in this term.
I20260709 13:04:32.879818  9650 consensus_queue.cc:237] T 85d647b0abf74fbebc7e9a9bfe14b8ea P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:32.882682  9217 catalog_manager.cc:5697] T b94916f0e1e340a38f4a100f451fdaba P a91e8b10a5984dec9d3777a7275cef49 reported cstate change: term changed from 0 to 1, leader changed from <none> to a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "a91e8b10a5984dec9d3777a7275cef49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:32.888300  9397 raft_consensus.cc:2468] T 774befa616254c02901f28edde6ab758 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 1.
I20260709 13:04:32.888222  9221 catalog_manager.cc:5697] T faf56b218e614e51962171088f3c4f63 P ef5fe58eb3e04ae18fda957b4d507eff reported cstate change: term changed from 0 to 1, leader changed from <none> to ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:32.891360  9510 leader_election.cc:304] T 774befa616254c02901f28edde6ab758 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 932245f14aac417f913cc7330a1833b8
I20260709 13:04:32.892531  9599 raft_consensus.cc:2804] T 774befa616254c02901f28edde6ab758 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:32.893044  9599 raft_consensus.cc:697] T 774befa616254c02901f28edde6ab758 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Becoming Leader. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Running, Role: LEADER
I20260709 13:04:32.893900  9599 consensus_queue.cc:237] T 774befa616254c02901f28edde6ab758 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:32.896059  9590 ts_tablet_manager.cc:1434] T 85d647b0abf74fbebc7e9a9bfe14b8ea P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.001s
I20260709 13:04:32.898027  9590 tablet_bootstrap.cc:492] T ab069642e354446db85dabd0cedd7eec P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
I20260709 13:04:32.900619  9593 tablet_bootstrap.cc:492] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:32.901126  9593 ts_tablet_manager.cc:1403] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.154s	user 0.022s	sys 0.037s
I20260709 13:04:32.909626  9593 raft_consensus.cc:359] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:32.910395  9593 raft_consensus.cc:385] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.910698  9593 raft_consensus.cc:740] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.911445  9593 consensus_queue.cc:260] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:32.926919  9593 ts_tablet_manager.cc:1434] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.002s
I20260709 13:04:32.928602  9593 tablet_bootstrap.cc:492] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:32.930765  9590 tablet_bootstrap.cc:654] T ab069642e354446db85dabd0cedd7eec P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.938570  9739 consensus_queue.cc:1048] T 17d57808c20741cd85b0e175935cdab7 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Connected to new peer: Peer: permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:32.942971  9592 tablet_bootstrap.cc:492] T ab069642e354446db85dabd0cedd7eec P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:32.943573  9592 ts_tablet_manager.cc:1403] T ab069642e354446db85dabd0cedd7eec P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.104s	user 0.007s	sys 0.014s
I20260709 13:04:32.944370  9221 catalog_manager.cc:5697] T 774befa616254c02901f28edde6ab758 P dfbbb80ab8e345e0ae1684fafefceccf reported cstate change: term changed from 0 to 1, leader changed from <none> to dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196). New cstate: current_term: 1 leader_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:32.960137  9592 raft_consensus.cc:359] T ab069642e354446db85dabd0cedd7eec P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:32.960903  9591 tablet_bootstrap.cc:492] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:32.961607  9591 ts_tablet_manager.cc:1403] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.267s	user 0.013s	sys 0.030s
I20260709 13:04:32.965278  9591 raft_consensus.cc:359] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:32.965975  9591 raft_consensus.cc:385] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.966221  9591 raft_consensus.cc:740] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.966993  9591 consensus_queue.cc:260] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:32.969749  9591 ts_tablet_manager.cc:1434] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:32.970250  9592 raft_consensus.cc:385] T ab069642e354446db85dabd0cedd7eec P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.970911  9592 raft_consensus.cc:740] T ab069642e354446db85dabd0cedd7eec P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.971046  9591 tablet_bootstrap.cc:492] T 774befa616254c02901f28edde6ab758 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:32.971299  9510 leader_election.cc:304] T 85d647b0abf74fbebc7e9a9bfe14b8ea P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf; no voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:32.971820  9592 consensus_queue.cc:260] T ab069642e354446db85dabd0cedd7eec P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:32.972874  9599 raft_consensus.cc:3060] T 85d647b0abf74fbebc7e9a9bfe14b8ea P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.976642  9593 tablet_bootstrap.cc:654] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.978914  9591 tablet_bootstrap.cc:654] T 774befa616254c02901f28edde6ab758 P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.980118  9592 ts_tablet_manager.cc:1434] T ab069642e354446db85dabd0cedd7eec P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.001s
I20260709 13:04:32.989699  9592 tablet_bootstrap.cc:492] T f3a3d4fd34924b7c8ed0df6709391329 P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:32.992952  9709 consensus_queue.cc:1048] T 17d57808c20741cd85b0e175935cdab7 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:32.996210  9592 tablet_bootstrap.cc:654] T f3a3d4fd34924b7c8ed0df6709391329 P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.998075  9220 catalog_manager.cc:5697] T 85d647b0abf74fbebc7e9a9bfe14b8ea P a91e8b10a5984dec9d3777a7275cef49 reported cstate change: term changed from 0 to 1, leader changed from <none> to a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "a91e8b10a5984dec9d3777a7275cef49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:33.004586  9746 consensus_queue.cc:1048] T 9a8ed4502cb447c7b2cb94c96dcb7daf P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:04:33.014777  9599 raft_consensus.cc:2749] T 85d647b0abf74fbebc7e9a9bfe14b8ea P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:33.017145  9593 tablet_bootstrap.cc:492] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:33.017700  9593 ts_tablet_manager.cc:1403] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.090s	user 0.014s	sys 0.000s
I20260709 13:04:33.020787  9593 raft_consensus.cc:359] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:33.021565  9593 raft_consensus.cc:385] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:33.021868  9593 raft_consensus.cc:740] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.024398  9593 consensus_queue.cc:260] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:33.027904  9590 tablet_bootstrap.cc:492] T ab069642e354446db85dabd0cedd7eec P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:33.028473  9590 ts_tablet_manager.cc:1403] T ab069642e354446db85dabd0cedd7eec P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.131s	user 0.028s	sys 0.002s
I20260709 13:04:33.028563  9591 tablet_bootstrap.cc:492] T 774befa616254c02901f28edde6ab758 P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:33.030401  9591 ts_tablet_manager.cc:1403] T 774befa616254c02901f28edde6ab758 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.060s	user 0.022s	sys 0.033s
I20260709 13:04:33.036228  9591 raft_consensus.cc:359] T 774befa616254c02901f28edde6ab758 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:33.036914  9591 raft_consensus.cc:385] T 774befa616254c02901f28edde6ab758 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:33.037220  9591 raft_consensus.cc:740] T 774befa616254c02901f28edde6ab758 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.037868  9591 consensus_queue.cc:260] T 774befa616254c02901f28edde6ab758 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:33.039933  9591 ts_tablet_manager.cc:1434] T 774befa616254c02901f28edde6ab758 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:04:33.047092  9591 tablet_bootstrap.cc:492] T f3a3d4fd34924b7c8ed0df6709391329 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:33.053915  9591 tablet_bootstrap.cc:654] T f3a3d4fd34924b7c8ed0df6709391329 P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:33.057057  9593 ts_tablet_manager.cc:1434] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:04:33.058624  9593 tablet_bootstrap.cc:492] T 47b7a6191c374a6a84d8223c573fa318 P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:33.066015  9590 raft_consensus.cc:359] T ab069642e354446db85dabd0cedd7eec P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:33.066996  9590 raft_consensus.cc:385] T ab069642e354446db85dabd0cedd7eec P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:33.067360  9590 raft_consensus.cc:740] T ab069642e354446db85dabd0cedd7eec P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.068172  9590 consensus_queue.cc:260] T ab069642e354446db85dabd0cedd7eec P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:33.069263  9592 tablet_bootstrap.cc:492] T f3a3d4fd34924b7c8ed0df6709391329 P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:33.069772  9592 ts_tablet_manager.cc:1403] T f3a3d4fd34924b7c8ed0df6709391329 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.080s	user 0.016s	sys 0.006s
I20260709 13:04:33.072602  9593 tablet_bootstrap.cc:654] T 47b7a6191c374a6a84d8223c573fa318 P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:33.073032  9592 raft_consensus.cc:359] T f3a3d4fd34924b7c8ed0df6709391329 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:33.073817  9592 raft_consensus.cc:385] T f3a3d4fd34924b7c8ed0df6709391329 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:33.074067  9592 raft_consensus.cc:740] T f3a3d4fd34924b7c8ed0df6709391329 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.074751  9592 consensus_queue.cc:260] T f3a3d4fd34924b7c8ed0df6709391329 P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:33.076303  9592 ts_tablet_manager.cc:1434] T f3a3d4fd34924b7c8ed0df6709391329 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:04:33.077426  9592 tablet_bootstrap.cc:492] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:33.085098  9592 tablet_bootstrap.cc:654] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:33.089988  9752 consensus_queue.cc:1048] T 9a8ed4502cb447c7b2cb94c96dcb7daf P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:33.090798  9593 tablet_bootstrap.cc:492] T 47b7a6191c374a6a84d8223c573fa318 P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:33.091365  9593 ts_tablet_manager.cc:1403] T 47b7a6191c374a6a84d8223c573fa318 P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.000s
I20260709 13:04:33.094082  9593 raft_consensus.cc:359] T 47b7a6191c374a6a84d8223c573fa318 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:33.094739  9593 raft_consensus.cc:385] T 47b7a6191c374a6a84d8223c573fa318 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:33.095011  9593 raft_consensus.cc:740] T 47b7a6191c374a6a84d8223c573fa318 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.095738  9593 consensus_queue.cc:260] T 47b7a6191c374a6a84d8223c573fa318 P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:33.098344  9593 ts_tablet_manager.cc:1434] T 47b7a6191c374a6a84d8223c573fa318 P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:33.099689  9593 tablet_bootstrap.cc:492] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:33.108708  9593 tablet_bootstrap.cc:654] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:33.121253  9593 tablet_bootstrap.cc:492] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:33.121798  9593 ts_tablet_manager.cc:1403] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.003s
I20260709 13:04:33.124856  9593 raft_consensus.cc:359] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:33.125595  9593 raft_consensus.cc:385] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:33.125875  9593 raft_consensus.cc:740] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.126605  9593 consensus_queue.cc:260] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:33.128906  9593 ts_tablet_manager.cc:1434] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:04:33.130733  9593 tablet_bootstrap.cc:492] T e97eecc3acdf46a5b5577416f7bfe336 P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:33.131138  9691 consensus_queue.cc:1048] T b94916f0e1e340a38f4a100f451fdaba P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:33.139341  9593 tablet_bootstrap.cc:654] T e97eecc3acdf46a5b5577416f7bfe336 P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:33.144279  9590 ts_tablet_manager.cc:1434] T ab069642e354446db85dabd0cedd7eec P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.115s	user 0.006s	sys 0.000s
I20260709 13:04:33.145905  9590 tablet_bootstrap.cc:492] T f3a3d4fd34924b7c8ed0df6709391329 P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
I20260709 13:04:33.152288  9593 tablet_bootstrap.cc:492] T e97eecc3acdf46a5b5577416f7bfe336 P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:33.153015  9593 ts_tablet_manager.cc:1403] T e97eecc3acdf46a5b5577416f7bfe336 P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.001s
I20260709 13:04:33.157634  9593 raft_consensus.cc:359] T e97eecc3acdf46a5b5577416f7bfe336 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:33.158579  9593 raft_consensus.cc:385] T e97eecc3acdf46a5b5577416f7bfe336 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:33.158910  9593 raft_consensus.cc:740] T e97eecc3acdf46a5b5577416f7bfe336 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.160158  9593 consensus_queue.cc:260] T e97eecc3acdf46a5b5577416f7bfe336 P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:33.164906  9599 raft_consensus.cc:493] T ab069642e354446db85dabd0cedd7eec P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.165663  9702 raft_consensus.cc:493] T ab069642e354446db85dabd0cedd7eec P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.166157  9746 consensus_queue.cc:1048] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:33.166220  9702 raft_consensus.cc:515] T ab069642e354446db85dabd0cedd7eec P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:33.165699  9599 raft_consensus.cc:515] T ab069642e354446db85dabd0cedd7eec P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:33.171422  9397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab069642e354446db85dabd0cedd7eec" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:33.172664  9397 raft_consensus.cc:2468] T ab069642e354446db85dabd0cedd7eec P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 0.
I20260709 13:04:33.175403  9650 raft_consensus.cc:493] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.177623  9702 leader_election.cc:290] T ab069642e354446db85dabd0cedd7eec P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:33.177776  9650 raft_consensus.cc:515] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:33.175776  9510 leader_election.cc:304] T ab069642e354446db85dabd0cedd7eec P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 
I20260709 13:04:33.179992  9397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab069642e354446db85dabd0cedd7eec" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:33.181238  9397 raft_consensus.cc:2468] T ab069642e354446db85dabd0cedd7eec P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 0.
I20260709 13:04:33.181370  9709 raft_consensus.cc:2804] T ab069642e354446db85dabd0cedd7eec P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:33.181778  9709 raft_consensus.cc:493] T ab069642e354446db85dabd0cedd7eec P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.182148  9709 raft_consensus.cc:3060] T ab069642e354446db85dabd0cedd7eec P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.174546  9593 ts_tablet_manager.cc:1434] T e97eecc3acdf46a5b5577416f7bfe336 P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:04:33.183636  9593 tablet_bootstrap.cc:492] T a541a15041a3493dab6cbe921d81d1d7 P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:33.185339  9436 leader_election.cc:304] T ab069642e354446db85dabd0cedd7eec P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:33.187680  9545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab069642e354446db85dabd0cedd7eec" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:33.187623  9692 raft_consensus.cc:2804] T ab069642e354446db85dabd0cedd7eec P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:33.189908  9692 raft_consensus.cc:493] T ab069642e354446db85dabd0cedd7eec P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.190287  9692 raft_consensus.cc:3060] T ab069642e354446db85dabd0cedd7eec P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.192591  9592 tablet_bootstrap.cc:492] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:33.193203  9592 ts_tablet_manager.cc:1403] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.116s	user 0.009s	sys 0.028s
I20260709 13:04:33.196395  9592 raft_consensus.cc:359] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:33.197147  9592 raft_consensus.cc:385] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:33.196678  9702 consensus_queue.cc:1048] T faf56b218e614e51962171088f3c4f63 P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:33.197530  9592 raft_consensus.cc:740] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.198060  9692 raft_consensus.cc:515] T ab069642e354446db85dabd0cedd7eec P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:33.198426  9592 consensus_queue.cc:260] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:33.201124  9592 ts_tablet_manager.cc:1434] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:33.200959  9395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab069642e354446db85dabd0cedd7eec" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:33.202836  9395 raft_consensus.cc:3060] T ab069642e354446db85dabd0cedd7eec P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.201542  9692 leader_election.cc:290] T ab069642e354446db85dabd0cedd7eec P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Requested vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:33.215202  9591 tablet_bootstrap.cc:492] T f3a3d4fd34924b7c8ed0df6709391329 P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:33.216187  9591 ts_tablet_manager.cc:1403] T f3a3d4fd34924b7c8ed0df6709391329 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.170s	user 0.022s	sys 0.045s
I20260709 13:04:33.210924  9746 raft_consensus.cc:493] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.226943  9650 leader_election.cc:290] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:33.238457  9746 raft_consensus.cc:515] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:33.242799  9394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5b6e6fcfb04bc3bb6cc0270e14e0cd" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:33.243877  9394 raft_consensus.cc:2468] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 0.
I20260709 13:04:33.247967  9287 leader_election.cc:304] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, a91e8b10a5984dec9d3777a7275cef49; no voters: 
I20260709 13:04:33.249397  9606 raft_consensus.cc:2804] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:33.218781  9543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab069642e354446db85dabd0cedd7eec" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
I20260709 13:04:33.249933  9606 raft_consensus.cc:493] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.250416  9606 raft_consensus.cc:3060] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.250976  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c53f31a2697499cb5ad2d5bb6715f02" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:33.255905  9544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c53f31a2697499cb5ad2d5bb6715f02" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
W20260709 13:04:33.271282  9364 leader_election.cc:343] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:33.228502  9590 tablet_bootstrap.cc:654] T f3a3d4fd34924b7c8ed0df6709391329 P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:33.230736  9591 raft_consensus.cc:359] T f3a3d4fd34924b7c8ed0df6709391329 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:33.272612  9591 raft_consensus.cc:385] T f3a3d4fd34924b7c8ed0df6709391329 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:33.272943  9591 raft_consensus.cc:740] T f3a3d4fd34924b7c8ed0df6709391329 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.273777  9591 consensus_queue.cc:260] T f3a3d4fd34924b7c8ed0df6709391329 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:33.276161  9591 ts_tablet_manager.cc:1434] T f3a3d4fd34924b7c8ed0df6709391329 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.060s	user 0.005s	sys 0.000s
I20260709 13:04:33.230687  9709 raft_consensus.cc:515] T ab069642e354446db85dabd0cedd7eec P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
W20260709 13:04:33.276257  9364 leader_election.cc:343] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:33.277400  9591 tablet_bootstrap.cc:492] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:33.278175  9709 leader_election.cc:290] T ab069642e354446db85dabd0cedd7eec P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Requested vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:33.232261  9592 tablet_bootstrap.cc:492] T 6f213937fc9b4030a228a8e56ed80f52 P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:33.279145  9593 tablet_bootstrap.cc:654] T a541a15041a3493dab6cbe921d81d1d7 P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:33.234086  9599 leader_election.cc:290] T ab069642e354446db85dabd0cedd7eec P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:33.234714  9470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab069642e354446db85dabd0cedd7eec" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:33.237953  9395 raft_consensus.cc:2468] T ab069642e354446db85dabd0cedd7eec P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 1.
W20260709 13:04:33.284497  9512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37633, user_credentials={real_user=slave}} blocked reactor thread for 54428.2us
I20260709 13:04:33.287025  9545 raft_consensus.cc:2393] T ab069642e354446db85dabd0cedd7eec P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef5fe58eb3e04ae18fda957b4d507eff in current term 1: Already voted for candidate dfbbb80ab8e345e0ae1684fafefceccf in this term.
I20260709 13:04:33.287040  9470 raft_consensus.cc:2393] T ab069642e354446db85dabd0cedd7eec P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dfbbb80ab8e345e0ae1684fafefceccf in current term 1: Already voted for candidate ef5fe58eb3e04ae18fda957b4d507eff in this term.
I20260709 13:04:33.282945  9364 leader_election.cc:304] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49; no voters: 932245f14aac417f913cc7330a1833b8, dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:33.291442  9650 raft_consensus.cc:2749] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:33.295946  9394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab069642e354446db85dabd0cedd7eec" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:33.298349  9394 raft_consensus.cc:2393] T ab069642e354446db85dabd0cedd7eec P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dfbbb80ab8e345e0ae1684fafefceccf in current term 1: Already voted for candidate ef5fe58eb3e04ae18fda957b4d507eff in this term.
I20260709 13:04:33.292906  9592 tablet_bootstrap.cc:654] T 6f213937fc9b4030a228a8e56ed80f52 P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:33.298825  9692 raft_consensus.cc:493] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.300184  9692 raft_consensus.cc:515] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:33.303519  9692 leader_election.cc:290] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:33.304394  9394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64bc8ad603604e0d9c8eb9d37ef4aed5" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:33.304816  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64bc8ad603604e0d9c8eb9d37ef4aed5" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:33.305344  9394 raft_consensus.cc:2468] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 0.
W20260709 13:04:33.306188  9438 leader_election.cc:343] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:33.306810  9436 leader_election.cc:304] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 932245f14aac417f913cc7330a1833b8
I20260709 13:04:33.307332  9746 leader_election.cc:290] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:33.308355  9692 raft_consensus.cc:2804] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:33.308856  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5b6e6fcfb04bc3bb6cc0270e14e0cd" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:33.308998  9436 leader_election.cc:304] T ab069642e354446db85dabd0cedd7eec P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:33.309628  9472 raft_consensus.cc:2468] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 0.
I20260709 13:04:33.309863  9702 raft_consensus.cc:2804] T ab069642e354446db85dabd0cedd7eec P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:33.310420  9702 raft_consensus.cc:697] T ab069642e354446db85dabd0cedd7eec P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Becoming Leader. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Running, Role: LEADER
I20260709 13:04:33.311923  9606 raft_consensus.cc:515] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:33.311269  9702 consensus_queue.cc:237] T ab069642e354446db85dabd0cedd7eec P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:33.308832  9692 raft_consensus.cc:493] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.321694  9470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab069642e354446db85dabd0cedd7eec" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:33.323115  9752 consensus_queue.cc:1048] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:33.326617  9268 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:33.320761  9691 consensus_queue.cc:1048] T b94916f0e1e340a38f4a100f451fdaba P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:04:33.330220  9691 consensus_queue.cc:1048] T 85d647b0abf74fbebc7e9a9bfe14b8ea P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:33.331624  9689 raft_consensus.cc:493] T e97eecc3acdf46a5b5577416f7bfe336 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.332576  9689 raft_consensus.cc:515] T e97eecc3acdf46a5b5577416f7bfe336 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:33.342080  9687 raft_consensus.cc:493] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.352485  9689 leader_election.cc:290] T e97eecc3acdf46a5b5577416f7bfe336 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:33.357630  9650 raft_consensus.cc:493] T 47b7a6191c374a6a84d8223c573fa318 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.358350  9650 raft_consensus.cc:515] T 47b7a6191c374a6a84d8223c573fa318 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:33.367626  9398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5b6e6fcfb04bc3bb6cc0270e14e0cd" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:33.368685  9398 raft_consensus.cc:3060] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.349949  9687 raft_consensus.cc:515] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:33.337747  9692 raft_consensus.cc:3060] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.397498  9545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97eecc3acdf46a5b5577416f7bfe336" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:33.405292  9687 leader_election.cc:290] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:33.413275  9757 consensus_queue.cc:1048] T faf56b218e614e51962171088f3c4f63 P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:33.416656  9739 consensus_queue.cc:1048] T 774befa616254c02901f28edde6ab758 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:33.415964  9220 catalog_manager.cc:5697] T ab069642e354446db85dabd0cedd7eec P ef5fe58eb3e04ae18fda957b4d507eff reported cstate change: term changed from 0 to 1, leader changed from <none> to ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:33.418228  9606 leader_election.cc:290] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 election: Requested vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:33.429847  9593 tablet_bootstrap.cc:492] T a541a15041a3493dab6cbe921d81d1d7 P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:33.430627  9593 ts_tablet_manager.cc:1403] T a541a15041a3493dab6cbe921d81d1d7 P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.247s	user 0.018s	sys 0.006s
I20260709 13:04:33.428495  9650 leader_election.cc:290] T 47b7a6191c374a6a84d8223c573fa318 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:33.446491  9322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97eecc3acdf46a5b5577416f7bfe336" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:33.457448  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5b6e6fcfb04bc3bb6cc0270e14e0cd" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:33.458904  9593 raft_consensus.cc:359] T a541a15041a3493dab6cbe921d81d1d7 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:33.459730  9593 raft_consensus.cc:385] T a541a15041a3493dab6cbe921d81d1d7 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:33.460034  9593 raft_consensus.cc:740] T a541a15041a3493dab6cbe921d81d1d7 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.461026  9592 tablet_bootstrap.cc:492] T 6f213937fc9b4030a228a8e56ed80f52 P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:33.461709  9592 ts_tablet_manager.cc:1403] T 6f213937fc9b4030a228a8e56ed80f52 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.237s	user 0.014s	sys 0.016s
I20260709 13:04:33.458209  9472 raft_consensus.cc:3060] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.460742  9593 consensus_queue.cc:260] T a541a15041a3493dab6cbe921d81d1d7 P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:33.426743  9512 leader_election.cc:304] T ab069642e354446db85dabd0cedd7eec P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf; no voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:33.463027  9590 tablet_bootstrap.cc:492] T f3a3d4fd34924b7c8ed0df6709391329 P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:33.464967  9590 ts_tablet_manager.cc:1403] T f3a3d4fd34924b7c8ed0df6709391329 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.319s	user 0.028s	sys 0.043s
I20260709 13:04:33.469878  9593 ts_tablet_manager.cc:1434] T a541a15041a3493dab6cbe921d81d1d7 P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.000s
I20260709 13:04:33.469599  9592 raft_consensus.cc:359] T 6f213937fc9b4030a228a8e56ed80f52 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:33.470415  9592 raft_consensus.cc:385] T 6f213937fc9b4030a228a8e56ed80f52 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:33.471073  9593 tablet_bootstrap.cc:492] T 074269f6e5f843be8a85be8b70707304 P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:33.470813  9592 raft_consensus.cc:740] T 6f213937fc9b4030a228a8e56ed80f52 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.473654  9692 raft_consensus.cc:515] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:33.474743  9592 consensus_queue.cc:260] T 6f213937fc9b4030a228a8e56ed80f52 P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:33.475144  9470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b7a6191c374a6a84d8223c573fa318" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:33.476055  9692 leader_election.cc:290] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Requested vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:33.478291  9396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64bc8ad603604e0d9c8eb9d37ef4aed5" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:33.479177  9396 raft_consensus.cc:3060] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.479687  9592 ts_tablet_manager.cc:1434] T 6f213937fc9b4030a228a8e56ed80f52 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:04:33.480736  9592 tablet_bootstrap.cc:492] T 47b7a6191c374a6a84d8223c573fa318 P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:33.482697  9590 raft_consensus.cc:359] T f3a3d4fd34924b7c8ed0df6709391329 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:33.483376  9590 raft_consensus.cc:385] T f3a3d4fd34924b7c8ed0df6709391329 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:33.483675  9590 raft_consensus.cc:740] T f3a3d4fd34924b7c8ed0df6709391329 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
W20260709 13:04:33.484879  9821 log.cc:927] Time spent T faf56b218e614e51962171088f3c4f63 P a91e8b10a5984dec9d3777a7275cef49: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 13:04:33.490975  9364 leader_election.cc:343] T e97eecc3acdf46a5b5577416f7bfe336 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:33.491619  9470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d4c6d168b449f98425d091c54cddb9" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:33.492887  9544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b7a6191c374a6a84d8223c573fa318" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
W20260709 13:04:33.493069  9364 leader_election.cc:343] T 47b7a6191c374a6a84d8223c573fa318 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:33.508226  9364 leader_election.cc:343] T 47b7a6191c374a6a84d8223c573fa318 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:33.508627  9364 leader_election.cc:304] T 47b7a6191c374a6a84d8223c573fa318 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49; no voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:33.509462  9650 raft_consensus.cc:2749] T 47b7a6191c374a6a84d8223c573fa318 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:33.511176  9364 leader_election.cc:343] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:33.491652  9592 tablet_bootstrap.cc:654] T 47b7a6191c374a6a84d8223c573fa318 P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:33.502460  9591 tablet_bootstrap.cc:654] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:33.501565  9512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38559, user_credentials={real_user=slave}} blocked reactor thread for 78200.6us
I20260709 13:04:33.516057  9322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64bc8ad603604e0d9c8eb9d37ef4aed5" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8"
I20260709 13:04:33.516171  9752 raft_consensus.cc:493] T 774befa616254c02901f28edde6ab758 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.516758  9752 raft_consensus.cc:515] T 774befa616254c02901f28edde6ab758 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:33.514451  9687 consensus_queue.cc:1048] T 85d647b0abf74fbebc7e9a9bfe14b8ea P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:04:33.519039  9752 leader_election.cc:290] T 774befa616254c02901f28edde6ab758 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:33.504410  9398 raft_consensus.cc:2468] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 1.
I20260709 13:04:33.499769  9396 raft_consensus.cc:2468] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 1.
I20260709 13:04:33.521970  9287 leader_election.cc:304] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, a91e8b10a5984dec9d3777a7275cef49; no voters: 
I20260709 13:04:33.522759  9436 leader_election.cc:304] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:33.524117  9757 raft_consensus.cc:2804] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:33.525146  9606 raft_consensus.cc:2804] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:33.525540  9757 raft_consensus.cc:697] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Becoming Leader. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Running, Role: LEADER
I20260709 13:04:33.525892  9606 raft_consensus.cc:697] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8 [term 1 LEADER]: Becoming Leader. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Running, Role: LEADER
I20260709 13:04:33.527029  9757 consensus_queue.cc:237] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:33.514004  9590 consensus_queue.cc:260] T f3a3d4fd34924b7c8ed0df6709391329 P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:33.501287  9739 raft_consensus.cc:2749] T ab069642e354446db85dabd0cedd7eec P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:33.541239  9590 ts_tablet_manager.cc:1434] T f3a3d4fd34924b7c8ed0df6709391329 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.076s	user 0.008s	sys 0.000s
I20260709 13:04:33.542461  9396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "774befa616254c02901f28edde6ab758" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:33.549791  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d4c6d168b449f98425d091c54cddb9" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
W20260709 13:04:33.550086  9438 leader_election.cc:343] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:33.540127  9692 raft_consensus.cc:493] T f3a3d4fd34924b7c8ed0df6709391329 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.550755  9692 raft_consensus.cc:515] T f3a3d4fd34924b7c8ed0df6709391329 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:33.556459  9543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3a3d4fd34924b7c8ed0df6709391329" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:33.557158  9543 raft_consensus.cc:2468] T f3a3d4fd34924b7c8ed0df6709391329 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 0.
I20260709 13:04:33.527279  9606 consensus_queue.cc:237] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:33.565982  9593 tablet_bootstrap.cc:654] T 074269f6e5f843be8a85be8b70707304 P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:33.567231  9545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "774befa616254c02901f28edde6ab758" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:33.578912  9692 leader_election.cc:290] T f3a3d4fd34924b7c8ed0df6709391329 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:33.586822  9590 tablet_bootstrap.cc:492] T 3c53f31a2697499cb5ad2d5bb6715f02 P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
I20260709 13:04:33.569923  9472 raft_consensus.cc:2468] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 1.
W20260709 13:04:33.601418  9364 leader_election.cc:343] T e97eecc3acdf46a5b5577416f7bfe336 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:33.613201  9289 leader_election.cc:304] T 774befa616254c02901f28edde6ab758 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 932245f14aac417f913cc7330a1833b8; no voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:33.614552  9752 raft_consensus.cc:2749] T 774befa616254c02901f28edde6ab758 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:33.624378  9592 tablet_bootstrap.cc:492] T 47b7a6191c374a6a84d8223c573fa318 P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:33.625126  9592 ts_tablet_manager.cc:1403] T 47b7a6191c374a6a84d8223c573fa318 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.145s	user 0.034s	sys 0.026s
I20260709 13:04:33.603341  9438 leader_election.cc:304] T f3a3d4fd34924b7c8ed0df6709391329 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:33.628909  9592 raft_consensus.cc:359] T 47b7a6191c374a6a84d8223c573fa318 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:33.629653  9592 raft_consensus.cc:385] T 47b7a6191c374a6a84d8223c573fa318 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:33.629956  9592 raft_consensus.cc:740] T 47b7a6191c374a6a84d8223c573fa318 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.630728  9592 consensus_queue.cc:260] T 47b7a6191c374a6a84d8223c573fa318 P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:33.631091  9755 raft_consensus.cc:2804] T f3a3d4fd34924b7c8ed0df6709391329 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:33.631670  9755 raft_consensus.cc:493] T f3a3d4fd34924b7c8ed0df6709391329 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.632025  9755 raft_consensus.cc:3060] T f3a3d4fd34924b7c8ed0df6709391329 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.633503  9592 ts_tablet_manager.cc:1434] T 47b7a6191c374a6a84d8223c573fa318 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:04:33.634673  9592 tablet_bootstrap.cc:492] T b2a7ad91c8474397bae23c993b89fca4 P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:33.636843  9321 raft_consensus.cc:3060] T 774befa616254c02901f28edde6ab758 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.642000  9322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3a3d4fd34924b7c8ed0df6709391329" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:33.642709  9322 raft_consensus.cc:2468] T f3a3d4fd34924b7c8ed0df6709391329 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 0.
I20260709 13:04:33.642388  9219 catalog_manager.cc:5697] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 932245f14aac417f913cc7330a1833b8 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "932245f14aac417f913cc7330a1833b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:33.643225  9592 tablet_bootstrap.cc:654] T b2a7ad91c8474397bae23c993b89fca4 P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:33.650938  9709 consensus_queue.cc:1048] T 774befa616254c02901f28edde6ab758 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Connected to new peer: Peer: permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:33.666026  9590 tablet_bootstrap.cc:654] T 3c53f31a2697499cb5ad2d5bb6715f02 P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:33.621273  9364 leader_election.cc:304] T e97eecc3acdf46a5b5577416f7bfe336 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49; no voters: 932245f14aac417f913cc7330a1833b8, dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:33.694487  9687 raft_consensus.cc:2749] T e97eecc3acdf46a5b5577416f7bfe336 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:33.703896  9364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37633, user_credentials={real_user=slave}} blocked reactor thread for 117359us
I20260709 13:04:33.706386  9593 tablet_bootstrap.cc:492] T 074269f6e5f843be8a85be8b70707304 P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:33.709059  9593 ts_tablet_manager.cc:1403] T 074269f6e5f843be8a85be8b70707304 P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.238s	user 0.025s	sys 0.014s
I20260709 13:04:33.711278  9591 tablet_bootstrap.cc:492] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:33.713150  9591 ts_tablet_manager.cc:1403] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.436s	user 0.043s	sys 0.027s
I20260709 13:04:33.708909  9221 catalog_manager.cc:5697] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P ef5fe58eb3e04ae18fda957b4d507eff reported cstate change: term changed from 0 to 1, leader changed from <none> to ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:33.722808  9591 raft_consensus.cc:359] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:33.723730  9591 raft_consensus.cc:385] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:33.724045  9591 raft_consensus.cc:740] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.700547  9755 raft_consensus.cc:515] T f3a3d4fd34924b7c8ed0df6709391329 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:33.725684  9591 consensus_queue.cc:260] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
W20260709 13:04:33.724798  9364 leader_election.cc:343] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:33.733541  9592 tablet_bootstrap.cc:492] T b2a7ad91c8474397bae23c993b89fca4 P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:33.734216  9592 ts_tablet_manager.cc:1403] T b2a7ad91c8474397bae23c993b89fca4 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.100s	user 0.013s	sys 0.006s
I20260709 13:04:33.735002  9545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3a3d4fd34924b7c8ed0df6709391329" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
I20260709 13:04:33.735646  9545 raft_consensus.cc:3060] T f3a3d4fd34924b7c8ed0df6709391329 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.736260  9590 tablet_bootstrap.cc:492] T 3c53f31a2697499cb5ad2d5bb6715f02 P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:33.736771  9590 ts_tablet_manager.cc:1403] T 3c53f31a2697499cb5ad2d5bb6715f02 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.151s	user 0.015s	sys 0.012s
I20260709 13:04:33.738209  9592 raft_consensus.cc:359] T b2a7ad91c8474397bae23c993b89fca4 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:33.738965  9592 raft_consensus.cc:385] T b2a7ad91c8474397bae23c993b89fca4 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:33.739244  9592 raft_consensus.cc:740] T b2a7ad91c8474397bae23c993b89fca4 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.739740  9590 raft_consensus.cc:359] T 3c53f31a2697499cb5ad2d5bb6715f02 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:33.739974  9755 leader_election.cc:290] T f3a3d4fd34924b7c8ed0df6709391329 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Requested vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:33.740465  9590 raft_consensus.cc:385] T 3c53f31a2697499cb5ad2d5bb6715f02 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:33.740046  9592 consensus_queue.cc:260] T b2a7ad91c8474397bae23c993b89fca4 P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:33.740789  9590 raft_consensus.cc:740] T 3c53f31a2697499cb5ad2d5bb6715f02 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.741782  9593 raft_consensus.cc:359] T 074269f6e5f843be8a85be8b70707304 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:33.742553  9593 raft_consensus.cc:385] T 074269f6e5f843be8a85be8b70707304 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:33.742656  9592 ts_tablet_manager.cc:1434] T b2a7ad91c8474397bae23c993b89fca4 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:04:33.742864  9593 raft_consensus.cc:740] T 074269f6e5f843be8a85be8b70707304 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.743877  9593 consensus_queue.cc:260] T 074269f6e5f843be8a85be8b70707304 P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:33.744582  9591 ts_tablet_manager.cc:1434] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.001s
I20260709 13:04:33.745498  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3a3d4fd34924b7c8ed0df6709391329" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8"
I20260709 13:04:33.746066  9321 raft_consensus.cc:3060] T f3a3d4fd34924b7c8ed0df6709391329 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.746477  9593 ts_tablet_manager.cc:1434] T 074269f6e5f843be8a85be8b70707304 P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 13:04:33.747591  9593 tablet_bootstrap.cc:492] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:33.748585  9590 consensus_queue.cc:260] T 3c53f31a2697499cb5ad2d5bb6715f02 P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:33.751959  9590 ts_tablet_manager.cc:1434] T 3c53f31a2697499cb5ad2d5bb6715f02 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:04:33.753011  9590 tablet_bootstrap.cc:492] T 6f213937fc9b4030a228a8e56ed80f52 P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
I20260709 13:04:33.733397  9364 leader_election.cc:304] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49; no voters: 932245f14aac417f913cc7330a1833b8, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:33.757467  9591 tablet_bootstrap.cc:492] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:33.758958  9545 raft_consensus.cc:2468] T f3a3d4fd34924b7c8ed0df6709391329 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 1.
I20260709 13:04:33.759647  9590 tablet_bootstrap.cc:654] T 6f213937fc9b4030a228a8e56ed80f52 P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:33.760471  9438 leader_election.cc:304] T f3a3d4fd34924b7c8ed0df6709391329 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:33.765673  9755 raft_consensus.cc:2804] T f3a3d4fd34924b7c8ed0df6709391329 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:33.766368  9687 raft_consensus.cc:2749] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:33.766929  9593 tablet_bootstrap.cc:654] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:33.768244  9692 consensus_queue.cc:1048] T ab069642e354446db85dabd0cedd7eec P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:33.771878  9755 raft_consensus.cc:697] T f3a3d4fd34924b7c8ed0df6709391329 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Becoming Leader. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Running, Role: LEADER
I20260709 13:04:33.744313  9592 tablet_bootstrap.cc:492] T 074269f6e5f843be8a85be8b70707304 P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:33.784340  9755 consensus_queue.cc:237] T f3a3d4fd34924b7c8ed0df6709391329 P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:33.797684  9321 raft_consensus.cc:2468] T f3a3d4fd34924b7c8ed0df6709391329 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 1.
I20260709 13:04:33.799340  9650 raft_consensus.cc:493] T a541a15041a3493dab6cbe921d81d1d7 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.800187  9650 raft_consensus.cc:515] T a541a15041a3493dab6cbe921d81d1d7 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:33.803709  9650 leader_election.cc:290] T a541a15041a3493dab6cbe921d81d1d7 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:33.806183  9606 raft_consensus.cc:493] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.806740  9606 raft_consensus.cc:515] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:33.807492  9757 raft_consensus.cc:493] T b2a7ad91c8474397bae23c993b89fca4 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.808188  9757 raft_consensus.cc:515] T b2a7ad91c8474397bae23c993b89fca4 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:33.810509  9394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64bc8ad603604e0d9c8eb9d37ef4aed5" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:33.811347  9394 raft_consensus.cc:2393] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 932245f14aac417f913cc7330a1833b8 in current term 1: Already voted for candidate ef5fe58eb3e04ae18fda957b4d507eff in this term.
I20260709 13:04:33.811239  9757 leader_election.cc:290] T b2a7ad91c8474397bae23c993b89fca4 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:33.808836  9606 leader_election.cc:290] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:33.814975  9591 tablet_bootstrap.cc:654] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:33.816633  9545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2a7ad91c8474397bae23c993b89fca4" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:33.819545  9692 raft_consensus.cc:493] T 47b7a6191c374a6a84d8223c573fa318 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.820472  9593 tablet_bootstrap.cc:492] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:33.820153  9692 raft_consensus.cc:515] T 47b7a6191c374a6a84d8223c573fa318 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:33.821135  9593 ts_tablet_manager.cc:1403] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.074s	user 0.005s	sys 0.016s
W20260709 13:04:33.825122  9438 leader_election.cc:343] T b2a7ad91c8474397bae23c993b89fca4 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:33.824506  9593 raft_consensus.cc:359] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:33.826042  9593 raft_consensus.cc:385] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:33.828303  9593 raft_consensus.cc:740] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.828886  9702 consensus_queue.cc:1048] T ab069642e354446db85dabd0cedd7eec P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:33.829391  9593 consensus_queue.cc:260] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:33.831586  9702 raft_consensus.cc:493] T 6f213937fc9b4030a228a8e56ed80f52 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.832244  9702 raft_consensus.cc:515] T 6f213937fc9b4030a228a8e56ed80f52 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:33.833768  9692 leader_election.cc:290] T 47b7a6191c374a6a84d8223c573fa318 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:33.834472  9702 leader_election.cc:290] T 6f213937fc9b4030a228a8e56ed80f52 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:33.835171  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2a7ad91c8474397bae23c993b89fca4" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:33.835479  9396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b7a6191c374a6a84d8223c573fa318" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:33.836848  9593 ts_tablet_manager.cc:1434] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:04:33.863023  9396 raft_consensus.cc:2468] T 47b7a6191c374a6a84d8223c573fa318 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 0.
I20260709 13:04:33.863855  9593 tablet_bootstrap.cc:492] T b305803a339e40f99c1a6af7f6f84f7c P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:33.863219  9219 catalog_manager.cc:5697] T f3a3d4fd34924b7c8ed0df6709391329 P ef5fe58eb3e04ae18fda957b4d507eff reported cstate change: term changed from 0 to 1, leader changed from <none> to ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:33.864835  9436 leader_election.cc:304] T 47b7a6191c374a6a84d8223c573fa318 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:33.865971  9692 raft_consensus.cc:2804] T 47b7a6191c374a6a84d8223c573fa318 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:33.866632  9692 raft_consensus.cc:493] T 47b7a6191c374a6a84d8223c573fa318 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.867057  9692 raft_consensus.cc:3060] T 47b7a6191c374a6a84d8223c573fa318 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.832232  9590 tablet_bootstrap.cc:492] T 6f213937fc9b4030a228a8e56ed80f52 P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:33.841455  9543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f213937fc9b4030a228a8e56ed80f52" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:33.843629  9322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f213937fc9b4030a228a8e56ed80f52" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:33.871433  9590 ts_tablet_manager.cc:1403] T 6f213937fc9b4030a228a8e56ed80f52 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.119s	user 0.021s	sys 0.024s
W20260709 13:04:33.865990  9438 leader_election.cc:343] T b2a7ad91c8474397bae23c993b89fca4 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:33.875123  9438 leader_election.cc:304] T b2a7ad91c8474397bae23c993b89fca4 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef5fe58eb3e04ae18fda957b4d507eff; no voters: 932245f14aac417f913cc7330a1833b8, dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:33.847389  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a541a15041a3493dab6cbe921d81d1d7" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:33.844985  9592 tablet_bootstrap.cc:654] T 074269f6e5f843be8a85be8b70707304 P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:33.879933  9593 tablet_bootstrap.cc:654] T b305803a339e40f99c1a6af7f6f84f7c P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:33.849684  9546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a541a15041a3493dab6cbe921d81d1d7" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:33.851361  9545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b7a6191c374a6a84d8223c573fa318" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:33.874998  9590 raft_consensus.cc:359] T 6f213937fc9b4030a228a8e56ed80f52 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:33.845657  9471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64bc8ad603604e0d9c8eb9d37ef4aed5" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:33.884290  9590 raft_consensus.cc:385] T 6f213937fc9b4030a228a8e56ed80f52 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:33.884703  9590 raft_consensus.cc:740] T 6f213937fc9b4030a228a8e56ed80f52 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.885541  9590 consensus_queue.cc:260] T 6f213937fc9b4030a228a8e56ed80f52 P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:33.886016  9289 leader_election.cc:304] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 932245f14aac417f913cc7330a1833b8; no voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff
W20260709 13:04:33.888399  9364 leader_election.cc:343] T a541a15041a3493dab6cbe921d81d1d7 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:33.892519  9606 raft_consensus.cc:3060] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:33.892861  9364 leader_election.cc:343] T a541a15041a3493dab6cbe921d81d1d7 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:33.893388  9364 leader_election.cc:304] T a541a15041a3493dab6cbe921d81d1d7 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49; no voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:33.889240  9755 raft_consensus.cc:2749] T b2a7ad91c8474397bae23c993b89fca4 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:33.889879  9438 leader_election.cc:343] T 6f213937fc9b4030a228a8e56ed80f52 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:33.895756  9650 raft_consensus.cc:2749] T a541a15041a3493dab6cbe921d81d1d7 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:33.894883  9438 leader_election.cc:343] T 47b7a6191c374a6a84d8223c573fa318 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:33.898355  9591 tablet_bootstrap.cc:492] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:33.898896  9591 ts_tablet_manager.cc:1403] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.142s	user 0.017s	sys 0.015s
I20260709 13:04:33.900502  9692 raft_consensus.cc:515] T 47b7a6191c374a6a84d8223c573fa318 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:33.901217  9606 raft_consensus.cc:2749] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:33.903290  9590 ts_tablet_manager.cc:1434] T 6f213937fc9b4030a228a8e56ed80f52 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:04:33.907281  9590 tablet_bootstrap.cc:492] T b305803a339e40f99c1a6af7f6f84f7c P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
I20260709 13:04:33.905112  9593 tablet_bootstrap.cc:492] T b305803a339e40f99c1a6af7f6f84f7c P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:33.908712  9592 tablet_bootstrap.cc:492] T 074269f6e5f843be8a85be8b70707304 P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:33.909070  9593 ts_tablet_manager.cc:1403] T b305803a339e40f99c1a6af7f6f84f7c P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.012s
I20260709 13:04:33.909464  9592 ts_tablet_manager.cc:1403] T 074269f6e5f843be8a85be8b70707304 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.166s	user 0.011s	sys 0.010s
I20260709 13:04:33.910043  9591 raft_consensus.cc:359] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:33.910795  9591 raft_consensus.cc:385] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:33.911072  9591 raft_consensus.cc:740] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
W20260709 13:04:33.898368  9438 leader_election.cc:343] T 6f213937fc9b4030a228a8e56ed80f52 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:33.912168  9438 leader_election.cc:304] T 6f213937fc9b4030a228a8e56ed80f52 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef5fe58eb3e04ae18fda957b4d507eff; no voters: 932245f14aac417f913cc7330a1833b8, dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:33.913182  9755 raft_consensus.cc:2749] T 6f213937fc9b4030a228a8e56ed80f52 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:33.912623  9592 raft_consensus.cc:359] T 074269f6e5f843be8a85be8b70707304 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:33.914156  9590 tablet_bootstrap.cc:654] T b305803a339e40f99c1a6af7f6f84f7c P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:33.914325  9592 raft_consensus.cc:385] T 074269f6e5f843be8a85be8b70707304 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:33.912055  9593 raft_consensus.cc:359] T b305803a339e40f99c1a6af7f6f84f7c P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:33.915143  9593 raft_consensus.cc:385] T b305803a339e40f99c1a6af7f6f84f7c P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:33.914781  9592 raft_consensus.cc:740] T 074269f6e5f843be8a85be8b70707304 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.914783  9591 consensus_queue.cc:260] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:33.915158  9394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b7a6191c374a6a84d8223c573fa318" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:33.916092  9592 consensus_queue.cc:260] T 074269f6e5f843be8a85be8b70707304 P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:33.916987  9394 raft_consensus.cc:3060] T 47b7a6191c374a6a84d8223c573fa318 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.916414  9650 raft_consensus.cc:493] T 074269f6e5f843be8a85be8b70707304 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.921350  9692 leader_election.cc:290] T 47b7a6191c374a6a84d8223c573fa318 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Requested vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:33.921442  9650 raft_consensus.cc:515] T 074269f6e5f843be8a85be8b70707304 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:33.922408  9545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b7a6191c374a6a84d8223c573fa318" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
I20260709 13:04:33.924240  9650 leader_election.cc:290] T 074269f6e5f843be8a85be8b70707304 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:33.926481  9471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "074269f6e5f843be8a85be8b70707304" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:33.927451  9471 raft_consensus.cc:2468] T 074269f6e5f843be8a85be8b70707304 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 0.
I20260709 13:04:33.929636  9545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "074269f6e5f843be8a85be8b70707304" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:33.915588  9593 raft_consensus.cc:740] T b305803a339e40f99c1a6af7f6f84f7c P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.931675  9593 consensus_queue.cc:260] T b305803a339e40f99c1a6af7f6f84f7c P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:33.932204  9364 leader_election.cc:304] T 074269f6e5f843be8a85be8b70707304 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:33.935787  9691 raft_consensus.cc:2804] T 074269f6e5f843be8a85be8b70707304 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:33.936218  9691 raft_consensus.cc:493] T 074269f6e5f843be8a85be8b70707304 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:33.936358  9364 leader_election.cc:343] T 074269f6e5f843be8a85be8b70707304 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:33.936713  9691 raft_consensus.cc:3060] T 074269f6e5f843be8a85be8b70707304 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.937175  9687 raft_consensus.cc:493] T b305803a339e40f99c1a6af7f6f84f7c P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.937731  9687 raft_consensus.cc:515] T b305803a339e40f99c1a6af7f6f84f7c P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
W20260709 13:04:33.939308  9438 leader_election.cc:343] T 47b7a6191c374a6a84d8223c573fa318 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:33.941303  9592 ts_tablet_manager.cc:1434] T 074269f6e5f843be8a85be8b70707304 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:04:33.941391  9687 leader_election.cc:290] T b305803a339e40f99c1a6af7f6f84f7c P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:33.944001  9593 ts_tablet_manager.cc:1434] T b305803a339e40f99c1a6af7f6f84f7c P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:04:33.943964  9545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b305803a339e40f99c1a6af7f6f84f7c" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:33.945704  9593 tablet_bootstrap.cc:492] T 846ce8cad343420485af76370f029d54 P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
W20260709 13:04:33.946859  9364 leader_election.cc:343] T b305803a339e40f99c1a6af7f6f84f7c P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:33.946944  9322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b305803a339e40f99c1a6af7f6f84f7c" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
W20260709 13:04:33.948788  9364 leader_election.cc:343] T b305803a339e40f99c1a6af7f6f84f7c P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:33.934278  9591 ts_tablet_manager.cc:1434] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:04:33.950501  9591 tablet_bootstrap.cc:492] T 6f213937fc9b4030a228a8e56ed80f52 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:33.934641  9394 raft_consensus.cc:2468] T 47b7a6191c374a6a84d8223c573fa318 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 1.
I20260709 13:04:33.955056  9436 leader_election.cc:304] T 47b7a6191c374a6a84d8223c573fa318 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:33.956950  9691 raft_consensus.cc:515] T 074269f6e5f843be8a85be8b70707304 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:33.965744  9606 raft_consensus.cc:493] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.959244  9757 consensus_queue.cc:1048] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:04:33.971786  9691 leader_election.cc:290] T 074269f6e5f843be8a85be8b70707304 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Requested vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:33.957190  9692 raft_consensus.cc:2804] T 47b7a6191c374a6a84d8223c573fa318 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:33.975543  9692 raft_consensus.cc:697] T 47b7a6191c374a6a84d8223c573fa318 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Becoming Leader. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Running, Role: LEADER
I20260709 13:04:33.970929  9606 raft_consensus.cc:515] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:33.979306  9692 consensus_queue.cc:237] T 47b7a6191c374a6a84d8223c573fa318 P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:33.977839  9755 consensus_queue.cc:1048] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Connected to new peer: Peer: permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:33.980912  9545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c53f31a2697499cb5ad2d5bb6715f02" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:33.971788  9592 tablet_bootstrap.cc:492] T 58d4c6d168b449f98425d091c54cddb9 P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:33.981640  9545 raft_consensus.cc:2468] T 3c53f31a2697499cb5ad2d5bb6715f02 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 0.
I20260709 13:04:33.981587  9606 leader_election.cc:290] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:33.995038  9398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c53f31a2697499cb5ad2d5bb6715f02" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:33.995780  9398 raft_consensus.cc:2468] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 0.
I20260709 13:04:33.998984  9590 tablet_bootstrap.cc:492] T b305803a339e40f99c1a6af7f6f84f7c P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:34.000013  9590 ts_tablet_manager.cc:1403] T b305803a339e40f99c1a6af7f6f84f7c P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.093s	user 0.014s	sys 0.022s
I20260709 13:04:34.001214  9287 leader_election.cc:304] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, a91e8b10a5984dec9d3777a7275cef49; no voters: 
I20260709 13:04:34.003010  9591 tablet_bootstrap.cc:654] T 6f213937fc9b4030a228a8e56ed80f52 P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:33.949393  9364 leader_election.cc:304] T b305803a339e40f99c1a6af7f6f84f7c P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49; no voters: 932245f14aac417f913cc7330a1833b8, dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:34.006948  9606 raft_consensus.cc:2804] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:34.015863  9606 raft_consensus.cc:493] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.016297  9606 raft_consensus.cc:3060] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.018985  9590 raft_consensus.cc:359] T b305803a339e40f99c1a6af7f6f84f7c P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:34.019723  9590 raft_consensus.cc:385] T b305803a339e40f99c1a6af7f6f84f7c P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.020027  9590 raft_consensus.cc:740] T b305803a339e40f99c1a6af7f6f84f7c P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.020879  9590 consensus_queue.cc:260] T b305803a339e40f99c1a6af7f6f84f7c P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:34.023046  9590 ts_tablet_manager.cc:1434] T b305803a339e40f99c1a6af7f6f84f7c P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:04:34.023912  9650 raft_consensus.cc:2749] T b305803a339e40f99c1a6af7f6f84f7c P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:34.024111  9364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37633, user_credentials={real_user=slave}} blocked reactor thread for 75354.9us
I20260709 13:04:34.025908  9471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "074269f6e5f843be8a85be8b70707304" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:34.026842  9471 raft_consensus.cc:3060] T 074269f6e5f843be8a85be8b70707304 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.027607  9590 tablet_bootstrap.cc:492] T 47b7a6191c374a6a84d8223c573fa318 P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
I20260709 13:04:34.028793  9545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "074269f6e5f843be8a85be8b70707304" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
I20260709 13:04:34.038800  9592 tablet_bootstrap.cc:654] T 58d4c6d168b449f98425d091c54cddb9 P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:34.042661  9364 leader_election.cc:343] T 074269f6e5f843be8a85be8b70707304 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.043481  9220 catalog_manager.cc:5697] T 47b7a6191c374a6a84d8223c573fa318 P ef5fe58eb3e04ae18fda957b4d507eff reported cstate change: term changed from 0 to 1, leader changed from <none> to ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:34.044544  9590 tablet_bootstrap.cc:654] T 47b7a6191c374a6a84d8223c573fa318 P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.044809  9471 raft_consensus.cc:2468] T 074269f6e5f843be8a85be8b70707304 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 1.
I20260709 13:04:34.074608  9593 tablet_bootstrap.cc:654] T 846ce8cad343420485af76370f029d54 P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.075413  9606 raft_consensus.cc:515] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:34.077934  9591 tablet_bootstrap.cc:492] T 6f213937fc9b4030a228a8e56ed80f52 P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:34.078471  9591 ts_tablet_manager.cc:1403] T 6f213937fc9b4030a228a8e56ed80f52 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.128s	user 0.014s	sys 0.000s
I20260709 13:04:34.079224  9606 leader_election.cc:290] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 election: Requested vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:34.081532  9545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c53f31a2697499cb5ad2d5bb6715f02" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
I20260709 13:04:34.080361  9364 leader_election.cc:304] T 074269f6e5f843be8a85be8b70707304 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:34.081844  9394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c53f31a2697499cb5ad2d5bb6715f02" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:34.082204  9545 raft_consensus.cc:3060] T 3c53f31a2697499cb5ad2d5bb6715f02 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.082509  9394 raft_consensus.cc:3060] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.082602  9650 raft_consensus.cc:2804] T 074269f6e5f843be8a85be8b70707304 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:34.083199  9650 raft_consensus.cc:697] T 074269f6e5f843be8a85be8b70707304 P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Becoming Leader. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Running, Role: LEADER
I20260709 13:04:34.084172  9650 consensus_queue.cc:237] T 074269f6e5f843be8a85be8b70707304 P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:34.087908  9591 raft_consensus.cc:359] T 6f213937fc9b4030a228a8e56ed80f52 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:34.088647  9591 raft_consensus.cc:385] T 6f213937fc9b4030a228a8e56ed80f52 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.089015  9591 raft_consensus.cc:740] T 6f213937fc9b4030a228a8e56ed80f52 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.089852  9591 consensus_queue.cc:260] T 6f213937fc9b4030a228a8e56ed80f52 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:34.093942  9394 raft_consensus.cc:2468] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 1.
I20260709 13:04:34.114421  9287 leader_election.cc:304] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, a91e8b10a5984dec9d3777a7275cef49; no voters: 
I20260709 13:04:34.114292  9752 consensus_queue.cc:1048] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:34.116303  9752 raft_consensus.cc:2804] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:34.117102  9752 raft_consensus.cc:697] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8 [term 1 LEADER]: Becoming Leader. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Running, Role: LEADER
I20260709 13:04:34.118255  9752 consensus_queue.cc:237] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:34.121417  9591 ts_tablet_manager.cc:1434] T 6f213937fc9b4030a228a8e56ed80f52 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 13:04:34.132730  9217 catalog_manager.cc:5697] T 074269f6e5f843be8a85be8b70707304 P a91e8b10a5984dec9d3777a7275cef49 reported cstate change: term changed from 0 to 1, leader changed from <none> to a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "a91e8b10a5984dec9d3777a7275cef49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:34.136685  9591 tablet_bootstrap.cc:492] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:34.137801  9593 tablet_bootstrap.cc:492] T 846ce8cad343420485af76370f029d54 P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:34.138327  9593 ts_tablet_manager.cc:1403] T 846ce8cad343420485af76370f029d54 P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.193s	user 0.011s	sys 0.009s
I20260709 13:04:34.132141  9606 consensus_queue.cc:1048] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:04:34.142349  9592 tablet_bootstrap.cc:492] T 58d4c6d168b449f98425d091c54cddb9 P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:34.143069  9592 ts_tablet_manager.cc:1403] T 58d4c6d168b449f98425d091c54cddb9 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.172s	user 0.016s	sys 0.022s
I20260709 13:04:34.148080  9592 raft_consensus.cc:359] T 58d4c6d168b449f98425d091c54cddb9 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:34.148926  9592 raft_consensus.cc:385] T 58d4c6d168b449f98425d091c54cddb9 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.149184  9592 raft_consensus.cc:740] T 58d4c6d168b449f98425d091c54cddb9 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.142966  9593 raft_consensus.cc:359] T 846ce8cad343420485af76370f029d54 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:34.150538  9593 raft_consensus.cc:385] T 846ce8cad343420485af76370f029d54 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.149850  9592 consensus_queue.cc:260] T 58d4c6d168b449f98425d091c54cddb9 P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:34.150944  9593 raft_consensus.cc:740] T 846ce8cad343420485af76370f029d54 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.155412  9592 ts_tablet_manager.cc:1434] T 58d4c6d168b449f98425d091c54cddb9 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:04:34.157052  9545 raft_consensus.cc:2468] T 3c53f31a2697499cb5ad2d5bb6715f02 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 1.
I20260709 13:04:34.159716  9590 tablet_bootstrap.cc:492] T 47b7a6191c374a6a84d8223c573fa318 P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:34.161320  9590 ts_tablet_manager.cc:1403] T 47b7a6191c374a6a84d8223c573fa318 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.134s	user 0.018s	sys 0.000s
I20260709 13:04:34.164853  9590 raft_consensus.cc:359] T 47b7a6191c374a6a84d8223c573fa318 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:34.165571  9590 raft_consensus.cc:385] T 47b7a6191c374a6a84d8223c573fa318 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.165831  9590 raft_consensus.cc:740] T 47b7a6191c374a6a84d8223c573fa318 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.167662  9590 consensus_queue.cc:260] T 47b7a6191c374a6a84d8223c573fa318 P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:34.171810  9593 consensus_queue.cc:260] T 846ce8cad343420485af76370f029d54 P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:34.179001  9591 tablet_bootstrap.cc:654] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.182011  9687 raft_consensus.cc:493] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.182598  9593 ts_tablet_manager.cc:1434] T 846ce8cad343420485af76370f029d54 P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.002s
I20260709 13:04:34.188489  9687 raft_consensus.cc:515] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:34.189549  9593 tablet_bootstrap.cc:492] T 03c7fe8d164d4b2c9015337d9b4b7081 P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:34.182873  9217 catalog_manager.cc:5697] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 932245f14aac417f913cc7330a1833b8 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "932245f14aac417f913cc7330a1833b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:34.192139  9592 tablet_bootstrap.cc:492] T 846ce8cad343420485af76370f029d54 P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:34.192394  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a7d590cbac4b6da413dd8ea2a26225" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
W20260709 13:04:34.194140  9364 leader_election.cc:343] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.195464  9687 leader_election.cc:290] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:34.181774  9590 ts_tablet_manager.cc:1434] T 47b7a6191c374a6a84d8223c573fa318 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:04:34.197263  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a7d590cbac4b6da413dd8ea2a26225" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:34.197585  9590 tablet_bootstrap.cc:492] T b2a7ad91c8474397bae23c993b89fca4 P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
W20260709 13:04:34.198834  9364 leader_election.cc:343] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.199353  9364 leader_election.cc:304] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49; no voters: 932245f14aac417f913cc7330a1833b8, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:34.200564  9687 raft_consensus.cc:2749] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:34.203840  9590 tablet_bootstrap.cc:654] T b2a7ad91c8474397bae23c993b89fca4 P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.211268  9592 tablet_bootstrap.cc:654] T 846ce8cad343420485af76370f029d54 P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.215780  9593 tablet_bootstrap.cc:654] T 03c7fe8d164d4b2c9015337d9b4b7081 P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.217408  9591 tablet_bootstrap.cc:492] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:34.218091  9591 ts_tablet_manager.cc:1403] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.084s	user 0.009s	sys 0.005s
I20260709 13:04:34.221573  9591 raft_consensus.cc:359] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:34.237229  9591 raft_consensus.cc:385] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.237658  9591 raft_consensus.cc:740] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.240723  9709 raft_consensus.cc:493] T 6f213937fc9b4030a228a8e56ed80f52 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.241542  9709 raft_consensus.cc:515] T 6f213937fc9b4030a228a8e56ed80f52 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:34.239745  9591 consensus_queue.cc:260] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:34.244356  9709 leader_election.cc:290] T 6f213937fc9b4030a228a8e56ed80f52 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:34.247179  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f213937fc9b4030a228a8e56ed80f52" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:34.247359  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f213937fc9b4030a228a8e56ed80f52" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:34.248178  9321 raft_consensus.cc:2468] T 6f213937fc9b4030a228a8e56ed80f52 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 0.
I20260709 13:04:34.248360  9472 raft_consensus.cc:2468] T 6f213937fc9b4030a228a8e56ed80f52 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 0.
I20260709 13:04:34.249958  9512 leader_election.cc:304] T 6f213937fc9b4030a228a8e56ed80f52 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 
I20260709 13:04:34.255012  9709 raft_consensus.cc:2804] T 6f213937fc9b4030a228a8e56ed80f52 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:34.255712  9709 raft_consensus.cc:493] T 6f213937fc9b4030a228a8e56ed80f52 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.256165  9709 raft_consensus.cc:3060] T 6f213937fc9b4030a228a8e56ed80f52 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.265406  9757 consensus_queue.cc:1048] T f3a3d4fd34924b7c8ed0df6709391329 P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Connected to new peer: Peer: permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:34.321873  9590 tablet_bootstrap.cc:492] T b2a7ad91c8474397bae23c993b89fca4 P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:34.322505  9590 ts_tablet_manager.cc:1403] T b2a7ad91c8474397bae23c993b89fca4 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.125s	user 0.009s	sys 0.004s
I20260709 13:04:34.325802  9590 raft_consensus.cc:359] T b2a7ad91c8474397bae23c993b89fca4 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:34.342954  9590 raft_consensus.cc:385] T b2a7ad91c8474397bae23c993b89fca4 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.343482  9590 raft_consensus.cc:740] T b2a7ad91c8474397bae23c993b89fca4 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.350720  9599 raft_consensus.cc:493] T b305803a339e40f99c1a6af7f6f84f7c P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.351303  9599 raft_consensus.cc:515] T b305803a339e40f99c1a6af7f6f84f7c P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:34.354410  9606 raft_consensus.cc:493] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.356716  9606 raft_consensus.cc:515] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:34.358911  9606 leader_election.cc:290] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:34.360239  9396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d4c6d168b449f98425d091c54cddb9" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:34.360956  9396 raft_consensus.cc:2468] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 0.
I20260709 13:04:34.361435  9590 consensus_queue.cc:260] T b2a7ad91c8474397bae23c993b89fca4 P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:34.362401  9287 leader_election.cc:304] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, a91e8b10a5984dec9d3777a7275cef49; no voters: 
I20260709 13:04:34.362877  9591 ts_tablet_manager.cc:1434] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.144s	user 0.005s	sys 0.003s
I20260709 13:04:34.363703  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d4c6d168b449f98425d091c54cddb9" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:34.364061  9591 tablet_bootstrap.cc:492] T b2a7ad91c8474397bae23c993b89fca4 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:34.364209  9752 raft_consensus.cc:2804] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:34.364393  9472 raft_consensus.cc:2468] T 58d4c6d168b449f98425d091c54cddb9 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 0.
I20260709 13:04:34.364705  9752 raft_consensus.cc:493] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.365204  9752 raft_consensus.cc:3060] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.371987  9590 ts_tablet_manager.cc:1434] T b2a7ad91c8474397bae23c993b89fca4 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.002s
I20260709 13:04:34.374282  9592 tablet_bootstrap.cc:492] T 846ce8cad343420485af76370f029d54 P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:34.376513  9590 tablet_bootstrap.cc:492] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
I20260709 13:04:34.376992  9709 raft_consensus.cc:515] T 6f213937fc9b4030a228a8e56ed80f52 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:34.379274  9709 leader_election.cc:290] T 6f213937fc9b4030a228a8e56ed80f52 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Requested vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:34.375128  9592 ts_tablet_manager.cc:1403] T 846ce8cad343420485af76370f029d54 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.183s	user 0.033s	sys 0.045s
I20260709 13:04:34.382777  9592 raft_consensus.cc:359] T 846ce8cad343420485af76370f029d54 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:34.383535  9592 raft_consensus.cc:385] T 846ce8cad343420485af76370f029d54 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.383813  9592 raft_consensus.cc:740] T 846ce8cad343420485af76370f029d54 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.384563  9592 consensus_queue.cc:260] T 846ce8cad343420485af76370f029d54 P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:34.385113  9599 leader_election.cc:290] T b305803a339e40f99c1a6af7f6f84f7c P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:34.386271  9592 ts_tablet_manager.cc:1434] T 846ce8cad343420485af76370f029d54 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:34.387465  9592 tablet_bootstrap.cc:492] T 03c7fe8d164d4b2c9015337d9b4b7081 P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
W20260709 13:04:34.392765  9512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37633, user_credentials={real_user=slave}} blocked reactor thread for 141766us
I20260709 13:04:34.405789  9752 raft_consensus.cc:515] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:34.419798  9593 tablet_bootstrap.cc:492] T 03c7fe8d164d4b2c9015337d9b4b7081 P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:34.420413  9593 ts_tablet_manager.cc:1403] T 03c7fe8d164d4b2c9015337d9b4b7081 P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.231s	user 0.011s	sys 0.006s
I20260709 13:04:34.420516  9591 tablet_bootstrap.cc:654] T b2a7ad91c8474397bae23c993b89fca4 P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.422859  9396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b305803a339e40f99c1a6af7f6f84f7c" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:34.433593  9396 raft_consensus.cc:2468] T b305803a339e40f99c1a6af7f6f84f7c P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 0.
I20260709 13:04:34.438005  9593 raft_consensus.cc:359] T 03c7fe8d164d4b2c9015337d9b4b7081 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:34.439627  9593 raft_consensus.cc:385] T 03c7fe8d164d4b2c9015337d9b4b7081 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.439981  9593 raft_consensus.cc:740] T 03c7fe8d164d4b2c9015337d9b4b7081 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.446041  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f213937fc9b4030a228a8e56ed80f52" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:34.446769  9472 raft_consensus.cc:3060] T 6f213937fc9b4030a228a8e56ed80f52 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.453441  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b305803a339e40f99c1a6af7f6f84f7c" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:34.454790  9752 leader_election.cc:290] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 election: Requested vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:34.455866  9396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d4c6d168b449f98425d091c54cddb9" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:34.456494  9396 raft_consensus.cc:3060] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.460728  9472 raft_consensus.cc:2468] T 6f213937fc9b4030a228a8e56ed80f52 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 1.
I20260709 13:04:34.464056  9546 raft_consensus.cc:3060] T 47b7a6191c374a6a84d8223c573fa318 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.469281  9593 consensus_queue.cc:260] T 03c7fe8d164d4b2c9015337d9b4b7081 P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:34.479449  9757 consensus_queue.cc:1048] T 47b7a6191c374a6a84d8223c573fa318 P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:34.480906  9593 ts_tablet_manager.cc:1434] T 03c7fe8d164d4b2c9015337d9b4b7081 P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.000s
I20260709 13:04:34.482506  9593 tablet_bootstrap.cc:492] T a25f8459a3644bfcaf8f9d71705b1c33 P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
W20260709 13:04:34.421903  9289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38559, user_credentials={real_user=slave}} blocked reactor thread for 45394.7us
I20260709 13:04:34.461665  9322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f213937fc9b4030a228a8e56ed80f52" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8"
I20260709 13:04:34.486763  9322 raft_consensus.cc:3060] T 6f213937fc9b4030a228a8e56ed80f52 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.488127  9590 tablet_bootstrap.cc:654] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.467574  9510 leader_election.cc:304] T b305803a339e40f99c1a6af7f6f84f7c P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 
W20260709 13:04:34.489480  9512 leader_election.cc:343] T b305803a339e40f99c1a6af7f6f84f7c P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.489699  9867 raft_consensus.cc:2804] T b305803a339e40f99c1a6af7f6f84f7c P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:34.490119  9867 raft_consensus.cc:493] T b305803a339e40f99c1a6af7f6f84f7c P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.490502  9867 raft_consensus.cc:3060] T b305803a339e40f99c1a6af7f6f84f7c P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.465862  9396 raft_consensus.cc:2468] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 1.
I20260709 13:04:34.494045  9287 leader_election.cc:304] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, a91e8b10a5984dec9d3777a7275cef49; no voters: 
I20260709 13:04:34.495453  9471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d4c6d168b449f98425d091c54cddb9" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:34.496138  9471 raft_consensus.cc:3060] T 58d4c6d168b449f98425d091c54cddb9 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.498193  9606 raft_consensus.cc:2804] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:34.498692  9606 raft_consensus.cc:697] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8 [term 1 LEADER]: Becoming Leader. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Running, Role: LEADER
I20260709 13:04:34.499457  9606 consensus_queue.cc:237] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:34.495393  9592 tablet_bootstrap.cc:654] T 03c7fe8d164d4b2c9015337d9b4b7081 P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.507923  9867 raft_consensus.cc:515] T b305803a339e40f99c1a6af7f6f84f7c P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
W20260709 13:04:34.511029  9510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33607, user_credentials={real_user=slave}} blocked reactor thread for 43541.3us
I20260709 13:04:34.513010  9846 consensus_queue.cc:1048] T f3a3d4fd34924b7c8ed0df6709391329 P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:04:34.518538  9512 leader_election.cc:304] T 6f213937fc9b4030a228a8e56ed80f52 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:34.519495  9866 raft_consensus.cc:2804] T 6f213937fc9b4030a228a8e56ed80f52 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:34.520015  9866 raft_consensus.cc:697] T 6f213937fc9b4030a228a8e56ed80f52 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Becoming Leader. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Running, Role: LEADER
I20260709 13:04:34.520866  9866 consensus_queue.cc:237] T 6f213937fc9b4030a228a8e56ed80f52 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:34.522730  9471 raft_consensus.cc:2468] T 58d4c6d168b449f98425d091c54cddb9 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 1.
I20260709 13:04:34.531055  9846 consensus_queue.cc:1048] T 47b7a6191c374a6a84d8223c573fa318 P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:34.536547  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b305803a339e40f99c1a6af7f6f84f7c" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8"
W20260709 13:04:34.539479  9512 leader_election.cc:343] T b305803a339e40f99c1a6af7f6f84f7c P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.546720  9591 tablet_bootstrap.cc:492] T b2a7ad91c8474397bae23c993b89fca4 P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:34.547446  9591 ts_tablet_manager.cc:1403] T b2a7ad91c8474397bae23c993b89fca4 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.184s	user 0.018s	sys 0.001s
I20260709 13:04:34.549275  9322 raft_consensus.cc:2468] T 6f213937fc9b4030a228a8e56ed80f52 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 1.
I20260709 13:04:34.560462  9867 leader_election.cc:290] T b305803a339e40f99c1a6af7f6f84f7c P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Requested vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
W20260709 13:04:34.569957  9268 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:34.570101  9398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b305803a339e40f99c1a6af7f6f84f7c" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:34.576359  9398 raft_consensus.cc:3060] T b305803a339e40f99c1a6af7f6f84f7c P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.592651  9872 consensus_queue.cc:1048] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:34.597500  9220 catalog_manager.cc:5697] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 932245f14aac417f913cc7330a1833b8 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "932245f14aac417f913cc7330a1833b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:34.604218  9398 raft_consensus.cc:2468] T b305803a339e40f99c1a6af7f6f84f7c P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 1.
I20260709 13:04:34.606958  9593 tablet_bootstrap.cc:654] T a25f8459a3644bfcaf8f9d71705b1c33 P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.617069  9510 leader_election.cc:304] T b305803a339e40f99c1a6af7f6f84f7c P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 932245f14aac417f913cc7330a1833b8
I20260709 13:04:34.618068  9599 raft_consensus.cc:2804] T b305803a339e40f99c1a6af7f6f84f7c P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:34.618561  9599 raft_consensus.cc:697] T b305803a339e40f99c1a6af7f6f84f7c P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Becoming Leader. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Running, Role: LEADER
I20260709 13:04:34.619297  9599 consensus_queue.cc:237] T b305803a339e40f99c1a6af7f6f84f7c P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:34.621580  9591 raft_consensus.cc:359] T b2a7ad91c8474397bae23c993b89fca4 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:34.622345  9591 raft_consensus.cc:385] T b2a7ad91c8474397bae23c993b89fca4 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.626772  9591 raft_consensus.cc:740] T b2a7ad91c8474397bae23c993b89fca4 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.632515  9591 consensus_queue.cc:260] T b2a7ad91c8474397bae23c993b89fca4 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:34.645522  9687 raft_consensus.cc:493] T 846ce8cad343420485af76370f029d54 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.646409  9870 raft_consensus.cc:493] T b2a7ad91c8474397bae23c993b89fca4 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.646350  9687 raft_consensus.cc:515] T 846ce8cad343420485af76370f029d54 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:34.647019  9870 raft_consensus.cc:515] T b2a7ad91c8474397bae23c993b89fca4 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:34.652518  9471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2a7ad91c8474397bae23c993b89fca4" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:34.653429  9471 raft_consensus.cc:2468] T b2a7ad91c8474397bae23c993b89fca4 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 0.
W20260709 13:04:34.656455  9364 consensus_peers.cc:597] T 074269f6e5f843be8a85be8b70707304 P a91e8b10a5984dec9d3777a7275cef49 -> Peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Couldn't send request to peer dfbbb80ab8e345e0ae1684fafefceccf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.658730  9870 leader_election.cc:290] T b2a7ad91c8474397bae23c993b89fca4 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:34.655972  9217 catalog_manager.cc:5697] T 6f213937fc9b4030a228a8e56ed80f52 P dfbbb80ab8e345e0ae1684fafefceccf reported cstate change: term changed from 0 to 1, leader changed from <none> to dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196). New cstate: current_term: 1 leader_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:34.665653  9591 ts_tablet_manager.cc:1434] T b2a7ad91c8474397bae23c993b89fca4 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.118s	user 0.007s	sys 0.000s
I20260709 13:04:34.666898  9591 tablet_bootstrap.cc:492] T e97eecc3acdf46a5b5577416f7bfe336 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:34.673106  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2a7ad91c8474397bae23c993b89fca4" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:34.674146  9321 raft_consensus.cc:2468] T b2a7ad91c8474397bae23c993b89fca4 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 0.
I20260709 13:04:34.677702  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "846ce8cad343420485af76370f029d54" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
W20260709 13:04:34.679771  9364 leader_election.cc:343] T 846ce8cad343420485af76370f029d54 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.659500  9512 leader_election.cc:304] T b2a7ad91c8474397bae23c993b89fca4 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:34.681113  9867 raft_consensus.cc:2804] T b2a7ad91c8474397bae23c993b89fca4 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:34.681494  9867 raft_consensus.cc:493] T b2a7ad91c8474397bae23c993b89fca4 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.681840  9867 raft_consensus.cc:3060] T b2a7ad91c8474397bae23c993b89fca4 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.685906  9592 tablet_bootstrap.cc:492] T 03c7fe8d164d4b2c9015337d9b4b7081 P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:34.686439  9592 ts_tablet_manager.cc:1403] T 03c7fe8d164d4b2c9015337d9b4b7081 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.299s	user 0.013s	sys 0.003s
I20260709 13:04:34.733649  9591 tablet_bootstrap.cc:654] T e97eecc3acdf46a5b5577416f7bfe336 P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.735697  9590 tablet_bootstrap.cc:492] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:34.736387  9590 ts_tablet_manager.cc:1403] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.363s	user 0.019s	sys 0.021s
I20260709 13:04:34.712502  9687 leader_election.cc:290] T 846ce8cad343420485af76370f029d54 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
W20260709 13:04:34.744362  9878 log.cc:927] Time spent T f3a3d4fd34924b7c8ed0df6709391329 P dfbbb80ab8e345e0ae1684fafefceccf: Append to log took a long time: real 0.055s	user 0.000s	sys 0.002s
I20260709 13:04:34.745028  9606 consensus_queue.cc:1048] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:34.751334  9593 tablet_bootstrap.cc:492] T a25f8459a3644bfcaf8f9d71705b1c33 P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:34.752015  9593 ts_tablet_manager.cc:1403] T a25f8459a3644bfcaf8f9d71705b1c33 P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.270s	user 0.023s	sys 0.018s
I20260709 13:04:34.752243  9471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "846ce8cad343420485af76370f029d54" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:34.752934  9471 raft_consensus.cc:2468] T 846ce8cad343420485af76370f029d54 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 0.
I20260709 13:04:34.754571  9364 leader_election.cc:304] T 846ce8cad343420485af76370f029d54 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 932245f14aac417f913cc7330a1833b8
I20260709 13:04:34.755184  9593 raft_consensus.cc:359] T a25f8459a3644bfcaf8f9d71705b1c33 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:34.755934  9593 raft_consensus.cc:385] T a25f8459a3644bfcaf8f9d71705b1c33 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.756327  9593 raft_consensus.cc:740] T a25f8459a3644bfcaf8f9d71705b1c33 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.757117  9593 consensus_queue.cc:260] T a25f8459a3644bfcaf8f9d71705b1c33 P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:34.747560  9217 catalog_manager.cc:5697] T b305803a339e40f99c1a6af7f6f84f7c P dfbbb80ab8e345e0ae1684fafefceccf reported cstate change: term changed from 0 to 1, leader changed from <none> to dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196). New cstate: current_term: 1 leader_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:34.777958  9590 raft_consensus.cc:359] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:34.779089  9590 raft_consensus.cc:385] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.779429  9590 raft_consensus.cc:740] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.783953  9650 raft_consensus.cc:2804] T 846ce8cad343420485af76370f029d54 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:34.784562  9650 raft_consensus.cc:493] T 846ce8cad343420485af76370f029d54 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.786361  9590 consensus_queue.cc:260] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:34.802903  9592 raft_consensus.cc:359] T 03c7fe8d164d4b2c9015337d9b4b7081 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:34.806071  9592 raft_consensus.cc:385] T 03c7fe8d164d4b2c9015337d9b4b7081 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.806442  9592 raft_consensus.cc:740] T 03c7fe8d164d4b2c9015337d9b4b7081 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.794034  9650 raft_consensus.cc:3060] T 846ce8cad343420485af76370f029d54 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.815582  9593 ts_tablet_manager.cc:1434] T a25f8459a3644bfcaf8f9d71705b1c33 P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.063s	user 0.021s	sys 0.015s
I20260709 13:04:34.817181  9590 ts_tablet_manager.cc:1434] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.080s	user 0.009s	sys 0.002s
I20260709 13:04:34.808122  9592 consensus_queue.cc:260] T 03c7fe8d164d4b2c9015337d9b4b7081 P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:34.769053  9687 consensus_queue.cc:1048] T 074269f6e5f843be8a85be8b70707304 P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.036s
I20260709 13:04:34.784699  9867 raft_consensus.cc:515] T b2a7ad91c8474397bae23c993b89fca4 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:34.826934  9590 tablet_bootstrap.cc:492] T 074269f6e5f843be8a85be8b70707304 P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
I20260709 13:04:34.828658  9593 tablet_bootstrap.cc:492] T a792fefbeb0c4eb79e87501fb6dbe780 P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:34.829291  9592 ts_tablet_manager.cc:1434] T 03c7fe8d164d4b2c9015337d9b4b7081 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.143s	user 0.007s	sys 0.002s
I20260709 13:04:34.842869  9650 raft_consensus.cc:515] T 846ce8cad343420485af76370f029d54 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:34.845777  9650 leader_election.cc:290] T 846ce8cad343420485af76370f029d54 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Requested vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:34.847757  9867 leader_election.cc:290] T b2a7ad91c8474397bae23c993b89fca4 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Requested vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:34.848372  9471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2a7ad91c8474397bae23c993b89fca4" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:34.848909  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2a7ad91c8474397bae23c993b89fca4" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8"
I20260709 13:04:34.849038  9471 raft_consensus.cc:3060] T b2a7ad91c8474397bae23c993b89fca4 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.849650  9321 raft_consensus.cc:3060] T b2a7ad91c8474397bae23c993b89fca4 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.860987  9891 raft_consensus.cc:493] T 03c7fe8d164d4b2c9015337d9b4b7081 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.861660  9891 raft_consensus.cc:515] T 03c7fe8d164d4b2c9015337d9b4b7081 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:34.863637  9590 tablet_bootstrap.cc:654] T 074269f6e5f843be8a85be8b70707304 P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.868754  9592 tablet_bootstrap.cc:492] T ff040bb60327424d8aeec71e3bf58a0a P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:34.872779  9470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "846ce8cad343420485af76370f029d54" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:34.883137  9322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "846ce8cad343420485af76370f029d54" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8"
I20260709 13:04:34.884470  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c7fe8d164d4b2c9015337d9b4b7081" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:34.885239  9472 raft_consensus.cc:2468] T 03c7fe8d164d4b2c9015337d9b4b7081 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 0.
I20260709 13:04:34.892864  9470 raft_consensus.cc:3060] T 846ce8cad343420485af76370f029d54 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.899281  9546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c7fe8d164d4b2c9015337d9b4b7081" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:34.900267  9591 tablet_bootstrap.cc:492] T e97eecc3acdf46a5b5577416f7bfe336 P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:34.900799  9591 ts_tablet_manager.cc:1403] T e97eecc3acdf46a5b5577416f7bfe336 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.234s	user 0.029s	sys 0.054s
W20260709 13:04:34.903517  9364 leader_election.cc:343] T 03c7fe8d164d4b2c9015337d9b4b7081 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.904189  9591 raft_consensus.cc:359] T e97eecc3acdf46a5b5577416f7bfe336 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:34.905194  9591 raft_consensus.cc:385] T e97eecc3acdf46a5b5577416f7bfe336 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.905532  9591 raft_consensus.cc:740] T e97eecc3acdf46a5b5577416f7bfe336 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.906719  9591 consensus_queue.cc:260] T e97eecc3acdf46a5b5577416f7bfe336 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:34.908465  9591 ts_tablet_manager.cc:1434] T e97eecc3acdf46a5b5577416f7bfe336 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:34.904263  9364 leader_election.cc:304] T 03c7fe8d164d4b2c9015337d9b4b7081 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: dfbbb80ab8e345e0ae1684fafefceccf
W20260709 13:04:34.909785  9364 leader_election.cc:343] T 846ce8cad343420485af76370f029d54 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.910830  9687 raft_consensus.cc:2804] T 03c7fe8d164d4b2c9015337d9b4b7081 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:34.911463  9687 raft_consensus.cc:493] T 03c7fe8d164d4b2c9015337d9b4b7081 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.911929  9687 raft_consensus.cc:3060] T 03c7fe8d164d4b2c9015337d9b4b7081 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.880357  9891 leader_election.cc:290] T 03c7fe8d164d4b2c9015337d9b4b7081 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:34.911852  9591 tablet_bootstrap.cc:492] T a25f8459a3644bfcaf8f9d71705b1c33 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:34.920608  9321 raft_consensus.cc:2468] T b2a7ad91c8474397bae23c993b89fca4 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 1.
I20260709 13:04:34.922577  9593 tablet_bootstrap.cc:654] T a792fefbeb0c4eb79e87501fb6dbe780 P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.924386  9512 leader_election.cc:304] T b2a7ad91c8474397bae23c993b89fca4 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 
I20260709 13:04:34.925823  9592 tablet_bootstrap.cc:654] T ff040bb60327424d8aeec71e3bf58a0a P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.926927  9867 raft_consensus.cc:2804] T b2a7ad91c8474397bae23c993b89fca4 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:34.927439  9867 raft_consensus.cc:697] T b2a7ad91c8474397bae23c993b89fca4 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Becoming Leader. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Running, Role: LEADER
I20260709 13:04:34.928226  9867 consensus_queue.cc:237] T b2a7ad91c8474397bae23c993b89fca4 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:34.933907  9687 raft_consensus.cc:515] T 03c7fe8d164d4b2c9015337d9b4b7081 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:34.939797  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c7fe8d164d4b2c9015337d9b4b7081" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:34.940399  9870 consensus_queue.cc:1048] T 6f213937fc9b4030a228a8e56ed80f52 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:34.940858  9468 raft_consensus.cc:3060] T 03c7fe8d164d4b2c9015337d9b4b7081 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.952330  9709 raft_consensus.cc:493] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.953652  9709 raft_consensus.cc:515] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:34.955026  9546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c7fe8d164d4b2c9015337d9b4b7081" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
W20260709 13:04:34.956786  9364 leader_election.cc:343] T 03c7fe8d164d4b2c9015337d9b4b7081 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.958513  9687 leader_election.cc:290] T 03c7fe8d164d4b2c9015337d9b4b7081 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Requested vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:34.962272  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25f8459a3644bfcaf8f9d71705b1c33" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
W20260709 13:04:34.963861  9512 leader_election.cc:343] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.970311  9709 leader_election.cc:290] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:34.970546  9471 raft_consensus.cc:2468] T b2a7ad91c8474397bae23c993b89fca4 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 1.
I20260709 13:04:34.975615  9397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25f8459a3644bfcaf8f9d71705b1c33" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:34.976325  9397 raft_consensus.cc:2468] T a25f8459a3644bfcaf8f9d71705b1c33 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 0.
I20260709 13:04:34.979164  9510 leader_election.cc:304] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 932245f14aac417f913cc7330a1833b8
I20260709 13:04:34.980072  9709 raft_consensus.cc:2804] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:34.980481  9709 raft_consensus.cc:493] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.980840  9709 raft_consensus.cc:3060] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.991839  9592 tablet_bootstrap.cc:492] T ff040bb60327424d8aeec71e3bf58a0a P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:34.992419  9592 ts_tablet_manager.cc:1403] T ff040bb60327424d8aeec71e3bf58a0a P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.134s	user 0.009s	sys 0.007s
I20260709 13:04:34.997653  9592 raft_consensus.cc:359] T ff040bb60327424d8aeec71e3bf58a0a P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:34.998108  9470 raft_consensus.cc:2468] T 846ce8cad343420485af76370f029d54 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 1.
I20260709 13:04:34.998520  9592 raft_consensus.cc:385] T ff040bb60327424d8aeec71e3bf58a0a P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.998888  9592 raft_consensus.cc:740] T ff040bb60327424d8aeec71e3bf58a0a P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.999573  9364 leader_election.cc:304] T 846ce8cad343420485af76370f029d54 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 932245f14aac417f913cc7330a1833b8
I20260709 13:04:35.000491  9891 raft_consensus.cc:2804] T 846ce8cad343420485af76370f029d54 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:35.001061  9891 raft_consensus.cc:697] T 846ce8cad343420485af76370f029d54 P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Becoming Leader. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Running, Role: LEADER
I20260709 13:04:35.002211  9891 consensus_queue.cc:237] T 846ce8cad343420485af76370f029d54 P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:34.999997  9592 consensus_queue.cc:260] T ff040bb60327424d8aeec71e3bf58a0a P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:35.010382  9592 ts_tablet_manager.cc:1434] T ff040bb60327424d8aeec71e3bf58a0a P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.005s
I20260709 13:04:35.011740  9591 tablet_bootstrap.cc:654] T a25f8459a3644bfcaf8f9d71705b1c33 P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:35.020058  9592 tablet_bootstrap.cc:492] T a541a15041a3493dab6cbe921d81d1d7 P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:35.032361  9606 consensus_queue.cc:1048] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:35.033656  9593 tablet_bootstrap.cc:492] T a792fefbeb0c4eb79e87501fb6dbe780 P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:35.034001  9590 tablet_bootstrap.cc:492] T 074269f6e5f843be8a85be8b70707304 P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:35.034299  9593 ts_tablet_manager.cc:1403] T a792fefbeb0c4eb79e87501fb6dbe780 P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.212s	user 0.010s	sys 0.014s
I20260709 13:04:35.034497  9590 ts_tablet_manager.cc:1403] T 074269f6e5f843be8a85be8b70707304 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.208s	user 0.016s	sys 0.020s
I20260709 13:04:35.039755  9606 consensus_queue.cc:1048] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:35.041285  9468 raft_consensus.cc:2468] T 03c7fe8d164d4b2c9015337d9b4b7081 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 1.
I20260709 13:04:35.042872  9364 leader_election.cc:304] T 03c7fe8d164d4b2c9015337d9b4b7081 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:35.050570  9887 raft_consensus.cc:2804] T 03c7fe8d164d4b2c9015337d9b4b7081 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:35.054677  9592 tablet_bootstrap.cc:654] T a541a15041a3493dab6cbe921d81d1d7 P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:35.050730  9709 raft_consensus.cc:515] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:35.058869  9887 raft_consensus.cc:697] T 03c7fe8d164d4b2c9015337d9b4b7081 P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Becoming Leader. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Running, Role: LEADER
I20260709 13:04:35.059996  9887 consensus_queue.cc:237] T 03c7fe8d164d4b2c9015337d9b4b7081 P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:35.054638  9593 raft_consensus.cc:359] T a792fefbeb0c4eb79e87501fb6dbe780 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:35.062216  9593 raft_consensus.cc:385] T a792fefbeb0c4eb79e87501fb6dbe780 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:35.062613  9593 raft_consensus.cc:740] T a792fefbeb0c4eb79e87501fb6dbe780 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.060418  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25f8459a3644bfcaf8f9d71705b1c33" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8"
I20260709 13:04:35.074756  9217 catalog_manager.cc:5697] T b2a7ad91c8474397bae23c993b89fca4 P dfbbb80ab8e345e0ae1684fafefceccf reported cstate change: term changed from 0 to 1, leader changed from <none> to dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196). New cstate: current_term: 1 leader_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:35.082325  9709 leader_election.cc:290] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Requested vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:35.085198  9593 consensus_queue.cc:260] T a792fefbeb0c4eb79e87501fb6dbe780 P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:35.091708  9593 ts_tablet_manager.cc:1434] T a792fefbeb0c4eb79e87501fb6dbe780 P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.002s
I20260709 13:04:35.099255  9591 tablet_bootstrap.cc:492] T a25f8459a3644bfcaf8f9d71705b1c33 P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:35.099884  9591 ts_tablet_manager.cc:1403] T a25f8459a3644bfcaf8f9d71705b1c33 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.188s	user 0.024s	sys 0.009s
I20260709 13:04:35.119381  9398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25f8459a3644bfcaf8f9d71705b1c33" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:35.120146  9398 raft_consensus.cc:3060] T a25f8459a3644bfcaf8f9d71705b1c33 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.120507  9592 tablet_bootstrap.cc:492] T a541a15041a3493dab6cbe921d81d1d7 P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:35.121107  9592 ts_tablet_manager.cc:1403] T a541a15041a3493dab6cbe921d81d1d7 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.109s	user 0.027s	sys 0.016s
I20260709 13:04:35.124119  9592 raft_consensus.cc:359] T a541a15041a3493dab6cbe921d81d1d7 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
W20260709 13:04:35.109900  9512 leader_election.cc:343] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:35.124841  9592 raft_consensus.cc:385] T a541a15041a3493dab6cbe921d81d1d7 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:35.125196  9592 raft_consensus.cc:740] T a541a15041a3493dab6cbe921d81d1d7 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.124841  9846 raft_consensus.cc:493] T ff040bb60327424d8aeec71e3bf58a0a P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.126212  9592 consensus_queue.cc:260] T a541a15041a3493dab6cbe921d81d1d7 P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:35.126349  9846 raft_consensus.cc:515] T ff040bb60327424d8aeec71e3bf58a0a P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:35.133770  9869 consensus_queue.cc:1048] T 6f213937fc9b4030a228a8e56ed80f52 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Connected to new peer: Peer: permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:35.134811  9592 ts_tablet_manager.cc:1434] T a541a15041a3493dab6cbe921d81d1d7 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:04:35.135165  9591 raft_consensus.cc:359] T a25f8459a3644bfcaf8f9d71705b1c33 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:35.135905  9592 tablet_bootstrap.cc:492] T 93a7d590cbac4b6da413dd8ea2a26225 P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:35.144290  9592 tablet_bootstrap.cc:654] T 93a7d590cbac4b6da413dd8ea2a26225 P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:35.145757  9545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff040bb60327424d8aeec71e3bf58a0a" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:35.135845  9591 raft_consensus.cc:385] T a25f8459a3644bfcaf8f9d71705b1c33 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:35.146584  9591 raft_consensus.cc:740] T a25f8459a3644bfcaf8f9d71705b1c33 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.147289  9591 consensus_queue.cc:260] T a25f8459a3644bfcaf8f9d71705b1c33 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:35.150318  9846 leader_election.cc:290] T ff040bb60327424d8aeec71e3bf58a0a P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:35.154582  9590 raft_consensus.cc:359] T 074269f6e5f843be8a85be8b70707304 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:35.155364  9590 raft_consensus.cc:385] T 074269f6e5f843be8a85be8b70707304 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:35.155643  9590 raft_consensus.cc:740] T 074269f6e5f843be8a85be8b70707304 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.156317  9590 consensus_queue.cc:260] T 074269f6e5f843be8a85be8b70707304 P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:35.158414  9590 ts_tablet_manager.cc:1434] T 074269f6e5f843be8a85be8b70707304 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.124s	user 0.003s	sys 0.004s
W20260709 13:04:35.156477  9438 leader_election.cc:343] T ff040bb60327424d8aeec71e3bf58a0a P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:35.165552  9590 tablet_bootstrap.cc:492] T a541a15041a3493dab6cbe921d81d1d7 P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
I20260709 13:04:35.175781  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff040bb60327424d8aeec71e3bf58a0a" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
W20260709 13:04:35.182176  9438 leader_election.cc:343] T ff040bb60327424d8aeec71e3bf58a0a P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:35.183552  9438 leader_election.cc:304] T ff040bb60327424d8aeec71e3bf58a0a P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef5fe58eb3e04ae18fda957b4d507eff; no voters: 932245f14aac417f913cc7330a1833b8, dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:35.167567  9220 catalog_manager.cc:5697] T 846ce8cad343420485af76370f029d54 P a91e8b10a5984dec9d3777a7275cef49 reported cstate change: term changed from 0 to 1, leader changed from <none> to a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "a91e8b10a5984dec9d3777a7275cef49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:35.187098  9846 raft_consensus.cc:2749] T ff040bb60327424d8aeec71e3bf58a0a P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:35.190220  9593 tablet_bootstrap.cc:492] T 1a5145e5f9a64fe0acdd74d909e841fc P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:35.195480  9398 raft_consensus.cc:2468] T a25f8459a3644bfcaf8f9d71705b1c33 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 1.
I20260709 13:04:35.196812  9510 leader_election.cc:304] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 932245f14aac417f913cc7330a1833b8
I20260709 13:04:35.198144  9867 raft_consensus.cc:2804] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:35.198890  9867 raft_consensus.cc:697] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Becoming Leader. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Running, Role: LEADER
I20260709 13:04:35.202527  9590 tablet_bootstrap.cc:654] T a541a15041a3493dab6cbe921d81d1d7 P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:35.199820  9867 consensus_queue.cc:237] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:35.197029  9591 ts_tablet_manager.cc:1434] T a25f8459a3644bfcaf8f9d71705b1c33 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.097s	user 0.006s	sys 0.004s
W20260709 13:04:35.205754  9512 consensus_peers.cc:597] T b305803a339e40f99c1a6af7f6f84f7c P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:35.226647  9591 tablet_bootstrap.cc:492] T 93a7d590cbac4b6da413dd8ea2a26225 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:35.225638  9887 raft_consensus.cc:493] T a792fefbeb0c4eb79e87501fb6dbe780 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.229856  9893 raft_consensus.cc:493] T e97eecc3acdf46a5b5577416f7bfe336 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.242229  9893 raft_consensus.cc:515] T e97eecc3acdf46a5b5577416f7bfe336 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:35.244467  9893 leader_election.cc:290] T e97eecc3acdf46a5b5577416f7bfe336 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:35.245954  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97eecc3acdf46a5b5577416f7bfe336" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:35.246940  9323 raft_consensus.cc:2468] T e97eecc3acdf46a5b5577416f7bfe336 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 0.
I20260709 13:04:35.249632  9866 consensus_queue.cc:1048] T b305803a339e40f99c1a6af7f6f84f7c P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.249825  9364 leader_election.cc:304] T e97eecc3acdf46a5b5577416f7bfe336 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, a91e8b10a5984dec9d3777a7275cef49; no voters: 
I20260709 13:04:35.246179  9546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97eecc3acdf46a5b5577416f7bfe336" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:35.259915  9891 raft_consensus.cc:2804] T e97eecc3acdf46a5b5577416f7bfe336 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:35.267751  9592 tablet_bootstrap.cc:492] T 93a7d590cbac4b6da413dd8ea2a26225 P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:35.270665  9891 raft_consensus.cc:493] T e97eecc3acdf46a5b5577416f7bfe336 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:35.270943  9592 ts_tablet_manager.cc:1403] T 93a7d590cbac4b6da413dd8ea2a26225 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.135s	user 0.015s	sys 0.022s
I20260709 13:04:35.271138  9891 raft_consensus.cc:3060] T e97eecc3acdf46a5b5577416f7bfe336 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.251338  9887 raft_consensus.cc:515] T a792fefbeb0c4eb79e87501fb6dbe780 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:35.273437  9887 leader_election.cc:290] T a792fefbeb0c4eb79e87501fb6dbe780 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:35.274266  9592 raft_consensus.cc:359] T 93a7d590cbac4b6da413dd8ea2a26225 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:35.274998  9592 raft_consensus.cc:385] T 93a7d590cbac4b6da413dd8ea2a26225 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:35.275259  9592 raft_consensus.cc:740] T 93a7d590cbac4b6da413dd8ea2a26225 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.275944  9592 consensus_queue.cc:260] T 93a7d590cbac4b6da413dd8ea2a26225 P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:35.276731  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a792fefbeb0c4eb79e87501fb6dbe780" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:35.277995  9592 ts_tablet_manager.cc:1434] T 93a7d590cbac4b6da413dd8ea2a26225 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:04:35.279320  9592 tablet_bootstrap.cc:492] T 65ba9982e9bd4177995544e13394911a P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:35.276810  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a792fefbeb0c4eb79e87501fb6dbe780" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
W20260709 13:04:35.281816  9364 leader_election.cc:343] T a792fefbeb0c4eb79e87501fb6dbe780 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:35.282486  9364 leader_election.cc:343] T e97eecc3acdf46a5b5577416f7bfe336 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:35.283280  9364 leader_election.cc:343] T a792fefbeb0c4eb79e87501fb6dbe780 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:35.283507  9590 tablet_bootstrap.cc:492] T a541a15041a3493dab6cbe921d81d1d7 P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:35.284229  9590 ts_tablet_manager.cc:1403] T a541a15041a3493dab6cbe921d81d1d7 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.119s	user 0.027s	sys 0.014s
I20260709 13:04:35.269470  9591 tablet_bootstrap.cc:654] T 93a7d590cbac4b6da413dd8ea2a26225 P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:35.286247  9592 tablet_bootstrap.cc:654] T 65ba9982e9bd4177995544e13394911a P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:35.287395  9590 raft_consensus.cc:359] T a541a15041a3493dab6cbe921d81d1d7 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:35.283602  9364 leader_election.cc:304] T a792fefbeb0c4eb79e87501fb6dbe780 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49; no voters: 932245f14aac417f913cc7330a1833b8, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:35.288163  9590 raft_consensus.cc:385] T a541a15041a3493dab6cbe921d81d1d7 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:35.288430  9590 raft_consensus.cc:740] T a541a15041a3493dab6cbe921d81d1d7 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.288944  9893 raft_consensus.cc:2749] T a792fefbeb0c4eb79e87501fb6dbe780 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:35.289253  9590 consensus_queue.cc:260] T a541a15041a3493dab6cbe921d81d1d7 P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:35.291075  9593 tablet_bootstrap.cc:654] T 1a5145e5f9a64fe0acdd74d909e841fc P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:35.291718  9590 ts_tablet_manager.cc:1434] T a541a15041a3493dab6cbe921d81d1d7 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:35.292817  9590 tablet_bootstrap.cc:492] T 65ba9982e9bd4177995544e13394911a P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
I20260709 13:04:35.304693  9590 tablet_bootstrap.cc:654] T 65ba9982e9bd4177995544e13394911a P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:35.313783  9591 tablet_bootstrap.cc:492] T 93a7d590cbac4b6da413dd8ea2a26225 P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:35.316339  9590 tablet_bootstrap.cc:492] T 65ba9982e9bd4177995544e13394911a P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:35.316902  9590 ts_tablet_manager.cc:1403] T 65ba9982e9bd4177995544e13394911a P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.002s
I20260709 13:04:35.314441  9591 ts_tablet_manager.cc:1403] T 93a7d590cbac4b6da413dd8ea2a26225 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.090s	user 0.015s	sys 0.003s
I20260709 13:04:35.319737  9590 raft_consensus.cc:359] T 65ba9982e9bd4177995544e13394911a P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:35.320449  9590 raft_consensus.cc:385] T 65ba9982e9bd4177995544e13394911a P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:35.320713  9590 raft_consensus.cc:740] T 65ba9982e9bd4177995544e13394911a P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.321676  9590 consensus_queue.cc:260] T 65ba9982e9bd4177995544e13394911a P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:35.324182  9590 ts_tablet_manager.cc:1434] T 65ba9982e9bd4177995544e13394911a P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:35.325599  9590 tablet_bootstrap.cc:492] T e97eecc3acdf46a5b5577416f7bfe336 P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
I20260709 13:04:35.332299  9590 tablet_bootstrap.cc:654] T e97eecc3acdf46a5b5577416f7bfe336 P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:35.332152  9591 raft_consensus.cc:359] T 93a7d590cbac4b6da413dd8ea2a26225 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:35.331502  9220 catalog_manager.cc:5697] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf reported cstate change: term changed from 0 to 1, leader changed from <none> to dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196). New cstate: current_term: 1 leader_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:35.338001  9591 raft_consensus.cc:385] T 93a7d590cbac4b6da413dd8ea2a26225 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:35.339979  9591 raft_consensus.cc:740] T 93a7d590cbac4b6da413dd8ea2a26225 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.341106  9592 tablet_bootstrap.cc:492] T 65ba9982e9bd4177995544e13394911a P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:35.340823  9591 consensus_queue.cc:260] T 93a7d590cbac4b6da413dd8ea2a26225 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:35.341672  9592 ts_tablet_manager.cc:1403] T 65ba9982e9bd4177995544e13394911a P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.063s	user 0.029s	sys 0.032s
I20260709 13:04:35.342921  9870 raft_consensus.cc:493] T 074269f6e5f843be8a85be8b70707304 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.343506  9870 raft_consensus.cc:515] T 074269f6e5f843be8a85be8b70707304 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:35.343789  9591 ts_tablet_manager.cc:1434] T 93a7d590cbac4b6da413dd8ea2a26225 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:04:35.345535  9591 tablet_bootstrap.cc:492] T 65ba9982e9bd4177995544e13394911a P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:35.345363  9592 raft_consensus.cc:359] T 65ba9982e9bd4177995544e13394911a P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:35.346220  9592 raft_consensus.cc:385] T 65ba9982e9bd4177995544e13394911a P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:35.346513  9592 raft_consensus.cc:740] T 65ba9982e9bd4177995544e13394911a P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.347313  9592 consensus_queue.cc:260] T 65ba9982e9bd4177995544e13394911a P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:35.349536  9592 ts_tablet_manager.cc:1434] T 65ba9982e9bd4177995544e13394911a P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:35.350589  9592 tablet_bootstrap.cc:492] T a792fefbeb0c4eb79e87501fb6dbe780 P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:35.353394  9591 tablet_bootstrap.cc:654] T 65ba9982e9bd4177995544e13394911a P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:35.353633  9870 leader_election.cc:290] T 074269f6e5f843be8a85be8b70707304 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:35.355466  9470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "074269f6e5f843be8a85be8b70707304" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:35.360522  9592 tablet_bootstrap.cc:654] T a792fefbeb0c4eb79e87501fb6dbe780 P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:35.362704  9891 raft_consensus.cc:515] T e97eecc3acdf46a5b5577416f7bfe336 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:35.381395  9905 raft_consensus.cc:493] T a541a15041a3493dab6cbe921d81d1d7 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.408434  9905 raft_consensus.cc:515] T a541a15041a3493dab6cbe921d81d1d7 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:35.409140  9891 leader_election.cc:290] T e97eecc3acdf46a5b5577416f7bfe336 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Requested vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:35.411214  9905 leader_election.cc:290] T a541a15041a3493dab6cbe921d81d1d7 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:35.381872  9398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "074269f6e5f843be8a85be8b70707304" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:35.413480  9510 leader_election.cc:304] T 074269f6e5f843be8a85be8b70707304 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf; no voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:35.414691  9867 raft_consensus.cc:2749] T 074269f6e5f843be8a85be8b70707304 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:35.417337  9398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a541a15041a3493dab6cbe921d81d1d7" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:35.418097  9398 raft_consensus.cc:2468] T a541a15041a3493dab6cbe921d81d1d7 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 0.
I20260709 13:04:35.419252  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97eecc3acdf46a5b5577416f7bfe336" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8"
I20260709 13:04:35.419955  9319 raft_consensus.cc:3060] T e97eecc3acdf46a5b5577416f7bfe336 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.419075  9217 catalog_manager.cc:5697] T 03c7fe8d164d4b2c9015337d9b4b7081 P a91e8b10a5984dec9d3777a7275cef49 reported cstate change: term changed from 0 to 1, leader changed from <none> to a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "a91e8b10a5984dec9d3777a7275cef49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:35.420027  9545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97eecc3acdf46a5b5577416f7bfe336" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
I20260709 13:04:35.426174  9436 leader_election.cc:304] T a541a15041a3493dab6cbe921d81d1d7 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:35.392102  9592 tablet_bootstrap.cc:492] T a792fefbeb0c4eb79e87501fb6dbe780 P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:35.429387  9692 raft_consensus.cc:2804] T a541a15041a3493dab6cbe921d81d1d7 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:35.404060  9869 raft_consensus.cc:493] T a541a15041a3493dab6cbe921d81d1d7 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.429827  9692 raft_consensus.cc:493] T a541a15041a3493dab6cbe921d81d1d7 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:35.430207  9692 raft_consensus.cc:3060] T a541a15041a3493dab6cbe921d81d1d7 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.404196  9870 consensus_queue.cc:1048] T b2a7ad91c8474397bae23c993b89fca4 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Connected to new peer: Peer: permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 13:04:35.396234  9590 tablet_bootstrap.cc:492] T e97eecc3acdf46a5b5577416f7bfe336 P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:35.433033  9590 ts_tablet_manager.cc:1403] T e97eecc3acdf46a5b5577416f7bfe336 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.108s	user 0.014s	sys 0.015s
I20260709 13:04:35.434595  9546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a541a15041a3493dab6cbe921d81d1d7" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:35.430155  9869 raft_consensus.cc:515] T a541a15041a3493dab6cbe921d81d1d7 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:35.437424  9869 leader_election.cc:290] T a541a15041a3493dab6cbe921d81d1d7 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:35.438905  9397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a541a15041a3493dab6cbe921d81d1d7" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:35.439908  9397 raft_consensus.cc:2468] T a541a15041a3493dab6cbe921d81d1d7 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 0.
I20260709 13:04:35.436792  9590 raft_consensus.cc:359] T e97eecc3acdf46a5b5577416f7bfe336 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:35.440662  9592 ts_tablet_manager.cc:1403] T a792fefbeb0c4eb79e87501fb6dbe780 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.090s	user 0.018s	sys 0.020s
I20260709 13:04:35.441035  9590 raft_consensus.cc:385] T e97eecc3acdf46a5b5577416f7bfe336 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:35.441452  9590 raft_consensus.cc:740] T e97eecc3acdf46a5b5577416f7bfe336 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
W20260709 13:04:35.442283  9364 leader_election.cc:343] T e97eecc3acdf46a5b5577416f7bfe336 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:35.443986  9592 raft_consensus.cc:359] T a792fefbeb0c4eb79e87501fb6dbe780 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:35.443900  9590 consensus_queue.cc:260] T e97eecc3acdf46a5b5577416f7bfe336 P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:35.447557  9590 ts_tablet_manager.cc:1434] T e97eecc3acdf46a5b5577416f7bfe336 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:04:35.449168  9590 tablet_bootstrap.cc:492] T 03c7fe8d164d4b2c9015337d9b4b7081 P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
I20260709 13:04:35.456089  9546 raft_consensus.cc:2468] T a541a15041a3493dab6cbe921d81d1d7 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 0.
I20260709 13:04:35.459003  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a541a15041a3493dab6cbe921d81d1d7" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:35.462009  9510 leader_election.cc:304] T a541a15041a3493dab6cbe921d81d1d7 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 
I20260709 13:04:35.464141  9590 tablet_bootstrap.cc:654] T 03c7fe8d164d4b2c9015337d9b4b7081 P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:35.464622  9866 raft_consensus.cc:2804] T a541a15041a3493dab6cbe921d81d1d7 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:35.465186  9866 raft_consensus.cc:493] T a541a15041a3493dab6cbe921d81d1d7 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:35.465552  9866 raft_consensus.cc:3060] T a541a15041a3493dab6cbe921d81d1d7 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.470733  9319 raft_consensus.cc:2468] T e97eecc3acdf46a5b5577416f7bfe336 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 1.
I20260709 13:04:35.471693  9752 raft_consensus.cc:493] T a25f8459a3644bfcaf8f9d71705b1c33 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.472452  9752 raft_consensus.cc:515] T a25f8459a3644bfcaf8f9d71705b1c33 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:35.475453  9752 leader_election.cc:290] T a25f8459a3644bfcaf8f9d71705b1c33 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:35.485528  9397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25f8459a3644bfcaf8f9d71705b1c33" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:35.486943  9397 raft_consensus.cc:2393] T a25f8459a3644bfcaf8f9d71705b1c33 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 932245f14aac417f913cc7330a1833b8 in current term 1: Already voted for candidate dfbbb80ab8e345e0ae1684fafefceccf in this term.
I20260709 13:04:35.485344  9866 raft_consensus.cc:515] T a541a15041a3493dab6cbe921d81d1d7 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:35.444847  9592 raft_consensus.cc:385] T a792fefbeb0c4eb79e87501fb6dbe780 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:35.491156  9592 raft_consensus.cc:740] T a792fefbeb0c4eb79e87501fb6dbe780 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.492106  9364 leader_election.cc:304] T e97eecc3acdf46a5b5577416f7bfe336 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, a91e8b10a5984dec9d3777a7275cef49; no voters: dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:35.493661  9592 consensus_queue.cc:260] T a792fefbeb0c4eb79e87501fb6dbe780 P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:35.495153  9893 raft_consensus.cc:2804] T e97eecc3acdf46a5b5577416f7bfe336 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:35.495720  9893 raft_consensus.cc:697] T e97eecc3acdf46a5b5577416f7bfe336 P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Becoming Leader. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Running, Role: LEADER
I20260709 13:04:35.496975  9893 consensus_queue.cc:237] T e97eecc3acdf46a5b5577416f7bfe336 P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:35.498423  9593 tablet_bootstrap.cc:492] T 1a5145e5f9a64fe0acdd74d909e841fc P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:35.499071  9593 ts_tablet_manager.cc:1403] T 1a5145e5f9a64fe0acdd74d909e841fc P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.309s	user 0.021s	sys 0.046s
I20260709 13:04:35.500589  9592 ts_tablet_manager.cc:1434] T a792fefbeb0c4eb79e87501fb6dbe780 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.059s	user 0.005s	sys 0.001s
I20260709 13:04:35.500705  9866 leader_election.cc:290] T a541a15041a3493dab6cbe921d81d1d7 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Requested vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:35.504134  9590 tablet_bootstrap.cc:492] T 03c7fe8d164d4b2c9015337d9b4b7081 P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:35.504583  9593 raft_consensus.cc:359] T 1a5145e5f9a64fe0acdd74d909e841fc P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:35.505910  9593 raft_consensus.cc:385] T 1a5145e5f9a64fe0acdd74d909e841fc P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:35.506294  9593 raft_consensus.cc:740] T 1a5145e5f9a64fe0acdd74d909e841fc P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.507176  9593 consensus_queue.cc:260] T 1a5145e5f9a64fe0acdd74d909e841fc P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:35.508597  9592 tablet_bootstrap.cc:492] T 3bd9c3f12cc546ff905df61c5a9028f6 P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:35.509840  9593 ts_tablet_manager.cc:1434] T 1a5145e5f9a64fe0acdd74d909e841fc P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:04:35.512435  9591 tablet_bootstrap.cc:492] T 65ba9982e9bd4177995544e13394911a P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:35.513597  9591 ts_tablet_manager.cc:1403] T 65ba9982e9bd4177995544e13394911a P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.168s	user 0.040s	sys 0.029s
I20260709 13:04:35.514180  9872 raft_consensus.cc:493] T 93a7d590cbac4b6da413dd8ea2a26225 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.514735  9872 raft_consensus.cc:515] T 93a7d590cbac4b6da413dd8ea2a26225 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:35.517588  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a541a15041a3493dab6cbe921d81d1d7" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:35.517961  9870 consensus_queue.cc:1048] T b2a7ad91c8474397bae23c993b89fca4 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.512946  9590 ts_tablet_manager.cc:1403] T 03c7fe8d164d4b2c9015337d9b4b7081 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.064s	user 0.009s	sys 0.008s
W20260709 13:04:35.527949  9364 consensus_peers.cc:597] T 846ce8cad343420485af76370f029d54 P a91e8b10a5984dec9d3777a7275cef49 -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:35.532003  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a7d590cbac4b6da413dd8ea2a26225" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:35.532908  9472 raft_consensus.cc:2468] T 93a7d590cbac4b6da413dd8ea2a26225 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 0.
I20260709 13:04:35.533380  9397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a7d590cbac4b6da413dd8ea2a26225" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:35.534051  9397 raft_consensus.cc:2468] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 0.
I20260709 13:04:35.535311  9287 leader_election.cc:304] T 93a7d590cbac4b6da413dd8ea2a26225 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, a91e8b10a5984dec9d3777a7275cef49; no voters: 
I20260709 13:04:35.536087  9592 tablet_bootstrap.cc:654] T 3bd9c3f12cc546ff905df61c5a9028f6 P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:35.536202  9606 raft_consensus.cc:2804] T 93a7d590cbac4b6da413dd8ea2a26225 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:35.536602  9606 raft_consensus.cc:493] T 93a7d590cbac4b6da413dd8ea2a26225 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:35.536903  9606 raft_consensus.cc:3060] T 93a7d590cbac4b6da413dd8ea2a26225 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.531347  9546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25f8459a3644bfcaf8f9d71705b1c33" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:35.524739  9872 leader_election.cc:290] T 93a7d590cbac4b6da413dd8ea2a26225 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:35.550264  9289 leader_election.cc:304] T a25f8459a3644bfcaf8f9d71705b1c33 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 932245f14aac417f913cc7330a1833b8; no voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:35.548933  9593 tablet_bootstrap.cc:492] T 890ffb7e0f6b463f8d8771d5cd9481c9 P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
W20260709 13:04:35.560544  9364 consensus_peers.cc:597] T 03c7fe8d164d4b2c9015337d9b4b7081 P a91e8b10a5984dec9d3777a7275cef49 -> Peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Couldn't send request to peer dfbbb80ab8e345e0ae1684fafefceccf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:35.561939  9606 raft_consensus.cc:515] T 93a7d590cbac4b6da413dd8ea2a26225 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:35.541949  9398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a541a15041a3493dab6cbe921d81d1d7" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:35.569651  9905 raft_consensus.cc:493] T 65ba9982e9bd4177995544e13394911a P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.582791  9606 leader_election.cc:290] T 93a7d590cbac4b6da413dd8ea2a26225 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 election: Requested vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:35.583810  9590 raft_consensus.cc:359] T 03c7fe8d164d4b2c9015337d9b4b7081 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:35.584594  9590 raft_consensus.cc:385] T 03c7fe8d164d4b2c9015337d9b4b7081 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:35.584923  9590 raft_consensus.cc:740] T 03c7fe8d164d4b2c9015337d9b4b7081 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.584797  9469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a7d590cbac4b6da413dd8ea2a26225" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:35.587265  9469 raft_consensus.cc:3060] T 93a7d590cbac4b6da413dd8ea2a26225 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.577806  9398 raft_consensus.cc:3060] T a541a15041a3493dab6cbe921d81d1d7 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.590855  9545 raft_consensus.cc:3060] T 074269f6e5f843be8a85be8b70707304 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.597309  9905 raft_consensus.cc:515] T 65ba9982e9bd4177995544e13394911a P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:35.606211  9905 leader_election.cc:290] T 65ba9982e9bd4177995544e13394911a P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:35.607501  9590 consensus_queue.cc:260] T 03c7fe8d164d4b2c9015337d9b4b7081 P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:35.607582  9887 consensus_queue.cc:1048] T 846ce8cad343420485af76370f029d54 P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:35.609390  9870 raft_consensus.cc:493] T e97eecc3acdf46a5b5577416f7bfe336 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.610215  9870 raft_consensus.cc:515] T e97eecc3acdf46a5b5577416f7bfe336 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:35.603104  9217 catalog_manager.cc:5697] T e97eecc3acdf46a5b5577416f7bfe336 P a91e8b10a5984dec9d3777a7275cef49 reported cstate change: term changed from 0 to 1, leader changed from <none> to a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "a91e8b10a5984dec9d3777a7275cef49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:35.637609  9590 ts_tablet_manager.cc:1434] T 03c7fe8d164d4b2c9015337d9b4b7081 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.118s	user 0.014s	sys 0.000s
I20260709 13:04:35.640049  9591 raft_consensus.cc:359] T 65ba9982e9bd4177995544e13394911a P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:35.640796  9591 raft_consensus.cc:385] T 65ba9982e9bd4177995544e13394911a P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:35.641058  9591 raft_consensus.cc:740] T 65ba9982e9bd4177995544e13394911a P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.648923  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ba9982e9bd4177995544e13394911a" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:35.657856  9593 tablet_bootstrap.cc:654] T 890ffb7e0f6b463f8d8771d5cd9481c9 P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:35.660682  9397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a7d590cbac4b6da413dd8ea2a26225" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:35.661509  9397 raft_consensus.cc:3060] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.661190  9692 raft_consensus.cc:515] T a541a15041a3493dab6cbe921d81d1d7 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:35.664054  9692 leader_election.cc:290] T a541a15041a3493dab6cbe921d81d1d7 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Requested vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:35.667291  9891 consensus_queue.cc:1048] T 03c7fe8d164d4b2c9015337d9b4b7081 P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:35.630295  9709 raft_consensus.cc:493] T 65ba9982e9bd4177995544e13394911a P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.672749  9709 raft_consensus.cc:515] T 65ba9982e9bd4177995544e13394911a P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:35.675997  9709 leader_election.cc:290] T 65ba9982e9bd4177995544e13394911a P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:35.677361  9468 raft_consensus.cc:2393] T a541a15041a3493dab6cbe921d81d1d7 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dfbbb80ab8e345e0ae1684fafefceccf in current term 1: Already voted for candidate ef5fe58eb3e04ae18fda957b4d507eff in this term.
I20260709 13:04:35.691776  9543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ba9982e9bd4177995544e13394911a" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:35.692111  9544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a541a15041a3493dab6cbe921d81d1d7" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
I20260709 13:04:35.692658  9543 raft_consensus.cc:2468] T 65ba9982e9bd4177995544e13394911a P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 0.
I20260709 13:04:35.692977  9544 raft_consensus.cc:2393] T a541a15041a3493dab6cbe921d81d1d7 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ef5fe58eb3e04ae18fda957b4d507eff in current term 1: Already voted for candidate dfbbb80ab8e345e0ae1684fafefceccf in this term.
I20260709 13:04:35.695014  9590 tablet_bootstrap.cc:492] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
I20260709 13:04:35.697724  9396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a541a15041a3493dab6cbe921d81d1d7" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:35.702440  9397 raft_consensus.cc:2468] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 1.
I20260709 13:04:35.648845  9591 consensus_queue.cc:260] T 65ba9982e9bd4177995544e13394911a P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:35.710294  9321 raft_consensus.cc:2468] T 65ba9982e9bd4177995544e13394911a P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 0.
I20260709 13:04:35.714124  9438 leader_election.cc:304] T 65ba9982e9bd4177995544e13394911a P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:35.717648  9846 raft_consensus.cc:2804] T 65ba9982e9bd4177995544e13394911a P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:35.718056  9846 raft_consensus.cc:493] T 65ba9982e9bd4177995544e13394911a P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:35.718384  9846 raft_consensus.cc:3060] T 65ba9982e9bd4177995544e13394911a P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.718616  9870 leader_election.cc:290] T e97eecc3acdf46a5b5577416f7bfe336 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:35.720472  9322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97eecc3acdf46a5b5577416f7bfe336" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:35.721344  9322 raft_consensus.cc:2393] T e97eecc3acdf46a5b5577416f7bfe336 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dfbbb80ab8e345e0ae1684fafefceccf in current term 1: Already voted for candidate a91e8b10a5984dec9d3777a7275cef49 in this term.
I20260709 13:04:35.725328  9591 ts_tablet_manager.cc:1434] T 65ba9982e9bd4177995544e13394911a P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.206s	user 0.008s	sys 0.001s
I20260709 13:04:35.726574  9891 raft_consensus.cc:493] T 1a5145e5f9a64fe0acdd74d909e841fc P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.662001  9925 raft_consensus.cc:3060] T a25f8459a3644bfcaf8f9d71705b1c33 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.740149  9592 tablet_bootstrap.cc:492] T 3bd9c3f12cc546ff905df61c5a9028f6 P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:35.740854  9592 ts_tablet_manager.cc:1403] T 3bd9c3f12cc546ff905df61c5a9028f6 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.232s	user 0.020s	sys 0.027s
I20260709 13:04:35.745791  9591 tablet_bootstrap.cc:492] T 846ce8cad343420485af76370f029d54 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:35.736570  9891 raft_consensus.cc:515] T 1a5145e5f9a64fe0acdd74d909e841fc P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:35.748231  9398 raft_consensus.cc:2468] T a541a15041a3493dab6cbe921d81d1d7 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 1.
I20260709 13:04:35.750640  9510 leader_election.cc:304] T a541a15041a3493dab6cbe921d81d1d7 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf; no voters: ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:35.752036  9870 raft_consensus.cc:2804] T a541a15041a3493dab6cbe921d81d1d7 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:35.752323  9891 leader_election.cc:290] T 1a5145e5f9a64fe0acdd74d909e841fc P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:35.752615  9870 raft_consensus.cc:697] T a541a15041a3493dab6cbe921d81d1d7 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Becoming Leader. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Running, Role: LEADER
I20260709 13:04:35.753803  9870 consensus_queue.cc:237] T a541a15041a3493dab6cbe921d81d1d7 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:35.744866  9592 raft_consensus.cc:359] T 3bd9c3f12cc546ff905df61c5a9028f6 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:35.763043  9592 raft_consensus.cc:385] T 3bd9c3f12cc546ff905df61c5a9028f6 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:35.763422  9592 raft_consensus.cc:740] T 3bd9c3f12cc546ff905df61c5a9028f6 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
W20260709 13:04:35.764112  9512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37633, user_credentials={real_user=slave}} blocked reactor thread for 108765us
I20260709 13:04:35.760241  9438 leader_election.cc:304] T a541a15041a3493dab6cbe921d81d1d7 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef5fe58eb3e04ae18fda957b4d507eff; no voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:35.779206  9755 raft_consensus.cc:2749] T a541a15041a3493dab6cbe921d81d1d7 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:35.737572  9469 raft_consensus.cc:2468] T 93a7d590cbac4b6da413dd8ea2a26225 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 1.
I20260709 13:04:35.787256  9322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a5145e5f9a64fe0acdd74d909e841fc" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:35.789681  9592 consensus_queue.cc:260] T 3bd9c3f12cc546ff905df61c5a9028f6 P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:35.782639  9287 leader_election.cc:304] T 93a7d590cbac4b6da413dd8ea2a26225 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, a91e8b10a5984dec9d3777a7275cef49; no voters: 
I20260709 13:04:35.775763  9905 raft_consensus.cc:493] T a792fefbeb0c4eb79e87501fb6dbe780 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:35.796489  9364 leader_election.cc:343] T 1a5145e5f9a64fe0acdd74d909e841fc P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:35.800153  9606 raft_consensus.cc:2804] T 93a7d590cbac4b6da413dd8ea2a26225 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:35.784056  9397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97eecc3acdf46a5b5577416f7bfe336" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:35.784935  9546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a5145e5f9a64fe0acdd74d909e841fc" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:35.808640  9593 tablet_bootstrap.cc:492] T 890ffb7e0f6b463f8d8771d5cd9481c9 P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:35.809065  9593 ts_tablet_manager.cc:1403] T 890ffb7e0f6b463f8d8771d5cd9481c9 P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.290s	user 0.013s	sys 0.004s
I20260709 13:04:35.799376  9709 consensus_queue.cc:1048] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
W20260709 13:04:35.823469  9364 leader_election.cc:343] T 1a5145e5f9a64fe0acdd74d909e841fc P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:35.823998  9364 leader_election.cc:304] T 1a5145e5f9a64fe0acdd74d909e841fc P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49; no voters: 932245f14aac417f913cc7330a1833b8, dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:35.802328  9905 raft_consensus.cc:515] T a792fefbeb0c4eb79e87501fb6dbe780 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:35.832338  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ba9982e9bd4177995544e13394911a" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:35.833432  9905 leader_election.cc:290] T a792fefbeb0c4eb79e87501fb6dbe780 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:35.835817  9323 raft_consensus.cc:2468] T 65ba9982e9bd4177995544e13394911a P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 0.
I20260709 13:04:35.846192  9317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a792fefbeb0c4eb79e87501fb6dbe780" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:35.827823  9887 raft_consensus.cc:2749] T 1a5145e5f9a64fe0acdd74d909e841fc P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:35.854696  9438 leader_election.cc:343] T a792fefbeb0c4eb79e87501fb6dbe780 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:35.860231  9268 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:35.863426  9590 tablet_bootstrap.cc:654] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:35.865334  9606 raft_consensus.cc:697] T 93a7d590cbac4b6da413dd8ea2a26225 P 932245f14aac417f913cc7330a1833b8 [term 1 LEADER]: Becoming Leader. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Running, Role: LEADER
I20260709 13:04:35.866714  9606 consensus_queue.cc:237] T 93a7d590cbac4b6da413dd8ea2a26225 P 932245f14aac417f913cc7330a1833b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:35.872206  9593 raft_consensus.cc:359] T 890ffb7e0f6b463f8d8771d5cd9481c9 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:35.872872  9593 raft_consensus.cc:385] T 890ffb7e0f6b463f8d8771d5cd9481c9 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:35.873148  9593 raft_consensus.cc:740] T 890ffb7e0f6b463f8d8771d5cd9481c9 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.878661  9593 consensus_queue.cc:260] T 890ffb7e0f6b463f8d8771d5cd9481c9 P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:35.881091  9512 leader_election.cc:304] T 65ba9982e9bd4177995544e13394911a P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 
I20260709 13:04:35.871528  9398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a792fefbeb0c4eb79e87501fb6dbe780" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:35.893189  9593 ts_tablet_manager.cc:1434] T 890ffb7e0f6b463f8d8771d5cd9481c9 P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.084s	user 0.007s	sys 0.000s
I20260709 13:04:35.888340  9866 raft_consensus.cc:2804] T 65ba9982e9bd4177995544e13394911a P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:35.904250  9866 raft_consensus.cc:493] T 65ba9982e9bd4177995544e13394911a P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:35.904665  9866 raft_consensus.cc:3060] T 65ba9982e9bd4177995544e13394911a P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:35.888581  9510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33607, user_credentials={real_user=slave}} blocked reactor thread for 103657us
I20260709 13:04:35.936201  9593 tablet_bootstrap.cc:492] T 8f602c194d1c445ba1851f0a2272b40b P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:35.946741  9591 tablet_bootstrap.cc:654] T 846ce8cad343420485af76370f029d54 P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:35.925375  9925 raft_consensus.cc:2749] T a25f8459a3644bfcaf8f9d71705b1c33 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:35.915254  9398 raft_consensus.cc:2468] T a792fefbeb0c4eb79e87501fb6dbe780 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 0.
I20260709 13:04:35.928839  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ba9982e9bd4177995544e13394911a" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:35.968382  9870 raft_consensus.cc:493] T 03c7fe8d164d4b2c9015337d9b4b7081 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.015628  9870 raft_consensus.cc:515] T 03c7fe8d164d4b2c9015337d9b4b7081 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:36.018168  9870 leader_election.cc:290] T 03c7fe8d164d4b2c9015337d9b4b7081 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:36.046030  9593 tablet_bootstrap.cc:654] T 8f602c194d1c445ba1851f0a2272b40b P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.000269  9866 raft_consensus.cc:515] T 65ba9982e9bd4177995544e13394911a P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:35.993198  9846 raft_consensus.cc:515] T 65ba9982e9bd4177995544e13394911a P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
W20260709 13:04:36.058503  9512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37633, user_credentials={real_user=slave}} blocked reactor thread for 82946.2us
I20260709 13:04:36.069761  9592 ts_tablet_manager.cc:1434] T 3bd9c3f12cc546ff905df61c5a9028f6 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.329s	user 0.038s	sys 0.038s
I20260709 13:04:36.077694  9467 raft_consensus.cc:2393] T 65ba9982e9bd4177995544e13394911a P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dfbbb80ab8e345e0ae1684fafefceccf in current term 1: Already voted for candidate ef5fe58eb3e04ae18fda957b4d507eff in this term.
I20260709 13:04:36.085997  9846 leader_election.cc:290] T 65ba9982e9bd4177995544e13394911a P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Requested vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:36.110412  9510 leader_election.cc:304] T e97eecc3acdf46a5b5577416f7bfe336 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf; no voters: 932245f14aac417f913cc7330a1833b8, a91e8b10a5984dec9d3777a7275cef49
I20260709 13:04:36.111195  9546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ba9982e9bd4177995544e13394911a" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
I20260709 13:04:36.111645  9928 raft_consensus.cc:3060] T e97eecc3acdf46a5b5577416f7bfe336 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.111871  9866 leader_election.cc:290] T 65ba9982e9bd4177995544e13394911a P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Requested vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:36.112064  9546 raft_consensus.cc:2393] T 65ba9982e9bd4177995544e13394911a P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ef5fe58eb3e04ae18fda957b4d507eff in current term 1: Already voted for candidate dfbbb80ab8e345e0ae1684fafefceccf in this term.
I20260709 13:04:36.106389  9317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ba9982e9bd4177995544e13394911a" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8"
I20260709 13:04:36.113549  9317 raft_consensus.cc:3060] T 65ba9982e9bd4177995544e13394911a P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.120556  9932 consensus_queue.cc:1048] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Connected to new peer: Peer: permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:36.147008  9928 raft_consensus.cc:2749] T e97eecc3acdf46a5b5577416f7bfe336 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:36.152942  9317 raft_consensus.cc:2468] T 65ba9982e9bd4177995544e13394911a P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 1.
I20260709 13:04:36.160351  9436 leader_election.cc:304] T a792fefbeb0c4eb79e87501fb6dbe780 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 932245f14aac417f913cc7330a1833b8
I20260709 13:04:36.162307  9692 raft_consensus.cc:2804] T a792fefbeb0c4eb79e87501fb6dbe780 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:36.162796  9692 raft_consensus.cc:493] T a792fefbeb0c4eb79e87501fb6dbe780 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:36.163159  9692 raft_consensus.cc:3060] T a792fefbeb0c4eb79e87501fb6dbe780 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.169730  9318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ba9982e9bd4177995544e13394911a" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8"
I20260709 13:04:36.170977  9318 raft_consensus.cc:2393] T 65ba9982e9bd4177995544e13394911a P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dfbbb80ab8e345e0ae1684fafefceccf in current term 1: Already voted for candidate ef5fe58eb3e04ae18fda957b4d507eff in this term.
I20260709 13:04:36.124109  9219 catalog_manager.cc:5697] T 93a7d590cbac4b6da413dd8ea2a26225 P 932245f14aac417f913cc7330a1833b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 932245f14aac417f913cc7330a1833b8 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "932245f14aac417f913cc7330a1833b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:36.176896  9438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37633, user_credentials={real_user=slave}} blocked reactor thread for 46033.6us
I20260709 13:04:36.211879  9692 raft_consensus.cc:515] T a792fefbeb0c4eb79e87501fb6dbe780 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:36.194388  9438 leader_election.cc:304] T 65ba9982e9bd4177995544e13394911a P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:36.214215  9592 tablet_bootstrap.cc:492] T 8f602c194d1c445ba1851f0a2272b40b P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
W20260709 13:04:36.227356  9364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38559, user_credentials={real_user=slave}} blocked reactor thread for 192438us
I20260709 13:04:36.217722  9905 raft_consensus.cc:2804] T 65ba9982e9bd4177995544e13394911a P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:36.247088  9317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a792fefbeb0c4eb79e87501fb6dbe780" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8"
I20260709 13:04:36.250582  9542 raft_consensus.cc:3060] T 03c7fe8d164d4b2c9015337d9b4b7081 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.245756  9692 leader_election.cc:290] T a792fefbeb0c4eb79e87501fb6dbe780 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Requested vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
W20260709 13:04:36.257489  9438 leader_election.cc:343] T a792fefbeb0c4eb79e87501fb6dbe780 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:36.260344  9905 raft_consensus.cc:697] T 65ba9982e9bd4177995544e13394911a P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Becoming Leader. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Running, Role: LEADER
I20260709 13:04:36.261324  9593 tablet_bootstrap.cc:492] T 8f602c194d1c445ba1851f0a2272b40b P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:36.261981  9593 ts_tablet_manager.cc:1403] T 8f602c194d1c445ba1851f0a2272b40b P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.326s	user 0.035s	sys 0.021s
I20260709 13:04:36.261474  9905 consensus_queue.cc:237] T 65ba9982e9bd4177995544e13394911a P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:36.265988  9590 tablet_bootstrap.cc:492] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:36.266544  9590 ts_tablet_manager.cc:1403] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.579s	user 0.015s	sys 0.006s
I20260709 13:04:36.261377  9470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c7fe8d164d4b2c9015337d9b4b7081" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:36.273300  9590 raft_consensus.cc:359] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:36.275287  9590 raft_consensus.cc:385] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.275539  9590 raft_consensus.cc:740] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.277006  9692 raft_consensus.cc:493] T 3bd9c3f12cc546ff905df61c5a9028f6 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.277561  9692 raft_consensus.cc:515] T 3bd9c3f12cc546ff905df61c5a9028f6 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:36.291947  9591 tablet_bootstrap.cc:492] T 846ce8cad343420485af76370f029d54 P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:36.291726  9590 consensus_queue.cc:260] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:36.292654  9591 ts_tablet_manager.cc:1403] T 846ce8cad343420485af76370f029d54 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.554s	user 0.017s	sys 0.008s
I20260709 13:04:36.300313  9692 leader_election.cc:290] T 3bd9c3f12cc546ff905df61c5a9028f6 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:36.289484  9891 raft_consensus.cc:493] T 890ffb7e0f6b463f8d8771d5cd9481c9 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.303895  9593 raft_consensus.cc:359] T 8f602c194d1c445ba1851f0a2272b40b P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:36.306680  9593 raft_consensus.cc:385] T 8f602c194d1c445ba1851f0a2272b40b P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.307030  9593 raft_consensus.cc:740] T 8f602c194d1c445ba1851f0a2272b40b P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.307611  9593 consensus_queue.cc:260] T 8f602c194d1c445ba1851f0a2272b40b P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:36.316319  9592 tablet_bootstrap.cc:654] T 8f602c194d1c445ba1851f0a2272b40b P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.317466  9397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c7fe8d164d4b2c9015337d9b4b7081" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:36.320035  9590 ts_tablet_manager.cc:1434] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.053s	user 0.010s	sys 0.000s
I20260709 13:04:36.322896  9546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bd9c3f12cc546ff905df61c5a9028f6" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
W20260709 13:04:36.344058  9438 leader_election.cc:343] T 3bd9c3f12cc546ff905df61c5a9028f6 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:36.324772  9317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bd9c3f12cc546ff905df61c5a9028f6" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:36.330657  9891 raft_consensus.cc:515] T 890ffb7e0f6b463f8d8771d5cd9481c9 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
W20260709 13:04:36.346379  9438 leader_election.cc:343] T 3bd9c3f12cc546ff905df61c5a9028f6 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:36.346823  9438 leader_election.cc:304] T 3bd9c3f12cc546ff905df61c5a9028f6 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef5fe58eb3e04ae18fda957b4d507eff; no voters: 932245f14aac417f913cc7330a1833b8, dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:36.347295  9938 consensus_queue.cc:1048] T e97eecc3acdf46a5b5577416f7bfe336 P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:04:36.348035  9891 leader_election.cc:290] T 890ffb7e0f6b463f8d8771d5cd9481c9 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:36.340649  9590 tablet_bootstrap.cc:492] T 3bd9c3f12cc546ff905df61c5a9028f6 P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
I20260709 13:04:36.329514  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ba9982e9bd4177995544e13394911a" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:36.352377  9593 ts_tablet_manager.cc:1434] T 8f602c194d1c445ba1851f0a2272b40b P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.090s	user 0.005s	sys 0.002s
I20260709 13:04:36.353479  9593 tablet_bootstrap.cc:492] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:36.348273  9692 raft_consensus.cc:2749] T 3bd9c3f12cc546ff905df61c5a9028f6 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:36.358754  9934 raft_consensus.cc:493] T 8f602c194d1c445ba1851f0a2272b40b P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.359335  9934 raft_consensus.cc:515] T 8f602c194d1c445ba1851f0a2272b40b P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:36.362861  9396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a792fefbeb0c4eb79e87501fb6dbe780" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:36.358685  9220 catalog_manager.cc:5697] T a541a15041a3493dab6cbe921d81d1d7 P dfbbb80ab8e345e0ae1684fafefceccf reported cstate change: term changed from 0 to 1, leader changed from <none> to dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196). New cstate: current_term: 1 leader_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:36.363926  9396 raft_consensus.cc:3060] T a792fefbeb0c4eb79e87501fb6dbe780 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.365828  9593 tablet_bootstrap.cc:654] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.372239  9934 leader_election.cc:290] T 8f602c194d1c445ba1851f0a2272b40b P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
W20260709 13:04:36.383008  9364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37633, user_credentials={real_user=slave}} blocked reactor thread for 76236.9us
I20260709 13:04:36.329069  9591 raft_consensus.cc:359] T 846ce8cad343420485af76370f029d54 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:36.385862  9591 raft_consensus.cc:385] T 846ce8cad343420485af76370f029d54 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.386351  9591 raft_consensus.cc:740] T 846ce8cad343420485af76370f029d54 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.388505  9591 consensus_queue.cc:260] T 846ce8cad343420485af76370f029d54 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:36.411351  9512 leader_election.cc:304] T 65ba9982e9bd4177995544e13394911a P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf; no voters: 932245f14aac417f913cc7330a1833b8, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:36.424187  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890ffb7e0f6b463f8d8771d5cd9481c9" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:36.429745  9591 ts_tablet_manager.cc:1434] T 846ce8cad343420485af76370f029d54 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.137s	user 0.008s	sys 0.001s
W20260709 13:04:36.431507  9364 leader_election.cc:343] T 890ffb7e0f6b463f8d8771d5cd9481c9 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:36.414569  9869 raft_consensus.cc:2749] T 65ba9982e9bd4177995544e13394911a P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:36.443516  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f602c194d1c445ba1851f0a2272b40b" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
W20260709 13:04:36.446827  9364 leader_election.cc:343] T 8f602c194d1c445ba1851f0a2272b40b P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:36.449275  9321 raft_consensus.cc:3060] T 846ce8cad343420485af76370f029d54 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.455020  9546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890ffb7e0f6b463f8d8771d5cd9481c9" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:36.455024  9941 consensus_queue.cc:1048] T a541a15041a3493dab6cbe921d81d1d7 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.069s
I20260709 13:04:36.457230  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f602c194d1c445ba1851f0a2272b40b" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:36.458284  9935 consensus_queue.cc:1048] T a541a15041a3493dab6cbe921d81d1d7 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:36.460232  9510 leader_election.cc:304] T 03c7fe8d164d4b2c9015337d9b4b7081 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf; no voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff
W20260709 13:04:36.466189  9364 leader_election.cc:343] T 8f602c194d1c445ba1851f0a2272b40b P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:36.466771  9364 leader_election.cc:304] T 8f602c194d1c445ba1851f0a2272b40b P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49; no voters: 932245f14aac417f913cc7330a1833b8, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:36.469467  9943 raft_consensus.cc:2749] T 8f602c194d1c445ba1851f0a2272b40b P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:36.470104  9591 tablet_bootstrap.cc:492] T b305803a339e40f99c1a6af7f6f84f7c P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:36.456970  9590 tablet_bootstrap.cc:654] T 3bd9c3f12cc546ff905df61c5a9028f6 P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.473950  9925 consensus_queue.cc:1048] T 93a7d590cbac4b6da413dd8ea2a26225 P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:04:36.486881  9593 tablet_bootstrap.cc:492] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:36.487649  9593 ts_tablet_manager.cc:1403] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.134s	user 0.010s	sys 0.019s
W20260709 13:04:36.505512  9364 leader_election.cc:343] T 890ffb7e0f6b463f8d8771d5cd9481c9 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:36.506088  9364 leader_election.cc:304] T 890ffb7e0f6b463f8d8771d5cd9481c9 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49; no voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:36.507472  9938 raft_consensus.cc:2749] T 890ffb7e0f6b463f8d8771d5cd9481c9 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:36.521464  9606 consensus_queue.cc:1048] T 93a7d590cbac4b6da413dd8ea2a26225 P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:36.541997  9592 tablet_bootstrap.cc:492] T 8f602c194d1c445ba1851f0a2272b40b P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:36.542568  9592 ts_tablet_manager.cc:1403] T 8f602c194d1c445ba1851f0a2272b40b P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.337s	user 0.017s	sys 0.008s
I20260709 13:04:36.542830  9946 consensus_queue.cc:1048] T e97eecc3acdf46a5b5577416f7bfe336 P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:36.547574  9396 raft_consensus.cc:2468] T a792fefbeb0c4eb79e87501fb6dbe780 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 1.
I20260709 13:04:36.549368  9436 leader_election.cc:304] T a792fefbeb0c4eb79e87501fb6dbe780 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 932245f14aac417f913cc7330a1833b8
I20260709 13:04:36.550467  9846 raft_consensus.cc:2804] T a792fefbeb0c4eb79e87501fb6dbe780 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:36.551066  9846 raft_consensus.cc:697] T a792fefbeb0c4eb79e87501fb6dbe780 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Becoming Leader. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Running, Role: LEADER
I20260709 13:04:36.552222  9846 consensus_queue.cc:237] T a792fefbeb0c4eb79e87501fb6dbe780 P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:36.567982  9592 raft_consensus.cc:359] T 8f602c194d1c445ba1851f0a2272b40b P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:36.572114  9592 raft_consensus.cc:385] T 8f602c194d1c445ba1851f0a2272b40b P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.573334  9592 raft_consensus.cc:740] T 8f602c194d1c445ba1851f0a2272b40b P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.580268  9592 consensus_queue.cc:260] T 8f602c194d1c445ba1851f0a2272b40b P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:36.620599  9592 ts_tablet_manager.cc:1434] T 8f602c194d1c445ba1851f0a2272b40b P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.078s	user 0.010s	sys 0.001s
I20260709 13:04:36.616783  9217 catalog_manager.cc:5697] T 65ba9982e9bd4177995544e13394911a P ef5fe58eb3e04ae18fda957b4d507eff reported cstate change: term changed from 0 to 1, leader changed from <none> to ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:36.661794  9591 tablet_bootstrap.cc:654] T b305803a339e40f99c1a6af7f6f84f7c P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.665323  9592 tablet_bootstrap.cc:492] T 890ffb7e0f6b463f8d8771d5cd9481c9 P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:36.670279  9593 raft_consensus.cc:359] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:36.671017  9593 raft_consensus.cc:385] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.671275  9593 raft_consensus.cc:740] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.671952  9593 consensus_queue.cc:260] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:36.675735  9593 ts_tablet_manager.cc:1434] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.188s	user 0.010s	sys 0.000s
I20260709 13:04:36.695426  9593 tablet_bootstrap.cc:492] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:36.684531  9869 raft_consensus.cc:2749] T 03c7fe8d164d4b2c9015337d9b4b7081 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:36.725860  9963 log.cc:927] Time spent T a541a15041a3493dab6cbe921d81d1d7 P ef5fe58eb3e04ae18fda957b4d507eff: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
W20260709 13:04:36.729509  9289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38559, user_credentials={real_user=slave}} blocked reactor thread for 49048.3us
I20260709 13:04:36.722858  9709 raft_consensus.cc:493] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.754786  9709 raft_consensus.cc:515] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:36.778595  9709 leader_election.cc:290] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:36.779464  9593 tablet_bootstrap.cc:654] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.788748  9590 tablet_bootstrap.cc:492] T 3bd9c3f12cc546ff905df61c5a9028f6 P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:36.789477  9590 ts_tablet_manager.cc:1403] T 3bd9c3f12cc546ff905df61c5a9028f6 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.449s	user 0.024s	sys 0.017s
I20260709 13:04:36.804790  9592 tablet_bootstrap.cc:654] T 890ffb7e0f6b463f8d8771d5cd9481c9 P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:36.806222  9964 log.cc:927] Time spent T 93a7d590cbac4b6da413dd8ea2a26225 P ef5fe58eb3e04ae18fda957b4d507eff: Append to log took a long time: real 0.098s	user 0.000s	sys 0.003s
W20260709 13:04:36.826234  9967 log.cc:927] Time spent T e97eecc3acdf46a5b5577416f7bfe336 P dfbbb80ab8e345e0ae1684fafefceccf: Append to log took a long time: real 0.185s	user 0.002s	sys 0.000s
I20260709 13:04:36.826710  9591 tablet_bootstrap.cc:492] T b305803a339e40f99c1a6af7f6f84f7c P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:36.827247  9591 ts_tablet_manager.cc:1403] T b305803a339e40f99c1a6af7f6f84f7c P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.357s	user 0.028s	sys 0.014s
W20260709 13:04:36.829435  9626 log.cc:927] Time spent T 00000000000000000000000000000000 P c7bbf8b42238465898b968984e058005: Append to log took a long time: real 0.065s	user 0.002s	sys 0.000s
I20260709 13:04:36.830255  9591 raft_consensus.cc:359] T b305803a339e40f99c1a6af7f6f84f7c P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:36.830983  9591 raft_consensus.cc:385] T b305803a339e40f99c1a6af7f6f84f7c P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.831254  9591 raft_consensus.cc:740] T b305803a339e40f99c1a6af7f6f84f7c P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.831918  9591 consensus_queue.cc:260] T b305803a339e40f99c1a6af7f6f84f7c P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:36.836447  9590 raft_consensus.cc:359] T 3bd9c3f12cc546ff905df61c5a9028f6 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:36.837293  9590 raft_consensus.cc:385] T 3bd9c3f12cc546ff905df61c5a9028f6 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.837610  9590 raft_consensus.cc:740] T 3bd9c3f12cc546ff905df61c5a9028f6 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.838253  9590 consensus_queue.cc:260] T 3bd9c3f12cc546ff905df61c5a9028f6 P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:36.840197  9590 ts_tablet_manager.cc:1434] T 3bd9c3f12cc546ff905df61c5a9028f6 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
I20260709 13:04:36.841279  9590 tablet_bootstrap.cc:492] T 890ffb7e0f6b463f8d8771d5cd9481c9 P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
I20260709 13:04:36.850509  9692 consensus_queue.cc:1048] T 65ba9982e9bd4177995544e13394911a P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:36.852617  9592 tablet_bootstrap.cc:492] T 890ffb7e0f6b463f8d8771d5cd9481c9 P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:36.853189  9592 ts_tablet_manager.cc:1403] T 890ffb7e0f6b463f8d8771d5cd9481c9 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.196s	user 0.017s	sys 0.002s
I20260709 13:04:36.856073  9590 tablet_bootstrap.cc:654] T 890ffb7e0f6b463f8d8771d5cd9481c9 P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.861243  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff040bb60327424d8aeec71e3bf58a0a" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:36.862417  9467 raft_consensus.cc:2468] T ff040bb60327424d8aeec71e3bf58a0a P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 0.
W20260709 13:04:36.925539  9966 log.cc:927] Time spent T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49: Append to log took a long time: real 0.064s	user 0.000s	sys 0.009s
I20260709 13:04:36.927774  9592 raft_consensus.cc:359] T 890ffb7e0f6b463f8d8771d5cd9481c9 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:36.928660  9592 raft_consensus.cc:385] T 890ffb7e0f6b463f8d8771d5cd9481c9 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.929001  9592 raft_consensus.cc:740] T 890ffb7e0f6b463f8d8771d5cd9481c9 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.929720  9592 consensus_queue.cc:260] T 890ffb7e0f6b463f8d8771d5cd9481c9 P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:36.940039  9592 ts_tablet_manager.cc:1434] T 890ffb7e0f6b463f8d8771d5cd9481c9 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.087s	user 0.006s	sys 0.000s
I20260709 13:04:36.941159  9869 raft_consensus.cc:493] T 3bd9c3f12cc546ff905df61c5a9028f6 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.943702  9592 tablet_bootstrap.cc:492] T b90aae84687f41e99e58dada706ae2d7 P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:36.943284  9869 raft_consensus.cc:515] T 3bd9c3f12cc546ff905df61c5a9028f6 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:36.945974  9869 leader_election.cc:290] T 3bd9c3f12cc546ff905df61c5a9028f6 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:36.952689  9512 leader_election.cc:304] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:36.953621  9869 raft_consensus.cc:2804] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:36.953999  9869 raft_consensus.cc:493] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:36.954353  9869 raft_consensus.cc:3060] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.960779  9469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bd9c3f12cc546ff905df61c5a9028f6" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:36.961668  9469 raft_consensus.cc:2468] T 3bd9c3f12cc546ff905df61c5a9028f6 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 0.
I20260709 13:04:36.961812  9592 tablet_bootstrap.cc:654] T b90aae84687f41e99e58dada706ae2d7 P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.991223  9217 catalog_manager.cc:5697] T a792fefbeb0c4eb79e87501fb6dbe780 P ef5fe58eb3e04ae18fda957b4d507eff reported cstate change: term changed from 0 to 1, leader changed from <none> to ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:36.988871  9869 raft_consensus.cc:515] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:36.995754  9512 leader_election.cc:304] T 3bd9c3f12cc546ff905df61c5a9028f6 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:36.996726  9973 raft_consensus.cc:2804] T 3bd9c3f12cc546ff905df61c5a9028f6 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:36.997119  9973 raft_consensus.cc:493] T 3bd9c3f12cc546ff905df61c5a9028f6 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:36.997241  9869 leader_election.cc:290] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Requested vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:36.997479  9973 raft_consensus.cc:3060] T 3bd9c3f12cc546ff905df61c5a9028f6 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.999614  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff040bb60327424d8aeec71e3bf58a0a" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:37.000341  9468 raft_consensus.cc:3060] T ff040bb60327424d8aeec71e3bf58a0a P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:37.001058  9592 tablet_bootstrap.cc:492] T b90aae84687f41e99e58dada706ae2d7 P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:37.001686  9592 ts_tablet_manager.cc:1403] T b90aae84687f41e99e58dada706ae2d7 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.058s	user 0.015s	sys 0.004s
I20260709 13:04:37.004911  9592 raft_consensus.cc:359] T b90aae84687f41e99e58dada706ae2d7 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:37.005894  9592 raft_consensus.cc:385] T b90aae84687f41e99e58dada706ae2d7 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:37.006062  9894 raft_consensus.cc:493] T 8f602c194d1c445ba1851f0a2272b40b P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.006255  9592 raft_consensus.cc:740] T b90aae84687f41e99e58dada706ae2d7 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:37.006865  9894 raft_consensus.cc:515] T 8f602c194d1c445ba1851f0a2272b40b P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:37.007365  9592 consensus_queue.cc:260] T b90aae84687f41e99e58dada706ae2d7 P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:37.009563  9894 leader_election.cc:290] T 8f602c194d1c445ba1851f0a2272b40b P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:37.009764  9592 ts_tablet_manager.cc:1434] T b90aae84687f41e99e58dada706ae2d7 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:04:37.011950  9592 tablet_bootstrap.cc:492] T 8e017796f5c643859d8a0e1916ab3f05 P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:37.006174  9973 raft_consensus.cc:515] T 3bd9c3f12cc546ff905df61c5a9028f6 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:37.020004  9592 tablet_bootstrap.cc:654] T 8e017796f5c643859d8a0e1916ab3f05 P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:37.026188  9973 leader_election.cc:290] T 3bd9c3f12cc546ff905df61c5a9028f6 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Requested vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:37.032436  9469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bd9c3f12cc546ff905df61c5a9028f6" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:37.033222  9469 raft_consensus.cc:3060] T 3bd9c3f12cc546ff905df61c5a9028f6 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:37.045852  9364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37995, user_credentials={real_user=slave}} blocked reactor thread for 85111.8us
I20260709 13:04:37.050693  9396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f602c194d1c445ba1851f0a2272b40b" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:37.051477  9396 raft_consensus.cc:2468] T 8f602c194d1c445ba1851f0a2272b40b P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 0.
I20260709 13:04:37.051707  9939 raft_consensus.cc:493] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.052204  9939 raft_consensus.cc:515] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:37.057015  9939 leader_election.cc:290] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:37.056540  9468 raft_consensus.cc:2468] T ff040bb60327424d8aeec71e3bf58a0a P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 1.
W20260709 13:04:37.062566  9287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33607, user_credentials={real_user=slave}} blocked reactor thread for 203878us
I20260709 13:04:37.063752  9591 ts_tablet_manager.cc:1434] T b305803a339e40f99c1a6af7f6f84f7c P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.236s	user 0.007s	sys 0.000s
I20260709 13:04:37.064864  9591 tablet_bootstrap.cc:492] T ff040bb60327424d8aeec71e3bf58a0a P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:37.067870  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff040bb60327424d8aeec71e3bf58a0a" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
W20260709 13:04:37.070399  9289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38559, user_credentials={real_user=slave}} blocked reactor thread for 144227us
I20260709 13:04:37.071878  9591 tablet_bootstrap.cc:654] T ff040bb60327424d8aeec71e3bf58a0a P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:37.053172  9436 leader_election.cc:304] T 8f602c194d1c445ba1851f0a2272b40b P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:37.090262  9846 raft_consensus.cc:2804] T 8f602c194d1c445ba1851f0a2272b40b P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:37.090567  9512 leader_election.cc:304] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:37.090694  9846 raft_consensus.cc:493] T 8f602c194d1c445ba1851f0a2272b40b P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:37.091189  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bd9c3f12cc546ff905df61c5a9028f6" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:37.091452  9935 raft_consensus.cc:2804] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:37.092026  9935 raft_consensus.cc:697] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Becoming Leader. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Running, Role: LEADER
I20260709 13:04:37.092867  9935 consensus_queue.cc:237] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:37.091236  9846 raft_consensus.cc:3060] T 8f602c194d1c445ba1851f0a2272b40b P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:37.101178  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bd9c3f12cc546ff905df61c5a9028f6" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8"
I20260709 13:04:37.103713  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff040bb60327424d8aeec71e3bf58a0a" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8"
I20260709 13:04:37.099903  9469 raft_consensus.cc:2468] T 3bd9c3f12cc546ff905df61c5a9028f6 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 1.
I20260709 13:04:37.106639  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f602c194d1c445ba1851f0a2272b40b" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:37.108372  9471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99d222cbc8341f7ac9a4b2e7eb7e5f0" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
W20260709 13:04:37.111907  9512 leader_election.cc:343] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:37.114075  9320 raft_consensus.cc:3060] T b305803a339e40f99c1a6af7f6f84f7c P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:37.115227  9894 consensus_queue.cc:1048] T 65ba9982e9bd4177995544e13394911a P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Connected to new peer: Peer: permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:37.132876  9512 leader_election.cc:304] T 3bd9c3f12cc546ff905df61c5a9028f6 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:37.134325  9973 raft_consensus.cc:2804] T 3bd9c3f12cc546ff905df61c5a9028f6 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:37.135238  9973 raft_consensus.cc:697] T 3bd9c3f12cc546ff905df61c5a9028f6 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Becoming Leader. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Running, Role: LEADER
W20260709 13:04:37.135492  9438 consensus_peers.cc:597] T a792fefbeb0c4eb79e87501fb6dbe780 P ef5fe58eb3e04ae18fda957b4d507eff -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:37.136639  9973 consensus_queue.cc:237] T 3bd9c3f12cc546ff905df61c5a9028f6 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
W20260709 13:04:37.139302  9364 leader_election.cc:343] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:37.144783  9438 leader_election.cc:343] T 8f602c194d1c445ba1851f0a2272b40b P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:37.147907  9512 leader_election.cc:343] T 3bd9c3f12cc546ff905df61c5a9028f6 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:37.151124  9512 leader_election.cc:343] T 3bd9c3f12cc546ff905df61c5a9028f6 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:37.152544  9512 leader_election.cc:343] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:37.155580  9894 raft_consensus.cc:493] T 890ffb7e0f6b463f8d8771d5cd9481c9 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.183022  9894 raft_consensus.cc:515] T 890ffb7e0f6b463f8d8771d5cd9481c9 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:37.187518  9396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890ffb7e0f6b463f8d8771d5cd9481c9" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:37.188256  9396 raft_consensus.cc:2468] T 890ffb7e0f6b463f8d8771d5cd9481c9 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 0.
I20260709 13:04:37.190518  9846 raft_consensus.cc:515] T 8f602c194d1c445ba1851f0a2272b40b P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:37.193763  9436 leader_election.cc:304] T 890ffb7e0f6b463f8d8771d5cd9481c9 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:37.193938  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f602c194d1c445ba1851f0a2272b40b" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8"
I20260709 13:04:37.194907  9937 raft_consensus.cc:2804] T 890ffb7e0f6b463f8d8771d5cd9481c9 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:37.195328  9937 raft_consensus.cc:493] T 890ffb7e0f6b463f8d8771d5cd9481c9 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:37.195478  9846 leader_election.cc:290] T 8f602c194d1c445ba1851f0a2272b40b P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Requested vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:37.196164  9894 leader_election.cc:290] T 890ffb7e0f6b463f8d8771d5cd9481c9 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
W20260709 13:04:37.196278  9438 leader_election.cc:343] T 8f602c194d1c445ba1851f0a2272b40b P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:37.198915  9542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890ffb7e0f6b463f8d8771d5cd9481c9" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
W20260709 13:04:37.201262  9438 leader_election.cc:343] T 890ffb7e0f6b463f8d8771d5cd9481c9 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:37.195676  9937 raft_consensus.cc:3060] T 890ffb7e0f6b463f8d8771d5cd9481c9 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:37.156374  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99d222cbc8341f7ac9a4b2e7eb7e5f0" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:37.213748  9590 tablet_bootstrap.cc:492] T 890ffb7e0f6b463f8d8771d5cd9481c9 P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:37.213531  9396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f602c194d1c445ba1851f0a2272b40b" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:37.214378  9590 ts_tablet_manager.cc:1403] T 890ffb7e0f6b463f8d8771d5cd9481c9 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.373s	user 0.008s	sys 0.005s
I20260709 13:04:37.214807  9396 raft_consensus.cc:3060] T 8f602c194d1c445ba1851f0a2272b40b P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:37.209208  9364 leader_election.cc:343] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:37.219535  9364 leader_election.cc:304] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49; no voters: 932245f14aac417f913cc7330a1833b8, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:37.159381  9593 tablet_bootstrap.cc:492] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:37.180774  9592 tablet_bootstrap.cc:492] T 8e017796f5c643859d8a0e1916ab3f05 P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:37.222481  9592 ts_tablet_manager.cc:1403] T 8e017796f5c643859d8a0e1916ab3f05 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.211s	user 0.016s	sys 0.019s
I20260709 13:04:37.223146  9593 ts_tablet_manager.cc:1403] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.528s	user 0.021s	sys 0.018s
I20260709 13:04:37.226078  9893 raft_consensus.cc:2749] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:37.226994  9590 raft_consensus.cc:359] T 890ffb7e0f6b463f8d8771d5cd9481c9 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:37.227686  9590 raft_consensus.cc:385] T 890ffb7e0f6b463f8d8771d5cd9481c9 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:37.227962  9590 raft_consensus.cc:740] T 890ffb7e0f6b463f8d8771d5cd9481c9 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:37.220841  9937 raft_consensus.cc:515] T 890ffb7e0f6b463f8d8771d5cd9481c9 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:37.228894  9590 consensus_queue.cc:260] T 890ffb7e0f6b463f8d8771d5cd9481c9 P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:37.229584  9592 raft_consensus.cc:359] T 8e017796f5c643859d8a0e1916ab3f05 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:37.230299  9592 raft_consensus.cc:385] T 8e017796f5c643859d8a0e1916ab3f05 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:37.230589  9592 raft_consensus.cc:740] T 8e017796f5c643859d8a0e1916ab3f05 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:37.231247  9590 ts_tablet_manager.cc:1434] T 890ffb7e0f6b463f8d8771d5cd9481c9 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.005s
I20260709 13:04:37.232756  9590 tablet_bootstrap.cc:492] T 8dfdb24cbc824b95ac65712323103e2a P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
W20260709 13:04:37.235013  9268 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:37.231338  9592 consensus_queue.cc:260] T 8e017796f5c643859d8a0e1916ab3f05 P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:37.238400  9592 ts_tablet_manager.cc:1434] T 8e017796f5c643859d8a0e1916ab3f05 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:04:37.224095  9221 catalog_manager.cc:5697] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf reported cstate change: term changed from 0 to 1, leader changed from <none> to dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196). New cstate: current_term: 1 leader_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:37.241248  9221 catalog_manager.cc:5697] T 3bd9c3f12cc546ff905df61c5a9028f6 P dfbbb80ab8e345e0ae1684fafefceccf reported cstate change: term changed from 0 to 1, leader changed from <none> to dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196). New cstate: current_term: 1 leader_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:37.242697  9392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890ffb7e0f6b463f8d8771d5cd9481c9" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:37.243448  9392 raft_consensus.cc:3060] T 890ffb7e0f6b463f8d8771d5cd9481c9 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:37.246697  9591 tablet_bootstrap.cc:492] T ff040bb60327424d8aeec71e3bf58a0a P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:37.247243  9591 ts_tablet_manager.cc:1403] T ff040bb60327424d8aeec71e3bf58a0a P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.183s	user 0.044s	sys 0.084s
I20260709 13:04:37.248520  9590 tablet_bootstrap.cc:654] T 8dfdb24cbc824b95ac65712323103e2a P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:37.257752  9592 tablet_bootstrap.cc:492] T 803c43e83ee5487590c9d922559adc0f P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:37.256309  9591 raft_consensus.cc:359] T ff040bb60327424d8aeec71e3bf58a0a P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:37.258806  9591 raft_consensus.cc:385] T ff040bb60327424d8aeec71e3bf58a0a P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:37.259124  9591 raft_consensus.cc:740] T ff040bb60327424d8aeec71e3bf58a0a P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:37.259994  9591 consensus_queue.cc:260] T ff040bb60327424d8aeec71e3bf58a0a P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:37.262039  9542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890ffb7e0f6b463f8d8771d5cd9481c9" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
I20260709 13:04:37.262703  9542 raft_consensus.cc:3060] T 890ffb7e0f6b463f8d8771d5cd9481c9 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:37.266763  9396 raft_consensus.cc:2468] T 8f602c194d1c445ba1851f0a2272b40b P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 1.
I20260709 13:04:37.268741  9591 ts_tablet_manager.cc:1434] T ff040bb60327424d8aeec71e3bf58a0a P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.001s
I20260709 13:04:37.269945  9591 tablet_bootstrap.cc:492] T 1a5145e5f9a64fe0acdd74d909e841fc P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:37.270247  9436 leader_election.cc:304] T 8f602c194d1c445ba1851f0a2272b40b P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 932245f14aac417f913cc7330a1833b8
I20260709 13:04:37.271489  9846 raft_consensus.cc:2804] T 8f602c194d1c445ba1851f0a2272b40b P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:37.272013  9846 raft_consensus.cc:697] T 8f602c194d1c445ba1851f0a2272b40b P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Becoming Leader. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Running, Role: LEADER
I20260709 13:04:37.273285  9846 consensus_queue.cc:237] T 8f602c194d1c445ba1851f0a2272b40b P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:37.275131  9542 raft_consensus.cc:2468] T 890ffb7e0f6b463f8d8771d5cd9481c9 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 1.
I20260709 13:04:37.279070  9894 consensus_queue.cc:1048] T a792fefbeb0c4eb79e87501fb6dbe780 P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:37.287312  9591 tablet_bootstrap.cc:654] T 1a5145e5f9a64fe0acdd74d909e841fc P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:37.293375  9593 raft_consensus.cc:359] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:37.302170  9593 raft_consensus.cc:385] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:37.302667  9593 raft_consensus.cc:740] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:37.303647  9593 consensus_queue.cc:260] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:37.309664  9593 ts_tablet_manager.cc:1434] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.086s	user 0.009s	sys 0.000s
I20260709 13:04:37.267352  9937 leader_election.cc:290] T 890ffb7e0f6b463f8d8771d5cd9481c9 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Requested vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:37.363619  9438 leader_election.cc:304] T 890ffb7e0f6b463f8d8771d5cd9481c9 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:37.367758  9590 tablet_bootstrap.cc:492] T 8dfdb24cbc824b95ac65712323103e2a P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:37.368366  9590 ts_tablet_manager.cc:1403] T 8dfdb24cbc824b95ac65712323103e2a P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.136s	user 0.018s	sys 0.009s
I20260709 13:04:37.373966  9592 tablet_bootstrap.cc:654] T 803c43e83ee5487590c9d922559adc0f P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:37.372370  9905 raft_consensus.cc:2804] T 890ffb7e0f6b463f8d8771d5cd9481c9 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:37.407398  9593 tablet_bootstrap.cc:492] T 8e017796f5c643859d8a0e1916ab3f05 P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:37.386571  9392 raft_consensus.cc:2468] T 890ffb7e0f6b463f8d8771d5cd9481c9 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 1.
I20260709 13:04:37.411141  9846 raft_consensus.cc:493] T b90aae84687f41e99e58dada706ae2d7 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.411755  9846 raft_consensus.cc:515] T b90aae84687f41e99e58dada706ae2d7 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:37.413918  9846 leader_election.cc:290] T b90aae84687f41e99e58dada706ae2d7 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:37.393445  9905 raft_consensus.cc:697] T 890ffb7e0f6b463f8d8771d5cd9481c9 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Becoming Leader. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Running, Role: LEADER
I20260709 13:04:37.419987  9905 consensus_queue.cc:237] T 890ffb7e0f6b463f8d8771d5cd9481c9 P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:37.481806  9591 tablet_bootstrap.cc:492] T 1a5145e5f9a64fe0acdd74d909e841fc P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:37.482626  9591 ts_tablet_manager.cc:1403] T 1a5145e5f9a64fe0acdd74d909e841fc P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.213s	user 0.024s	sys 0.018s
I20260709 13:04:37.487644  9320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90aae84687f41e99e58dada706ae2d7" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:37.492966  9542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90aae84687f41e99e58dada706ae2d7" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:37.493556  9590 raft_consensus.cc:359] T 8dfdb24cbc824b95ac65712323103e2a P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:37.494457  9590 raft_consensus.cc:385] T 8dfdb24cbc824b95ac65712323103e2a P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:37.494740  9590 raft_consensus.cc:740] T 8dfdb24cbc824b95ac65712323103e2a P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
W20260709 13:04:37.502396  9438 leader_election.cc:343] T b90aae84687f41e99e58dada706ae2d7 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:37.507311  9593 tablet_bootstrap.cc:654] T 8e017796f5c643859d8a0e1916ab3f05 P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:37.508466  9438 leader_election.cc:343] T b90aae84687f41e99e58dada706ae2d7 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:37.519665  9692 raft_consensus.cc:493] T 8e017796f5c643859d8a0e1916ab3f05 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.520267  9692 raft_consensus.cc:515] T 8e017796f5c643859d8a0e1916ab3f05 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:37.495354  9590 consensus_queue.cc:260] T 8dfdb24cbc824b95ac65712323103e2a P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:37.530511  9692 leader_election.cc:290] T 8e017796f5c643859d8a0e1916ab3f05 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:37.531682  9591 raft_consensus.cc:359] T 1a5145e5f9a64fe0acdd74d909e841fc P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:37.532421  9591 raft_consensus.cc:385] T 1a5145e5f9a64fe0acdd74d909e841fc P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:37.532693  9591 raft_consensus.cc:740] T 1a5145e5f9a64fe0acdd74d909e841fc P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:37.533358  9591 consensus_queue.cc:260] T 1a5145e5f9a64fe0acdd74d909e841fc P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:37.533926  9396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e017796f5c643859d8a0e1916ab3f05" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:37.538630  9593 tablet_bootstrap.cc:492] T 8e017796f5c643859d8a0e1916ab3f05 P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:37.539162  9593 ts_tablet_manager.cc:1403] T 8e017796f5c643859d8a0e1916ab3f05 P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.132s	user 0.007s	sys 0.005s
I20260709 13:04:37.541458  9592 tablet_bootstrap.cc:492] T 803c43e83ee5487590c9d922559adc0f P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:37.542052  9592 ts_tablet_manager.cc:1403] T 803c43e83ee5487590c9d922559adc0f P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.285s	user 0.058s	sys 0.051s
I20260709 13:04:37.544164  9217 catalog_manager.cc:5697] T 8f602c194d1c445ba1851f0a2272b40b P ef5fe58eb3e04ae18fda957b4d507eff reported cstate change: term changed from 0 to 1, leader changed from <none> to ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:37.560211  9436 leader_election.cc:343] T 8e017796f5c643859d8a0e1916ab3f05 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:37.561918  9590 ts_tablet_manager.cc:1434] T 8dfdb24cbc824b95ac65712323103e2a P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.193s	user 0.009s	sys 0.000s
I20260709 13:04:37.564708  9590 tablet_bootstrap.cc:492] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
I20260709 13:04:37.508948  9438 leader_election.cc:304] T b90aae84687f41e99e58dada706ae2d7 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef5fe58eb3e04ae18fda957b4d507eff; no voters: 932245f14aac417f913cc7330a1833b8, dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:37.574875  9692 raft_consensus.cc:2749] T b90aae84687f41e99e58dada706ae2d7 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:37.575935  9438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37995, user_credentials={real_user=slave}} blocked reactor thread for 67506.6us
W20260709 13:04:37.626955  9438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37995, user_credentials={real_user=slave}} blocked reactor thread for 50401.5us
I20260709 13:04:37.636204  9592 raft_consensus.cc:359] T 803c43e83ee5487590c9d922559adc0f P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:37.637785  9593 raft_consensus.cc:359] T 8e017796f5c643859d8a0e1916ab3f05 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:37.640684  9593 raft_consensus.cc:385] T 8e017796f5c643859d8a0e1916ab3f05 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:37.641032  9593 raft_consensus.cc:740] T 8e017796f5c643859d8a0e1916ab3f05 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:37.641762  9593 consensus_queue.cc:260] T 8e017796f5c643859d8a0e1916ab3f05 P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:37.638526  9591 ts_tablet_manager.cc:1434] T 1a5145e5f9a64fe0acdd74d909e841fc P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.156s	user 0.005s	sys 0.005s
I20260709 13:04:37.654726  9591 tablet_bootstrap.cc:492] T 3bd9c3f12cc546ff905df61c5a9028f6 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:37.644584  9590 tablet_bootstrap.cc:654] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:37.637023  9592 raft_consensus.cc:385] T 803c43e83ee5487590c9d922559adc0f P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:37.657174  9593 ts_tablet_manager.cc:1434] T 8e017796f5c643859d8a0e1916ab3f05 P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.118s	user 0.010s	sys 0.000s
I20260709 13:04:37.656045  9592 raft_consensus.cc:740] T 803c43e83ee5487590c9d922559adc0f P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:37.665249  9592 consensus_queue.cc:260] T 803c43e83ee5487590c9d922559adc0f P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:37.669479  9592 ts_tablet_manager.cc:1434] T 803c43e83ee5487590c9d922559adc0f P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.127s	user 0.021s	sys 0.011s
I20260709 13:04:37.681280  9546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e017796f5c643859d8a0e1916ab3f05" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:37.684788  9593 tablet_bootstrap.cc:492] T 8528ae822cb04615a9dbd1166b7d7328 P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:37.698056  9893 raft_consensus.cc:493] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.698678  9893 raft_consensus.cc:515] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:37.700811  9217 catalog_manager.cc:5697] T 890ffb7e0f6b463f8d8771d5cd9481c9 P ef5fe58eb3e04ae18fda957b4d507eff reported cstate change: term changed from 0 to 1, leader changed from <none> to ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:37.709167  9546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dfdb24cbc824b95ac65712323103e2a" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:37.710013  9546 raft_consensus.cc:2468] T 8dfdb24cbc824b95ac65712323103e2a P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 0.
I20260709 13:04:37.712800  9591 tablet_bootstrap.cc:654] T 3bd9c3f12cc546ff905df61c5a9028f6 P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:37.712623  9320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dfdb24cbc824b95ac65712323103e2a" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:37.700929  9893 leader_election.cc:290] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:37.711228  9364 leader_election.cc:304] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 
I20260709 13:04:37.720993  9593 tablet_bootstrap.cc:654] T 8528ae822cb04615a9dbd1166b7d7328 P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:37.727517  9438 leader_election.cc:343] T 8e017796f5c643859d8a0e1916ab3f05 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:37.728024  9438 leader_election.cc:304] T 8e017796f5c643859d8a0e1916ab3f05 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef5fe58eb3e04ae18fda957b4d507eff; no voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:37.732398  9692 raft_consensus.cc:2749] T 8e017796f5c643859d8a0e1916ab3f05 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:37.734000  9592 tablet_bootstrap.cc:492] T 9b19e51cda7e44e5a1f02a736e555ac4 P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
W20260709 13:04:37.735455  9364 leader_election.cc:343] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:37.738147  9512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37633, user_credentials={real_user=slave}} blocked reactor thread for 68953.7us
I20260709 13:04:37.727370  9938 raft_consensus.cc:2804] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:37.745784  9590 tablet_bootstrap.cc:492] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:37.747411  9590 ts_tablet_manager.cc:1403] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.183s	user 0.010s	sys 0.007s
I20260709 13:04:37.742986  9938 raft_consensus.cc:493] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:37.758279  9938 raft_consensus.cc:3060] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:37.770328  9590 raft_consensus.cc:359] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:37.771211  9590 raft_consensus.cc:385] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:37.771488  9590 raft_consensus.cc:740] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:37.744324  9935 consensus_queue.cc:1048] T 3bd9c3f12cc546ff905df61c5a9028f6 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 13:04:37.786631  9973 consensus_queue.cc:1048] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:04:37.789301  9590 consensus_queue.cc:260] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:37.753283 10001 raft_consensus.cc:493] T ff040bb60327424d8aeec71e3bf58a0a P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.823149  9590 ts_tablet_manager.cc:1434] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.075s	user 0.010s	sys 0.000s
I20260709 13:04:37.835403  9590 tablet_bootstrap.cc:492] T 8e017796f5c643859d8a0e1916ab3f05 P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
I20260709 13:04:37.796047 10001 raft_consensus.cc:515] T ff040bb60327424d8aeec71e3bf58a0a P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:37.826251  9973 raft_consensus.cc:493] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.841610  9973 raft_consensus.cc:515] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:37.842394 10001 leader_election.cc:290] T ff040bb60327424d8aeec71e3bf58a0a P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:37.842960  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff040bb60327424d8aeec71e3bf58a0a" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:37.829710  9893 raft_consensus.cc:493] T 8e017796f5c643859d8a0e1916ab3f05 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.845872  9546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff040bb60327424d8aeec71e3bf58a0a" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:37.846412  9893 raft_consensus.cc:515] T 8e017796f5c643859d8a0e1916ab3f05 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:37.850432  9893 leader_election.cc:290] T 8e017796f5c643859d8a0e1916ab3f05 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:37.852481  9320 raft_consensus.cc:3060] T ff040bb60327424d8aeec71e3bf58a0a P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:37.852588  9289 leader_election.cc:304] T ff040bb60327424d8aeec71e3bf58a0a P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 932245f14aac417f913cc7330a1833b8; no voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:37.864511  9542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e017796f5c643859d8a0e1916ab3f05" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
W20260709 13:04:37.867383  9364 leader_election.cc:343] T 8e017796f5c643859d8a0e1916ab3f05 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:37.881215  9937 consensus_queue.cc:1048] T 890ffb7e0f6b463f8d8771d5cd9481c9 P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:37.888631  9973 leader_election.cc:290] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
W20260709 13:04:37.903822  9438 consensus_peers.cc:597] T 8f602c194d1c445ba1851f0a2272b40b P ef5fe58eb3e04ae18fda957b4d507eff -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:37.926833  9592 tablet_bootstrap.cc:654] T 9b19e51cda7e44e5a1f02a736e555ac4 P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:37.939958  9471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90aae84687f41e99e58dada706ae2d7" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:37.941979  9471 raft_consensus.cc:2468] T b90aae84687f41e99e58dada706ae2d7 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 0.
W20260709 13:04:37.949277  9512 consensus_peers.cc:597] T 3bd9c3f12cc546ff905df61c5a9028f6 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:37.951264  9905 consensus_queue.cc:1048] T 890ffb7e0f6b463f8d8771d5cd9481c9 P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:37.957235  9946 raft_consensus.cc:493] T 1a5145e5f9a64fe0acdd74d909e841fc P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.957818  9946 raft_consensus.cc:515] T 1a5145e5f9a64fe0acdd74d909e841fc P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:37.960007  9946 leader_election.cc:290] T 1a5145e5f9a64fe0acdd74d909e841fc P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:37.965341  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a5145e5f9a64fe0acdd74d909e841fc" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:37.966291  9321 raft_consensus.cc:2468] T 1a5145e5f9a64fe0acdd74d909e841fc P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 0.
I20260709 13:04:37.967983  9364 leader_election.cc:304] T 1a5145e5f9a64fe0acdd74d909e841fc P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, a91e8b10a5984dec9d3777a7275cef49; no voters: 
I20260709 13:04:37.971550  9590 tablet_bootstrap.cc:654] T 8e017796f5c643859d8a0e1916ab3f05 P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:37.972141  9512 leader_election.cc:304] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:37.998852  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90aae84687f41e99e58dada706ae2d7" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:37.988096  9946 raft_consensus.cc:2804] T 1a5145e5f9a64fe0acdd74d909e841fc P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:38.004491 10000 raft_consensus.cc:2749] T ff040bb60327424d8aeec71e3bf58a0a P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:37.990284  9995 raft_consensus.cc:2804] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:37.992309  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e017796f5c643859d8a0e1916ab3f05" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:38.020442  9938 raft_consensus.cc:515] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:38.008349  9543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a5145e5f9a64fe0acdd74d909e841fc" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:38.021502  9468 raft_consensus.cc:2468] T 8e017796f5c643859d8a0e1916ab3f05 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 0.
W20260709 13:04:38.022927  9364 leader_election.cc:343] T 1a5145e5f9a64fe0acdd74d909e841fc P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:38.004084  9946 raft_consensus.cc:493] T 1a5145e5f9a64fe0acdd74d909e841fc P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.007618  9995 raft_consensus.cc:493] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.037783  9364 leader_election.cc:304] T 8e017796f5c643859d8a0e1916ab3f05 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:38.049422  9591 tablet_bootstrap.cc:492] T 3bd9c3f12cc546ff905df61c5a9028f6 P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:38.050280  9591 ts_tablet_manager.cc:1403] T 3bd9c3f12cc546ff905df61c5a9028f6 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.396s	user 0.053s	sys 0.082s
I20260709 13:04:38.028349  9946 raft_consensus.cc:3060] T 1a5145e5f9a64fe0acdd74d909e841fc P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:38.053942  9905 raft_consensus.cc:493] T 803c43e83ee5487590c9d922559adc0f P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.054687  9891 raft_consensus.cc:2804] T 8e017796f5c643859d8a0e1916ab3f05 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:38.056031  9543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dfdb24cbc824b95ac65712323103e2a" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
I20260709 13:04:38.034760  9995 raft_consensus.cc:3060] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:38.063244  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dfdb24cbc824b95ac65712323103e2a" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8"
I20260709 13:04:38.059808  9891 raft_consensus.cc:493] T 8e017796f5c643859d8a0e1916ab3f05 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.068027  9891 raft_consensus.cc:3060] T 8e017796f5c643859d8a0e1916ab3f05 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:38.063154  9905 raft_consensus.cc:515] T 803c43e83ee5487590c9d922559adc0f P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:38.071707  9905 leader_election.cc:290] T 803c43e83ee5487590c9d922559adc0f P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:38.074666  9593 tablet_bootstrap.cc:492] T 8528ae822cb04615a9dbd1166b7d7328 P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:38.076057  9593 ts_tablet_manager.cc:1403] T 8528ae822cb04615a9dbd1166b7d7328 P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.392s	user 0.015s	sys 0.008s
W20260709 13:04:38.076432  9364 leader_election.cc:343] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:38.074338  9543 raft_consensus.cc:3060] T 8dfdb24cbc824b95ac65712323103e2a P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:38.086819  9545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "803c43e83ee5487590c9d922559adc0f" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:38.081238  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "803c43e83ee5487590c9d922559adc0f" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
W20260709 13:04:38.093995  9438 leader_election.cc:343] T 803c43e83ee5487590c9d922559adc0f P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:38.095840  9438 leader_election.cc:343] T 803c43e83ee5487590c9d922559adc0f P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:38.096268 10007 log.cc:927] Time spent T 3bd9c3f12cc546ff905df61c5a9028f6 P ef5fe58eb3e04ae18fda957b4d507eff: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 13:04:38.102115  9512 leader_election.cc:343] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:38.104987  9996 consensus_queue.cc:1048] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Connected to new peer: Peer: permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:38.096287  9438 leader_election.cc:304] T 803c43e83ee5487590c9d922559adc0f P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef5fe58eb3e04ae18fda957b4d507eff; no voters: 932245f14aac417f913cc7330a1833b8, dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:38.111722  9593 raft_consensus.cc:359] T 8528ae822cb04615a9dbd1166b7d7328 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:38.063351  9938 leader_election.cc:290] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Requested vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:38.115156  9593 raft_consensus.cc:385] T 8528ae822cb04615a9dbd1166b7d7328 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:38.120484  9593 raft_consensus.cc:740] T 8528ae822cb04615a9dbd1166b7d7328 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:38.118894  9937 raft_consensus.cc:2749] T 803c43e83ee5487590c9d922559adc0f P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:38.121752  9905 consensus_queue.cc:1048] T 8f602c194d1c445ba1851f0a2272b40b P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:38.123167  9591 raft_consensus.cc:359] T 3bd9c3f12cc546ff905df61c5a9028f6 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:38.145352  9591 raft_consensus.cc:385] T 3bd9c3f12cc546ff905df61c5a9028f6 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:38.146073  9591 raft_consensus.cc:740] T 3bd9c3f12cc546ff905df61c5a9028f6 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:38.146905  9591 consensus_queue.cc:260] T 3bd9c3f12cc546ff905df61c5a9028f6 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:38.149806  9593 consensus_queue.cc:260] T 8528ae822cb04615a9dbd1166b7d7328 P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:38.151944  9593 ts_tablet_manager.cc:1434] T 8528ae822cb04615a9dbd1166b7d7328 P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.076s	user 0.004s	sys 0.001s
I20260709 13:04:38.127740  9592 tablet_bootstrap.cc:492] T 9b19e51cda7e44e5a1f02a736e555ac4 P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:38.128140  9543 raft_consensus.cc:2468] T 8dfdb24cbc824b95ac65712323103e2a P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 1.
I20260709 13:04:38.156160  9592 ts_tablet_manager.cc:1403] T 9b19e51cda7e44e5a1f02a736e555ac4 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.431s	user 0.020s	sys 0.020s
I20260709 13:04:38.159291  9592 raft_consensus.cc:359] T 9b19e51cda7e44e5a1f02a736e555ac4 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:38.160055  9592 raft_consensus.cc:385] T 9b19e51cda7e44e5a1f02a736e555ac4 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:38.160395  9592 raft_consensus.cc:740] T 9b19e51cda7e44e5a1f02a736e555ac4 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:38.163754  9891 raft_consensus.cc:515] T 8e017796f5c643859d8a0e1916ab3f05 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:38.166242  9995 raft_consensus.cc:515] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:38.169925  9542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e017796f5c643859d8a0e1916ab3f05" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
I20260709 13:04:38.171886  9591 ts_tablet_manager.cc:1434] T 3bd9c3f12cc546ff905df61c5a9028f6 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.121s	user 0.009s	sys 0.000s
I20260709 13:04:38.172963  9591 tablet_bootstrap.cc:492] T a792fefbeb0c4eb79e87501fb6dbe780 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:38.174975  9946 raft_consensus.cc:515] T 1a5145e5f9a64fe0acdd74d909e841fc P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:38.178056  9593 tablet_bootstrap.cc:492] T a6f012a5e95f4006871d83f7b18e356b P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:38.180132  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e017796f5c643859d8a0e1916ab3f05" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:38.187354  9995 leader_election.cc:290] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Requested vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:38.213601  9946 leader_election.cc:290] T 1a5145e5f9a64fe0acdd74d909e841fc P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Requested vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:38.214623  9467 raft_consensus.cc:3060] T 8e017796f5c643859d8a0e1916ab3f05 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:38.188237  9319 raft_consensus.cc:3060] T 3bd9c3f12cc546ff905df61c5a9028f6 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:38.189379  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90aae84687f41e99e58dada706ae2d7" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:38.219328  9472 raft_consensus.cc:3060] T b90aae84687f41e99e58dada706ae2d7 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:38.220126  9593 tablet_bootstrap.cc:654] T a6f012a5e95f4006871d83f7b18e356b P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:38.189908  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90aae84687f41e99e58dada706ae2d7" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8"
I20260709 13:04:38.190253  9592 consensus_queue.cc:260] T 9b19e51cda7e44e5a1f02a736e555ac4 P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:38.226907  9592 ts_tablet_manager.cc:1434] T 9b19e51cda7e44e5a1f02a736e555ac4 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.070s	user 0.006s	sys 0.001s
I20260709 13:04:38.197368  9591 tablet_bootstrap.cc:654] T a792fefbeb0c4eb79e87501fb6dbe780 P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:38.234772  9512 leader_election.cc:343] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:38.244638  9472 raft_consensus.cc:2468] T b90aae84687f41e99e58dada706ae2d7 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 1.
I20260709 13:04:38.166814  9891 leader_election.cc:290] T 8e017796f5c643859d8a0e1916ab3f05 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Requested vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:38.197734  9364 leader_election.cc:304] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 932245f14aac417f913cc7330a1833b8
I20260709 13:04:38.260947  9592 tablet_bootstrap.cc:492] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:38.303700  9592 tablet_bootstrap.cc:654] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:38.305233  9364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37995, user_credentials={real_user=slave}} blocked reactor thread for 107620us
W20260709 13:04:38.306223  9364 leader_election.cc:343] T 8e017796f5c643859d8a0e1916ab3f05 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:38.303422  9512 leader_election.cc:304] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 932245f14aac417f913cc7330a1833b8
W20260709 13:04:38.321858 10020 log.cc:927] Time spent T 8f602c194d1c445ba1851f0a2272b40b P a91e8b10a5984dec9d3777a7275cef49: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:04:38.325677  9973 raft_consensus.cc:2804] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:38.326601  9973 raft_consensus.cc:697] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Becoming Leader. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Running, Role: LEADER
I20260709 13:04:38.328301  9973 consensus_queue.cc:237] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:38.335157  9939 raft_consensus.cc:2804] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:38.379119  9939 raft_consensus.cc:697] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Becoming Leader. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Running, Role: LEADER
I20260709 13:04:38.380034  9939 consensus_queue.cc:237] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
W20260709 13:04:38.342154 10023 log.cc:927] Time spent T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf: Append to log took a long time: real 0.141s	user 0.006s	sys 0.010s
W20260709 13:04:38.342636 10014 log.cc:927] Time spent T 890ffb7e0f6b463f8d8771d5cd9481c9 P dfbbb80ab8e345e0ae1684fafefceccf: Append to log took a long time: real 0.127s	user 0.000s	sys 0.015s
W20260709 13:04:38.343041 10007 log.cc:927] Time spent T 3bd9c3f12cc546ff905df61c5a9028f6 P ef5fe58eb3e04ae18fda957b4d507eff: Append to log took a long time: real 0.155s	user 0.007s	sys 0.020s
I20260709 13:04:38.344139  9590 tablet_bootstrap.cc:492] T 8e017796f5c643859d8a0e1916ab3f05 P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:38.383936  9590 ts_tablet_manager.cc:1403] T 8e017796f5c643859d8a0e1916ab3f05 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.549s	user 0.029s	sys 0.023s
I20260709 13:04:38.387323  9590 raft_consensus.cc:359] T 8e017796f5c643859d8a0e1916ab3f05 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:38.388128  9590 raft_consensus.cc:385] T 8e017796f5c643859d8a0e1916ab3f05 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:38.388445  9590 raft_consensus.cc:740] T 8e017796f5c643859d8a0e1916ab3f05 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:38.350158  9467 raft_consensus.cc:2468] T 8e017796f5c643859d8a0e1916ab3f05 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 1.
W20260709 13:04:38.351032  9364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37995, user_credentials={real_user=slave}} blocked reactor thread for 44090.8us
I20260709 13:04:38.389459  9590 consensus_queue.cc:260] T 8e017796f5c643859d8a0e1916ab3f05 P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:38.391072  9590 ts_tablet_manager.cc:1434] T 8e017796f5c643859d8a0e1916ab3f05 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:38.392060  9590 tablet_bootstrap.cc:492] T 02c431d6db7643adbb4b26a3c7e38b76 P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
W20260709 13:04:38.351090  9998 log.cc:927] Time spent T 890ffb7e0f6b463f8d8771d5cd9481c9 P ef5fe58eb3e04ae18fda957b4d507eff: Append to log took a long time: real 0.140s	user 0.005s	sys 0.005s
W20260709 13:04:38.355461 10019 log.cc:927] Time spent T ff040bb60327424d8aeec71e3bf58a0a P 932245f14aac417f913cc7330a1833b8: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 13:04:38.396490  9546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a5145e5f9a64fe0acdd74d909e841fc" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
I20260709 13:04:38.402699  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a5145e5f9a64fe0acdd74d909e841fc" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8"
I20260709 13:04:38.403688  9323 raft_consensus.cc:3060] T 1a5145e5f9a64fe0acdd74d909e841fc P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:38.404675  9590 tablet_bootstrap.cc:654] T 02c431d6db7643adbb4b26a3c7e38b76 P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:38.406683  9593 tablet_bootstrap.cc:492] T a6f012a5e95f4006871d83f7b18e356b P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:38.407204  9593 ts_tablet_manager.cc:1403] T a6f012a5e95f4006871d83f7b18e356b P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.254s	user 0.013s	sys 0.001s
W20260709 13:04:38.357266  9512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38559, user_credentials={real_user=slave}} blocked reactor thread for 53995.1us
I20260709 13:04:38.414021  9323 raft_consensus.cc:2468] T 1a5145e5f9a64fe0acdd74d909e841fc P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 1.
I20260709 13:04:38.369416  9591 tablet_bootstrap.cc:492] T a792fefbeb0c4eb79e87501fb6dbe780 P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:38.367380  9592 tablet_bootstrap.cc:492] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:38.420469  9593 raft_consensus.cc:359] T a6f012a5e95f4006871d83f7b18e356b P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:38.465965  9217 catalog_manager.cc:5697] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49 reported cstate change: term changed from 0 to 1, leader changed from <none> to a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "a91e8b10a5984dec9d3777a7275cef49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:38.467967  9592 ts_tablet_manager.cc:1403] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.207s	user 0.010s	sys 0.010s
I20260709 13:04:38.463868  9591 ts_tablet_manager.cc:1403] T a792fefbeb0c4eb79e87501fb6dbe780 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.291s	user 0.017s	sys 0.013s
W20260709 13:04:38.472018  9438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37995, user_credentials={real_user=slave}} blocked reactor thread for 87709us
I20260709 13:04:38.464591  9364 leader_election.cc:304] T 8e017796f5c643859d8a0e1916ab3f05 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:38.478236  9593 raft_consensus.cc:385] T a6f012a5e95f4006871d83f7b18e356b P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:38.478624  9593 raft_consensus.cc:740] T a6f012a5e95f4006871d83f7b18e356b P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:38.482725  9364 leader_election.cc:304] T 1a5145e5f9a64fe0acdd74d909e841fc P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, a91e8b10a5984dec9d3777a7275cef49; no voters: 
W20260709 13:04:38.485795  9364 leader_election.cc:343] T 1a5145e5f9a64fe0acdd74d909e841fc P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:38.490959  9593 consensus_queue.cc:260] T a6f012a5e95f4006871d83f7b18e356b P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:38.484176  9894 raft_consensus.cc:493] T 9b19e51cda7e44e5a1f02a736e555ac4 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.487107  9939 raft_consensus.cc:2804] T 8e017796f5c643859d8a0e1916ab3f05 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:38.493007  9893 raft_consensus.cc:2804] T 1a5145e5f9a64fe0acdd74d909e841fc P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:38.510694  9593 ts_tablet_manager.cc:1434] T a6f012a5e95f4006871d83f7b18e356b P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.103s	user 0.012s	sys 0.002s
W20260709 13:04:38.511303  9268 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:38.511807  9893 raft_consensus.cc:697] T 1a5145e5f9a64fe0acdd74d909e841fc P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Becoming Leader. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Running, Role: LEADER
I20260709 13:04:38.518344  9893 consensus_queue.cc:237] T 1a5145e5f9a64fe0acdd74d909e841fc P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:38.505424  9894 raft_consensus.cc:515] T 9b19e51cda7e44e5a1f02a736e555ac4 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:38.508375  9939 raft_consensus.cc:697] T 8e017796f5c643859d8a0e1916ab3f05 P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Becoming Leader. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Running, Role: LEADER
I20260709 13:04:38.535663  9546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19e51cda7e44e5a1f02a736e555ac4" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:38.542953  9593 tablet_bootstrap.cc:492] T 02c431d6db7643adbb4b26a3c7e38b76 P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:38.544050  9397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19e51cda7e44e5a1f02a736e555ac4" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
W20260709 13:04:38.544890  9438 leader_election.cc:343] T 9b19e51cda7e44e5a1f02a736e555ac4 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:38.524716  9894 leader_election.cc:290] T 9b19e51cda7e44e5a1f02a736e555ac4 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
W20260709 13:04:38.550444  9436 leader_election.cc:343] T 9b19e51cda7e44e5a1f02a736e555ac4 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:38.550803  9436 leader_election.cc:304] T 9b19e51cda7e44e5a1f02a736e555ac4 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef5fe58eb3e04ae18fda957b4d507eff; no voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:38.552906  9993 raft_consensus.cc:2749] T 9b19e51cda7e44e5a1f02a736e555ac4 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:38.553656  9219 catalog_manager.cc:5697] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf reported cstate change: term changed from 0 to 1, leader changed from <none> to dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196). New cstate: current_term: 1 leader_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:38.533627  9939 consensus_queue.cc:237] T 8e017796f5c643859d8a0e1916ab3f05 P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:38.556514  9590 tablet_bootstrap.cc:492] T 02c431d6db7643adbb4b26a3c7e38b76 P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:38.557052  9590 ts_tablet_manager.cc:1403] T 02c431d6db7643adbb4b26a3c7e38b76 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.165s	user 0.022s	sys 0.007s
I20260709 13:04:38.574692  9590 raft_consensus.cc:359] T 02c431d6db7643adbb4b26a3c7e38b76 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:38.575434  9590 raft_consensus.cc:385] T 02c431d6db7643adbb4b26a3c7e38b76 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:38.575724  9590 raft_consensus.cc:740] T 02c431d6db7643adbb4b26a3c7e38b76 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:38.576483  9590 consensus_queue.cc:260] T 02c431d6db7643adbb4b26a3c7e38b76 P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:38.583593  9891 raft_consensus.cc:493] T 8528ae822cb04615a9dbd1166b7d7328 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.584189  9891 raft_consensus.cc:515] T 8528ae822cb04615a9dbd1166b7d7328 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:38.588867  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8528ae822cb04615a9dbd1166b7d7328" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:38.589071  9891 leader_election.cc:290] T 8528ae822cb04615a9dbd1166b7d7328 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
W20260709 13:04:38.590901  9364 leader_election.cc:343] T 8528ae822cb04615a9dbd1166b7d7328 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:38.590963  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8528ae822cb04615a9dbd1166b7d7328" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
W20260709 13:04:38.593291  9364 leader_election.cc:343] T 8528ae822cb04615a9dbd1166b7d7328 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:38.594162  9364 leader_election.cc:304] T 8528ae822cb04615a9dbd1166b7d7328 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49; no voters: 932245f14aac417f913cc7330a1833b8, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:38.597698  9891 raft_consensus.cc:2749] T 8528ae822cb04615a9dbd1166b7d7328 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:38.590984  9590 ts_tablet_manager.cc:1434] T 02c431d6db7643adbb4b26a3c7e38b76 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.002s
I20260709 13:04:38.600098  9590 tablet_bootstrap.cc:492] T 1a5145e5f9a64fe0acdd74d909e841fc P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
I20260709 13:04:38.601476  9591 raft_consensus.cc:359] T a792fefbeb0c4eb79e87501fb6dbe780 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:38.603386  9591 raft_consensus.cc:385] T a792fefbeb0c4eb79e87501fb6dbe780 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:38.603582  9591 raft_consensus.cc:740] T a792fefbeb0c4eb79e87501fb6dbe780 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:38.602619  9592 raft_consensus.cc:359] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:38.604347  9592 raft_consensus.cc:385] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:38.604616  9592 raft_consensus.cc:740] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:38.605430  9591 consensus_queue.cc:260] T a792fefbeb0c4eb79e87501fb6dbe780 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:38.612381  9592 consensus_queue.cc:260] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:38.623418  9592 ts_tablet_manager.cc:1434] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.147s	user 0.007s	sys 0.000s
I20260709 13:04:38.627586  9893 raft_consensus.cc:493] T a6f012a5e95f4006871d83f7b18e356b P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.628243  9893 raft_consensus.cc:515] T a6f012a5e95f4006871d83f7b18e356b P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:38.630801  9590 tablet_bootstrap.cc:654] T 1a5145e5f9a64fe0acdd74d909e841fc P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:38.632401  9593 tablet_bootstrap.cc:654] T 02c431d6db7643adbb4b26a3c7e38b76 P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:38.635646  9545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f012a5e95f4006871d83f7b18e356b" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
W20260709 13:04:38.636981  9364 leader_election.cc:343] T a6f012a5e95f4006871d83f7b18e356b P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:38.639487  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f012a5e95f4006871d83f7b18e356b" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
W20260709 13:04:38.641381  9364 leader_election.cc:343] T a6f012a5e95f4006871d83f7b18e356b P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:38.641796  9364 leader_election.cc:304] T a6f012a5e95f4006871d83f7b18e356b P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49; no voters: 932245f14aac417f913cc7330a1833b8, dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:38.642558  9891 raft_consensus.cc:2749] T a6f012a5e95f4006871d83f7b18e356b P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:38.646011  9893 leader_election.cc:290] T a6f012a5e95f4006871d83f7b18e356b P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:38.649602  9590 tablet_bootstrap.cc:492] T 1a5145e5f9a64fe0acdd74d909e841fc P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:38.650178  9590 ts_tablet_manager.cc:1403] T 1a5145e5f9a64fe0acdd74d909e841fc P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.050s	user 0.006s	sys 0.006s
I20260709 13:04:38.653118  9590 raft_consensus.cc:359] T 1a5145e5f9a64fe0acdd74d909e841fc P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:38.653837  9590 raft_consensus.cc:385] T 1a5145e5f9a64fe0acdd74d909e841fc P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:38.654098  9590 raft_consensus.cc:740] T 1a5145e5f9a64fe0acdd74d909e841fc P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:38.657991  9590 consensus_queue.cc:260] T 1a5145e5f9a64fe0acdd74d909e841fc P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:38.661980  9590 ts_tablet_manager.cc:1434] T 1a5145e5f9a64fe0acdd74d909e841fc P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:04:38.662683  9592 tablet_bootstrap.cc:492] T 8528ae822cb04615a9dbd1166b7d7328 P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:38.663125  9590 tablet_bootstrap.cc:492] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
I20260709 13:04:38.670058  9590 tablet_bootstrap.cc:654] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:38.677351  9591 ts_tablet_manager.cc:1434] T a792fefbeb0c4eb79e87501fb6dbe780 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.199s	user 0.005s	sys 0.002s
I20260709 13:04:38.678478  9591 tablet_bootstrap.cc:492] T 8f602c194d1c445ba1851f0a2272b40b P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:38.695668  9591 tablet_bootstrap.cc:654] T 8f602c194d1c445ba1851f0a2272b40b P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:38.701797  9592 tablet_bootstrap.cc:654] T 8528ae822cb04615a9dbd1166b7d7328 P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:38.706638  9217 catalog_manager.cc:5697] T 8e017796f5c643859d8a0e1916ab3f05 P a91e8b10a5984dec9d3777a7275cef49 reported cstate change: term changed from 0 to 1, leader changed from <none> to a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "a91e8b10a5984dec9d3777a7275cef49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:38.742013  9217 catalog_manager.cc:5697] T 1a5145e5f9a64fe0acdd74d909e841fc P a91e8b10a5984dec9d3777a7275cef49 reported cstate change: term changed from 0 to 1, leader changed from <none> to a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "a91e8b10a5984dec9d3777a7275cef49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:38.748754  9592 tablet_bootstrap.cc:492] T 8528ae822cb04615a9dbd1166b7d7328 P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
I20260709 13:04:38.749374  9592 ts_tablet_manager.cc:1403] T 8528ae822cb04615a9dbd1166b7d7328 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.087s	user 0.009s	sys 0.004s
I20260709 13:04:38.750221  9319 raft_consensus.cc:3060] T a792fefbeb0c4eb79e87501fb6dbe780 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:38.752066  9592 raft_consensus.cc:359] T 8528ae822cb04615a9dbd1166b7d7328 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:38.752789  9592 raft_consensus.cc:385] T 8528ae822cb04615a9dbd1166b7d7328 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:38.753052  9592 raft_consensus.cc:740] T 8528ae822cb04615a9dbd1166b7d7328 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:38.753809  9592 consensus_queue.cc:260] T 8528ae822cb04615a9dbd1166b7d7328 P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:38.762979  9592 ts_tablet_manager.cc:1434] T 8528ae822cb04615a9dbd1166b7d7328 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.004s
I20260709 13:04:38.764070  9592 tablet_bootstrap.cc:492] T d8bd3f903abb4dd99431dbf597c0d462 P ef5fe58eb3e04ae18fda957b4d507eff: Bootstrap starting.
I20260709 13:04:38.767297 10038 raft_consensus.cc:493] T 8528ae822cb04615a9dbd1166b7d7328 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.767967 10038 raft_consensus.cc:515] T 8528ae822cb04615a9dbd1166b7d7328 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:38.772821 10038 leader_election.cc:290] T 8528ae822cb04615a9dbd1166b7d7328 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:38.770481  9593 tablet_bootstrap.cc:492] T 02c431d6db7643adbb4b26a3c7e38b76 P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:38.773036  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8528ae822cb04615a9dbd1166b7d7328" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:38.773598  9593 ts_tablet_manager.cc:1403] T 02c431d6db7643adbb4b26a3c7e38b76 P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.231s	user 0.009s	sys 0.013s
I20260709 13:04:38.770617  9592 tablet_bootstrap.cc:654] T d8bd3f903abb4dd99431dbf597c0d462 P ef5fe58eb3e04ae18fda957b4d507eff: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:38.775720  9397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8528ae822cb04615a9dbd1166b7d7328" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:38.772907  9590 tablet_bootstrap.cc:492] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:38.776376  9397 raft_consensus.cc:2468] T 8528ae822cb04615a9dbd1166b7d7328 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 0.
I20260709 13:04:38.776556  9590 ts_tablet_manager.cc:1403] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.114s	user 0.008s	sys 0.019s
I20260709 13:04:38.777922  9436 leader_election.cc:304] T 8528ae822cb04615a9dbd1166b7d7328 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:38.779176  9593 raft_consensus.cc:359] T 02c431d6db7643adbb4b26a3c7e38b76 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
W20260709 13:04:38.779769  9438 leader_election.cc:343] T 8528ae822cb04615a9dbd1166b7d7328 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:38.780151 10038 raft_consensus.cc:2804] T 8528ae822cb04615a9dbd1166b7d7328 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:38.780794 10038 raft_consensus.cc:493] T 8528ae822cb04615a9dbd1166b7d7328 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.781358 10038 raft_consensus.cc:3060] T 8528ae822cb04615a9dbd1166b7d7328 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:38.782066  9364 consensus_peers.cc:597] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49 -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:38.779881  9593 raft_consensus.cc:385] T 02c431d6db7643adbb4b26a3c7e38b76 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:38.784121  9593 raft_consensus.cc:740] T 02c431d6db7643adbb4b26a3c7e38b76 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:38.784958  9593 consensus_queue.cc:260] T 02c431d6db7643adbb4b26a3c7e38b76 P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:38.789701  9593 ts_tablet_manager.cc:1434] T 02c431d6db7643adbb4b26a3c7e38b76 P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260709 13:04:38.786279  9591 tablet_bootstrap.cc:492] T 8f602c194d1c445ba1851f0a2272b40b P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:38.790786  9593 tablet_bootstrap.cc:492] T 9b19e51cda7e44e5a1f02a736e555ac4 P a91e8b10a5984dec9d3777a7275cef49: Bootstrap starting.
I20260709 13:04:38.794293  9591 ts_tablet_manager.cc:1403] T 8f602c194d1c445ba1851f0a2272b40b P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.116s	user 0.006s	sys 0.014s
I20260709 13:04:38.814390 10038 raft_consensus.cc:515] T 8528ae822cb04615a9dbd1166b7d7328 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:38.815830  9593 tablet_bootstrap.cc:654] T 9b19e51cda7e44e5a1f02a736e555ac4 P a91e8b10a5984dec9d3777a7275cef49: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:38.815500  9591 raft_consensus.cc:359] T 8f602c194d1c445ba1851f0a2272b40b P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:38.816461  9591 raft_consensus.cc:385] T 8f602c194d1c445ba1851f0a2272b40b P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:38.816773  9591 raft_consensus.cc:740] T 8f602c194d1c445ba1851f0a2272b40b P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:38.795670  9973 raft_consensus.cc:493] T 8e017796f5c643859d8a0e1916ab3f05 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.817260  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8528ae822cb04615a9dbd1166b7d7328" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8"
I20260709 13:04:38.817674  9973 raft_consensus.cc:515] T 8e017796f5c643859d8a0e1916ab3f05 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:38.818675  9592 tablet_bootstrap.cc:492] T d8bd3f903abb4dd99431dbf597c0d462 P ef5fe58eb3e04ae18fda957b4d507eff: No bootstrap required, opened a new log
W20260709 13:04:38.818755  9438 leader_election.cc:343] T 8528ae822cb04615a9dbd1166b7d7328 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:38.819311  9592 ts_tablet_manager.cc:1403] T d8bd3f903abb4dd99431dbf597c0d462 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent bootstrapping tablet: real 0.055s	user 0.018s	sys 0.017s
I20260709 13:04:38.820261  9973 leader_election.cc:290] T 8e017796f5c643859d8a0e1916ab3f05 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:38.821614  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e017796f5c643859d8a0e1916ab3f05" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:38.822093  9397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e017796f5c643859d8a0e1916ab3f05" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:38.822650  9467 raft_consensus.cc:2393] T 8e017796f5c643859d8a0e1916ab3f05 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dfbbb80ab8e345e0ae1684fafefceccf in current term 1: Already voted for candidate a91e8b10a5984dec9d3777a7275cef49 in this term.
I20260709 13:04:38.822747 10038 leader_election.cc:290] T 8528ae822cb04615a9dbd1166b7d7328 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Requested vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:38.822142  9592 raft_consensus.cc:359] T d8bd3f903abb4dd99431dbf597c0d462 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:38.824002  9592 raft_consensus.cc:385] T d8bd3f903abb4dd99431dbf597c0d462 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:38.824283  9592 raft_consensus.cc:740] T d8bd3f903abb4dd99431dbf597c0d462 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Initialized, Role: FOLLOWER
I20260709 13:04:38.824983  9592 consensus_queue.cc:260] T d8bd3f903abb4dd99431dbf597c0d462 P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:38.825940  9510 leader_election.cc:304] T 8e017796f5c643859d8a0e1916ab3f05 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf; no voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:38.827229  9592 ts_tablet_manager.cc:1434] T d8bd3f903abb4dd99431dbf597c0d462 P ef5fe58eb3e04ae18fda957b4d507eff: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:38.827261  9397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8528ae822cb04615a9dbd1166b7d7328" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:38.831506  9893 consensus_queue.cc:1048] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:38.798862  9590 raft_consensus.cc:359] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:38.832120  9397 raft_consensus.cc:3060] T 8528ae822cb04615a9dbd1166b7d7328 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:38.832557  9590 raft_consensus.cc:385] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:38.833065  9590 raft_consensus.cc:740] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:38.834623  9591 consensus_queue.cc:260] T 8f602c194d1c445ba1851f0a2272b40b P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:38.836659  9935 raft_consensus.cc:3060] T 8e017796f5c643859d8a0e1916ab3f05 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:38.838805  9593 tablet_bootstrap.cc:492] T 9b19e51cda7e44e5a1f02a736e555ac4 P a91e8b10a5984dec9d3777a7275cef49: No bootstrap required, opened a new log
I20260709 13:04:38.839741  9593 ts_tablet_manager.cc:1403] T 9b19e51cda7e44e5a1f02a736e555ac4 P a91e8b10a5984dec9d3777a7275cef49: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.006s
I20260709 13:04:38.839874  9591 ts_tablet_manager.cc:1434] T 8f602c194d1c445ba1851f0a2272b40b P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.004s
I20260709 13:04:38.840966  9591 tablet_bootstrap.cc:492] T 8dfdb24cbc824b95ac65712323103e2a P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:38.842684  9593 raft_consensus.cc:359] T 9b19e51cda7e44e5a1f02a736e555ac4 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:38.843389  9593 raft_consensus.cc:385] T 9b19e51cda7e44e5a1f02a736e555ac4 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:38.836249  9590 consensus_queue.cc:260] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:38.845322  9894 raft_consensus.cc:493] T d8bd3f903abb4dd99431dbf597c0d462 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.845889  9894 raft_consensus.cc:515] T d8bd3f903abb4dd99431dbf597c0d462 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:38.847045  9590 ts_tablet_manager.cc:1434] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.070s	user 0.007s	sys 0.000s
I20260709 13:04:38.847483 10038 raft_consensus.cc:493] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.848091  9894 leader_election.cc:290] T d8bd3f903abb4dd99431dbf597c0d462 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:38.840830  9397 raft_consensus.cc:2468] T 8528ae822cb04615a9dbd1166b7d7328 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 1.
I20260709 13:04:38.849948  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8bd3f903abb4dd99431dbf597c0d462" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:38.850428  9436 leader_election.cc:304] T 8528ae822cb04615a9dbd1166b7d7328 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 932245f14aac417f913cc7330a1833b8
W20260709 13:04:38.851619  9438 leader_election.cc:343] T d8bd3f903abb4dd99431dbf597c0d462 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:38.852053  9894 raft_consensus.cc:2804] T 8528ae822cb04615a9dbd1166b7d7328 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:38.852600  9894 raft_consensus.cc:697] T 8528ae822cb04615a9dbd1166b7d7328 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Becoming Leader. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Running, Role: LEADER
I20260709 13:04:38.852921  9542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8bd3f903abb4dd99431dbf597c0d462" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:38.853520  9894 consensus_queue.cc:237] T 8528ae822cb04615a9dbd1166b7d7328 P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:38.849207 10038 raft_consensus.cc:515] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:38.857968 10038 leader_election.cc:290] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:38.858893  9935 raft_consensus.cc:2749] T 8e017796f5c643859d8a0e1916ab3f05 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:38.861459  9397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99d222cbc8341f7ac9a4b2e7eb7e5f0" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:38.861866  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99d222cbc8341f7ac9a4b2e7eb7e5f0" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:38.862226  9397 raft_consensus.cc:2468] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 0.
W20260709 13:04:38.863639  9438 leader_election.cc:343] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:38.848122  9590 tablet_bootstrap.cc:492] T 803c43e83ee5487590c9d922559adc0f P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
W20260709 13:04:38.865206  9438 leader_election.cc:343] T d8bd3f903abb4dd99431dbf597c0d462 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:38.865669  9438 leader_election.cc:304] T d8bd3f903abb4dd99431dbf597c0d462 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef5fe58eb3e04ae18fda957b4d507eff; no voters: 932245f14aac417f913cc7330a1833b8, dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:38.865897  9436 leader_election.cc:304] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 932245f14aac417f913cc7330a1833b8
I20260709 13:04:38.868346  9935 raft_consensus.cc:493] T 02c431d6db7643adbb4b26a3c7e38b76 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.868885  9935 raft_consensus.cc:515] T 02c431d6db7643adbb4b26a3c7e38b76 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:38.869401 10029 raft_consensus.cc:2749] T d8bd3f903abb4dd99431dbf597c0d462 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:38.870482 10029 raft_consensus.cc:2804] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:38.871078 10029 raft_consensus.cc:493] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.843672  9593 raft_consensus.cc:740] T 9b19e51cda7e44e5a1f02a736e555ac4 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Initialized, Role: FOLLOWER
I20260709 13:04:38.872440  9593 consensus_queue.cc:260] T 9b19e51cda7e44e5a1f02a736e555ac4 P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:38.873636  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c431d6db7643adbb4b26a3c7e38b76" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:38.875407  9593 ts_tablet_manager.cc:1434] T 9b19e51cda7e44e5a1f02a736e555ac4 P a91e8b10a5984dec9d3777a7275cef49: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
W20260709 13:04:38.875628  9512 leader_election.cc:343] T 02c431d6db7643adbb4b26a3c7e38b76 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:38.871539 10029 raft_consensus.cc:3060] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:38.879001 10001 raft_consensus.cc:493] T 8f602c194d1c445ba1851f0a2272b40b P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.879554 10001 raft_consensus.cc:515] T 8f602c194d1c445ba1851f0a2272b40b P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:38.881847 10001 leader_election.cc:290] T 8f602c194d1c445ba1851f0a2272b40b P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:38.883508  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f602c194d1c445ba1851f0a2272b40b" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:38.884920  9973 raft_consensus.cc:493] T 1a5145e5f9a64fe0acdd74d909e841fc P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.885151  9397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c431d6db7643adbb4b26a3c7e38b76" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:38.885489  9973 raft_consensus.cc:515] T 1a5145e5f9a64fe0acdd74d909e841fc P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:38.885910  9397 raft_consensus.cc:2468] T 02c431d6db7643adbb4b26a3c7e38b76 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 0.
I20260709 13:04:38.888051  9590 tablet_bootstrap.cc:654] T 803c43e83ee5487590c9d922559adc0f P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:38.888808  9973 leader_election.cc:290] T 1a5145e5f9a64fe0acdd74d909e841fc P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:38.889613  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a5145e5f9a64fe0acdd74d909e841fc" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:38.890465  9319 raft_consensus.cc:2393] T 1a5145e5f9a64fe0acdd74d909e841fc P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dfbbb80ab8e345e0ae1684fafefceccf in current term 1: Already voted for candidate a91e8b10a5984dec9d3777a7275cef49 in this term.
I20260709 13:04:38.891005  9219 catalog_manager.cc:5697] T 8528ae822cb04615a9dbd1166b7d7328 P ef5fe58eb3e04ae18fda957b4d507eff reported cstate change: term changed from 0 to 1, leader changed from <none> to ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:38.892023  9397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f602c194d1c445ba1851f0a2272b40b" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:38.893121  9510 leader_election.cc:304] T 02c431d6db7643adbb4b26a3c7e38b76 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 932245f14aac417f913cc7330a1833b8
I20260709 13:04:38.894572  9395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a5145e5f9a64fe0acdd74d909e841fc" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:38.897516  9995 raft_consensus.cc:2804] T 02c431d6db7643adbb4b26a3c7e38b76 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:38.897746  9591 tablet_bootstrap.cc:654] T 8dfdb24cbc824b95ac65712323103e2a P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:38.898013  9995 raft_consensus.cc:493] T 02c431d6db7643adbb4b26a3c7e38b76 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.898399  9995 raft_consensus.cc:3060] T 02c431d6db7643adbb4b26a3c7e38b76 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:38.902351  9287 leader_election.cc:304] T 8f602c194d1c445ba1851f0a2272b40b P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 932245f14aac417f913cc7330a1833b8; no voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:38.903668  9925 raft_consensus.cc:2749] T 8f602c194d1c445ba1851f0a2272b40b P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:38.904778  9590 tablet_bootstrap.cc:492] T 803c43e83ee5487590c9d922559adc0f P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:38.905454  9590 ts_tablet_manager.cc:1403] T 803c43e83ee5487590c9d922559adc0f P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.058s	user 0.011s	sys 0.008s
I20260709 13:04:38.915097  9590 raft_consensus.cc:359] T 803c43e83ee5487590c9d922559adc0f P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:38.915884  9590 raft_consensus.cc:385] T 803c43e83ee5487590c9d922559adc0f P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:38.916188  9590 raft_consensus.cc:740] T 803c43e83ee5487590c9d922559adc0f P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:38.917043  9590 consensus_queue.cc:260] T 803c43e83ee5487590c9d922559adc0f P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:38.919312  9590 ts_tablet_manager.cc:1434] T 803c43e83ee5487590c9d922559adc0f P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:04:38.923632  9510 leader_election.cc:304] T 1a5145e5f9a64fe0acdd74d909e841fc P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf; no voters: 932245f14aac417f913cc7330a1833b8, a91e8b10a5984dec9d3777a7275cef49
I20260709 13:04:38.928179  9941 raft_consensus.cc:3060] T 1a5145e5f9a64fe0acdd74d909e841fc P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:38.928457  9591 tablet_bootstrap.cc:492] T 8dfdb24cbc824b95ac65712323103e2a P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:38.929023  9591 ts_tablet_manager.cc:1403] T 8dfdb24cbc824b95ac65712323103e2a P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.088s	user 0.022s	sys 0.011s
I20260709 13:04:38.931929  9591 raft_consensus.cc:359] T 8dfdb24cbc824b95ac65712323103e2a P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:38.932601  9591 raft_consensus.cc:385] T 8dfdb24cbc824b95ac65712323103e2a P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:38.932848  9591 raft_consensus.cc:740] T 8dfdb24cbc824b95ac65712323103e2a P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:38.933645  9591 consensus_queue.cc:260] T 8dfdb24cbc824b95ac65712323103e2a P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:38.935261  9591 ts_tablet_manager.cc:1434] T 8dfdb24cbc824b95ac65712323103e2a P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:38.936252  9591 tablet_bootstrap.cc:492] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:38.947793  9591 tablet_bootstrap.cc:654] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:38.960255  9941 raft_consensus.cc:2749] T 1a5145e5f9a64fe0acdd74d909e841fc P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:38.973414  9512 consensus_peers.cc:597] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:38.974278  9590 tablet_bootstrap.cc:492] T d8bd3f903abb4dd99431dbf597c0d462 P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
I20260709 13:04:38.982053  9893 consensus_queue.cc:1048] T 1a5145e5f9a64fe0acdd74d909e841fc P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:38.984503  9893 consensus_queue.cc:1048] T 8e017796f5c643859d8a0e1916ab3f05 P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:38.966200  9995 raft_consensus.cc:515] T 02c431d6db7643adbb4b26a3c7e38b76 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:38.994904  9995 leader_election.cc:290] T 02c431d6db7643adbb4b26a3c7e38b76 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Requested vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:38.874001  9935 leader_election.cc:290] T 02c431d6db7643adbb4b26a3c7e38b76 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:38.995715  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c431d6db7643adbb4b26a3c7e38b76" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8"
I20260709 13:04:38.996006  9395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c431d6db7643adbb4b26a3c7e38b76" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:38.996765  9395 raft_consensus.cc:3060] T 02c431d6db7643adbb4b26a3c7e38b76 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:38.997296  9512 leader_election.cc:343] T 02c431d6db7643adbb4b26a3c7e38b76 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:38.999316 10029 raft_consensus.cc:515] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:39.007628  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99d222cbc8341f7ac9a4b2e7eb7e5f0" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8"
W20260709 13:04:39.009135  9438 leader_election.cc:343] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:39.010422 10029 leader_election.cc:290] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Requested vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:39.013820  9941 consensus_queue.cc:1048] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:39.019560  9395 raft_consensus.cc:2468] T 02c431d6db7643adbb4b26a3c7e38b76 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 1.
I20260709 13:04:39.032866  9510 leader_election.cc:304] T 02c431d6db7643adbb4b26a3c7e38b76 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 932245f14aac417f913cc7330a1833b8
I20260709 13:04:39.033692  9941 raft_consensus.cc:2804] T 02c431d6db7643adbb4b26a3c7e38b76 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:39.034241  9941 raft_consensus.cc:697] T 02c431d6db7643adbb4b26a3c7e38b76 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Becoming Leader. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Running, Role: LEADER
I20260709 13:04:39.037329  9941 consensus_queue.cc:237] T 02c431d6db7643adbb4b26a3c7e38b76 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:39.049213  9590 tablet_bootstrap.cc:654] T d8bd3f903abb4dd99431dbf597c0d462 P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:39.101691  9590 tablet_bootstrap.cc:492] T d8bd3f903abb4dd99431dbf597c0d462 P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:39.102268  9590 ts_tablet_manager.cc:1403] T d8bd3f903abb4dd99431dbf597c0d462 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.128s	user 0.013s	sys 0.003s
I20260709 13:04:39.080402  9395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99d222cbc8341f7ac9a4b2e7eb7e5f0" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:39.103009  9395 raft_consensus.cc:3060] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.104456  9891 consensus_queue.cc:1048] T 1a5145e5f9a64fe0acdd74d909e841fc P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:39.106475  9590 raft_consensus.cc:359] T d8bd3f903abb4dd99431dbf597c0d462 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:39.107575  9590 raft_consensus.cc:385] T d8bd3f903abb4dd99431dbf597c0d462 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.107946  9590 raft_consensus.cc:740] T d8bd3f903abb4dd99431dbf597c0d462 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.109382  9591 tablet_bootstrap.cc:492] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:39.108700  9590 consensus_queue.cc:260] T d8bd3f903abb4dd99431dbf597c0d462 P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:39.109966  9591 ts_tablet_manager.cc:1403] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.174s	user 0.028s	sys 0.060s
I20260709 13:04:39.113240  9935 raft_consensus.cc:493] T 803c43e83ee5487590c9d922559adc0f P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.113775  9935 raft_consensus.cc:515] T 803c43e83ee5487590c9d922559adc0f P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:39.115733  9935 leader_election.cc:290] T 803c43e83ee5487590c9d922559adc0f P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:39.120839 10001 raft_consensus.cc:493] T 8dfdb24cbc824b95ac65712323103e2a P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.121400 10001 raft_consensus.cc:515] T 8dfdb24cbc824b95ac65712323103e2a P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:39.123548 10001 leader_election.cc:290] T 8dfdb24cbc824b95ac65712323103e2a P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:39.126084  9544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dfdb24cbc824b95ac65712323103e2a" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:39.127512  9217 catalog_manager.cc:5697] T 02c431d6db7643adbb4b26a3c7e38b76 P dfbbb80ab8e345e0ae1684fafefceccf reported cstate change: term changed from 0 to 1, leader changed from <none> to dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196). New cstate: current_term: 1 leader_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:39.128600  9591 raft_consensus.cc:359] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:39.128922  9939 consensus_queue.cc:1048] T 8e017796f5c643859d8a0e1916ab3f05 P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:39.130663  9591 raft_consensus.cc:385] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.130995  9591 raft_consensus.cc:740] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.131675  9591 consensus_queue.cc:260] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:39.134418  9590 ts_tablet_manager.cc:1434] T d8bd3f903abb4dd99431dbf597c0d462 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:04:39.138445  9590 tablet_bootstrap.cc:492] T 9b19e51cda7e44e5a1f02a736e555ac4 P dfbbb80ab8e345e0ae1684fafefceccf: Bootstrap starting.
I20260709 13:04:39.142603  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "803c43e83ee5487590c9d922559adc0f" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:39.144209  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "803c43e83ee5487590c9d922559adc0f" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:39.143371  9472 raft_consensus.cc:2468] T 803c43e83ee5487590c9d922559adc0f P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 0.
I20260709 13:04:39.154588  9393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dfdb24cbc824b95ac65712323103e2a" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:39.157464  9287 leader_election.cc:304] T 8dfdb24cbc824b95ac65712323103e2a P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 932245f14aac417f913cc7330a1833b8; no voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:39.167026  9591 ts_tablet_manager.cc:1434] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.000s
I20260709 13:04:39.169317 10000 raft_consensus.cc:2749] T 8dfdb24cbc824b95ac65712323103e2a P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:39.175081  9938 raft_consensus.cc:493] T 9b19e51cda7e44e5a1f02a736e555ac4 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.175864  9938 raft_consensus.cc:515] T 9b19e51cda7e44e5a1f02a736e555ac4 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:39.190524  9938 leader_election.cc:290] T 9b19e51cda7e44e5a1f02a736e555ac4 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:39.192004  9591 tablet_bootstrap.cc:492] T 02c431d6db7643adbb4b26a3c7e38b76 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:39.192281  9545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19e51cda7e44e5a1f02a736e555ac4" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:39.192075  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19e51cda7e44e5a1f02a736e555ac4" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:39.197012  9467 raft_consensus.cc:2468] T 9b19e51cda7e44e5a1f02a736e555ac4 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 0.
W20260709 13:04:39.197815  9364 leader_election.cc:343] T 9b19e51cda7e44e5a1f02a736e555ac4 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:39.200724  9364 leader_election.cc:304] T 9b19e51cda7e44e5a1f02a736e555ac4 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:39.179996  9512 leader_election.cc:304] T 803c43e83ee5487590c9d922559adc0f P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
W20260709 13:04:39.214524  9512 leader_election.cc:343] T 803c43e83ee5487590c9d922559adc0f P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:39.213692  9938 raft_consensus.cc:2804] T 9b19e51cda7e44e5a1f02a736e555ac4 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:39.220335  9938 raft_consensus.cc:493] T 9b19e51cda7e44e5a1f02a736e555ac4 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:39.220719  9938 raft_consensus.cc:3060] T 9b19e51cda7e44e5a1f02a736e555ac4 P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.208496 10064 raft_consensus.cc:2804] T 803c43e83ee5487590c9d922559adc0f P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:39.225553 10064 raft_consensus.cc:493] T 803c43e83ee5487590c9d922559adc0f P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:39.226063 10064 raft_consensus.cc:3060] T 803c43e83ee5487590c9d922559adc0f P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.254973  9395 raft_consensus.cc:2468] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 1.
I20260709 13:04:39.257278  9436 leader_election.cc:304] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 932245f14aac417f913cc7330a1833b8
I20260709 13:04:39.259284  9894 raft_consensus.cc:2804] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:39.260162  9894 raft_consensus.cc:697] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Becoming Leader. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Running, Role: LEADER
I20260709 13:04:39.267961  9894 consensus_queue.cc:237] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:39.282598  9590 tablet_bootstrap.cc:654] T 9b19e51cda7e44e5a1f02a736e555ac4 P dfbbb80ab8e345e0ae1684fafefceccf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:39.284250  9591 tablet_bootstrap.cc:654] T 02c431d6db7643adbb4b26a3c7e38b76 P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:39.281989  9289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38559, user_credentials={real_user=slave}} blocked reactor thread for 139942us
I20260709 13:04:39.294132  9323 raft_consensus.cc:3060] T 8f602c194d1c445ba1851f0a2272b40b P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.322427  9941 raft_consensus.cc:493] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.354977 10064 raft_consensus.cc:515] T 803c43e83ee5487590c9d922559adc0f P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:39.357209 10064 leader_election.cc:290] T 803c43e83ee5487590c9d922559adc0f P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Requested vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:39.352066  9941 raft_consensus.cc:515] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:39.372673  9941 leader_election.cc:290] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
W20260709 13:04:39.378239  9512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37633, user_credentials={real_user=slave}} blocked reactor thread for 56469.6us
I20260709 13:04:39.387598  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "803c43e83ee5487590c9d922559adc0f" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8"
W20260709 13:04:39.388648  9364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37633, user_credentials={real_user=slave}} blocked reactor thread for 55017.9us
I20260709 13:04:39.391255  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f012a5e95f4006871d83f7b18e356b" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
W20260709 13:04:39.398206  9512 leader_election.cc:343] T 803c43e83ee5487590c9d922559adc0f P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:39.399752  9512 leader_election.cc:343] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:39.422127  9438 consensus_peers.cc:597] T 8528ae822cb04615a9dbd1166b7d7328 P ef5fe58eb3e04ae18fda957b4d507eff -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:39.426230  9591 tablet_bootstrap.cc:492] T 02c431d6db7643adbb4b26a3c7e38b76 P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:39.426954  9591 ts_tablet_manager.cc:1403] T 02c431d6db7643adbb4b26a3c7e38b76 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.247s	user 0.018s	sys 0.016s
I20260709 13:04:39.415830  9469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "803c43e83ee5487590c9d922559adc0f" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:39.406949  9938 raft_consensus.cc:515] T 9b19e51cda7e44e5a1f02a736e555ac4 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
W20260709 13:04:39.444917  9364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37633, user_credentials={real_user=slave}} blocked reactor thread for 55184.4us
I20260709 13:04:39.443514  9217 catalog_manager.cc:5697] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P ef5fe58eb3e04ae18fda957b4d507eff reported cstate change: term changed from 0 to 1, leader changed from <none> to ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:39.452476  9397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f012a5e95f4006871d83f7b18e356b" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:39.453497  9397 raft_consensus.cc:2468] T a6f012a5e95f4006871d83f7b18e356b P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 0.
I20260709 13:04:39.458192  9510 leader_election.cc:304] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 932245f14aac417f913cc7330a1833b8
I20260709 13:04:39.445035  9469 raft_consensus.cc:3060] T 803c43e83ee5487590c9d922559adc0f P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.446691 10001 raft_consensus.cc:493] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.465835 10001 raft_consensus.cc:515] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:39.466737  9318 raft_consensus.cc:3060] T 8dfdb24cbc824b95ac65712323103e2a P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.467973 10001 leader_election.cc:290] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:39.470796  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90aae84687f41e99e58dada706ae2d7" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:39.476949  9938 leader_election.cc:290] T 9b19e51cda7e44e5a1f02a736e555ac4 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Requested vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:39.481417  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19e51cda7e44e5a1f02a736e555ac4" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:39.482102  9468 raft_consensus.cc:3060] T 9b19e51cda7e44e5a1f02a736e555ac4 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.483390  9469 raft_consensus.cc:2468] T 803c43e83ee5487590c9d922559adc0f P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 1.
I20260709 13:04:39.483745  9590 tablet_bootstrap.cc:492] T 9b19e51cda7e44e5a1f02a736e555ac4 P dfbbb80ab8e345e0ae1684fafefceccf: No bootstrap required, opened a new log
I20260709 13:04:39.484337  9591 raft_consensus.cc:359] T 02c431d6db7643adbb4b26a3c7e38b76 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:39.485152  9591 raft_consensus.cc:385] T 02c431d6db7643adbb4b26a3c7e38b76 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.485430  9591 raft_consensus.cc:740] T 02c431d6db7643adbb4b26a3c7e38b76 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.485545  9941 raft_consensus.cc:2804] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:39.486052  9941 raft_consensus.cc:493] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:39.486455  9941 raft_consensus.cc:3060] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.489848  9546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90aae84687f41e99e58dada706ae2d7" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:39.490648 10073 raft_consensus.cc:493] T d8bd3f903abb4dd99431dbf597c0d462 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.491164 10073 raft_consensus.cc:515] T d8bd3f903abb4dd99431dbf597c0d462 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:39.493127  9468 raft_consensus.cc:2468] T 9b19e51cda7e44e5a1f02a736e555ac4 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 1.
I20260709 13:04:39.493183  9320 raft_consensus.cc:3060] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.500124  9546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19e51cda7e44e5a1f02a736e555ac4" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
I20260709 13:04:39.486232  9591 consensus_queue.cc:260] T 02c431d6db7643adbb4b26a3c7e38b76 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
W20260709 13:04:39.503831  9364 leader_election.cc:343] T 9b19e51cda7e44e5a1f02a736e555ac4 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:39.484385  9590 ts_tablet_manager.cc:1403] T 9b19e51cda7e44e5a1f02a736e555ac4 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent bootstrapping tablet: real 0.346s	user 0.015s	sys 0.013s
I20260709 13:04:39.505048 10073 leader_election.cc:290] T d8bd3f903abb4dd99431dbf597c0d462 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:39.511286  9590 raft_consensus.cc:359] T 9b19e51cda7e44e5a1f02a736e555ac4 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:39.512259  9590 raft_consensus.cc:385] T 9b19e51cda7e44e5a1f02a736e555ac4 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.515455  9364 leader_election.cc:304] T 9b19e51cda7e44e5a1f02a736e555ac4 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:39.516311  9938 raft_consensus.cc:2804] T 9b19e51cda7e44e5a1f02a736e555ac4 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:39.516794  9938 raft_consensus.cc:697] T 9b19e51cda7e44e5a1f02a736e555ac4 P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Becoming Leader. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Running, Role: LEADER
I20260709 13:04:39.517665  9938 consensus_queue.cc:237] T 9b19e51cda7e44e5a1f02a736e555ac4 P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:39.512907  9590 raft_consensus.cc:740] T 9b19e51cda7e44e5a1f02a736e555ac4 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.535799  9590 consensus_queue.cc:260] T 9b19e51cda7e44e5a1f02a736e555ac4 P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:39.543268  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8bd3f903abb4dd99431dbf597c0d462" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:39.551147  9512 leader_election.cc:304] T 803c43e83ee5487590c9d922559adc0f P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 932245f14aac417f913cc7330a1833b8
I20260709 13:04:39.552824  9935 raft_consensus.cc:2804] T 803c43e83ee5487590c9d922559adc0f P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:39.553431  9935 raft_consensus.cc:697] T 803c43e83ee5487590c9d922559adc0f P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Becoming Leader. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Running, Role: LEADER
I20260709 13:04:39.554349  9935 consensus_queue.cc:237] T 803c43e83ee5487590c9d922559adc0f P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:39.561124  9591 ts_tablet_manager.cc:1434] T 02c431d6db7643adbb4b26a3c7e38b76 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.134s	user 0.008s	sys 0.000s
I20260709 13:04:39.562527  9591 tablet_bootstrap.cc:492] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:39.564765  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8bd3f903abb4dd99431dbf597c0d462" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:39.565410  9289 leader_election.cc:304] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 932245f14aac417f913cc7330a1833b8; no voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:39.565511  9468 raft_consensus.cc:2468] T d8bd3f903abb4dd99431dbf597c0d462 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 0.
I20260709 13:04:39.566319  9925 raft_consensus.cc:2749] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:39.585686  9512 leader_election.cc:343] T d8bd3f903abb4dd99431dbf597c0d462 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:39.578436  9217 catalog_manager.cc:5697] T 9b19e51cda7e44e5a1f02a736e555ac4 P a91e8b10a5984dec9d3777a7275cef49 reported cstate change: term changed from 0 to 1, leader changed from <none> to a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "a91e8b10a5984dec9d3777a7275cef49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:39.622793  9318 raft_consensus.cc:3060] T 02c431d6db7643adbb4b26a3c7e38b76 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.635030  9512 leader_election.cc:304] T d8bd3f903abb4dd99431dbf597c0d462 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 932245f14aac417f913cc7330a1833b8
I20260709 13:04:39.641804  9935 raft_consensus.cc:2804] T d8bd3f903abb4dd99431dbf597c0d462 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:39.642233  9935 raft_consensus.cc:493] T d8bd3f903abb4dd99431dbf597c0d462 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:39.642612  9935 raft_consensus.cc:3060] T d8bd3f903abb4dd99431dbf597c0d462 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.572726  9941 raft_consensus.cc:515] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:39.650635  9941 leader_election.cc:290] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Requested vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:39.592502  9995 consensus_queue.cc:1048] T 02c431d6db7643adbb4b26a3c7e38b76 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:39.597260  9991 consensus_queue.cc:1048] T 8528ae822cb04615a9dbd1166b7d7328 P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:39.652416  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f012a5e95f4006871d83f7b18e356b" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8"
I20260709 13:04:39.599694  9591 tablet_bootstrap.cc:654] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:39.653890  9512 leader_election.cc:343] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:39.607887  9220 catalog_manager.cc:5697] T 803c43e83ee5487590c9d922559adc0f P dfbbb80ab8e345e0ae1684fafefceccf reported cstate change: term changed from 0 to 1, leader changed from <none> to dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196). New cstate: current_term: 1 leader_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:39.538338  9590 ts_tablet_manager.cc:1434] T 9b19e51cda7e44e5a1f02a736e555ac4 P dfbbb80ab8e345e0ae1684fafefceccf: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:04:39.657781  9935 raft_consensus.cc:515] T d8bd3f903abb4dd99431dbf597c0d462 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:39.659935  9935 leader_election.cc:290] T d8bd3f903abb4dd99431dbf597c0d462 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Requested vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:39.660929  9973 consensus_queue.cc:1048] T 02c431d6db7643adbb4b26a3c7e38b76 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Connected to new peer: Peer: permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:39.666460  9393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f012a5e95f4006871d83f7b18e356b" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:39.667196  9393 raft_consensus.cc:3060] T a6f012a5e95f4006871d83f7b18e356b P a91e8b10a5984dec9d3777a7275cef49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.679116  9925 raft_consensus.cc:493] T 02c431d6db7643adbb4b26a3c7e38b76 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.679912  9925 raft_consensus.cc:515] T 02c431d6db7643adbb4b26a3c7e38b76 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:39.680709  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8bd3f903abb4dd99431dbf597c0d462" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:39.681427  9468 raft_consensus.cc:3060] T d8bd3f903abb4dd99431dbf597c0d462 P ef5fe58eb3e04ae18fda957b4d507eff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.681929  9320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8bd3f903abb4dd99431dbf597c0d462" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8"
I20260709 13:04:39.682662  9925 leader_election.cc:290] T 02c431d6db7643adbb4b26a3c7e38b76 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:39.684584  9398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c431d6db7643adbb4b26a3c7e38b76" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
W20260709 13:04:39.686803  9512 leader_election.cc:343] T d8bd3f903abb4dd99431dbf597c0d462 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:39.688697  9545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c431d6db7643adbb4b26a3c7e38b76" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:39.690791  9289 leader_election.cc:304] T 02c431d6db7643adbb4b26a3c7e38b76 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 932245f14aac417f913cc7330a1833b8; no voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:39.695811  9591 tablet_bootstrap.cc:492] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:39.696429  9591 ts_tablet_manager.cc:1403] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.134s	user 0.006s	sys 0.006s
I20260709 13:04:39.699308  9591 raft_consensus.cc:359] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:39.700194  9591 raft_consensus.cc:385] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.700595  9591 raft_consensus.cc:740] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.701601  9591 consensus_queue.cc:260] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
W20260709 13:04:39.703423  9268 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:39.704581  9591 ts_tablet_manager.cc:1434] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:04:39.708770  9591 tablet_bootstrap.cc:492] T 803c43e83ee5487590c9d922559adc0f P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:39.712162  9925 raft_consensus.cc:2749] T 02c431d6db7643adbb4b26a3c7e38b76 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:39.712992  9393 raft_consensus.cc:2468] T a6f012a5e95f4006871d83f7b18e356b P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 1.
I20260709 13:04:39.725584  9591 tablet_bootstrap.cc:654] T 803c43e83ee5487590c9d922559adc0f P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:39.735541  9468 raft_consensus.cc:2468] T d8bd3f903abb4dd99431dbf597c0d462 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 1.
I20260709 13:04:39.738454  9510 leader_election.cc:304] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 932245f14aac417f913cc7330a1833b8
I20260709 13:04:39.740428  9512 leader_election.cc:304] T d8bd3f903abb4dd99431dbf597c0d462 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 932245f14aac417f913cc7330a1833b8
I20260709 13:04:39.741559  9941 raft_consensus.cc:2804] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:39.741915  9973 raft_consensus.cc:2804] T d8bd3f903abb4dd99431dbf597c0d462 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:39.742295  9941 raft_consensus.cc:697] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Becoming Leader. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Running, Role: LEADER
I20260709 13:04:39.742730  9973 raft_consensus.cc:697] T d8bd3f903abb4dd99431dbf597c0d462 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Becoming Leader. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Running, Role: LEADER
I20260709 13:04:39.743744  9941 consensus_queue.cc:237] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:39.743984  9973 consensus_queue.cc:237] T d8bd3f903abb4dd99431dbf597c0d462 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:39.807853  9591 tablet_bootstrap.cc:492] T 803c43e83ee5487590c9d922559adc0f P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:39.808629  9591 ts_tablet_manager.cc:1403] T 803c43e83ee5487590c9d922559adc0f P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.100s	user 0.019s	sys 0.003s
I20260709 13:04:39.811575  9591 raft_consensus.cc:359] T 803c43e83ee5487590c9d922559adc0f P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:39.813299  9591 raft_consensus.cc:385] T 803c43e83ee5487590c9d922559adc0f P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.813597  9591 raft_consensus.cc:740] T 803c43e83ee5487590c9d922559adc0f P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.814620  9591 consensus_queue.cc:260] T 803c43e83ee5487590c9d922559adc0f P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:39.815589  9221 catalog_manager.cc:5697] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf reported cstate change: term changed from 0 to 1, leader changed from <none> to dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196). New cstate: current_term: 1 leader_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:39.817245  9221 catalog_manager.cc:5697] T d8bd3f903abb4dd99431dbf597c0d462 P dfbbb80ab8e345e0ae1684fafefceccf reported cstate change: term changed from 0 to 1, leader changed from <none> to dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196). New cstate: current_term: 1 leader_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:39.826653  9591 ts_tablet_manager.cc:1434] T 803c43e83ee5487590c9d922559adc0f P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:04:39.828111  9591 tablet_bootstrap.cc:492] T 8528ae822cb04615a9dbd1166b7d7328 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:39.832903 10001 raft_consensus.cc:493] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.834059 10001 raft_consensus.cc:515] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:39.836601 10001 leader_election.cc:290] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:39.837715  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99d222cbc8341f7ac9a4b2e7eb7e5f0" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:39.838021  9393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99d222cbc8341f7ac9a4b2e7eb7e5f0" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:39.838935  9393 raft_consensus.cc:2393] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 932245f14aac417f913cc7330a1833b8 in current term 1: Already voted for candidate ef5fe58eb3e04ae18fda957b4d507eff in this term.
I20260709 13:04:39.840123  9287 leader_election.cc:304] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 932245f14aac417f913cc7330a1833b8; no voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:39.840969 10001 raft_consensus.cc:3060] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.845216  9591 tablet_bootstrap.cc:654] T 8528ae822cb04615a9dbd1166b7d7328 P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:39.854233  9591 tablet_bootstrap.cc:492] T 8528ae822cb04615a9dbd1166b7d7328 P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:39.854815  9591 ts_tablet_manager.cc:1403] T 8528ae822cb04615a9dbd1166b7d7328 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.002s
I20260709 13:04:39.854939 10001 raft_consensus.cc:2749] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:39.857553  9591 raft_consensus.cc:359] T 8528ae822cb04615a9dbd1166b7d7328 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:39.858108  9591 raft_consensus.cc:385] T 8528ae822cb04615a9dbd1166b7d7328 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.858295  9591 raft_consensus.cc:740] T 8528ae822cb04615a9dbd1166b7d7328 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.858809  9591 consensus_queue.cc:260] T 8528ae822cb04615a9dbd1166b7d7328 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:39.860867  9591 ts_tablet_manager.cc:1434] T 8528ae822cb04615a9dbd1166b7d7328 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 13:04:39.862404  9591 tablet_bootstrap.cc:492] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:39.868870  9591 tablet_bootstrap.cc:654] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:39.908862 10081 consensus_queue.cc:1048] T 9b19e51cda7e44e5a1f02a736e555ac4 P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:39.927975  9941 raft_consensus.cc:493] T 9b19e51cda7e44e5a1f02a736e555ac4 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.928709  9941 raft_consensus.cc:515] T 9b19e51cda7e44e5a1f02a736e555ac4 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:39.930918  9941 leader_election.cc:290] T 9b19e51cda7e44e5a1f02a736e555ac4 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:39.933007 10029 consensus_queue.cc:1048] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:39.933387  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19e51cda7e44e5a1f02a736e555ac4" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:39.936424  9393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19e51cda7e44e5a1f02a736e555ac4" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:39.938514 10029 consensus_queue.cc:1048] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Connected to new peer: Peer: permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:39.938795  9512 leader_election.cc:304] T 9b19e51cda7e44e5a1f02a736e555ac4 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf; no voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:39.940023  9941 raft_consensus.cc:2749] T 9b19e51cda7e44e5a1f02a736e555ac4 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:39.975189  9591 tablet_bootstrap.cc:492] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:39.976090  9546 raft_consensus.cc:3060] T 9b19e51cda7e44e5a1f02a736e555ac4 P dfbbb80ab8e345e0ae1684fafefceccf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.976074  9591 ts_tablet_manager.cc:1403] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.114s	user 0.016s	sys 0.045s
I20260709 13:04:39.983264  9591 raft_consensus.cc:359] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:39.984052  9591 raft_consensus.cc:385] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.984257  9591 raft_consensus.cc:740] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.984827  9591 consensus_queue.cc:260] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:39.987951  9591 ts_tablet_manager.cc:1434] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:39.989173  9591 tablet_bootstrap.cc:492] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:39.994553 10081 consensus_queue.cc:1048] T 9b19e51cda7e44e5a1f02a736e555ac4 P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:39.995915  9591 tablet_bootstrap.cc:654] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:40.006096  9591 tablet_bootstrap.cc:492] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8: No bootstrap required, opened a new log
I20260709 13:04:40.006861  9591 ts_tablet_manager.cc:1403] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.000s
I20260709 13:04:40.010766  9591 raft_consensus.cc:359] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:40.011569  9591 raft_consensus.cc:385] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:40.011916  9591 raft_consensus.cc:740] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:40.012879  9591 consensus_queue.cc:260] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:40.015239  9591 ts_tablet_manager.cc:1434] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:04:40.086822  9925 raft_consensus.cc:493] T 8528ae822cb04615a9dbd1166b7d7328 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.087405  9925 raft_consensus.cc:515] T 8528ae822cb04615a9dbd1166b7d7328 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:40.089329  9925 leader_election.cc:290] T 8528ae822cb04615a9dbd1166b7d7328 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:40.090073  9398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8528ae822cb04615a9dbd1166b7d7328" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:40.090272  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8528ae822cb04615a9dbd1166b7d7328" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:40.091673  9289 leader_election.cc:304] T 8528ae822cb04615a9dbd1166b7d7328 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 932245f14aac417f913cc7330a1833b8; no voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:40.092430  9925 raft_consensus.cc:2749] T 8528ae822cb04615a9dbd1166b7d7328 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:40.101478  9925 raft_consensus.cc:493] T 803c43e83ee5487590c9d922559adc0f P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.102562  9925 raft_consensus.cc:515] T 803c43e83ee5487590c9d922559adc0f P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:40.104779  9925 leader_election.cc:290] T 803c43e83ee5487590c9d922559adc0f P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:40.106106  9545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "803c43e83ee5487590c9d922559adc0f" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:40.106141  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "803c43e83ee5487590c9d922559adc0f" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:40.107383  9468 raft_consensus.cc:2393] T 803c43e83ee5487590c9d922559adc0f P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 932245f14aac417f913cc7330a1833b8 in current term 1: Already voted for candidate dfbbb80ab8e345e0ae1684fafefceccf in this term.
I20260709 13:04:40.108592  9289 leader_election.cc:304] T 803c43e83ee5487590c9d922559adc0f P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 932245f14aac417f913cc7330a1833b8; no voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:40.109575  9925 raft_consensus.cc:3060] T 803c43e83ee5487590c9d922559adc0f P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:40.118986  9925 raft_consensus.cc:2749] T 803c43e83ee5487590c9d922559adc0f P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:40.158617  9973 consensus_queue.cc:1048] T 803c43e83ee5487590c9d922559adc0f P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:40.169735  9320 raft_consensus.cc:3060] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:40.173458  9318 raft_consensus.cc:3060] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:40.169713  9973 consensus_queue.cc:1048] T 803c43e83ee5487590c9d922559adc0f P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Connected to new peer: Peer: permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:04:40.182013  9973 consensus_queue.cc:1048] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Connected to new peer: Peer: permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:40.188313  9941 consensus_queue.cc:1048] T d8bd3f903abb4dd99431dbf597c0d462 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Connected to new peer: Peer: permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:40.190970  9973 consensus_queue.cc:1048] T d8bd3f903abb4dd99431dbf597c0d462 P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:40.255303   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:04:40.270303  9512 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:04:40.297569  9512 consensus_peers.cc:597] T b31d08e4168243f08eb2a31031a039ed P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:40.306617  9438 consensus_peers.cc:597] T a792fefbeb0c4eb79e87501fb6dbe780 P ef5fe58eb3e04ae18fda957b4d507eff -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:40.309666  9935 consensus_queue.cc:1048] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:04:40.315749  9512 consensus_peers.cc:597] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:40.333238  9364 consensus_peers.cc:597] T ad58816d959840df923159e870cf4ad8 P a91e8b10a5984dec9d3777a7275cef49 -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:40.342814  9512 consensus_peers.cc:597] T 5cfc1f2582a64d8dbc3f127e15024ec0 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:40.346964  9438 consensus_peers.cc:597] T 93877deb770d41a6ba34cefdea146d54 P ef5fe58eb3e04ae18fda957b4d507eff -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:40.360677  9438 consensus_peers.cc:597] T 73b8fed487d54513b9256d4c1a39cfa0 P ef5fe58eb3e04ae18fda957b4d507eff -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:40.361763  9364 consensus_peers.cc:597] T 846ce8cad343420485af76370f029d54 P a91e8b10a5984dec9d3777a7275cef49 -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:40.368031   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:40.369477   431 tablet_replica.cc:333] T 8f602c194d1c445ba1851f0a2272b40b P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.371417   431 raft_consensus.cc:2243] T 8f602c194d1c445ba1851f0a2272b40b P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.372015   431 raft_consensus.cc:2272] T 8f602c194d1c445ba1851f0a2272b40b P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:40.373836  9438 consensus_peers.cc:597] T e7d162d34de74e47895dac207e265059 P ef5fe58eb3e04ae18fda957b4d507eff -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:40.375540   431 tablet_replica.cc:333] T a792fefbeb0c4eb79e87501fb6dbe780 P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.376298   431 raft_consensus.cc:2243] T a792fefbeb0c4eb79e87501fb6dbe780 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.376791   431 raft_consensus.cc:2272] T a792fefbeb0c4eb79e87501fb6dbe780 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:40.378974   431 tablet_replica.cc:333] T 02c431d6db7643adbb4b26a3c7e38b76 P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.379880   431 raft_consensus.cc:2243] T 02c431d6db7643adbb4b26a3c7e38b76 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.380455   431 raft_consensus.cc:2272] T 02c431d6db7643adbb4b26a3c7e38b76 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:40.385347   431 tablet_replica.cc:333] T 1a5145e5f9a64fe0acdd74d909e841fc P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.386442   431 raft_consensus.cc:2243] T 1a5145e5f9a64fe0acdd74d909e841fc P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.387149   431 raft_consensus.cc:2272] T 1a5145e5f9a64fe0acdd74d909e841fc P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:40.390707   431 tablet_replica.cc:333] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
W20260709 13:04:40.391350  9512 consensus_peers.cc:597] T 225ca60d9645490dbcdcf6d4d127d955 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:40.391526   431 raft_consensus.cc:2243] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.392164   431 raft_consensus.cc:2272] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:40.395181   431 tablet_replica.cc:333] T b305803a339e40f99c1a6af7f6f84f7c P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.396078   431 raft_consensus.cc:2243] T b305803a339e40f99c1a6af7f6f84f7c P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.396601   431 raft_consensus.cc:2272] T b305803a339e40f99c1a6af7f6f84f7c P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:40.399152   431 tablet_replica.cc:333] T 65ba9982e9bd4177995544e13394911a P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.400032   431 raft_consensus.cc:2243] T 65ba9982e9bd4177995544e13394911a P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.400734   431 raft_consensus.cc:2272] T 65ba9982e9bd4177995544e13394911a P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:40.402400  9364 consensus_peers.cc:597] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49 -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:40.403251   431 tablet_replica.cc:333] T 93a7d590cbac4b6da413dd8ea2a26225 P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.404140   431 raft_consensus.cc:2243] T 93a7d590cbac4b6da413dd8ea2a26225 P 932245f14aac417f913cc7330a1833b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:40.405153   431 raft_consensus.cc:2272] T 93a7d590cbac4b6da413dd8ea2a26225 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:40.406383  9438 consensus_peers.cc:597] T 8f602c194d1c445ba1851f0a2272b40b P ef5fe58eb3e04ae18fda957b4d507eff -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:40.407851   431 tablet_replica.cc:333] T a25f8459a3644bfcaf8f9d71705b1c33 P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.408998   431 raft_consensus.cc:2243] T a25f8459a3644bfcaf8f9d71705b1c33 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.409742   431 raft_consensus.cc:2272] T a25f8459a3644bfcaf8f9d71705b1c33 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:40.411120  9438 consensus_peers.cc:597] T f3a3d4fd34924b7c8ed0df6709391329 P ef5fe58eb3e04ae18fda957b4d507eff -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:40.412657   431 tablet_replica.cc:333] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.413609   431 raft_consensus.cc:2243] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:40.414680   431 raft_consensus.cc:2272] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:40.417120   431 tablet_replica.cc:333] T 6f213937fc9b4030a228a8e56ed80f52 P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.417927   431 raft_consensus.cc:2243] T 6f213937fc9b4030a228a8e56ed80f52 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.418434   431 raft_consensus.cc:2272] T 6f213937fc9b4030a228a8e56ed80f52 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:40.420576   431 tablet_replica.cc:333] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.421479   431 raft_consensus.cc:2243] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:40.422210   431 raft_consensus.cc:2272] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:40.423993   431 tablet_replica.cc:333] T 803c43e83ee5487590c9d922559adc0f P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.424510   431 raft_consensus.cc:2243] T 803c43e83ee5487590c9d922559adc0f P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.424860   431 raft_consensus.cc:2272] T 803c43e83ee5487590c9d922559adc0f P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:40.427155   431 tablet_replica.cc:333] T b2a7ad91c8474397bae23c993b89fca4 P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.427786   431 raft_consensus.cc:2243] T b2a7ad91c8474397bae23c993b89fca4 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.428210   431 raft_consensus.cc:2272] T b2a7ad91c8474397bae23c993b89fca4 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:40.430102   431 tablet_replica.cc:333] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.430671   431 raft_consensus.cc:2243] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.431097   431 raft_consensus.cc:2272] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:40.432890   431 tablet_replica.cc:333] T f3a3d4fd34924b7c8ed0df6709391329 P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.433547   431 raft_consensus.cc:2243] T f3a3d4fd34924b7c8ed0df6709391329 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.433955   431 raft_consensus.cc:2272] T f3a3d4fd34924b7c8ed0df6709391329 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:40.435727   431 tablet_replica.cc:333] T b94916f0e1e340a38f4a100f451fdaba P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.436298   431 raft_consensus.cc:2243] T b94916f0e1e340a38f4a100f451fdaba P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.436731   431 raft_consensus.cc:2272] T b94916f0e1e340a38f4a100f451fdaba P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:40.438732   431 tablet_replica.cc:333] T e97eecc3acdf46a5b5577416f7bfe336 P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.439339   431 raft_consensus.cc:2243] T e97eecc3acdf46a5b5577416f7bfe336 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.439797   431 raft_consensus.cc:2272] T e97eecc3acdf46a5b5577416f7bfe336 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:40.442358   431 tablet_replica.cc:333] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.443043   431 raft_consensus.cc:2243] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:40.444386   431 raft_consensus.cc:2272] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:40.447110   431 tablet_replica.cc:333] T 9a8ed4502cb447c7b2cb94c96dcb7daf P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.447715   431 raft_consensus.cc:2243] T 9a8ed4502cb447c7b2cb94c96dcb7daf P 932245f14aac417f913cc7330a1833b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:40.448509   431 raft_consensus.cc:2272] T 9a8ed4502cb447c7b2cb94c96dcb7daf P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:40.450533   431 tablet_replica.cc:333] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.451138   431 raft_consensus.cc:2243] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.451586   431 raft_consensus.cc:2272] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:40.454526   431 tablet_replica.cc:333] T 846ce8cad343420485af76370f029d54 P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.455173   431 raft_consensus.cc:2243] T 846ce8cad343420485af76370f029d54 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.455714   431 raft_consensus.cc:2272] T 846ce8cad343420485af76370f029d54 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:40.458134   431 tablet_replica.cc:333] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.458899   431 raft_consensus.cc:2243] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:40.459635   431 raft_consensus.cc:2272] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:40.462029   431 tablet_replica.cc:333] T a55798aa4230462f9befe5d7fc9bd3ce P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.462881   431 raft_consensus.cc:2243] T a55798aa4230462f9befe5d7fc9bd3ce P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.463429   431 raft_consensus.cc:2272] T a55798aa4230462f9befe5d7fc9bd3ce P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:40.465916   431 tablet_replica.cc:333] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.466529   431 raft_consensus.cc:2243] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:40.467375   431 raft_consensus.cc:2272] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:40.469561   431 tablet_replica.cc:333] T b31d08e4168243f08eb2a31031a039ed P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.470244   431 raft_consensus.cc:2243] T b31d08e4168243f08eb2a31031a039ed P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.470669   431 raft_consensus.cc:2272] T b31d08e4168243f08eb2a31031a039ed P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:40.472899   431 tablet_replica.cc:333] T 7937a8107df4458ebd48b5ce1589d788 P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.473548   431 raft_consensus.cc:2243] T 7937a8107df4458ebd48b5ce1589d788 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.474079   431 raft_consensus.cc:2272] T 7937a8107df4458ebd48b5ce1589d788 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:40.476248   431 tablet_replica.cc:333] T 8528ae822cb04615a9dbd1166b7d7328 P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.476871   431 raft_consensus.cc:2243] T 8528ae822cb04615a9dbd1166b7d7328 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.477296   431 raft_consensus.cc:2272] T 8528ae822cb04615a9dbd1166b7d7328 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:40.479235   431 tablet_replica.cc:333] T 8dfdb24cbc824b95ac65712323103e2a P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.479813   431 raft_consensus.cc:2243] T 8dfdb24cbc824b95ac65712323103e2a P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.480263   431 raft_consensus.cc:2272] T 8dfdb24cbc824b95ac65712323103e2a P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:40.483019   431 tablet_replica.cc:333] T e7d162d34de74e47895dac207e265059 P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.484638   431 raft_consensus.cc:2243] T e7d162d34de74e47895dac207e265059 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.485287   431 raft_consensus.cc:2272] T e7d162d34de74e47895dac207e265059 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:40.487510   431 tablet_replica.cc:333] T ad58816d959840df923159e870cf4ad8 P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.488212   431 raft_consensus.cc:2243] T ad58816d959840df923159e870cf4ad8 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.488634   431 raft_consensus.cc:2272] T ad58816d959840df923159e870cf4ad8 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:40.491164   431 tablet_replica.cc:333] T 93877deb770d41a6ba34cefdea146d54 P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.491900   431 raft_consensus.cc:2243] T 93877deb770d41a6ba34cefdea146d54 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.492435   431 raft_consensus.cc:2272] T 93877deb770d41a6ba34cefdea146d54 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:40.493885  9512 consensus_peers.cc:597] T 774befa616254c02901f28edde6ab758 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:40.494963   431 tablet_replica.cc:333] T 73b8fed487d54513b9256d4c1a39cfa0 P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.495872   431 raft_consensus.cc:2243] T 73b8fed487d54513b9256d4c1a39cfa0 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.496425   431 raft_consensus.cc:2272] T 73b8fed487d54513b9256d4c1a39cfa0 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:40.496935  9364 consensus_peers.cc:597] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49 -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:40.498307  9512 consensus_peers.cc:597] T b305803a339e40f99c1a6af7f6f84f7c P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:40.499135   431 tablet_replica.cc:333] T 3bd9c3f12cc546ff905df61c5a9028f6 P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.499850   431 raft_consensus.cc:2243] T 3bd9c3f12cc546ff905df61c5a9028f6 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.500319   431 raft_consensus.cc:2272] T 3bd9c3f12cc546ff905df61c5a9028f6 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:40.502866   431 tablet_replica.cc:333] T 5cfc1f2582a64d8dbc3f127e15024ec0 P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.503590   431 raft_consensus.cc:2243] T 5cfc1f2582a64d8dbc3f127e15024ec0 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.504139   431 raft_consensus.cc:2272] T 5cfc1f2582a64d8dbc3f127e15024ec0 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:40.506469   431 tablet_replica.cc:333] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.507045   431 raft_consensus.cc:2243] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:40.507828   431 raft_consensus.cc:2272] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:40.509955   431 tablet_replica.cc:333] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.510531   431 raft_consensus.cc:2243] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.510905   431 pending_rounds.cc:70] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8: Trying to abort 1 pending ops.
I20260709 13:04:40.511052   431 pending_rounds.cc:77] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305634937874345984 op_type: NO_OP noop_request { }
I20260709 13:04:40.511442   431 raft_consensus.cc:2889] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:04:40.511811   431 raft_consensus.cc:2272] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:40.514516   431 tablet_replica.cc:333] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
W20260709 13:04:40.515009  9512 consensus_peers.cc:597] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:40.515300   431 raft_consensus.cc:2243] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.515869   431 raft_consensus.cc:2272] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:40.518827   431 tablet_replica.cc:333] T 774befa616254c02901f28edde6ab758 P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.519780   431 raft_consensus.cc:2243] T 774befa616254c02901f28edde6ab758 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.520195   431 raft_consensus.cc:2272] T 774befa616254c02901f28edde6ab758 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:40.522029   431 tablet_replica.cc:333] T 331d1446396c45ce9486793ecb5de7f7 P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.522538   431 raft_consensus.cc:2243] T 331d1446396c45ce9486793ecb5de7f7 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.522898   431 raft_consensus.cc:2272] T 331d1446396c45ce9486793ecb5de7f7 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:40.524976   431 tablet_replica.cc:333] T 225ca60d9645490dbcdcf6d4d127d955 P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.525561   431 raft_consensus.cc:2243] T 225ca60d9645490dbcdcf6d4d127d955 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.526065   431 raft_consensus.cc:2272] T 225ca60d9645490dbcdcf6d4d127d955 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:40.528344   431 tablet_replica.cc:333] T 17d57808c20741cd85b0e175935cdab7 P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.529059   431 raft_consensus.cc:2243] T 17d57808c20741cd85b0e175935cdab7 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.529544   431 raft_consensus.cc:2272] T 17d57808c20741cd85b0e175935cdab7 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:40.530048  9512 consensus_peers.cc:597] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:40.531471   431 tablet_replica.cc:333] T a8fbcbebcf87468f821e14a079bf305d P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.532156   431 raft_consensus.cc:2243] T a8fbcbebcf87468f821e14a079bf305d P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.532634   431 raft_consensus.cc:2272] T a8fbcbebcf87468f821e14a079bf305d P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:40.535213   431 tablet_replica.cc:333] T ff040bb60327424d8aeec71e3bf58a0a P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.535919   431 raft_consensus.cc:2243] T ff040bb60327424d8aeec71e3bf58a0a P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.536432   431 raft_consensus.cc:2272] T ff040bb60327424d8aeec71e3bf58a0a P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:40.536540  9364 consensus_peers.cc:597] T e97eecc3acdf46a5b5577416f7bfe336 P a91e8b10a5984dec9d3777a7275cef49 -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:40.538405   431 tablet_replica.cc:333] T 879fbf42aa3c4c21a58f094d1a2b91e7 P 932245f14aac417f913cc7330a1833b8: stopping tablet replica
I20260709 13:04:40.538996   431 raft_consensus.cc:2243] T 879fbf42aa3c4c21a58f094d1a2b91e7 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.539413   431 raft_consensus.cc:2272] T 879fbf42aa3c4c21a58f094d1a2b91e7 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:40.560662  9438 consensus_peers.cc:597] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P ef5fe58eb3e04ae18fda957b4d507eff -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:40.566774  9438 consensus_peers.cc:597] T 65ba9982e9bd4177995544e13394911a P ef5fe58eb3e04ae18fda957b4d507eff -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:40.568598  9512 consensus_peers.cc:597] T 803c43e83ee5487590c9d922559adc0f P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:40.578747  9438 consensus_peers.cc:597] T 879fbf42aa3c4c21a58f094d1a2b91e7 P ef5fe58eb3e04ae18fda957b4d507eff -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:40.579128  9512 consensus_peers.cc:597] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:40.587698  9438 consensus_peers.cc:597] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P ef5fe58eb3e04ae18fda957b4d507eff -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:40.628031  9364 consensus_peers.cc:597] T a8fbcbebcf87468f821e14a079bf305d P a91e8b10a5984dec9d3777a7275cef49 -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:40.628858   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:04:40.633001  9512 consensus_peers.cc:597] T 6f213937fc9b4030a228a8e56ed80f52 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:40.662384  9364 consensus_peers.cc:597] T 1a5145e5f9a64fe0acdd74d909e841fc P a91e8b10a5984dec9d3777a7275cef49 -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:40.667375  9364 consensus_peers.cc:597] T 7937a8107df4458ebd48b5ce1589d788 P a91e8b10a5984dec9d3777a7275cef49 -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:40.680507  9512 consensus_peers.cc:597] T b2a7ad91c8474397bae23c993b89fca4 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:40.697955  9512 consensus_peers.cc:597] T 331d1446396c45ce9486793ecb5de7f7 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:40.698061  9364 consensus_peers.cc:597] T b94916f0e1e340a38f4a100f451fdaba P a91e8b10a5984dec9d3777a7275cef49 -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:40.698477  9512 consensus_peers.cc:597] T 17d57808c20741cd85b0e175935cdab7 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:40.702214  9512 consensus_peers.cc:597] T 02c431d6db7643adbb4b26a3c7e38b76 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:40.704514  9512 consensus_peers.cc:597] T d8bd3f903abb4dd99431dbf597c0d462 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:40.720353   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:40.725222  9512 consensus_peers.cc:597] T 3bd9c3f12cc546ff905df61c5a9028f6 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:40.731668 10116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:40.733204 10117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:40.736984 10119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:40.739220   431 server_base.cc:1061] running on GCE node
I20260709 13:04:40.744056   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:40.744377   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:40.744599   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602280744578 us; error 0 us; skew 500 ppm
I20260709 13:04:40.745296   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:40.749290   431 webserver.cc:533] Webserver started at http://127.0.107.193:34135/ using document root <none> and password file <none>
I20260709 13:04:40.749971   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:40.750202   431 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:04:40.754961   431 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:04:40.775282 10124 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:40.777652   431 fs_manager.cc:730] Time spent opening block manager: real 0.016s	user 0.001s	sys 0.009s
I20260709 13:04:40.778095   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601979855482-431-0/minicluster-data/ts-0-root
uuid: "932245f14aac417f913cc7330a1833b8"
format_stamp: "Formatted at 2026-07-09 13:04:27 on dist-test-slave-g4pn"
I20260709 13:04:40.778649   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601979855482-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601979855482-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601979855482-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:40.820420   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:40.822297   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:40.824203   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:40.830624 10131 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:04:41.159422   431 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:04:41.159762   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.330s	user 0.008s	sys 0.000s
I20260709 13:04:41.160099   431 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:04:41.165372 10131 tablet_bootstrap.cc:492] T e7d162d34de74e47895dac207e265059 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:41.185439 10131 tablet_bootstrap.cc:492] T e7d162d34de74e47895dac207e265059 P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:41.186414 10131 tablet_bootstrap.cc:492] T e7d162d34de74e47895dac207e265059 P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:41.187319 10131 ts_tablet_manager.cc:1403] T e7d162d34de74e47895dac207e265059 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.005s
I20260709 13:04:41.190389 10131 raft_consensus.cc:359] T e7d162d34de74e47895dac207e265059 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:41.191088 10131 raft_consensus.cc:740] T e7d162d34de74e47895dac207e265059 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:41.191789 10131 consensus_queue.cc:260] T e7d162d34de74e47895dac207e265059 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:41.194679 10131 ts_tablet_manager.cc:1434] T e7d162d34de74e47895dac207e265059 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:04:41.195410 10131 tablet_bootstrap.cc:492] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:41.214481 10131 tablet_bootstrap.cc:492] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:41.215408 10131 tablet_bootstrap.cc:492] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:41.216051 10131 ts_tablet_manager.cc:1403] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.001s
I20260709 13:04:41.218473 10131 raft_consensus.cc:359] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:41.219136 10131 raft_consensus.cc:740] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:41.219924 10131 consensus_queue.cc:260] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:41.221837 10131 ts_tablet_manager.cc:1434] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:04:41.222599 10131 tablet_bootstrap.cc:492] T 803c43e83ee5487590c9d922559adc0f P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:41.242913 10131 tablet_bootstrap.cc:492] T 803c43e83ee5487590c9d922559adc0f P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:41.250416 10131 tablet_bootstrap.cc:492] T 803c43e83ee5487590c9d922559adc0f P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:41.251178 10131 ts_tablet_manager.cc:1403] T 803c43e83ee5487590c9d922559adc0f P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.008s
I20260709 13:04:41.253587 10131 raft_consensus.cc:359] T 803c43e83ee5487590c9d922559adc0f P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:41.254346 10131 raft_consensus.cc:740] T 803c43e83ee5487590c9d922559adc0f P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:41.255177 10131 consensus_queue.cc:260] T 803c43e83ee5487590c9d922559adc0f P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:41.257349 10131 ts_tablet_manager.cc:1434] T 803c43e83ee5487590c9d922559adc0f P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:41.258297 10131 tablet_bootstrap.cc:492] T b31d08e4168243f08eb2a31031a039ed P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:41.271996 10131 tablet_bootstrap.cc:492] T b31d08e4168243f08eb2a31031a039ed P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:41.273303 10131 tablet_bootstrap.cc:492] T b31d08e4168243f08eb2a31031a039ed P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:41.274096 10131 ts_tablet_manager.cc:1403] T b31d08e4168243f08eb2a31031a039ed P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.003s
I20260709 13:04:41.276911 10131 raft_consensus.cc:359] T b31d08e4168243f08eb2a31031a039ed P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:41.277698 10131 raft_consensus.cc:740] T b31d08e4168243f08eb2a31031a039ed P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:41.278600 10131 consensus_queue.cc:260] T b31d08e4168243f08eb2a31031a039ed P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:41.281219 10131 ts_tablet_manager.cc:1434] T b31d08e4168243f08eb2a31031a039ed P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:41.282230 10131 tablet_bootstrap.cc:492] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:41.295550 10131 tablet_bootstrap.cc:492] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:04:41.296507 10131 tablet_bootstrap.cc:492] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:41.297173 10131 ts_tablet_manager.cc:1403] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 13:04:41.299166 10131 raft_consensus.cc:359] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:41.299819 10131 raft_consensus.cc:740] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:41.300547 10131 consensus_queue.cc:260] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:41.302217 10131 ts_tablet_manager.cc:1434] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:41.302858 10131 tablet_bootstrap.cc:492] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:41.317744 10131 tablet_bootstrap.cc:492] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:41.318626 10131 tablet_bootstrap.cc:492] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:41.319217 10131 ts_tablet_manager.cc:1403] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 13:04:41.321229 10131 raft_consensus.cc:359] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:41.321807 10131 raft_consensus.cc:740] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:41.322430 10131 consensus_queue.cc:260] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:41.324151 10131 ts_tablet_manager.cc:1434] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:41.325034 10131 tablet_bootstrap.cc:492] T 8528ae822cb04615a9dbd1166b7d7328 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:41.338454 10131 tablet_bootstrap.cc:492] T 8528ae822cb04615a9dbd1166b7d7328 P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:41.339139 10131 tablet_bootstrap.cc:492] T 8528ae822cb04615a9dbd1166b7d7328 P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:41.339682 10131 ts_tablet_manager.cc:1403] T 8528ae822cb04615a9dbd1166b7d7328 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:04:41.341560 10131 raft_consensus.cc:359] T 8528ae822cb04615a9dbd1166b7d7328 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:41.342064 10131 raft_consensus.cc:385] T 8528ae822cb04615a9dbd1166b7d7328 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:41.342310 10131 raft_consensus.cc:740] T 8528ae822cb04615a9dbd1166b7d7328 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:41.342828 10131 consensus_queue.cc:260] T 8528ae822cb04615a9dbd1166b7d7328 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:41.344648 10131 ts_tablet_manager.cc:1434] T 8528ae822cb04615a9dbd1166b7d7328 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:04:41.345446 10131 tablet_bootstrap.cc:492] T 73b8fed487d54513b9256d4c1a39cfa0 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:41.372206 10131 tablet_bootstrap.cc:492] T 73b8fed487d54513b9256d4c1a39cfa0 P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:41.373176 10131 tablet_bootstrap.cc:492] T 73b8fed487d54513b9256d4c1a39cfa0 P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:41.373829 10131 ts_tablet_manager.cc:1403] T 73b8fed487d54513b9256d4c1a39cfa0 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.016s
I20260709 13:04:41.376047 10131 raft_consensus.cc:359] T 73b8fed487d54513b9256d4c1a39cfa0 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:41.376591 10131 raft_consensus.cc:740] T 73b8fed487d54513b9256d4c1a39cfa0 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:41.377310 10131 consensus_queue.cc:260] T 73b8fed487d54513b9256d4c1a39cfa0 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:41.378810 10131 ts_tablet_manager.cc:1434] T 73b8fed487d54513b9256d4c1a39cfa0 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:41.379536 10131 tablet_bootstrap.cc:492] T 5cfc1f2582a64d8dbc3f127e15024ec0 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:41.392939 10131 tablet_bootstrap.cc:492] T 5cfc1f2582a64d8dbc3f127e15024ec0 P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:41.393952 10131 tablet_bootstrap.cc:492] T 5cfc1f2582a64d8dbc3f127e15024ec0 P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:41.394707 10131 ts_tablet_manager.cc:1403] T 5cfc1f2582a64d8dbc3f127e15024ec0 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 13:04:41.397177 10131 raft_consensus.cc:359] T 5cfc1f2582a64d8dbc3f127e15024ec0 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:41.397871 10131 raft_consensus.cc:740] T 5cfc1f2582a64d8dbc3f127e15024ec0 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:41.398531 10131 consensus_queue.cc:260] T 5cfc1f2582a64d8dbc3f127e15024ec0 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:41.400496 10131 ts_tablet_manager.cc:1434] T 5cfc1f2582a64d8dbc3f127e15024ec0 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:41.401291 10131 tablet_bootstrap.cc:492] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:41.420612 10131 tablet_bootstrap.cc:492] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:41.422134 10131 tablet_bootstrap.cc:492] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:41.422819 10131 ts_tablet_manager.cc:1403] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.004s
I20260709 13:04:41.425769 10131 raft_consensus.cc:359] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:41.426460 10131 raft_consensus.cc:740] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:41.427253 10131 consensus_queue.cc:260] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:41.429654 10131 ts_tablet_manager.cc:1434] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:04:41.430447 10131 tablet_bootstrap.cc:492] T b305803a339e40f99c1a6af7f6f84f7c P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:41.439060   431 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:04:41.439463   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.279s	user 0.255s	sys 0.007s
I20260709 13:04:41.448719  9995 raft_consensus.cc:493] T 9a8ed4502cb447c7b2cb94c96dcb7daf P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 932245f14aac417f913cc7330a1833b8)
I20260709 13:04:41.449419  9995 raft_consensus.cc:515] T 9a8ed4502cb447c7b2cb94c96dcb7daf P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:41.451350 10131 tablet_bootstrap.cc:492] T b305803a339e40f99c1a6af7f6f84f7c P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:41.451881  9995 leader_election.cc:290] T 9a8ed4502cb447c7b2cb94c96dcb7daf P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:41.452603 10131 tablet_bootstrap.cc:492] T b305803a339e40f99c1a6af7f6f84f7c P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:41.453472 10131 ts_tablet_manager.cc:1403] T b305803a339e40f99c1a6af7f6f84f7c P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.004s
I20260709 13:04:41.454469  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8ed4502cb447c7b2cb94c96dcb7daf" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:41.456298 10131 raft_consensus.cc:359] T b305803a339e40f99c1a6af7f6f84f7c P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
W20260709 13:04:41.456911  9512 leader_election.cc:336] T 9a8ed4502cb447c7b2cb94c96dcb7daf P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111)
I20260709 13:04:41.457334 10131 raft_consensus.cc:740] T b305803a339e40f99c1a6af7f6f84f7c P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:41.458088  9512 leader_election.cc:304] T 9a8ed4502cb447c7b2cb94c96dcb7daf P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf; no voters: 932245f14aac417f913cc7330a1833b8, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:41.458600 10131 consensus_queue.cc:260] T b305803a339e40f99c1a6af7f6f84f7c P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:41.459223  9973 raft_consensus.cc:2749] T 9a8ed4502cb447c7b2cb94c96dcb7daf P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:41.465113 10131 ts_tablet_manager.cc:1434] T b305803a339e40f99c1a6af7f6f84f7c P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:04:41.466279 10131 tablet_bootstrap.cc:492] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:41.484378 10131 tablet_bootstrap.cc:492] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:41.485356 10131 tablet_bootstrap.cc:492] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:41.485921 10131 ts_tablet_manager.cc:1403] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260709 13:04:41.487718 10131 raft_consensus.cc:359] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:41.488395 10131 raft_consensus.cc:740] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:41.489070 10131 consensus_queue.cc:260] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:41.489682 10038 raft_consensus.cc:493] T 9b34d97496514d29a27c52d749609084 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 932245f14aac417f913cc7330a1833b8)
I20260709 13:04:41.490228 10038 raft_consensus.cc:515] T 9b34d97496514d29a27c52d749609084 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:41.491266 10131 ts_tablet_manager.cc:1434] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:04:41.491796 10111 raft_consensus.cc:493] T 8c1e5b4bc1bc437884e6835b61227d4d P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 932245f14aac417f913cc7330a1833b8)
I20260709 13:04:41.492110 10131 tablet_bootstrap.cc:492] T e97eecc3acdf46a5b5577416f7bfe336 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:41.492350 10038 leader_election.cc:290] T 9b34d97496514d29a27c52d749609084 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:41.495834  9398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b34d97496514d29a27c52d749609084" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:41.492367 10111 raft_consensus.cc:515] T 8c1e5b4bc1bc437884e6835b61227d4d P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:41.512045 10111 leader_election.cc:290] T 8c1e5b4bc1bc437884e6835b61227d4d P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
W20260709 13:04:41.512859  9438 leader_election.cc:336] T 9b34d97496514d29a27c52d749609084 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111)
I20260709 13:04:41.521420  9436 leader_election.cc:304] T 9b34d97496514d29a27c52d749609084 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef5fe58eb3e04ae18fda957b4d507eff; no voters: 932245f14aac417f913cc7330a1833b8, a91e8b10a5984dec9d3777a7275cef49
I20260709 13:04:41.522943 10005 raft_consensus.cc:2749] T 9b34d97496514d29a27c52d749609084 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:41.525709  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c1e5b4bc1bc437884e6835b61227d4d" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:41.546010 10005 raft_consensus.cc:493] T 9a8ed4502cb447c7b2cb94c96dcb7daf P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 932245f14aac417f913cc7330a1833b8)
I20260709 13:04:41.546983 10005 raft_consensus.cc:515] T 9a8ed4502cb447c7b2cb94c96dcb7daf P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:41.551052  9546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8ed4502cb447c7b2cb94c96dcb7daf" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:41.552461  9546 raft_consensus.cc:2468] T 9a8ed4502cb447c7b2cb94c96dcb7daf P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 1.
I20260709 13:04:41.557626  9438 leader_election.cc:304] T 9a8ed4502cb447c7b2cb94c96dcb7daf P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
W20260709 13:04:41.559111  9364 leader_election.cc:336] T 8c1e5b4bc1bc437884e6835b61227d4d P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111)
I20260709 13:04:41.560285 10038 raft_consensus.cc:2804] T 9a8ed4502cb447c7b2cb94c96dcb7daf P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:41.565726  9364 leader_election.cc:304] T 8c1e5b4bc1bc437884e6835b61227d4d P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49; no voters: 932245f14aac417f913cc7330a1833b8, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:41.565749 10038 raft_consensus.cc:493] T 9a8ed4502cb447c7b2cb94c96dcb7daf P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Starting leader election (detected failure of leader 932245f14aac417f913cc7330a1833b8)
I20260709 13:04:41.566754 10038 raft_consensus.cc:3060] T 9a8ed4502cb447c7b2cb94c96dcb7daf P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:41.573727  9438 leader_election.cc:336] T 9a8ed4502cb447c7b2cb94c96dcb7daf P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111)
I20260709 13:04:41.564771  9995 raft_consensus.cc:493] T 3c53f31a2697499cb5ad2d5bb6715f02 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 932245f14aac417f913cc7330a1833b8)
I20260709 13:04:41.575168  9995 raft_consensus.cc:515] T 3c53f31a2697499cb5ad2d5bb6715f02 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:41.581378 10005 leader_election.cc:290] T 9a8ed4502cb447c7b2cb94c96dcb7daf P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:41.583809 10111 raft_consensus.cc:2749] T 8c1e5b4bc1bc437884e6835b61227d4d P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:41.588027  9398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c53f31a2697499cb5ad2d5bb6715f02" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:41.595552  9995 leader_election.cc:290] T 3c53f31a2697499cb5ad2d5bb6715f02 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
W20260709 13:04:41.605955  9512 leader_election.cc:336] T 3c53f31a2697499cb5ad2d5bb6715f02 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111)
I20260709 13:04:41.606441  9512 leader_election.cc:304] T 3c53f31a2697499cb5ad2d5bb6715f02 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf; no voters: 932245f14aac417f913cc7330a1833b8, a91e8b10a5984dec9d3777a7275cef49
I20260709 13:04:41.607987 10131 tablet_bootstrap.cc:492] T e97eecc3acdf46a5b5577416f7bfe336 P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:41.608387  9973 raft_consensus.cc:2749] T 3c53f31a2697499cb5ad2d5bb6715f02 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:41.609352 10131 tablet_bootstrap.cc:492] T e97eecc3acdf46a5b5577416f7bfe336 P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:41.610110 10131 ts_tablet_manager.cc:1403] T e97eecc3acdf46a5b5577416f7bfe336 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.118s	user 0.047s	sys 0.048s
I20260709 13:04:41.612772 10131 raft_consensus.cc:359] T e97eecc3acdf46a5b5577416f7bfe336 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:41.613489 10131 raft_consensus.cc:740] T e97eecc3acdf46a5b5577416f7bfe336 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:41.614331 10131 consensus_queue.cc:260] T e97eecc3acdf46a5b5577416f7bfe336 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:41.616549 10131 ts_tablet_manager.cc:1434] T e97eecc3acdf46a5b5577416f7bfe336 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:04:41.617368 10131 tablet_bootstrap.cc:492] T 774befa616254c02901f28edde6ab758 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:41.646543 10038 raft_consensus.cc:515] T 9a8ed4502cb447c7b2cb94c96dcb7daf P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:41.671103  9939 raft_consensus.cc:493] T 9b34d97496514d29a27c52d749609084 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 932245f14aac417f913cc7330a1833b8)
I20260709 13:04:41.673641  9939 raft_consensus.cc:515] T 9b34d97496514d29a27c52d749609084 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:41.676445  9939 leader_election.cc:290] T 9b34d97496514d29a27c52d749609084 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:41.683560  9546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8ed4502cb447c7b2cb94c96dcb7daf" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
I20260709 13:04:41.684513  9546 raft_consensus.cc:3060] T 9a8ed4502cb447c7b2cb94c96dcb7daf P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:41.691425  9438 leader_election.cc:336] T 9a8ed4502cb447c7b2cb94c96dcb7daf P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111)
I20260709 13:04:41.680650 10038 leader_election.cc:290] T 9a8ed4502cb447c7b2cb94c96dcb7daf P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 2 election: Requested vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:41.707721  9546 raft_consensus.cc:2468] T 9a8ed4502cb447c7b2cb94c96dcb7daf P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 2.
I20260709 13:04:41.711666  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b34d97496514d29a27c52d749609084" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:41.728049  9468 raft_consensus.cc:2468] T 9b34d97496514d29a27c52d749609084 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 1.
I20260709 13:04:41.714646 10038 raft_consensus.cc:493] T 58d4c6d168b449f98425d091c54cddb9 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 932245f14aac417f913cc7330a1833b8)
I20260709 13:04:41.715487 10111 raft_consensus.cc:493] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 932245f14aac417f913cc7330a1833b8)
I20260709 13:04:41.730374 10111 raft_consensus.cc:515] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:41.732671 10111 leader_election.cc:290] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:41.733619 10038 raft_consensus.cc:515] T 58d4c6d168b449f98425d091c54cddb9 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:41.738361 10038 leader_election.cc:290] T 58d4c6d168b449f98425d091c54cddb9 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
W20260709 13:04:41.738869  9364 leader_election.cc:336] T 9b34d97496514d29a27c52d749609084 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111)
I20260709 13:04:41.739967  9395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d4c6d168b449f98425d091c54cddb9" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:41.744190  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a7d590cbac4b6da413dd8ea2a26225" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:41.744383  9364 leader_election.cc:304] T 9b34d97496514d29a27c52d749609084 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 932245f14aac417f913cc7330a1833b8
I20260709 13:04:41.744884  9468 raft_consensus.cc:2468] T 93a7d590cbac4b6da413dd8ea2a26225 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 1.
I20260709 13:04:41.745630 10111 raft_consensus.cc:2804] T 9b34d97496514d29a27c52d749609084 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:41.746049 10111 raft_consensus.cc:493] T 9b34d97496514d29a27c52d749609084 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 932245f14aac417f913cc7330a1833b8)
I20260709 13:04:41.746393 10081 raft_consensus.cc:493] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 932245f14aac417f913cc7330a1833b8)
I20260709 13:04:41.746946 10081 raft_consensus.cc:515] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:41.749591 10081 leader_election.cc:290] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:41.746416 10111 raft_consensus.cc:3060] T 9b34d97496514d29a27c52d749609084 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:41.750190  9438 leader_election.cc:304] T 9a8ed4502cb447c7b2cb94c96dcb7daf P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 932245f14aac417f913cc7330a1833b8
I20260709 13:04:41.751156  9364 leader_election.cc:304] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:41.753403  9939 raft_consensus.cc:2804] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:41.753790  9939 raft_consensus.cc:493] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 932245f14aac417f913cc7330a1833b8)
I20260709 13:04:41.754144  9939 raft_consensus.cc:3060] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:41.754508 10131 tablet_bootstrap.cc:492] T 774befa616254c02901f28edde6ab758 P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:41.755522 10131 tablet_bootstrap.cc:492] T 774befa616254c02901f28edde6ab758 P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:41.756193 10131 ts_tablet_manager.cc:1403] T 774befa616254c02901f28edde6ab758 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.139s	user 0.073s	sys 0.060s
W20260709 13:04:41.758589  9438 leader_election.cc:336] T 58d4c6d168b449f98425d091c54cddb9 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111)
I20260709 13:04:41.759099  9438 leader_election.cc:304] T 58d4c6d168b449f98425d091c54cddb9 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef5fe58eb3e04ae18fda957b4d507eff; no voters: 932245f14aac417f913cc7330a1833b8, a91e8b10a5984dec9d3777a7275cef49
I20260709 13:04:41.760250 10029 raft_consensus.cc:2804] T 9a8ed4502cb447c7b2cb94c96dcb7daf P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:41.760316 10038 raft_consensus.cc:2749] T 58d4c6d168b449f98425d091c54cddb9 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:41.760882 10029 raft_consensus.cc:697] T 9a8ed4502cb447c7b2cb94c96dcb7daf P ef5fe58eb3e04ae18fda957b4d507eff [term 2 LEADER]: Becoming Leader. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Running, Role: LEADER
I20260709 13:04:41.761821 10029 consensus_queue.cc:237] T 9a8ed4502cb447c7b2cb94c96dcb7daf P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:41.763108  9939 raft_consensus.cc:515] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:41.765219  9939 leader_election.cc:290] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 election: Requested vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:41.759034 10131 raft_consensus.cc:359] T 774befa616254c02901f28edde6ab758 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:41.766839 10131 raft_consensus.cc:740] T 774befa616254c02901f28edde6ab758 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:41.767588 10131 consensus_queue.cc:260] T 774befa616254c02901f28edde6ab758 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:41.768942  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5b6e6fcfb04bc3bb6cc0270e14e0cd" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:41.769799 10131 ts_tablet_manager.cc:1434] T 774befa616254c02901f28edde6ab758 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:04:41.770756 10111 raft_consensus.cc:515] T 9b34d97496514d29a27c52d749609084 P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:41.772650  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a7d590cbac4b6da413dd8ea2a26225" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:41.770718 10131 tablet_bootstrap.cc:492] T 3bd9c3f12cc546ff905df61c5a9028f6 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:41.773564  9468 raft_consensus.cc:3060] T 93a7d590cbac4b6da413dd8ea2a26225 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:41.773276 10111 leader_election.cc:290] T 9b34d97496514d29a27c52d749609084 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 election: Requested vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:41.785272  9468 raft_consensus.cc:2468] T 93a7d590cbac4b6da413dd8ea2a26225 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 2.
I20260709 13:04:41.784946  9221 catalog_manager.cc:5697] T 9a8ed4502cb447c7b2cb94c96dcb7daf P ef5fe58eb3e04ae18fda957b4d507eff reported cstate change: term changed from 1 to 2, leader changed from 932245f14aac417f913cc7330a1833b8 (127.0.107.193) to ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195). New cstate: current_term: 2 leader_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:41.793229 10131 tablet_bootstrap.cc:492] T 3bd9c3f12cc546ff905df61c5a9028f6 P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:41.794317 10131 tablet_bootstrap.cc:492] T 3bd9c3f12cc546ff905df61c5a9028f6 P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:41.795011 10131 ts_tablet_manager.cc:1403] T 3bd9c3f12cc546ff905df61c5a9028f6 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.005s
I20260709 13:04:41.796597 10081 raft_consensus.cc:493] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 932245f14aac417f913cc7330a1833b8)
W20260709 13:04:41.796639  9364 leader_election.cc:336] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111)
I20260709 13:04:41.797405 10081 raft_consensus.cc:515] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:41.798741 10131 raft_consensus.cc:359] T 3bd9c3f12cc546ff905df61c5a9028f6 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:41.799449 10131 raft_consensus.cc:740] T 3bd9c3f12cc546ff905df61c5a9028f6 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:41.799563 10081 leader_election.cc:290] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:41.800194 10131 consensus_queue.cc:260] T 3bd9c3f12cc546ff905df61c5a9028f6 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:41.802317 10131 ts_tablet_manager.cc:1434] T 3bd9c3f12cc546ff905df61c5a9028f6 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:41.803274 10131 tablet_bootstrap.cc:492] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:41.804296  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b34d97496514d29a27c52d749609084" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:41.804944  9468 raft_consensus.cc:3060] T 9b34d97496514d29a27c52d749609084 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:41.811486 10164 raft_consensus.cc:493] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 932245f14aac417f913cc7330a1833b8)
I20260709 13:04:41.812660 10164 raft_consensus.cc:515] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:41.813971  9468 raft_consensus.cc:2468] T 9b34d97496514d29a27c52d749609084 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 2.
I20260709 13:04:41.816735  9364 leader_election.cc:304] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:41.818961  9939 raft_consensus.cc:2804] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:41.819535  9364 leader_election.cc:304] T 9b34d97496514d29a27c52d749609084 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:41.819593  9939 raft_consensus.cc:697] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49 [term 2 LEADER]: Becoming Leader. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Running, Role: LEADER
I20260709 13:04:41.820586 10111 raft_consensus.cc:2804] T 9b34d97496514d29a27c52d749609084 P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:41.821123 10111 raft_consensus.cc:697] T 9b34d97496514d29a27c52d749609084 P a91e8b10a5984dec9d3777a7275cef49 [term 2 LEADER]: Becoming Leader. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Running, Role: LEADER
I20260709 13:04:41.820780  9939 consensus_queue.cc:237] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:41.822026 10111 consensus_queue.cc:237] T 9b34d97496514d29a27c52d749609084 P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:41.822978 10164 leader_election.cc:290] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:41.826803  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d4c6d168b449f98425d091c54cddb9" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:41.827677  9468 raft_consensus.cc:2468] T 58d4c6d168b449f98425d091c54cddb9 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 1.
W20260709 13:04:41.830552  9364 leader_election.cc:336] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111)
I20260709 13:04:41.831079  9364 leader_election.cc:304] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49; no voters: 932245f14aac417f913cc7330a1833b8, ef5fe58eb3e04ae18fda957b4d507eff
W20260709 13:04:41.832195  9364 leader_election.cc:336] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111)
W20260709 13:04:41.838235  9438 leader_election.cc:336] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111)
I20260709 13:04:41.839084 10081 raft_consensus.cc:2749] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:41.841251 10133 raft_consensus.cc:493] T 8528ae822cb04615a9dbd1166b7d7328 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.842595 10133 raft_consensus.cc:515] T 8528ae822cb04615a9dbd1166b7d7328 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:41.857827 10133 leader_election.cc:290] T 8528ae822cb04615a9dbd1166b7d7328 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
W20260709 13:04:41.902479  9438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37633, user_credentials={real_user=slave}} blocked reactor thread for 64284.3us
I20260709 13:04:41.911715 10164 raft_consensus.cc:493] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 932245f14aac417f913cc7330a1833b8)
I20260709 13:04:41.912400 10164 raft_consensus.cc:515] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:41.915040 10164 leader_election.cc:290] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:41.963368  9939 raft_consensus.cc:493] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 932245f14aac417f913cc7330a1833b8)
I20260709 13:04:41.964334  9939 raft_consensus.cc:515] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:41.967115  9939 leader_election.cc:290] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:41.995994 10164 raft_consensus.cc:493] T 63d5c2ea967a4c1586216c60202c5514 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 932245f14aac417f913cc7330a1833b8)
I20260709 13:04:42.025113 10164 raft_consensus.cc:515] T 63d5c2ea967a4c1586216c60202c5514 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:42.027362 10164 leader_election.cc:290] T 63d5c2ea967a4c1586216c60202c5514 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:42.000797  9395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c1e5b4bc1bc437884e6835b61227d4d" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:42.028242  9395 raft_consensus.cc:2468] T 8c1e5b4bc1bc437884e6835b61227d4d P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 1.
I20260709 13:04:42.002069  9398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5b6e6fcfb04bc3bb6cc0270e14e0cd" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:42.030336  9398 raft_consensus.cc:2468] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 1.
I20260709 13:04:42.040683 10131 tablet_bootstrap.cc:492] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:42.041723 10131 tablet_bootstrap.cc:492] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:42.042470 10131 ts_tablet_manager.cc:1403] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.239s	user 0.036s	sys 0.041s
I20260709 13:04:42.045279 10131 raft_consensus.cc:359] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:42.045991 10131 raft_consensus.cc:740] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:42.046847 10131 consensus_queue.cc:260] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:42.048811 10131 ts_tablet_manager.cc:1434] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:42.049734 10131 tablet_bootstrap.cc:492] T 02c431d6db7643adbb4b26a3c7e38b76 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:42.016376  9217 catalog_manager.cc:5697] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49 reported cstate change: term changed from 1 to 2, leader changed from 932245f14aac417f913cc7330a1833b8 (127.0.107.193) to a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "a91e8b10a5984dec9d3777a7275cef49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:42.019320  9438 consensus_peers.cc:597] T 8528ae822cb04615a9dbd1166b7d7328 P ef5fe58eb3e04ae18fda957b4d507eff -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Error code: TABLET_NOT_RUNNING (12). Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:42.120481  9438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37633, user_credentials={real_user=slave}} blocked reactor thread for 101158us
I20260709 13:04:42.102110  9393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8528ae822cb04615a9dbd1166b7d7328" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:42.107131  9436 leader_election.cc:304] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 932245f14aac417f913cc7330a1833b8
I20260709 13:04:42.127950  9398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5c2ea967a4c1586216c60202c5514" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:42.129263  9398 raft_consensus.cc:2468] T 63d5c2ea967a4c1586216c60202c5514 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 1.
I20260709 13:04:42.133114  9436 leader_election.cc:304] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
W20260709 13:04:42.135492  9364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38559, user_credentials={real_user=slave}} blocked reactor thread for 292819us
I20260709 13:04:42.138677 10005 raft_consensus.cc:2804] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:42.139308 10005 raft_consensus.cc:493] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Starting leader election (detected failure of leader 932245f14aac417f913cc7330a1833b8)
I20260709 13:04:42.139787 10005 raft_consensus.cc:3060] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.140409 10038 raft_consensus.cc:2804] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:42.141333 10038 raft_consensus.cc:493] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Starting leader election (detected failure of leader 932245f14aac417f913cc7330a1833b8)
I20260709 13:04:42.143235 10038 raft_consensus.cc:3060] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.148283  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8528ae822cb04615a9dbd1166b7d7328" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:42.161641  9364 leader_election.cc:304] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
W20260709 13:04:42.171679  9438 leader_election.cc:336] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111)
I20260709 13:04:42.179857  9436 leader_election.cc:304] T 63d5c2ea967a4c1586216c60202c5514 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:42.182329 10164 raft_consensus.cc:2804] T 63d5c2ea967a4c1586216c60202c5514 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:42.182840 10164 raft_consensus.cc:493] T 63d5c2ea967a4c1586216c60202c5514 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Starting leader election (detected failure of leader 932245f14aac417f913cc7330a1833b8)
I20260709 13:04:42.183259 10164 raft_consensus.cc:3060] T 63d5c2ea967a4c1586216c60202c5514 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.187505 10128 leader_election.cc:304] T 8528ae822cb04615a9dbd1166b7d7328 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 932245f14aac417f913cc7330a1833b8; no voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:42.190618 10133 raft_consensus.cc:2749] T 8528ae822cb04615a9dbd1166b7d7328 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:42.205726  9364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38559, user_credentials={real_user=slave}} blocked reactor thread for 44357.8us
I20260709 13:04:42.206208 10193 raft_consensus.cc:2804] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:42.207018 10193 raft_consensus.cc:493] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 932245f14aac417f913cc7330a1833b8)
I20260709 13:04:42.207520 10193 raft_consensus.cc:3060] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:42.207608  9364 leader_election.cc:336] T 9b34d97496514d29a27c52d749609084 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111)
I20260709 13:04:42.210249 10005 raft_consensus.cc:515] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:42.212826 10005 leader_election.cc:290] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 2 election: Requested vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
W20260709 13:04:42.223639  9364 leader_election.cc:336] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111)
I20260709 13:04:42.251569 10193 raft_consensus.cc:515] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:42.278971  9546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c53f31a2697499cb5ad2d5bb6715f02" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:42.280305  9546 raft_consensus.cc:2468] T 3c53f31a2697499cb5ad2d5bb6715f02 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 1.
I20260709 13:04:42.281912  9217 catalog_manager.cc:5697] T 9b34d97496514d29a27c52d749609084 P a91e8b10a5984dec9d3777a7275cef49 reported cstate change: term changed from 1 to 2, leader changed from 932245f14aac417f913cc7330a1833b8 (127.0.107.193) to a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "a91e8b10a5984dec9d3777a7275cef49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:42.289291 10193 leader_election.cc:290] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 election: Requested vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
W20260709 13:04:42.291393  9436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33607, user_credentials={real_user=slave}} blocked reactor thread for 91582us
W20260709 13:04:42.316484  9438 leader_election.cc:336] T 63d5c2ea967a4c1586216c60202c5514 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111)
I20260709 13:04:42.352403  9398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5b6e6fcfb04bc3bb6cc0270e14e0cd" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:42.353670  9398 raft_consensus.cc:3060] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:42.368330  9438 leader_election.cc:336] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111)
I20260709 13:04:42.332291 10038 raft_consensus.cc:515] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:42.367136 10164 raft_consensus.cc:515] T 63d5c2ea967a4c1586216c60202c5514 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:42.382480 10164 leader_election.cc:290] T 63d5c2ea967a4c1586216c60202c5514 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 2 election: Requested vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:42.386078 10038 leader_election.cc:290] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 2 election: Requested vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:42.403640 10131 tablet_bootstrap.cc:492] T 02c431d6db7643adbb4b26a3c7e38b76 P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:42.406070 10131 tablet_bootstrap.cc:492] T 02c431d6db7643adbb4b26a3c7e38b76 P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:42.411500  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d4c6d168b449f98425d091c54cddb9" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:42.412547  9468 raft_consensus.cc:3060] T 58d4c6d168b449f98425d091c54cddb9 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.420804  9546 raft_consensus.cc:1275] T 9a8ed4502cb447c7b2cb94c96dcb7daf P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Refusing update from remote peer ef5fe58eb3e04ae18fda957b4d507eff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:42.423112 10131 ts_tablet_manager.cc:1403] T 02c431d6db7643adbb4b26a3c7e38b76 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.374s	user 0.025s	sys 0.006s
I20260709 13:04:42.429906  9472 raft_consensus.cc:1275] T 9b34d97496514d29a27c52d749609084 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Refusing update from remote peer a91e8b10a5984dec9d3777a7275cef49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:42.430523  9364 leader_election.cc:304] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 
W20260709 13:04:42.431874  9438 consensus_peers.cc:597] T 9a8ed4502cb447c7b2cb94c96dcb7daf P ef5fe58eb3e04ae18fda957b4d507eff -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:42.435694 10131 raft_consensus.cc:359] T 02c431d6db7643adbb4b26a3c7e38b76 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:42.437031 10131 raft_consensus.cc:740] T 02c431d6db7643adbb4b26a3c7e38b76 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
W20260709 13:04:42.432636  9438 leader_election.cc:336] T 63d5c2ea967a4c1586216c60202c5514 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111)
W20260709 13:04:42.438562  9438 leader_election.cc:336] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111)
I20260709 13:04:42.441208  9393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5c2ea967a4c1586216c60202c5514" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:42.442026  9393 raft_consensus.cc:3060] T 63d5c2ea967a4c1586216c60202c5514 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.443264 10133 raft_consensus.cc:493] T b31d08e4168243f08eb2a31031a039ed P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.444059 10133 raft_consensus.cc:515] T b31d08e4168243f08eb2a31031a039ed P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:42.446859 10200 consensus_queue.cc:1048] T 9a8ed4502cb447c7b2cb94c96dcb7daf P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:42.451234 10133 leader_election.cc:290] T b31d08e4168243f08eb2a31031a039ed P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:42.453248  9395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31d08e4168243f08eb2a31031a039ed" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:42.457741  9398 raft_consensus.cc:2468] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 2.
I20260709 13:04:42.463558 10111 raft_consensus.cc:2804] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:42.461820 10131 consensus_queue.cc:260] T 02c431d6db7643adbb4b26a3c7e38b76 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:42.464071 10111 raft_consensus.cc:493] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 932245f14aac417f913cc7330a1833b8)
I20260709 13:04:42.464648 10111 raft_consensus.cc:3060] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.472498  9468 raft_consensus.cc:2468] T 58d4c6d168b449f98425d091c54cddb9 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 2.
I20260709 13:04:42.475266  9398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c1e5b4bc1bc437884e6835b61227d4d" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:42.477777  9436 leader_election.cc:304] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 932245f14aac417f913cc7330a1833b8
I20260709 13:04:42.480502 10005 raft_consensus.cc:2804] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:42.493214  9398 raft_consensus.cc:3060] T 8c1e5b4bc1bc437884e6835b61227d4d P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.482803 10005 raft_consensus.cc:697] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff [term 2 LEADER]: Becoming Leader. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Running, Role: LEADER
I20260709 13:04:42.505879 10005 consensus_queue.cc:237] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:42.519345 10131 ts_tablet_manager.cc:1434] T 02c431d6db7643adbb4b26a3c7e38b76 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.094s	user 0.012s	sys 0.000s
I20260709 13:04:42.522663 10131 tablet_bootstrap.cc:492] T 879fbf42aa3c4c21a58f094d1a2b91e7 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:42.523656  9393 raft_consensus.cc:2468] T 63d5c2ea967a4c1586216c60202c5514 P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 2.
I20260709 13:04:42.536368 10111 raft_consensus.cc:515] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:42.542665  9436 leader_election.cc:304] T 63d5c2ea967a4c1586216c60202c5514 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 932245f14aac417f913cc7330a1833b8
I20260709 13:04:42.553568  9217 catalog_manager.cc:5697] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff reported cstate change: term changed from 1 to 2, leader changed from 932245f14aac417f913cc7330a1833b8 (127.0.107.193) to ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195). New cstate: current_term: 2 leader_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:42.557919 10133 raft_consensus.cc:493] T 5cfc1f2582a64d8dbc3f127e15024ec0 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.558784 10133 raft_consensus.cc:515] T 5cfc1f2582a64d8dbc3f127e15024ec0 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:42.560454 10081 consensus_queue.cc:1048] T 9b34d97496514d29a27c52d749609084 P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:42.563524 10133 leader_election.cc:290] T 5cfc1f2582a64d8dbc3f127e15024ec0 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:42.564790  9397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cfc1f2582a64d8dbc3f127e15024ec0" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:42.567166 10111 leader_election.cc:290] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 election: Requested vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:42.568616 10005 raft_consensus.cc:2804] T 63d5c2ea967a4c1586216c60202c5514 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:42.569289 10005 raft_consensus.cc:697] T 63d5c2ea967a4c1586216c60202c5514 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 LEADER]: Becoming Leader. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Running, Role: LEADER
I20260709 13:04:42.570688  9364 leader_election.cc:304] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:42.573415  9468 raft_consensus.cc:1275] T 93a7d590cbac4b6da413dd8ea2a26225 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Refusing update from remote peer a91e8b10a5984dec9d3777a7275cef49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:42.574010 10081 raft_consensus.cc:2804] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:42.574576 10081 raft_consensus.cc:697] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49 [term 2 LEADER]: Becoming Leader. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Running, Role: LEADER
I20260709 13:04:42.575599 10081 consensus_queue.cc:237] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:42.570205 10005 consensus_queue.cc:237] T 63d5c2ea967a4c1586216c60202c5514 P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
W20260709 13:04:42.588776  9364 leader_election.cc:336] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111)
W20260709 13:04:42.609021  9364 leader_election.cc:336] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111)
I20260709 13:04:42.623628 10133 raft_consensus.cc:493] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.627170 10133 raft_consensus.cc:515] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:42.631281 10133 leader_election.cc:290] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:42.633404  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8bd3f903abb4dd99431dbf597c0d462" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:42.643894 10133 raft_consensus.cc:493] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.643383  9545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c53f31a2697499cb5ad2d5bb6715f02" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
I20260709 13:04:42.645313  9545 raft_consensus.cc:3060] T 3c53f31a2697499cb5ad2d5bb6715f02 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.644838 10133 raft_consensus.cc:515] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
W20260709 13:04:42.650463  9364 consensus_peers.cc:597] T 9b34d97496514d29a27c52d749609084 P a91e8b10a5984dec9d3777a7275cef49 -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:42.651110  9364 consensus_peers.cc:597] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49 -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:42.655004  9393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c1e5b4bc1bc437884e6835b61227d4d" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:42.657517 10133 leader_election.cc:290] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:42.658340 10133 raft_consensus.cc:493] T 803c43e83ee5487590c9d922559adc0f P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.659250 10133 raft_consensus.cc:515] T 803c43e83ee5487590c9d922559adc0f P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:42.662510 10133 leader_election.cc:290] T 803c43e83ee5487590c9d922559adc0f P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:42.666657 10133 raft_consensus.cc:493] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.668412 10133 raft_consensus.cc:515] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:42.672015 10133 leader_election.cc:290] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:42.673731 10208 consensus_queue.cc:1048] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:42.693184  9398 raft_consensus.cc:2468] T 8c1e5b4bc1bc437884e6835b61227d4d P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5fe58eb3e04ae18fda957b4d507eff in term 2.
I20260709 13:04:42.696421  9436 leader_election.cc:304] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 932245f14aac417f913cc7330a1833b8
W20260709 13:04:42.704008  9364 leader_election.cc:336] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111)
I20260709 13:04:42.704671 10199 raft_consensus.cc:2804] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:42.705334 10199 raft_consensus.cc:697] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff [term 2 LEADER]: Becoming Leader. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Running, Role: LEADER
I20260709 13:04:42.706413 10199 consensus_queue.cc:237] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
W20260709 13:04:42.751674 10216 log.cc:927] Time spent T 63d5c2ea967a4c1586216c60202c5514 P ef5fe58eb3e04ae18fda957b4d507eff: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:04:42.758076  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c1e5b4bc1bc437884e6835b61227d4d" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:42.758363  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "803c43e83ee5487590c9d922559adc0f" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
W20260709 13:04:42.758803  9438 consensus_peers.cc:597] T a792fefbeb0c4eb79e87501fb6dbe780 P ef5fe58eb3e04ae18fda957b4d507eff -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:42.759727  9469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90aae84687f41e99e58dada706ae2d7" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:42.760628 10128 leader_election.cc:304] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 932245f14aac417f913cc7330a1833b8; no voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:42.765399  9545 raft_consensus.cc:2468] T 3c53f31a2697499cb5ad2d5bb6715f02 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 2.
I20260709 13:04:42.766976 10220 raft_consensus.cc:2749] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:42.769044  9364 leader_election.cc:304] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 932245f14aac417f913cc7330a1833b8
I20260709 13:04:42.771858 10111 raft_consensus.cc:2804] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:42.772423 10111 raft_consensus.cc:697] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 [term 2 LEADER]: Becoming Leader. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Running, Role: LEADER
I20260709 13:04:42.773468 10111 consensus_queue.cc:237] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:42.776782 10220 raft_consensus.cc:493] T e97eecc3acdf46a5b5577416f7bfe336 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.778142 10220 raft_consensus.cc:515] T e97eecc3acdf46a5b5577416f7bfe336 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
W20260709 13:04:42.779675  9438 consensus_peers.cc:597] T 8f602c194d1c445ba1851f0a2272b40b P ef5fe58eb3e04ae18fda957b4d507eff -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:42.780489 10220 leader_election.cc:290] T e97eecc3acdf46a5b5577416f7bfe336 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:42.781802  9398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97eecc3acdf46a5b5577416f7bfe336" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:42.779472  9217 catalog_manager.cc:5697] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49 reported cstate change: term changed from 1 to 2, leader changed from 932245f14aac417f913cc7330a1833b8 (127.0.107.193) to a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "a91e8b10a5984dec9d3777a7275cef49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:42.812425 10220 raft_consensus.cc:493] T b305803a339e40f99c1a6af7f6f84f7c P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.813694 10220 raft_consensus.cc:515] T b305803a339e40f99c1a6af7f6f84f7c P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
W20260709 13:04:42.812697  9438 consensus_peers.cc:597] T 73b8fed487d54513b9256d4c1a39cfa0 P ef5fe58eb3e04ae18fda957b4d507eff -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:42.817018 10220 leader_election.cc:290] T b305803a339e40f99c1a6af7f6f84f7c P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:42.818790  9393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b305803a339e40f99c1a6af7f6f84f7c" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:42.836956  9221 catalog_manager.cc:5697] T 63d5c2ea967a4c1586216c60202c5514 P ef5fe58eb3e04ae18fda957b4d507eff reported cstate change: term changed from 1 to 2, leader changed from 932245f14aac417f913cc7330a1833b8 (127.0.107.193) to ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195). New cstate: current_term: 2 leader_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:42.841548  9221 catalog_manager.cc:5697] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff reported cstate change: term changed from 1 to 2, leader changed from 932245f14aac417f913cc7330a1833b8 (127.0.107.193) to ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195). New cstate: current_term: 2 leader_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:42.865136 10131 tablet_bootstrap.cc:492] T 879fbf42aa3c4c21a58f094d1a2b91e7 P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:42.866279 10131 tablet_bootstrap.cc:492] T 879fbf42aa3c4c21a58f094d1a2b91e7 P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:42.869997 10131 ts_tablet_manager.cc:1403] T 879fbf42aa3c4c21a58f094d1a2b91e7 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.348s	user 0.040s	sys 0.052s
I20260709 13:04:42.873623 10131 raft_consensus.cc:359] T 879fbf42aa3c4c21a58f094d1a2b91e7 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:42.875247  9217 catalog_manager.cc:5697] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 reported cstate change: term changed from 1 to 2, leader changed from 932245f14aac417f913cc7330a1833b8 (127.0.107.193) to a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "a91e8b10a5984dec9d3777a7275cef49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:42.876145 10131 raft_consensus.cc:740] T 879fbf42aa3c4c21a58f094d1a2b91e7 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:42.876984 10131 consensus_queue.cc:260] T 879fbf42aa3c4c21a58f094d1a2b91e7 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:42.878459  9545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31d08e4168243f08eb2a31031a039ed" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:42.879087  9546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cfc1f2582a64d8dbc3f127e15024ec0" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:42.879576 10131 ts_tablet_manager.cc:1434] T 879fbf42aa3c4c21a58f094d1a2b91e7 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:04:42.879426  9542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8bd3f903abb4dd99431dbf597c0d462" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:42.880837 10131 tablet_bootstrap.cc:492] T 9a8ed4502cb447c7b2cb94c96dcb7daf P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:42.881810  9542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "803c43e83ee5487590c9d922559adc0f" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:42.883652  9542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90aae84687f41e99e58dada706ae2d7" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:42.885938  9542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97eecc3acdf46a5b5577416f7bfe336" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:42.887694  9542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b305803a339e40f99c1a6af7f6f84f7c" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
W20260709 13:04:42.893692  9512 consensus_peers.cc:597] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:42.899680 10128 leader_election.cc:304] T b31d08e4168243f08eb2a31031a039ed P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 932245f14aac417f913cc7330a1833b8; no voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:42.901486 10220 raft_consensus.cc:2749] T b31d08e4168243f08eb2a31031a039ed P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:42.904038 10128 leader_election.cc:304] T 5cfc1f2582a64d8dbc3f127e15024ec0 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 932245f14aac417f913cc7330a1833b8; no voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:42.905885 10220 raft_consensus.cc:2749] T 5cfc1f2582a64d8dbc3f127e15024ec0 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:42.907683 10128 leader_election.cc:304] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 932245f14aac417f913cc7330a1833b8; no voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:42.908951 10220 raft_consensus.cc:2749] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:42.914769 10128 leader_election.cc:304] T 803c43e83ee5487590c9d922559adc0f P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 932245f14aac417f913cc7330a1833b8; no voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:42.915740 10220 raft_consensus.cc:2749] T 803c43e83ee5487590c9d922559adc0f P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:42.918426 10128 leader_election.cc:304] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 932245f14aac417f913cc7330a1833b8; no voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:42.919873 10220 raft_consensus.cc:2749] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:42.924942 10131 tablet_bootstrap.cc:492] T 9a8ed4502cb447c7b2cb94c96dcb7daf P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:42.926198 10131 tablet_bootstrap.cc:492] T 9a8ed4502cb447c7b2cb94c96dcb7daf P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:42.926905 10131 ts_tablet_manager.cc:1403] T 9a8ed4502cb447c7b2cb94c96dcb7daf P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.046s	user 0.022s	sys 0.005s
I20260709 13:04:42.931780 10131 raft_consensus.cc:359] T 9a8ed4502cb447c7b2cb94c96dcb7daf P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:42.932511 10131 raft_consensus.cc:740] T 9a8ed4502cb447c7b2cb94c96dcb7daf P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:42.933418 10131 consensus_queue.cc:260] T 9a8ed4502cb447c7b2cb94c96dcb7daf P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:42.936209 10131 ts_tablet_manager.cc:1434] T 9a8ed4502cb447c7b2cb94c96dcb7daf P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:04:42.937942 10131 tablet_bootstrap.cc:492] T 6f213937fc9b4030a228a8e56ed80f52 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
W20260709 13:04:42.940006  9438 consensus_peers.cc:597] T 93877deb770d41a6ba34cefdea146d54 P ef5fe58eb3e04ae18fda957b4d507eff -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:42.940567  9438 consensus_peers.cc:597] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P ef5fe58eb3e04ae18fda957b4d507eff -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:42.951498  9438 consensus_peers.cc:597] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:42.952309  9438 consensus_peers.cc:597] T f3a3d4fd34924b7c8ed0df6709391329 P ef5fe58eb3e04ae18fda957b4d507eff -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:42.953634 10128 leader_election.cc:304] T e97eecc3acdf46a5b5577416f7bfe336 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 932245f14aac417f913cc7330a1833b8; no voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:42.955358 10220 raft_consensus.cc:2749] T e97eecc3acdf46a5b5577416f7bfe336 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:42.956019 10128 leader_election.cc:304] T b305803a339e40f99c1a6af7f6f84f7c P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 932245f14aac417f913cc7330a1833b8; no voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:42.957278 10220 raft_consensus.cc:2749] T b305803a339e40f99c1a6af7f6f84f7c P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:42.976251  9512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38559, user_credentials={real_user=slave}} blocked reactor thread for 58272.9us
I20260709 13:04:42.977533 10131 tablet_bootstrap.cc:492] T 6f213937fc9b4030a228a8e56ed80f52 P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:42.978611 10131 tablet_bootstrap.cc:492] T 6f213937fc9b4030a228a8e56ed80f52 P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:42.979316 10131 ts_tablet_manager.cc:1403] T 6f213937fc9b4030a228a8e56ed80f52 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.011s
I20260709 13:04:42.982949 10131 raft_consensus.cc:359] T 6f213937fc9b4030a228a8e56ed80f52 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:42.983659 10131 raft_consensus.cc:740] T 6f213937fc9b4030a228a8e56ed80f52 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:42.984527 10131 consensus_queue.cc:260] T 6f213937fc9b4030a228a8e56ed80f52 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:42.987609 10131 ts_tablet_manager.cc:1434] T 6f213937fc9b4030a228a8e56ed80f52 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:42.988693 10131 tablet_bootstrap.cc:492] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
W20260709 13:04:42.994443  9438 consensus_peers.cc:597] T e7d162d34de74e47895dac207e265059 P ef5fe58eb3e04ae18fda957b4d507eff -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:43.028914  9469 raft_consensus.cc:1275] T 58d4c6d168b449f98425d091c54cddb9 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Refusing update from remote peer a91e8b10a5984dec9d3777a7275cef49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:04:43.054283  9438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37633, user_credentials={real_user=slave}} blocked reactor thread for 59891.3us
I20260709 13:04:43.048190  9398 raft_consensus.cc:1275] T 63d5c2ea967a4c1586216c60202c5514 P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Refusing update from remote peer ef5fe58eb3e04ae18fda957b4d507eff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:04:43.055634  9512 consensus_peers.cc:597] T b31d08e4168243f08eb2a31031a039ed P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:43.056659 10164 consensus_queue.cc:1048] T 63d5c2ea967a4c1586216c60202c5514 P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:43.057323 10081 consensus_queue.cc:1048] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:43.066764 10220 raft_consensus.cc:493] T e7d162d34de74e47895dac207e265059 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:43.067626 10220 raft_consensus.cc:515] T e7d162d34de74e47895dac207e265059 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:43.070236 10220 leader_election.cc:290] T e7d162d34de74e47895dac207e265059 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:43.080341 10220 raft_consensus.cc:493] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:43.081137 10220 raft_consensus.cc:515] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:43.083863 10220 leader_election.cc:290] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:43.086702  9398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f012a5e95f4006871d83f7b18e356b" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:43.091382 10220 raft_consensus.cc:493] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:43.092176 10220 raft_consensus.cc:515] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:43.097729  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7d162d34de74e47895dac207e265059" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:43.101343 10220 leader_election.cc:290] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:43.101464  9398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5c2ea967a4c1586216c60202c5514" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
W20260709 13:04:43.106803  9512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37633, user_credentials={real_user=slave}} blocked reactor thread for 50605.2us
W20260709 13:04:43.115044  9512 consensus_peers.cc:597] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:43.118713  9398 raft_consensus.cc:1275] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Refusing update from remote peer ef5fe58eb3e04ae18fda957b4d507eff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:43.120182 10164 consensus_queue.cc:1048] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:43.125449  9364 consensus_peers.cc:597] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49 -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:43.148236  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5c2ea967a4c1586216c60202c5514" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
W20260709 13:04:43.149644  9438 consensus_peers.cc:597] T 63d5c2ea967a4c1586216c60202c5514 P ef5fe58eb3e04ae18fda957b4d507eff -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:43.151589  9364 consensus_peers.cc:597] T e97eecc3acdf46a5b5577416f7bfe336 P a91e8b10a5984dec9d3777a7275cef49 -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:43.154054  9364 consensus_peers.cc:597] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49 -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:43.159641 10220 raft_consensus.cc:493] T 73b8fed487d54513b9256d4c1a39cfa0 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:43.160414 10220 raft_consensus.cc:515] T 73b8fed487d54513b9256d4c1a39cfa0 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:43.165290 10220 leader_election.cc:290] T 73b8fed487d54513b9256d4c1a39cfa0 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:43.166203  9393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b8fed487d54513b9256d4c1a39cfa0" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:43.180531 10252 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:37633 every 8 connection(s)
I20260709 13:04:43.181818   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:37633
I20260709 13:04:43.186966  9393 raft_consensus.cc:1275] T 8c1e5b4bc1bc437884e6835b61227d4d P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Refusing update from remote peer ef5fe58eb3e04ae18fda957b4d507eff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:43.188862 10005 consensus_queue.cc:1048] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:43.192185 10128 leader_election.cc:304] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 932245f14aac417f913cc7330a1833b8; no voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:43.193634 10220 raft_consensus.cc:2749] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:43.194756  9512 consensus_peers.cc:597] T 17d57808c20741cd85b0e175935cdab7 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:43.197523  9512 consensus_peers.cc:597] T 803c43e83ee5487590c9d922559adc0f P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:43.227042  9469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b8fed487d54513b9256d4c1a39cfa0" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:43.227753  9542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7d162d34de74e47895dac207e265059" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:43.258387  9542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f012a5e95f4006871d83f7b18e356b" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:43.261560 10128 leader_election.cc:304] T 73b8fed487d54513b9256d4c1a39cfa0 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 932245f14aac417f913cc7330a1833b8; no voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:43.263010 10220 raft_consensus.cc:2749] T 73b8fed487d54513b9256d4c1a39cfa0 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:43.340960  9364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37633, user_credentials={real_user=slave}} blocked reactor thread for 71291.9us
W20260709 13:04:43.343959  9364 consensus_peers.cc:597] T 846ce8cad343420485af76370f029d54 P a91e8b10a5984dec9d3777a7275cef49 -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:43.344734  9364 consensus_peers.cc:597] T b94916f0e1e340a38f4a100f451fdaba P a91e8b10a5984dec9d3777a7275cef49 -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:43.352454 10128 leader_election.cc:304] T e7d162d34de74e47895dac207e265059 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 932245f14aac417f913cc7330a1833b8; no voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff
W20260709 13:04:43.341410 10254 log.cc:927] Time spent T 8c1e5b4bc1bc437884e6835b61227d4d P a91e8b10a5984dec9d3777a7275cef49: Append to log took a long time: real 0.139s	user 0.007s	sys 0.008s
I20260709 13:04:43.365197 10131 tablet_bootstrap.cc:492] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:43.366278 10131 tablet_bootstrap.cc:492] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:43.368661 10131 ts_tablet_manager.cc:1403] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.380s	user 0.064s	sys 0.098s
I20260709 13:04:43.371994 10220 raft_consensus.cc:2749] T e7d162d34de74e47895dac207e265059 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:43.378193  9364 consensus_peers.cc:597] T 1a5145e5f9a64fe0acdd74d909e841fc P a91e8b10a5984dec9d3777a7275cef49 -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:43.385634  9364 consensus_peers.cc:597] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:43.413043 10131 raft_consensus.cc:359] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:43.413681 10131 raft_consensus.cc:740] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:43.421515 10255 heartbeater.cc:344] Connected to a master server at 127.0.107.254:39947
I20260709 13:04:43.422080 10255 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:43.423158 10255 heartbeater.cc:507] Master 127.0.107.254:39947 requested a full tablet report, sending...
I20260709 13:04:43.425702 10131 consensus_queue.cc:260] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:43.432868  9546 raft_consensus.cc:1275] T 3c53f31a2697499cb5ad2d5bb6715f02 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Refusing update from remote peer a91e8b10a5984dec9d3777a7275cef49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:04:43.435140  9364 consensus_peers.cc:597] T ad58816d959840df923159e870cf4ad8 P a91e8b10a5984dec9d3777a7275cef49 -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:43.435956  9364 consensus_peers.cc:597] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49 -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:43.410440 10128 leader_election.cc:304] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 932245f14aac417f913cc7330a1833b8; no voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:43.436911 10220 raft_consensus.cc:2749] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:43.440608 10206 raft_consensus.cc:3060] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:43.441218  9510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33607, user_credentials={real_user=slave}} blocked reactor thread for 54846.3us
I20260709 13:04:43.444945 10220 raft_consensus.cc:493] T 774befa616254c02901f28edde6ab758 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:43.445523 10220 raft_consensus.cc:515] T 774befa616254c02901f28edde6ab758 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:43.448045 10220 leader_election.cc:290] T 774befa616254c02901f28edde6ab758 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
W20260709 13:04:43.450234  9364 consensus_peers.cc:597] T a8fbcbebcf87468f821e14a079bf305d P a91e8b10a5984dec9d3777a7275cef49 -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:43.451606  9398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "774befa616254c02901f28edde6ab758" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:43.452337 10208 consensus_queue.cc:1048] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:43.459827 10206 raft_consensus.cc:1275] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Refusing update from remote peer ef5fe58eb3e04ae18fda957b4d507eff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:43.462962 10205 raft_consensus.cc:3060] T 9a8ed4502cb447c7b2cb94c96dcb7daf P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.475178 10131 ts_tablet_manager.cc:1434] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.095s	user 0.010s	sys 0.000s
I20260709 13:04:43.476202 10131 tablet_bootstrap.cc:492] T 1a5145e5f9a64fe0acdd74d909e841fc P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:43.495587  9542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "774befa616254c02901f28edde6ab758" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:43.495795 10206 raft_consensus.cc:3060] T 8528ae822cb04615a9dbd1166b7d7328 P 932245f14aac417f913cc7330a1833b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:43.496977 10220 raft_consensus.cc:493] T 3bd9c3f12cc546ff905df61c5a9028f6 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:43.497565 10220 raft_consensus.cc:515] T 3bd9c3f12cc546ff905df61c5a9028f6 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:43.499924 10220 leader_election.cc:290] T 3bd9c3f12cc546ff905df61c5a9028f6 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:43.501250 10128 leader_election.cc:304] T 774befa616254c02901f28edde6ab758 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 932245f14aac417f913cc7330a1833b8; no voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf
W20260709 13:04:43.502321  9438 consensus_peers.cc:597] T 65ba9982e9bd4177995544e13394911a P ef5fe58eb3e04ae18fda957b4d507eff -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:43.503865 10220 raft_consensus.cc:2749] T 774befa616254c02901f28edde6ab758 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:43.508982 10029 consensus_queue.cc:1048] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff [LEADER]: Connected to new peer: Peer: permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:43.511067  9469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bd9c3f12cc546ff905df61c5a9028f6" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
W20260709 13:04:43.540589  9436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33607, user_credentials={real_user=slave}} blocked reactor thread for 64341.2us
W20260709 13:04:43.554060  9512 consensus_peers.cc:597] T 331d1446396c45ce9486793ecb5de7f7 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:43.554723  9546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bd9c3f12cc546ff905df61c5a9028f6" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:43.568718  9221 ts_manager.cc:194] Re-registered known tserver with Master: 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:43.583114 10131 tablet_bootstrap.cc:492] T 1a5145e5f9a64fe0acdd74d909e841fc P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:43.586689 10131 tablet_bootstrap.cc:492] T 1a5145e5f9a64fe0acdd74d909e841fc P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:43.587654 10131 ts_tablet_manager.cc:1403] T 1a5145e5f9a64fe0acdd74d909e841fc P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.112s	user 0.017s	sys 0.001s
W20260709 13:04:43.554776  9512 consensus_peers.cc:597] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:43.598294 10131 raft_consensus.cc:359] T 1a5145e5f9a64fe0acdd74d909e841fc P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:43.599123 10131 raft_consensus.cc:740] T 1a5145e5f9a64fe0acdd74d909e841fc P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:43.599887 10131 consensus_queue.cc:260] T 1a5145e5f9a64fe0acdd74d909e841fc P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:43.606683 10131 ts_tablet_manager.cc:1434] T 1a5145e5f9a64fe0acdd74d909e841fc P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:04:43.607754 10131 tablet_bootstrap.cc:492] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
W20260709 13:04:43.603327  9512 consensus_peers.cc:597] T b2a7ad91c8474397bae23c993b89fca4 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:43.611580  9512 consensus_peers.cc:597] T 225ca60d9645490dbcdcf6d4d127d955 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:43.636870  9364 consensus_peers.cc:597] T 7937a8107df4458ebd48b5ce1589d788 P a91e8b10a5984dec9d3777a7275cef49 -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:43.641726 10128 leader_election.cc:304] T 3bd9c3f12cc546ff905df61c5a9028f6 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 932245f14aac417f913cc7330a1833b8; no voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:43.642696 10220 raft_consensus.cc:2749] T 3bd9c3f12cc546ff905df61c5a9028f6 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:43.645462 10206 raft_consensus.cc:3060] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.692521 10131 tablet_bootstrap.cc:492] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:43.694375 10205 raft_consensus.cc:3060] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.696556 10131 tablet_bootstrap.cc:492] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:43.697798 10131 ts_tablet_manager.cc:1403] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.090s	user 0.017s	sys 0.003s
I20260709 13:04:43.701658 10131 raft_consensus.cc:359] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:43.702668 10131 raft_consensus.cc:740] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:43.709326 10131 consensus_queue.cc:260] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:43.720265 10131 ts_tablet_manager.cc:1434] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:04:43.724244 10131 tablet_bootstrap.cc:492] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:43.772179 10131 tablet_bootstrap.cc:492] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:43.775102 10131 tablet_bootstrap.cc:492] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:43.775810  9221 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50656
I20260709 13:04:43.775863 10131 ts_tablet_manager.cc:1403] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.052s	user 0.020s	sys 0.017s
I20260709 13:04:43.780174 10131 raft_consensus.cc:359] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:43.780916 10131 raft_consensus.cc:740] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:43.781471 10255 heartbeater.cc:499] Master 127.0.107.254:39947 was elected leader, sending a full tablet report...
I20260709 13:04:43.781741 10131 consensus_queue.cc:260] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:43.783996 10131 ts_tablet_manager.cc:1434] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:04:43.788066 10131 tablet_bootstrap.cc:492] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:43.816082 10131 tablet_bootstrap.cc:492] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:43.817255 10131 tablet_bootstrap.cc:492] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:43.818185 10131 ts_tablet_manager.cc:1403] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.031s	user 0.023s	sys 0.001s
I20260709 13:04:43.821272 10131 raft_consensus.cc:359] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:43.822116 10131 raft_consensus.cc:740] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:43.822989 10131 consensus_queue.cc:260] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:43.825456 10131 ts_tablet_manager.cc:1434] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:43.826320 10131 tablet_bootstrap.cc:492] T ad58816d959840df923159e870cf4ad8 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:43.843696 10131 tablet_bootstrap.cc:492] T ad58816d959840df923159e870cf4ad8 P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:43.844766 10131 tablet_bootstrap.cc:492] T ad58816d959840df923159e870cf4ad8 P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:43.847011 10131 ts_tablet_manager.cc:1403] T ad58816d959840df923159e870cf4ad8 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.003s
I20260709 13:04:43.849716 10131 raft_consensus.cc:359] T ad58816d959840df923159e870cf4ad8 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:43.850494 10131 raft_consensus.cc:740] T ad58816d959840df923159e870cf4ad8 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:43.851457 10131 consensus_queue.cc:260] T ad58816d959840df923159e870cf4ad8 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:43.853894 10131 ts_tablet_manager.cc:1434] T ad58816d959840df923159e870cf4ad8 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:43.854646 10131 tablet_bootstrap.cc:492] T a8fbcbebcf87468f821e14a079bf305d P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:43.866109 10206 raft_consensus.cc:3060] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.869989 10131 tablet_bootstrap.cc:492] T a8fbcbebcf87468f821e14a079bf305d P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:43.871080 10131 tablet_bootstrap.cc:492] T a8fbcbebcf87468f821e14a079bf305d P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:43.871842 10131 ts_tablet_manager.cc:1403] T a8fbcbebcf87468f821e14a079bf305d P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.007s
I20260709 13:04:43.874641 10131 raft_consensus.cc:359] T a8fbcbebcf87468f821e14a079bf305d P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:43.875334 10131 raft_consensus.cc:740] T a8fbcbebcf87468f821e14a079bf305d P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:43.903321 10131 consensus_queue.cc:260] T a8fbcbebcf87468f821e14a079bf305d P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:43.905140 10131 ts_tablet_manager.cc:1434] T a8fbcbebcf87468f821e14a079bf305d P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 13:04:43.908998 10131 tablet_bootstrap.cc:492] T ff040bb60327424d8aeec71e3bf58a0a P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:43.940733 10131 tablet_bootstrap.cc:492] T ff040bb60327424d8aeec71e3bf58a0a P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:43.941762 10131 tablet_bootstrap.cc:492] T ff040bb60327424d8aeec71e3bf58a0a P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:43.942428 10131 ts_tablet_manager.cc:1403] T ff040bb60327424d8aeec71e3bf58a0a P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.007s
I20260709 13:04:43.944980 10131 raft_consensus.cc:359] T ff040bb60327424d8aeec71e3bf58a0a P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:43.945612 10131 raft_consensus.cc:740] T ff040bb60327424d8aeec71e3bf58a0a P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:43.946286 10131 consensus_queue.cc:260] T ff040bb60327424d8aeec71e3bf58a0a P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:43.947891 10131 ts_tablet_manager.cc:1434] T ff040bb60327424d8aeec71e3bf58a0a P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:43.948617 10131 tablet_bootstrap.cc:492] T 8dfdb24cbc824b95ac65712323103e2a P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:43.975057 10131 tablet_bootstrap.cc:492] T 8dfdb24cbc824b95ac65712323103e2a P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:43.976331 10131 tablet_bootstrap.cc:492] T 8dfdb24cbc824b95ac65712323103e2a P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:43.977296 10131 ts_tablet_manager.cc:1403] T 8dfdb24cbc824b95ac65712323103e2a P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.008s
I20260709 13:04:43.980579 10131 raft_consensus.cc:359] T 8dfdb24cbc824b95ac65712323103e2a P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:43.981716 10131 raft_consensus.cc:740] T 8dfdb24cbc824b95ac65712323103e2a P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:43.982498 10131 consensus_queue.cc:260] T 8dfdb24cbc824b95ac65712323103e2a P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:43.984596 10131 ts_tablet_manager.cc:1434] T 8dfdb24cbc824b95ac65712323103e2a P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:43.985458 10131 tablet_bootstrap.cc:492] T f3a3d4fd34924b7c8ed0df6709391329 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:44.006094 10131 tablet_bootstrap.cc:492] T f3a3d4fd34924b7c8ed0df6709391329 P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:44.007198 10131 tablet_bootstrap.cc:492] T f3a3d4fd34924b7c8ed0df6709391329 P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:44.008006 10131 ts_tablet_manager.cc:1403] T f3a3d4fd34924b7c8ed0df6709391329 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.004s
I20260709 13:04:44.010649 10131 raft_consensus.cc:359] T f3a3d4fd34924b7c8ed0df6709391329 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:44.011659 10131 raft_consensus.cc:740] T f3a3d4fd34924b7c8ed0df6709391329 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:44.012470 10131 consensus_queue.cc:260] T f3a3d4fd34924b7c8ed0df6709391329 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:44.014752 10131 ts_tablet_manager.cc:1434] T f3a3d4fd34924b7c8ed0df6709391329 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:04:44.015501 10131 tablet_bootstrap.cc:492] T a25f8459a3644bfcaf8f9d71705b1c33 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:44.039625 10131 tablet_bootstrap.cc:492] T a25f8459a3644bfcaf8f9d71705b1c33 P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:44.040537 10131 tablet_bootstrap.cc:492] T a25f8459a3644bfcaf8f9d71705b1c33 P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:44.041198 10131 ts_tablet_manager.cc:1403] T a25f8459a3644bfcaf8f9d71705b1c33 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.008s
I20260709 13:04:44.043387 10131 raft_consensus.cc:359] T a25f8459a3644bfcaf8f9d71705b1c33 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:44.044070 10131 raft_consensus.cc:740] T a25f8459a3644bfcaf8f9d71705b1c33 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:44.045322 10131 consensus_queue.cc:260] T a25f8459a3644bfcaf8f9d71705b1c33 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:44.048235 10131 ts_tablet_manager.cc:1434] T a25f8459a3644bfcaf8f9d71705b1c33 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:04:44.049032 10131 tablet_bootstrap.cc:492] T a55798aa4230462f9befe5d7fc9bd3ce P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:44.065474 10206 raft_consensus.cc:3060] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:44.067592 10131 tablet_bootstrap.cc:492] T a55798aa4230462f9befe5d7fc9bd3ce P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:44.068485 10131 tablet_bootstrap.cc:492] T a55798aa4230462f9befe5d7fc9bd3ce P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:44.069067 10131 ts_tablet_manager.cc:1403] T a55798aa4230462f9befe5d7fc9bd3ce P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.000s
I20260709 13:04:44.071245 10131 raft_consensus.cc:359] T a55798aa4230462f9befe5d7fc9bd3ce P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:44.071858 10131 raft_consensus.cc:740] T a55798aa4230462f9befe5d7fc9bd3ce P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:44.072395 10131 consensus_queue.cc:260] T a55798aa4230462f9befe5d7fc9bd3ce P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:44.074594 10131 ts_tablet_manager.cc:1434] T a55798aa4230462f9befe5d7fc9bd3ce P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:44.075510 10131 tablet_bootstrap.cc:492] T b2a7ad91c8474397bae23c993b89fca4 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:44.094198 10131 tablet_bootstrap.cc:492] T b2a7ad91c8474397bae23c993b89fca4 P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:44.095229 10131 tablet_bootstrap.cc:492] T b2a7ad91c8474397bae23c993b89fca4 P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:44.095947 10131 ts_tablet_manager.cc:1403] T b2a7ad91c8474397bae23c993b89fca4 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 13:04:44.099128 10131 raft_consensus.cc:359] T b2a7ad91c8474397bae23c993b89fca4 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:44.099933 10131 raft_consensus.cc:740] T b2a7ad91c8474397bae23c993b89fca4 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:44.100695 10131 consensus_queue.cc:260] T b2a7ad91c8474397bae23c993b89fca4 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:44.103039 10131 ts_tablet_manager.cc:1434] T b2a7ad91c8474397bae23c993b89fca4 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:04:44.104249 10131 tablet_bootstrap.cc:492] T 93877deb770d41a6ba34cefdea146d54 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:44.120128 10131 tablet_bootstrap.cc:492] T 93877deb770d41a6ba34cefdea146d54 P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:44.120931 10131 tablet_bootstrap.cc:492] T 93877deb770d41a6ba34cefdea146d54 P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:44.121565 10131 ts_tablet_manager.cc:1403] T 93877deb770d41a6ba34cefdea146d54 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.007s
I20260709 13:04:44.124141 10131 raft_consensus.cc:359] T 93877deb770d41a6ba34cefdea146d54 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:44.125248 10131 raft_consensus.cc:740] T 93877deb770d41a6ba34cefdea146d54 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:44.126078 10131 consensus_queue.cc:260] T 93877deb770d41a6ba34cefdea146d54 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:44.128646 10131 ts_tablet_manager.cc:1434] T 93877deb770d41a6ba34cefdea146d54 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:04:44.130163 10131 tablet_bootstrap.cc:492] T b94916f0e1e340a38f4a100f451fdaba P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:44.146318 10131 tablet_bootstrap.cc:492] T b94916f0e1e340a38f4a100f451fdaba P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:44.147576 10131 tablet_bootstrap.cc:492] T b94916f0e1e340a38f4a100f451fdaba P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:44.148227 10131 ts_tablet_manager.cc:1403] T b94916f0e1e340a38f4a100f451fdaba P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 13:04:44.151082 10131 raft_consensus.cc:359] T b94916f0e1e340a38f4a100f451fdaba P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:44.151682 10131 raft_consensus.cc:740] T b94916f0e1e340a38f4a100f451fdaba P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:44.152326 10131 consensus_queue.cc:260] T b94916f0e1e340a38f4a100f451fdaba P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:44.154137 10131 ts_tablet_manager.cc:1434] T b94916f0e1e340a38f4a100f451fdaba P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:04:44.155905 10131 tablet_bootstrap.cc:492] T 7937a8107df4458ebd48b5ce1589d788 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:44.171062 10131 tablet_bootstrap.cc:492] T 7937a8107df4458ebd48b5ce1589d788 P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:44.172405 10131 tablet_bootstrap.cc:492] T 7937a8107df4458ebd48b5ce1589d788 P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:44.173185 10131 ts_tablet_manager.cc:1403] T 7937a8107df4458ebd48b5ce1589d788 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 13:04:44.176381 10131 raft_consensus.cc:359] T 7937a8107df4458ebd48b5ce1589d788 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:44.177058 10131 raft_consensus.cc:740] T 7937a8107df4458ebd48b5ce1589d788 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:44.177677 10131 consensus_queue.cc:260] T 7937a8107df4458ebd48b5ce1589d788 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:44.179316 10131 ts_tablet_manager.cc:1434] T 7937a8107df4458ebd48b5ce1589d788 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:04:44.180490 10131 tablet_bootstrap.cc:492] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:44.197597 10131 tablet_bootstrap.cc:492] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:44.198450 10131 tablet_bootstrap.cc:492] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:44.199019 10131 ts_tablet_manager.cc:1403] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:04:44.201448 10131 raft_consensus.cc:359] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:44.201968 10131 raft_consensus.cc:740] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:44.202498 10131 consensus_queue.cc:260] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:44.203935 10131 ts_tablet_manager.cc:1434] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:44.204730 10131 tablet_bootstrap.cc:492] T 331d1446396c45ce9486793ecb5de7f7 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:44.224229 10131 tablet_bootstrap.cc:492] T 331d1446396c45ce9486793ecb5de7f7 P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:44.225354 10131 tablet_bootstrap.cc:492] T 331d1446396c45ce9486793ecb5de7f7 P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:44.227015 10131 ts_tablet_manager.cc:1403] T 331d1446396c45ce9486793ecb5de7f7 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.007s
I20260709 13:04:44.229584 10131 raft_consensus.cc:359] T 331d1446396c45ce9486793ecb5de7f7 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:44.230293 10131 raft_consensus.cc:740] T 331d1446396c45ce9486793ecb5de7f7 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:44.231016 10131 consensus_queue.cc:260] T 331d1446396c45ce9486793ecb5de7f7 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:44.232568 10131 ts_tablet_manager.cc:1434] T 331d1446396c45ce9486793ecb5de7f7 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 13:04:44.233417 10131 tablet_bootstrap.cc:492] T 93a7d590cbac4b6da413dd8ea2a26225 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:44.260807 10131 tablet_bootstrap.cc:492] T 93a7d590cbac4b6da413dd8ea2a26225 P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:44.261786 10131 tablet_bootstrap.cc:492] T 93a7d590cbac4b6da413dd8ea2a26225 P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:44.262492 10131 ts_tablet_manager.cc:1403] T 93a7d590cbac4b6da413dd8ea2a26225 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.029s	user 0.021s	sys 0.004s
I20260709 13:04:44.265447 10131 raft_consensus.cc:359] T 93a7d590cbac4b6da413dd8ea2a26225 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:44.266173 10131 raft_consensus.cc:740] T 93a7d590cbac4b6da413dd8ea2a26225 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:44.267215 10131 consensus_queue.cc:260] T 93a7d590cbac4b6da413dd8ea2a26225 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:44.269701 10131 ts_tablet_manager.cc:1434] T 93a7d590cbac4b6da413dd8ea2a26225 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:44.270502 10131 tablet_bootstrap.cc:492] T 17d57808c20741cd85b0e175935cdab7 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:44.287587 10131 tablet_bootstrap.cc:492] T 17d57808c20741cd85b0e175935cdab7 P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:44.288630 10131 tablet_bootstrap.cc:492] T 17d57808c20741cd85b0e175935cdab7 P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:44.289348 10131 ts_tablet_manager.cc:1403] T 17d57808c20741cd85b0e175935cdab7 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.006s
I20260709 13:04:44.291993 10131 raft_consensus.cc:359] T 17d57808c20741cd85b0e175935cdab7 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:44.292691 10131 raft_consensus.cc:740] T 17d57808c20741cd85b0e175935cdab7 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:44.293380 10131 consensus_queue.cc:260] T 17d57808c20741cd85b0e175935cdab7 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:44.295775 10131 ts_tablet_manager.cc:1434] T 17d57808c20741cd85b0e175935cdab7 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:44.302323 10131 tablet_bootstrap.cc:492] T 846ce8cad343420485af76370f029d54 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:44.319689 10131 tablet_bootstrap.cc:492] T 846ce8cad343420485af76370f029d54 P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:44.320681 10131 tablet_bootstrap.cc:492] T 846ce8cad343420485af76370f029d54 P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:44.321528 10131 ts_tablet_manager.cc:1403] T 846ce8cad343420485af76370f029d54 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 13:04:44.325631 10131 raft_consensus.cc:359] T 846ce8cad343420485af76370f029d54 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:44.327092 10131 raft_consensus.cc:740] T 846ce8cad343420485af76370f029d54 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:44.327903 10131 consensus_queue.cc:260] T 846ce8cad343420485af76370f029d54 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:44.329922 10131 ts_tablet_manager.cc:1434] T 846ce8cad343420485af76370f029d54 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:04:44.330653 10131 tablet_bootstrap.cc:492] T 225ca60d9645490dbcdcf6d4d127d955 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:44.345790 10131 tablet_bootstrap.cc:492] T 225ca60d9645490dbcdcf6d4d127d955 P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:44.346830 10131 tablet_bootstrap.cc:492] T 225ca60d9645490dbcdcf6d4d127d955 P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:44.347537 10131 ts_tablet_manager.cc:1403] T 225ca60d9645490dbcdcf6d4d127d955 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.001s
I20260709 13:04:44.350077 10131 raft_consensus.cc:359] T 225ca60d9645490dbcdcf6d4d127d955 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:44.350625 10131 raft_consensus.cc:740] T 225ca60d9645490dbcdcf6d4d127d955 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:44.351289 10131 consensus_queue.cc:260] T 225ca60d9645490dbcdcf6d4d127d955 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:44.353073 10131 ts_tablet_manager.cc:1434] T 225ca60d9645490dbcdcf6d4d127d955 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:44.354542 10131 tablet_bootstrap.cc:492] T a792fefbeb0c4eb79e87501fb6dbe780 P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:44.371553 10131 tablet_bootstrap.cc:492] T a792fefbeb0c4eb79e87501fb6dbe780 P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:44.373106 10131 tablet_bootstrap.cc:492] T a792fefbeb0c4eb79e87501fb6dbe780 P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:44.374231 10131 ts_tablet_manager.cc:1403] T a792fefbeb0c4eb79e87501fb6dbe780 P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.003s
I20260709 13:04:44.376739 10131 raft_consensus.cc:359] T a792fefbeb0c4eb79e87501fb6dbe780 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:44.377466 10131 raft_consensus.cc:740] T a792fefbeb0c4eb79e87501fb6dbe780 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:44.378080 10131 consensus_queue.cc:260] T a792fefbeb0c4eb79e87501fb6dbe780 P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:44.379987 10131 ts_tablet_manager.cc:1434] T a792fefbeb0c4eb79e87501fb6dbe780 P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:04:44.381182 10131 tablet_bootstrap.cc:492] T 8f602c194d1c445ba1851f0a2272b40b P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:44.386445 10205 raft_consensus.cc:3060] T 93a7d590cbac4b6da413dd8ea2a26225 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:44.413735 10206 raft_consensus.cc:3060] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:44.437901 10131 tablet_bootstrap.cc:492] T 8f602c194d1c445ba1851f0a2272b40b P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:44.439162 10131 tablet_bootstrap.cc:492] T 8f602c194d1c445ba1851f0a2272b40b P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:44.439906 10131 ts_tablet_manager.cc:1403] T 8f602c194d1c445ba1851f0a2272b40b P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.059s	user 0.032s	sys 0.024s
I20260709 13:04:44.444057 10131 raft_consensus.cc:359] T 8f602c194d1c445ba1851f0a2272b40b P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:44.445067 10131 raft_consensus.cc:740] T 8f602c194d1c445ba1851f0a2272b40b P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:44.445818 10131 consensus_queue.cc:260] T 8f602c194d1c445ba1851f0a2272b40b P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:44.454906 10131 ts_tablet_manager.cc:1434] T 8f602c194d1c445ba1851f0a2272b40b P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:04:44.455785 10131 tablet_bootstrap.cc:492] T 65ba9982e9bd4177995544e13394911a P 932245f14aac417f913cc7330a1833b8: Bootstrap starting.
I20260709 13:04:44.494278 10131 tablet_bootstrap.cc:492] T 65ba9982e9bd4177995544e13394911a P 932245f14aac417f913cc7330a1833b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:44.495368 10131 tablet_bootstrap.cc:492] T 65ba9982e9bd4177995544e13394911a P 932245f14aac417f913cc7330a1833b8: Bootstrap complete.
I20260709 13:04:44.496068 10131 ts_tablet_manager.cc:1403] T 65ba9982e9bd4177995544e13394911a P 932245f14aac417f913cc7330a1833b8: Time spent bootstrapping tablet: real 0.040s	user 0.026s	sys 0.002s
I20260709 13:04:44.498874 10131 raft_consensus.cc:359] T 65ba9982e9bd4177995544e13394911a P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:44.499595 10131 raft_consensus.cc:740] T 65ba9982e9bd4177995544e13394911a P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Initialized, Role: FOLLOWER
I20260709 13:04:44.500324 10131 consensus_queue.cc:260] T 65ba9982e9bd4177995544e13394911a P 932245f14aac417f913cc7330a1833b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:44.503008 10131 ts_tablet_manager.cc:1434] T 65ba9982e9bd4177995544e13394911a P 932245f14aac417f913cc7330a1833b8: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
W20260709 13:04:47.445894  9363 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.003s	sys 0.013s
W20260709 13:04:47.446389  9363 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.003s	sys 0.013s
W20260709 13:04:47.451964  9361 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.006s	sys 0.009s
W20260709 13:04:47.452397  9361 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.006s	sys 0.009s
I20260709 13:04:47.579905 10315 raft_consensus.cc:493] T 01a5f4a59c5e47bc8b7b11db44d80006 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dfbbb80ab8e345e0ae1684fafefceccf)
W20260709 13:04:47.595350  9509 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.854s	user 0.009s	sys 0.011s
W20260709 13:04:47.595870  9509 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.009s	sys 0.011s
I20260709 13:04:47.620378 10180 raft_consensus.cc:493] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef5fe58eb3e04ae18fda957b4d507eff)
I20260709 13:04:47.620850 10180 raft_consensus.cc:515] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:47.592434 10315 raft_consensus.cc:515] T 01a5f4a59c5e47bc8b7b11db44d80006 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:47.635416 10180 leader_election.cc:290] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:47.649953 10206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5b6e6fcfb04bc3bb6cc0270e14e0cd" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:47.662029 10315 leader_election.cc:290] T 01a5f4a59c5e47bc8b7b11db44d80006 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:47.670712  9544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a5f4a59c5e47bc8b7b11db44d80006" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
W20260709 13:04:47.677210  9510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.971s	user 0.002s	sys 0.015s
W20260709 13:04:47.677760  9510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.002s	sys 0.015s
I20260709 13:04:47.694715 10180 raft_consensus.cc:493] T 879fbf42aa3c4c21a58f094d1a2b91e7 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef5fe58eb3e04ae18fda957b4d507eff)
I20260709 13:04:47.698532 10322 raft_consensus.cc:493] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a91e8b10a5984dec9d3777a7275cef49)
I20260709 13:04:47.717540 10180 raft_consensus.cc:515] T 879fbf42aa3c4c21a58f094d1a2b91e7 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
W20260709 13:04:47.719832  9512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37633, user_credentials={real_user=slave}} blocked reactor thread for 48318.4us
I20260709 13:04:47.720880 10322 raft_consensus.cc:515] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:47.723172 10322 leader_election.cc:290] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:47.728433 10180 leader_election.cc:290] T 879fbf42aa3c4c21a58f094d1a2b91e7 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:47.733954 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879fbf42aa3c4c21a58f094d1a2b91e7" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:47.734308 10315 raft_consensus.cc:493] T ab069642e354446db85dabd0cedd7eec P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef5fe58eb3e04ae18fda957b4d507eff)
I20260709 13:04:47.747421 10315 raft_consensus.cc:515] T ab069642e354446db85dabd0cedd7eec P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:47.750489 10315 leader_election.cc:290] T ab069642e354446db85dabd0cedd7eec P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:47.765175  9544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab069642e354446db85dabd0cedd7eec" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:47.742434 10322 raft_consensus.cc:493] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dfbbb80ab8e345e0ae1684fafefceccf)
I20260709 13:04:47.768859 10315 raft_consensus.cc:493] T 63d5c2ea967a4c1586216c60202c5514 P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef5fe58eb3e04ae18fda957b4d507eff)
I20260709 13:04:47.769603 10315 raft_consensus.cc:515] T 63d5c2ea967a4c1586216c60202c5514 P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:47.768724 10322 raft_consensus.cc:515] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:47.770548  9394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d4c6d168b449f98425d091c54cddb9" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:47.773691 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5c2ea967a4c1586216c60202c5514" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:47.774016 10322 leader_election.cc:290] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:47.780532 10315 leader_election.cc:290] T 63d5c2ea967a4c1586216c60202c5514 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:47.768746  9397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57570 (request call id 290) took 1085 ms. Trace:
I20260709 13:04:47.782774  9397 rpcz_store.cc:276] 0709 13:04:46.683262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:47.767381 (+1084119us) service_pool.cc:224] Handling call
0709 13:04:47.767908 (+   527us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:47.768157 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:47.768195 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:47.768363 (+   168us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:04:47.768421 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:47.768507 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:47.768670 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:47.787946  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d4c6d168b449f98425d091c54cddb9" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
W20260709 13:04:47.791424  9512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37633, user_credentials={real_user=slave}} blocked reactor thread for 49877.2us
I20260709 13:04:47.793120  9469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8bd3f903abb4dd99431dbf597c0d462" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:47.793721 10315 raft_consensus.cc:493] T faf56b218e614e51962171088f3c4f63 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef5fe58eb3e04ae18fda957b4d507eff)
I20260709 13:04:47.794677 10315 raft_consensus.cc:515] T faf56b218e614e51962171088f3c4f63 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:47.804914 10326 raft_consensus.cc:493] T 99fc4b4b16d0432390a92d5c04149ce1 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a91e8b10a5984dec9d3777a7275cef49)
I20260709 13:04:47.807739 10326 raft_consensus.cc:515] T 99fc4b4b16d0432390a92d5c04149ce1 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:47.805826 10200 raft_consensus.cc:493] T 9b19e51cda7e44e5a1f02a736e555ac4 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a91e8b10a5984dec9d3777a7275cef49)
I20260709 13:04:47.789619 10322 raft_consensus.cc:493] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef5fe58eb3e04ae18fda957b4d507eff)
I20260709 13:04:47.812711 10315 leader_election.cc:290] T faf56b218e614e51962171088f3c4f63 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:47.813350 10326 leader_election.cc:290] T 99fc4b4b16d0432390a92d5c04149ce1 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:47.813829  9544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf56b218e614e51962171088f3c4f63" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:47.809384 10200 raft_consensus.cc:515] T 9b19e51cda7e44e5a1f02a736e555ac4 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:47.810024 10329 raft_consensus.cc:493] T e7d162d34de74e47895dac207e265059 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef5fe58eb3e04ae18fda957b4d507eff)
I20260709 13:04:47.823207  9397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99fc4b4b16d0432390a92d5c04149ce1" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:47.821697 10200 leader_election.cc:290] T 9b19e51cda7e44e5a1f02a736e555ac4 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:47.822572 10329 raft_consensus.cc:515] T e7d162d34de74e47895dac207e265059 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:47.822561 10328 raft_consensus.cc:493] T f3a3d4fd34924b7c8ed0df6709391329 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef5fe58eb3e04ae18fda957b4d507eff)
I20260709 13:04:47.825937 10322 raft_consensus.cc:515] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:47.839089 10128 leader_election.cc:304] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 932245f14aac417f913cc7330a1833b8; no voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:47.833698 10328 raft_consensus.cc:515] T f3a3d4fd34924b7c8ed0df6709391329 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:47.852638  9397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99d222cbc8341f7ac9a4b2e7eb7e5f0" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:47.853703 10318 raft_consensus.cc:493] T 85d647b0abf74fbebc7e9a9bfe14b8ea P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a91e8b10a5984dec9d3777a7275cef49)
I20260709 13:04:47.854465 10329 leader_election.cc:290] T e7d162d34de74e47895dac207e265059 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:47.854315 10318 raft_consensus.cc:515] T 85d647b0abf74fbebc7e9a9bfe14b8ea P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:47.856637 10318 leader_election.cc:290] T 85d647b0abf74fbebc7e9a9bfe14b8ea P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:47.861893 10322 leader_election.cc:290] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:47.862825 10322 raft_consensus.cc:2749] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:47.865221 10328 leader_election.cc:290] T f3a3d4fd34924b7c8ed0df6709391329 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:04:47.870081  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99d222cbc8341f7ac9a4b2e7eb7e5f0" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:47.875857  9545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85d647b0abf74fbebc7e9a9bfe14b8ea" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:47.876513  9539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19e51cda7e44e5a1f02a736e555ac4" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:47.880977  9537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99fc4b4b16d0432390a92d5c04149ce1" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:47.881449 10128 leader_election.cc:304] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 932245f14aac417f913cc7330a1833b8; no voters: a91e8b10a5984dec9d3777a7275cef49, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:47.882620 10334 raft_consensus.cc:2749] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:47.885305  9544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8bd3f903abb4dd99431dbf597c0d462" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" is_pre_election: true
I20260709 13:04:47.888000 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7d162d34de74e47895dac207e265059" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:47.894762  9471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5b6e6fcfb04bc3bb6cc0270e14e0cd" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:47.895998 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3a3d4fd34924b7c8ed0df6709391329" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "932245f14aac417f913cc7330a1833b8" is_pre_election: true
I20260709 13:04:47.904415  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a5f4a59c5e47bc8b7b11db44d80006" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:47.905885 10128 leader_election.cc:304] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 932245f14aac417f913cc7330a1833b8; no voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:47.906934 10334 raft_consensus.cc:2749] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:47.907342  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879fbf42aa3c4c21a58f094d1a2b91e7" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:47.912151  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab069642e354446db85dabd0cedd7eec" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:47.916846  9472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5c2ea967a4c1586216c60202c5514" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:47.917044  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf56b218e614e51962171088f3c4f63" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
W20260709 13:04:47.919607  9436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33607, user_credentials={real_user=slave}} blocked reactor thread for 74434.8us
I20260709 13:04:47.922946  9364 leader_election.cc:304] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49; no voters: 932245f14aac417f913cc7330a1833b8, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:47.924345  9436 leader_election.cc:304] T 99fc4b4b16d0432390a92d5c04149ce1 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef5fe58eb3e04ae18fda957b4d507eff; no voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:47.925551 10311 raft_consensus.cc:2749] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:47.926278 10335 raft_consensus.cc:2749] T 99fc4b4b16d0432390a92d5c04149ce1 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:47.927378  9364 leader_election.cc:304] T 01a5f4a59c5e47bc8b7b11db44d80006 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49; no voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:47.928387 10180 raft_consensus.cc:2749] T 01a5f4a59c5e47bc8b7b11db44d80006 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:47.928817  9364 leader_election.cc:304] T 879fbf42aa3c4c21a58f094d1a2b91e7 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49; no voters: 932245f14aac417f913cc7330a1833b8, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:47.929725 10180 raft_consensus.cc:2749] T 879fbf42aa3c4c21a58f094d1a2b91e7 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:47.930742  9397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19e51cda7e44e5a1f02a736e555ac4" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:47.932333  9396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85d647b0abf74fbebc7e9a9bfe14b8ea" candidate_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a91e8b10a5984dec9d3777a7275cef49" is_pre_election: true
I20260709 13:04:47.935256  9469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7d162d34de74e47895dac207e265059" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:47.937098  9469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3a3d4fd34924b7c8ed0df6709391329" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" is_pre_election: true
I20260709 13:04:47.940074  9364 leader_election.cc:304] T ab069642e354446db85dabd0cedd7eec P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49; no voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:47.941519  9436 leader_election.cc:304] T 9b19e51cda7e44e5a1f02a736e555ac4 P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef5fe58eb3e04ae18fda957b4d507eff; no voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:47.941707  9512 leader_election.cc:304] T e7d162d34de74e47895dac207e265059 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf; no voters: 932245f14aac417f913cc7330a1833b8, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:47.942586 10335 raft_consensus.cc:2749] T 9b19e51cda7e44e5a1f02a736e555ac4 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:47.942880 10311 raft_consensus.cc:2749] T ab069642e354446db85dabd0cedd7eec P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:47.943524  9436 leader_election.cc:304] T 85d647b0abf74fbebc7e9a9bfe14b8ea P ef5fe58eb3e04ae18fda957b4d507eff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef5fe58eb3e04ae18fda957b4d507eff; no voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:47.943714 10328 raft_consensus.cc:2749] T e7d162d34de74e47895dac207e265059 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:47.944615 10335 raft_consensus.cc:2749] T 85d647b0abf74fbebc7e9a9bfe14b8ea P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:47.945046  9364 leader_election.cc:304] T faf56b218e614e51962171088f3c4f63 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49; no voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:47.946478 10311 raft_consensus.cc:2749] T faf56b218e614e51962171088f3c4f63 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:47.949554  9512 leader_election.cc:304] T f3a3d4fd34924b7c8ed0df6709391329 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf; no voters: 932245f14aac417f913cc7330a1833b8, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:47.950385 10328 raft_consensus.cc:2749] T f3a3d4fd34924b7c8ed0df6709391329 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:47.948455  9364 leader_election.cc:304] T 63d5c2ea967a4c1586216c60202c5514 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49; no voters: 932245f14aac417f913cc7330a1833b8, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:47.954644 10311 raft_consensus.cc:2749] T 63d5c2ea967a4c1586216c60202c5514 P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:04:48.239818  9252 debug-util.cc:398] Leaking SignalData structure 0x7b08000e36e0 after lost signal to thread 434
W20260709 13:04:48.241112  9252 debug-util.cc:398] Leaking SignalData structure 0x7b0800301340 after lost signal to thread 9255
W20260709 13:04:48.242545  9252 debug-util.cc:398] Leaking SignalData structure 0x7b08001c6de0 after lost signal to thread 9422
W20260709 13:04:48.243794  9252 debug-util.cc:398] Leaking SignalData structure 0x7b080021da20 after lost signal to thread 9496
W20260709 13:04:48.245047  9252 debug-util.cc:398] Leaking SignalData structure 0x7b08003d8480 after lost signal to thread 9570
W20260709 13:04:48.246416  9252 debug-util.cc:398] Leaking SignalData structure 0x7b080030b660 after lost signal to thread 10252
W20260709 13:04:52.288501  9364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37633, user_credentials={real_user=slave}} blocked reactor thread for 46438.5us
I20260709 13:04:53.253567   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:53.319751  9395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c53f31a2697499cb5ad2d5bb6715f02"
dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
mode: GRACEFUL
new_leader_uuid: "932245f14aac417f913cc7330a1833b8"
 from {username='slave'} at 127.0.0.1:39432
I20260709 13:04:53.320505  9395 raft_consensus.cc:606] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 [term 2 LEADER]: Received request to transfer leadership to TS 932245f14aac417f913cc7330a1833b8
I20260709 13:04:53.338784  9472 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c1e5b4bc1bc437884e6835b61227d4d"
dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
mode: GRACEFUL
new_leader_uuid: "932245f14aac417f913cc7330a1833b8"
 from {username='slave'} at 127.0.0.1:35286
I20260709 13:04:53.339463  9472 raft_consensus.cc:606] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff [term 2 LEADER]: Received request to transfer leadership to TS 932245f14aac417f913cc7330a1833b8
I20260709 13:04:53.342628  9396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8dfdb24cbc824b95ac65712323103e2a"
dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
mode: GRACEFUL
new_leader_uuid: "932245f14aac417f913cc7330a1833b8"
 from {username='slave'} at 127.0.0.1:39432
I20260709 13:04:53.343181  9396 raft_consensus.cc:606] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Received request to transfer leadership to TS 932245f14aac417f913cc7330a1833b8
I20260709 13:04:53.355896  9546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a25f8459a3644bfcaf8f9d71705b1c33"
dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
mode: GRACEFUL
new_leader_uuid: "932245f14aac417f913cc7330a1833b8"
 from {username='slave'} at 127.0.0.1:36782
I20260709 13:04:53.356473  9546 raft_consensus.cc:606] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Received request to transfer leadership to TS 932245f14aac417f913cc7330a1833b8
I20260709 13:04:53.359823  9396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a55798aa4230462f9befe5d7fc9bd3ce"
dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
mode: GRACEFUL
new_leader_uuid: "932245f14aac417f913cc7330a1833b8"
 from {username='slave'} at 127.0.0.1:39432
I20260709 13:04:53.360392  9396 raft_consensus.cc:606] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Received request to transfer leadership to TS 932245f14aac417f913cc7330a1833b8
I20260709 13:04:53.362895  9396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad58816d959840df923159e870cf4ad8"
dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
mode: GRACEFUL
new_leader_uuid: "932245f14aac417f913cc7330a1833b8"
 from {username='slave'} at 127.0.0.1:39432
I20260709 13:04:53.363430  9396 raft_consensus.cc:606] T ad58816d959840df923159e870cf4ad8 P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Received request to transfer leadership to TS 932245f14aac417f913cc7330a1833b8
I20260709 13:04:53.364533   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:04:53.366361   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:53.402854 10347 raft_consensus.cc:993] T ad58816d959840df923159e870cf4ad8 P a91e8b10a5984dec9d3777a7275cef49: : Instructing follower 932245f14aac417f913cc7330a1833b8 to start an election
I20260709 13:04:53.403550 10349 raft_consensus.cc:1081] T ad58816d959840df923159e870cf4ad8 P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Signalling peer 932245f14aac417f913cc7330a1833b8 to start an election
I20260709 13:04:53.405167 10202 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad58816d959840df923159e870cf4ad8"
dest_uuid: "932245f14aac417f913cc7330a1833b8"
 from {username='slave'} at 127.0.0.1:36580
I20260709 13:04:53.405678 10202 raft_consensus.cc:493] T ad58816d959840df923159e870cf4ad8 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:53.406008 10202 raft_consensus.cc:3060] T ad58816d959840df923159e870cf4ad8 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.414414 10202 raft_consensus.cc:515] T ad58816d959840df923159e870cf4ad8 P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:53.416527 10202 leader_election.cc:290] T ad58816d959840df923159e870cf4ad8 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 election: Requested vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:53.417869  9546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad58816d959840df923159e870cf4ad8" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
I20260709 13:04:53.418211  9396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad58816d959840df923159e870cf4ad8" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:53.418653  9546 raft_consensus.cc:3060] T ad58816d959840df923159e870cf4ad8 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.418896  9396 raft_consensus.cc:3055] T ad58816d959840df923159e870cf4ad8 P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:53.419299  9396 raft_consensus.cc:740] T ad58816d959840df923159e870cf4ad8 P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Running, Role: LEADER
I20260709 13:04:53.420375  9396 consensus_queue.cc:260] T ad58816d959840df923159e870cf4ad8 P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:53.422113  9396 raft_consensus.cc:3060] T ad58816d959840df923159e870cf4ad8 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.426863  9546 raft_consensus.cc:2468] T ad58816d959840df923159e870cf4ad8 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 2.
I20260709 13:04:53.428596 10128 leader_election.cc:304] T ad58816d959840df923159e870cf4ad8 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 
I20260709 13:04:53.433900 10355 raft_consensus.cc:2804] T ad58816d959840df923159e870cf4ad8 P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:53.435755 10355 raft_consensus.cc:697] T ad58816d959840df923159e870cf4ad8 P 932245f14aac417f913cc7330a1833b8 [term 2 LEADER]: Becoming Leader. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Running, Role: LEADER
I20260709 13:04:53.437139  9396 raft_consensus.cc:2468] T ad58816d959840df923159e870cf4ad8 P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 2.
I20260709 13:04:53.437986 10355 consensus_queue.cc:237] T ad58816d959840df923159e870cf4ad8 P 932245f14aac417f913cc7330a1833b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:53.457149  9217 catalog_manager.cc:5697] T ad58816d959840df923159e870cf4ad8 P 932245f14aac417f913cc7330a1833b8 reported cstate change: term changed from 1 to 2, leader changed from a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194) to 932245f14aac417f913cc7330a1833b8 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "932245f14aac417f913cc7330a1833b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.462044 10348 raft_consensus.cc:993] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff: : Instructing follower 932245f14aac417f913cc7330a1833b8 to start an election
I20260709 13:04:53.462625 10348 raft_consensus.cc:1081] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff [term 2 LEADER]: Signalling peer 932245f14aac417f913cc7330a1833b8 to start an election
I20260709 13:04:53.464426 10196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c1e5b4bc1bc437884e6835b61227d4d"
dest_uuid: "932245f14aac417f913cc7330a1833b8"
 from {username='slave'} at 127.0.0.1:36588
I20260709 13:04:53.464974 10196 raft_consensus.cc:493] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:53.465440 10196 raft_consensus.cc:3060] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:53.477300 10196 raft_consensus.cc:515] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:53.480592 10196 leader_election.cc:290] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 3 election: Requested vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:53.481439  9396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c1e5b4bc1bc437884e6835b61227d4d" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:53.482273  9396 raft_consensus.cc:3060] T 8c1e5b4bc1bc437884e6835b61227d4d P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:53.482578  9469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c1e5b4bc1bc437884e6835b61227d4d" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:53.483259  9469 raft_consensus.cc:3055] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:53.483592  9469 raft_consensus.cc:740] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Running, Role: LEADER
I20260709 13:04:53.484619  9469 consensus_queue.cc:260] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:53.486043  9469 raft_consensus.cc:3060] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:53.498574  9396 raft_consensus.cc:2468] T 8c1e5b4bc1bc437884e6835b61227d4d P a91e8b10a5984dec9d3777a7275cef49 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 3.
I20260709 13:04:53.500069  9469 raft_consensus.cc:2468] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 3.
I20260709 13:04:53.500032 10126 leader_election.cc:304] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, a91e8b10a5984dec9d3777a7275cef49; no voters: 
I20260709 13:04:53.504375 10355 raft_consensus.cc:2804] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:53.504972 10355 raft_consensus.cc:697] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [term 3 LEADER]: Becoming Leader. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Running, Role: LEADER
I20260709 13:04:53.506139 10355 consensus_queue.cc:237] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:53.510742 10349 raft_consensus.cc:993] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49: : Instructing follower 932245f14aac417f913cc7330a1833b8 to start an election
I20260709 13:04:53.515029 10363 raft_consensus.cc:993] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49: : Instructing follower 932245f14aac417f913cc7330a1833b8 to start an election
I20260709 13:04:53.515005 10347 raft_consensus.cc:1081] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Signalling peer 932245f14aac417f913cc7330a1833b8 to start an election
I20260709 13:04:53.515877 10349 raft_consensus.cc:1081] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Signalling peer 932245f14aac417f913cc7330a1833b8 to start an election
I20260709 13:04:53.518777 10206 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a55798aa4230462f9befe5d7fc9bd3ce"
dest_uuid: "932245f14aac417f913cc7330a1833b8"
 from {username='slave'} at 127.0.0.1:36580
I20260709 13:04:53.518994 10196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8dfdb24cbc824b95ac65712323103e2a"
dest_uuid: "932245f14aac417f913cc7330a1833b8"
 from {username='slave'} at 127.0.0.1:36580
I20260709 13:04:53.519418 10206 raft_consensus.cc:493] T a55798aa4230462f9befe5d7fc9bd3ce P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:53.519659 10196 raft_consensus.cc:493] T 8dfdb24cbc824b95ac65712323103e2a P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:53.519879 10206 raft_consensus.cc:3060] T a55798aa4230462f9befe5d7fc9bd3ce P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.520054 10196 raft_consensus.cc:3060] T 8dfdb24cbc824b95ac65712323103e2a P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.528064 10206 raft_consensus.cc:515] T a55798aa4230462f9befe5d7fc9bd3ce P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:53.530256 10196 raft_consensus.cc:515] T 8dfdb24cbc824b95ac65712323103e2a P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:53.532522  9546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55798aa4230462f9befe5d7fc9bd3ce" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
I20260709 13:04:53.533059  9396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55798aa4230462f9befe5d7fc9bd3ce" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:53.533695  9396 raft_consensus.cc:3055] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:53.533983  9396 raft_consensus.cc:740] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Running, Role: LEADER
I20260709 13:04:53.534034  9217 catalog_manager.cc:5697] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 reported cstate change: term changed from 2 to 3, leader changed from ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195) to 932245f14aac417f913cc7330a1833b8 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "932245f14aac417f913cc7330a1833b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.534948  9396 consensus_queue.cc:260] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:53.535766  9396 raft_consensus.cc:3060] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.533179  9546 raft_consensus.cc:3060] T a55798aa4230462f9befe5d7fc9bd3ce P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.532073 10206 leader_election.cc:290] T a55798aa4230462f9befe5d7fc9bd3ce P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 election: Requested vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:53.531742 10363 raft_consensus.cc:993] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49: : Instructing follower 932245f14aac417f913cc7330a1833b8 to start an election
I20260709 13:04:53.547220 10363 raft_consensus.cc:1081] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 [term 2 LEADER]: Signalling peer 932245f14aac417f913cc7330a1833b8 to start an election
I20260709 13:04:53.549458 10202 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c53f31a2697499cb5ad2d5bb6715f02"
dest_uuid: "932245f14aac417f913cc7330a1833b8"
 from {username='slave'} at 127.0.0.1:36580
I20260709 13:04:53.556139 10202 raft_consensus.cc:493] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:53.556506 10202 raft_consensus.cc:3060] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:53.550817  9538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dfdb24cbc824b95ac65712323103e2a" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
I20260709 13:04:53.557577  9538 raft_consensus.cc:3060] T 8dfdb24cbc824b95ac65712323103e2a P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.551412  9395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dfdb24cbc824b95ac65712323103e2a" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:53.558732  9395 raft_consensus.cc:3055] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:53.559038  9395 raft_consensus.cc:740] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Running, Role: LEADER
I20260709 13:04:53.559872  9395 consensus_queue.cc:260] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:53.561039  9395 raft_consensus.cc:3060] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.564595 10202 raft_consensus.cc:515] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:53.565999  9538 raft_consensus.cc:2468] T 8dfdb24cbc824b95ac65712323103e2a P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 2.
I20260709 13:04:53.549068  9396 raft_consensus.cc:2468] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 2.
I20260709 13:04:53.568316 10126 leader_election.cc:304] T a55798aa4230462f9befe5d7fc9bd3ce P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, a91e8b10a5984dec9d3777a7275cef49; no voters: 
I20260709 13:04:53.568382 10128 leader_election.cc:304] T 8dfdb24cbc824b95ac65712323103e2a P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 
I20260709 13:04:53.568920 10202 leader_election.cc:290] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 3 election: Requested vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:53.569712 10356 raft_consensus.cc:2804] T a55798aa4230462f9befe5d7fc9bd3ce P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:53.550915 10196 leader_election.cc:290] T 8dfdb24cbc824b95ac65712323103e2a P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 election: Requested vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:53.569706 10355 raft_consensus.cc:2804] T 8dfdb24cbc824b95ac65712323103e2a P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:53.570991  9544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c53f31a2697499cb5ad2d5bb6715f02" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
I20260709 13:04:53.572243  9544 raft_consensus.cc:3060] T 3c53f31a2697499cb5ad2d5bb6715f02 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:53.572665  9395 raft_consensus.cc:2468] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 2.
I20260709 13:04:53.575109  9546 raft_consensus.cc:2468] T a55798aa4230462f9befe5d7fc9bd3ce P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 2.
I20260709 13:04:53.584079  9396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c53f31a2697499cb5ad2d5bb6715f02" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:53.584851  9396 raft_consensus.cc:3055] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:53.585230  9396 raft_consensus.cc:740] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Running, Role: LEADER
I20260709 13:04:53.586129  9396 consensus_queue.cc:260] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:53.588493  9396 raft_consensus.cc:3060] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:53.590185  9544 raft_consensus.cc:2468] T 3c53f31a2697499cb5ad2d5bb6715f02 P dfbbb80ab8e345e0ae1684fafefceccf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 3.
I20260709 13:04:53.591408 10355 raft_consensus.cc:697] T 8dfdb24cbc824b95ac65712323103e2a P 932245f14aac417f913cc7330a1833b8 [term 2 LEADER]: Becoming Leader. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Running, Role: LEADER
I20260709 13:04:53.592499 10355 consensus_queue.cc:237] T 8dfdb24cbc824b95ac65712323103e2a P 932245f14aac417f913cc7330a1833b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:53.593418 10356 raft_consensus.cc:697] T a55798aa4230462f9befe5d7fc9bd3ce P 932245f14aac417f913cc7330a1833b8 [term 2 LEADER]: Becoming Leader. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Running, Role: LEADER
I20260709 13:04:53.594488 10128 leader_election.cc:304] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 
I20260709 13:04:53.595594 10356 consensus_queue.cc:237] T a55798aa4230462f9befe5d7fc9bd3ce P 932245f14aac417f913cc7330a1833b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:53.598614 10365 raft_consensus.cc:2804] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:53.596271  9396 raft_consensus.cc:2468] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 3.
I20260709 13:04:53.599511 10365 raft_consensus.cc:697] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8 [term 3 LEADER]: Becoming Leader. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Running, Role: LEADER
I20260709 13:04:53.600754 10365 consensus_queue.cc:237] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:53.616147  9217 catalog_manager.cc:5697] T a55798aa4230462f9befe5d7fc9bd3ce P 932245f14aac417f913cc7330a1833b8 reported cstate change: term changed from 1 to 2, leader changed from a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194) to 932245f14aac417f913cc7330a1833b8 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "932245f14aac417f913cc7330a1833b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.618100  9217 catalog_manager.cc:5697] T 8dfdb24cbc824b95ac65712323103e2a P 932245f14aac417f913cc7330a1833b8 reported cstate change: term changed from 1 to 2, leader changed from a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194) to 932245f14aac417f913cc7330a1833b8 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "932245f14aac417f913cc7330a1833b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.620571 10342 raft_consensus.cc:993] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf: : Instructing follower 932245f14aac417f913cc7330a1833b8 to start an election
I20260709 13:04:53.621193 10342 raft_consensus.cc:1081] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Signalling peer 932245f14aac417f913cc7330a1833b8 to start an election
I20260709 13:04:53.622869 10206 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a25f8459a3644bfcaf8f9d71705b1c33"
dest_uuid: "932245f14aac417f913cc7330a1833b8"
 from {username='slave'} at 127.0.0.1:36602
I20260709 13:04:53.623391 10206 raft_consensus.cc:493] T a25f8459a3644bfcaf8f9d71705b1c33 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:53.623730 10206 raft_consensus.cc:3060] T a25f8459a3644bfcaf8f9d71705b1c33 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.629876 10206 raft_consensus.cc:515] T a25f8459a3644bfcaf8f9d71705b1c33 P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:53.633328  9544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25f8459a3644bfcaf8f9d71705b1c33" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
I20260709 13:04:53.633935  9544 raft_consensus.cc:3055] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:53.633567  9395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25f8459a3644bfcaf8f9d71705b1c33" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:53.634285  9544 raft_consensus.cc:740] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Running, Role: LEADER
I20260709 13:04:53.634559  9395 raft_consensus.cc:3060] T a25f8459a3644bfcaf8f9d71705b1c33 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.635160  9544 consensus_queue.cc:260] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:53.636050  9544 raft_consensus.cc:3060] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.637652  9217 catalog_manager.cc:5697] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8 reported cstate change: term changed from 2 to 3, leader changed from a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194) to 932245f14aac417f913cc7330a1833b8 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "932245f14aac417f913cc7330a1833b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.643684  9395 raft_consensus.cc:2468] T a25f8459a3644bfcaf8f9d71705b1c33 P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 2.
I20260709 13:04:53.645427 10206 leader_election.cc:290] T a25f8459a3644bfcaf8f9d71705b1c33 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 election: Requested vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:53.645395 10126 leader_election.cc:304] T a25f8459a3644bfcaf8f9d71705b1c33 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, a91e8b10a5984dec9d3777a7275cef49; no voters: 
I20260709 13:04:53.646627 10355 raft_consensus.cc:2804] T a25f8459a3644bfcaf8f9d71705b1c33 P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:53.647171 10355 raft_consensus.cc:697] T a25f8459a3644bfcaf8f9d71705b1c33 P 932245f14aac417f913cc7330a1833b8 [term 2 LEADER]: Becoming Leader. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Running, Role: LEADER
I20260709 13:04:53.648172 10355 consensus_queue.cc:237] T a25f8459a3644bfcaf8f9d71705b1c33 P 932245f14aac417f913cc7330a1833b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:53.648777  9544 raft_consensus.cc:2468] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 2.
I20260709 13:04:53.659102  9217 catalog_manager.cc:5697] T a25f8459a3644bfcaf8f9d71705b1c33 P 932245f14aac417f913cc7330a1833b8 reported cstate change: term changed from 1 to 2, leader changed from dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196) to 932245f14aac417f913cc7330a1833b8 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "932245f14aac417f913cc7330a1833b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.884081  9396 raft_consensus.cc:1275] T ad58816d959840df923159e870cf4ad8 P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Refusing update from remote peer 932245f14aac417f913cc7330a1833b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:53.885573 10355 consensus_queue.cc:1048] T ad58816d959840df923159e870cf4ad8 P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:53.901165  9544 raft_consensus.cc:1275] T ad58816d959840df923159e870cf4ad8 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Refusing update from remote peer 932245f14aac417f913cc7330a1833b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:53.903020  9396 raft_consensus.cc:1275] T 8c1e5b4bc1bc437884e6835b61227d4d P a91e8b10a5984dec9d3777a7275cef49 [term 3 FOLLOWER]: Refusing update from remote peer 932245f14aac417f913cc7330a1833b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:53.903191 10355 consensus_queue.cc:1048] T ad58816d959840df923159e870cf4ad8 P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:53.905611 10366 consensus_queue.cc:1048] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:53.931550  9472 raft_consensus.cc:1275] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff [term 3 FOLLOWER]: Refusing update from remote peer 932245f14aac417f913cc7330a1833b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:53.933471 10355 consensus_queue.cc:1048] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:53.990999  9397 raft_consensus.cc:1275] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Refusing update from remote peer 932245f14aac417f913cc7330a1833b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:53.992543 10355 consensus_queue.cc:1048] T 8dfdb24cbc824b95ac65712323103e2a P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:54.017443  9538 raft_consensus.cc:1275] T 3c53f31a2697499cb5ad2d5bb6715f02 P dfbbb80ab8e345e0ae1684fafefceccf [term 3 FOLLOWER]: Refusing update from remote peer 932245f14aac417f913cc7330a1833b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:54.019439 10355 consensus_queue.cc:1048] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:54.025311  9544 raft_consensus.cc:1275] T 8dfdb24cbc824b95ac65712323103e2a P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Refusing update from remote peer 932245f14aac417f913cc7330a1833b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:54.029538 10366 consensus_queue.cc:1048] T 8dfdb24cbc824b95ac65712323103e2a P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:54.048434  9397 raft_consensus.cc:1275] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 [term 3 FOLLOWER]: Refusing update from remote peer 932245f14aac417f913cc7330a1833b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:54.050112 10355 consensus_queue.cc:1048] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:54.056417  9395 raft_consensus.cc:1275] T a25f8459a3644bfcaf8f9d71705b1c33 P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Refusing update from remote peer 932245f14aac417f913cc7330a1833b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:54.058358 10355 consensus_queue.cc:1048] T a25f8459a3644bfcaf8f9d71705b1c33 P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:54.091687  9544 raft_consensus.cc:1275] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Refusing update from remote peer 932245f14aac417f913cc7330a1833b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:54.093881 10365 consensus_queue.cc:1048] T a25f8459a3644bfcaf8f9d71705b1c33 P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:54.116432  9538 raft_consensus.cc:1275] T a55798aa4230462f9befe5d7fc9bd3ce P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Refusing update from remote peer 932245f14aac417f913cc7330a1833b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:54.118832 10365 consensus_queue.cc:1048] T a55798aa4230462f9befe5d7fc9bd3ce P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:54.148876  9396 raft_consensus.cc:1275] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Refusing update from remote peer 932245f14aac417f913cc7330a1833b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:54.150497 10355 consensus_queue.cc:1048] T a55798aa4230462f9befe5d7fc9bd3ce P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:54.367797   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:54.416055   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:54.466661  9472 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93877deb770d41a6ba34cefdea146d54"
dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
mode: GRACEFUL
new_leader_uuid: "932245f14aac417f913cc7330a1833b8"
 from {username='slave'} at 127.0.0.1:35286
I20260709 13:04:54.467319  9472 raft_consensus.cc:606] T 93877deb770d41a6ba34cefdea146d54 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Received request to transfer leadership to TS 932245f14aac417f913cc7330a1833b8
I20260709 13:04:54.473855  9538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6f012a5e95f4006871d83f7b18e356b"
dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
mode: GRACEFUL
new_leader_uuid: "932245f14aac417f913cc7330a1833b8"
 from {username='slave'} at 127.0.0.1:36782
I20260709 13:04:54.474481  9538 raft_consensus.cc:606] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Received request to transfer leadership to TS 932245f14aac417f913cc7330a1833b8
I20260709 13:04:54.478531  9538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b90aae84687f41e99e58dada706ae2d7"
dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
mode: GRACEFUL
new_leader_uuid: "932245f14aac417f913cc7330a1833b8"
 from {username='slave'} at 127.0.0.1:36782
I20260709 13:04:54.479295  9538 raft_consensus.cc:606] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Received request to transfer leadership to TS 932245f14aac417f913cc7330a1833b8
I20260709 13:04:54.484376  9544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8bd3f903abb4dd99431dbf597c0d462"
dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
mode: GRACEFUL
new_leader_uuid: "932245f14aac417f913cc7330a1833b8"
 from {username='slave'} at 127.0.0.1:36782
I20260709 13:04:54.484922  9544 raft_consensus.cc:606] T d8bd3f903abb4dd99431dbf597c0d462 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Received request to transfer leadership to TS 932245f14aac417f913cc7330a1833b8
I20260709 13:04:54.487321  9544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff040bb60327424d8aeec71e3bf58a0a"
dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
mode: GRACEFUL
new_leader_uuid: "932245f14aac417f913cc7330a1833b8"
 from {username='slave'} at 127.0.0.1:36782
I20260709 13:04:54.487926  9544 raft_consensus.cc:606] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Received request to transfer leadership to TS 932245f14aac417f913cc7330a1833b8
I20260709 13:04:54.489257   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:54.490875   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:54.506004 10342 raft_consensus.cc:993] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf: : Instructing follower 932245f14aac417f913cc7330a1833b8 to start an election
I20260709 13:04:54.506685 10371 raft_consensus.cc:1081] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Signalling peer 932245f14aac417f913cc7330a1833b8 to start an election
I20260709 13:04:54.508359 10196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b90aae84687f41e99e58dada706ae2d7"
dest_uuid: "932245f14aac417f913cc7330a1833b8"
 from {username='slave'} at 127.0.0.1:36602
I20260709 13:04:54.509125 10196 raft_consensus.cc:493] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:54.509582 10196 raft_consensus.cc:3060] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:54.521389 10196 raft_consensus.cc:515] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:54.522588 10371 raft_consensus.cc:993] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf: : Instructing follower 932245f14aac417f913cc7330a1833b8 to start an election
I20260709 13:04:54.523209 10371 raft_consensus.cc:1081] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Signalling peer 932245f14aac417f913cc7330a1833b8 to start an election
I20260709 13:04:54.523712 10196 leader_election.cc:290] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 election: Requested vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:54.524430  9471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90aae84687f41e99e58dada706ae2d7" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:54.524961  9471 raft_consensus.cc:3060] T b90aae84687f41e99e58dada706ae2d7 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:54.526041 10196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff040bb60327424d8aeec71e3bf58a0a"
dest_uuid: "932245f14aac417f913cc7330a1833b8"
 from {username='slave'} at 127.0.0.1:36602
I20260709 13:04:54.526729 10196 raft_consensus.cc:493] T ff040bb60327424d8aeec71e3bf58a0a P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:54.527197 10196 raft_consensus.cc:3060] T ff040bb60327424d8aeec71e3bf58a0a P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:54.527070  9538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90aae84687f41e99e58dada706ae2d7" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
I20260709 13:04:54.527918  9538 raft_consensus.cc:3055] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:54.528318  9538 raft_consensus.cc:740] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Running, Role: LEADER
I20260709 13:04:54.529323  9538 consensus_queue.cc:260] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:54.530483  9538 raft_consensus.cc:3060] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:54.543300  9471 raft_consensus.cc:2468] T b90aae84687f41e99e58dada706ae2d7 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 2.
I20260709 13:04:54.543771  9538 raft_consensus.cc:2468] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 2.
I20260709 13:04:54.545056 10128 leader_election.cc:304] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:54.546674 10356 raft_consensus.cc:2804] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:54.547189 10356 raft_consensus.cc:697] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8 [term 2 LEADER]: Becoming Leader. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Running, Role: LEADER
I20260709 13:04:54.548456 10356 consensus_queue.cc:237] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:54.549753 10196 raft_consensus.cc:515] T ff040bb60327424d8aeec71e3bf58a0a P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:54.553580  9538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff040bb60327424d8aeec71e3bf58a0a" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
I20260709 13:04:54.554263  9538 raft_consensus.cc:3055] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:54.554622  9538 raft_consensus.cc:740] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Running, Role: LEADER
I20260709 13:04:54.555558  9538 consensus_queue.cc:260] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:54.556881  9538 raft_consensus.cc:3060] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:54.557322 10196 leader_election.cc:290] T ff040bb60327424d8aeec71e3bf58a0a P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 election: Requested vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:54.559222  9469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff040bb60327424d8aeec71e3bf58a0a" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:54.559841  9469 raft_consensus.cc:3060] T ff040bb60327424d8aeec71e3bf58a0a P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:54.568856  9469 raft_consensus.cc:2468] T ff040bb60327424d8aeec71e3bf58a0a P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 2.
I20260709 13:04:54.569764  9220 catalog_manager.cc:5697] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8 reported cstate change: term changed from 1 to 2, leader changed from dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196) to 932245f14aac417f913cc7330a1833b8 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "932245f14aac417f913cc7330a1833b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:54.572407 10128 leader_election.cc:304] T ff040bb60327424d8aeec71e3bf58a0a P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:54.574803  9538 raft_consensus.cc:2468] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 2.
I20260709 13:04:54.576073 10356 raft_consensus.cc:2804] T ff040bb60327424d8aeec71e3bf58a0a P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:54.576887 10356 raft_consensus.cc:697] T ff040bb60327424d8aeec71e3bf58a0a P 932245f14aac417f913cc7330a1833b8 [term 2 LEADER]: Becoming Leader. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Running, Role: LEADER
I20260709 13:04:54.584657 10356 consensus_queue.cc:237] T ff040bb60327424d8aeec71e3bf58a0a P 932245f14aac417f913cc7330a1833b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:54.600239  9220 catalog_manager.cc:5697] T ff040bb60327424d8aeec71e3bf58a0a P 932245f14aac417f913cc7330a1833b8 reported cstate change: term changed from 1 to 2, leader changed from dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196) to 932245f14aac417f913cc7330a1833b8 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "932245f14aac417f913cc7330a1833b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:54.641306 10342 raft_consensus.cc:993] T d8bd3f903abb4dd99431dbf597c0d462 P dfbbb80ab8e345e0ae1684fafefceccf: : Instructing follower 932245f14aac417f913cc7330a1833b8 to start an election
I20260709 13:04:54.641924 10371 raft_consensus.cc:1081] T d8bd3f903abb4dd99431dbf597c0d462 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Signalling peer 932245f14aac417f913cc7330a1833b8 to start an election
I20260709 13:04:54.643558 10196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8bd3f903abb4dd99431dbf597c0d462"
dest_uuid: "932245f14aac417f913cc7330a1833b8"
 from {username='slave'} at 127.0.0.1:36602
I20260709 13:04:54.644203 10196 raft_consensus.cc:493] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:54.644627 10196 raft_consensus.cc:3060] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:54.652110 10196 raft_consensus.cc:515] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:54.653817 10196 leader_election.cc:290] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 election: Requested vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:54.654579  9471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8bd3f903abb4dd99431dbf597c0d462" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:54.654861  9538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8bd3f903abb4dd99431dbf597c0d462" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
I20260709 13:04:54.655304  9471 raft_consensus.cc:3060] T d8bd3f903abb4dd99431dbf597c0d462 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:54.655575  9538 raft_consensus.cc:3055] T d8bd3f903abb4dd99431dbf597c0d462 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:54.655995  9538 raft_consensus.cc:740] T d8bd3f903abb4dd99431dbf597c0d462 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Running, Role: LEADER
I20260709 13:04:54.656841  9538 consensus_queue.cc:260] T d8bd3f903abb4dd99431dbf597c0d462 P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:54.658093  9538 raft_consensus.cc:3060] T d8bd3f903abb4dd99431dbf597c0d462 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:54.662572  9471 raft_consensus.cc:2468] T d8bd3f903abb4dd99431dbf597c0d462 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 2.
I20260709 13:04:54.663692 10128 leader_election.cc:304] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:54.664321  9538 raft_consensus.cc:2468] T d8bd3f903abb4dd99431dbf597c0d462 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 2.
I20260709 13:04:54.664413 10356 raft_consensus.cc:2804] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:54.665462 10356 raft_consensus.cc:697] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8 [term 2 LEADER]: Becoming Leader. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Running, Role: LEADER
I20260709 13:04:54.666462 10356 consensus_queue.cc:237] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:54.675895  9220 catalog_manager.cc:5697] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8 reported cstate change: term changed from 1 to 2, leader changed from dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196) to 932245f14aac417f913cc7330a1833b8 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "932245f14aac417f913cc7330a1833b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:54.764739 10388 raft_consensus.cc:993] T 93877deb770d41a6ba34cefdea146d54 P ef5fe58eb3e04ae18fda957b4d507eff: : Instructing follower 932245f14aac417f913cc7330a1833b8 to start an election
I20260709 13:04:54.765455 10348 raft_consensus.cc:1081] T 93877deb770d41a6ba34cefdea146d54 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Signalling peer 932245f14aac417f913cc7330a1833b8 to start an election
I20260709 13:04:54.766961 10196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93877deb770d41a6ba34cefdea146d54"
dest_uuid: "932245f14aac417f913cc7330a1833b8"
 from {username='slave'} at 127.0.0.1:36588
I20260709 13:04:54.767599 10196 raft_consensus.cc:493] T 93877deb770d41a6ba34cefdea146d54 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:54.767943 10196 raft_consensus.cc:3060] T 93877deb770d41a6ba34cefdea146d54 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:54.774346 10196 raft_consensus.cc:515] T 93877deb770d41a6ba34cefdea146d54 P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:54.776265 10196 leader_election.cc:290] T 93877deb770d41a6ba34cefdea146d54 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 election: Requested vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:54.777261  9469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93877deb770d41a6ba34cefdea146d54" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:54.777782  9538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93877deb770d41a6ba34cefdea146d54" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
I20260709 13:04:54.778113  9469 raft_consensus.cc:3055] T 93877deb770d41a6ba34cefdea146d54 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:54.778481  9538 raft_consensus.cc:3060] T 93877deb770d41a6ba34cefdea146d54 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:54.778505  9469 raft_consensus.cc:740] T 93877deb770d41a6ba34cefdea146d54 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Running, Role: LEADER
I20260709 13:04:54.779639  9469 consensus_queue.cc:260] T 93877deb770d41a6ba34cefdea146d54 P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:54.781199  9469 raft_consensus.cc:3060] T 93877deb770d41a6ba34cefdea146d54 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:54.787961  9538 raft_consensus.cc:2468] T 93877deb770d41a6ba34cefdea146d54 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 2.
I20260709 13:04:54.789283 10128 leader_election.cc:304] T 93877deb770d41a6ba34cefdea146d54 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 
I20260709 13:04:54.789320  9469 raft_consensus.cc:2468] T 93877deb770d41a6ba34cefdea146d54 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 2.
I20260709 13:04:54.790218 10356 raft_consensus.cc:2804] T 93877deb770d41a6ba34cefdea146d54 P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:54.790752 10356 raft_consensus.cc:697] T 93877deb770d41a6ba34cefdea146d54 P 932245f14aac417f913cc7330a1833b8 [term 2 LEADER]: Becoming Leader. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Running, Role: LEADER
I20260709 13:04:54.791530 10356 consensus_queue.cc:237] T 93877deb770d41a6ba34cefdea146d54 P 932245f14aac417f913cc7330a1833b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:54.801553  9220 catalog_manager.cc:5697] T 93877deb770d41a6ba34cefdea146d54 P 932245f14aac417f913cc7330a1833b8 reported cstate change: term changed from 1 to 2, leader changed from ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195) to 932245f14aac417f913cc7330a1833b8 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "932245f14aac417f913cc7330a1833b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:54.845741 10371 raft_consensus.cc:993] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf: : Instructing follower 932245f14aac417f913cc7330a1833b8 to start an election
I20260709 13:04:54.846333 10342 raft_consensus.cc:1081] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Signalling peer 932245f14aac417f913cc7330a1833b8 to start an election
I20260709 13:04:54.847733 10196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6f012a5e95f4006871d83f7b18e356b"
dest_uuid: "932245f14aac417f913cc7330a1833b8"
 from {username='slave'} at 127.0.0.1:36602
I20260709 13:04:54.848250 10196 raft_consensus.cc:493] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:54.848676 10196 raft_consensus.cc:3060] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:54.855005 10196 raft_consensus.cc:515] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:54.856791 10196 leader_election.cc:290] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 election: Requested vote from peers dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:04:54.857581  9538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f012a5e95f4006871d83f7b18e356b" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
I20260709 13:04:54.857753  9396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f012a5e95f4006871d83f7b18e356b" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:54.858273  9538 raft_consensus.cc:3055] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:54.858346  9396 raft_consensus.cc:3060] T a6f012a5e95f4006871d83f7b18e356b P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:54.858703  9538 raft_consensus.cc:740] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Running, Role: LEADER
I20260709 13:04:54.859568  9538 consensus_queue.cc:260] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:54.861028  9538 raft_consensus.cc:3060] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:54.866106  9396 raft_consensus.cc:2468] T a6f012a5e95f4006871d83f7b18e356b P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 2.
I20260709 13:04:54.867472 10126 leader_election.cc:304] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, a91e8b10a5984dec9d3777a7275cef49; no voters: 
I20260709 13:04:54.868541 10356 raft_consensus.cc:2804] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:54.869132 10356 raft_consensus.cc:697] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8 [term 2 LEADER]: Becoming Leader. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Running, Role: LEADER
I20260709 13:04:54.870121 10356 consensus_queue.cc:237] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:04:54.874639  9538 raft_consensus.cc:2468] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 2.
I20260709 13:04:54.888554  9220 catalog_manager.cc:5697] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8 reported cstate change: term changed from 1 to 2, leader changed from dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196) to 932245f14aac417f913cc7330a1833b8 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "932245f14aac417f913cc7330a1833b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:54.997925  9469 raft_consensus.cc:1275] T b90aae84687f41e99e58dada706ae2d7 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Refusing update from remote peer 932245f14aac417f913cc7330a1833b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:54.999188 10356 consensus_queue.cc:1048] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:55.015409  9538 raft_consensus.cc:1275] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Refusing update from remote peer 932245f14aac417f913cc7330a1833b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:55.016839 10366 consensus_queue.cc:1048] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:55.029016  9544 raft_consensus.cc:1275] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Refusing update from remote peer 932245f14aac417f913cc7330a1833b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:55.031827 10366 consensus_queue.cc:1048] T ff040bb60327424d8aeec71e3bf58a0a P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:55.042801  9469 raft_consensus.cc:1275] T ff040bb60327424d8aeec71e3bf58a0a P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Refusing update from remote peer 932245f14aac417f913cc7330a1833b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:55.044691 10355 consensus_queue.cc:1048] T ff040bb60327424d8aeec71e3bf58a0a P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:55.086737  9544 raft_consensus.cc:1275] T d8bd3f903abb4dd99431dbf597c0d462 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Refusing update from remote peer 932245f14aac417f913cc7330a1833b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:55.087954 10355 consensus_queue.cc:1048] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:55.097710  9471 raft_consensus.cc:1275] T d8bd3f903abb4dd99431dbf597c0d462 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Refusing update from remote peer 932245f14aac417f913cc7330a1833b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:55.106415 10356 consensus_queue.cc:1048] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:55.367332  9544 raft_consensus.cc:1275] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Refusing update from remote peer 932245f14aac417f913cc7330a1833b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:55.368687 10356 consensus_queue.cc:1048] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:55.381385  9396 raft_consensus.cc:1275] T a6f012a5e95f4006871d83f7b18e356b P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Refusing update from remote peer 932245f14aac417f913cc7330a1833b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:55.382993 10356 consensus_queue.cc:1048] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:55.403432  9544 raft_consensus.cc:1275] T 93877deb770d41a6ba34cefdea146d54 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Refusing update from remote peer 932245f14aac417f913cc7330a1833b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:55.404723 10356 consensus_queue.cc:1048] T 93877deb770d41a6ba34cefdea146d54 P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:55.410786  9471 raft_consensus.cc:1275] T 93877deb770d41a6ba34cefdea146d54 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Refusing update from remote peer 932245f14aac417f913cc7330a1833b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:55.416815 10356 consensus_queue.cc:1048] T 93877deb770d41a6ba34cefdea146d54 P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:55.491937   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:55.541988   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:55.583220  9471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d5b6e6fcfb04bc3bb6cc0270e14e0cd"
dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
mode: GRACEFUL
new_leader_uuid: "932245f14aac417f913cc7330a1833b8"
 from {username='slave'} at 127.0.0.1:35286
I20260709 13:04:55.584020  9471 raft_consensus.cc:606] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff [term 2 LEADER]: Received request to transfer leadership to TS 932245f14aac417f913cc7330a1833b8
I20260709 13:04:55.586719  9471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64bc8ad603604e0d9c8eb9d37ef4aed5"
dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
mode: GRACEFUL
new_leader_uuid: "932245f14aac417f913cc7330a1833b8"
 from {username='slave'} at 127.0.0.1:35286
I20260709 13:04:55.587179  9471 raft_consensus.cc:606] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Received request to transfer leadership to TS 932245f14aac417f913cc7330a1833b8
I20260709 13:04:55.589524  9471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "faf56b218e614e51962171088f3c4f63"
dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
mode: GRACEFUL
new_leader_uuid: "a91e8b10a5984dec9d3777a7275cef49"
 from {username='slave'} at 127.0.0.1:35286
I20260709 13:04:55.589964  9471 raft_consensus.cc:606] T faf56b218e614e51962171088f3c4f63 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Received request to transfer leadership to TS a91e8b10a5984dec9d3777a7275cef49
I20260709 13:04:55.590967   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:04:55.592367   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:55.739850 10388 raft_consensus.cc:993] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff: : Instructing follower 932245f14aac417f913cc7330a1833b8 to start an election
I20260709 13:04:55.740377 10348 raft_consensus.cc:1081] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff [term 2 LEADER]: Signalling peer 932245f14aac417f913cc7330a1833b8 to start an election
I20260709 13:04:55.741840 10202 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d5b6e6fcfb04bc3bb6cc0270e14e0cd"
dest_uuid: "932245f14aac417f913cc7330a1833b8"
 from {username='slave'} at 127.0.0.1:36588
I20260709 13:04:55.742385 10202 raft_consensus.cc:493] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:55.742695 10202 raft_consensus.cc:3060] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:55.747910 10202 raft_consensus.cc:515] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:55.749804 10202 leader_election.cc:290] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 3 election: Requested vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:55.750499  9396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5b6e6fcfb04bc3bb6cc0270e14e0cd" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:55.750886  9471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5b6e6fcfb04bc3bb6cc0270e14e0cd" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:55.751408  9396 raft_consensus.cc:3060] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:55.751518  9471 raft_consensus.cc:3055] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:55.751967  9471 raft_consensus.cc:740] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Running, Role: LEADER
I20260709 13:04:55.752704  9471 consensus_queue.cc:260] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:55.754057  9471 raft_consensus.cc:3060] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:55.757928  9396 raft_consensus.cc:2468] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P a91e8b10a5984dec9d3777a7275cef49 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 3.
I20260709 13:04:55.759140 10126 leader_election.cc:304] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, a91e8b10a5984dec9d3777a7275cef49; no voters: 
I20260709 13:04:55.759948 10365 raft_consensus.cc:2804] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:55.760413 10365 raft_consensus.cc:697] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8 [term 3 LEADER]: Becoming Leader. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Running, Role: LEADER
I20260709 13:04:55.761265 10365 consensus_queue.cc:237] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:55.763005  9471 raft_consensus.cc:2468] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 3.
I20260709 13:04:55.772845  9220 catalog_manager.cc:5697] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8 reported cstate change: term changed from 2 to 3, leader changed from ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195) to 932245f14aac417f913cc7330a1833b8 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "932245f14aac417f913cc7330a1833b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:55.919296 10348 raft_consensus.cc:993] T faf56b218e614e51962171088f3c4f63 P ef5fe58eb3e04ae18fda957b4d507eff: : Instructing follower a91e8b10a5984dec9d3777a7275cef49 to start an election
I20260709 13:04:55.919857 10388 raft_consensus.cc:1081] T faf56b218e614e51962171088f3c4f63 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Signalling peer a91e8b10a5984dec9d3777a7275cef49 to start an election
I20260709 13:04:55.921558  9395 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "faf56b218e614e51962171088f3c4f63"
dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
 from {username='slave'} at 127.0.0.1:57550
I20260709 13:04:55.922073  9395 raft_consensus.cc:493] T faf56b218e614e51962171088f3c4f63 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:55.922371  9395 raft_consensus.cc:3060] T faf56b218e614e51962171088f3c4f63 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:55.927765  9395 raft_consensus.cc:515] T faf56b218e614e51962171088f3c4f63 P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:55.929299  9395 leader_election.cc:290] T faf56b218e614e51962171088f3c4f63 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 election: Requested vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:55.930032  9471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf56b218e614e51962171088f3c4f63" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:55.930398  9538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf56b218e614e51962171088f3c4f63" candidate_uuid: "a91e8b10a5984dec9d3777a7275cef49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
I20260709 13:04:55.930716  9471 raft_consensus.cc:3055] T faf56b218e614e51962171088f3c4f63 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:55.931025  9538 raft_consensus.cc:3060] T faf56b218e614e51962171088f3c4f63 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:55.931057  9471 raft_consensus.cc:740] T faf56b218e614e51962171088f3c4f63 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Running, Role: LEADER
I20260709 13:04:55.931941  9471 consensus_queue.cc:260] T faf56b218e614e51962171088f3c4f63 P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:55.932912  9471 raft_consensus.cc:3060] T faf56b218e614e51962171088f3c4f63 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:55.939337  9538 raft_consensus.cc:2468] T faf56b218e614e51962171088f3c4f63 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 2.
I20260709 13:04:55.941347  9364 leader_election.cc:304] T faf56b218e614e51962171088f3c4f63 P a91e8b10a5984dec9d3777a7275cef49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a91e8b10a5984dec9d3777a7275cef49, dfbbb80ab8e345e0ae1684fafefceccf; no voters: 
I20260709 13:04:55.941581  9471 raft_consensus.cc:2468] T faf56b218e614e51962171088f3c4f63 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a91e8b10a5984dec9d3777a7275cef49 in term 2.
I20260709 13:04:55.943192 10364 raft_consensus.cc:2804] T faf56b218e614e51962171088f3c4f63 P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:55.944147 10364 raft_consensus.cc:697] T faf56b218e614e51962171088f3c4f63 P a91e8b10a5984dec9d3777a7275cef49 [term 2 LEADER]: Becoming Leader. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Running, Role: LEADER
I20260709 13:04:55.945325 10364 consensus_queue.cc:237] T faf56b218e614e51962171088f3c4f63 P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:55.960577  9220 catalog_manager.cc:5697] T faf56b218e614e51962171088f3c4f63 P a91e8b10a5984dec9d3777a7275cef49 reported cstate change: term changed from 1 to 2, leader changed from ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195) to a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "a91e8b10a5984dec9d3777a7275cef49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.041011 10418 raft_consensus.cc:993] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P ef5fe58eb3e04ae18fda957b4d507eff: : Instructing follower 932245f14aac417f913cc7330a1833b8 to start an election
I20260709 13:04:56.041663 10388 raft_consensus.cc:1081] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Signalling peer 932245f14aac417f913cc7330a1833b8 to start an election
I20260709 13:04:56.043339 10196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64bc8ad603604e0d9c8eb9d37ef4aed5"
dest_uuid: "932245f14aac417f913cc7330a1833b8"
 from {username='slave'} at 127.0.0.1:36588
I20260709 13:04:56.044028 10196 raft_consensus.cc:493] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:56.044464 10196 raft_consensus.cc:3060] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.050266 10196 raft_consensus.cc:515] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:56.051959 10196 leader_election.cc:290] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 election: Requested vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:56.052984  9471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64bc8ad603604e0d9c8eb9d37ef4aed5" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:56.053002  9395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64bc8ad603604e0d9c8eb9d37ef4aed5" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:56.053759  9471 raft_consensus.cc:3055] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:56.053902  9395 raft_consensus.cc:3060] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.054049  9471 raft_consensus.cc:740] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef5fe58eb3e04ae18fda957b4d507eff, State: Running, Role: LEADER
I20260709 13:04:56.054864  9471 consensus_queue.cc:260] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P ef5fe58eb3e04ae18fda957b4d507eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:56.055903  9471 raft_consensus.cc:3060] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.061427  9395 raft_consensus.cc:2468] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 2.
I20260709 13:04:56.062067  9471 raft_consensus.cc:2468] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 2.
I20260709 13:04:56.063485 10126 leader_election.cc:304] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, a91e8b10a5984dec9d3777a7275cef49; no voters: 
I20260709 13:04:56.064280 10355 raft_consensus.cc:2804] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:56.064736 10355 raft_consensus.cc:697] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P 932245f14aac417f913cc7330a1833b8 [term 2 LEADER]: Becoming Leader. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Running, Role: LEADER
I20260709 13:04:56.065551 10355 consensus_queue.cc:237] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P 932245f14aac417f913cc7330a1833b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } }
I20260709 13:04:56.075455  9220 catalog_manager.cc:5697] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P 932245f14aac417f913cc7330a1833b8 reported cstate change: term changed from 1 to 2, leader changed from ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195) to 932245f14aac417f913cc7330a1833b8 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "932245f14aac417f913cc7330a1833b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.221498  9395 raft_consensus.cc:1275] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P a91e8b10a5984dec9d3777a7275cef49 [term 3 FOLLOWER]: Refusing update from remote peer 932245f14aac417f913cc7330a1833b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:56.222929 10365 consensus_queue.cc:1048] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:56.237712  9469 raft_consensus.cc:1275] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff [term 3 FOLLOWER]: Refusing update from remote peer 932245f14aac417f913cc7330a1833b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:56.239967 10365 consensus_queue.cc:1048] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:56.326203  9538 raft_consensus.cc:1275] T faf56b218e614e51962171088f3c4f63 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Refusing update from remote peer a91e8b10a5984dec9d3777a7275cef49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:56.327752 10349 consensus_queue.cc:1048] T faf56b218e614e51962171088f3c4f63 P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:56.342792  9471 raft_consensus.cc:1275] T faf56b218e614e51962171088f3c4f63 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Refusing update from remote peer a91e8b10a5984dec9d3777a7275cef49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:56.344653 10427 consensus_queue.cc:1048] T faf56b218e614e51962171088f3c4f63 P a91e8b10a5984dec9d3777a7275cef49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:56.593361   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:56.638057   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:56.660133  9471 raft_consensus.cc:1275] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Refusing update from remote peer 932245f14aac417f913cc7330a1833b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:56.661684 10356 consensus_queue.cc:1048] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:56.680832  9395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "85d647b0abf74fbebc7e9a9bfe14b8ea"
dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
mode: GRACEFUL
new_leader_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
 from {username='slave'} at 127.0.0.1:39432
I20260709 13:04:56.681499  9395 raft_consensus.cc:606] T 85d647b0abf74fbebc7e9a9bfe14b8ea P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Received request to transfer leadership to TS dfbbb80ab8e345e0ae1684fafefceccf
I20260709 13:04:56.683135  9396 raft_consensus.cc:1275] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Refusing update from remote peer 932245f14aac417f913cc7330a1833b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:56.686264 10365 consensus_queue.cc:1048] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:56.694219   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:04:56.696166   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:57.022403 10436 raft_consensus.cc:993] T 85d647b0abf74fbebc7e9a9bfe14b8ea P a91e8b10a5984dec9d3777a7275cef49: : Instructing follower dfbbb80ab8e345e0ae1684fafefceccf to start an election
I20260709 13:04:57.023034 10426 raft_consensus.cc:1081] T 85d647b0abf74fbebc7e9a9bfe14b8ea P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Signalling peer dfbbb80ab8e345e0ae1684fafefceccf to start an election
I20260709 13:04:57.024575  9538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "85d647b0abf74fbebc7e9a9bfe14b8ea"
dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
 from {username='slave'} at 127.0.0.1:51942
I20260709 13:04:57.025276  9538 raft_consensus.cc:493] T 85d647b0abf74fbebc7e9a9bfe14b8ea P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:57.025606  9538 raft_consensus.cc:3060] T 85d647b0abf74fbebc7e9a9bfe14b8ea P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.031612  9538 raft_consensus.cc:515] T 85d647b0abf74fbebc7e9a9bfe14b8ea P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:57.033429  9538 leader_election.cc:290] T 85d647b0abf74fbebc7e9a9bfe14b8ea P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 2 election: Requested vote from peers a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607), ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559)
I20260709 13:04:57.034322  9471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85d647b0abf74fbebc7e9a9bfe14b8ea" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:57.034374  9396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85d647b0abf74fbebc7e9a9bfe14b8ea" candidate_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a91e8b10a5984dec9d3777a7275cef49"
I20260709 13:04:57.035000  9471 raft_consensus.cc:3060] T 85d647b0abf74fbebc7e9a9bfe14b8ea P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.035081  9396 raft_consensus.cc:3055] T 85d647b0abf74fbebc7e9a9bfe14b8ea P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:57.035542  9396 raft_consensus.cc:740] T 85d647b0abf74fbebc7e9a9bfe14b8ea P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a91e8b10a5984dec9d3777a7275cef49, State: Running, Role: LEADER
I20260709 13:04:57.036504  9396 consensus_queue.cc:260] T 85d647b0abf74fbebc7e9a9bfe14b8ea P a91e8b10a5984dec9d3777a7275cef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:57.037906  9396 raft_consensus.cc:3060] T 85d647b0abf74fbebc7e9a9bfe14b8ea P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.042266  9471 raft_consensus.cc:2468] T 85d647b0abf74fbebc7e9a9bfe14b8ea P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 2.
I20260709 13:04:57.043649  9512 leader_election.cc:304] T 85d647b0abf74fbebc7e9a9bfe14b8ea P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:57.044526 10434 raft_consensus.cc:2804] T 85d647b0abf74fbebc7e9a9bfe14b8ea P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:57.044749  9396 raft_consensus.cc:2468] T 85d647b0abf74fbebc7e9a9bfe14b8ea P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfbbb80ab8e345e0ae1684fafefceccf in term 2.
I20260709 13:04:57.045138 10434 raft_consensus.cc:697] T 85d647b0abf74fbebc7e9a9bfe14b8ea P dfbbb80ab8e345e0ae1684fafefceccf [term 2 LEADER]: Becoming Leader. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Running, Role: LEADER
I20260709 13:04:57.046072 10434 consensus_queue.cc:237] T 85d647b0abf74fbebc7e9a9bfe14b8ea P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } }
I20260709 13:04:57.057237  9220 catalog_manager.cc:5697] T 85d647b0abf74fbebc7e9a9bfe14b8ea P dfbbb80ab8e345e0ae1684fafefceccf reported cstate change: term changed from 1 to 2, leader changed from a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194) to dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196). New cstate: current_term: 2 leader_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:57.576874  9395 raft_consensus.cc:1275] T 85d647b0abf74fbebc7e9a9bfe14b8ea P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Refusing update from remote peer dfbbb80ab8e345e0ae1684fafefceccf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:57.578727 10442 consensus_queue.cc:1048] T 85d647b0abf74fbebc7e9a9bfe14b8ea P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:57.600365  9471 raft_consensus.cc:1275] T 85d647b0abf74fbebc7e9a9bfe14b8ea P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Refusing update from remote peer dfbbb80ab8e345e0ae1684fafefceccf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:57.601724 10442 consensus_queue.cc:1048] T 85d647b0abf74fbebc7e9a9bfe14b8ea P dfbbb80ab8e345e0ae1684fafefceccf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:57.697214   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:57.747094   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:57.787070  9544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2a7ad91c8474397bae23c993b89fca4"
dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
mode: GRACEFUL
new_leader_uuid: "932245f14aac417f913cc7330a1833b8"
 from {username='slave'} at 127.0.0.1:36782
I20260709 13:04:57.787600  9544 raft_consensus.cc:606] T b2a7ad91c8474397bae23c993b89fca4 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Received request to transfer leadership to TS 932245f14aac417f913cc7330a1833b8
I20260709 13:04:57.788821   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:04:57.790199   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:57.806892 10435 raft_consensus.cc:993] T b2a7ad91c8474397bae23c993b89fca4 P dfbbb80ab8e345e0ae1684fafefceccf: : Instructing follower 932245f14aac417f913cc7330a1833b8 to start an election
I20260709 13:04:57.807542 10435 raft_consensus.cc:1081] T b2a7ad91c8474397bae23c993b89fca4 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Signalling peer 932245f14aac417f913cc7330a1833b8 to start an election
I20260709 13:04:57.809347 10196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2a7ad91c8474397bae23c993b89fca4"
dest_uuid: "932245f14aac417f913cc7330a1833b8"
 from {username='slave'} at 127.0.0.1:36602
I20260709 13:04:57.809985 10196 raft_consensus.cc:493] T b2a7ad91c8474397bae23c993b89fca4 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:57.810400 10196 raft_consensus.cc:3060] T b2a7ad91c8474397bae23c993b89fca4 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.817199 10196 raft_consensus.cc:515] T b2a7ad91c8474397bae23c993b89fca4 P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:57.819345 10196 leader_election.cc:290] T b2a7ad91c8474397bae23c993b89fca4 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 election: Requested vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196:37995)
I20260709 13:04:57.820863  9469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2a7ad91c8474397bae23c993b89fca4" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef5fe58eb3e04ae18fda957b4d507eff"
I20260709 13:04:57.821564  9469 raft_consensus.cc:3060] T b2a7ad91c8474397bae23c993b89fca4 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.822800  9544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2a7ad91c8474397bae23c993b89fca4" candidate_uuid: "932245f14aac417f913cc7330a1833b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dfbbb80ab8e345e0ae1684fafefceccf"
I20260709 13:04:57.823498  9544 raft_consensus.cc:3055] T b2a7ad91c8474397bae23c993b89fca4 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:57.823788  9544 raft_consensus.cc:740] T b2a7ad91c8474397bae23c993b89fca4 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dfbbb80ab8e345e0ae1684fafefceccf, State: Running, Role: LEADER
I20260709 13:04:57.824564  9544 consensus_queue.cc:260] T b2a7ad91c8474397bae23c993b89fca4 P dfbbb80ab8e345e0ae1684fafefceccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:57.825891  9544 raft_consensus.cc:3060] T b2a7ad91c8474397bae23c993b89fca4 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.829197  9469 raft_consensus.cc:2468] T b2a7ad91c8474397bae23c993b89fca4 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 2.
I20260709 13:04:57.830296 10128 leader_election.cc:304] T b2a7ad91c8474397bae23c993b89fca4 P 932245f14aac417f913cc7330a1833b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932245f14aac417f913cc7330a1833b8, ef5fe58eb3e04ae18fda957b4d507eff; no voters: 
I20260709 13:04:57.831207 10441 raft_consensus.cc:2804] T b2a7ad91c8474397bae23c993b89fca4 P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:57.831713 10441 raft_consensus.cc:697] T b2a7ad91c8474397bae23c993b89fca4 P 932245f14aac417f913cc7330a1833b8 [term 2 LEADER]: Becoming Leader. State: Replica: 932245f14aac417f913cc7330a1833b8, State: Running, Role: LEADER
I20260709 13:04:57.832451 10441 consensus_queue.cc:237] T b2a7ad91c8474397bae23c993b89fca4 P 932245f14aac417f913cc7330a1833b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:57.832849  9544 raft_consensus.cc:2468] T b2a7ad91c8474397bae23c993b89fca4 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932245f14aac417f913cc7330a1833b8 in term 2.
I20260709 13:04:57.842509  9217 catalog_manager.cc:5697] T b2a7ad91c8474397bae23c993b89fca4 P 932245f14aac417f913cc7330a1833b8 reported cstate change: term changed from 1 to 2, leader changed from dfbbb80ab8e345e0ae1684fafefceccf (127.0.107.196) to 932245f14aac417f913cc7330a1833b8 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "932245f14aac417f913cc7330a1833b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:58.307456  9544 raft_consensus.cc:1275] T b2a7ad91c8474397bae23c993b89fca4 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Refusing update from remote peer 932245f14aac417f913cc7330a1833b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:58.308719 10449 consensus_queue.cc:1048] T b2a7ad91c8474397bae23c993b89fca4 P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:58.325330  9471 raft_consensus.cc:1275] T b2a7ad91c8474397bae23c993b89fca4 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Refusing update from remote peer 932245f14aac417f913cc7330a1833b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:58.327797 10355 consensus_queue.cc:1048] T b2a7ad91c8474397bae23c993b89fca4 P 932245f14aac417f913cc7330a1833b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:58.791077   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:58.829638   431 tablet_server.cc:179] TabletServer@127.0.107.193:37633 shutting down...
W20260709 13:04:58.866777  9512 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 232 similar messages]
W20260709 13:04:58.873016  9512 consensus_peers.cc:597] T 331d1446396c45ce9486793ecb5de7f7 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:58.875479   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:58.876929   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:58.879372   431 raft_consensus.cc:2243] T 65ba9982e9bd4177995544e13394911a P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.879962   431 raft_consensus.cc:2272] T 65ba9982e9bd4177995544e13394911a P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.883244   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:58.884142   431 raft_consensus.cc:2243] T 8f602c194d1c445ba1851f0a2272b40b P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.884711   431 raft_consensus.cc:2272] T 8f602c194d1c445ba1851f0a2272b40b P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.888485   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:58.889423   431 raft_consensus.cc:2243] T a792fefbeb0c4eb79e87501fb6dbe780 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.890257   431 raft_consensus.cc:2272] T a792fefbeb0c4eb79e87501fb6dbe780 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:58.892405  9364 consensus_peers.cc:597] T 9b34d97496514d29a27c52d749609084 P a91e8b10a5984dec9d3777a7275cef49 -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:58.893064   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:58.894042   431 raft_consensus.cc:2243] T 225ca60d9645490dbcdcf6d4d127d955 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.894531   431 raft_consensus.cc:2272] T 225ca60d9645490dbcdcf6d4d127d955 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.897030   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:58.897819   431 raft_consensus.cc:2243] T 17d57808c20741cd85b0e175935cdab7 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.898469   431 raft_consensus.cc:2272] T 17d57808c20741cd85b0e175935cdab7 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.901454   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:58.902163   431 raft_consensus.cc:2243] T 93a7d590cbac4b6da413dd8ea2a26225 P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.902698   431 raft_consensus.cc:2272] T 93a7d590cbac4b6da413dd8ea2a26225 P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.905365   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:58.906482   431 raft_consensus.cc:2243] T 331d1446396c45ce9486793ecb5de7f7 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.907079   431 raft_consensus.cc:2272] T 331d1446396c45ce9486793ecb5de7f7 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.910811   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:58.911831   431 raft_consensus.cc:2243] T 7937a8107df4458ebd48b5ce1589d788 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.913048   431 raft_consensus.cc:2272] T 7937a8107df4458ebd48b5ce1589d788 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.918092   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:58.919371   431 raft_consensus.cc:2243] T b94916f0e1e340a38f4a100f451fdaba P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.919986   431 raft_consensus.cc:2272] T b94916f0e1e340a38f4a100f451fdaba P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.924135   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:58.925292   431 raft_consensus.cc:2243] T a55798aa4230462f9befe5d7fc9bd3ce P 932245f14aac417f913cc7330a1833b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:58.926370   431 raft_consensus.cc:2272] T a55798aa4230462f9befe5d7fc9bd3ce P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.929500   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:58.930445   431 raft_consensus.cc:2243] T a25f8459a3644bfcaf8f9d71705b1c33 P 932245f14aac417f913cc7330a1833b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:58.931608   431 raft_consensus.cc:2272] T a25f8459a3644bfcaf8f9d71705b1c33 P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.934939   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:58.935855   431 raft_consensus.cc:2243] T f3a3d4fd34924b7c8ed0df6709391329 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.936466   431 raft_consensus.cc:2272] T f3a3d4fd34924b7c8ed0df6709391329 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.939857   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:58.940834   431 raft_consensus.cc:2243] T a8fbcbebcf87468f821e14a079bf305d P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.941576   431 raft_consensus.cc:2272] T a8fbcbebcf87468f821e14a079bf305d P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:58.941659  9364 consensus_peers.cc:597] T a8fbcbebcf87468f821e14a079bf305d P a91e8b10a5984dec9d3777a7275cef49 -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:58.945385  9512 consensus_peers.cc:597] T b31d08e4168243f08eb2a31031a039ed P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:58.947234   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:04:58.947772  9512 consensus_peers.cc:597] T 17d57808c20741cd85b0e175935cdab7 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:58.948205   431 raft_consensus.cc:2243] T 93877deb770d41a6ba34cefdea146d54 P 932245f14aac417f913cc7330a1833b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:58.949362   431 raft_consensus.cc:2272] T 93877deb770d41a6ba34cefdea146d54 P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.952939   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:58.954041   431 raft_consensus.cc:2243] T ad58816d959840df923159e870cf4ad8 P 932245f14aac417f913cc7330a1833b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:58.955236   431 raft_consensus.cc:2272] T ad58816d959840df923159e870cf4ad8 P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:58.958074  9512 consensus_peers.cc:597] T 803c43e83ee5487590c9d922559adc0f P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:58.958890   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:58.960068   431 raft_consensus.cc:2243] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:58.961184   431 raft_consensus.cc:2272] T 3c53f31a2697499cb5ad2d5bb6715f02 P 932245f14aac417f913cc7330a1833b8 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:58.961390  9438 consensus_peers.cc:597] T 63d5c2ea967a4c1586216c60202c5514 P ef5fe58eb3e04ae18fda957b4d507eff -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:58.963757  9512 consensus_peers.cc:597] T 5cfc1f2582a64d8dbc3f127e15024ec0 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:58.964854   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:58.965924   431 raft_consensus.cc:2243] T 846ce8cad343420485af76370f029d54 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:58.966173  9438 consensus_peers.cc:597] T 65ba9982e9bd4177995544e13394911a P ef5fe58eb3e04ae18fda957b4d507eff -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:58.966574   431 raft_consensus.cc:2272] T 846ce8cad343420485af76370f029d54 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.969365   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:58.970347   431 raft_consensus.cc:2243] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.970952   431 raft_consensus.cc:2272] T 63d5c2ea967a4c1586216c60202c5514 P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.974202   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:58.975100   431 raft_consensus.cc:2243] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.975672   431 raft_consensus.cc:2272] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:58.976492  9438 consensus_peers.cc:597] T e7d162d34de74e47895dac207e265059 P ef5fe58eb3e04ae18fda957b4d507eff -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:58.978905   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:58.979960   431 raft_consensus.cc:2243] T 1a5145e5f9a64fe0acdd74d909e841fc P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.980603   431 raft_consensus.cc:2272] T 1a5145e5f9a64fe0acdd74d909e841fc P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:58.982736  9512 consensus_peers.cc:597] T 3bd9c3f12cc546ff905df61c5a9028f6 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:58.983757   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:58.984525   431 raft_consensus.cc:2243] T 02c431d6db7643adbb4b26a3c7e38b76 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.985033   431 raft_consensus.cc:2272] T 02c431d6db7643adbb4b26a3c7e38b76 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.987614   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:58.988420   431 raft_consensus.cc:2243] T 5cfc1f2582a64d8dbc3f127e15024ec0 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.988890   431 raft_consensus.cc:2272] T 5cfc1f2582a64d8dbc3f127e15024ec0 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.992063   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:58.992741   431 raft_consensus.cc:2243] T 3bd9c3f12cc546ff905df61c5a9028f6 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.993270   431 raft_consensus.cc:2272] T 3bd9c3f12cc546ff905df61c5a9028f6 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.995364   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:58.996047   431 raft_consensus.cc:2243] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.996667   431 raft_consensus.cc:2272] T 9b34d97496514d29a27c52d749609084 P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.998943   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:58.999598   431 raft_consensus.cc:2243] T 9a8ed4502cb447c7b2cb94c96dcb7daf P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.000098   431 raft_consensus.cc:2272] T 9a8ed4502cb447c7b2cb94c96dcb7daf P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.002470   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:59.003181   431 raft_consensus.cc:2243] T e97eecc3acdf46a5b5577416f7bfe336 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.003629   431 raft_consensus.cc:2272] T e97eecc3acdf46a5b5577416f7bfe336 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.005865   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:59.006477   431 raft_consensus.cc:2243] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:59.007362   431 raft_consensus.cc:2272] T d8bd3f903abb4dd99431dbf597c0d462 P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.009889   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:59.010686   431 raft_consensus.cc:2243] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:59.011590   431 raft_consensus.cc:2272] T a6f012a5e95f4006871d83f7b18e356b P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:59.011722  9512 consensus_peers.cc:597] T 774befa616254c02901f28edde6ab758 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:59.014092   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:59.014799   431 raft_consensus.cc:2243] T 774befa616254c02901f28edde6ab758 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.015338   431 raft_consensus.cc:2272] T 774befa616254c02901f28edde6ab758 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.018141   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:59.018800   431 raft_consensus.cc:2243] T b305803a339e40f99c1a6af7f6f84f7c P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.019378   431 raft_consensus.cc:2272] T b305803a339e40f99c1a6af7f6f84f7c P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.022537   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:59.023579   431 raft_consensus.cc:2243] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:59.024677   431 raft_consensus.cc:2272] T b90aae84687f41e99e58dada706ae2d7 P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:59.027565  9438 consensus_peers.cc:597] T 73b8fed487d54513b9256d4c1a39cfa0 P ef5fe58eb3e04ae18fda957b4d507eff -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:59.028306   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:59.028982   431 raft_consensus.cc:2243] T ff040bb60327424d8aeec71e3bf58a0a P 932245f14aac417f913cc7330a1833b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:59.029829   431 raft_consensus.cc:2272] T ff040bb60327424d8aeec71e3bf58a0a P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.032621   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:59.033339   431 raft_consensus.cc:2243] T 879fbf42aa3c4c21a58f094d1a2b91e7 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.033834   431 raft_consensus.cc:2272] T 879fbf42aa3c4c21a58f094d1a2b91e7 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:59.035254  9364 consensus_peers.cc:597] T 846ce8cad343420485af76370f029d54 P a91e8b10a5984dec9d3777a7275cef49 -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:59.036141   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:59.036823   431 raft_consensus.cc:2243] T 73b8fed487d54513b9256d4c1a39cfa0 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.037258   431 raft_consensus.cc:2272] T 73b8fed487d54513b9256d4c1a39cfa0 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.039898   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:59.040659   431 raft_consensus.cc:2243] T b2a7ad91c8474397bae23c993b89fca4 P 932245f14aac417f913cc7330a1833b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:59.041654   431 raft_consensus.cc:2272] T b2a7ad91c8474397bae23c993b89fca4 P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.043984   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:59.044575   431 raft_consensus.cc:2243] T 803c43e83ee5487590c9d922559adc0f P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.045179   431 raft_consensus.cc:2272] T 803c43e83ee5487590c9d922559adc0f P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.047320   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:59.047933   431 raft_consensus.cc:2243] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P 932245f14aac417f913cc7330a1833b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:59.048733   431 raft_consensus.cc:2272] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.050925   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:59.051653   431 raft_consensus.cc:2243] T 8dfdb24cbc824b95ac65712323103e2a P 932245f14aac417f913cc7330a1833b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:59.052439   431 raft_consensus.cc:2272] T 8dfdb24cbc824b95ac65712323103e2a P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.055130   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:59.056013   431 raft_consensus.cc:2243] T 8528ae822cb04615a9dbd1166b7d7328 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.056696   431 raft_consensus.cc:2272] T 8528ae822cb04615a9dbd1166b7d7328 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:59.058101  9364 consensus_peers.cc:597] T b94916f0e1e340a38f4a100f451fdaba P a91e8b10a5984dec9d3777a7275cef49 -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:59.060043   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:59.060992   431 raft_consensus.cc:2243] T e7d162d34de74e47895dac207e265059 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.061647   431 raft_consensus.cc:2272] T e7d162d34de74e47895dac207e265059 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.064417   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:59.065047   431 raft_consensus.cc:2243] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.065601   431 raft_consensus.cc:2272] T 58d4c6d168b449f98425d091c54cddb9 P 932245f14aac417f913cc7330a1833b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.067844   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:59.068578   431 raft_consensus.cc:2243] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:59.069546   431 raft_consensus.cc:2272] T 8c1e5b4bc1bc437884e6835b61227d4d P 932245f14aac417f913cc7330a1833b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.072410   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:59.072970   431 raft_consensus.cc:2243] T 6f213937fc9b4030a228a8e56ed80f52 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.073414   431 raft_consensus.cc:2272] T 6f213937fc9b4030a228a8e56ed80f52 P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.075939   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:59.076579   431 raft_consensus.cc:2243] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:59.077607   431 raft_consensus.cc:2272] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P 932245f14aac417f913cc7330a1833b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.080358   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:59.080976   431 raft_consensus.cc:2243] T b31d08e4168243f08eb2a31031a039ed P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.081557   431 raft_consensus.cc:2272] T b31d08e4168243f08eb2a31031a039ed P 932245f14aac417f913cc7330a1833b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:59.091248  9438 consensus_peers.cc:597] T 9a8ed4502cb447c7b2cb94c96dcb7daf P ef5fe58eb3e04ae18fda957b4d507eff -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:59.097679  9438 consensus_peers.cc:597] T 8528ae822cb04615a9dbd1166b7d7328 P ef5fe58eb3e04ae18fda957b4d507eff -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:59.101353  9512 consensus_peers.cc:597] T 02c431d6db7643adbb4b26a3c7e38b76 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:59.104449  9512 consensus_peers.cc:597] T 6f213937fc9b4030a228a8e56ed80f52 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:59.128157  9512 consensus_peers.cc:597] T 225ca60d9645490dbcdcf6d4d127d955 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:59.154289  9438 consensus_peers.cc:597] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P ef5fe58eb3e04ae18fda957b4d507eff -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:59.163482  9364 consensus_peers.cc:597] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49 -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:59.164290  9364 consensus_peers.cc:597] T e97eecc3acdf46a5b5577416f7bfe336 P a91e8b10a5984dec9d3777a7275cef49 -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:59.165161   431 tablet_server.cc:196] TabletServer@127.0.107.193:37633 shutdown complete.
W20260709 13:04:59.212411  9364 consensus_peers.cc:597] T 1a5145e5f9a64fe0acdd74d909e841fc P a91e8b10a5984dec9d3777a7275cef49 -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:59.217465  9438 consensus_peers.cc:597] T 8f602c194d1c445ba1851f0a2272b40b P ef5fe58eb3e04ae18fda957b4d507eff -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:59.247213  9364 consensus_peers.cc:597] T 7937a8107df4458ebd48b5ce1589d788 P a91e8b10a5984dec9d3777a7275cef49 -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:59.264238  9364 consensus_peers.cc:597] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49 -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:59.266074   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:04:59.302503  9510 consensus_peers.cc:597] T a541a15041a3493dab6cbe921d81d1d7 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607): Couldn't send request to peer a91e8b10a5984dec9d3777a7275cef49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:59.322019  9512 consensus_peers.cc:597] T b305803a339e40f99c1a6af7f6f84f7c P dfbbb80ab8e345e0ae1684fafefceccf -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:59.326725   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:59.327855   431 tablet_replica.cc:333] T 8e017796f5c643859d8a0e1916ab3f05 P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
I20260709 13:04:59.329160   431 raft_consensus.cc:2243] T 8e017796f5c643859d8a0e1916ab3f05 P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:59.330339   431 raft_consensus.cc:2272] T 8e017796f5c643859d8a0e1916ab3f05 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.333348   431 tablet_replica.cc:333] T 8528ae822cb04615a9dbd1166b7d7328 P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
I20260709 13:04:59.334158   431 raft_consensus.cc:2243] T 8528ae822cb04615a9dbd1166b7d7328 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.334744   431 raft_consensus.cc:2272] T 8528ae822cb04615a9dbd1166b7d7328 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:59.335224  9438 consensus_peers.cc:597] T a792fefbeb0c4eb79e87501fb6dbe780 P ef5fe58eb3e04ae18fda957b4d507eff -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:59.336911   431 tablet_replica.cc:333] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
I20260709 13:04:59.337626   431 raft_consensus.cc:2243] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.338068   431 raft_consensus.cc:2272] T 8dfdb24cbc824b95ac65712323103e2a P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.340101   431 tablet_replica.cc:333] T 8f602c194d1c445ba1851f0a2272b40b P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
I20260709 13:04:59.340795   431 raft_consensus.cc:2243] T 8f602c194d1c445ba1851f0a2272b40b P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.341334   431 raft_consensus.cc:2272] T 8f602c194d1c445ba1851f0a2272b40b P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.344528   431 tablet_replica.cc:333] T a792fefbeb0c4eb79e87501fb6dbe780 P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
W20260709 13:04:59.344630  9436 consensus_peers.cc:597] T ab069642e354446db85dabd0cedd7eec P ef5fe58eb3e04ae18fda957b4d507eff -> Peer a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607): Couldn't send request to peer a91e8b10a5984dec9d3777a7275cef49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:59.345571   431 raft_consensus.cc:2243] T a792fefbeb0c4eb79e87501fb6dbe780 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.346292   431 raft_consensus.cc:2272] T a792fefbeb0c4eb79e87501fb6dbe780 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:59.347486  9438 consensus_peers.cc:597] T f3a3d4fd34924b7c8ed0df6709391329 P ef5fe58eb3e04ae18fda957b4d507eff -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:59.349782   431 tablet_replica.cc:333] T a25f8459a3644bfcaf8f9d71705b1c33 P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
W20260709 13:04:59.350483  9436 consensus_peers.cc:597] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P ef5fe58eb3e04ae18fda957b4d507eff -> Peer a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607): Couldn't send request to peer a91e8b10a5984dec9d3777a7275cef49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:59.350826   431 raft_consensus.cc:2243] T a25f8459a3644bfcaf8f9d71705b1c33 P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.351487   431 raft_consensus.cc:2272] T a25f8459a3644bfcaf8f9d71705b1c33 P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.354493   431 tablet_replica.cc:333] T b305803a339e40f99c1a6af7f6f84f7c P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
I20260709 13:04:59.355198   431 raft_consensus.cc:2243] T b305803a339e40f99c1a6af7f6f84f7c P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.355667   431 raft_consensus.cc:2272] T b305803a339e40f99c1a6af7f6f84f7c P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.358127   431 tablet_replica.cc:333] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
I20260709 13:04:59.359195   431 raft_consensus.cc:2243] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:59.360244   431 raft_consensus.cc:2272] T 93a7d590cbac4b6da413dd8ea2a26225 P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.363417   431 tablet_replica.cc:333] T 074269f6e5f843be8a85be8b70707304 P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
I20260709 13:04:59.364275   431 raft_consensus.cc:2243] T 074269f6e5f843be8a85be8b70707304 P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:59.365556   431 raft_consensus.cc:2272] T 074269f6e5f843be8a85be8b70707304 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:59.366508  9510 consensus_peers.cc:597] T 774befa616254c02901f28edde6ab758 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607): Couldn't send request to peer a91e8b10a5984dec9d3777a7275cef49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:59.368621   431 tablet_replica.cc:333] T a541a15041a3493dab6cbe921d81d1d7 P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
W20260709 13:04:59.369127  9438 consensus_peers.cc:597] T 879fbf42aa3c4c21a58f094d1a2b91e7 P ef5fe58eb3e04ae18fda957b4d507eff -> Peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Couldn't send request to peer 932245f14aac417f913cc7330a1833b8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:59.369669   431 raft_consensus.cc:2243] T a541a15041a3493dab6cbe921d81d1d7 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.370292   431 raft_consensus.cc:2272] T a541a15041a3493dab6cbe921d81d1d7 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:59.372989  9436 consensus_peers.cc:597] T 8528ae822cb04615a9dbd1166b7d7328 P ef5fe58eb3e04ae18fda957b4d507eff -> Peer a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607): Couldn't send request to peer a91e8b10a5984dec9d3777a7275cef49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:59.373697   431 tablet_replica.cc:333] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
I20260709 13:04:59.374617   431 raft_consensus.cc:2243] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:04:59.374773  9436 consensus_peers.cc:597] T 890ffb7e0f6b463f8d8771d5cd9481c9 P ef5fe58eb3e04ae18fda957b4d507eff -> Peer a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607): Couldn't send request to peer a91e8b10a5984dec9d3777a7275cef49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:59.375450   431 raft_consensus.cc:2272] T 58d4c6d168b449f98425d091c54cddb9 P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.377656   431 tablet_replica.cc:333] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
I20260709 13:04:59.378288   431 raft_consensus.cc:2243] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.378720   431 raft_consensus.cc:2272] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.381042   431 tablet_replica.cc:333] T 85d647b0abf74fbebc7e9a9bfe14b8ea P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
I20260709 13:04:59.381753   431 raft_consensus.cc:2243] T 85d647b0abf74fbebc7e9a9bfe14b8ea P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.382206   431 raft_consensus.cc:2272] T 85d647b0abf74fbebc7e9a9bfe14b8ea P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.384382   431 tablet_replica.cc:333] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
I20260709 13:04:59.384999   431 raft_consensus.cc:2243] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.385514   431 raft_consensus.cc:2272] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.387804   431 tablet_replica.cc:333] T 846ce8cad343420485af76370f029d54 P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
I20260709 13:04:59.388444   431 raft_consensus.cc:2243] T 846ce8cad343420485af76370f029d54 P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:59.389391   431 raft_consensus.cc:2272] T 846ce8cad343420485af76370f029d54 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.391582   431 tablet_replica.cc:333] T 63d5c2ea967a4c1586216c60202c5514 P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
I20260709 13:04:59.392180   431 raft_consensus.cc:2243] T 63d5c2ea967a4c1586216c60202c5514 P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.392722   431 raft_consensus.cc:2272] T 63d5c2ea967a4c1586216c60202c5514 P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.395562   431 tablet_replica.cc:333] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
I20260709 13:04:59.396456   431 raft_consensus.cc:2243] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.397058   431 raft_consensus.cc:2272] T a55798aa4230462f9befe5d7fc9bd3ce P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.399873   431 tablet_replica.cc:333] T a6f012a5e95f4006871d83f7b18e356b P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
I20260709 13:04:59.400591   431 raft_consensus.cc:2243] T a6f012a5e95f4006871d83f7b18e356b P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.401151   431 raft_consensus.cc:2272] T a6f012a5e95f4006871d83f7b18e356b P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.403862   431 tablet_replica.cc:333] T 24abd32dde1f44c7af83b9344e632ab0 P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
I20260709 13:04:59.404541   431 raft_consensus.cc:2243] T 24abd32dde1f44c7af83b9344e632ab0 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.405164   431 raft_consensus.cc:2272] T 24abd32dde1f44c7af83b9344e632ab0 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.407862   431 tablet_replica.cc:333] T 774befa616254c02901f28edde6ab758 P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
I20260709 13:04:59.408538   431 raft_consensus.cc:2243] T 774befa616254c02901f28edde6ab758 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.409121   431 raft_consensus.cc:2272] T 774befa616254c02901f28edde6ab758 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:59.409963  9510 consensus_peers.cc:597] T b305803a339e40f99c1a6af7f6f84f7c P dfbbb80ab8e345e0ae1684fafefceccf -> Peer a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607): Couldn't send request to peer a91e8b10a5984dec9d3777a7275cef49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:59.412039   431 tablet_replica.cc:333] T ab069642e354446db85dabd0cedd7eec P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
I20260709 13:04:59.413035   431 raft_consensus.cc:2243] T ab069642e354446db85dabd0cedd7eec P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.413607   431 raft_consensus.cc:2272] T ab069642e354446db85dabd0cedd7eec P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.416007   431 tablet_replica.cc:333] T 7937a8107df4458ebd48b5ce1589d788 P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
I20260709 13:04:59.416721   431 raft_consensus.cc:2243] T 7937a8107df4458ebd48b5ce1589d788 P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:59.417716   431 raft_consensus.cc:2272] T 7937a8107df4458ebd48b5ce1589d788 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:59.418949  9436 consensus_peers.cc:597] T 879fbf42aa3c4c21a58f094d1a2b91e7 P ef5fe58eb3e04ae18fda957b4d507eff -> Peer a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607): Couldn't send request to peer a91e8b10a5984dec9d3777a7275cef49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:59.419696  9436 consensus_peers.cc:597] T 63d5c2ea967a4c1586216c60202c5514 P ef5fe58eb3e04ae18fda957b4d507eff -> Peer a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607): Couldn't send request to peer a91e8b10a5984dec9d3777a7275cef49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:59.421206   431 tablet_replica.cc:333] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
I20260709 13:04:59.422196   431 raft_consensus.cc:2243] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P a91e8b10a5984dec9d3777a7275cef49 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.422797   431 raft_consensus.cc:2272] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P a91e8b10a5984dec9d3777a7275cef49 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.425866   431 tablet_replica.cc:333] T b31d08e4168243f08eb2a31031a039ed P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
I20260709 13:04:59.426826   431 raft_consensus.cc:2243] T b31d08e4168243f08eb2a31031a039ed P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.427400   431 raft_consensus.cc:2272] T b31d08e4168243f08eb2a31031a039ed P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.430410   431 tablet_replica.cc:333] T a8fbcbebcf87468f821e14a079bf305d P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
I20260709 13:04:59.431263   431 raft_consensus.cc:2243] T a8fbcbebcf87468f821e14a079bf305d P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:59.432214   431 raft_consensus.cc:2272] T a8fbcbebcf87468f821e14a079bf305d P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.435599   431 tablet_replica.cc:333] T 879fbf42aa3c4c21a58f094d1a2b91e7 P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
I20260709 13:04:59.436378   431 raft_consensus.cc:2243] T 879fbf42aa3c4c21a58f094d1a2b91e7 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.437214   431 raft_consensus.cc:2272] T 879fbf42aa3c4c21a58f094d1a2b91e7 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.440551   431 tablet_replica.cc:333] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
W20260709 13:04:59.440847  9510 consensus_peers.cc:597] T 85d647b0abf74fbebc7e9a9bfe14b8ea P dfbbb80ab8e345e0ae1684fafefceccf -> Peer a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607): Couldn't send request to peer a91e8b10a5984dec9d3777a7275cef49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:59.441591   431 raft_consensus.cc:2243] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.442154   431 raft_consensus.cc:2272] T 3c53f31a2697499cb5ad2d5bb6715f02 P a91e8b10a5984dec9d3777a7275cef49 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.445020   431 tablet_replica.cc:333] T faf56b218e614e51962171088f3c4f63 P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
I20260709 13:04:59.445895   431 raft_consensus.cc:2243] T faf56b218e614e51962171088f3c4f63 P a91e8b10a5984dec9d3777a7275cef49 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:59.447062   431 raft_consensus.cc:2272] T faf56b218e614e51962171088f3c4f63 P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.449990   431 tablet_replica.cc:333] T 02c431d6db7643adbb4b26a3c7e38b76 P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
I20260709 13:04:59.450862   431 raft_consensus.cc:2243] T 02c431d6db7643adbb4b26a3c7e38b76 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.451429   431 raft_consensus.cc:2272] T 02c431d6db7643adbb4b26a3c7e38b76 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.454221   431 tablet_replica.cc:333] T 1a5145e5f9a64fe0acdd74d909e841fc P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
I20260709 13:04:59.454839   431 raft_consensus.cc:2243] T 1a5145e5f9a64fe0acdd74d909e841fc P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:59.455677   431 raft_consensus.cc:2272] T 1a5145e5f9a64fe0acdd74d909e841fc P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.458025   431 tablet_replica.cc:333] T 01a5f4a59c5e47bc8b7b11db44d80006 P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
I20260709 13:04:59.458657   431 raft_consensus.cc:2243] T 01a5f4a59c5e47bc8b7b11db44d80006 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.459172   431 raft_consensus.cc:2272] T 01a5f4a59c5e47bc8b7b11db44d80006 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.461876   431 tablet_replica.cc:333] T 120581d9b8ba40dd854cec64a671e394 P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
I20260709 13:04:59.462702   431 raft_consensus.cc:2243] T 120581d9b8ba40dd854cec64a671e394 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.463467   431 raft_consensus.cc:2272] T 120581d9b8ba40dd854cec64a671e394 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:59.464618  9510 consensus_peers.cc:597] T b31d08e4168243f08eb2a31031a039ed P dfbbb80ab8e345e0ae1684fafefceccf -> Peer a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607): Couldn't send request to peer a91e8b10a5984dec9d3777a7275cef49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:59.466632   431 tablet_replica.cc:333] T 03c7fe8d164d4b2c9015337d9b4b7081 P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
I20260709 13:04:59.467482   431 raft_consensus.cc:2243] T 03c7fe8d164d4b2c9015337d9b4b7081 P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:59.468693   431 raft_consensus.cc:2272] T 03c7fe8d164d4b2c9015337d9b4b7081 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:59.470170  9436 consensus_peers.cc:597] T a792fefbeb0c4eb79e87501fb6dbe780 P ef5fe58eb3e04ae18fda957b4d507eff -> Peer a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607): Couldn't send request to peer a91e8b10a5984dec9d3777a7275cef49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:59.471980   431 tablet_replica.cc:333] T 99fc4b4b16d0432390a92d5c04149ce1 P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
I20260709 13:04:59.472886   431 raft_consensus.cc:2243] T 99fc4b4b16d0432390a92d5c04149ce1 P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:59.473882   431 raft_consensus.cc:2272] T 99fc4b4b16d0432390a92d5c04149ce1 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:59.475972  9436 consensus_peers.cc:597] T 8f602c194d1c445ba1851f0a2272b40b P ef5fe58eb3e04ae18fda957b4d507eff -> Peer a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607): Couldn't send request to peer a91e8b10a5984dec9d3777a7275cef49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:59.476845   431 tablet_replica.cc:333] T 47b7a6191c374a6a84d8223c573fa318 P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
I20260709 13:04:59.477715   431 raft_consensus.cc:2243] T 47b7a6191c374a6a84d8223c573fa318 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.478173   431 raft_consensus.cc:2272] T 47b7a6191c374a6a84d8223c573fa318 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.480919   431 tablet_replica.cc:333] T 73b8fed487d54513b9256d4c1a39cfa0 P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
I20260709 13:04:59.481730   431 raft_consensus.cc:2243] T 73b8fed487d54513b9256d4c1a39cfa0 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.482266   431 raft_consensus.cc:2272] T 73b8fed487d54513b9256d4c1a39cfa0 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:59.482872  9436 consensus_peers.cc:597] T 24abd32dde1f44c7af83b9344e632ab0 P ef5fe58eb3e04ae18fda957b4d507eff -> Peer a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607): Couldn't send request to peer a91e8b10a5984dec9d3777a7275cef49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:59.484752   431 tablet_replica.cc:333] T e97eecc3acdf46a5b5577416f7bfe336 P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
I20260709 13:04:59.485526   431 raft_consensus.cc:2243] T e97eecc3acdf46a5b5577416f7bfe336 P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:59.486452   431 raft_consensus.cc:2272] T e97eecc3acdf46a5b5577416f7bfe336 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.489542   431 tablet_replica.cc:333] T 9b34d97496514d29a27c52d749609084 P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
I20260709 13:04:59.490296   431 raft_consensus.cc:2243] T 9b34d97496514d29a27c52d749609084 P a91e8b10a5984dec9d3777a7275cef49 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:59.491291   431 raft_consensus.cc:2272] T 9b34d97496514d29a27c52d749609084 P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.494185   431 tablet_replica.cc:333] T 9b19e51cda7e44e5a1f02a736e555ac4 P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
I20260709 13:04:59.495029   431 raft_consensus.cc:2243] T 9b19e51cda7e44e5a1f02a736e555ac4 P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:59.496012   431 raft_consensus.cc:2272] T 9b19e51cda7e44e5a1f02a736e555ac4 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:59.492657  9510 consensus_peers.cc:597] T 120581d9b8ba40dd854cec64a671e394 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607): Couldn't send request to peer a91e8b10a5984dec9d3777a7275cef49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:59.498864   431 tablet_replica.cc:333] T 5cfc1f2582a64d8dbc3f127e15024ec0 P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
I20260709 13:04:59.499732   431 raft_consensus.cc:2243] T 5cfc1f2582a64d8dbc3f127e15024ec0 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.500358   431 raft_consensus.cc:2272] T 5cfc1f2582a64d8dbc3f127e15024ec0 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.503506   431 tablet_replica.cc:333] T 8c1e5b4bc1bc437884e6835b61227d4d P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
I20260709 13:04:59.504215   431 raft_consensus.cc:2243] T 8c1e5b4bc1bc437884e6835b61227d4d P a91e8b10a5984dec9d3777a7275cef49 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.504773   431 raft_consensus.cc:2272] T 8c1e5b4bc1bc437884e6835b61227d4d P a91e8b10a5984dec9d3777a7275cef49 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.507699   431 tablet_replica.cc:333] T 890ffb7e0f6b463f8d8771d5cd9481c9 P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
W20260709 13:04:59.508399  9436 consensus_peers.cc:597] T 47b7a6191c374a6a84d8223c573fa318 P ef5fe58eb3e04ae18fda957b4d507eff -> Peer a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607): Couldn't send request to peer a91e8b10a5984dec9d3777a7275cef49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:59.508409   431 raft_consensus.cc:2243] T 890ffb7e0f6b463f8d8771d5cd9481c9 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.509331   431 raft_consensus.cc:2272] T 890ffb7e0f6b463f8d8771d5cd9481c9 P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:59.510257  9510 consensus_peers.cc:597] T 01a5f4a59c5e47bc8b7b11db44d80006 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607): Couldn't send request to peer a91e8b10a5984dec9d3777a7275cef49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:59.512367   431 tablet_replica.cc:333] T b94916f0e1e340a38f4a100f451fdaba P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
I20260709 13:04:59.513033   431 raft_consensus.cc:2243] T b94916f0e1e340a38f4a100f451fdaba P a91e8b10a5984dec9d3777a7275cef49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:59.513928   431 raft_consensus.cc:2272] T b94916f0e1e340a38f4a100f451fdaba P a91e8b10a5984dec9d3777a7275cef49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.516327   431 tablet_replica.cc:333] T ad58816d959840df923159e870cf4ad8 P a91e8b10a5984dec9d3777a7275cef49: stopping tablet replica
I20260709 13:04:59.516831   431 raft_consensus.cc:2243] T ad58816d959840df923159e870cf4ad8 P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.517355   431 raft_consensus.cc:2272] T ad58816d959840df923159e870cf4ad8 P a91e8b10a5984dec9d3777a7275cef49 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:59.518644  9436 consensus_peers.cc:597] T 73b8fed487d54513b9256d4c1a39cfa0 P ef5fe58eb3e04ae18fda957b4d507eff -> Peer a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607): Couldn't send request to peer a91e8b10a5984dec9d3777a7275cef49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:59.602761   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:04:59.631722  9510 consensus_peers.cc:597] T 02c431d6db7643adbb4b26a3c7e38b76 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607): Couldn't send request to peer a91e8b10a5984dec9d3777a7275cef49. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:59.691895   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:04:59.701267  9512 consensus_peers.cc:597] T 225ca60d9645490dbcdcf6d4d127d955 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Couldn't send request to peer ef5fe58eb3e04ae18fda957b4d507eff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:59.721567  9512 consensus_peers.cc:597] T 803c43e83ee5487590c9d922559adc0f P dfbbb80ab8e345e0ae1684fafefceccf -> Peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Couldn't send request to peer ef5fe58eb3e04ae18fda957b4d507eff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:59.736582   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:59.737574   431 tablet_replica.cc:333] T 8e017796f5c643859d8a0e1916ab3f05 P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.738648   431 raft_consensus.cc:2243] T 8e017796f5c643859d8a0e1916ab3f05 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.739118   431 raft_consensus.cc:2272] T 8e017796f5c643859d8a0e1916ab3f05 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.741317   431 tablet_replica.cc:333] T b90aae84687f41e99e58dada706ae2d7 P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.741971   431 raft_consensus.cc:2243] T b90aae84687f41e99e58dada706ae2d7 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.742435   431 raft_consensus.cc:2272] T b90aae84687f41e99e58dada706ae2d7 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.744999   431 tablet_replica.cc:333] T 890ffb7e0f6b463f8d8771d5cd9481c9 P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.745977   431 raft_consensus.cc:2243] T 890ffb7e0f6b463f8d8771d5cd9481c9 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:59.747076   431 raft_consensus.cc:2272] T 890ffb7e0f6b463f8d8771d5cd9481c9 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.750051   431 tablet_replica.cc:333] T 8f602c194d1c445ba1851f0a2272b40b P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.750711   431 raft_consensus.cc:2243] T 8f602c194d1c445ba1851f0a2272b40b P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:59.751677   431 raft_consensus.cc:2272] T 8f602c194d1c445ba1851f0a2272b40b P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.756008   431 tablet_replica.cc:333] T 9b19e51cda7e44e5a1f02a736e555ac4 P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.756907   431 raft_consensus.cc:2243] T 9b19e51cda7e44e5a1f02a736e555ac4 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.757473   431 raft_consensus.cc:2272] T 9b19e51cda7e44e5a1f02a736e555ac4 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.760321   431 tablet_replica.cc:333] T 3bd9c3f12cc546ff905df61c5a9028f6 P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.761173   431 raft_consensus.cc:2243] T 3bd9c3f12cc546ff905df61c5a9028f6 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.761740   431 raft_consensus.cc:2272] T 3bd9c3f12cc546ff905df61c5a9028f6 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.764648   431 tablet_replica.cc:333] T a792fefbeb0c4eb79e87501fb6dbe780 P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.765552   431 raft_consensus.cc:2243] T a792fefbeb0c4eb79e87501fb6dbe780 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:59.766448   431 raft_consensus.cc:2272] T a792fefbeb0c4eb79e87501fb6dbe780 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.768900   431 tablet_replica.cc:333] T 65ba9982e9bd4177995544e13394911a P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.769493   431 raft_consensus.cc:2243] T 65ba9982e9bd4177995544e13394911a P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:59.770215   431 raft_consensus.cc:2272] T 65ba9982e9bd4177995544e13394911a P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.772330   431 tablet_replica.cc:333] T 93a7d590cbac4b6da413dd8ea2a26225 P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.773032   431 raft_consensus.cc:2243] T 93a7d590cbac4b6da413dd8ea2a26225 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.773572   431 raft_consensus.cc:2272] T 93a7d590cbac4b6da413dd8ea2a26225 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.775588   431 tablet_replica.cc:333] T 58d4c6d168b449f98425d091c54cddb9 P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.776336   431 raft_consensus.cc:2243] T 58d4c6d168b449f98425d091c54cddb9 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.776787   431 raft_consensus.cc:2272] T 58d4c6d168b449f98425d091c54cddb9 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.778854   431 tablet_replica.cc:333] T 074269f6e5f843be8a85be8b70707304 P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.779394   431 raft_consensus.cc:2243] T 074269f6e5f843be8a85be8b70707304 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.779793   431 raft_consensus.cc:2272] T 074269f6e5f843be8a85be8b70707304 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.781912   431 tablet_replica.cc:333] T 6f213937fc9b4030a228a8e56ed80f52 P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.782534   431 raft_consensus.cc:2243] T 6f213937fc9b4030a228a8e56ed80f52 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.783048   431 raft_consensus.cc:2272] T 6f213937fc9b4030a228a8e56ed80f52 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.785987   431 tablet_replica.cc:333] T 803c43e83ee5487590c9d922559adc0f P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.786722   431 raft_consensus.cc:2243] T 803c43e83ee5487590c9d922559adc0f P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.787320   431 raft_consensus.cc:2272] T 803c43e83ee5487590c9d922559adc0f P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.789567   431 tablet_replica.cc:333] T b2a7ad91c8474397bae23c993b89fca4 P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.790182   431 raft_consensus.cc:2243] T b2a7ad91c8474397bae23c993b89fca4 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.790611   431 raft_consensus.cc:2272] T b2a7ad91c8474397bae23c993b89fca4 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.792563   431 tablet_replica.cc:333] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.793304   431 raft_consensus.cc:2243] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.793813   431 raft_consensus.cc:2272] T 64bc8ad603604e0d9c8eb9d37ef4aed5 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.795784   431 tablet_replica.cc:333] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.796406   431 raft_consensus.cc:2243] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.796834   431 raft_consensus.cc:2272] T 2d5b6e6fcfb04bc3bb6cc0270e14e0cd P ef5fe58eb3e04ae18fda957b4d507eff [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.798826   431 tablet_replica.cc:333] T 85d647b0abf74fbebc7e9a9bfe14b8ea P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.799412   431 raft_consensus.cc:2243] T 85d647b0abf74fbebc7e9a9bfe14b8ea P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.799839   431 raft_consensus.cc:2272] T 85d647b0abf74fbebc7e9a9bfe14b8ea P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.801815   431 tablet_replica.cc:333] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.802379   431 raft_consensus.cc:2243] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:59.803200   431 raft_consensus.cc:2272] T a99d222cbc8341f7ac9a4b2e7eb7e5f0 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.805330   431 tablet_replica.cc:333] T 846ce8cad343420485af76370f029d54 P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.805896   431 raft_consensus.cc:2243] T 846ce8cad343420485af76370f029d54 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.806324   431 raft_consensus.cc:2272] T 846ce8cad343420485af76370f029d54 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.808391   431 tablet_replica.cc:333] T 63d5c2ea967a4c1586216c60202c5514 P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.808979   431 raft_consensus.cc:2243] T 63d5c2ea967a4c1586216c60202c5514 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:59.809824   431 raft_consensus.cc:2272] T 63d5c2ea967a4c1586216c60202c5514 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.813589   431 tablet_replica.cc:333] T 9b34d97496514d29a27c52d749609084 P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.814731   431 raft_consensus.cc:2243] T 9b34d97496514d29a27c52d749609084 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.815328   431 raft_consensus.cc:2272] T 9b34d97496514d29a27c52d749609084 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.818336   431 tablet_replica.cc:333] T 9a8ed4502cb447c7b2cb94c96dcb7daf P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.819093   431 raft_consensus.cc:2243] T 9a8ed4502cb447c7b2cb94c96dcb7daf P ef5fe58eb3e04ae18fda957b4d507eff [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:59.820133   431 raft_consensus.cc:2272] T 9a8ed4502cb447c7b2cb94c96dcb7daf P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.823024   431 tablet_replica.cc:333] T d8bd3f903abb4dd99431dbf597c0d462 P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.823872   431 raft_consensus.cc:2243] T d8bd3f903abb4dd99431dbf597c0d462 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.824389   431 raft_consensus.cc:2272] T d8bd3f903abb4dd99431dbf597c0d462 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.827668   431 tablet_replica.cc:333] T 24abd32dde1f44c7af83b9344e632ab0 P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.828327   431 raft_consensus.cc:2243] T 24abd32dde1f44c7af83b9344e632ab0 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:59.829636   431 raft_consensus.cc:2272] T 24abd32dde1f44c7af83b9344e632ab0 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.832697   431 tablet_replica.cc:333] T ab069642e354446db85dabd0cedd7eec P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.833407   431 raft_consensus.cc:2243] T ab069642e354446db85dabd0cedd7eec P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:59.834254   431 raft_consensus.cc:2272] T ab069642e354446db85dabd0cedd7eec P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.836678   431 tablet_replica.cc:333] T 7937a8107df4458ebd48b5ce1589d788 P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.837328   431 raft_consensus.cc:2243] T 7937a8107df4458ebd48b5ce1589d788 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.837780   431 raft_consensus.cc:2272] T 7937a8107df4458ebd48b5ce1589d788 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.839711   431 tablet_replica.cc:333] T 225ca60d9645490dbcdcf6d4d127d955 P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.840265   431 raft_consensus.cc:2243] T 225ca60d9645490dbcdcf6d4d127d955 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.840701   431 raft_consensus.cc:2272] T 225ca60d9645490dbcdcf6d4d127d955 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.843009   431 tablet_replica.cc:333] T 331d1446396c45ce9486793ecb5de7f7 P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.843585   431 raft_consensus.cc:2243] T 331d1446396c45ce9486793ecb5de7f7 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.844041   431 raft_consensus.cc:2272] T 331d1446396c45ce9486793ecb5de7f7 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.846267   431 tablet_replica.cc:333] T faf56b218e614e51962171088f3c4f63 P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.846909   431 raft_consensus.cc:2243] T faf56b218e614e51962171088f3c4f63 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.847427   431 raft_consensus.cc:2272] T faf56b218e614e51962171088f3c4f63 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.850163   431 tablet_replica.cc:333] T 120581d9b8ba40dd854cec64a671e394 P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.850986   431 raft_consensus.cc:2243] T 120581d9b8ba40dd854cec64a671e394 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.851572   431 raft_consensus.cc:2272] T 120581d9b8ba40dd854cec64a671e394 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.854121   431 tablet_replica.cc:333] T 01a5f4a59c5e47bc8b7b11db44d80006 P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.854959   431 raft_consensus.cc:2243] T 01a5f4a59c5e47bc8b7b11db44d80006 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.855481   431 raft_consensus.cc:2272] T 01a5f4a59c5e47bc8b7b11db44d80006 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.858312   431 tablet_replica.cc:333] T 03c7fe8d164d4b2c9015337d9b4b7081 P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
W20260709 13:04:59.858811  9510 consensus_peers.cc:597] T 5cfc1f2582a64d8dbc3f127e15024ec0 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607): Couldn't send request to peer a91e8b10a5984dec9d3777a7275cef49. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:59.859112   431 raft_consensus.cc:2243] T 03c7fe8d164d4b2c9015337d9b4b7081 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.859867   431 raft_consensus.cc:2272] T 03c7fe8d164d4b2c9015337d9b4b7081 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:59.860419  9512 consensus_peers.cc:597] T 85d647b0abf74fbebc7e9a9bfe14b8ea P dfbbb80ab8e345e0ae1684fafefceccf -> Peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Couldn't send request to peer ef5fe58eb3e04ae18fda957b4d507eff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:59.862406   431 tablet_replica.cc:333] T 99fc4b4b16d0432390a92d5c04149ce1 P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.863130   431 raft_consensus.cc:2243] T 99fc4b4b16d0432390a92d5c04149ce1 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.863701   431 raft_consensus.cc:2272] T 99fc4b4b16d0432390a92d5c04149ce1 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.866345   431 tablet_replica.cc:333] T 8528ae822cb04615a9dbd1166b7d7328 P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.866993   431 raft_consensus.cc:2243] T 8528ae822cb04615a9dbd1166b7d7328 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:59.867986   431 raft_consensus.cc:2272] T 8528ae822cb04615a9dbd1166b7d7328 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.870756   431 tablet_replica.cc:333] T e7d162d34de74e47895dac207e265059 P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.871430   431 raft_consensus.cc:2243] T e7d162d34de74e47895dac207e265059 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:59.872253   431 raft_consensus.cc:2272] T e7d162d34de74e47895dac207e265059 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.874384   431 tablet_replica.cc:333] T 93877deb770d41a6ba34cefdea146d54 P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.874948   431 raft_consensus.cc:2243] T 93877deb770d41a6ba34cefdea146d54 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.875530   431 raft_consensus.cc:2272] T 93877deb770d41a6ba34cefdea146d54 P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.877530   431 tablet_replica.cc:333] T 47b7a6191c374a6a84d8223c573fa318 P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.878093   431 raft_consensus.cc:2243] T 47b7a6191c374a6a84d8223c573fa318 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:59.879004   431 raft_consensus.cc:2272] T 47b7a6191c374a6a84d8223c573fa318 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.881233   431 tablet_replica.cc:333] T 73b8fed487d54513b9256d4c1a39cfa0 P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.881778   431 raft_consensus.cc:2243] T 73b8fed487d54513b9256d4c1a39cfa0 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:59.882599   431 raft_consensus.cc:2272] T 73b8fed487d54513b9256d4c1a39cfa0 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.885289   431 tablet_replica.cc:333] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.885849   431 raft_consensus.cc:2243] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.886312   431 raft_consensus.cc:2272] T 8c1e5b4bc1bc437884e6835b61227d4d P ef5fe58eb3e04ae18fda957b4d507eff [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.888695   431 tablet_replica.cc:333] T f3a3d4fd34924b7c8ed0df6709391329 P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.889312   431 raft_consensus.cc:2243] T f3a3d4fd34924b7c8ed0df6709391329 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:59.890137   431 raft_consensus.cc:2272] T f3a3d4fd34924b7c8ed0df6709391329 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.892727   431 tablet_replica.cc:333] T a541a15041a3493dab6cbe921d81d1d7 P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.893360   431 raft_consensus.cc:2243] T a541a15041a3493dab6cbe921d81d1d7 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.893874   431 raft_consensus.cc:2272] T a541a15041a3493dab6cbe921d81d1d7 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.896919   431 tablet_replica.cc:333] T 17d57808c20741cd85b0e175935cdab7 P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.897668   431 raft_consensus.cc:2243] T 17d57808c20741cd85b0e175935cdab7 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.898161   431 raft_consensus.cc:2272] T 17d57808c20741cd85b0e175935cdab7 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.900290   431 tablet_replica.cc:333] T ff040bb60327424d8aeec71e3bf58a0a P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.900969   431 raft_consensus.cc:2243] T ff040bb60327424d8aeec71e3bf58a0a P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:59.901521   431 raft_consensus.cc:2272] T ff040bb60327424d8aeec71e3bf58a0a P ef5fe58eb3e04ae18fda957b4d507eff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.903882   431 tablet_replica.cc:333] T 879fbf42aa3c4c21a58f094d1a2b91e7 P ef5fe58eb3e04ae18fda957b4d507eff: stopping tablet replica
I20260709 13:04:59.904451   431 raft_consensus.cc:2243] T 879fbf42aa3c4c21a58f094d1a2b91e7 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:59.905623   431 raft_consensus.cc:2272] T 879fbf42aa3c4c21a58f094d1a2b91e7 P ef5fe58eb3e04ae18fda957b4d507eff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:59.947897 10435 raft_consensus.cc:493] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 932245f14aac417f913cc7330a1833b8)
I20260709 13:04:59.948503 10435 raft_consensus.cc:515] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:04:59.950515 10435 leader_election.cc:290] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
W20260709 13:04:59.952250  9512 consensus_peers.cc:597] T 120581d9b8ba40dd854cec64a671e394 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Couldn't send request to peer ef5fe58eb3e04ae18fda957b4d507eff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:59.954538  9512 leader_election.cc:336] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:04:59.955307  9512 leader_election.cc:336] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111)
I20260709 13:04:59.955668  9512 leader_election.cc:304] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf; no voters: 932245f14aac417f913cc7330a1833b8, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:04:59.956283 10435 raft_consensus.cc:2749] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:04:59.961536  9512 consensus_peers.cc:597] T a541a15041a3493dab6cbe921d81d1d7 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Couldn't send request to peer ef5fe58eb3e04ae18fda957b4d507eff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:59.970908  9512 consensus_peers.cc:597] T 6f213937fc9b4030a228a8e56ed80f52 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Couldn't send request to peer ef5fe58eb3e04ae18fda957b4d507eff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:59.982841   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
W20260709 13:05:00.020083  9512 consensus_peers.cc:597] T 331d1446396c45ce9486793ecb5de7f7 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Couldn't send request to peer ef5fe58eb3e04ae18fda957b4d507eff. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:38559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:00.027294 10435 raft_consensus.cc:493] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 932245f14aac417f913cc7330a1833b8)
I20260709 13:05:00.028095 10435 raft_consensus.cc:515] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:05:00.031363 10435 leader_election.cc:290] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
W20260709 13:05:00.040490  9512 leader_election.cc:336] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111)
W20260709 13:05:00.045456  9510 leader_election.cc:336] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33607: connect: Connection refused (error 111)
I20260709 13:05:00.046452  9510 leader_election.cc:304] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf; no voters: 932245f14aac417f913cc7330a1833b8, a91e8b10a5984dec9d3777a7275cef49
I20260709 13:05:00.047659 10472 raft_consensus.cc:2749] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:00.074301 10472 raft_consensus.cc:493] T 93877deb770d41a6ba34cefdea146d54 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 932245f14aac417f913cc7330a1833b8)
I20260709 13:05:00.074949 10472 raft_consensus.cc:515] T 93877deb770d41a6ba34cefdea146d54 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef5fe58eb3e04ae18fda957b4d507eff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38559 } } peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } }
I20260709 13:05:00.077569 10472 leader_election.cc:290] T 93877deb770d41a6ba34cefdea146d54 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559), 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633)
I20260709 13:05:00.079816   431 tablet_server.cc:179] TabletServer@127.0.107.196:0 shutting down...
W20260709 13:05:00.084475  9512 leader_election.cc:336] T 93877deb770d41a6ba34cefdea146d54 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Network error: Client connection negotiation failed: client connection to 127.0.107.195:38559: connect: Connection refused (error 111)
W20260709 13:05:00.085661  9512 leader_election.cc:336] T 93877deb770d41a6ba34cefdea146d54 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111)
I20260709 13:05:00.086037  9512 leader_election.cc:304] T 93877deb770d41a6ba34cefdea146d54 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf; no voters: 932245f14aac417f913cc7330a1833b8, ef5fe58eb3e04ae18fda957b4d507eff
I20260709 13:05:00.087072 10472 raft_consensus.cc:2749] T 93877deb770d41a6ba34cefdea146d54 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:00.095630  9512 consensus_peers.cc:597] T 17d57808c20741cd85b0e175935cdab7 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Couldn't send request to peer ef5fe58eb3e04ae18fda957b4d507eff. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:38559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:00.131175  9512 consensus_peers.cc:597] T 01a5f4a59c5e47bc8b7b11db44d80006 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Couldn't send request to peer ef5fe58eb3e04ae18fda957b4d507eff. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:38559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:00.135102   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:00.136096   431 tablet_replica.cc:333] T 8e017796f5c643859d8a0e1916ab3f05 P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.137197   431 raft_consensus.cc:2243] T 8e017796f5c643859d8a0e1916ab3f05 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:00.137825   431 raft_consensus.cc:2272] T 8e017796f5c643859d8a0e1916ab3f05 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.140137   431 tablet_replica.cc:333] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.140733   431 raft_consensus.cc:2243] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:00.141227   431 raft_consensus.cc:2272] T ff040bb60327424d8aeec71e3bf58a0a P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.143311   431 tablet_replica.cc:333] T 65ba9982e9bd4177995544e13394911a P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.143894   431 raft_consensus.cc:2243] T 65ba9982e9bd4177995544e13394911a P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:00.144308   431 raft_consensus.cc:2272] T 65ba9982e9bd4177995544e13394911a P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.146497   431 tablet_replica.cc:333] T 074269f6e5f843be8a85be8b70707304 P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.147078   431 raft_consensus.cc:2243] T 074269f6e5f843be8a85be8b70707304 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:00.147500   431 raft_consensus.cc:2272] T 074269f6e5f843be8a85be8b70707304 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.149567   431 tablet_replica.cc:333] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.150134   431 raft_consensus.cc:2243] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:00.150506   431 raft_consensus.cc:2272] T a25f8459a3644bfcaf8f9d71705b1c33 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.152405   431 tablet_replica.cc:333] T 803c43e83ee5487590c9d922559adc0f P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.153117   431 raft_consensus.cc:2243] T 803c43e83ee5487590c9d922559adc0f P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:00.154095   431 raft_consensus.cc:2272] T 803c43e83ee5487590c9d922559adc0f P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.156348   431 tablet_replica.cc:333] T b2a7ad91c8474397bae23c993b89fca4 P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.156944   431 raft_consensus.cc:2243] T b2a7ad91c8474397bae23c993b89fca4 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:00.157641   431 raft_consensus.cc:2272] T b2a7ad91c8474397bae23c993b89fca4 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.159785   431 tablet_replica.cc:333] T 47b7a6191c374a6a84d8223c573fa318 P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.160751   431 raft_consensus.cc:2243] T 47b7a6191c374a6a84d8223c573fa318 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:00.161420   431 raft_consensus.cc:2272] T 47b7a6191c374a6a84d8223c573fa318 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.163637   431 tablet_replica.cc:333] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.164333   431 raft_consensus.cc:2243] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:00.164866   431 raft_consensus.cc:2272] T b90aae84687f41e99e58dada706ae2d7 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.166128 10472 raft_consensus.cc:493] T 3c53f31a2697499cb5ad2d5bb6715f02 P dfbbb80ab8e345e0ae1684fafefceccf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 932245f14aac417f913cc7330a1833b8)
I20260709 13:05:00.166815 10472 raft_consensus.cc:515] T 3c53f31a2697499cb5ad2d5bb6715f02 P dfbbb80ab8e345e0ae1684fafefceccf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:05:00.168303   431 tablet_replica.cc:333] T b305803a339e40f99c1a6af7f6f84f7c P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.169127 10472 leader_election.cc:290] T 3c53f31a2697499cb5ad2d5bb6715f02 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:05:00.169492   431 raft_consensus.cc:2243] T b305803a339e40f99c1a6af7f6f84f7c P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:00.170914   431 raft_consensus.cc:2272] T b305803a339e40f99c1a6af7f6f84f7c P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.172984 10472 raft_consensus.cc:493] T ad58816d959840df923159e870cf4ad8 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 932245f14aac417f913cc7330a1833b8)
W20260709 13:05:00.173733  9512 leader_election.cc:336] T 3c53f31a2697499cb5ad2d5bb6715f02 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111)
I20260709 13:05:00.173604 10472 raft_consensus.cc:515] T ad58816d959840df923159e870cf4ad8 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfbbb80ab8e345e0ae1684fafefceccf" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37995 } } peers { permanent_uuid: "932245f14aac417f913cc7330a1833b8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37633 } } peers { permanent_uuid: "a91e8b10a5984dec9d3777a7275cef49" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33607 } }
I20260709 13:05:00.174448   431 tablet_replica.cc:333] T d8bd3f903abb4dd99431dbf597c0d462 P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
W20260709 13:05:00.174820  9510 leader_election.cc:336] T 3c53f31a2697499cb5ad2d5bb6715f02 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33607: connect: Connection refused (error 111)
I20260709 13:05:00.175273  9510 leader_election.cc:304] T 3c53f31a2697499cb5ad2d5bb6715f02 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf; no voters: 932245f14aac417f913cc7330a1833b8, a91e8b10a5984dec9d3777a7275cef49
I20260709 13:05:00.175369   431 raft_consensus.cc:2243] T d8bd3f903abb4dd99431dbf597c0d462 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:00.176105 10472 leader_election.cc:290] T ad58816d959840df923159e870cf4ad8 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633), a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607)
I20260709 13:05:00.176467 10467 raft_consensus.cc:2749] T 3c53f31a2697499cb5ad2d5bb6715f02 P dfbbb80ab8e345e0ae1684fafefceccf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:00.176119   431 raft_consensus.cc:2272] T d8bd3f903abb4dd99431dbf597c0d462 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.179832   431 tablet_replica.cc:333] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
W20260709 13:05:00.180301  9512 leader_election.cc:336] T ad58816d959840df923159e870cf4ad8 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 932245f14aac417f913cc7330a1833b8 (127.0.107.193:37633): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37633: connect: Connection refused (error 111)
I20260709 13:05:00.180787   431 raft_consensus.cc:2243] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:00.181466   431 raft_consensus.cc:2272] T a6f012a5e95f4006871d83f7b18e356b P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:00.182116  9510 leader_election.cc:336] T ad58816d959840df923159e870cf4ad8 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a91e8b10a5984dec9d3777a7275cef49 (127.0.107.194:33607): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33607: connect: Connection refused (error 111)
I20260709 13:05:00.182561  9510 leader_election.cc:304] T ad58816d959840df923159e870cf4ad8 P dfbbb80ab8e345e0ae1684fafefceccf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dfbbb80ab8e345e0ae1684fafefceccf; no voters: 932245f14aac417f913cc7330a1833b8, a91e8b10a5984dec9d3777a7275cef49
I20260709 13:05:00.183264 10467 raft_consensus.cc:2749] T ad58816d959840df923159e870cf4ad8 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:00.184128   431 tablet_replica.cc:333] T 24abd32dde1f44c7af83b9344e632ab0 P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.184760   431 raft_consensus.cc:2243] T 24abd32dde1f44c7af83b9344e632ab0 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:00.185449   431 raft_consensus.cc:2272] T 24abd32dde1f44c7af83b9344e632ab0 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.187923   431 tablet_replica.cc:333] T 774befa616254c02901f28edde6ab758 P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.188621   431 raft_consensus.cc:2243] T 774befa616254c02901f28edde6ab758 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:00.190120   431 raft_consensus.cc:2272] T 774befa616254c02901f28edde6ab758 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.193002   431 tablet_replica.cc:333] T ab069642e354446db85dabd0cedd7eec P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.193766   431 raft_consensus.cc:2243] T ab069642e354446db85dabd0cedd7eec P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:00.194590   431 raft_consensus.cc:2272] T ab069642e354446db85dabd0cedd7eec P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.197721   431 tablet_replica.cc:333] T 85d647b0abf74fbebc7e9a9bfe14b8ea P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.198388   431 raft_consensus.cc:2243] T 85d647b0abf74fbebc7e9a9bfe14b8ea P dfbbb80ab8e345e0ae1684fafefceccf [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:00.199254   431 raft_consensus.cc:2272] T 85d647b0abf74fbebc7e9a9bfe14b8ea P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.201385   431 tablet_replica.cc:333] T e97eecc3acdf46a5b5577416f7bfe336 P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.202056   431 raft_consensus.cc:2243] T e97eecc3acdf46a5b5577416f7bfe336 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:00.202565   431 raft_consensus.cc:2272] T e97eecc3acdf46a5b5577416f7bfe336 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.204648   431 tablet_replica.cc:333] T 9a8ed4502cb447c7b2cb94c96dcb7daf P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.205399   431 raft_consensus.cc:2243] T 9a8ed4502cb447c7b2cb94c96dcb7daf P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:00.206192   431 raft_consensus.cc:2272] T 9a8ed4502cb447c7b2cb94c96dcb7daf P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.208362   431 tablet_replica.cc:333] T 6f213937fc9b4030a228a8e56ed80f52 P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.208948   431 raft_consensus.cc:2243] T 6f213937fc9b4030a228a8e56ed80f52 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:00.210069   431 raft_consensus.cc:2272] T 6f213937fc9b4030a228a8e56ed80f52 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.213809   431 tablet_replica.cc:333] T b31d08e4168243f08eb2a31031a039ed P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.214674   431 raft_consensus.cc:2243] T b31d08e4168243f08eb2a31031a039ed P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:00.215581   431 raft_consensus.cc:2272] T b31d08e4168243f08eb2a31031a039ed P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.219439   431 tablet_replica.cc:333] T a55798aa4230462f9befe5d7fc9bd3ce P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.220690   431 raft_consensus.cc:2243] T a55798aa4230462f9befe5d7fc9bd3ce P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:00.221489   431 raft_consensus.cc:2272] T a55798aa4230462f9befe5d7fc9bd3ce P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.225919   431 tablet_replica.cc:333] T 225ca60d9645490dbcdcf6d4d127d955 P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.227627   431 raft_consensus.cc:2243] T 225ca60d9645490dbcdcf6d4d127d955 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:00.229346   431 raft_consensus.cc:2272] T 225ca60d9645490dbcdcf6d4d127d955 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:00.229545  9512 consensus_peers.cc:597] T 3bd9c3f12cc546ff905df61c5a9028f6 P dfbbb80ab8e345e0ae1684fafefceccf -> Peer ef5fe58eb3e04ae18fda957b4d507eff (127.0.107.195:38559): Couldn't send request to peer ef5fe58eb3e04ae18fda957b4d507eff. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:38559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:00.232151   431 tablet_replica.cc:333] T faf56b218e614e51962171088f3c4f63 P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.233055   431 raft_consensus.cc:2243] T faf56b218e614e51962171088f3c4f63 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:00.233603   431 raft_consensus.cc:2272] T faf56b218e614e51962171088f3c4f63 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.235680   431 tablet_replica.cc:333] T 331d1446396c45ce9486793ecb5de7f7 P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.236282   431 raft_consensus.cc:2243] T 331d1446396c45ce9486793ecb5de7f7 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:00.237177   431 raft_consensus.cc:2272] T 331d1446396c45ce9486793ecb5de7f7 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.239161   431 tablet_replica.cc:333] T 8dfdb24cbc824b95ac65712323103e2a P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.239760   431 raft_consensus.cc:2243] T 8dfdb24cbc824b95ac65712323103e2a P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:00.240193   431 raft_consensus.cc:2272] T 8dfdb24cbc824b95ac65712323103e2a P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.242863   431 tablet_replica.cc:333] T e7d162d34de74e47895dac207e265059 P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.243592   431 raft_consensus.cc:2243] T e7d162d34de74e47895dac207e265059 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:00.244066   431 raft_consensus.cc:2272] T e7d162d34de74e47895dac207e265059 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.246626   431 tablet_replica.cc:333] T ad58816d959840df923159e870cf4ad8 P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.247243   431 raft_consensus.cc:2243] T ad58816d959840df923159e870cf4ad8 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:00.247685   431 raft_consensus.cc:2272] T ad58816d959840df923159e870cf4ad8 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.249943   431 tablet_replica.cc:333] T 93877deb770d41a6ba34cefdea146d54 P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.250563   431 raft_consensus.cc:2243] T 93877deb770d41a6ba34cefdea146d54 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:00.250977   431 raft_consensus.cc:2272] T 93877deb770d41a6ba34cefdea146d54 P dfbbb80ab8e345e0ae1684fafefceccf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.252875   431 tablet_replica.cc:333] T 3c53f31a2697499cb5ad2d5bb6715f02 P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.253506   431 raft_consensus.cc:2243] T 3c53f31a2697499cb5ad2d5bb6715f02 P dfbbb80ab8e345e0ae1684fafefceccf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:00.253921   431 raft_consensus.cc:2272] T 3c53f31a2697499cb5ad2d5bb6715f02 P dfbbb80ab8e345e0ae1684fafefceccf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.255942   431 tablet_replica.cc:333] T 1a5145e5f9a64fe0acdd74d909e841fc P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.256482   431 raft_consensus.cc:2243] T 1a5145e5f9a64fe0acdd74d909e841fc P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:00.256910   431 raft_consensus.cc:2272] T 1a5145e5f9a64fe0acdd74d909e841fc P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.258913   431 tablet_replica.cc:333] T 02c431d6db7643adbb4b26a3c7e38b76 P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.259503   431 raft_consensus.cc:2243] T 02c431d6db7643adbb4b26a3c7e38b76 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:00.260314   431 raft_consensus.cc:2272] T 02c431d6db7643adbb4b26a3c7e38b76 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.262387   431 tablet_replica.cc:333] T 01a5f4a59c5e47bc8b7b11db44d80006 P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.262950   431 raft_consensus.cc:2243] T 01a5f4a59c5e47bc8b7b11db44d80006 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:00.263754   431 raft_consensus.cc:2272] T 01a5f4a59c5e47bc8b7b11db44d80006 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.266170   431 tablet_replica.cc:333] T 120581d9b8ba40dd854cec64a671e394 P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.266774   431 raft_consensus.cc:2243] T 120581d9b8ba40dd854cec64a671e394 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:00.267719   431 raft_consensus.cc:2272] T 120581d9b8ba40dd854cec64a671e394 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.269948   431 tablet_replica.cc:333] T 03c7fe8d164d4b2c9015337d9b4b7081 P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.270529   431 raft_consensus.cc:2243] T 03c7fe8d164d4b2c9015337d9b4b7081 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:00.271461   431 raft_consensus.cc:2272] T 03c7fe8d164d4b2c9015337d9b4b7081 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.273943   431 tablet_replica.cc:333] T 99fc4b4b16d0432390a92d5c04149ce1 P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.274549   431 raft_consensus.cc:2243] T 99fc4b4b16d0432390a92d5c04149ce1 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:00.275058   431 raft_consensus.cc:2272] T 99fc4b4b16d0432390a92d5c04149ce1 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.277285   431 tablet_replica.cc:333] T f3a3d4fd34924b7c8ed0df6709391329 P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.277865   431 raft_consensus.cc:2243] T f3a3d4fd34924b7c8ed0df6709391329 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:00.278344   431 raft_consensus.cc:2272] T f3a3d4fd34924b7c8ed0df6709391329 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.280435   431 tablet_replica.cc:333] T 890ffb7e0f6b463f8d8771d5cd9481c9 P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.280999   431 raft_consensus.cc:2243] T 890ffb7e0f6b463f8d8771d5cd9481c9 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:00.281510   431 raft_consensus.cc:2272] T 890ffb7e0f6b463f8d8771d5cd9481c9 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.283677   431 tablet_replica.cc:333] T b94916f0e1e340a38f4a100f451fdaba P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.284315   431 raft_consensus.cc:2243] T b94916f0e1e340a38f4a100f451fdaba P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:00.284873   431 raft_consensus.cc:2272] T b94916f0e1e340a38f4a100f451fdaba P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.287187   431 tablet_replica.cc:333] T a541a15041a3493dab6cbe921d81d1d7 P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.287729   431 raft_consensus.cc:2243] T a541a15041a3493dab6cbe921d81d1d7 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:00.288734   431 raft_consensus.cc:2272] T a541a15041a3493dab6cbe921d81d1d7 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.290757   431 tablet_replica.cc:333] T 17d57808c20741cd85b0e175935cdab7 P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.291286   431 raft_consensus.cc:2243] T 17d57808c20741cd85b0e175935cdab7 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:00.292086   431 raft_consensus.cc:2272] T 17d57808c20741cd85b0e175935cdab7 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.294124   431 tablet_replica.cc:333] T a8fbcbebcf87468f821e14a079bf305d P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.294651   431 raft_consensus.cc:2243] T a8fbcbebcf87468f821e14a079bf305d P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:00.295073   431 raft_consensus.cc:2272] T a8fbcbebcf87468f821e14a079bf305d P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.297010   431 tablet_replica.cc:333] T 9b19e51cda7e44e5a1f02a736e555ac4 P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.297551   431 raft_consensus.cc:2243] T 9b19e51cda7e44e5a1f02a736e555ac4 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:00.298019   431 raft_consensus.cc:2272] T 9b19e51cda7e44e5a1f02a736e555ac4 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.300060   431 tablet_replica.cc:333] T 3bd9c3f12cc546ff905df61c5a9028f6 P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.300559   431 raft_consensus.cc:2243] T 3bd9c3f12cc546ff905df61c5a9028f6 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:00.301451   431 raft_consensus.cc:2272] T 3bd9c3f12cc546ff905df61c5a9028f6 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.303544   431 tablet_replica.cc:333] T 5cfc1f2582a64d8dbc3f127e15024ec0 P dfbbb80ab8e345e0ae1684fafefceccf: stopping tablet replica
I20260709 13:05:00.304032   431 raft_consensus.cc:2243] T 5cfc1f2582a64d8dbc3f127e15024ec0 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:00.304864   431 raft_consensus.cc:2272] T 5cfc1f2582a64d8dbc3f127e15024ec0 P dfbbb80ab8e345e0ae1684fafefceccf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.378749   431 tablet_server.cc:196] TabletServer@127.0.107.196:0 shutdown complete.
I20260709 13:05:00.445299   431 master.cc:562] Master@127.0.107.254:39947 shutting down...
I20260709 13:05:00.472716   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c7bbf8b42238465898b968984e058005 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:00.473362   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c7bbf8b42238465898b968984e058005 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:00.473654   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P c7bbf8b42238465898b968984e058005: stopping tablet replica
I20260709 13:05:00.515377   431 master.cc:584] Master@127.0.107.254:39947 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (33677 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:05:00.615216   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:41867
I20260709 13:05:00.616537   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:00.623616 10474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:00.623657 10473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:00.624873 10476 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:00.626488   431 server_base.cc:1061] running on GCE node
I20260709 13:05:00.627779   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:00.627995   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:00.628196   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602300628180 us; error 0 us; skew 500 ppm
I20260709 13:05:00.628849   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:00.631769   431 webserver.cc:533] Webserver started at http://127.0.107.254:37391/ using document root <none> and password file <none>
I20260709 13:05:00.632310   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:00.632472   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:00.632794   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:00.634116   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601979855482-431-0/minicluster-data/master-0-root/instance:
uuid: "e9b4e7fc361447bc919f195ce51e8480"
format_stamp: "Formatted at 2026-07-09 13:05:00 on dist-test-slave-g4pn"
I20260709 13:05:00.639222   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.001s
I20260709 13:05:00.643200 10481 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:00.644241   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:05:00.644608   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601979855482-431-0/minicluster-data/master-0-root
uuid: "e9b4e7fc361447bc919f195ce51e8480"
format_stamp: "Formatted at 2026-07-09 13:05:00 on dist-test-slave-g4pn"
I20260709 13:05:00.644944   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601979855482-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601979855482-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601979855482-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:00.664453   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:00.666029   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:00.711002   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:41867
I20260709 13:05:00.711032 10532 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:41867 every 8 connection(s)
I20260709 13:05:00.715448 10533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:00.730615 10533 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9b4e7fc361447bc919f195ce51e8480: Bootstrap starting.
I20260709 13:05:00.736229 10533 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e9b4e7fc361447bc919f195ce51e8480: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:00.742640 10533 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9b4e7fc361447bc919f195ce51e8480: No bootstrap required, opened a new log
I20260709 13:05:00.745314 10533 raft_consensus.cc:359] T 00000000000000000000000000000000 P e9b4e7fc361447bc919f195ce51e8480 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9b4e7fc361447bc919f195ce51e8480" member_type: VOTER }
I20260709 13:05:00.745745 10533 raft_consensus.cc:385] T 00000000000000000000000000000000 P e9b4e7fc361447bc919f195ce51e8480 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:00.745975 10533 raft_consensus.cc:740] T 00000000000000000000000000000000 P e9b4e7fc361447bc919f195ce51e8480 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9b4e7fc361447bc919f195ce51e8480, State: Initialized, Role: FOLLOWER
I20260709 13:05:00.746703 10533 consensus_queue.cc:260] T 00000000000000000000000000000000 P e9b4e7fc361447bc919f195ce51e8480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9b4e7fc361447bc919f195ce51e8480" member_type: VOTER }
I20260709 13:05:00.747215 10533 raft_consensus.cc:399] T 00000000000000000000000000000000 P e9b4e7fc361447bc919f195ce51e8480 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:00.747422 10533 raft_consensus.cc:493] T 00000000000000000000000000000000 P e9b4e7fc361447bc919f195ce51e8480 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:00.747730 10533 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e9b4e7fc361447bc919f195ce51e8480 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.752727 10533 raft_consensus.cc:515] T 00000000000000000000000000000000 P e9b4e7fc361447bc919f195ce51e8480 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9b4e7fc361447bc919f195ce51e8480" member_type: VOTER }
I20260709 13:05:00.753382 10533 leader_election.cc:304] T 00000000000000000000000000000000 P e9b4e7fc361447bc919f195ce51e8480 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e9b4e7fc361447bc919f195ce51e8480; no voters: 
I20260709 13:05:00.754608 10533 leader_election.cc:290] T 00000000000000000000000000000000 P e9b4e7fc361447bc919f195ce51e8480 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:00.755097 10536 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e9b4e7fc361447bc919f195ce51e8480 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:00.756551 10536 raft_consensus.cc:697] T 00000000000000000000000000000000 P e9b4e7fc361447bc919f195ce51e8480 [term 1 LEADER]: Becoming Leader. State: Replica: e9b4e7fc361447bc919f195ce51e8480, State: Running, Role: LEADER
I20260709 13:05:00.757318 10536 consensus_queue.cc:237] T 00000000000000000000000000000000 P e9b4e7fc361447bc919f195ce51e8480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9b4e7fc361447bc919f195ce51e8480" member_type: VOTER }
I20260709 13:05:00.757727 10533 sys_catalog.cc:565] T 00000000000000000000000000000000 P e9b4e7fc361447bc919f195ce51e8480 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:00.762820 10538 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9b4e7fc361447bc919f195ce51e8480 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e9b4e7fc361447bc919f195ce51e8480. Latest consensus state: current_term: 1 leader_uuid: "e9b4e7fc361447bc919f195ce51e8480" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9b4e7fc361447bc919f195ce51e8480" member_type: VOTER } }
I20260709 13:05:00.762905 10537 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9b4e7fc361447bc919f195ce51e8480 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e9b4e7fc361447bc919f195ce51e8480" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9b4e7fc361447bc919f195ce51e8480" member_type: VOTER } }
I20260709 13:05:00.764159 10538 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9b4e7fc361447bc919f195ce51e8480 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:00.764341 10537 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9b4e7fc361447bc919f195ce51e8480 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:00.766484 10544 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:00.771610 10544 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:00.775755   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:00.781767 10544 catalog_manager.cc:1383] Generated new cluster ID: 1742f3d23243401fb219d343bba9a992
I20260709 13:05:00.782094 10544 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:00.805951 10544 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:00.807359 10544 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:00.824710 10544 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e9b4e7fc361447bc919f195ce51e8480: Generated new TSK 0
I20260709 13:05:00.825559 10544 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:00.843238   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:00.850483 10554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:00.852561 10555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:00.854405 10557 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:00.856072   431 server_base.cc:1061] running on GCE node
I20260709 13:05:00.857597   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:00.857836   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:00.858055   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602300858038 us; error 0 us; skew 500 ppm
I20260709 13:05:00.858795   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:00.861622   431 webserver.cc:533] Webserver started at http://127.0.107.193:33979/ using document root <none> and password file <none>
I20260709 13:05:00.862161   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:00.862325   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:00.862663   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:00.863776   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601979855482-431-0/minicluster-data/ts-0-root/instance:
uuid: "d9879027b78541b49ed49f803e95f76b"
format_stamp: "Formatted at 2026-07-09 13:05:00 on dist-test-slave-g4pn"
I20260709 13:05:00.869503   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:05:00.873342 10562 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:00.874231   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:05:00.874675   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601979855482-431-0/minicluster-data/ts-0-root
uuid: "d9879027b78541b49ed49f803e95f76b"
format_stamp: "Formatted at 2026-07-09 13:05:00 on dist-test-slave-g4pn"
I20260709 13:05:00.875011   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601979855482-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601979855482-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601979855482-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:00.900874   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:00.902312   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:00.903966   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:00.913223   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:00.913554   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:00.913940   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:00.914180   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:00.965224   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:42139
I20260709 13:05:00.965497 10624 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:42139 every 8 connection(s)
I20260709 13:05:00.971190   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:00.981011 10629 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:00.982841 10630 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:00.985240   431 server_base.cc:1061] running on GCE node
W20260709 13:05:00.988878 10633 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:00.990151 10625 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41867
I20260709 13:05:00.990538   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:05:00.990763 10625 heartbeater.cc:461] Registering TS with master...
W20260709 13:05:00.990917   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:00.991798   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602300991773 us; error 0 us; skew 500 ppm
I20260709 13:05:00.992496 10625 heartbeater.cc:507] Master 127.0.107.254:41867 requested a full tablet report, sending...
I20260709 13:05:00.992666   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:00.995879 10498 ts_manager.cc:194] Registered new tserver with Master: d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139)
I20260709 13:05:00.996508   431 webserver.cc:533] Webserver started at http://127.0.107.194:40165/ using document root <none> and password file <none>
I20260709 13:05:00.997514   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:00.997725   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:00.997967   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:00.998884 10498 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49860
I20260709 13:05:00.999189   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601979855482-431-0/minicluster-data/ts-1-root/instance:
uuid: "25a826f326054a31a5be8db7f6b09a83"
format_stamp: "Formatted at 2026-07-09 13:05:00 on dist-test-slave-g4pn"
I20260709 13:05:01.005590   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:05:01.010532 10637 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:01.011638   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:05:01.011952   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601979855482-431-0/minicluster-data/ts-1-root
uuid: "25a826f326054a31a5be8db7f6b09a83"
format_stamp: "Formatted at 2026-07-09 13:05:00 on dist-test-slave-g4pn"
I20260709 13:05:01.012220   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601979855482-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601979855482-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601979855482-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:01.028362   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:01.030812   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:01.032763   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:01.037228   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:01.037451   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:01.037634   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:01.037772   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:01.091195   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:36333
I20260709 13:05:01.091383 10699 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:36333 every 8 connection(s)
I20260709 13:05:01.097337   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:01.104440 10703 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:01.105302 10704 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:01.107905   431 server_base.cc:1061] running on GCE node
W20260709 13:05:01.108039 10706 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:01.109505   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:01.109760   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:01.109954   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602301109936 us; error 0 us; skew 500 ppm
I20260709 13:05:01.110679   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:01.112587 10700 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41867
I20260709 13:05:01.113011 10700 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:01.113588   431 webserver.cc:533] Webserver started at http://127.0.107.195:46499/ using document root <none> and password file <none>
I20260709 13:05:01.114068 10700 heartbeater.cc:507] Master 127.0.107.254:41867 requested a full tablet report, sending...
I20260709 13:05:01.114336   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:01.114621   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:01.114943   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:01.116391   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601979855482-431-0/minicluster-data/ts-2-root/instance:
uuid: "c12666dfd84348ca891f38fb4d0738b8"
format_stamp: "Formatted at 2026-07-09 13:05:01 on dist-test-slave-g4pn"
I20260709 13:05:01.116520 10498 ts_manager.cc:194] Registered new tserver with Master: 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194:36333)
I20260709 13:05:01.118521 10498 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49868
I20260709 13:05:01.122727   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.002s
I20260709 13:05:01.127071 10711 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:01.128221   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:05:01.128556   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601979855482-431-0/minicluster-data/ts-2-root
uuid: "c12666dfd84348ca891f38fb4d0738b8"
format_stamp: "Formatted at 2026-07-09 13:05:01 on dist-test-slave-g4pn"
I20260709 13:05:01.129222   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601979855482-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601979855482-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601979855482-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:01.142037   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:01.143342   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:01.144687   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:01.147373   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:01.147568   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:01.147886   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:01.148056   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:01.195211   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:38441
I20260709 13:05:01.195348 10773 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:38441 every 8 connection(s)
I20260709 13:05:01.210675 10774 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41867
I20260709 13:05:01.211225 10774 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:01.212150 10774 heartbeater.cc:507] Master 127.0.107.254:41867 requested a full tablet report, sending...
I20260709 13:05:01.214540 10498 ts_manager.cc:194] Registered new tserver with Master: c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195:38441)
I20260709 13:05:01.215025   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016190987s
I20260709 13:05:01.216054 10498 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49878
I20260709 13:05:01.242811 10498 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49884:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:01.246102 10498 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:01.339498 10587 tablet_service.cc:1511] Processing CreateTablet for tablet b9ea195e53c447cca2d3d8cfc8481ff6 (DEFAULT_TABLE table=test-workload [id=0fb28bbb2ae04195be714fd25d19c5b5]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:01.339748 10586 tablet_service.cc:1511] Processing CreateTablet for tablet c9d1d89d891b4b84b70e9baa05c5b45a (DEFAULT_TABLE table=test-workload [id=0fb28bbb2ae04195be714fd25d19c5b5]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:01.340646 10588 tablet_service.cc:1511] Processing CreateTablet for tablet 0769de616981443f98fe2c1f18b8cb95 (DEFAULT_TABLE table=test-workload [id=0fb28bbb2ae04195be714fd25d19c5b5]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:01.341250 10587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9ea195e53c447cca2d3d8cfc8481ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:01.342149 10584 tablet_service.cc:1511] Processing CreateTablet for tablet 65fb662e39fe49258d71de811265ba16 (DEFAULT_TABLE table=test-workload [id=0fb28bbb2ae04195be714fd25d19c5b5]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:01.343343 10590 tablet_service.cc:1511] Processing CreateTablet for tablet b42fcc8a7b364f1eb90b8983dd617f74 (DEFAULT_TABLE table=test-workload [id=0fb28bbb2ae04195be714fd25d19c5b5]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:01.344084 10585 tablet_service.cc:1511] Processing CreateTablet for tablet 1d2f00bc524547b794c3a65afa1b00f7 (DEFAULT_TABLE table=test-workload [id=0fb28bbb2ae04195be714fd25d19c5b5]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:01.345700 10589 tablet_service.cc:1511] Processing CreateTablet for tablet 275e6f7ace35466d9a3dcc0ab83dfbcd (DEFAULT_TABLE table=test-workload [id=0fb28bbb2ae04195be714fd25d19c5b5]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:01.342170 10588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0769de616981443f98fe2c1f18b8cb95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:01.348021 10585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d2f00bc524547b794c3a65afa1b00f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:01.348829 10590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b42fcc8a7b364f1eb90b8983dd617f74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:01.349479 10584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65fb662e39fe49258d71de811265ba16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:01.352476 10586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9d1d89d891b4b84b70e9baa05c5b45a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:01.353543 10589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 275e6f7ace35466d9a3dcc0ab83dfbcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:01.356722 10583 tablet_service.cc:1511] Processing CreateTablet for tablet 99ac7fd5cbe444fda04f98de073d9b47 (DEFAULT_TABLE table=test-workload [id=0fb28bbb2ae04195be714fd25d19c5b5]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:01.358219 10583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99ac7fd5cbe444fda04f98de073d9b47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:01.358737 10582 tablet_service.cc:1511] Processing CreateTablet for tablet d60282d41bde45538429171e6a290048 (DEFAULT_TABLE table=test-workload [id=0fb28bbb2ae04195be714fd25d19c5b5]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:01.360126 10582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d60282d41bde45538429171e6a290048. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:01.362963 10581 tablet_service.cc:1511] Processing CreateTablet for tablet 1789fe885f1e4e2a851aebab8d6f1c95 (DEFAULT_TABLE table=test-workload [id=0fb28bbb2ae04195be714fd25d19c5b5]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:01.369192 10581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1789fe885f1e4e2a851aebab8d6f1c95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:01.382231 10789 tablet_bootstrap.cc:492] T 275e6f7ace35466d9a3dcc0ab83dfbcd P d9879027b78541b49ed49f803e95f76b: Bootstrap starting.
I20260709 13:05:01.389597 10663 tablet_service.cc:1511] Processing CreateTablet for tablet 0769de616981443f98fe2c1f18b8cb95 (DEFAULT_TABLE table=test-workload [id=0fb28bbb2ae04195be714fd25d19c5b5]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:01.391363 10663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0769de616981443f98fe2c1f18b8cb95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:01.397753 10664 tablet_service.cc:1511] Processing CreateTablet for tablet 275e6f7ace35466d9a3dcc0ab83dfbcd (DEFAULT_TABLE table=test-workload [id=0fb28bbb2ae04195be714fd25d19c5b5]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:01.399351 10664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 275e6f7ace35466d9a3dcc0ab83dfbcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:01.403733 10789 tablet_bootstrap.cc:654] T 275e6f7ace35466d9a3dcc0ab83dfbcd P d9879027b78541b49ed49f803e95f76b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:01.397753 10665 tablet_service.cc:1511] Processing CreateTablet for tablet b42fcc8a7b364f1eb90b8983dd617f74 (DEFAULT_TABLE table=test-workload [id=0fb28bbb2ae04195be714fd25d19c5b5]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:01.406599 10665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b42fcc8a7b364f1eb90b8983dd617f74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:01.431790 10661 tablet_service.cc:1511] Processing CreateTablet for tablet c9d1d89d891b4b84b70e9baa05c5b45a (DEFAULT_TABLE table=test-workload [id=0fb28bbb2ae04195be714fd25d19c5b5]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:01.432591 10659 tablet_service.cc:1511] Processing CreateTablet for tablet 65fb662e39fe49258d71de811265ba16 (DEFAULT_TABLE table=test-workload [id=0fb28bbb2ae04195be714fd25d19c5b5]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:01.433430 10661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9d1d89d891b4b84b70e9baa05c5b45a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:01.433614 10662 tablet_service.cc:1511] Processing CreateTablet for tablet b9ea195e53c447cca2d3d8cfc8481ff6 (DEFAULT_TABLE table=test-workload [id=0fb28bbb2ae04195be714fd25d19c5b5]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:01.435019 10662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9ea195e53c447cca2d3d8cfc8481ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:01.434942 10658 tablet_service.cc:1511] Processing CreateTablet for tablet 99ac7fd5cbe444fda04f98de073d9b47 (DEFAULT_TABLE table=test-workload [id=0fb28bbb2ae04195be714fd25d19c5b5]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:01.436414 10658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99ac7fd5cbe444fda04f98de073d9b47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:01.438303 10660 tablet_service.cc:1511] Processing CreateTablet for tablet 1d2f00bc524547b794c3a65afa1b00f7 (DEFAULT_TABLE table=test-workload [id=0fb28bbb2ae04195be714fd25d19c5b5]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:01.439709 10660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d2f00bc524547b794c3a65afa1b00f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:01.441226 10657 tablet_service.cc:1511] Processing CreateTablet for tablet d60282d41bde45538429171e6a290048 (DEFAULT_TABLE table=test-workload [id=0fb28bbb2ae04195be714fd25d19c5b5]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:01.441458 10739 tablet_service.cc:1511] Processing CreateTablet for tablet b42fcc8a7b364f1eb90b8983dd617f74 (DEFAULT_TABLE table=test-workload [id=0fb28bbb2ae04195be714fd25d19c5b5]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:01.442735 10657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d60282d41bde45538429171e6a290048. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:01.442840 10739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b42fcc8a7b364f1eb90b8983dd617f74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:01.446498 10732 tablet_service.cc:1511] Processing CreateTablet for tablet 99ac7fd5cbe444fda04f98de073d9b47 (DEFAULT_TABLE table=test-workload [id=0fb28bbb2ae04195be714fd25d19c5b5]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:01.446826 10656 tablet_service.cc:1511] Processing CreateTablet for tablet 1789fe885f1e4e2a851aebab8d6f1c95 (DEFAULT_TABLE table=test-workload [id=0fb28bbb2ae04195be714fd25d19c5b5]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:01.448046 10732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99ac7fd5cbe444fda04f98de073d9b47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:01.450949 10737 tablet_service.cc:1511] Processing CreateTablet for tablet 0769de616981443f98fe2c1f18b8cb95 (DEFAULT_TABLE table=test-workload [id=0fb28bbb2ae04195be714fd25d19c5b5]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:01.454380 10730 tablet_service.cc:1511] Processing CreateTablet for tablet 1789fe885f1e4e2a851aebab8d6f1c95 (DEFAULT_TABLE table=test-workload [id=0fb28bbb2ae04195be714fd25d19c5b5]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:01.455060 10736 tablet_service.cc:1511] Processing CreateTablet for tablet b9ea195e53c447cca2d3d8cfc8481ff6 (DEFAULT_TABLE table=test-workload [id=0fb28bbb2ae04195be714fd25d19c5b5]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:01.456029 10730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1789fe885f1e4e2a851aebab8d6f1c95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:01.458973 10735 tablet_service.cc:1511] Processing CreateTablet for tablet c9d1d89d891b4b84b70e9baa05c5b45a (DEFAULT_TABLE table=test-workload [id=0fb28bbb2ae04195be714fd25d19c5b5]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:01.462565 10734 tablet_service.cc:1511] Processing CreateTablet for tablet 1d2f00bc524547b794c3a65afa1b00f7 (DEFAULT_TABLE table=test-workload [id=0fb28bbb2ae04195be714fd25d19c5b5]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:01.465910 10733 tablet_service.cc:1511] Processing CreateTablet for tablet 65fb662e39fe49258d71de811265ba16 (DEFAULT_TABLE table=test-workload [id=0fb28bbb2ae04195be714fd25d19c5b5]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:01.450941 10731 tablet_service.cc:1511] Processing CreateTablet for tablet d60282d41bde45538429171e6a290048 (DEFAULT_TABLE table=test-workload [id=0fb28bbb2ae04195be714fd25d19c5b5]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:01.439308 10738 tablet_service.cc:1511] Processing CreateTablet for tablet 275e6f7ace35466d9a3dcc0ab83dfbcd (DEFAULT_TABLE table=test-workload [id=0fb28bbb2ae04195be714fd25d19c5b5]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:01.448839 10656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1789fe885f1e4e2a851aebab8d6f1c95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:01.481705 10659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65fb662e39fe49258d71de811265ba16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:01.497618 10736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9ea195e53c447cca2d3d8cfc8481ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:01.498669 10734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d2f00bc524547b794c3a65afa1b00f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:01.501276 10731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d60282d41bde45538429171e6a290048. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:01.504702 10738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 275e6f7ace35466d9a3dcc0ab83dfbcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:01.506790 10735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9d1d89d891b4b84b70e9baa05c5b45a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:01.512686 10737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0769de616981443f98fe2c1f18b8cb95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:01.516710 10733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65fb662e39fe49258d71de811265ba16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:01.526500 10791 tablet_bootstrap.cc:492] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83: Bootstrap starting.
I20260709 13:05:01.532861 10789 tablet_bootstrap.cc:492] T 275e6f7ace35466d9a3dcc0ab83dfbcd P d9879027b78541b49ed49f803e95f76b: No bootstrap required, opened a new log
I20260709 13:05:01.533586 10789 ts_tablet_manager.cc:1403] T 275e6f7ace35466d9a3dcc0ab83dfbcd P d9879027b78541b49ed49f803e95f76b: Time spent bootstrapping tablet: real 0.152s	user 0.017s	sys 0.016s
I20260709 13:05:01.542719 10791 tablet_bootstrap.cc:654] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:01.536633 10789 raft_consensus.cc:359] T 275e6f7ace35466d9a3dcc0ab83dfbcd P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.557827 10789 raft_consensus.cc:385] T 275e6f7ace35466d9a3dcc0ab83dfbcd P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:01.558313 10789 raft_consensus.cc:740] T 275e6f7ace35466d9a3dcc0ab83dfbcd P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9879027b78541b49ed49f803e95f76b, State: Initialized, Role: FOLLOWER
I20260709 13:05:01.585597 10789 consensus_queue.cc:260] T 275e6f7ace35466d9a3dcc0ab83dfbcd P d9879027b78541b49ed49f803e95f76b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.594957 10793 tablet_bootstrap.cc:492] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8: Bootstrap starting.
I20260709 13:05:01.595894 10625 heartbeater.cc:499] Master 127.0.107.254:41867 was elected leader, sending a full tablet report...
I20260709 13:05:01.603113 10789 ts_tablet_manager.cc:1434] T 275e6f7ace35466d9a3dcc0ab83dfbcd P d9879027b78541b49ed49f803e95f76b: Time spent starting tablet: real 0.069s	user 0.009s	sys 0.006s
I20260709 13:05:01.604331 10789 tablet_bootstrap.cc:492] T 0769de616981443f98fe2c1f18b8cb95 P d9879027b78541b49ed49f803e95f76b: Bootstrap starting.
I20260709 13:05:01.605127 10793 tablet_bootstrap.cc:654] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:01.606884 10791 tablet_bootstrap.cc:492] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83: No bootstrap required, opened a new log
I20260709 13:05:01.607618 10791 ts_tablet_manager.cc:1403] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83: Time spent bootstrapping tablet: real 0.082s	user 0.015s	sys 0.027s
I20260709 13:05:01.613565 10789 tablet_bootstrap.cc:654] T 0769de616981443f98fe2c1f18b8cb95 P d9879027b78541b49ed49f803e95f76b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:01.629490 10791 raft_consensus.cc:359] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.630463 10791 raft_consensus.cc:385] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:01.630806 10791 raft_consensus.cc:740] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25a826f326054a31a5be8db7f6b09a83, State: Initialized, Role: FOLLOWER
I20260709 13:05:01.631805 10791 consensus_queue.cc:260] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.637804 10793 tablet_bootstrap.cc:492] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8: No bootstrap required, opened a new log
I20260709 13:05:01.638389 10793 ts_tablet_manager.cc:1403] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8: Time spent bootstrapping tablet: real 0.044s	user 0.021s	sys 0.004s
I20260709 13:05:01.642987 10791 ts_tablet_manager.cc:1434] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83: Time spent starting tablet: real 0.035s	user 0.012s	sys 0.004s
I20260709 13:05:01.643857 10700 heartbeater.cc:499] Master 127.0.107.254:41867 was elected leader, sending a full tablet report...
I20260709 13:05:01.644335 10791 tablet_bootstrap.cc:492] T b42fcc8a7b364f1eb90b8983dd617f74 P 25a826f326054a31a5be8db7f6b09a83: Bootstrap starting.
I20260709 13:05:01.643239 10793 raft_consensus.cc:359] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.644922 10789 tablet_bootstrap.cc:492] T 0769de616981443f98fe2c1f18b8cb95 P d9879027b78541b49ed49f803e95f76b: No bootstrap required, opened a new log
I20260709 13:05:01.645947 10793 raft_consensus.cc:385] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:01.646306 10793 raft_consensus.cc:740] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c12666dfd84348ca891f38fb4d0738b8, State: Initialized, Role: FOLLOWER
I20260709 13:05:01.646350 10789 ts_tablet_manager.cc:1403] T 0769de616981443f98fe2c1f18b8cb95 P d9879027b78541b49ed49f803e95f76b: Time spent bootstrapping tablet: real 0.042s	user 0.022s	sys 0.008s
I20260709 13:05:01.647271 10793 consensus_queue.cc:260] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.650058 10789 raft_consensus.cc:359] T 0769de616981443f98fe2c1f18b8cb95 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.651130 10789 raft_consensus.cc:385] T 0769de616981443f98fe2c1f18b8cb95 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:01.651340 10791 tablet_bootstrap.cc:654] T b42fcc8a7b364f1eb90b8983dd617f74 P 25a826f326054a31a5be8db7f6b09a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:01.651553 10789 raft_consensus.cc:740] T 0769de616981443f98fe2c1f18b8cb95 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9879027b78541b49ed49f803e95f76b, State: Initialized, Role: FOLLOWER
I20260709 13:05:01.652904 10789 consensus_queue.cc:260] T 0769de616981443f98fe2c1f18b8cb95 P d9879027b78541b49ed49f803e95f76b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.661728 10789 ts_tablet_manager.cc:1434] T 0769de616981443f98fe2c1f18b8cb95 P d9879027b78541b49ed49f803e95f76b: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.004s
I20260709 13:05:01.663321 10789 tablet_bootstrap.cc:492] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b: Bootstrap starting.
I20260709 13:05:01.672639 10789 tablet_bootstrap.cc:654] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:01.673985 10774 heartbeater.cc:499] Master 127.0.107.254:41867 was elected leader, sending a full tablet report...
I20260709 13:05:01.676095 10793 ts_tablet_manager.cc:1434] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8: Time spent starting tablet: real 0.037s	user 0.012s	sys 0.020s
I20260709 13:05:01.677733 10793 tablet_bootstrap.cc:492] T b42fcc8a7b364f1eb90b8983dd617f74 P c12666dfd84348ca891f38fb4d0738b8: Bootstrap starting.
I20260709 13:05:01.679327 10791 tablet_bootstrap.cc:492] T b42fcc8a7b364f1eb90b8983dd617f74 P 25a826f326054a31a5be8db7f6b09a83: No bootstrap required, opened a new log
I20260709 13:05:01.679934 10791 ts_tablet_manager.cc:1403] T b42fcc8a7b364f1eb90b8983dd617f74 P 25a826f326054a31a5be8db7f6b09a83: Time spent bootstrapping tablet: real 0.036s	user 0.026s	sys 0.000s
I20260709 13:05:01.683209 10791 raft_consensus.cc:359] T b42fcc8a7b364f1eb90b8983dd617f74 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.684005 10791 raft_consensus.cc:385] T b42fcc8a7b364f1eb90b8983dd617f74 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:01.684334 10791 raft_consensus.cc:740] T b42fcc8a7b364f1eb90b8983dd617f74 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25a826f326054a31a5be8db7f6b09a83, State: Initialized, Role: FOLLOWER
I20260709 13:05:01.685328 10791 consensus_queue.cc:260] T b42fcc8a7b364f1eb90b8983dd617f74 P 25a826f326054a31a5be8db7f6b09a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.686540 10793 tablet_bootstrap.cc:654] T b42fcc8a7b364f1eb90b8983dd617f74 P c12666dfd84348ca891f38fb4d0738b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:01.687911 10791 ts_tablet_manager.cc:1434] T b42fcc8a7b364f1eb90b8983dd617f74 P 25a826f326054a31a5be8db7f6b09a83: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:05:01.689121 10791 tablet_bootstrap.cc:492] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83: Bootstrap starting.
I20260709 13:05:01.696357 10791 tablet_bootstrap.cc:654] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:01.699751 10775 tablet.cc:2406] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:05:01.703114 10793 tablet_bootstrap.cc:492] T b42fcc8a7b364f1eb90b8983dd617f74 P c12666dfd84348ca891f38fb4d0738b8: No bootstrap required, opened a new log
I20260709 13:05:01.704116 10793 ts_tablet_manager.cc:1403] T b42fcc8a7b364f1eb90b8983dd617f74 P c12666dfd84348ca891f38fb4d0738b8: Time spent bootstrapping tablet: real 0.027s	user 0.020s	sys 0.002s
I20260709 13:05:01.708369 10791 tablet_bootstrap.cc:492] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83: No bootstrap required, opened a new log
I20260709 13:05:01.709029 10791 ts_tablet_manager.cc:1403] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
I20260709 13:05:01.708665 10793 raft_consensus.cc:359] T b42fcc8a7b364f1eb90b8983dd617f74 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.710144 10793 raft_consensus.cc:385] T b42fcc8a7b364f1eb90b8983dd617f74 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:01.710642 10793 raft_consensus.cc:740] T b42fcc8a7b364f1eb90b8983dd617f74 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c12666dfd84348ca891f38fb4d0738b8, State: Initialized, Role: FOLLOWER
I20260709 13:05:01.711892 10793 consensus_queue.cc:260] T b42fcc8a7b364f1eb90b8983dd617f74 P c12666dfd84348ca891f38fb4d0738b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.712682 10791 raft_consensus.cc:359] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.714920 10791 raft_consensus.cc:385] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:01.715257 10791 raft_consensus.cc:740] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25a826f326054a31a5be8db7f6b09a83, State: Initialized, Role: FOLLOWER
I20260709 13:05:01.715411 10793 ts_tablet_manager.cc:1434] T b42fcc8a7b364f1eb90b8983dd617f74 P c12666dfd84348ca891f38fb4d0738b8: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:05:01.716068 10789 tablet_bootstrap.cc:492] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b: No bootstrap required, opened a new log
I20260709 13:05:01.716509 10793 tablet_bootstrap.cc:492] T c9d1d89d891b4b84b70e9baa05c5b45a P c12666dfd84348ca891f38fb4d0738b8: Bootstrap starting.
I20260709 13:05:01.716667 10789 ts_tablet_manager.cc:1403] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b: Time spent bootstrapping tablet: real 0.054s	user 0.029s	sys 0.020s
I20260709 13:05:01.716202 10791 consensus_queue.cc:260] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.721310 10789 raft_consensus.cc:359] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.722126 10789 raft_consensus.cc:385] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:01.722404 10789 raft_consensus.cc:740] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9879027b78541b49ed49f803e95f76b, State: Initialized, Role: FOLLOWER
I20260709 13:05:01.723323 10789 consensus_queue.cc:260] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.724326 10793 tablet_bootstrap.cc:654] T c9d1d89d891b4b84b70e9baa05c5b45a P c12666dfd84348ca891f38fb4d0738b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:01.728432 10791 ts_tablet_manager.cc:1434] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83: Time spent starting tablet: real 0.019s	user 0.001s	sys 0.006s
I20260709 13:05:01.730584 10791 tablet_bootstrap.cc:492] T c9d1d89d891b4b84b70e9baa05c5b45a P 25a826f326054a31a5be8db7f6b09a83: Bootstrap starting.
I20260709 13:05:01.732388 10793 tablet_bootstrap.cc:492] T c9d1d89d891b4b84b70e9baa05c5b45a P c12666dfd84348ca891f38fb4d0738b8: No bootstrap required, opened a new log
I20260709 13:05:01.732976 10793 ts_tablet_manager.cc:1403] T c9d1d89d891b4b84b70e9baa05c5b45a P c12666dfd84348ca891f38fb4d0738b8: Time spent bootstrapping tablet: real 0.017s	user 0.006s	sys 0.008s
I20260709 13:05:01.734918 10789 ts_tablet_manager.cc:1434] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:05:01.736266 10789 tablet_bootstrap.cc:492] T b9ea195e53c447cca2d3d8cfc8481ff6 P d9879027b78541b49ed49f803e95f76b: Bootstrap starting.
I20260709 13:05:01.737316 10793 raft_consensus.cc:359] T c9d1d89d891b4b84b70e9baa05c5b45a P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.738147 10793 raft_consensus.cc:385] T c9d1d89d891b4b84b70e9baa05c5b45a P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:01.738456 10793 raft_consensus.cc:740] T c9d1d89d891b4b84b70e9baa05c5b45a P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c12666dfd84348ca891f38fb4d0738b8, State: Initialized, Role: FOLLOWER
I20260709 13:05:01.739269 10793 consensus_queue.cc:260] T c9d1d89d891b4b84b70e9baa05c5b45a P c12666dfd84348ca891f38fb4d0738b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.742580 10793 ts_tablet_manager.cc:1434] T c9d1d89d891b4b84b70e9baa05c5b45a P c12666dfd84348ca891f38fb4d0738b8: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:05:01.744151 10793 tablet_bootstrap.cc:492] T b9ea195e53c447cca2d3d8cfc8481ff6 P c12666dfd84348ca891f38fb4d0738b8: Bootstrap starting.
I20260709 13:05:01.744709 10789 tablet_bootstrap.cc:654] T b9ea195e53c447cca2d3d8cfc8481ff6 P d9879027b78541b49ed49f803e95f76b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:01.748764 10791 tablet_bootstrap.cc:654] T c9d1d89d891b4b84b70e9baa05c5b45a P 25a826f326054a31a5be8db7f6b09a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:01.750953 10793 tablet_bootstrap.cc:654] T b9ea195e53c447cca2d3d8cfc8481ff6 P c12666dfd84348ca891f38fb4d0738b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:01.757333 10789 tablet_bootstrap.cc:492] T b9ea195e53c447cca2d3d8cfc8481ff6 P d9879027b78541b49ed49f803e95f76b: No bootstrap required, opened a new log
I20260709 13:05:01.757975 10789 ts_tablet_manager.cc:1403] T b9ea195e53c447cca2d3d8cfc8481ff6 P d9879027b78541b49ed49f803e95f76b: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.003s
I20260709 13:05:01.759641 10793 tablet_bootstrap.cc:492] T b9ea195e53c447cca2d3d8cfc8481ff6 P c12666dfd84348ca891f38fb4d0738b8: No bootstrap required, opened a new log
I20260709 13:05:01.760133 10791 tablet_bootstrap.cc:492] T c9d1d89d891b4b84b70e9baa05c5b45a P 25a826f326054a31a5be8db7f6b09a83: No bootstrap required, opened a new log
I20260709 13:05:01.760154 10793 ts_tablet_manager.cc:1403] T b9ea195e53c447cca2d3d8cfc8481ff6 P c12666dfd84348ca891f38fb4d0738b8: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:05:01.760833 10791 ts_tablet_manager.cc:1403] T c9d1d89d891b4b84b70e9baa05c5b45a P 25a826f326054a31a5be8db7f6b09a83: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.000s
I20260709 13:05:01.761308 10789 raft_consensus.cc:359] T b9ea195e53c447cca2d3d8cfc8481ff6 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.762176 10789 raft_consensus.cc:385] T b9ea195e53c447cca2d3d8cfc8481ff6 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:01.762488 10789 raft_consensus.cc:740] T b9ea195e53c447cca2d3d8cfc8481ff6 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9879027b78541b49ed49f803e95f76b, State: Initialized, Role: FOLLOWER
I20260709 13:05:01.763345 10789 consensus_queue.cc:260] T b9ea195e53c447cca2d3d8cfc8481ff6 P d9879027b78541b49ed49f803e95f76b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.763450 10793 raft_consensus.cc:359] T b9ea195e53c447cca2d3d8cfc8481ff6 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.763868 10798 raft_consensus.cc:493] T b42fcc8a7b364f1eb90b8983dd617f74 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.764307 10793 raft_consensus.cc:385] T b9ea195e53c447cca2d3d8cfc8481ff6 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:01.764086 10791 raft_consensus.cc:359] T c9d1d89d891b4b84b70e9baa05c5b45a P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.764689 10793 raft_consensus.cc:740] T b9ea195e53c447cca2d3d8cfc8481ff6 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c12666dfd84348ca891f38fb4d0738b8, State: Initialized, Role: FOLLOWER
I20260709 13:05:01.764472 10798 raft_consensus.cc:515] T b42fcc8a7b364f1eb90b8983dd617f74 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.764946 10791 raft_consensus.cc:385] T c9d1d89d891b4b84b70e9baa05c5b45a P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:01.765501 10791 raft_consensus.cc:740] T c9d1d89d891b4b84b70e9baa05c5b45a P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25a826f326054a31a5be8db7f6b09a83, State: Initialized, Role: FOLLOWER
I20260709 13:05:01.765690 10793 consensus_queue.cc:260] T b9ea195e53c447cca2d3d8cfc8481ff6 P c12666dfd84348ca891f38fb4d0738b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.766279 10791 consensus_queue.cc:260] T c9d1d89d891b4b84b70e9baa05c5b45a P 25a826f326054a31a5be8db7f6b09a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
W20260709 13:05:01.769886 10546 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:01.771447 10789 ts_tablet_manager.cc:1434] T b9ea195e53c447cca2d3d8cfc8481ff6 P d9879027b78541b49ed49f803e95f76b: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.005s
I20260709 13:05:01.772596 10789 tablet_bootstrap.cc:492] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b: Bootstrap starting.
I20260709 13:05:01.776834 10791 ts_tablet_manager.cc:1434] T c9d1d89d891b4b84b70e9baa05c5b45a P 25a826f326054a31a5be8db7f6b09a83: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:05:01.779769 10789 tablet_bootstrap.cc:654] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:01.785852 10798 leader_election.cc:290] T b42fcc8a7b364f1eb90b8983dd617f74 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139), 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194:36333)
I20260709 13:05:01.787047 10798 raft_consensus.cc:493] T b9ea195e53c447cca2d3d8cfc8481ff6 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.786247 10791 tablet_bootstrap.cc:492] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83: Bootstrap starting.
I20260709 13:05:01.790448 10798 raft_consensus.cc:515] T b9ea195e53c447cca2d3d8cfc8481ff6 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.792953 10798 leader_election.cc:290] T b9ea195e53c447cca2d3d8cfc8481ff6 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139), 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194:36333)
I20260709 13:05:01.789714 10789 tablet_bootstrap.cc:492] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b: No bootstrap required, opened a new log
I20260709 13:05:01.797894 10789 ts_tablet_manager.cc:1403] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.002s
I20260709 13:05:01.798596 10675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42fcc8a7b364f1eb90b8983dd617f74" candidate_uuid: "c12666dfd84348ca891f38fb4d0738b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25a826f326054a31a5be8db7f6b09a83" is_pre_election: true
I20260709 13:05:01.799562 10675 raft_consensus.cc:2468] T b42fcc8a7b364f1eb90b8983dd617f74 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c12666dfd84348ca891f38fb4d0738b8 in term 0.
I20260709 13:05:01.801173 10674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ea195e53c447cca2d3d8cfc8481ff6" candidate_uuid: "c12666dfd84348ca891f38fb4d0738b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25a826f326054a31a5be8db7f6b09a83" is_pre_election: true
I20260709 13:05:01.803570 10713 leader_election.cc:304] T b42fcc8a7b364f1eb90b8983dd617f74 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a826f326054a31a5be8db7f6b09a83, c12666dfd84348ca891f38fb4d0738b8; no voters: 
W20260709 13:05:01.804883 10713 leader_election.cc:343] T b9ea195e53c447cca2d3d8cfc8481ff6 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194:36333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:01.804729 10789 raft_consensus.cc:359] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.805756 10789 raft_consensus.cc:385] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:01.805997 10798 raft_consensus.cc:2804] T b42fcc8a7b364f1eb90b8983dd617f74 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:01.806845 10798 raft_consensus.cc:493] T b42fcc8a7b364f1eb90b8983dd617f74 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:01.807327 10798 raft_consensus.cc:3060] T b42fcc8a7b364f1eb90b8983dd617f74 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:01.810581 10791 tablet_bootstrap.cc:654] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:01.806136 10789 raft_consensus.cc:740] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9879027b78541b49ed49f803e95f76b, State: Initialized, Role: FOLLOWER
I20260709 13:05:01.815286 10789 consensus_queue.cc:260] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.816470 10793 ts_tablet_manager.cc:1434] T b9ea195e53c447cca2d3d8cfc8481ff6 P c12666dfd84348ca891f38fb4d0738b8: Time spent starting tablet: real 0.056s	user 0.013s	sys 0.020s
I20260709 13:05:01.818883 10797 raft_consensus.cc:493] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.820850 10797 raft_consensus.cc:515] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.822825 10794 raft_consensus.cc:493] T b9ea195e53c447cca2d3d8cfc8481ff6 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.823577 10794 raft_consensus.cc:515] T b9ea195e53c447cca2d3d8cfc8481ff6 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.824559 10797 leader_election.cc:290] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139), c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195:38441)
I20260709 13:05:01.826483 10794 leader_election.cc:290] T b9ea195e53c447cca2d3d8cfc8481ff6 P d9879027b78541b49ed49f803e95f76b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194:36333), c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195:38441)
I20260709 13:05:01.828285 10793 tablet_bootstrap.cc:492] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8: Bootstrap starting.
I20260709 13:05:01.819372 10798 raft_consensus.cc:515] T b42fcc8a7b364f1eb90b8983dd617f74 P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.833367 10798 leader_election.cc:290] T b42fcc8a7b364f1eb90b8983dd617f74 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 1 election: Requested vote from peers d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139), 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194:36333)
I20260709 13:05:01.835045 10674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42fcc8a7b364f1eb90b8983dd617f74" candidate_uuid: "c12666dfd84348ca891f38fb4d0738b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25a826f326054a31a5be8db7f6b09a83"
I20260709 13:05:01.835815 10674 raft_consensus.cc:3060] T b42fcc8a7b364f1eb90b8983dd617f74 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:01.838830 10793 tablet_bootstrap.cc:654] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:01.839185 10798 raft_consensus.cc:493] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.839871 10798 raft_consensus.cc:515] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.850423 10674 raft_consensus.cc:2468] T b42fcc8a7b364f1eb90b8983dd617f74 P 25a826f326054a31a5be8db7f6b09a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c12666dfd84348ca891f38fb4d0738b8 in term 1.
I20260709 13:05:01.851691 10794 raft_consensus.cc:493] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.854089 10794 raft_consensus.cc:515] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.856455 10675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ac7fd5cbe444fda04f98de073d9b47" candidate_uuid: "c12666dfd84348ca891f38fb4d0738b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25a826f326054a31a5be8db7f6b09a83" is_pre_election: true
W20260709 13:05:01.859246 10713 leader_election.cc:343] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194:36333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:01.860865 10798 leader_election.cc:290] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139), 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194:36333)
I20260709 13:05:01.860724 10794 leader_election.cc:290] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194:36333), c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195:38441)
I20260709 13:05:01.864466 10713 leader_election.cc:304] T b42fcc8a7b364f1eb90b8983dd617f74 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a826f326054a31a5be8db7f6b09a83, c12666dfd84348ca891f38fb4d0738b8; no voters: 
I20260709 13:05:01.865483 10798 raft_consensus.cc:2804] T b42fcc8a7b364f1eb90b8983dd617f74 P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:01.866875 10798 raft_consensus.cc:697] T b42fcc8a7b364f1eb90b8983dd617f74 P c12666dfd84348ca891f38fb4d0738b8 [term 1 LEADER]: Becoming Leader. State: Replica: c12666dfd84348ca891f38fb4d0738b8, State: Running, Role: LEADER
I20260709 13:05:01.867858 10798 consensus_queue.cc:237] T b42fcc8a7b364f1eb90b8983dd617f74 P c12666dfd84348ca891f38fb4d0738b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.868743 10791 tablet_bootstrap.cc:492] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83: No bootstrap required, opened a new log
I20260709 13:05:01.869410 10791 ts_tablet_manager.cc:1403] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83: Time spent bootstrapping tablet: real 0.083s	user 0.021s	sys 0.006s
I20260709 13:05:01.872757 10791 raft_consensus.cc:359] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.874446 10791 raft_consensus.cc:385] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:01.874778 10791 raft_consensus.cc:740] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25a826f326054a31a5be8db7f6b09a83, State: Initialized, Role: FOLLOWER
I20260709 13:05:01.875734 10791 consensus_queue.cc:260] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.880856 10749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275e6f7ace35466d9a3dcc0ab83dfbcd" candidate_uuid: "25a826f326054a31a5be8db7f6b09a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c12666dfd84348ca891f38fb4d0738b8" is_pre_election: true
I20260709 13:05:01.883132 10791 ts_tablet_manager.cc:1434] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:05:01.884441 10791 tablet_bootstrap.cc:492] T b9ea195e53c447cca2d3d8cfc8481ff6 P 25a826f326054a31a5be8db7f6b09a83: Bootstrap starting.
I20260709 13:05:01.889185 10600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275e6f7ace35466d9a3dcc0ab83dfbcd" candidate_uuid: "25a826f326054a31a5be8db7f6b09a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9879027b78541b49ed49f803e95f76b" is_pre_election: true
I20260709 13:05:01.890780 10600 raft_consensus.cc:2468] T 275e6f7ace35466d9a3dcc0ab83dfbcd P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25a826f326054a31a5be8db7f6b09a83 in term 0.
I20260709 13:05:01.894064 10797 raft_consensus.cc:493] T c9d1d89d891b4b84b70e9baa05c5b45a P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.894778 10640 leader_election.cc:304] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a826f326054a31a5be8db7f6b09a83, d9879027b78541b49ed49f803e95f76b; no voters: 
I20260709 13:05:01.894876 10797 raft_consensus.cc:515] T c9d1d89d891b4b84b70e9baa05c5b45a P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.894070 10789 ts_tablet_manager.cc:1434] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b: Time spent starting tablet: real 0.096s	user 0.013s	sys 0.006s
I20260709 13:05:01.897639 10599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ea195e53c447cca2d3d8cfc8481ff6" candidate_uuid: "c12666dfd84348ca891f38fb4d0738b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9879027b78541b49ed49f803e95f76b" is_pre_election: true
I20260709 13:05:01.898494 10599 raft_consensus.cc:2468] T b9ea195e53c447cca2d3d8cfc8481ff6 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c12666dfd84348ca891f38fb4d0738b8 in term 0.
I20260709 13:05:01.899906 10598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42fcc8a7b364f1eb90b8983dd617f74" candidate_uuid: "c12666dfd84348ca891f38fb4d0738b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9879027b78541b49ed49f803e95f76b"
I20260709 13:05:01.900084 10714 leader_election.cc:304] T b9ea195e53c447cca2d3d8cfc8481ff6 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c12666dfd84348ca891f38fb4d0738b8, d9879027b78541b49ed49f803e95f76b; no voters: 25a826f326054a31a5be8db7f6b09a83
I20260709 13:05:01.901684 10597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ac7fd5cbe444fda04f98de073d9b47" candidate_uuid: "c12666dfd84348ca891f38fb4d0738b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9879027b78541b49ed49f803e95f76b" is_pre_election: true
I20260709 13:05:01.902253 10807 raft_consensus.cc:2804] T b9ea195e53c447cca2d3d8cfc8481ff6 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:01.902875 10807 raft_consensus.cc:493] T b9ea195e53c447cca2d3d8cfc8481ff6 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:01.903329 10807 raft_consensus.cc:3060] T b9ea195e53c447cca2d3d8cfc8481ff6 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:01.905953 10639 leader_election.cc:343] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195:38441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:01.906996 10813 raft_consensus.cc:493] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.907384 10600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42fcc8a7b364f1eb90b8983dd617f74" candidate_uuid: "c12666dfd84348ca891f38fb4d0738b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9879027b78541b49ed49f803e95f76b" is_pre_election: true
I20260709 13:05:01.907562 10813 raft_consensus.cc:515] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.909947 10813 leader_election.cc:290] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194:36333), c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195:38441)
W20260709 13:05:01.911703 10714 leader_election.cc:343] T b42fcc8a7b364f1eb90b8983dd617f74 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:01.914980 10714 leader_election.cc:343] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:01.915617 10714 leader_election.cc:304] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c12666dfd84348ca891f38fb4d0738b8; no voters: 25a826f326054a31a5be8db7f6b09a83, d9879027b78541b49ed49f803e95f76b
I20260709 13:05:01.916519 10797 leader_election.cc:290] T c9d1d89d891b4b84b70e9baa05c5b45a P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139), c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195:38441)
I20260709 13:05:01.916932 10810 raft_consensus.cc:2749] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:01.917335 10797 raft_consensus.cc:2804] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:01.917855 10797 raft_consensus.cc:493] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:01.918260 10797 raft_consensus.cc:3060] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:01.918889 10714 leader_election.cc:343] T b42fcc8a7b364f1eb90b8983dd617f74 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:01.898535 10789 tablet_bootstrap.cc:492] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b: Bootstrap starting.
I20260709 13:05:01.924256 10807 raft_consensus.cc:515] T b9ea195e53c447cca2d3d8cfc8481ff6 P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.929178 10674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ea195e53c447cca2d3d8cfc8481ff6" candidate_uuid: "c12666dfd84348ca891f38fb4d0738b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25a826f326054a31a5be8db7f6b09a83"
W20260709 13:05:01.931519 10713 leader_election.cc:343] T b9ea195e53c447cca2d3d8cfc8481ff6 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194:36333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:01.935294 10600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ea195e53c447cca2d3d8cfc8481ff6" candidate_uuid: "c12666dfd84348ca891f38fb4d0738b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9879027b78541b49ed49f803e95f76b"
I20260709 13:05:01.936276 10600 raft_consensus.cc:3060] T b9ea195e53c447cca2d3d8cfc8481ff6 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:01.942773 10674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ea195e53c447cca2d3d8cfc8481ff6" candidate_uuid: "d9879027b78541b49ed49f803e95f76b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25a826f326054a31a5be8db7f6b09a83" is_pre_election: true
I20260709 13:05:01.946056 10674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d60282d41bde45538429171e6a290048" candidate_uuid: "d9879027b78541b49ed49f803e95f76b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25a826f326054a31a5be8db7f6b09a83" is_pre_election: true
I20260709 13:05:01.948740 10674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2f00bc524547b794c3a65afa1b00f7" candidate_uuid: "d9879027b78541b49ed49f803e95f76b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25a826f326054a31a5be8db7f6b09a83" is_pre_election: true
I20260709 13:05:01.949671 10674 raft_consensus.cc:2468] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9879027b78541b49ed49f803e95f76b in term 0.
W20260709 13:05:01.950783 10564 leader_election.cc:343] T b9ea195e53c447cca2d3d8cfc8481ff6 P d9879027b78541b49ed49f803e95f76b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194:36333): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:01.951342 10564 leader_election.cc:343] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194:36333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:01.951970 10564 leader_election.cc:304] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a826f326054a31a5be8db7f6b09a83, d9879027b78541b49ed49f803e95f76b; no voters: 
W20260709 13:05:01.954398 10640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42139, user_credentials={real_user=slave}} blocked reactor thread for 59826.3us
I20260709 13:05:01.954952 10789 tablet_bootstrap.cc:654] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:01.956198 10597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d1d89d891b4b84b70e9baa05c5b45a" candidate_uuid: "25a826f326054a31a5be8db7f6b09a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9879027b78541b49ed49f803e95f76b" is_pre_election: true
I20260709 13:05:01.956607 10749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d1d89d891b4b84b70e9baa05c5b45a" candidate_uuid: "25a826f326054a31a5be8db7f6b09a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c12666dfd84348ca891f38fb4d0738b8" is_pre_election: true
I20260709 13:05:01.957237 10600 raft_consensus.cc:2468] T b9ea195e53c447cca2d3d8cfc8481ff6 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c12666dfd84348ca891f38fb4d0738b8 in term 1.
I20260709 13:05:01.957399 10749 raft_consensus.cc:2468] T c9d1d89d891b4b84b70e9baa05c5b45a P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25a826f326054a31a5be8db7f6b09a83 in term 0.
I20260709 13:05:01.959074 10791 tablet_bootstrap.cc:654] T b9ea195e53c447cca2d3d8cfc8481ff6 P 25a826f326054a31a5be8db7f6b09a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:01.959633 10639 leader_election.cc:304] T c9d1d89d891b4b84b70e9baa05c5b45a P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a826f326054a31a5be8db7f6b09a83, c12666dfd84348ca891f38fb4d0738b8; no voters: 
I20260709 13:05:01.960804 10813 raft_consensus.cc:2804] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:01.961509 10813 raft_consensus.cc:493] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:01.960856 10640 leader_election.cc:343] T c9d1d89d891b4b84b70e9baa05c5b45a P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:01.962119 10813 raft_consensus.cc:3060] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:01.961292 10496 catalog_manager.cc:5697] T b42fcc8a7b364f1eb90b8983dd617f74 P c12666dfd84348ca891f38fb4d0738b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c12666dfd84348ca891f38fb4d0738b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:01.960868 10807 leader_election.cc:290] T b9ea195e53c447cca2d3d8cfc8481ff6 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 1 election: Requested vote from peers d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139), 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194:36333)
I20260709 13:05:01.963685 10822 raft_consensus.cc:2804] T c9d1d89d891b4b84b70e9baa05c5b45a P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:01.964278 10822 raft_consensus.cc:493] T c9d1d89d891b4b84b70e9baa05c5b45a P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:01.964633 10822 raft_consensus.cc:3060] T c9d1d89d891b4b84b70e9baa05c5b45a P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:01.963250 10793 tablet_bootstrap.cc:492] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8: No bootstrap required, opened a new log
I20260709 13:05:01.963490 10714 leader_election.cc:304] T b9ea195e53c447cca2d3d8cfc8481ff6 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c12666dfd84348ca891f38fb4d0738b8, d9879027b78541b49ed49f803e95f76b; no voters: 25a826f326054a31a5be8db7f6b09a83
I20260709 13:05:01.969758 10807 raft_consensus.cc:2804] T b9ea195e53c447cca2d3d8cfc8481ff6 P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:01.970469 10807 raft_consensus.cc:697] T b9ea195e53c447cca2d3d8cfc8481ff6 P c12666dfd84348ca891f38fb4d0738b8 [term 1 LEADER]: Becoming Leader. State: Replica: c12666dfd84348ca891f38fb4d0738b8, State: Running, Role: LEADER
I20260709 13:05:01.971371 10797 raft_consensus.cc:515] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.974457 10793 ts_tablet_manager.cc:1403] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8: Time spent bootstrapping tablet: real 0.146s	user 0.027s	sys 0.035s
I20260709 13:05:01.974141 10807 consensus_queue.cc:237] T b9ea195e53c447cca2d3d8cfc8481ff6 P c12666dfd84348ca891f38fb4d0738b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.978189 10793 raft_consensus.cc:359] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.979101 10793 raft_consensus.cc:385] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:01.979454 10793 raft_consensus.cc:740] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c12666dfd84348ca891f38fb4d0738b8, State: Initialized, Role: FOLLOWER
I20260709 13:05:01.980515 10793 consensus_queue.cc:260] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.981971 10749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ea195e53c447cca2d3d8cfc8481ff6" candidate_uuid: "d9879027b78541b49ed49f803e95f76b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c12666dfd84348ca891f38fb4d0738b8" is_pre_election: true
I20260709 13:05:01.984634 10749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d60282d41bde45538429171e6a290048" candidate_uuid: "d9879027b78541b49ed49f803e95f76b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c12666dfd84348ca891f38fb4d0738b8" is_pre_election: true
I20260709 13:05:01.985585 10749 raft_consensus.cc:2468] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9879027b78541b49ed49f803e95f76b in term 0.
I20260709 13:05:01.987564 10822 raft_consensus.cc:515] T c9d1d89d891b4b84b70e9baa05c5b45a P 25a826f326054a31a5be8db7f6b09a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.974073 10813 raft_consensus.cc:515] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:01.991508 10600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d1d89d891b4b84b70e9baa05c5b45a" candidate_uuid: "25a826f326054a31a5be8db7f6b09a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9879027b78541b49ed49f803e95f76b"
I20260709 13:05:01.993574 10793 ts_tablet_manager.cc:1434] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.004s
I20260709 13:05:01.992690 10748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d1d89d891b4b84b70e9baa05c5b45a" candidate_uuid: "25a826f326054a31a5be8db7f6b09a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c12666dfd84348ca891f38fb4d0738b8"
I20260709 13:05:01.994434 10748 raft_consensus.cc:3060] T c9d1d89d891b4b84b70e9baa05c5b45a P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:01.994535 10674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2f00bc524547b794c3a65afa1b00f7" candidate_uuid: "d9879027b78541b49ed49f803e95f76b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25a826f326054a31a5be8db7f6b09a83"
I20260709 13:05:01.995461 10674 raft_consensus.cc:3060] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:01.997895 10797 leader_election.cc:290] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 1 election: Requested vote from peers d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139), c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195:38441)
I20260709 13:05:01.999883 10747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275e6f7ace35466d9a3dcc0ab83dfbcd" candidate_uuid: "25a826f326054a31a5be8db7f6b09a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c12666dfd84348ca891f38fb4d0738b8"
I20260709 13:05:02.001410 10789 tablet_bootstrap.cc:492] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b: No bootstrap required, opened a new log
I20260709 13:05:02.001938 10789 ts_tablet_manager.cc:1403] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b: Time spent bootstrapping tablet: real 0.104s	user 0.015s	sys 0.000s
I20260709 13:05:02.002034 10793 tablet_bootstrap.cc:492] T 0769de616981443f98fe2c1f18b8cb95 P c12666dfd84348ca891f38fb4d0738b8: Bootstrap starting.
W20260709 13:05:02.002179 10639 leader_election.cc:343] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195:38441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:02.005218 10789 raft_consensus.cc:359] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.006040 10789 raft_consensus.cc:385] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:02.006376 10789 raft_consensus.cc:740] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9879027b78541b49ed49f803e95f76b, State: Initialized, Role: FOLLOWER
W20260709 13:05:01.993518 10640 leader_election.cc:343] T c9d1d89d891b4b84b70e9baa05c5b45a P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:02.029042 10791 tablet_bootstrap.cc:492] T b9ea195e53c447cca2d3d8cfc8481ff6 P 25a826f326054a31a5be8db7f6b09a83: No bootstrap required, opened a new log
I20260709 13:05:02.029726 10791 ts_tablet_manager.cc:1403] T b9ea195e53c447cca2d3d8cfc8481ff6 P 25a826f326054a31a5be8db7f6b09a83: Time spent bootstrapping tablet: real 0.146s	user 0.036s	sys 0.019s
I20260709 13:05:02.029960 10748 raft_consensus.cc:2468] T c9d1d89d891b4b84b70e9baa05c5b45a P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25a826f326054a31a5be8db7f6b09a83 in term 1.
I20260709 13:05:02.009626 10749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2f00bc524547b794c3a65afa1b00f7" candidate_uuid: "d9879027b78541b49ed49f803e95f76b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c12666dfd84348ca891f38fb4d0738b8" is_pre_election: true
I20260709 13:05:02.030817 10600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275e6f7ace35466d9a3dcc0ab83dfbcd" candidate_uuid: "25a826f326054a31a5be8db7f6b09a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9879027b78541b49ed49f803e95f76b"
I20260709 13:05:02.031714 10600 raft_consensus.cc:3060] T 275e6f7ace35466d9a3dcc0ab83dfbcd P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:02.026738 10564 leader_election.cc:304] T b9ea195e53c447cca2d3d8cfc8481ff6 P d9879027b78541b49ed49f803e95f76b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9879027b78541b49ed49f803e95f76b; no voters: 25a826f326054a31a5be8db7f6b09a83, c12666dfd84348ca891f38fb4d0738b8
I20260709 13:05:02.027662 10789 consensus_queue.cc:260] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.028208 10813 leader_election.cc:290] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b [CANDIDATE]: Term 1 election: Requested vote from peers 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194:36333), c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195:38441)
I20260709 13:05:02.027320 10793 tablet_bootstrap.cc:654] T 0769de616981443f98fe2c1f18b8cb95 P c12666dfd84348ca891f38fb4d0738b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:02.031631 10639 leader_election.cc:304] T c9d1d89d891b4b84b70e9baa05c5b45a P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25a826f326054a31a5be8db7f6b09a83, c12666dfd84348ca891f38fb4d0738b8; no voters: d9879027b78541b49ed49f803e95f76b
I20260709 13:05:02.032646 10794 raft_consensus.cc:2749] T b9ea195e53c447cca2d3d8cfc8481ff6 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:02.032850 10791 raft_consensus.cc:359] T b9ea195e53c447cca2d3d8cfc8481ff6 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.033299 10797 raft_consensus.cc:2804] T c9d1d89d891b4b84b70e9baa05c5b45a P 25a826f326054a31a5be8db7f6b09a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:02.033627 10791 raft_consensus.cc:385] T b9ea195e53c447cca2d3d8cfc8481ff6 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:02.009794 10822 leader_election.cc:290] T c9d1d89d891b4b84b70e9baa05c5b45a P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 1 election: Requested vote from peers d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139), c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195:38441)
I20260709 13:05:02.033970 10791 raft_consensus.cc:740] T b9ea195e53c447cca2d3d8cfc8481ff6 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25a826f326054a31a5be8db7f6b09a83, State: Initialized, Role: FOLLOWER
I20260709 13:05:02.035064 10791 consensus_queue.cc:260] T b9ea195e53c447cca2d3d8cfc8481ff6 P 25a826f326054a31a5be8db7f6b09a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.038945 10791 ts_tablet_manager.cc:1434] T b9ea195e53c447cca2d3d8cfc8481ff6 P 25a826f326054a31a5be8db7f6b09a83: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:05:02.040450 10791 tablet_bootstrap.cc:492] T d60282d41bde45538429171e6a290048 P 25a826f326054a31a5be8db7f6b09a83: Bootstrap starting.
I20260709 13:05:02.044654 10822 raft_consensus.cc:493] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.045110 10748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2f00bc524547b794c3a65afa1b00f7" candidate_uuid: "d9879027b78541b49ed49f803e95f76b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c12666dfd84348ca891f38fb4d0738b8"
I20260709 13:05:02.045209 10822 raft_consensus.cc:515] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.047024 10674 raft_consensus.cc:2468] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9879027b78541b49ed49f803e95f76b in term 1.
I20260709 13:05:02.048022 10822 leader_election.cc:290] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139), c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195:38441)
I20260709 13:05:02.049382 10748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0769de616981443f98fe2c1f18b8cb95" candidate_uuid: "25a826f326054a31a5be8db7f6b09a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c12666dfd84348ca891f38fb4d0738b8" is_pre_election: true
I20260709 13:05:02.049757 10597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0769de616981443f98fe2c1f18b8cb95" candidate_uuid: "25a826f326054a31a5be8db7f6b09a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9879027b78541b49ed49f803e95f76b" is_pre_election: true
I20260709 13:05:02.050436 10597 raft_consensus.cc:2468] T 0769de616981443f98fe2c1f18b8cb95 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25a826f326054a31a5be8db7f6b09a83 in term 0.
W20260709 13:05:02.050771 10639 leader_election.cc:343] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195:38441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:02.052050 10640 leader_election.cc:304] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25a826f326054a31a5be8db7f6b09a83, d9879027b78541b49ed49f803e95f76b; no voters: c12666dfd84348ca891f38fb4d0738b8
I20260709 13:05:02.053648 10822 raft_consensus.cc:2804] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:02.054181 10822 raft_consensus.cc:493] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:02.054631 10822 raft_consensus.cc:3060] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:02.055164 10791 tablet_bootstrap.cc:654] T d60282d41bde45538429171e6a290048 P 25a826f326054a31a5be8db7f6b09a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:02.061270 10797 raft_consensus.cc:697] T c9d1d89d891b4b84b70e9baa05c5b45a P 25a826f326054a31a5be8db7f6b09a83 [term 1 LEADER]: Becoming Leader. State: Replica: 25a826f326054a31a5be8db7f6b09a83, State: Running, Role: LEADER
I20260709 13:05:02.057654 10496 catalog_manager.cc:5697] T b9ea195e53c447cca2d3d8cfc8481ff6 P c12666dfd84348ca891f38fb4d0738b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c12666dfd84348ca891f38fb4d0738b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:02.042150 10600 raft_consensus.cc:2468] T 275e6f7ace35466d9a3dcc0ab83dfbcd P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25a826f326054a31a5be8db7f6b09a83 in term 1.
I20260709 13:05:02.042357 10789 ts_tablet_manager.cc:1434] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b: Time spent starting tablet: real 0.040s	user 0.012s	sys 0.007s
I20260709 13:05:02.064908 10789 tablet_bootstrap.cc:492] T 65fb662e39fe49258d71de811265ba16 P d9879027b78541b49ed49f803e95f76b: Bootstrap starting.
I20260709 13:05:02.043679 10564 leader_election.cc:304] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c12666dfd84348ca891f38fb4d0738b8, d9879027b78541b49ed49f803e95f76b; no voters: 25a826f326054a31a5be8db7f6b09a83
I20260709 13:05:02.067323 10564 leader_election.cc:304] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a826f326054a31a5be8db7f6b09a83, d9879027b78541b49ed49f803e95f76b; no voters: 
I20260709 13:05:02.067556 10794 raft_consensus.cc:2804] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:02.068012 10794 raft_consensus.cc:493] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:02.068192 10813 raft_consensus.cc:2804] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:05:02.068367 10564 leader_election.cc:343] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195:38441): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:02.070091 10564 leader_election.cc:343] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195:38441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:02.068398 10794 raft_consensus.cc:3060] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:02.073982 10791 tablet_bootstrap.cc:492] T d60282d41bde45538429171e6a290048 P 25a826f326054a31a5be8db7f6b09a83: No bootstrap required, opened a new log
I20260709 13:05:02.062668 10797 consensus_queue.cc:237] T c9d1d89d891b4b84b70e9baa05c5b45a P 25a826f326054a31a5be8db7f6b09a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.074734 10791 ts_tablet_manager.cc:1403] T d60282d41bde45538429171e6a290048 P 25a826f326054a31a5be8db7f6b09a83: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.004s
I20260709 13:05:02.079470 10789 tablet_bootstrap.cc:654] T 65fb662e39fe49258d71de811265ba16 P d9879027b78541b49ed49f803e95f76b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:02.084827 10813 raft_consensus.cc:697] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b [term 1 LEADER]: Becoming Leader. State: Replica: d9879027b78541b49ed49f803e95f76b, State: Running, Role: LEADER
I20260709 13:05:02.085847 10813 consensus_queue.cc:237] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.089413 10640 leader_election.cc:304] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25a826f326054a31a5be8db7f6b09a83, d9879027b78541b49ed49f803e95f76b; no voters: c12666dfd84348ca891f38fb4d0738b8
I20260709 13:05:02.091856 10829 raft_consensus.cc:2804] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:02.098450 10794 raft_consensus.cc:515] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.101584 10794 leader_election.cc:290] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b [CANDIDATE]: Term 1 election: Requested vote from peers 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194:36333), c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195:38441)
I20260709 13:05:02.091410 10791 raft_consensus.cc:359] T d60282d41bde45538429171e6a290048 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.103401 10791 raft_consensus.cc:385] T d60282d41bde45538429171e6a290048 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:02.104358 10791 raft_consensus.cc:740] T d60282d41bde45538429171e6a290048 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25a826f326054a31a5be8db7f6b09a83, State: Initialized, Role: FOLLOWER
I20260709 13:05:02.105389 10791 consensus_queue.cc:260] T d60282d41bde45538429171e6a290048 P 25a826f326054a31a5be8db7f6b09a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.103641 10674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d60282d41bde45538429171e6a290048" candidate_uuid: "d9879027b78541b49ed49f803e95f76b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25a826f326054a31a5be8db7f6b09a83"
I20260709 13:05:02.110237 10674 raft_consensus.cc:3060] T d60282d41bde45538429171e6a290048 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:02.107340 10497 catalog_manager.cc:5697] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b reported cstate change: term changed from 0 to 1, leader changed from <none> to d9879027b78541b49ed49f803e95f76b (127.0.107.193). New cstate: current_term: 1 leader_uuid: "d9879027b78541b49ed49f803e95f76b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:02.103430 10748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d60282d41bde45538429171e6a290048" candidate_uuid: "d9879027b78541b49ed49f803e95f76b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c12666dfd84348ca891f38fb4d0738b8"
I20260709 13:05:02.121630 10748 raft_consensus.cc:3060] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:02.125174 10674 raft_consensus.cc:2468] T d60282d41bde45538429171e6a290048 P 25a826f326054a31a5be8db7f6b09a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9879027b78541b49ed49f803e95f76b in term 1.
I20260709 13:05:02.119179 10793 tablet_bootstrap.cc:492] T 0769de616981443f98fe2c1f18b8cb95 P c12666dfd84348ca891f38fb4d0738b8: No bootstrap required, opened a new log
I20260709 13:05:02.130144 10564 leader_election.cc:304] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a826f326054a31a5be8db7f6b09a83, d9879027b78541b49ed49f803e95f76b; no voters: 
I20260709 13:05:02.131990 10794 raft_consensus.cc:2804] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:02.132704 10794 raft_consensus.cc:697] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b [term 1 LEADER]: Becoming Leader. State: Replica: d9879027b78541b49ed49f803e95f76b, State: Running, Role: LEADER
I20260709 13:05:02.133841 10794 consensus_queue.cc:237] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.137929 10793 ts_tablet_manager.cc:1403] T 0769de616981443f98fe2c1f18b8cb95 P c12666dfd84348ca891f38fb4d0738b8: Time spent bootstrapping tablet: real 0.136s	user 0.029s	sys 0.015s
I20260709 13:05:02.137990 10829 raft_consensus.cc:697] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83 [term 1 LEADER]: Becoming Leader. State: Replica: 25a826f326054a31a5be8db7f6b09a83, State: Running, Role: LEADER
I20260709 13:05:02.146009 10748 raft_consensus.cc:2468] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9879027b78541b49ed49f803e95f76b in term 1.
I20260709 13:05:02.153398 10791 ts_tablet_manager.cc:1434] T d60282d41bde45538429171e6a290048 P 25a826f326054a31a5be8db7f6b09a83: Time spent starting tablet: real 0.076s	user 0.021s	sys 0.024s
I20260709 13:05:02.154716 10791 tablet_bootstrap.cc:492] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83: Bootstrap starting.
I20260709 13:05:02.161625 10829 consensus_queue.cc:237] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.161988 10793 raft_consensus.cc:359] T 0769de616981443f98fe2c1f18b8cb95 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.162884 10793 raft_consensus.cc:385] T 0769de616981443f98fe2c1f18b8cb95 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:02.163267 10793 raft_consensus.cc:740] T 0769de616981443f98fe2c1f18b8cb95 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c12666dfd84348ca891f38fb4d0738b8, State: Initialized, Role: FOLLOWER
I20260709 13:05:02.164232 10793 consensus_queue.cc:260] T 0769de616981443f98fe2c1f18b8cb95 P c12666dfd84348ca891f38fb4d0738b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.165185 10822 raft_consensus.cc:515] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.170094 10789 tablet_bootstrap.cc:492] T 65fb662e39fe49258d71de811265ba16 P d9879027b78541b49ed49f803e95f76b: No bootstrap required, opened a new log
I20260709 13:05:02.170915 10789 ts_tablet_manager.cc:1403] T 65fb662e39fe49258d71de811265ba16 P d9879027b78541b49ed49f803e95f76b: Time spent bootstrapping tablet: real 0.106s	user 0.027s	sys 0.004s
I20260709 13:05:02.171177 10791 tablet_bootstrap.cc:654] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:02.172191 10832 raft_consensus.cc:493] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.172765 10832 raft_consensus.cc:515] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.175701 10832 leader_election.cc:290] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194:36333), c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195:38441)
I20260709 13:05:02.178270 10793 ts_tablet_manager.cc:1434] T 0769de616981443f98fe2c1f18b8cb95 P c12666dfd84348ca891f38fb4d0738b8: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:05:02.180060 10793 tablet_bootstrap.cc:492] T 1d2f00bc524547b794c3a65afa1b00f7 P c12666dfd84348ca891f38fb4d0738b8: Bootstrap starting.
I20260709 13:05:02.181180 10497 catalog_manager.cc:5697] T c9d1d89d891b4b84b70e9baa05c5b45a P 25a826f326054a31a5be8db7f6b09a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "25a826f326054a31a5be8db7f6b09a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:02.181195 10674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ac7fd5cbe444fda04f98de073d9b47" candidate_uuid: "d9879027b78541b49ed49f803e95f76b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25a826f326054a31a5be8db7f6b09a83" is_pre_election: true
I20260709 13:05:02.176290 10789 raft_consensus.cc:359] T 65fb662e39fe49258d71de811265ba16 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.185941 10748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ac7fd5cbe444fda04f98de073d9b47" candidate_uuid: "d9879027b78541b49ed49f803e95f76b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c12666dfd84348ca891f38fb4d0738b8" is_pre_election: true
W20260709 13:05:02.186151 10564 leader_election.cc:343] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194:36333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:02.186218 10789 raft_consensus.cc:385] T 65fb662e39fe49258d71de811265ba16 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:02.186761 10789 raft_consensus.cc:740] T 65fb662e39fe49258d71de811265ba16 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9879027b78541b49ed49f803e95f76b, State: Initialized, Role: FOLLOWER
I20260709 13:05:02.187934 10789 consensus_queue.cc:260] T 65fb662e39fe49258d71de811265ba16 P d9879027b78541b49ed49f803e95f76b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.190507 10789 ts_tablet_manager.cc:1434] T 65fb662e39fe49258d71de811265ba16 P d9879027b78541b49ed49f803e95f76b: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.007s
I20260709 13:05:02.191676 10789 tablet_bootstrap.cc:492] T c9d1d89d891b4b84b70e9baa05c5b45a P d9879027b78541b49ed49f803e95f76b: Bootstrap starting.
I20260709 13:05:02.195411 10600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0769de616981443f98fe2c1f18b8cb95" candidate_uuid: "25a826f326054a31a5be8db7f6b09a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9879027b78541b49ed49f803e95f76b"
I20260709 13:05:02.196391 10600 raft_consensus.cc:3060] T 0769de616981443f98fe2c1f18b8cb95 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:02.186647 10748 raft_consensus.cc:2468] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9879027b78541b49ed49f803e95f76b in term 0.
I20260709 13:05:02.198987 10564 leader_election.cc:304] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c12666dfd84348ca891f38fb4d0738b8, d9879027b78541b49ed49f803e95f76b; no voters: 25a826f326054a31a5be8db7f6b09a83
I20260709 13:05:02.200066 10832 raft_consensus.cc:2804] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:02.200443 10832 raft_consensus.cc:493] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:02.200516 10793 tablet_bootstrap.cc:654] T 1d2f00bc524547b794c3a65afa1b00f7 P c12666dfd84348ca891f38fb4d0738b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:02.200807 10832 raft_consensus.cc:3060] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:02.207897 10822 leader_election.cc:290] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 1 election: Requested vote from peers d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139), c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195:38441)
I20260709 13:05:02.209533 10748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0769de616981443f98fe2c1f18b8cb95" candidate_uuid: "25a826f326054a31a5be8db7f6b09a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c12666dfd84348ca891f38fb4d0738b8"
I20260709 13:05:02.210225 10748 raft_consensus.cc:3060] T 0769de616981443f98fe2c1f18b8cb95 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:02.212251 10600 raft_consensus.cc:2468] T 0769de616981443f98fe2c1f18b8cb95 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25a826f326054a31a5be8db7f6b09a83 in term 1.
I20260709 13:05:02.212990 10832 raft_consensus.cc:515] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.214514 10640 leader_election.cc:304] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a826f326054a31a5be8db7f6b09a83, d9879027b78541b49ed49f803e95f76b; no voters: 
I20260709 13:05:02.218318 10674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ac7fd5cbe444fda04f98de073d9b47" candidate_uuid: "d9879027b78541b49ed49f803e95f76b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25a826f326054a31a5be8db7f6b09a83"
I20260709 13:05:02.218729 10837 raft_consensus.cc:2804] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:02.219326 10748 raft_consensus.cc:2468] T 0769de616981443f98fe2c1f18b8cb95 P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25a826f326054a31a5be8db7f6b09a83 in term 1.
W20260709 13:05:02.220321 10564 leader_election.cc:343] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194:36333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:02.219671 10837 raft_consensus.cc:697] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 [term 1 LEADER]: Becoming Leader. State: Replica: 25a826f326054a31a5be8db7f6b09a83, State: Running, Role: LEADER
I20260709 13:05:02.221803 10837 consensus_queue.cc:237] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.223280 10791 tablet_bootstrap.cc:492] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83: No bootstrap required, opened a new log
I20260709 13:05:02.223807 10791 ts_tablet_manager.cc:1403] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83: Time spent bootstrapping tablet: real 0.069s	user 0.009s	sys 0.014s
I20260709 13:05:02.226699 10789 tablet_bootstrap.cc:654] T c9d1d89d891b4b84b70e9baa05c5b45a P d9879027b78541b49ed49f803e95f76b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:02.228847 10496 catalog_manager.cc:5697] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b reported cstate change: term changed from 0 to 1, leader changed from <none> to d9879027b78541b49ed49f803e95f76b (127.0.107.193). New cstate: current_term: 1 leader_uuid: "d9879027b78541b49ed49f803e95f76b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:02.231990 10832 leader_election.cc:290] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b [CANDIDATE]: Term 1 election: Requested vote from peers 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194:36333), c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195:38441)
I20260709 13:05:02.239114 10748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ac7fd5cbe444fda04f98de073d9b47" candidate_uuid: "d9879027b78541b49ed49f803e95f76b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c12666dfd84348ca891f38fb4d0738b8"
I20260709 13:05:02.239912 10748 raft_consensus.cc:3060] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:02.242794 10498 catalog_manager.cc:5697] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "25a826f326054a31a5be8db7f6b09a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:02.248109 10748 raft_consensus.cc:2468] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9879027b78541b49ed49f803e95f76b in term 1.
I20260709 13:05:02.249781 10564 leader_election.cc:304] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c12666dfd84348ca891f38fb4d0738b8, d9879027b78541b49ed49f803e95f76b; no voters: 25a826f326054a31a5be8db7f6b09a83
I20260709 13:05:02.251175 10832 raft_consensus.cc:2804] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:02.251665 10832 raft_consensus.cc:697] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b [term 1 LEADER]: Becoming Leader. State: Replica: d9879027b78541b49ed49f803e95f76b, State: Running, Role: LEADER
I20260709 13:05:02.252502 10832 consensus_queue.cc:237] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.256340 10829 raft_consensus.cc:493] T b9ea195e53c447cca2d3d8cfc8481ff6 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.256922 10829 raft_consensus.cc:515] T b9ea195e53c447cca2d3d8cfc8481ff6 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.259307 10829 leader_election.cc:290] T b9ea195e53c447cca2d3d8cfc8481ff6 P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139), c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195:38441)
I20260709 13:05:02.259793 10793 tablet_bootstrap.cc:492] T 1d2f00bc524547b794c3a65afa1b00f7 P c12666dfd84348ca891f38fb4d0738b8: No bootstrap required, opened a new log
I20260709 13:05:02.260522 10793 ts_tablet_manager.cc:1403] T 1d2f00bc524547b794c3a65afa1b00f7 P c12666dfd84348ca891f38fb4d0738b8: Time spent bootstrapping tablet: real 0.081s	user 0.007s	sys 0.007s
I20260709 13:05:02.261559 10600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ea195e53c447cca2d3d8cfc8481ff6" candidate_uuid: "25a826f326054a31a5be8db7f6b09a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9879027b78541b49ed49f803e95f76b" is_pre_election: true
I20260709 13:05:02.262480 10600 raft_consensus.cc:2393] T b9ea195e53c447cca2d3d8cfc8481ff6 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25a826f326054a31a5be8db7f6b09a83 in current term 1: Already voted for candidate c12666dfd84348ca891f38fb4d0738b8 in this term.
I20260709 13:05:02.260661 10749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ea195e53c447cca2d3d8cfc8481ff6" candidate_uuid: "25a826f326054a31a5be8db7f6b09a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c12666dfd84348ca891f38fb4d0738b8" is_pre_election: true
I20260709 13:05:02.265719 10793 raft_consensus.cc:359] T 1d2f00bc524547b794c3a65afa1b00f7 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.266851 10640 leader_election.cc:304] T b9ea195e53c447cca2d3d8cfc8481ff6 P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25a826f326054a31a5be8db7f6b09a83; no voters: c12666dfd84348ca891f38fb4d0738b8, d9879027b78541b49ed49f803e95f76b
I20260709 13:05:02.267387 10793 raft_consensus.cc:385] T 1d2f00bc524547b794c3a65afa1b00f7 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:02.267870 10793 raft_consensus.cc:740] T 1d2f00bc524547b794c3a65afa1b00f7 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c12666dfd84348ca891f38fb4d0738b8, State: Initialized, Role: FOLLOWER
I20260709 13:05:02.268422 10829 raft_consensus.cc:3060] T b9ea195e53c447cca2d3d8cfc8481ff6 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:02.269284 10793 consensus_queue.cc:260] T 1d2f00bc524547b794c3a65afa1b00f7 P c12666dfd84348ca891f38fb4d0738b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.272235 10793 ts_tablet_manager.cc:1434] T 1d2f00bc524547b794c3a65afa1b00f7 P c12666dfd84348ca891f38fb4d0738b8: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:05:02.273715 10793 tablet_bootstrap.cc:492] T 275e6f7ace35466d9a3dcc0ab83dfbcd P c12666dfd84348ca891f38fb4d0738b8: Bootstrap starting.
I20260709 13:05:02.275476 10497 catalog_manager.cc:5697] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b reported cstate change: term changed from 0 to 1, leader changed from <none> to d9879027b78541b49ed49f803e95f76b (127.0.107.193). New cstate: current_term: 1 leader_uuid: "d9879027b78541b49ed49f803e95f76b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:02.283372 10791 raft_consensus.cc:359] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.284045 10791 raft_consensus.cc:385] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:02.284284 10791 raft_consensus.cc:740] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25a826f326054a31a5be8db7f6b09a83, State: Initialized, Role: FOLLOWER
I20260709 13:05:02.285315 10791 consensus_queue.cc:260] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.285696 10829 raft_consensus.cc:2749] T b9ea195e53c447cca2d3d8cfc8481ff6 P 25a826f326054a31a5be8db7f6b09a83 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:02.287003 10791 ts_tablet_manager.cc:1434] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.000s
I20260709 13:05:02.288026 10791 tablet_bootstrap.cc:492] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83: Bootstrap starting.
I20260709 13:05:02.295130 10793 tablet_bootstrap.cc:654] T 275e6f7ace35466d9a3dcc0ab83dfbcd P c12666dfd84348ca891f38fb4d0738b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:02.295508 10791 tablet_bootstrap.cc:654] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:02.296185 10789 tablet_bootstrap.cc:492] T c9d1d89d891b4b84b70e9baa05c5b45a P d9879027b78541b49ed49f803e95f76b: No bootstrap required, opened a new log
I20260709 13:05:02.296808 10789 ts_tablet_manager.cc:1403] T c9d1d89d891b4b84b70e9baa05c5b45a P d9879027b78541b49ed49f803e95f76b: Time spent bootstrapping tablet: real 0.105s	user 0.021s	sys 0.027s
I20260709 13:05:02.300577 10789 raft_consensus.cc:359] T c9d1d89d891b4b84b70e9baa05c5b45a P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.301396 10789 raft_consensus.cc:385] T c9d1d89d891b4b84b70e9baa05c5b45a P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:02.301723 10789 raft_consensus.cc:740] T c9d1d89d891b4b84b70e9baa05c5b45a P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9879027b78541b49ed49f803e95f76b, State: Initialized, Role: FOLLOWER
I20260709 13:05:02.302488 10789 consensus_queue.cc:260] T c9d1d89d891b4b84b70e9baa05c5b45a P d9879027b78541b49ed49f803e95f76b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.303544 10793 tablet_bootstrap.cc:492] T 275e6f7ace35466d9a3dcc0ab83dfbcd P c12666dfd84348ca891f38fb4d0738b8: No bootstrap required, opened a new log
I20260709 13:05:02.304111 10793 ts_tablet_manager.cc:1403] T 275e6f7ace35466d9a3dcc0ab83dfbcd P c12666dfd84348ca891f38fb4d0738b8: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.000s
I20260709 13:05:02.304876 10789 ts_tablet_manager.cc:1434] T c9d1d89d891b4b84b70e9baa05c5b45a P d9879027b78541b49ed49f803e95f76b: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:05:02.352789 10494 catalog_manager.cc:5697] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "25a826f326054a31a5be8db7f6b09a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:02.364596 10789 tablet_bootstrap.cc:492] T 1789fe885f1e4e2a851aebab8d6f1c95 P d9879027b78541b49ed49f803e95f76b: Bootstrap starting.
I20260709 13:05:02.301416 10791 tablet_bootstrap.cc:492] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83: No bootstrap required, opened a new log
I20260709 13:05:02.369196 10791 ts_tablet_manager.cc:1403] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83: Time spent bootstrapping tablet: real 0.081s	user 0.013s	sys 0.000s
W20260709 13:05:02.371749 10714 consensus_peers.cc:597] T b42fcc8a7b364f1eb90b8983dd617f74 P c12666dfd84348ca891f38fb4d0738b8 -> Peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Couldn't send request to peer d9879027b78541b49ed49f803e95f76b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:02.378754 10791 raft_consensus.cc:359] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.380439 10791 raft_consensus.cc:385] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:02.381132 10791 raft_consensus.cc:740] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25a826f326054a31a5be8db7f6b09a83, State: Initialized, Role: FOLLOWER
I20260709 13:05:02.381542 10789 tablet_bootstrap.cc:654] T 1789fe885f1e4e2a851aebab8d6f1c95 P d9879027b78541b49ed49f803e95f76b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:02.381016 10793 raft_consensus.cc:359] T 275e6f7ace35466d9a3dcc0ab83dfbcd P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.382153 10793 raft_consensus.cc:385] T 275e6f7ace35466d9a3dcc0ab83dfbcd P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:02.382534 10793 raft_consensus.cc:740] T 275e6f7ace35466d9a3dcc0ab83dfbcd P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c12666dfd84348ca891f38fb4d0738b8, State: Initialized, Role: FOLLOWER
I20260709 13:05:02.388453 10793 consensus_queue.cc:260] T 275e6f7ace35466d9a3dcc0ab83dfbcd P c12666dfd84348ca891f38fb4d0738b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.395413 10793 ts_tablet_manager.cc:1434] T 275e6f7ace35466d9a3dcc0ab83dfbcd P c12666dfd84348ca891f38fb4d0738b8: Time spent starting tablet: real 0.091s	user 0.009s	sys 0.007s
I20260709 13:05:02.395920 10807 consensus_queue.cc:1048] T b42fcc8a7b364f1eb90b8983dd617f74 P c12666dfd84348ca891f38fb4d0738b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:02.397665 10793 tablet_bootstrap.cc:492] T 65fb662e39fe49258d71de811265ba16 P c12666dfd84348ca891f38fb4d0738b8: Bootstrap starting.
I20260709 13:05:02.404364 10791 consensus_queue.cc:260] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.408545 10791 ts_tablet_manager.cc:1434] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83: Time spent starting tablet: real 0.039s	user 0.013s	sys 0.000s
I20260709 13:05:02.409070 10793 tablet_bootstrap.cc:654] T 65fb662e39fe49258d71de811265ba16 P c12666dfd84348ca891f38fb4d0738b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:02.410599 10791 tablet_bootstrap.cc:492] T 99ac7fd5cbe444fda04f98de073d9b47 P 25a826f326054a31a5be8db7f6b09a83: Bootstrap starting.
I20260709 13:05:02.416314 10832 raft_consensus.cc:493] T c9d1d89d891b4b84b70e9baa05c5b45a P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.417095 10832 raft_consensus.cc:515] T c9d1d89d891b4b84b70e9baa05c5b45a P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.423650 10675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d1d89d891b4b84b70e9baa05c5b45a" candidate_uuid: "d9879027b78541b49ed49f803e95f76b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25a826f326054a31a5be8db7f6b09a83" is_pre_election: true
I20260709 13:05:02.429801 10832 leader_election.cc:290] T c9d1d89d891b4b84b70e9baa05c5b45a P d9879027b78541b49ed49f803e95f76b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194:36333), c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195:38441)
I20260709 13:05:02.431900 10749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d1d89d891b4b84b70e9baa05c5b45a" candidate_uuid: "d9879027b78541b49ed49f803e95f76b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c12666dfd84348ca891f38fb4d0738b8" is_pre_election: true
I20260709 13:05:02.433400 10749 raft_consensus.cc:2393] T c9d1d89d891b4b84b70e9baa05c5b45a P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d9879027b78541b49ed49f803e95f76b in current term 1: Already voted for candidate 25a826f326054a31a5be8db7f6b09a83 in this term.
I20260709 13:05:02.435034 10564 leader_election.cc:304] T c9d1d89d891b4b84b70e9baa05c5b45a P d9879027b78541b49ed49f803e95f76b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9879027b78541b49ed49f803e95f76b; no voters: 25a826f326054a31a5be8db7f6b09a83, c12666dfd84348ca891f38fb4d0738b8
I20260709 13:05:02.436501 10791 tablet_bootstrap.cc:654] T 99ac7fd5cbe444fda04f98de073d9b47 P 25a826f326054a31a5be8db7f6b09a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:02.436874 10832 raft_consensus.cc:3060] T c9d1d89d891b4b84b70e9baa05c5b45a P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:02.438531 10793 tablet_bootstrap.cc:492] T 65fb662e39fe49258d71de811265ba16 P c12666dfd84348ca891f38fb4d0738b8: No bootstrap required, opened a new log
I20260709 13:05:02.439260 10793 ts_tablet_manager.cc:1403] T 65fb662e39fe49258d71de811265ba16 P c12666dfd84348ca891f38fb4d0738b8: Time spent bootstrapping tablet: real 0.042s	user 0.019s	sys 0.015s
I20260709 13:05:02.440975 10789 tablet_bootstrap.cc:492] T 1789fe885f1e4e2a851aebab8d6f1c95 P d9879027b78541b49ed49f803e95f76b: No bootstrap required, opened a new log
I20260709 13:05:02.441131 10807 raft_consensus.cc:493] T 1d2f00bc524547b794c3a65afa1b00f7 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.442027 10789 ts_tablet_manager.cc:1403] T 1789fe885f1e4e2a851aebab8d6f1c95 P d9879027b78541b49ed49f803e95f76b: Time spent bootstrapping tablet: real 0.078s	user 0.027s	sys 0.020s
I20260709 13:05:02.442219 10807 raft_consensus.cc:515] T 1d2f00bc524547b794c3a65afa1b00f7 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.450973 10807 leader_election.cc:290] T 1d2f00bc524547b794c3a65afa1b00f7 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139), 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194:36333)
I20260709 13:05:02.453918 10789 raft_consensus.cc:359] T 1789fe885f1e4e2a851aebab8d6f1c95 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.454514 10600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2f00bc524547b794c3a65afa1b00f7" candidate_uuid: "c12666dfd84348ca891f38fb4d0738b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9879027b78541b49ed49f803e95f76b" is_pre_election: true
I20260709 13:05:02.455165 10789 raft_consensus.cc:385] T 1789fe885f1e4e2a851aebab8d6f1c95 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:02.455603 10789 raft_consensus.cc:740] T 1789fe885f1e4e2a851aebab8d6f1c95 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9879027b78541b49ed49f803e95f76b, State: Initialized, Role: FOLLOWER
I20260709 13:05:02.456593 10789 consensus_queue.cc:260] T 1789fe885f1e4e2a851aebab8d6f1c95 P d9879027b78541b49ed49f803e95f76b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.457834 10837 raft_consensus.cc:493] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.458781 10837 raft_consensus.cc:515] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.460659 10789 ts_tablet_manager.cc:1434] T 1789fe885f1e4e2a851aebab8d6f1c95 P d9879027b78541b49ed49f803e95f76b: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.000s
I20260709 13:05:02.463398 10793 raft_consensus.cc:359] T 65fb662e39fe49258d71de811265ba16 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.464443 10793 raft_consensus.cc:385] T 65fb662e39fe49258d71de811265ba16 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:02.464767 10793 raft_consensus.cc:740] T 65fb662e39fe49258d71de811265ba16 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c12666dfd84348ca891f38fb4d0738b8, State: Initialized, Role: FOLLOWER
I20260709 13:05:02.467025 10791 tablet_bootstrap.cc:492] T 99ac7fd5cbe444fda04f98de073d9b47 P 25a826f326054a31a5be8db7f6b09a83: No bootstrap required, opened a new log
I20260709 13:05:02.467643 10791 ts_tablet_manager.cc:1403] T 99ac7fd5cbe444fda04f98de073d9b47 P 25a826f326054a31a5be8db7f6b09a83: Time spent bootstrapping tablet: real 0.058s	user 0.007s	sys 0.019s
I20260709 13:05:02.471338 10791 raft_consensus.cc:359] T 99ac7fd5cbe444fda04f98de073d9b47 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.472394 10791 raft_consensus.cc:385] T 99ac7fd5cbe444fda04f98de073d9b47 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:02.472692 10791 raft_consensus.cc:740] T 99ac7fd5cbe444fda04f98de073d9b47 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25a826f326054a31a5be8db7f6b09a83, State: Initialized, Role: FOLLOWER
I20260709 13:05:02.472733 10793 consensus_queue.cc:260] T 65fb662e39fe49258d71de811265ba16 P c12666dfd84348ca891f38fb4d0738b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.471689 10789 tablet_bootstrap.cc:492] T b42fcc8a7b364f1eb90b8983dd617f74 P d9879027b78541b49ed49f803e95f76b: Bootstrap starting.
I20260709 13:05:02.473570 10791 consensus_queue.cc:260] T 99ac7fd5cbe444fda04f98de073d9b47 P 25a826f326054a31a5be8db7f6b09a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.473505 10674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2f00bc524547b794c3a65afa1b00f7" candidate_uuid: "c12666dfd84348ca891f38fb4d0738b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25a826f326054a31a5be8db7f6b09a83" is_pre_election: true
I20260709 13:05:02.475152 10674 raft_consensus.cc:2393] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c12666dfd84348ca891f38fb4d0738b8 in current term 1: Already voted for candidate d9879027b78541b49ed49f803e95f76b in this term.
I20260709 13:05:02.476895 10798 consensus_queue.cc:1048] T b9ea195e53c447cca2d3d8cfc8481ff6 P c12666dfd84348ca891f38fb4d0738b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:02.479234 10791 ts_tablet_manager.cc:1434] T 99ac7fd5cbe444fda04f98de073d9b47 P 25a826f326054a31a5be8db7f6b09a83: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.004s
I20260709 13:05:02.480299 10793 ts_tablet_manager.cc:1434] T 65fb662e39fe49258d71de811265ba16 P c12666dfd84348ca891f38fb4d0738b8: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 13:05:02.486948 10597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fb662e39fe49258d71de811265ba16" candidate_uuid: "25a826f326054a31a5be8db7f6b09a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9879027b78541b49ed49f803e95f76b" is_pre_election: true
I20260709 13:05:02.487341 10789 tablet_bootstrap.cc:654] T b42fcc8a7b364f1eb90b8983dd617f74 P d9879027b78541b49ed49f803e95f76b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:02.488117 10597 raft_consensus.cc:2468] T 65fb662e39fe49258d71de811265ba16 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25a826f326054a31a5be8db7f6b09a83 in term 0.
I20260709 13:05:02.490383 10640 leader_election.cc:304] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a826f326054a31a5be8db7f6b09a83, d9879027b78541b49ed49f803e95f76b; no voters: 
I20260709 13:05:02.491953 10829 raft_consensus.cc:2804] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:02.492411 10829 raft_consensus.cc:493] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:02.493125 10837 leader_election.cc:290] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139), c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195:38441)
I20260709 13:05:02.492760 10829 raft_consensus.cc:3060] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:02.495242 10749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fb662e39fe49258d71de811265ba16" candidate_uuid: "25a826f326054a31a5be8db7f6b09a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c12666dfd84348ca891f38fb4d0738b8" is_pre_election: true
I20260709 13:05:02.496284 10749 raft_consensus.cc:2468] T 65fb662e39fe49258d71de811265ba16 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25a826f326054a31a5be8db7f6b09a83 in term 0.
I20260709 13:05:02.505556 10832 raft_consensus.cc:2749] T c9d1d89d891b4b84b70e9baa05c5b45a P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:02.513893 10793 tablet_bootstrap.cc:492] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8: Bootstrap starting.
I20260709 13:05:02.518376 10853 consensus_queue.cc:1048] T b9ea195e53c447cca2d3d8cfc8481ff6 P c12666dfd84348ca891f38fb4d0738b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:02.527997 10793 tablet_bootstrap.cc:654] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:02.534793 10789 tablet_bootstrap.cc:492] T b42fcc8a7b364f1eb90b8983dd617f74 P d9879027b78541b49ed49f803e95f76b: No bootstrap required, opened a new log
I20260709 13:05:02.535506 10789 ts_tablet_manager.cc:1403] T b42fcc8a7b364f1eb90b8983dd617f74 P d9879027b78541b49ed49f803e95f76b: Time spent bootstrapping tablet: real 0.074s	user 0.022s	sys 0.009s
I20260709 13:05:02.535012 10829 raft_consensus.cc:515] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.530227 10713 leader_election.cc:304] T 1d2f00bc524547b794c3a65afa1b00f7 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c12666dfd84348ca891f38fb4d0738b8; no voters: 25a826f326054a31a5be8db7f6b09a83, d9879027b78541b49ed49f803e95f76b
I20260709 13:05:02.539455 10597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fb662e39fe49258d71de811265ba16" candidate_uuid: "25a826f326054a31a5be8db7f6b09a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9879027b78541b49ed49f803e95f76b"
I20260709 13:05:02.540195 10597 raft_consensus.cc:3060] T 65fb662e39fe49258d71de811265ba16 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:02.542562 10789 raft_consensus.cc:359] T b42fcc8a7b364f1eb90b8983dd617f74 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.547241 10829 leader_election.cc:290] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 1 election: Requested vote from peers d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139), c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195:38441)
I20260709 13:05:02.548784 10789 raft_consensus.cc:385] T b42fcc8a7b364f1eb90b8983dd617f74 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:02.551608 10748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fb662e39fe49258d71de811265ba16" candidate_uuid: "25a826f326054a31a5be8db7f6b09a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c12666dfd84348ca891f38fb4d0738b8"
I20260709 13:05:02.552392 10748 raft_consensus.cc:3060] T 65fb662e39fe49258d71de811265ba16 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:02.553049 10807 raft_consensus.cc:3060] T 1d2f00bc524547b794c3a65afa1b00f7 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:02.549269 10789 raft_consensus.cc:740] T b42fcc8a7b364f1eb90b8983dd617f74 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9879027b78541b49ed49f803e95f76b, State: Initialized, Role: FOLLOWER
I20260709 13:05:02.557744 10832 consensus_queue.cc:1048] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b [LEADER]: Connected to new peer: Peer: permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:02.567827 10789 consensus_queue.cc:260] T b42fcc8a7b364f1eb90b8983dd617f74 P d9879027b78541b49ed49f803e95f76b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.587091 10807 raft_consensus.cc:2749] T 1d2f00bc524547b794c3a65afa1b00f7 P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:02.599162 10832 consensus_queue.cc:1048] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:02.588610 10597 raft_consensus.cc:2468] T 65fb662e39fe49258d71de811265ba16 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25a826f326054a31a5be8db7f6b09a83 in term 1.
I20260709 13:05:02.603309 10793 tablet_bootstrap.cc:492] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8: No bootstrap required, opened a new log
I20260709 13:05:02.604038 10793 ts_tablet_manager.cc:1403] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8: Time spent bootstrapping tablet: real 0.091s	user 0.019s	sys 0.019s
I20260709 13:05:02.602134 10640 leader_election.cc:304] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a826f326054a31a5be8db7f6b09a83, d9879027b78541b49ed49f803e95f76b; no voters: 
I20260709 13:05:02.605072 10789 ts_tablet_manager.cc:1434] T b42fcc8a7b364f1eb90b8983dd617f74 P d9879027b78541b49ed49f803e95f76b: Time spent starting tablet: real 0.069s	user 0.012s	sys 0.000s
I20260709 13:05:02.605720 10829 raft_consensus.cc:2804] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:02.606381 10829 raft_consensus.cc:697] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 [term 1 LEADER]: Becoming Leader. State: Replica: 25a826f326054a31a5be8db7f6b09a83, State: Running, Role: LEADER
I20260709 13:05:02.606890 10748 raft_consensus.cc:2468] T 65fb662e39fe49258d71de811265ba16 P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25a826f326054a31a5be8db7f6b09a83 in term 1.
I20260709 13:05:02.612943 10829 consensus_queue.cc:237] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.617008 10837 raft_consensus.cc:493] T 99ac7fd5cbe444fda04f98de073d9b47 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.617794 10837 raft_consensus.cc:515] T 99ac7fd5cbe444fda04f98de073d9b47 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.622448 10597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ac7fd5cbe444fda04f98de073d9b47" candidate_uuid: "25a826f326054a31a5be8db7f6b09a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9879027b78541b49ed49f803e95f76b" is_pre_election: true
I20260709 13:05:02.627614 10793 raft_consensus.cc:359] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.629124 10793 raft_consensus.cc:385] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:02.629827 10793 raft_consensus.cc:740] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c12666dfd84348ca891f38fb4d0738b8, State: Initialized, Role: FOLLOWER
I20260709 13:05:02.631313 10793 consensus_queue.cc:260] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.634711 10793 ts_tablet_manager.cc:1434] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.003s
I20260709 13:05:02.638091 10822 consensus_queue.cc:1048] T c9d1d89d891b4b84b70e9baa05c5b45a P 25a826f326054a31a5be8db7f6b09a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:02.642967 10837 leader_election.cc:290] T 99ac7fd5cbe444fda04f98de073d9b47 P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139), c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195:38441)
I20260709 13:05:02.644313 10748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ac7fd5cbe444fda04f98de073d9b47" candidate_uuid: "25a826f326054a31a5be8db7f6b09a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c12666dfd84348ca891f38fb4d0738b8" is_pre_election: true
I20260709 13:05:02.644510 10832 consensus_queue.cc:1048] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:02.645473 10748 raft_consensus.cc:2393] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25a826f326054a31a5be8db7f6b09a83 in current term 1: Already voted for candidate d9879027b78541b49ed49f803e95f76b in this term.
I20260709 13:05:02.647380 10639 leader_election.cc:304] T 99ac7fd5cbe444fda04f98de073d9b47 P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25a826f326054a31a5be8db7f6b09a83; no voters: c12666dfd84348ca891f38fb4d0738b8, d9879027b78541b49ed49f803e95f76b
I20260709 13:05:02.649854 10822 raft_consensus.cc:3060] T 99ac7fd5cbe444fda04f98de073d9b47 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:02.654018 10794 consensus_queue.cc:1048] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b [LEADER]: Connected to new peer: Peer: permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:02.670830 10837 consensus_queue.cc:1048] T c9d1d89d891b4b84b70e9baa05c5b45a P 25a826f326054a31a5be8db7f6b09a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:02.676462 10497 catalog_manager.cc:5697] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "25a826f326054a31a5be8db7f6b09a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:02.684109 10822 raft_consensus.cc:2749] T 99ac7fd5cbe444fda04f98de073d9b47 P 25a826f326054a31a5be8db7f6b09a83 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:02.688253 10829 raft_consensus.cc:493] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.688787 10829 raft_consensus.cc:515] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.691246 10829 leader_election.cc:290] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139), c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195:38441)
I20260709 13:05:02.694484 10747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1789fe885f1e4e2a851aebab8d6f1c95" candidate_uuid: "25a826f326054a31a5be8db7f6b09a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c12666dfd84348ca891f38fb4d0738b8" is_pre_election: true
I20260709 13:05:02.695391 10747 raft_consensus.cc:2468] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25a826f326054a31a5be8db7f6b09a83 in term 0.
I20260709 13:05:02.696722 10639 leader_election.cc:304] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a826f326054a31a5be8db7f6b09a83, c12666dfd84348ca891f38fb4d0738b8; no voters: 
I20260709 13:05:02.698048 10797 raft_consensus.cc:2804] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:02.698441 10797 raft_consensus.cc:493] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:02.698796 10797 raft_consensus.cc:3060] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:02.699419 10807 raft_consensus.cc:493] T 275e6f7ace35466d9a3dcc0ab83dfbcd P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.699999 10807 raft_consensus.cc:515] T 275e6f7ace35466d9a3dcc0ab83dfbcd P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.703778 10674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275e6f7ace35466d9a3dcc0ab83dfbcd" candidate_uuid: "c12666dfd84348ca891f38fb4d0738b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25a826f326054a31a5be8db7f6b09a83" is_pre_election: true
I20260709 13:05:02.704273 10600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1789fe885f1e4e2a851aebab8d6f1c95" candidate_uuid: "25a826f326054a31a5be8db7f6b09a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9879027b78541b49ed49f803e95f76b" is_pre_election: true
I20260709 13:05:02.704998 10600 raft_consensus.cc:2468] T 1789fe885f1e4e2a851aebab8d6f1c95 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25a826f326054a31a5be8db7f6b09a83 in term 0.
I20260709 13:05:02.705288 10807 leader_election.cc:290] T 275e6f7ace35466d9a3dcc0ab83dfbcd P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139), 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194:36333)
I20260709 13:05:02.706010 10794 consensus_queue.cc:1048] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:02.706053 10597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275e6f7ace35466d9a3dcc0ab83dfbcd" candidate_uuid: "c12666dfd84348ca891f38fb4d0738b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9879027b78541b49ed49f803e95f76b" is_pre_election: true
I20260709 13:05:02.707314 10597 raft_consensus.cc:2393] T 275e6f7ace35466d9a3dcc0ab83dfbcd P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c12666dfd84348ca891f38fb4d0738b8 in current term 1: Already voted for candidate 25a826f326054a31a5be8db7f6b09a83 in this term.
I20260709 13:05:02.711560 10714 leader_election.cc:304] T 275e6f7ace35466d9a3dcc0ab83dfbcd P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c12666dfd84348ca891f38fb4d0738b8; no voters: 25a826f326054a31a5be8db7f6b09a83, d9879027b78541b49ed49f803e95f76b
I20260709 13:05:02.712432 10807 raft_consensus.cc:3060] T 275e6f7ace35466d9a3dcc0ab83dfbcd P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:02.719079 10797 raft_consensus.cc:515] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.722466 10797 leader_election.cc:290] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 1 election: Requested vote from peers d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139), c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195:38441)
I20260709 13:05:02.723086 10597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1789fe885f1e4e2a851aebab8d6f1c95" candidate_uuid: "25a826f326054a31a5be8db7f6b09a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9879027b78541b49ed49f803e95f76b"
I20260709 13:05:02.723321 10747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1789fe885f1e4e2a851aebab8d6f1c95" candidate_uuid: "25a826f326054a31a5be8db7f6b09a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c12666dfd84348ca891f38fb4d0738b8"
I20260709 13:05:02.723825 10597 raft_consensus.cc:3060] T 1789fe885f1e4e2a851aebab8d6f1c95 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:02.723990 10747 raft_consensus.cc:3060] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:02.728626 10807 raft_consensus.cc:2749] T 275e6f7ace35466d9a3dcc0ab83dfbcd P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:02.732470 10597 raft_consensus.cc:2468] T 1789fe885f1e4e2a851aebab8d6f1c95 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25a826f326054a31a5be8db7f6b09a83 in term 1.
I20260709 13:05:02.733903 10640 leader_election.cc:304] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a826f326054a31a5be8db7f6b09a83, d9879027b78541b49ed49f803e95f76b; no voters: 
I20260709 13:05:02.734989 10747 raft_consensus.cc:2468] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25a826f326054a31a5be8db7f6b09a83 in term 1.
I20260709 13:05:02.735195 10797 raft_consensus.cc:2804] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:02.736418 10797 raft_consensus.cc:697] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [term 1 LEADER]: Becoming Leader. State: Replica: 25a826f326054a31a5be8db7f6b09a83, State: Running, Role: LEADER
I20260709 13:05:02.737383 10797 consensus_queue.cc:237] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:02.743412 10822 consensus_queue.cc:1048] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:02.752234 10832 consensus_queue.cc:1048] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b [LEADER]: Connected to new peer: Peer: permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:02.754284 10497 catalog_manager.cc:5697] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "25a826f326054a31a5be8db7f6b09a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:02.785320 10797 consensus_queue.cc:1048] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:02.804646 10797 consensus_queue.cc:1048] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:02.823092 10797 consensus_queue.cc:1048] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:02.897926   431 ts_manager.cc:295] Set tserver state for d9879027b78541b49ed49f803e95f76b to MAINTENANCE_MODE
I20260709 13:05:02.898815   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:05:02.970151   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:02.972033   431 tablet_replica.cc:333] T b42fcc8a7b364f1eb90b8983dd617f74 P d9879027b78541b49ed49f803e95f76b: stopping tablet replica
I20260709 13:05:02.972892   431 raft_consensus.cc:2243] T b42fcc8a7b364f1eb90b8983dd617f74 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:02.973714   431 raft_consensus.cc:2272] T b42fcc8a7b364f1eb90b8983dd617f74 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:02.976892   431 tablet_replica.cc:333] T c9d1d89d891b4b84b70e9baa05c5b45a P d9879027b78541b49ed49f803e95f76b: stopping tablet replica
I20260709 13:05:02.979403   431 raft_consensus.cc:2243] T c9d1d89d891b4b84b70e9baa05c5b45a P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:02.979959   431 raft_consensus.cc:2272] T c9d1d89d891b4b84b70e9baa05c5b45a P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:02.987474   431 tablet_replica.cc:333] T 65fb662e39fe49258d71de811265ba16 P d9879027b78541b49ed49f803e95f76b: stopping tablet replica
I20260709 13:05:02.988238   431 raft_consensus.cc:2243] T 65fb662e39fe49258d71de811265ba16 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:02.989485   431 raft_consensus.cc:2272] T 65fb662e39fe49258d71de811265ba16 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:02.993468   431 tablet_replica.cc:333] T b9ea195e53c447cca2d3d8cfc8481ff6 P d9879027b78541b49ed49f803e95f76b: stopping tablet replica
I20260709 13:05:02.994143   431 raft_consensus.cc:2243] T b9ea195e53c447cca2d3d8cfc8481ff6 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:02.994693   431 raft_consensus.cc:2272] T b9ea195e53c447cca2d3d8cfc8481ff6 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:02.998275   431 tablet_replica.cc:333] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b: stopping tablet replica
I20260709 13:05:02.998828   431 raft_consensus.cc:2243] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:02.999806   431 raft_consensus.cc:2272] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.002568   431 tablet_replica.cc:333] T 1789fe885f1e4e2a851aebab8d6f1c95 P d9879027b78541b49ed49f803e95f76b: stopping tablet replica
I20260709 13:05:03.003633   431 raft_consensus.cc:2243] T 1789fe885f1e4e2a851aebab8d6f1c95 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:03.004140   431 raft_consensus.cc:2272] T 1789fe885f1e4e2a851aebab8d6f1c95 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.007217   431 tablet_replica.cc:333] T 0769de616981443f98fe2c1f18b8cb95 P d9879027b78541b49ed49f803e95f76b: stopping tablet replica
I20260709 13:05:03.008226   431 raft_consensus.cc:2243] T 0769de616981443f98fe2c1f18b8cb95 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:03.008883   431 raft_consensus.cc:2272] T 0769de616981443f98fe2c1f18b8cb95 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.014518   431 tablet_replica.cc:333] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b: stopping tablet replica
I20260709 13:05:03.015556   431 raft_consensus.cc:2243] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:03.016866   431 raft_consensus.cc:2272] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.020768   431 tablet_replica.cc:333] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b: stopping tablet replica
I20260709 13:05:03.021384   431 raft_consensus.cc:2243] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:03.022243   431 raft_consensus.cc:2272] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.025713   431 tablet_replica.cc:333] T 275e6f7ace35466d9a3dcc0ab83dfbcd P d9879027b78541b49ed49f803e95f76b: stopping tablet replica
I20260709 13:05:03.026726   431 raft_consensus.cc:2243] T 275e6f7ace35466d9a3dcc0ab83dfbcd P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:03.027391   431 raft_consensus.cc:2272] T 275e6f7ace35466d9a3dcc0ab83dfbcd P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.069869   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:05:03.089787 10640 consensus_peers.cc:597] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 -> Peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Couldn't send request to peer d9879027b78541b49ed49f803e95f76b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42139: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:03.098117 10714 consensus_peers.cc:597] T b9ea195e53c447cca2d3d8cfc8481ff6 P c12666dfd84348ca891f38fb4d0738b8 -> Peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Couldn't send request to peer d9879027b78541b49ed49f803e95f76b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42139: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:03.209288 10797 consensus_queue.cc:1048] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:05:03.242961 10640 consensus_peers.cc:597] T c9d1d89d891b4b84b70e9baa05c5b45a P 25a826f326054a31a5be8db7f6b09a83 -> Peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Couldn't send request to peer d9879027b78541b49ed49f803e95f76b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42139: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:03.270702 10797 consensus_queue.cc:1048] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:05:03.288091 10640 consensus_peers.cc:597] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 -> Peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Couldn't send request to peer d9879027b78541b49ed49f803e95f76b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42139: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:03.339687 10640 consensus_peers.cc:597] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83 -> Peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Couldn't send request to peer d9879027b78541b49ed49f803e95f76b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42139: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:03.429585 10640 consensus_peers.cc:597] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 -> Peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Couldn't send request to peer d9879027b78541b49ed49f803e95f76b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42139: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:03.817231 10546 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:05:03.929855 10640 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42139: connect: Connection refused (error 111) [suppressed 125 similar messages]
I20260709 13:05:04.140928 10880 raft_consensus.cc:493] T d60282d41bde45538429171e6a290048 P 25a826f326054a31a5be8db7f6b09a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d9879027b78541b49ed49f803e95f76b)
I20260709 13:05:04.141471 10880 raft_consensus.cc:515] T d60282d41bde45538429171e6a290048 P 25a826f326054a31a5be8db7f6b09a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:04.143250 10880 leader_election.cc:290] T d60282d41bde45538429171e6a290048 P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139), c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195:38441)
I20260709 13:05:04.144651 10748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d60282d41bde45538429171e6a290048" candidate_uuid: "25a826f326054a31a5be8db7f6b09a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c12666dfd84348ca891f38fb4d0738b8" is_pre_election: true
W20260709 13:05:04.147732 10640 leader_election.cc:336] T d60282d41bde45538429171e6a290048 P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42139: connect: Connection refused (error 111)
I20260709 13:05:04.148164 10640 leader_election.cc:304] T d60282d41bde45538429171e6a290048 P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25a826f326054a31a5be8db7f6b09a83; no voters: c12666dfd84348ca891f38fb4d0738b8, d9879027b78541b49ed49f803e95f76b
I20260709 13:05:04.148847 10880 raft_consensus.cc:2749] T d60282d41bde45538429171e6a290048 P 25a826f326054a31a5be8db7f6b09a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:04.150681 10881 raft_consensus.cc:493] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d9879027b78541b49ed49f803e95f76b)
I20260709 13:05:04.151151 10881 raft_consensus.cc:515] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:04.152932 10881 leader_election.cc:290] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139), 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194:36333)
I20260709 13:05:04.154016 10674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d60282d41bde45538429171e6a290048" candidate_uuid: "c12666dfd84348ca891f38fb4d0738b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25a826f326054a31a5be8db7f6b09a83" is_pre_election: true
I20260709 13:05:04.154656 10674 raft_consensus.cc:2468] T d60282d41bde45538429171e6a290048 P 25a826f326054a31a5be8db7f6b09a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c12666dfd84348ca891f38fb4d0738b8 in term 1.
I20260709 13:05:04.155059 10881 raft_consensus.cc:493] T 1d2f00bc524547b794c3a65afa1b00f7 P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d9879027b78541b49ed49f803e95f76b)
I20260709 13:05:04.155625 10881 raft_consensus.cc:515] T 1d2f00bc524547b794c3a65afa1b00f7 P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:04.156105 10713 leader_election.cc:304] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a826f326054a31a5be8db7f6b09a83, c12666dfd84348ca891f38fb4d0738b8; no voters: 
W20260709 13:05:04.157397 10714 leader_election.cc:336] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42139: connect: Connection refused (error 111)
I20260709 13:05:04.157840 10882 raft_consensus.cc:2804] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:04.158072 10881 leader_election.cc:290] T 1d2f00bc524547b794c3a65afa1b00f7 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139), 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194:36333)
I20260709 13:05:04.158560 10882 raft_consensus.cc:493] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d9879027b78541b49ed49f803e95f76b)
I20260709 13:05:04.159066 10882 raft_consensus.cc:3060] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:04.159554 10674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2f00bc524547b794c3a65afa1b00f7" candidate_uuid: "c12666dfd84348ca891f38fb4d0738b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25a826f326054a31a5be8db7f6b09a83" is_pre_election: true
I20260709 13:05:04.161893 10880 raft_consensus.cc:493] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d9879027b78541b49ed49f803e95f76b)
I20260709 13:05:04.162875 10880 raft_consensus.cc:515] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:04.166195 10880 leader_election.cc:290] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139), c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195:38441)
W20260709 13:05:04.167402 10714 leader_election.cc:336] T 1d2f00bc524547b794c3a65afa1b00f7 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42139: connect: Connection refused (error 111)
I20260709 13:05:04.168040 10714 leader_election.cc:304] T 1d2f00bc524547b794c3a65afa1b00f7 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c12666dfd84348ca891f38fb4d0738b8; no voters: 25a826f326054a31a5be8db7f6b09a83, d9879027b78541b49ed49f803e95f76b
I20260709 13:05:04.169242 10881 raft_consensus.cc:2749] T 1d2f00bc524547b794c3a65afa1b00f7 P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:04.169364 10882 raft_consensus.cc:515] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:04.171015 10748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2f00bc524547b794c3a65afa1b00f7" candidate_uuid: "25a826f326054a31a5be8db7f6b09a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c12666dfd84348ca891f38fb4d0738b8" is_pre_election: true
W20260709 13:05:04.171321 10640 leader_election.cc:336] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42139: connect: Connection refused (error 111)
I20260709 13:05:04.171813 10748 raft_consensus.cc:2468] T 1d2f00bc524547b794c3a65afa1b00f7 P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25a826f326054a31a5be8db7f6b09a83 in term 1.
I20260709 13:05:04.172544 10882 leader_election.cc:290] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 2 election: Requested vote from peers d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139), 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194:36333)
I20260709 13:05:04.173431 10639 leader_election.cc:304] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25a826f326054a31a5be8db7f6b09a83, c12666dfd84348ca891f38fb4d0738b8; no voters: d9879027b78541b49ed49f803e95f76b
I20260709 13:05:04.173792 10674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d60282d41bde45538429171e6a290048" candidate_uuid: "c12666dfd84348ca891f38fb4d0738b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25a826f326054a31a5be8db7f6b09a83"
I20260709 13:05:04.174265 10880 raft_consensus.cc:2804] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:04.174439 10674 raft_consensus.cc:3060] T d60282d41bde45538429171e6a290048 P 25a826f326054a31a5be8db7f6b09a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:04.174681 10880 raft_consensus.cc:493] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d9879027b78541b49ed49f803e95f76b)
I20260709 13:05:04.175246 10880 raft_consensus.cc:3060] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:04.179669 10714 leader_election.cc:336] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42139: connect: Connection refused (error 111)
I20260709 13:05:04.183872 10674 raft_consensus.cc:2468] T d60282d41bde45538429171e6a290048 P 25a826f326054a31a5be8db7f6b09a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c12666dfd84348ca891f38fb4d0738b8 in term 2.
I20260709 13:05:04.185843 10713 leader_election.cc:304] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25a826f326054a31a5be8db7f6b09a83, c12666dfd84348ca891f38fb4d0738b8; no voters: d9879027b78541b49ed49f803e95f76b
I20260709 13:05:04.185997 10880 raft_consensus.cc:515] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:04.188115 10882 raft_consensus.cc:2804] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:04.189632 10882 raft_consensus.cc:697] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8 [term 2 LEADER]: Becoming Leader. State: Replica: c12666dfd84348ca891f38fb4d0738b8, State: Running, Role: LEADER
I20260709 13:05:04.190076 10880 leader_election.cc:290] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 2 election: Requested vote from peers d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139), c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195:38441)
I20260709 13:05:04.190343 10748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2f00bc524547b794c3a65afa1b00f7" candidate_uuid: "25a826f326054a31a5be8db7f6b09a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c12666dfd84348ca891f38fb4d0738b8"
I20260709 13:05:04.190951 10748 raft_consensus.cc:3060] T 1d2f00bc524547b794c3a65afa1b00f7 P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:04.190763 10882 consensus_queue.cc:237] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
W20260709 13:05:04.197670 10640 leader_election.cc:336] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42139: connect: Connection refused (error 111)
I20260709 13:05:04.199595 10748 raft_consensus.cc:2468] T 1d2f00bc524547b794c3a65afa1b00f7 P c12666dfd84348ca891f38fb4d0738b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25a826f326054a31a5be8db7f6b09a83 in term 2.
I20260709 13:05:04.200583 10494 catalog_manager.cc:5697] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8 reported cstate change: term changed from 1 to 2, leader changed from d9879027b78541b49ed49f803e95f76b (127.0.107.193) to c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "c12666dfd84348ca891f38fb4d0738b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:04.201423 10639 leader_election.cc:304] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25a826f326054a31a5be8db7f6b09a83, c12666dfd84348ca891f38fb4d0738b8; no voters: d9879027b78541b49ed49f803e95f76b
I20260709 13:05:04.203054 10880 raft_consensus.cc:2804] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:04.203559 10880 raft_consensus.cc:697] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83 [term 2 LEADER]: Becoming Leader. State: Replica: 25a826f326054a31a5be8db7f6b09a83, State: Running, Role: LEADER
I20260709 13:05:04.204602 10880 consensus_queue.cc:237] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:04.215896 10498 catalog_manager.cc:5697] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83 reported cstate change: term changed from 1 to 2, leader changed from d9879027b78541b49ed49f803e95f76b (127.0.107.193) to 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "25a826f326054a31a5be8db7f6b09a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:04.254716 10882 raft_consensus.cc:493] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d9879027b78541b49ed49f803e95f76b)
I20260709 13:05:04.255271 10882 raft_consensus.cc:515] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:04.257252 10882 leader_election.cc:290] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139), 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194:36333)
I20260709 13:05:04.257443 10880 raft_consensus.cc:493] T 99ac7fd5cbe444fda04f98de073d9b47 P 25a826f326054a31a5be8db7f6b09a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d9879027b78541b49ed49f803e95f76b)
I20260709 13:05:04.258047 10880 raft_consensus.cc:515] T 99ac7fd5cbe444fda04f98de073d9b47 P 25a826f326054a31a5be8db7f6b09a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:04.258641 10674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ac7fd5cbe444fda04f98de073d9b47" candidate_uuid: "c12666dfd84348ca891f38fb4d0738b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25a826f326054a31a5be8db7f6b09a83" is_pre_election: true
I20260709 13:05:04.259325 10674 raft_consensus.cc:2468] T 99ac7fd5cbe444fda04f98de073d9b47 P 25a826f326054a31a5be8db7f6b09a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c12666dfd84348ca891f38fb4d0738b8 in term 1.
I20260709 13:05:04.260172 10880 leader_election.cc:290] T 99ac7fd5cbe444fda04f98de073d9b47 P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139), c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195:38441)
I20260709 13:05:04.260638 10713 leader_election.cc:304] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a826f326054a31a5be8db7f6b09a83, c12666dfd84348ca891f38fb4d0738b8; no voters: 
I20260709 13:05:04.261633 10882 raft_consensus.cc:2804] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:04.262017 10882 raft_consensus.cc:493] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d9879027b78541b49ed49f803e95f76b)
W20260709 13:05:04.261844 10714 leader_election.cc:336] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42139: connect: Connection refused (error 111)
I20260709 13:05:04.262143 10748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ac7fd5cbe444fda04f98de073d9b47" candidate_uuid: "25a826f326054a31a5be8db7f6b09a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c12666dfd84348ca891f38fb4d0738b8" is_pre_election: true
I20260709 13:05:04.262506 10882 raft_consensus.cc:3060] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:04.264719 10640 leader_election.cc:336] T 99ac7fd5cbe444fda04f98de073d9b47 P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42139: connect: Connection refused (error 111)
I20260709 13:05:04.269177 10882 raft_consensus.cc:515] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:04.270530 10748 raft_consensus.cc:2393] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25a826f326054a31a5be8db7f6b09a83 in current term 2: Already voted for candidate c12666dfd84348ca891f38fb4d0738b8 in this term.
I20260709 13:05:04.272897 10674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ac7fd5cbe444fda04f98de073d9b47" candidate_uuid: "c12666dfd84348ca891f38fb4d0738b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25a826f326054a31a5be8db7f6b09a83"
I20260709 13:05:04.273192 10882 leader_election.cc:290] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 2 election: Requested vote from peers d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139), 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194:36333)
I20260709 13:05:04.273617 10674 raft_consensus.cc:3060] T 99ac7fd5cbe444fda04f98de073d9b47 P 25a826f326054a31a5be8db7f6b09a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:04.274646 10639 leader_election.cc:304] T 99ac7fd5cbe444fda04f98de073d9b47 P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25a826f326054a31a5be8db7f6b09a83; no voters: c12666dfd84348ca891f38fb4d0738b8, d9879027b78541b49ed49f803e95f76b
W20260709 13:05:04.276386 10714 leader_election.cc:336] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42139: connect: Connection refused (error 111)
I20260709 13:05:04.279889 10674 raft_consensus.cc:2468] T 99ac7fd5cbe444fda04f98de073d9b47 P 25a826f326054a31a5be8db7f6b09a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c12666dfd84348ca891f38fb4d0738b8 in term 2.
I20260709 13:05:04.280426 10880 raft_consensus.cc:2749] T 99ac7fd5cbe444fda04f98de073d9b47 P 25a826f326054a31a5be8db7f6b09a83 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:04.281291 10713 leader_election.cc:304] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25a826f326054a31a5be8db7f6b09a83, c12666dfd84348ca891f38fb4d0738b8; no voters: d9879027b78541b49ed49f803e95f76b
I20260709 13:05:04.282300 10882 raft_consensus.cc:2804] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:04.282821 10882 raft_consensus.cc:697] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8 [term 2 LEADER]: Becoming Leader. State: Replica: c12666dfd84348ca891f38fb4d0738b8, State: Running, Role: LEADER
I20260709 13:05:04.283632 10882 consensus_queue.cc:237] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:04.293267 10498 catalog_manager.cc:5697] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8 reported cstate change: term changed from 1 to 2, leader changed from d9879027b78541b49ed49f803e95f76b (127.0.107.193) to c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "c12666dfd84348ca891f38fb4d0738b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:04.619728 10714 consensus_peers.cc:597] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8 -> Peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Couldn't send request to peer d9879027b78541b49ed49f803e95f76b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42139: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:04.621584 10640 consensus_peers.cc:597] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83 -> Peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Couldn't send request to peer d9879027b78541b49ed49f803e95f76b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42139: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:04.671630 10674 raft_consensus.cc:1275] T 99ac7fd5cbe444fda04f98de073d9b47 P 25a826f326054a31a5be8db7f6b09a83 [term 2 FOLLOWER]: Refusing update from remote peer c12666dfd84348ca891f38fb4d0738b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:04.673437 10882 consensus_queue.cc:1048] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:04.691682 10714 consensus_peers.cc:597] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8 -> Peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Couldn't send request to peer d9879027b78541b49ed49f803e95f76b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42139: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:04.725204 10674 raft_consensus.cc:1275] T d60282d41bde45538429171e6a290048 P 25a826f326054a31a5be8db7f6b09a83 [term 2 FOLLOWER]: Refusing update from remote peer c12666dfd84348ca891f38fb4d0738b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:04.726706 10881 consensus_queue.cc:1048] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:04.799263 10748 raft_consensus.cc:1275] T 1d2f00bc524547b794c3a65afa1b00f7 P c12666dfd84348ca891f38fb4d0738b8 [term 2 FOLLOWER]: Refusing update from remote peer 25a826f326054a31a5be8db7f6b09a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:04.800715 10880 consensus_queue.cc:1048] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:04.818207 10546 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:05:05.070525 10714 consensus_peers.cc:597] T b42fcc8a7b364f1eb90b8983dd617f74 P c12666dfd84348ca891f38fb4d0738b8 -> Peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Couldn't send request to peer d9879027b78541b49ed49f803e95f76b. Error code: TABLET_NOT_RUNNING (12). Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42139: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:05.470486 10640 consensus_peers.cc:597] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 -> Peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Couldn't send request to peer d9879027b78541b49ed49f803e95f76b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42139: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:05.696405 10714 consensus_peers.cc:597] T b9ea195e53c447cca2d3d8cfc8481ff6 P c12666dfd84348ca891f38fb4d0738b8 -> Peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Couldn't send request to peer d9879027b78541b49ed49f803e95f76b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42139: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:05.797534 10640 consensus_peers.cc:597] T c9d1d89d891b4b84b70e9baa05c5b45a P 25a826f326054a31a5be8db7f6b09a83 -> Peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Couldn't send request to peer d9879027b78541b49ed49f803e95f76b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42139: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:05.819254 10546 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:05:05.846696 10640 consensus_peers.cc:597] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 -> Peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Couldn't send request to peer d9879027b78541b49ed49f803e95f76b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42139: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:05.986763 10640 consensus_peers.cc:597] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83 -> Peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Couldn't send request to peer d9879027b78541b49ed49f803e95f76b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42139: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:06.022886 10640 consensus_peers.cc:597] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 -> Peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Couldn't send request to peer d9879027b78541b49ed49f803e95f76b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42139: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:06.820341 10546 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:05:06.898743 10640 consensus_peers.cc:597] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83 -> Peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Couldn't send request to peer d9879027b78541b49ed49f803e95f76b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42139: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:06.994436 10714 consensus_peers.cc:597] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8 -> Peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Couldn't send request to peer d9879027b78541b49ed49f803e95f76b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42139: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:07.179919 10714 consensus_peers.cc:597] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8 -> Peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Couldn't send request to peer d9879027b78541b49ed49f803e95f76b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42139: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:07.611025 10714 consensus_peers.cc:597] T b42fcc8a7b364f1eb90b8983dd617f74 P c12666dfd84348ca891f38fb4d0738b8 -> Peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Couldn't send request to peer d9879027b78541b49ed49f803e95f76b. Error code: TABLET_NOT_RUNNING (12). Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42139: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:07.821763 10546 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:05:07.890708 10640 consensus_peers.cc:597] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 -> Peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Couldn't send request to peer d9879027b78541b49ed49f803e95f76b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42139: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:08.098656 10714 consensus_peers.cc:597] T b9ea195e53c447cca2d3d8cfc8481ff6 P c12666dfd84348ca891f38fb4d0738b8 -> Peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Couldn't send request to peer d9879027b78541b49ed49f803e95f76b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42139: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:08.107833   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:08.115901 10901 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:08.116910 10902 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:08.123409 10904 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:08.123834   431 server_base.cc:1061] running on GCE node
I20260709 13:05:08.125542   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:08.125766   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:08.125975   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602308125953 us; error 0 us; skew 500 ppm
I20260709 13:05:08.126541   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:08.129413   431 webserver.cc:533] Webserver started at http://127.0.107.193:33979/ using document root <none> and password file <none>
I20260709 13:05:08.129920   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:08.130111   431 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:05:08.134371   431 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:05:08.138355 10909 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:08.139214   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:05:08.139535   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601979855482-431-0/minicluster-data/ts-0-root
uuid: "d9879027b78541b49ed49f803e95f76b"
format_stamp: "Formatted at 2026-07-09 13:05:00 on dist-test-slave-g4pn"
I20260709 13:05:08.139936   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601979855482-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601979855482-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601979855482-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:08.161188   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:08.162472   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:08.164094   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:08.167927 10916 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:05:08.228880   431 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:05:08.229270   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.062s	user 0.001s	sys 0.001s
I20260709 13:05:08.229635   431 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:05:08.236110 10916 tablet_bootstrap.cc:492] T 0769de616981443f98fe2c1f18b8cb95 P d9879027b78541b49ed49f803e95f76b: Bootstrap starting.
I20260709 13:05:08.254726 10916 tablet_bootstrap.cc:492] T 0769de616981443f98fe2c1f18b8cb95 P d9879027b78541b49ed49f803e95f76b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.255810 10916 tablet_bootstrap.cc:492] T 0769de616981443f98fe2c1f18b8cb95 P d9879027b78541b49ed49f803e95f76b: Bootstrap complete.
I20260709 13:05:08.256500 10916 ts_tablet_manager.cc:1403] T 0769de616981443f98fe2c1f18b8cb95 P d9879027b78541b49ed49f803e95f76b: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.007s
I20260709 13:05:08.259577 10916 raft_consensus.cc:359] T 0769de616981443f98fe2c1f18b8cb95 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:08.260340 10916 raft_consensus.cc:740] T 0769de616981443f98fe2c1f18b8cb95 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9879027b78541b49ed49f803e95f76b, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.261188 10916 consensus_queue.cc:260] T 0769de616981443f98fe2c1f18b8cb95 P d9879027b78541b49ed49f803e95f76b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:08.264195 10916 ts_tablet_manager.cc:1434] T 0769de616981443f98fe2c1f18b8cb95 P d9879027b78541b49ed49f803e95f76b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.001s
I20260709 13:05:08.265177 10916 tablet_bootstrap.cc:492] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b: Bootstrap starting.
I20260709 13:05:08.283329 10916 tablet_bootstrap.cc:492] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.284418 10916 tablet_bootstrap.cc:492] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b: Bootstrap complete.
I20260709 13:05:08.285192 10916 ts_tablet_manager.cc:1403] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.008s
I20260709 13:05:08.288196 10916 raft_consensus.cc:359] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:08.288991 10916 raft_consensus.cc:740] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9879027b78541b49ed49f803e95f76b, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.289798 10916 consensus_queue.cc:260] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:08.291976 10916 ts_tablet_manager.cc:1434] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:05:08.292938 10916 tablet_bootstrap.cc:492] T c9d1d89d891b4b84b70e9baa05c5b45a P d9879027b78541b49ed49f803e95f76b: Bootstrap starting.
I20260709 13:05:08.297557   431 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:05:08.298074   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.068s	user 0.063s	sys 0.006s
I20260709 13:05:08.313201 10916 tablet_bootstrap.cc:492] T c9d1d89d891b4b84b70e9baa05c5b45a P d9879027b78541b49ed49f803e95f76b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.314479 10916 tablet_bootstrap.cc:492] T c9d1d89d891b4b84b70e9baa05c5b45a P d9879027b78541b49ed49f803e95f76b: Bootstrap complete.
I20260709 13:05:08.315354 10916 ts_tablet_manager.cc:1403] T c9d1d89d891b4b84b70e9baa05c5b45a P d9879027b78541b49ed49f803e95f76b: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.007s
I20260709 13:05:08.319428 10916 raft_consensus.cc:359] T c9d1d89d891b4b84b70e9baa05c5b45a P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:08.320407 10916 raft_consensus.cc:740] T c9d1d89d891b4b84b70e9baa05c5b45a P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9879027b78541b49ed49f803e95f76b, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.321553 10916 consensus_queue.cc:260] T c9d1d89d891b4b84b70e9baa05c5b45a P d9879027b78541b49ed49f803e95f76b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:08.324488 10916 ts_tablet_manager.cc:1434] T c9d1d89d891b4b84b70e9baa05c5b45a P d9879027b78541b49ed49f803e95f76b: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:05:08.325567 10916 tablet_bootstrap.cc:492] T 65fb662e39fe49258d71de811265ba16 P d9879027b78541b49ed49f803e95f76b: Bootstrap starting.
W20260709 13:05:08.331823 10640 consensus_peers.cc:597] T c9d1d89d891b4b84b70e9baa05c5b45a P 25a826f326054a31a5be8db7f6b09a83 -> Peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Couldn't send request to peer d9879027b78541b49ed49f803e95f76b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42139: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:08.343112 10916 tablet_bootstrap.cc:492] T 65fb662e39fe49258d71de811265ba16 P d9879027b78541b49ed49f803e95f76b: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.344005 10916 tablet_bootstrap.cc:492] T 65fb662e39fe49258d71de811265ba16 P d9879027b78541b49ed49f803e95f76b: Bootstrap complete.
I20260709 13:05:08.344602 10916 ts_tablet_manager.cc:1403] T 65fb662e39fe49258d71de811265ba16 P d9879027b78541b49ed49f803e95f76b: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.005s
I20260709 13:05:08.346796 10916 raft_consensus.cc:359] T 65fb662e39fe49258d71de811265ba16 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:08.347412 10916 raft_consensus.cc:740] T 65fb662e39fe49258d71de811265ba16 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9879027b78541b49ed49f803e95f76b, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.348241 10916 consensus_queue.cc:260] T 65fb662e39fe49258d71de811265ba16 P d9879027b78541b49ed49f803e95f76b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:08.350306 10916 ts_tablet_manager.cc:1434] T 65fb662e39fe49258d71de811265ba16 P d9879027b78541b49ed49f803e95f76b: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:05:08.350993 10916 tablet_bootstrap.cc:492] T 275e6f7ace35466d9a3dcc0ab83dfbcd P d9879027b78541b49ed49f803e95f76b: Bootstrap starting.
I20260709 13:05:08.368657   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:42139
I20260709 13:05:08.368865 10978 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:42139 every 8 connection(s)
I20260709 13:05:08.369659 10916 tablet_bootstrap.cc:492] T 275e6f7ace35466d9a3dcc0ab83dfbcd P d9879027b78541b49ed49f803e95f76b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.370477 10916 tablet_bootstrap.cc:492] T 275e6f7ace35466d9a3dcc0ab83dfbcd P d9879027b78541b49ed49f803e95f76b: Bootstrap complete.
I20260709 13:05:08.371035 10916 ts_tablet_manager.cc:1403] T 275e6f7ace35466d9a3dcc0ab83dfbcd P d9879027b78541b49ed49f803e95f76b: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 13:05:08.373456 10916 raft_consensus.cc:359] T 275e6f7ace35466d9a3dcc0ab83dfbcd P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:08.374354 10916 raft_consensus.cc:740] T 275e6f7ace35466d9a3dcc0ab83dfbcd P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9879027b78541b49ed49f803e95f76b, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.374564   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:08.375121 10916 consensus_queue.cc:260] T 275e6f7ace35466d9a3dcc0ab83dfbcd P d9879027b78541b49ed49f803e95f76b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:08.377182 10916 ts_tablet_manager.cc:1434] T 275e6f7ace35466d9a3dcc0ab83dfbcd P d9879027b78541b49ed49f803e95f76b: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:05:08.378336 10916 tablet_bootstrap.cc:492] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b: Bootstrap starting.
I20260709 13:05:08.401192 10979 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41867
I20260709 13:05:08.401867 10979 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:08.403189 10979 heartbeater.cc:507] Master 127.0.107.254:41867 requested a full tablet report, sending...
I20260709 13:05:08.413381 10494 ts_manager.cc:194] Re-registered known tserver with Master: d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139)
I20260709 13:05:08.434674 10916 tablet_bootstrap.cc:492] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.435556 10494 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49896
I20260709 13:05:08.436072 10916 tablet_bootstrap.cc:492] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b: Bootstrap complete.
I20260709 13:05:08.436918 10916 ts_tablet_manager.cc:1403] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b: Time spent bootstrapping tablet: real 0.059s	user 0.040s	sys 0.012s
I20260709 13:05:08.439831 10979 heartbeater.cc:499] Master 127.0.107.254:41867 was elected leader, sending a full tablet report...
I20260709 13:05:08.439898 10916 raft_consensus.cc:359] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:08.441506 10916 raft_consensus.cc:740] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9879027b78541b49ed49f803e95f76b, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.442257 10674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1789fe885f1e4e2a851aebab8d6f1c95"
dest_uuid: "25a826f326054a31a5be8db7f6b09a83"
mode: GRACEFUL
new_leader_uuid: "c12666dfd84348ca891f38fb4d0738b8"
 from {username='slave'} at 127.0.0.1:47908
I20260709 13:05:08.442380 10916 consensus_queue.cc:260] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:08.442962 10674 raft_consensus.cc:606] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [term 1 LEADER]: Received request to transfer leadership to TS c12666dfd84348ca891f38fb4d0738b8
I20260709 13:05:08.444772 10916 ts_tablet_manager.cc:1434] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 13:05:08.446156 10916 tablet_bootstrap.cc:492] T 1789fe885f1e4e2a851aebab8d6f1c95 P d9879027b78541b49ed49f803e95f76b: Bootstrap starting.
I20260709 13:05:08.446193 10674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65fb662e39fe49258d71de811265ba16"
dest_uuid: "25a826f326054a31a5be8db7f6b09a83"
mode: GRACEFUL
new_leader_uuid: "c12666dfd84348ca891f38fb4d0738b8"
 from {username='slave'} at 127.0.0.1:47908
I20260709 13:05:08.447045 10674 raft_consensus.cc:606] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 [term 1 LEADER]: Received request to transfer leadership to TS c12666dfd84348ca891f38fb4d0738b8
I20260709 13:05:08.448596   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:08.449345   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:08.450153   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:08.459990 10916 tablet_bootstrap.cc:492] T 1789fe885f1e4e2a851aebab8d6f1c95 P d9879027b78541b49ed49f803e95f76b: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.460781 10916 tablet_bootstrap.cc:492] T 1789fe885f1e4e2a851aebab8d6f1c95 P d9879027b78541b49ed49f803e95f76b: Bootstrap complete.
I20260709 13:05:08.461539 10916 ts_tablet_manager.cc:1403] T 1789fe885f1e4e2a851aebab8d6f1c95 P d9879027b78541b49ed49f803e95f76b: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 13:05:08.463613 10916 raft_consensus.cc:359] T 1789fe885f1e4e2a851aebab8d6f1c95 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:08.464299 10916 raft_consensus.cc:740] T 1789fe885f1e4e2a851aebab8d6f1c95 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9879027b78541b49ed49f803e95f76b, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.464984 10916 consensus_queue.cc:260] T 1789fe885f1e4e2a851aebab8d6f1c95 P d9879027b78541b49ed49f803e95f76b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:08.466918 10916 ts_tablet_manager.cc:1434] T 1789fe885f1e4e2a851aebab8d6f1c95 P d9879027b78541b49ed49f803e95f76b: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:05:08.467739 10916 tablet_bootstrap.cc:492] T b9ea195e53c447cca2d3d8cfc8481ff6 P d9879027b78541b49ed49f803e95f76b: Bootstrap starting.
I20260709 13:05:08.483021 10916 tablet_bootstrap.cc:492] T b9ea195e53c447cca2d3d8cfc8481ff6 P d9879027b78541b49ed49f803e95f76b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.484054 10916 tablet_bootstrap.cc:492] T b9ea195e53c447cca2d3d8cfc8481ff6 P d9879027b78541b49ed49f803e95f76b: Bootstrap complete.
I20260709 13:05:08.484743 10916 ts_tablet_manager.cc:1403] T b9ea195e53c447cca2d3d8cfc8481ff6 P d9879027b78541b49ed49f803e95f76b: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.001s
I20260709 13:05:08.487442 10916 raft_consensus.cc:359] T b9ea195e53c447cca2d3d8cfc8481ff6 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:08.488209 10916 raft_consensus.cc:740] T b9ea195e53c447cca2d3d8cfc8481ff6 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9879027b78541b49ed49f803e95f76b, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.489411 10916 consensus_queue.cc:260] T b9ea195e53c447cca2d3d8cfc8481ff6 P d9879027b78541b49ed49f803e95f76b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:08.491658 10916 ts_tablet_manager.cc:1434] T b9ea195e53c447cca2d3d8cfc8481ff6 P d9879027b78541b49ed49f803e95f76b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:05:08.493492 10916 tablet_bootstrap.cc:492] T b42fcc8a7b364f1eb90b8983dd617f74 P d9879027b78541b49ed49f803e95f76b: Bootstrap starting.
I20260709 13:05:08.508821 10916 tablet_bootstrap.cc:492] T b42fcc8a7b364f1eb90b8983dd617f74 P d9879027b78541b49ed49f803e95f76b: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.510380 10916 tablet_bootstrap.cc:492] T b42fcc8a7b364f1eb90b8983dd617f74 P d9879027b78541b49ed49f803e95f76b: Bootstrap complete.
I20260709 13:05:08.511497 10916 ts_tablet_manager.cc:1403] T b42fcc8a7b364f1eb90b8983dd617f74 P d9879027b78541b49ed49f803e95f76b: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.007s
I20260709 13:05:08.512727 10952 raft_consensus.cc:3060] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.514405 10916 raft_consensus.cc:359] T b42fcc8a7b364f1eb90b8983dd617f74 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:08.514959 10916 raft_consensus.cc:385] T b42fcc8a7b364f1eb90b8983dd617f74 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:08.515215 10916 raft_consensus.cc:740] T b42fcc8a7b364f1eb90b8983dd617f74 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9879027b78541b49ed49f803e95f76b, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.515982 10916 consensus_queue.cc:260] T b42fcc8a7b364f1eb90b8983dd617f74 P d9879027b78541b49ed49f803e95f76b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:08.517766 10916 ts_tablet_manager.cc:1434] T b42fcc8a7b364f1eb90b8983dd617f74 P d9879027b78541b49ed49f803e95f76b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:05:08.518750 10916 tablet_bootstrap.cc:492] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b: Bootstrap starting.
I20260709 13:05:08.535476 10916 tablet_bootstrap.cc:492] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.536597 10916 tablet_bootstrap.cc:492] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b: Bootstrap complete.
I20260709 13:05:08.537531 10916 ts_tablet_manager.cc:1403] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:05:08.540059 10916 raft_consensus.cc:359] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:08.540781 10916 raft_consensus.cc:740] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9879027b78541b49ed49f803e95f76b, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.541535 10916 consensus_queue.cc:260] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:08.543032 10916 ts_tablet_manager.cc:1434] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:05:08.604348 10951 raft_consensus.cc:3060] T b42fcc8a7b364f1eb90b8983dd617f74 P d9879027b78541b49ed49f803e95f76b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.619035 10900 raft_consensus.cc:993] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83: : Instructing follower c12666dfd84348ca891f38fb4d0738b8 to start an election
I20260709 13:05:08.619556 10900 raft_consensus.cc:1081] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 [term 1 LEADER]: Signalling peer c12666dfd84348ca891f38fb4d0738b8 to start an election
I20260709 13:05:08.621572 10748 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65fb662e39fe49258d71de811265ba16"
dest_uuid: "c12666dfd84348ca891f38fb4d0738b8"
 from {username='slave'} at 127.0.0.1:54384
I20260709 13:05:08.622098 10748 raft_consensus.cc:493] T 65fb662e39fe49258d71de811265ba16 P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:08.622397 10748 raft_consensus.cc:3060] T 65fb662e39fe49258d71de811265ba16 P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.629555 10748 raft_consensus.cc:515] T 65fb662e39fe49258d71de811265ba16 P c12666dfd84348ca891f38fb4d0738b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:08.631229 10748 leader_election.cc:290] T 65fb662e39fe49258d71de811265ba16 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 2 election: Requested vote from peers d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139), 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194:36333)
I20260709 13:05:08.632109 10951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fb662e39fe49258d71de811265ba16" candidate_uuid: "c12666dfd84348ca891f38fb4d0738b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d9879027b78541b49ed49f803e95f76b"
I20260709 13:05:08.632369 10673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fb662e39fe49258d71de811265ba16" candidate_uuid: "c12666dfd84348ca891f38fb4d0738b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "25a826f326054a31a5be8db7f6b09a83"
I20260709 13:05:08.632813 10951 raft_consensus.cc:3060] T 65fb662e39fe49258d71de811265ba16 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.632913 10673 raft_consensus.cc:3055] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:08.633334 10673 raft_consensus.cc:740] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25a826f326054a31a5be8db7f6b09a83, State: Running, Role: LEADER
I20260709 13:05:08.634181 10673 consensus_queue.cc:260] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:08.635481 10673 raft_consensus.cc:3060] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.640918 10951 raft_consensus.cc:2468] T 65fb662e39fe49258d71de811265ba16 P d9879027b78541b49ed49f803e95f76b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c12666dfd84348ca891f38fb4d0738b8 in term 2.
I20260709 13:05:08.642423 10714 leader_election.cc:304] T 65fb662e39fe49258d71de811265ba16 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c12666dfd84348ca891f38fb4d0738b8, d9879027b78541b49ed49f803e95f76b; no voters: 
I20260709 13:05:08.643255 10996 raft_consensus.cc:2804] T 65fb662e39fe49258d71de811265ba16 P c12666dfd84348ca891f38fb4d0738b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:08.643599 10673 raft_consensus.cc:2468] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c12666dfd84348ca891f38fb4d0738b8 in term 2.
I20260709 13:05:08.643765 10996 raft_consensus.cc:697] T 65fb662e39fe49258d71de811265ba16 P c12666dfd84348ca891f38fb4d0738b8 [term 2 LEADER]: Becoming Leader. State: Replica: c12666dfd84348ca891f38fb4d0738b8, State: Running, Role: LEADER
I20260709 13:05:08.644713 10996 consensus_queue.cc:237] T 65fb662e39fe49258d71de811265ba16 P c12666dfd84348ca891f38fb4d0738b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:08.651904 10494 catalog_manager.cc:5697] T 65fb662e39fe49258d71de811265ba16 P c12666dfd84348ca891f38fb4d0738b8 reported cstate change: term changed from 1 to 2, leader changed from 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194) to c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "c12666dfd84348ca891f38fb4d0738b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:08.674878 10951 raft_consensus.cc:3060] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.809823 10900 raft_consensus.cc:993] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83: : Instructing follower c12666dfd84348ca891f38fb4d0738b8 to start an election
I20260709 13:05:08.810381 10997 raft_consensus.cc:1081] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [term 1 LEADER]: Signalling peer c12666dfd84348ca891f38fb4d0738b8 to start an election
I20260709 13:05:08.812157 10748 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1789fe885f1e4e2a851aebab8d6f1c95"
dest_uuid: "c12666dfd84348ca891f38fb4d0738b8"
 from {username='slave'} at 127.0.0.1:54384
I20260709 13:05:08.812633 10748 raft_consensus.cc:493] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:08.812888 10748 raft_consensus.cc:3060] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.817938 10748 raft_consensus.cc:515] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:08.819991 10748 leader_election.cc:290] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 2 election: Requested vote from peers d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139), 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194:36333)
I20260709 13:05:08.821228 10673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1789fe885f1e4e2a851aebab8d6f1c95" candidate_uuid: "c12666dfd84348ca891f38fb4d0738b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "25a826f326054a31a5be8db7f6b09a83"
I20260709 13:05:08.821813 10673 raft_consensus.cc:3055] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:08.822060 10673 raft_consensus.cc:740] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25a826f326054a31a5be8db7f6b09a83, State: Running, Role: LEADER
I20260709 13:05:08.822408 10951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1789fe885f1e4e2a851aebab8d6f1c95" candidate_uuid: "c12666dfd84348ca891f38fb4d0738b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d9879027b78541b49ed49f803e95f76b"
W20260709 13:05:08.822804 10546 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:05:08.823060 10951 raft_consensus.cc:3060] T 1789fe885f1e4e2a851aebab8d6f1c95 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.822917 10673 consensus_queue.cc:260] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:08.824640 10673 raft_consensus.cc:3060] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.832083 10951 raft_consensus.cc:2468] T 1789fe885f1e4e2a851aebab8d6f1c95 P d9879027b78541b49ed49f803e95f76b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c12666dfd84348ca891f38fb4d0738b8 in term 2.
I20260709 13:05:08.833319 10673 raft_consensus.cc:2468] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c12666dfd84348ca891f38fb4d0738b8 in term 2.
I20260709 13:05:08.833675 10714 leader_election.cc:304] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c12666dfd84348ca891f38fb4d0738b8, d9879027b78541b49ed49f803e95f76b; no voters: 
I20260709 13:05:08.834693 10996 raft_consensus.cc:2804] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:08.835201 10996 raft_consensus.cc:697] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 [term 2 LEADER]: Becoming Leader. State: Replica: c12666dfd84348ca891f38fb4d0738b8, State: Running, Role: LEADER
I20260709 13:05:08.835953 10996 consensus_queue.cc:237] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:08.844135 10494 catalog_manager.cc:5697] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 reported cstate change: term changed from 1 to 2, leader changed from 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194) to c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "c12666dfd84348ca891f38fb4d0738b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:08.972312 10951 raft_consensus.cc:3060] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.048861 10673 raft_consensus.cc:1275] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 [term 2 FOLLOWER]: Refusing update from remote peer c12666dfd84348ca891f38fb4d0738b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:09.050532 10899 consensus_queue.cc:1048] T 65fb662e39fe49258d71de811265ba16 P c12666dfd84348ca891f38fb4d0738b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:09.064888 10951 raft_consensus.cc:1275] T 65fb662e39fe49258d71de811265ba16 P d9879027b78541b49ed49f803e95f76b [term 2 FOLLOWER]: Refusing update from remote peer c12666dfd84348ca891f38fb4d0738b8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:09.066751 10996 consensus_queue.cc:1048] T 65fb662e39fe49258d71de811265ba16 P c12666dfd84348ca891f38fb4d0738b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:09.408708 10951 raft_consensus.cc:1275] T 1789fe885f1e4e2a851aebab8d6f1c95 P d9879027b78541b49ed49f803e95f76b [term 2 FOLLOWER]: Refusing update from remote peer c12666dfd84348ca891f38fb4d0738b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:09.410329 10899 consensus_queue.cc:1048] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:09.419305 10673 raft_consensus.cc:1275] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [term 2 FOLLOWER]: Refusing update from remote peer c12666dfd84348ca891f38fb4d0738b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:09.421300 11005 consensus_queue.cc:1048] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:09.460994   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:09.479234 10748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1789fe885f1e4e2a851aebab8d6f1c95"
dest_uuid: "c12666dfd84348ca891f38fb4d0738b8"
mode: GRACEFUL
new_leader_uuid: "25a826f326054a31a5be8db7f6b09a83"
 from {username='slave'} at 127.0.0.1:54390
I20260709 13:05:09.479765 10748 raft_consensus.cc:606] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 [term 2 LEADER]: Received request to transfer leadership to TS 25a826f326054a31a5be8db7f6b09a83
I20260709 13:05:09.482702 10748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d60282d41bde45538429171e6a290048"
dest_uuid: "c12666dfd84348ca891f38fb4d0738b8"
mode: GRACEFUL
new_leader_uuid: "25a826f326054a31a5be8db7f6b09a83"
 from {username='slave'} at 127.0.0.1:54390
I20260709 13:05:09.483202 10748 raft_consensus.cc:606] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8 [term 2 LEADER]: Received request to transfer leadership to TS 25a826f326054a31a5be8db7f6b09a83
I20260709 13:05:09.484535   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:09.485222   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:09.485921   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:09.598076 10899 raft_consensus.cc:993] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8: : Instructing follower 25a826f326054a31a5be8db7f6b09a83 to start an election
I20260709 13:05:09.598603 10996 raft_consensus.cc:1081] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8 [term 2 LEADER]: Signalling peer 25a826f326054a31a5be8db7f6b09a83 to start an election
I20260709 13:05:09.600464 10673 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d60282d41bde45538429171e6a290048"
dest_uuid: "25a826f326054a31a5be8db7f6b09a83"
 from {username='slave'} at 127.0.0.1:47892
I20260709 13:05:09.600992 10673 raft_consensus.cc:493] T d60282d41bde45538429171e6a290048 P 25a826f326054a31a5be8db7f6b09a83 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:09.601342 10673 raft_consensus.cc:3060] T d60282d41bde45538429171e6a290048 P 25a826f326054a31a5be8db7f6b09a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:09.606801 10673 raft_consensus.cc:515] T d60282d41bde45538429171e6a290048 P 25a826f326054a31a5be8db7f6b09a83 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:09.608963 10673 leader_election.cc:290] T d60282d41bde45538429171e6a290048 P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 3 election: Requested vote from peers d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139), c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195:38441)
I20260709 13:05:09.609920 10951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d60282d41bde45538429171e6a290048" candidate_uuid: "25a826f326054a31a5be8db7f6b09a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d9879027b78541b49ed49f803e95f76b"
I20260709 13:05:09.610000 10748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d60282d41bde45538429171e6a290048" candidate_uuid: "25a826f326054a31a5be8db7f6b09a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c12666dfd84348ca891f38fb4d0738b8"
I20260709 13:05:09.610754 10951 raft_consensus.cc:3060] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:09.610878 10748 raft_consensus.cc:3055] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:09.611281 10748 raft_consensus.cc:740] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c12666dfd84348ca891f38fb4d0738b8, State: Running, Role: LEADER
I20260709 13:05:09.611974 10748 consensus_queue.cc:260] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:09.613013 10748 raft_consensus.cc:3060] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:09.617805 10951 raft_consensus.cc:2468] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25a826f326054a31a5be8db7f6b09a83 in term 3.
I20260709 13:05:09.617986 10748 raft_consensus.cc:2468] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25a826f326054a31a5be8db7f6b09a83 in term 3.
I20260709 13:05:09.619024 10640 leader_election.cc:304] T d60282d41bde45538429171e6a290048 P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a826f326054a31a5be8db7f6b09a83, d9879027b78541b49ed49f803e95f76b; no voters: 
I20260709 13:05:09.619900 11007 raft_consensus.cc:2804] T d60282d41bde45538429171e6a290048 P 25a826f326054a31a5be8db7f6b09a83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:09.620386 11007 raft_consensus.cc:697] T d60282d41bde45538429171e6a290048 P 25a826f326054a31a5be8db7f6b09a83 [term 3 LEADER]: Becoming Leader. State: Replica: 25a826f326054a31a5be8db7f6b09a83, State: Running, Role: LEADER
I20260709 13:05:09.621187 11007 consensus_queue.cc:237] T d60282d41bde45538429171e6a290048 P 25a826f326054a31a5be8db7f6b09a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:09.628481 10494 catalog_manager.cc:5697] T d60282d41bde45538429171e6a290048 P 25a826f326054a31a5be8db7f6b09a83 reported cstate change: term changed from 2 to 3, leader changed from c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195) to 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "25a826f326054a31a5be8db7f6b09a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:09.824169 10546 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:05:09.858467 10996 raft_consensus.cc:993] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8: : Instructing follower 25a826f326054a31a5be8db7f6b09a83 to start an election
I20260709 13:05:09.859160 11005 raft_consensus.cc:1081] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 [term 2 LEADER]: Signalling peer 25a826f326054a31a5be8db7f6b09a83 to start an election
I20260709 13:05:09.860809 10673 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1789fe885f1e4e2a851aebab8d6f1c95"
dest_uuid: "25a826f326054a31a5be8db7f6b09a83"
 from {username='slave'} at 127.0.0.1:47892
I20260709 13:05:09.861411 10673 raft_consensus.cc:493] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:09.861744 10673 raft_consensus.cc:3060] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:09.867218 10673 raft_consensus.cc:515] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:09.870133 10673 leader_election.cc:290] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 3 election: Requested vote from peers d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139), c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195:38441)
I20260709 13:05:09.870954 10951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1789fe885f1e4e2a851aebab8d6f1c95" candidate_uuid: "25a826f326054a31a5be8db7f6b09a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d9879027b78541b49ed49f803e95f76b"
I20260709 13:05:09.871330 10748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1789fe885f1e4e2a851aebab8d6f1c95" candidate_uuid: "25a826f326054a31a5be8db7f6b09a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c12666dfd84348ca891f38fb4d0738b8"
I20260709 13:05:09.872162 10951 raft_consensus.cc:3060] T 1789fe885f1e4e2a851aebab8d6f1c95 P d9879027b78541b49ed49f803e95f76b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:09.872221 10748 raft_consensus.cc:3055] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:09.872634 10748 raft_consensus.cc:740] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c12666dfd84348ca891f38fb4d0738b8, State: Running, Role: LEADER
I20260709 13:05:09.873728 10748 consensus_queue.cc:260] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:09.874744 10748 raft_consensus.cc:3060] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:09.879925 10951 raft_consensus.cc:2468] T 1789fe885f1e4e2a851aebab8d6f1c95 P d9879027b78541b49ed49f803e95f76b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25a826f326054a31a5be8db7f6b09a83 in term 3.
I20260709 13:05:09.879956 10748 raft_consensus.cc:2468] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25a826f326054a31a5be8db7f6b09a83 in term 3.
I20260709 13:05:09.881444 10640 leader_election.cc:304] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a826f326054a31a5be8db7f6b09a83, d9879027b78541b49ed49f803e95f76b; no voters: 
I20260709 13:05:09.882143 11007 raft_consensus.cc:2804] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:09.882540 11007 raft_consensus.cc:697] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [term 3 LEADER]: Becoming Leader. State: Replica: 25a826f326054a31a5be8db7f6b09a83, State: Running, Role: LEADER
I20260709 13:05:09.883297 11007 consensus_queue.cc:237] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:09.889804 10494 catalog_manager.cc:5697] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 reported cstate change: term changed from 2 to 3, leader changed from c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195) to 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "25a826f326054a31a5be8db7f6b09a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:10.036302 10748 raft_consensus.cc:1275] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8 [term 3 FOLLOWER]: Refusing update from remote peer 25a826f326054a31a5be8db7f6b09a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:10.037905 10900 consensus_queue.cc:1048] T d60282d41bde45538429171e6a290048 P 25a826f326054a31a5be8db7f6b09a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:10.045782 10951 raft_consensus.cc:1275] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b [term 3 FOLLOWER]: Refusing update from remote peer 25a826f326054a31a5be8db7f6b09a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:10.048642 10900 consensus_queue.cc:1048] T d60282d41bde45538429171e6a290048 P 25a826f326054a31a5be8db7f6b09a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:10.372035 10951 raft_consensus.cc:1275] T 1789fe885f1e4e2a851aebab8d6f1c95 P d9879027b78541b49ed49f803e95f76b [term 3 FOLLOWER]: Refusing update from remote peer 25a826f326054a31a5be8db7f6b09a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:10.373683 11007 consensus_queue.cc:1048] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:10.382428 10748 raft_consensus.cc:1275] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 [term 3 FOLLOWER]: Refusing update from remote peer 25a826f326054a31a5be8db7f6b09a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:10.384188 10900 consensus_queue.cc:1048] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:10.495554   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:10.505434 10673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0769de616981443f98fe2c1f18b8cb95"
dest_uuid: "25a826f326054a31a5be8db7f6b09a83"
mode: GRACEFUL
new_leader_uuid: "c12666dfd84348ca891f38fb4d0738b8"
 from {username='slave'} at 127.0.0.1:47908
I20260709 13:05:10.506072 10673 raft_consensus.cc:606] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 [term 1 LEADER]: Received request to transfer leadership to TS c12666dfd84348ca891f38fb4d0738b8
I20260709 13:05:10.509150 10673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d2f00bc524547b794c3a65afa1b00f7"
dest_uuid: "25a826f326054a31a5be8db7f6b09a83"
mode: GRACEFUL
new_leader_uuid: "c12666dfd84348ca891f38fb4d0738b8"
 from {username='slave'} at 127.0.0.1:47908
I20260709 13:05:10.509811 10673 raft_consensus.cc:606] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83 [term 2 LEADER]: Received request to transfer leadership to TS c12666dfd84348ca891f38fb4d0738b8
I20260709 13:05:10.511068   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:10.511615   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:10.512264   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:10.569712 10997 raft_consensus.cc:993] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83: : Instructing follower c12666dfd84348ca891f38fb4d0738b8 to start an election
I20260709 13:05:10.570282 10900 raft_consensus.cc:1081] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83 [term 2 LEADER]: Signalling peer c12666dfd84348ca891f38fb4d0738b8 to start an election
I20260709 13:05:10.571875 10748 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d2f00bc524547b794c3a65afa1b00f7"
dest_uuid: "c12666dfd84348ca891f38fb4d0738b8"
 from {username='slave'} at 127.0.0.1:54384
I20260709 13:05:10.572353 10748 raft_consensus.cc:493] T 1d2f00bc524547b794c3a65afa1b00f7 P c12666dfd84348ca891f38fb4d0738b8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:10.572605 10748 raft_consensus.cc:3060] T 1d2f00bc524547b794c3a65afa1b00f7 P c12666dfd84348ca891f38fb4d0738b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:10.577896 10748 raft_consensus.cc:515] T 1d2f00bc524547b794c3a65afa1b00f7 P c12666dfd84348ca891f38fb4d0738b8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:10.579555 10748 leader_election.cc:290] T 1d2f00bc524547b794c3a65afa1b00f7 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 3 election: Requested vote from peers d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139), 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194:36333)
I20260709 13:05:10.580529 10951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2f00bc524547b794c3a65afa1b00f7" candidate_uuid: "c12666dfd84348ca891f38fb4d0738b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d9879027b78541b49ed49f803e95f76b"
I20260709 13:05:10.581216 10951 raft_consensus.cc:3060] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:10.581080 10673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2f00bc524547b794c3a65afa1b00f7" candidate_uuid: "c12666dfd84348ca891f38fb4d0738b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "25a826f326054a31a5be8db7f6b09a83"
I20260709 13:05:10.581997 10673 raft_consensus.cc:3055] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:10.582744 10673 raft_consensus.cc:740] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25a826f326054a31a5be8db7f6b09a83, State: Running, Role: LEADER
I20260709 13:05:10.583670 10673 consensus_queue.cc:260] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:10.584692 10673 raft_consensus.cc:3060] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:10.588477 10951 raft_consensus.cc:2468] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c12666dfd84348ca891f38fb4d0738b8 in term 3.
I20260709 13:05:10.589757 10714 leader_election.cc:304] T 1d2f00bc524547b794c3a65afa1b00f7 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c12666dfd84348ca891f38fb4d0738b8, d9879027b78541b49ed49f803e95f76b; no voters: 
I20260709 13:05:10.590627 10996 raft_consensus.cc:2804] T 1d2f00bc524547b794c3a65afa1b00f7 P c12666dfd84348ca891f38fb4d0738b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:10.591208 10673 raft_consensus.cc:2468] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c12666dfd84348ca891f38fb4d0738b8 in term 3.
I20260709 13:05:10.592746 10996 raft_consensus.cc:697] T 1d2f00bc524547b794c3a65afa1b00f7 P c12666dfd84348ca891f38fb4d0738b8 [term 3 LEADER]: Becoming Leader. State: Replica: c12666dfd84348ca891f38fb4d0738b8, State: Running, Role: LEADER
I20260709 13:05:10.594480 10996 consensus_queue.cc:237] T 1d2f00bc524547b794c3a65afa1b00f7 P c12666dfd84348ca891f38fb4d0738b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:10.603446 10498 catalog_manager.cc:5697] T 1d2f00bc524547b794c3a65afa1b00f7 P c12666dfd84348ca891f38fb4d0738b8 reported cstate change: term changed from 2 to 3, leader changed from 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194) to c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "c12666dfd84348ca891f38fb4d0738b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:10.825525 10546 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:05:10.861729 11007 raft_consensus.cc:993] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83: : Instructing follower c12666dfd84348ca891f38fb4d0738b8 to start an election
I20260709 13:05:10.862421 10900 raft_consensus.cc:1081] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 [term 1 LEADER]: Signalling peer c12666dfd84348ca891f38fb4d0738b8 to start an election
I20260709 13:05:10.864307 10748 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0769de616981443f98fe2c1f18b8cb95"
dest_uuid: "c12666dfd84348ca891f38fb4d0738b8"
 from {username='slave'} at 127.0.0.1:54384
I20260709 13:05:10.864775 10748 raft_consensus.cc:493] T 0769de616981443f98fe2c1f18b8cb95 P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:10.865025 10748 raft_consensus.cc:3060] T 0769de616981443f98fe2c1f18b8cb95 P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:10.870424 10748 raft_consensus.cc:515] T 0769de616981443f98fe2c1f18b8cb95 P c12666dfd84348ca891f38fb4d0738b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:10.872066 10748 leader_election.cc:290] T 0769de616981443f98fe2c1f18b8cb95 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 2 election: Requested vote from peers d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139), 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194:36333)
I20260709 13:05:10.873181 10951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0769de616981443f98fe2c1f18b8cb95" candidate_uuid: "c12666dfd84348ca891f38fb4d0738b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d9879027b78541b49ed49f803e95f76b"
I20260709 13:05:10.873533 10673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0769de616981443f98fe2c1f18b8cb95" candidate_uuid: "c12666dfd84348ca891f38fb4d0738b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "25a826f326054a31a5be8db7f6b09a83"
I20260709 13:05:10.873931 10951 raft_consensus.cc:3060] T 0769de616981443f98fe2c1f18b8cb95 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:10.874137 10673 raft_consensus.cc:3055] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:10.874523 10673 raft_consensus.cc:740] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25a826f326054a31a5be8db7f6b09a83, State: Running, Role: LEADER
I20260709 13:05:10.875515 10673 consensus_queue.cc:260] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:10.876863 10673 raft_consensus.cc:3060] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:10.882496 10951 raft_consensus.cc:2468] T 0769de616981443f98fe2c1f18b8cb95 P d9879027b78541b49ed49f803e95f76b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c12666dfd84348ca891f38fb4d0738b8 in term 2.
I20260709 13:05:10.884292 10714 leader_election.cc:304] T 0769de616981443f98fe2c1f18b8cb95 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c12666dfd84348ca891f38fb4d0738b8, d9879027b78541b49ed49f803e95f76b; no voters: 
I20260709 13:05:10.885146 11025 raft_consensus.cc:2804] T 0769de616981443f98fe2c1f18b8cb95 P c12666dfd84348ca891f38fb4d0738b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:10.885349 10673 raft_consensus.cc:2468] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c12666dfd84348ca891f38fb4d0738b8 in term 2.
I20260709 13:05:10.885674 11025 raft_consensus.cc:697] T 0769de616981443f98fe2c1f18b8cb95 P c12666dfd84348ca891f38fb4d0738b8 [term 2 LEADER]: Becoming Leader. State: Replica: c12666dfd84348ca891f38fb4d0738b8, State: Running, Role: LEADER
I20260709 13:05:10.886624 11025 consensus_queue.cc:237] T 0769de616981443f98fe2c1f18b8cb95 P c12666dfd84348ca891f38fb4d0738b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:10.893918 10498 catalog_manager.cc:5697] T 0769de616981443f98fe2c1f18b8cb95 P c12666dfd84348ca891f38fb4d0738b8 reported cstate change: term changed from 1 to 2, leader changed from 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194) to c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "c12666dfd84348ca891f38fb4d0738b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:10.981961 10951 raft_consensus.cc:1275] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b [term 3 FOLLOWER]: Refusing update from remote peer c12666dfd84348ca891f38fb4d0738b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:10.983312 11025 consensus_queue.cc:1048] T 1d2f00bc524547b794c3a65afa1b00f7 P c12666dfd84348ca891f38fb4d0738b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:10.996438 10673 raft_consensus.cc:1275] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83 [term 3 FOLLOWER]: Refusing update from remote peer c12666dfd84348ca891f38fb4d0738b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:11.006151 11037 consensus_queue.cc:1048] T 1d2f00bc524547b794c3a65afa1b00f7 P c12666dfd84348ca891f38fb4d0738b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:11.392222 10951 raft_consensus.cc:1275] T 0769de616981443f98fe2c1f18b8cb95 P d9879027b78541b49ed49f803e95f76b [term 2 FOLLOWER]: Refusing update from remote peer c12666dfd84348ca891f38fb4d0738b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:11.393561 11037 consensus_queue.cc:1048] T 0769de616981443f98fe2c1f18b8cb95 P c12666dfd84348ca891f38fb4d0738b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:11.405048 10673 raft_consensus.cc:1275] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 [term 2 FOLLOWER]: Refusing update from remote peer c12666dfd84348ca891f38fb4d0738b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:11.407514 11025 consensus_queue.cc:1048] T 0769de616981443f98fe2c1f18b8cb95 P c12666dfd84348ca891f38fb4d0738b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:11.520586   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:11.531347 10747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0769de616981443f98fe2c1f18b8cb95"
dest_uuid: "c12666dfd84348ca891f38fb4d0738b8"
mode: GRACEFUL
new_leader_uuid: "25a826f326054a31a5be8db7f6b09a83"
 from {username='slave'} at 127.0.0.1:54390
I20260709 13:05:11.532053 10747 raft_consensus.cc:606] T 0769de616981443f98fe2c1f18b8cb95 P c12666dfd84348ca891f38fb4d0738b8 [term 2 LEADER]: Received request to transfer leadership to TS 25a826f326054a31a5be8db7f6b09a83
I20260709 13:05:11.535363 10747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65fb662e39fe49258d71de811265ba16"
dest_uuid: "c12666dfd84348ca891f38fb4d0738b8"
mode: GRACEFUL
new_leader_uuid: "25a826f326054a31a5be8db7f6b09a83"
 from {username='slave'} at 127.0.0.1:54390
I20260709 13:05:11.536031 10747 raft_consensus.cc:606] T 65fb662e39fe49258d71de811265ba16 P c12666dfd84348ca891f38fb4d0738b8 [term 2 LEADER]: Received request to transfer leadership to TS 25a826f326054a31a5be8db7f6b09a83
I20260709 13:05:11.537393   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:11.537999   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:11.538766   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:11.579852 11037 raft_consensus.cc:993] T 65fb662e39fe49258d71de811265ba16 P c12666dfd84348ca891f38fb4d0738b8: : Instructing follower 25a826f326054a31a5be8db7f6b09a83 to start an election
I20260709 13:05:11.580457 11037 raft_consensus.cc:1081] T 65fb662e39fe49258d71de811265ba16 P c12666dfd84348ca891f38fb4d0738b8 [term 2 LEADER]: Signalling peer 25a826f326054a31a5be8db7f6b09a83 to start an election
I20260709 13:05:11.582031 10673 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65fb662e39fe49258d71de811265ba16"
dest_uuid: "25a826f326054a31a5be8db7f6b09a83"
 from {username='slave'} at 127.0.0.1:47892
I20260709 13:05:11.582602 10673 raft_consensus.cc:493] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:11.583098 10673 raft_consensus.cc:3060] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:11.589501 10673 raft_consensus.cc:515] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:11.591706 10673 leader_election.cc:290] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 3 election: Requested vote from peers d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139), c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195:38441)
I20260709 13:05:11.592633 10952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fb662e39fe49258d71de811265ba16" candidate_uuid: "25a826f326054a31a5be8db7f6b09a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d9879027b78541b49ed49f803e95f76b"
I20260709 13:05:11.592960 10747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fb662e39fe49258d71de811265ba16" candidate_uuid: "25a826f326054a31a5be8db7f6b09a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c12666dfd84348ca891f38fb4d0738b8"
I20260709 13:05:11.593405 10952 raft_consensus.cc:3060] T 65fb662e39fe49258d71de811265ba16 P d9879027b78541b49ed49f803e95f76b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:11.593808 10747 raft_consensus.cc:3055] T 65fb662e39fe49258d71de811265ba16 P c12666dfd84348ca891f38fb4d0738b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:11.594110 10747 raft_consensus.cc:740] T 65fb662e39fe49258d71de811265ba16 P c12666dfd84348ca891f38fb4d0738b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c12666dfd84348ca891f38fb4d0738b8, State: Running, Role: LEADER
I20260709 13:05:11.594852 10747 consensus_queue.cc:260] T 65fb662e39fe49258d71de811265ba16 P c12666dfd84348ca891f38fb4d0738b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:11.595880 10747 raft_consensus.cc:3060] T 65fb662e39fe49258d71de811265ba16 P c12666dfd84348ca891f38fb4d0738b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:11.599268 10952 raft_consensus.cc:2468] T 65fb662e39fe49258d71de811265ba16 P d9879027b78541b49ed49f803e95f76b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25a826f326054a31a5be8db7f6b09a83 in term 3.
I20260709 13:05:11.600643 10640 leader_election.cc:304] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a826f326054a31a5be8db7f6b09a83, d9879027b78541b49ed49f803e95f76b; no voters: 
I20260709 13:05:11.601707 11031 raft_consensus.cc:2804] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:11.602100 10747 raft_consensus.cc:2468] T 65fb662e39fe49258d71de811265ba16 P c12666dfd84348ca891f38fb4d0738b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25a826f326054a31a5be8db7f6b09a83 in term 3.
I20260709 13:05:11.602195 11031 raft_consensus.cc:697] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 [term 3 LEADER]: Becoming Leader. State: Replica: 25a826f326054a31a5be8db7f6b09a83, State: Running, Role: LEADER
I20260709 13:05:11.603404 11031 consensus_queue.cc:237] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:11.611282 10494 catalog_manager.cc:5697] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 reported cstate change: term changed from 2 to 3, leader changed from c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195) to 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "25a826f326054a31a5be8db7f6b09a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:11.826794 10546 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:05:11.885614 11037 raft_consensus.cc:993] T 0769de616981443f98fe2c1f18b8cb95 P c12666dfd84348ca891f38fb4d0738b8: : Instructing follower 25a826f326054a31a5be8db7f6b09a83 to start an election
I20260709 13:05:11.886581 11037 raft_consensus.cc:1081] T 0769de616981443f98fe2c1f18b8cb95 P c12666dfd84348ca891f38fb4d0738b8 [term 2 LEADER]: Signalling peer 25a826f326054a31a5be8db7f6b09a83 to start an election
I20260709 13:05:11.888664 10673 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0769de616981443f98fe2c1f18b8cb95"
dest_uuid: "25a826f326054a31a5be8db7f6b09a83"
 from {username='slave'} at 127.0.0.1:47892
I20260709 13:05:11.889559 10673 raft_consensus.cc:493] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:11.889989 10673 raft_consensus.cc:3060] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:11.896683 10673 raft_consensus.cc:515] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:11.898666 10673 leader_election.cc:290] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 3 election: Requested vote from peers d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139), c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195:38441)
I20260709 13:05:11.899739 10747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0769de616981443f98fe2c1f18b8cb95" candidate_uuid: "25a826f326054a31a5be8db7f6b09a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c12666dfd84348ca891f38fb4d0738b8"
I20260709 13:05:11.900421 10747 raft_consensus.cc:3055] T 0769de616981443f98fe2c1f18b8cb95 P c12666dfd84348ca891f38fb4d0738b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:11.899739 10952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0769de616981443f98fe2c1f18b8cb95" candidate_uuid: "25a826f326054a31a5be8db7f6b09a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d9879027b78541b49ed49f803e95f76b"
I20260709 13:05:11.900923 10747 raft_consensus.cc:740] T 0769de616981443f98fe2c1f18b8cb95 P c12666dfd84348ca891f38fb4d0738b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c12666dfd84348ca891f38fb4d0738b8, State: Running, Role: LEADER
I20260709 13:05:11.901153 10952 raft_consensus.cc:3060] T 0769de616981443f98fe2c1f18b8cb95 P d9879027b78541b49ed49f803e95f76b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:11.902042 10747 consensus_queue.cc:260] T 0769de616981443f98fe2c1f18b8cb95 P c12666dfd84348ca891f38fb4d0738b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:11.903681 10747 raft_consensus.cc:3060] T 0769de616981443f98fe2c1f18b8cb95 P c12666dfd84348ca891f38fb4d0738b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:11.911674 10952 raft_consensus.cc:2468] T 0769de616981443f98fe2c1f18b8cb95 P d9879027b78541b49ed49f803e95f76b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25a826f326054a31a5be8db7f6b09a83 in term 3.
I20260709 13:05:11.912985 10747 raft_consensus.cc:2468] T 0769de616981443f98fe2c1f18b8cb95 P c12666dfd84348ca891f38fb4d0738b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25a826f326054a31a5be8db7f6b09a83 in term 3.
I20260709 13:05:11.913173 10640 leader_election.cc:304] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a826f326054a31a5be8db7f6b09a83, d9879027b78541b49ed49f803e95f76b; no voters: 
I20260709 13:05:11.914218 11031 raft_consensus.cc:2804] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:11.914721 11031 raft_consensus.cc:697] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 [term 3 LEADER]: Becoming Leader. State: Replica: 25a826f326054a31a5be8db7f6b09a83, State: Running, Role: LEADER
I20260709 13:05:11.915473 11031 consensus_queue.cc:237] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:11.926862 10494 catalog_manager.cc:5697] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 reported cstate change: term changed from 2 to 3, leader changed from c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195) to 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "25a826f326054a31a5be8db7f6b09a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.087316 10747 raft_consensus.cc:1275] T 65fb662e39fe49258d71de811265ba16 P c12666dfd84348ca891f38fb4d0738b8 [term 3 FOLLOWER]: Refusing update from remote peer 25a826f326054a31a5be8db7f6b09a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:12.088611 11031 consensus_queue.cc:1048] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:12.099193 10952 raft_consensus.cc:1275] T 65fb662e39fe49258d71de811265ba16 P d9879027b78541b49ed49f803e95f76b [term 3 FOLLOWER]: Refusing update from remote peer 25a826f326054a31a5be8db7f6b09a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:12.104614 11031 consensus_queue.cc:1048] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:12.302475 10747 raft_consensus.cc:1275] T 0769de616981443f98fe2c1f18b8cb95 P c12666dfd84348ca891f38fb4d0738b8 [term 3 FOLLOWER]: Refusing update from remote peer 25a826f326054a31a5be8db7f6b09a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:12.303968 11049 consensus_queue.cc:1048] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:12.313550 10952 raft_consensus.cc:1275] T 0769de616981443f98fe2c1f18b8cb95 P d9879027b78541b49ed49f803e95f76b [term 3 FOLLOWER]: Refusing update from remote peer 25a826f326054a31a5be8db7f6b09a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:12.315800 11054 consensus_queue.cc:1048] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:12.546907   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:12.565264 10673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1789fe885f1e4e2a851aebab8d6f1c95"
dest_uuid: "25a826f326054a31a5be8db7f6b09a83"
mode: GRACEFUL
new_leader_uuid: "c12666dfd84348ca891f38fb4d0738b8"
 from {username='slave'} at 127.0.0.1:47908
I20260709 13:05:12.566654 10673 raft_consensus.cc:606] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [term 3 LEADER]: Received request to transfer leadership to TS c12666dfd84348ca891f38fb4d0738b8
I20260709 13:05:12.569932 10673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "275e6f7ace35466d9a3dcc0ab83dfbcd"
dest_uuid: "25a826f326054a31a5be8db7f6b09a83"
mode: GRACEFUL
new_leader_uuid: "c12666dfd84348ca891f38fb4d0738b8"
 from {username='slave'} at 127.0.0.1:47908
I20260709 13:05:12.570613 10673 raft_consensus.cc:606] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83 [term 1 LEADER]: Received request to transfer leadership to TS c12666dfd84348ca891f38fb4d0738b8
I20260709 13:05:12.571803   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:12.572351   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:12.573369   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:05:12.828019 10546 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:05:12.938853 11054 raft_consensus.cc:993] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83: : Instructing follower c12666dfd84348ca891f38fb4d0738b8 to start an election
I20260709 13:05:12.939795 11042 raft_consensus.cc:1081] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83 [term 1 LEADER]: Signalling peer c12666dfd84348ca891f38fb4d0738b8 to start an election
I20260709 13:05:12.943164 10747 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "275e6f7ace35466d9a3dcc0ab83dfbcd"
dest_uuid: "c12666dfd84348ca891f38fb4d0738b8"
 from {username='slave'} at 127.0.0.1:54384
I20260709 13:05:12.945299 10747 raft_consensus.cc:493] T 275e6f7ace35466d9a3dcc0ab83dfbcd P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:12.946147 10747 raft_consensus.cc:3060] T 275e6f7ace35466d9a3dcc0ab83dfbcd P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:12.958676 11054 raft_consensus.cc:993] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83: : Instructing follower c12666dfd84348ca891f38fb4d0738b8 to start an election
I20260709 13:05:12.959825 11054 raft_consensus.cc:1081] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [term 3 LEADER]: Signalling peer c12666dfd84348ca891f38fb4d0738b8 to start an election
I20260709 13:05:12.958781 10747 raft_consensus.cc:515] T 275e6f7ace35466d9a3dcc0ab83dfbcd P c12666dfd84348ca891f38fb4d0738b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:12.964010 10748 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1789fe885f1e4e2a851aebab8d6f1c95"
dest_uuid: "c12666dfd84348ca891f38fb4d0738b8"
 from {username='slave'} at 127.0.0.1:54384
I20260709 13:05:12.964725 10747 leader_election.cc:290] T 275e6f7ace35466d9a3dcc0ab83dfbcd P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 2 election: Requested vote from peers d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139), 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194:36333)
I20260709 13:05:12.964960 10748 raft_consensus.cc:493] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:12.965900 10748 raft_consensus.cc:3060] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:12.966400 10952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275e6f7ace35466d9a3dcc0ab83dfbcd" candidate_uuid: "c12666dfd84348ca891f38fb4d0738b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d9879027b78541b49ed49f803e95f76b"
I20260709 13:05:12.966467 10673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275e6f7ace35466d9a3dcc0ab83dfbcd" candidate_uuid: "c12666dfd84348ca891f38fb4d0738b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "25a826f326054a31a5be8db7f6b09a83"
I20260709 13:05:12.967393 10952 raft_consensus.cc:3060] T 275e6f7ace35466d9a3dcc0ab83dfbcd P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:12.967491 10673 raft_consensus.cc:3055] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:12.967993 10673 raft_consensus.cc:740] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25a826f326054a31a5be8db7f6b09a83, State: Running, Role: LEADER
I20260709 13:05:12.969339 10673 consensus_queue.cc:260] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:12.970768 10673 raft_consensus.cc:3060] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:12.980149 10673 raft_consensus.cc:2468] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c12666dfd84348ca891f38fb4d0738b8 in term 2.
I20260709 13:05:12.979264 10748 raft_consensus.cc:515] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:12.980842 10952 raft_consensus.cc:2468] T 275e6f7ace35466d9a3dcc0ab83dfbcd P d9879027b78541b49ed49f803e95f76b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c12666dfd84348ca891f38fb4d0738b8 in term 2.
I20260709 13:05:12.985442 10713 leader_election.cc:304] T 275e6f7ace35466d9a3dcc0ab83dfbcd P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a826f326054a31a5be8db7f6b09a83, c12666dfd84348ca891f38fb4d0738b8; no voters: 
I20260709 13:05:12.987576 10748 leader_election.cc:290] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 4 election: Requested vote from peers d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139), 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194:36333)
I20260709 13:05:12.987852 11037 raft_consensus.cc:2804] T 275e6f7ace35466d9a3dcc0ab83dfbcd P c12666dfd84348ca891f38fb4d0738b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:12.989151 10951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1789fe885f1e4e2a851aebab8d6f1c95" candidate_uuid: "c12666dfd84348ca891f38fb4d0738b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d9879027b78541b49ed49f803e95f76b"
I20260709 13:05:12.990242 10951 raft_consensus.cc:3060] T 1789fe885f1e4e2a851aebab8d6f1c95 P d9879027b78541b49ed49f803e95f76b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:12.990653 11037 raft_consensus.cc:697] T 275e6f7ace35466d9a3dcc0ab83dfbcd P c12666dfd84348ca891f38fb4d0738b8 [term 2 LEADER]: Becoming Leader. State: Replica: c12666dfd84348ca891f38fb4d0738b8, State: Running, Role: LEADER
I20260709 13:05:12.992053 10673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1789fe885f1e4e2a851aebab8d6f1c95" candidate_uuid: "c12666dfd84348ca891f38fb4d0738b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "25a826f326054a31a5be8db7f6b09a83"
I20260709 13:05:12.992100 11037 consensus_queue.cc:237] T 275e6f7ace35466d9a3dcc0ab83dfbcd P c12666dfd84348ca891f38fb4d0738b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:12.993438 10673 raft_consensus.cc:3055] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:12.993767 10673 raft_consensus.cc:740] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 25a826f326054a31a5be8db7f6b09a83, State: Running, Role: LEADER
I20260709 13:05:12.995329 10673 consensus_queue.cc:260] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:12.997135 10673 raft_consensus.cc:3060] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:13.009577 10951 raft_consensus.cc:2468] T 1789fe885f1e4e2a851aebab8d6f1c95 P d9879027b78541b49ed49f803e95f76b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c12666dfd84348ca891f38fb4d0738b8 in term 4.
I20260709 13:05:13.011023 10714 leader_election.cc:304] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c12666dfd84348ca891f38fb4d0738b8, d9879027b78541b49ed49f803e95f76b; no voters: 
I20260709 13:05:13.011775 11037 raft_consensus.cc:2804] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:13.012226 11037 raft_consensus.cc:697] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 [term 4 LEADER]: Becoming Leader. State: Replica: c12666dfd84348ca891f38fb4d0738b8, State: Running, Role: LEADER
I20260709 13:05:13.013339 11037 consensus_queue.cc:237] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } }
I20260709 13:05:13.013142 10498 catalog_manager.cc:5697] T 275e6f7ace35466d9a3dcc0ab83dfbcd P c12666dfd84348ca891f38fb4d0738b8 reported cstate change: term changed from 1 to 2, leader changed from 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194) to c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "c12666dfd84348ca891f38fb4d0738b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:13.014506 10673 raft_consensus.cc:2468] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c12666dfd84348ca891f38fb4d0738b8 in term 4.
I20260709 13:05:13.039602 10498 catalog_manager.cc:5697] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 reported cstate change: term changed from 3 to 4, leader changed from 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194) to c12666dfd84348ca891f38fb4d0738b8 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "c12666dfd84348ca891f38fb4d0738b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c12666dfd84348ca891f38fb4d0738b8" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38441 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:13.379668 10673 raft_consensus.cc:1275] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83 [term 2 FOLLOWER]: Refusing update from remote peer c12666dfd84348ca891f38fb4d0738b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.381863 11057 consensus_queue.cc:1048] T 275e6f7ace35466d9a3dcc0ab83dfbcd P c12666dfd84348ca891f38fb4d0738b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:13.394394 10951 raft_consensus.cc:1275] T 275e6f7ace35466d9a3dcc0ab83dfbcd P d9879027b78541b49ed49f803e95f76b [term 2 FOLLOWER]: Refusing update from remote peer c12666dfd84348ca891f38fb4d0738b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.396680 11037 consensus_queue.cc:1048] T 275e6f7ace35466d9a3dcc0ab83dfbcd P c12666dfd84348ca891f38fb4d0738b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:13.497529 10673 raft_consensus.cc:1275] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [term 4 FOLLOWER]: Refusing update from remote peer c12666dfd84348ca891f38fb4d0738b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:13.499567 11037 consensus_queue.cc:1048] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25a826f326054a31a5be8db7f6b09a83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:13.510128 10951 raft_consensus.cc:1275] T 1789fe885f1e4e2a851aebab8d6f1c95 P d9879027b78541b49ed49f803e95f76b [term 4 FOLLOWER]: Refusing update from remote peer c12666dfd84348ca891f38fb4d0738b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:13.511626 11056 consensus_queue.cc:1048] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9879027b78541b49ed49f803e95f76b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:13.580319   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:13.616762   431 tablet_server.cc:179] TabletServer@127.0.107.193:42139 shutting down...
I20260709 13:05:13.646832   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:13.647682   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:13.648554   431 raft_consensus.cc:2243] T b42fcc8a7b364f1eb90b8983dd617f74 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:13.649178   431 raft_consensus.cc:2272] T b42fcc8a7b364f1eb90b8983dd617f74 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:13.652030   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:13.652906   431 raft_consensus.cc:2243] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:13.653550   431 raft_consensus.cc:2272] T 1d2f00bc524547b794c3a65afa1b00f7 P d9879027b78541b49ed49f803e95f76b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:13.656246   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:13.657229   431 raft_consensus.cc:2243] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:13.657789   431 raft_consensus.cc:2272] T 99ac7fd5cbe444fda04f98de073d9b47 P d9879027b78541b49ed49f803e95f76b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:13.660344   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:13.660991   431 raft_consensus.cc:2243] T 275e6f7ace35466d9a3dcc0ab83dfbcd P d9879027b78541b49ed49f803e95f76b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:13.661537   431 raft_consensus.cc:2272] T 275e6f7ace35466d9a3dcc0ab83dfbcd P d9879027b78541b49ed49f803e95f76b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:13.664835   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:13.665539   431 raft_consensus.cc:2243] T 65fb662e39fe49258d71de811265ba16 P d9879027b78541b49ed49f803e95f76b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:13.666159   431 raft_consensus.cc:2272] T 65fb662e39fe49258d71de811265ba16 P d9879027b78541b49ed49f803e95f76b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:13.668540   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:13.669231   431 raft_consensus.cc:2243] T c9d1d89d891b4b84b70e9baa05c5b45a P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:13.669731   431 raft_consensus.cc:2272] T c9d1d89d891b4b84b70e9baa05c5b45a P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:13.672158   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:13.672725   431 raft_consensus.cc:2243] T b9ea195e53c447cca2d3d8cfc8481ff6 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:13.673233   431 raft_consensus.cc:2272] T b9ea195e53c447cca2d3d8cfc8481ff6 P d9879027b78541b49ed49f803e95f76b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:13.676014   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:13.676663   431 raft_consensus.cc:2243] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:13.677318   431 raft_consensus.cc:2272] T d60282d41bde45538429171e6a290048 P d9879027b78541b49ed49f803e95f76b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:13.680477   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:13.681051   431 raft_consensus.cc:2243] T 1789fe885f1e4e2a851aebab8d6f1c95 P d9879027b78541b49ed49f803e95f76b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:13.681641   431 raft_consensus.cc:2272] T 1789fe885f1e4e2a851aebab8d6f1c95 P d9879027b78541b49ed49f803e95f76b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:13.685457   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:13.686141   431 raft_consensus.cc:2243] T 0769de616981443f98fe2c1f18b8cb95 P d9879027b78541b49ed49f803e95f76b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:13.686815   431 raft_consensus.cc:2272] T 0769de616981443f98fe2c1f18b8cb95 P d9879027b78541b49ed49f803e95f76b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:13.726902   431 tablet_server.cc:196] TabletServer@127.0.107.193:42139 shutdown complete.
I20260709 13:05:13.762387   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:05:13.790570 10714 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42139: connect: Connection refused (error 111) [suppressed 97 similar messages]
W20260709 13:05:13.798975 10714 consensus_peers.cc:597] T b9ea195e53c447cca2d3d8cfc8481ff6 P c12666dfd84348ca891f38fb4d0738b8 -> Peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Couldn't send request to peer d9879027b78541b49ed49f803e95f76b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42139: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:13.809962   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:13.811034   431 tablet_replica.cc:333] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83: stopping tablet replica
I20260709 13:05:13.812229   431 raft_consensus.cc:2243] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:13.813333   431 raft_consensus.cc:2272] T 65fb662e39fe49258d71de811265ba16 P 25a826f326054a31a5be8db7f6b09a83 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:13.817045   431 tablet_replica.cc:333] T d60282d41bde45538429171e6a290048 P 25a826f326054a31a5be8db7f6b09a83: stopping tablet replica
I20260709 13:05:13.818187   431 raft_consensus.cc:2243] T d60282d41bde45538429171e6a290048 P 25a826f326054a31a5be8db7f6b09a83 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:13.820092   431 raft_consensus.cc:2272] T d60282d41bde45538429171e6a290048 P 25a826f326054a31a5be8db7f6b09a83 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:13.825395   431 tablet_replica.cc:333] T b9ea195e53c447cca2d3d8cfc8481ff6 P 25a826f326054a31a5be8db7f6b09a83: stopping tablet replica
I20260709 13:05:13.826099   431 raft_consensus.cc:2243] T b9ea195e53c447cca2d3d8cfc8481ff6 P 25a826f326054a31a5be8db7f6b09a83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:13.826637   431 raft_consensus.cc:2272] T b9ea195e53c447cca2d3d8cfc8481ff6 P 25a826f326054a31a5be8db7f6b09a83 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:13.829033 10546 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:05:13.829698   431 tablet_replica.cc:333] T c9d1d89d891b4b84b70e9baa05c5b45a P 25a826f326054a31a5be8db7f6b09a83: stopping tablet replica
I20260709 13:05:13.830461   431 raft_consensus.cc:2243] T c9d1d89d891b4b84b70e9baa05c5b45a P 25a826f326054a31a5be8db7f6b09a83 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:13.832072   431 raft_consensus.cc:2272] T c9d1d89d891b4b84b70e9baa05c5b45a P 25a826f326054a31a5be8db7f6b09a83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:13.834812   431 tablet_replica.cc:333] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83: stopping tablet replica
I20260709 13:05:13.835510   431 raft_consensus.cc:2243] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:13.835980   431 raft_consensus.cc:2272] T 1789fe885f1e4e2a851aebab8d6f1c95 P 25a826f326054a31a5be8db7f6b09a83 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:13.839969   431 tablet_replica.cc:333] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83: stopping tablet replica
I20260709 13:05:13.841424   431 raft_consensus.cc:2243] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:13.843005   431 raft_consensus.cc:2272] T 0769de616981443f98fe2c1f18b8cb95 P 25a826f326054a31a5be8db7f6b09a83 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:13.848415   431 tablet_replica.cc:333] T b42fcc8a7b364f1eb90b8983dd617f74 P 25a826f326054a31a5be8db7f6b09a83: stopping tablet replica
I20260709 13:05:13.849267   431 raft_consensus.cc:2243] T b42fcc8a7b364f1eb90b8983dd617f74 P 25a826f326054a31a5be8db7f6b09a83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:13.849828   431 raft_consensus.cc:2272] T b42fcc8a7b364f1eb90b8983dd617f74 P 25a826f326054a31a5be8db7f6b09a83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:13.852209   431 tablet_replica.cc:333] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83: stopping tablet replica
I20260709 13:05:13.852857   431 raft_consensus.cc:2243] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:13.853423   431 raft_consensus.cc:2272] T 1d2f00bc524547b794c3a65afa1b00f7 P 25a826f326054a31a5be8db7f6b09a83 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:13.856141   431 tablet_replica.cc:333] T 99ac7fd5cbe444fda04f98de073d9b47 P 25a826f326054a31a5be8db7f6b09a83: stopping tablet replica
I20260709 13:05:13.857668   431 raft_consensus.cc:2243] T 99ac7fd5cbe444fda04f98de073d9b47 P 25a826f326054a31a5be8db7f6b09a83 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:13.858215   431 raft_consensus.cc:2272] T 99ac7fd5cbe444fda04f98de073d9b47 P 25a826f326054a31a5be8db7f6b09a83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:13.862151   431 tablet_replica.cc:333] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83: stopping tablet replica
I20260709 13:05:13.862861   431 raft_consensus.cc:2243] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:13.863533   431 raft_consensus.cc:2272] T 275e6f7ace35466d9a3dcc0ab83dfbcd P 25a826f326054a31a5be8db7f6b09a83 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:13.881520 10714 consensus_peers.cc:597] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8 -> Peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Couldn't send request to peer d9879027b78541b49ed49f803e95f76b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42139: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:13.898999 10713 consensus_peers.cc:597] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 -> Peer 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194:36333): Couldn't send request to peer 25a826f326054a31a5be8db7f6b09a83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:36333: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:13.909951   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:05:13.951458 10714 consensus_peers.cc:597] T b42fcc8a7b364f1eb90b8983dd617f74 P c12666dfd84348ca891f38fb4d0738b8 -> Peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Couldn't send request to peer d9879027b78541b49ed49f803e95f76b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42139: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:13.954156   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:05:13.962512 10713 consensus_peers.cc:597] T 275e6f7ace35466d9a3dcc0ab83dfbcd P c12666dfd84348ca891f38fb4d0738b8 -> Peer 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194:36333): Couldn't send request to peer 25a826f326054a31a5be8db7f6b09a83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:36333: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:13.966144 10714 consensus_peers.cc:597] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 -> Peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Couldn't send request to peer d9879027b78541b49ed49f803e95f76b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42139: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:13.969641 10713 consensus_peers.cc:597] T 1d2f00bc524547b794c3a65afa1b00f7 P c12666dfd84348ca891f38fb4d0738b8 -> Peer 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194:36333): Couldn't send request to peer 25a826f326054a31a5be8db7f6b09a83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:36333: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:13.973446 10713 consensus_peers.cc:597] T b9ea195e53c447cca2d3d8cfc8481ff6 P c12666dfd84348ca891f38fb4d0738b8 -> Peer 25a826f326054a31a5be8db7f6b09a83 (127.0.107.194:36333): Couldn't send request to peer 25a826f326054a31a5be8db7f6b09a83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:36333: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:14.001948   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:14.002979   431 tablet_replica.cc:333] T 65fb662e39fe49258d71de811265ba16 P c12666dfd84348ca891f38fb4d0738b8: stopping tablet replica
I20260709 13:05:14.004462   431 raft_consensus.cc:2243] T 65fb662e39fe49258d71de811265ba16 P c12666dfd84348ca891f38fb4d0738b8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:14.005023   431 raft_consensus.cc:2272] T 65fb662e39fe49258d71de811265ba16 P c12666dfd84348ca891f38fb4d0738b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.007858   431 tablet_replica.cc:333] T 1d2f00bc524547b794c3a65afa1b00f7 P c12666dfd84348ca891f38fb4d0738b8: stopping tablet replica
I20260709 13:05:14.008527   431 raft_consensus.cc:2243] T 1d2f00bc524547b794c3a65afa1b00f7 P c12666dfd84348ca891f38fb4d0738b8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:14.009758   431 raft_consensus.cc:2272] T 1d2f00bc524547b794c3a65afa1b00f7 P c12666dfd84348ca891f38fb4d0738b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.012158   431 tablet_replica.cc:333] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8: stopping tablet replica
I20260709 13:05:14.012796   431 raft_consensus.cc:2243] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:14.013665   431 raft_consensus.cc:2272] T 1789fe885f1e4e2a851aebab8d6f1c95 P c12666dfd84348ca891f38fb4d0738b8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.017398   431 tablet_replica.cc:333] T 0769de616981443f98fe2c1f18b8cb95 P c12666dfd84348ca891f38fb4d0738b8: stopping tablet replica
I20260709 13:05:14.018221   431 raft_consensus.cc:2243] T 0769de616981443f98fe2c1f18b8cb95 P c12666dfd84348ca891f38fb4d0738b8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:14.019105   431 raft_consensus.cc:2272] T 0769de616981443f98fe2c1f18b8cb95 P c12666dfd84348ca891f38fb4d0738b8 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:14.019755 10714 consensus_peers.cc:597] T 275e6f7ace35466d9a3dcc0ab83dfbcd P c12666dfd84348ca891f38fb4d0738b8 -> Peer d9879027b78541b49ed49f803e95f76b (127.0.107.193:42139): Couldn't send request to peer d9879027b78541b49ed49f803e95f76b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42139: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:14.022094   431 tablet_replica.cc:333] T b9ea195e53c447cca2d3d8cfc8481ff6 P c12666dfd84348ca891f38fb4d0738b8: stopping tablet replica
I20260709 13:05:14.023289   431 raft_consensus.cc:2243] T b9ea195e53c447cca2d3d8cfc8481ff6 P c12666dfd84348ca891f38fb4d0738b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:14.024713   431 raft_consensus.cc:2272] T b9ea195e53c447cca2d3d8cfc8481ff6 P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.027644   431 tablet_replica.cc:333] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8: stopping tablet replica
I20260709 13:05:14.028329   431 raft_consensus.cc:2243] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:14.028874   431 raft_consensus.cc:2272] T d60282d41bde45538429171e6a290048 P c12666dfd84348ca891f38fb4d0738b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.031224   431 tablet_replica.cc:333] T c9d1d89d891b4b84b70e9baa05c5b45a P c12666dfd84348ca891f38fb4d0738b8: stopping tablet replica
I20260709 13:05:14.031916   431 raft_consensus.cc:2243] T c9d1d89d891b4b84b70e9baa05c5b45a P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:14.032456   431 raft_consensus.cc:2272] T c9d1d89d891b4b84b70e9baa05c5b45a P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.034775   431 tablet_replica.cc:333] T b42fcc8a7b364f1eb90b8983dd617f74 P c12666dfd84348ca891f38fb4d0738b8: stopping tablet replica
I20260709 13:05:14.035281   431 raft_consensus.cc:2243] T b42fcc8a7b364f1eb90b8983dd617f74 P c12666dfd84348ca891f38fb4d0738b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:14.036162   431 raft_consensus.cc:2272] T b42fcc8a7b364f1eb90b8983dd617f74 P c12666dfd84348ca891f38fb4d0738b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.038537   431 tablet_replica.cc:333] T 275e6f7ace35466d9a3dcc0ab83dfbcd P c12666dfd84348ca891f38fb4d0738b8: stopping tablet replica
I20260709 13:05:14.039076   431 raft_consensus.cc:2243] T 275e6f7ace35466d9a3dcc0ab83dfbcd P c12666dfd84348ca891f38fb4d0738b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:14.040136   431 raft_consensus.cc:2272] T 275e6f7ace35466d9a3dcc0ab83dfbcd P c12666dfd84348ca891f38fb4d0738b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.043076   431 tablet_replica.cc:333] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8: stopping tablet replica
I20260709 13:05:14.043587   431 raft_consensus.cc:2243] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:14.044474   431 raft_consensus.cc:2272] T 99ac7fd5cbe444fda04f98de073d9b47 P c12666dfd84348ca891f38fb4d0738b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.080991   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:05:14.111217   431 master.cc:562] Master@127.0.107.254:41867 shutting down...
I20260709 13:05:14.139812   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e9b4e7fc361447bc919f195ce51e8480 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:14.140904   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e9b4e7fc361447bc919f195ce51e8480 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.141466   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P e9b4e7fc361447bc919f195ce51e8480: stopping tablet replica
I20260709 13:05:14.163368   431 master.cc:584] Master@127.0.107.254:41867 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13603 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:05:14.218624   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:37799
I20260709 13:05:14.219805   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:14.228470 11079 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:14.228489 11082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:14.228739 11080 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:14.229813   431 server_base.cc:1061] running on GCE node
I20260709 13:05:14.231117   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:14.231357   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:14.231515   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602314231498 us; error 0 us; skew 500 ppm
I20260709 13:05:14.232115   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:14.234915   431 webserver.cc:533] Webserver started at http://127.0.107.254:46085/ using document root <none> and password file <none>
I20260709 13:05:14.235457   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:14.235670   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:14.235966   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:14.237526   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601979855482-431-0/minicluster-data/master-0-root/instance:
uuid: "c38278446c2e49d3b017e9b8ff12e60a"
format_stamp: "Formatted at 2026-07-09 13:05:14 on dist-test-slave-g4pn"
I20260709 13:05:14.243217   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:05:14.247139 11087 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:14.248152   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:05:14.248521   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601979855482-431-0/minicluster-data/master-0-root
uuid: "c38278446c2e49d3b017e9b8ff12e60a"
format_stamp: "Formatted at 2026-07-09 13:05:14 on dist-test-slave-g4pn"
I20260709 13:05:14.248855   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601979855482-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601979855482-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601979855482-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:14.268146   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:14.269599   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:14.316270   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:37799
I20260709 13:05:14.316368 11138 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:37799 every 8 connection(s)
I20260709 13:05:14.320986 11139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:14.335278 11139 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c38278446c2e49d3b017e9b8ff12e60a: Bootstrap starting.
I20260709 13:05:14.341107 11139 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c38278446c2e49d3b017e9b8ff12e60a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.346225 11139 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c38278446c2e49d3b017e9b8ff12e60a: No bootstrap required, opened a new log
I20260709 13:05:14.348785 11139 raft_consensus.cc:359] T 00000000000000000000000000000000 P c38278446c2e49d3b017e9b8ff12e60a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c38278446c2e49d3b017e9b8ff12e60a" member_type: VOTER }
I20260709 13:05:14.349368 11139 raft_consensus.cc:385] T 00000000000000000000000000000000 P c38278446c2e49d3b017e9b8ff12e60a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.349648 11139 raft_consensus.cc:740] T 00000000000000000000000000000000 P c38278446c2e49d3b017e9b8ff12e60a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c38278446c2e49d3b017e9b8ff12e60a, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.350317 11139 consensus_queue.cc:260] T 00000000000000000000000000000000 P c38278446c2e49d3b017e9b8ff12e60a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c38278446c2e49d3b017e9b8ff12e60a" member_type: VOTER }
I20260709 13:05:14.351043 11139 raft_consensus.cc:399] T 00000000000000000000000000000000 P c38278446c2e49d3b017e9b8ff12e60a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:14.351341 11139 raft_consensus.cc:493] T 00000000000000000000000000000000 P c38278446c2e49d3b017e9b8ff12e60a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:14.351634 11139 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c38278446c2e49d3b017e9b8ff12e60a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:14.358471 11139 raft_consensus.cc:515] T 00000000000000000000000000000000 P c38278446c2e49d3b017e9b8ff12e60a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c38278446c2e49d3b017e9b8ff12e60a" member_type: VOTER }
I20260709 13:05:14.359154 11139 leader_election.cc:304] T 00000000000000000000000000000000 P c38278446c2e49d3b017e9b8ff12e60a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c38278446c2e49d3b017e9b8ff12e60a; no voters: 
I20260709 13:05:14.360505 11139 leader_election.cc:290] T 00000000000000000000000000000000 P c38278446c2e49d3b017e9b8ff12e60a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:14.360924 11142 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c38278446c2e49d3b017e9b8ff12e60a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:14.362576 11142 raft_consensus.cc:697] T 00000000000000000000000000000000 P c38278446c2e49d3b017e9b8ff12e60a [term 1 LEADER]: Becoming Leader. State: Replica: c38278446c2e49d3b017e9b8ff12e60a, State: Running, Role: LEADER
I20260709 13:05:14.363358 11142 consensus_queue.cc:237] T 00000000000000000000000000000000 P c38278446c2e49d3b017e9b8ff12e60a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c38278446c2e49d3b017e9b8ff12e60a" member_type: VOTER }
I20260709 13:05:14.364078 11139 sys_catalog.cc:565] T 00000000000000000000000000000000 P c38278446c2e49d3b017e9b8ff12e60a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:14.368247 11143 sys_catalog.cc:455] T 00000000000000000000000000000000 P c38278446c2e49d3b017e9b8ff12e60a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c38278446c2e49d3b017e9b8ff12e60a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c38278446c2e49d3b017e9b8ff12e60a" member_type: VOTER } }
I20260709 13:05:14.369280 11143 sys_catalog.cc:458] T 00000000000000000000000000000000 P c38278446c2e49d3b017e9b8ff12e60a [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:14.368320 11144 sys_catalog.cc:455] T 00000000000000000000000000000000 P c38278446c2e49d3b017e9b8ff12e60a [sys.catalog]: SysCatalogTable state changed. Reason: New leader c38278446c2e49d3b017e9b8ff12e60a. Latest consensus state: current_term: 1 leader_uuid: "c38278446c2e49d3b017e9b8ff12e60a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c38278446c2e49d3b017e9b8ff12e60a" member_type: VOTER } }
I20260709 13:05:14.370491 11144 sys_catalog.cc:458] T 00000000000000000000000000000000 P c38278446c2e49d3b017e9b8ff12e60a [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:14.378173 11149 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:14.385056 11149 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:14.386495   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:14.395304 11149 catalog_manager.cc:1383] Generated new cluster ID: 0ab4d397e81c45d095c2638309940f82
I20260709 13:05:14.395769 11149 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:14.443717 11149 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:14.445376 11149 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:14.481838 11149 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c38278446c2e49d3b017e9b8ff12e60a: Generated new TSK 0
I20260709 13:05:14.482554 11149 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:14.518862   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:14.527994 11160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:14.529896 11161 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:14.532552 11163 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:14.532692   431 server_base.cc:1061] running on GCE node
I20260709 13:05:14.534930   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:14.535199   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:14.535387   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602314535364 us; error 0 us; skew 500 ppm
I20260709 13:05:14.535938   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:14.538836   431 webserver.cc:533] Webserver started at http://127.0.107.193:37695/ using document root <none> and password file <none>
I20260709 13:05:14.539398   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:14.539613   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:14.539896   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:14.541070   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601979855482-431-0/minicluster-data/ts-0-root/instance:
uuid: "817b494b9b5b4ff0bbf68b9fd74963d4"
format_stamp: "Formatted at 2026-07-09 13:05:14 on dist-test-slave-g4pn"
I20260709 13:05:14.546656   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:05:14.552273 11168 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:14.553534   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
I20260709 13:05:14.553918   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601979855482-431-0/minicluster-data/ts-0-root
uuid: "817b494b9b5b4ff0bbf68b9fd74963d4"
format_stamp: "Formatted at 2026-07-09 13:05:14 on dist-test-slave-g4pn"
I20260709 13:05:14.554240   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601979855482-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601979855482-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601979855482-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:14.571367   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:14.573035   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:14.574781   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:14.577687   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:14.577948   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:14.578225   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:14.578415   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:14.625802   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:37689
I20260709 13:05:14.625909 11230 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:37689 every 8 connection(s)
I20260709 13:05:14.632063   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:14.640344 11235 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:14.642479 11236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:14.644914 11238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:14.646562 11231 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37799
I20260709 13:05:14.646782   431 server_base.cc:1061] running on GCE node
I20260709 13:05:14.647234 11231 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:14.648125 11231 heartbeater.cc:507] Master 127.0.107.254:37799 requested a full tablet report, sending...
I20260709 13:05:14.648160   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:14.648618   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:14.648922   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602314648890 us; error 0 us; skew 500 ppm
I20260709 13:05:14.649634   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:14.651103 11104 ts_manager.cc:194] Registered new tserver with Master: 817b494b9b5b4ff0bbf68b9fd74963d4 (127.0.107.193:37689)
I20260709 13:05:14.652940   431 webserver.cc:533] Webserver started at http://127.0.107.194:44611/ using document root <none> and password file <none>
I20260709 13:05:14.653668   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:14.654004   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:14.653985 11104 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40070
I20260709 13:05:14.654698   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:14.656361   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601979855482-431-0/minicluster-data/ts-1-root/instance:
uuid: "42e9e3e7c02e4e6b92d7c6956c01a275"
format_stamp: "Formatted at 2026-07-09 13:05:14 on dist-test-slave-g4pn"
I20260709 13:05:14.661635   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:05:14.665282 11243 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:14.666249   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:05:14.666718   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601979855482-431-0/minicluster-data/ts-1-root
uuid: "42e9e3e7c02e4e6b92d7c6956c01a275"
format_stamp: "Formatted at 2026-07-09 13:05:14 on dist-test-slave-g4pn"
I20260709 13:05:14.667032   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601979855482-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601979855482-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601979855482-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:14.685655   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:14.687137   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:14.688966   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:14.691623   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:14.691982   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:14.692322   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:14.692481   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:14.739899   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:37547
I20260709 13:05:14.740027 11305 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:37547 every 8 connection(s)
I20260709 13:05:14.744932   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:14.753679 11309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:14.756949 11310 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:14.760346 11312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:14.761108   431 server_base.cc:1061] running on GCE node
I20260709 13:05:14.762333   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:14.762526   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:14.762782   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602314762748 us; error 0 us; skew 500 ppm
I20260709 13:05:14.763044 11306 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37799
I20260709 13:05:14.763429   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:14.763526 11306 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:14.764707 11306 heartbeater.cc:507] Master 127.0.107.254:37799 requested a full tablet report, sending...
I20260709 13:05:14.766522   431 webserver.cc:533] Webserver started at http://127.0.107.195:33155/ using document root <none> and password file <none>
I20260709 13:05:14.767401 11104 ts_manager.cc:194] Registered new tserver with Master: 42e9e3e7c02e4e6b92d7c6956c01a275 (127.0.107.194:37547)
I20260709 13:05:14.767400   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:14.768055   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:14.768429   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:14.769430 11104 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40080
I20260709 13:05:14.769863   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601979855482-431-0/minicluster-data/ts-2-root/instance:
uuid: "5d06cb5f8cff404097ba5f1d3afd3268"
format_stamp: "Formatted at 2026-07-09 13:05:14 on dist-test-slave-g4pn"
I20260709 13:05:14.774783   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 13:05:14.779063 11317 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:14.780185   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:05:14.780658   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601979855482-431-0/minicluster-data/ts-2-root
uuid: "5d06cb5f8cff404097ba5f1d3afd3268"
format_stamp: "Formatted at 2026-07-09 13:05:14 on dist-test-slave-g4pn"
I20260709 13:05:14.781134   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601979855482-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601979855482-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601979855482-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:14.791858   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:14.793237   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:14.795565   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:14.799045   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:14.799288   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:14.799523   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:14.799665   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:14.850296   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:44257
I20260709 13:05:14.850489 11379 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:44257 every 8 connection(s)
I20260709 13:05:14.867241 11380 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37799
I20260709 13:05:14.867705 11380 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:14.868503 11380 heartbeater.cc:507] Master 127.0.107.254:37799 requested a full tablet report, sending...
I20260709 13:05:14.871192 11104 ts_manager.cc:194] Registered new tserver with Master: 5d06cb5f8cff404097ba5f1d3afd3268 (127.0.107.195:44257)
I20260709 13:05:14.871326   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017096308s
I20260709 13:05:14.873371 11104 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40096
I20260709 13:05:14.904531 11104 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40106:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:14.908562 11104 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:14.965358 11196 tablet_service.cc:1511] Processing CreateTablet for tablet 88ce3a9f14a74ec7a3dac22d6f957a88 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=47c1b4c322464e15abc06ce0c802f44f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:05:14.966924 11196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88ce3a9f14a74ec7a3dac22d6f957a88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:14.969341 11195 tablet_service.cc:1511] Processing CreateTablet for tablet b4eb781f8ed04b4791f2d8ee53061a15 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=47c1b4c322464e15abc06ce0c802f44f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:05:14.970307 11270 tablet_service.cc:1511] Processing CreateTablet for tablet b4eb781f8ed04b4791f2d8ee53061a15 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=47c1b4c322464e15abc06ce0c802f44f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:05:14.970885 11195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4eb781f8ed04b4791f2d8ee53061a15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:14.971717 11270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4eb781f8ed04b4791f2d8ee53061a15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:14.974383 11271 tablet_service.cc:1511] Processing CreateTablet for tablet 88ce3a9f14a74ec7a3dac22d6f957a88 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=47c1b4c322464e15abc06ce0c802f44f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:05:14.975281 11345 tablet_service.cc:1511] Processing CreateTablet for tablet 88ce3a9f14a74ec7a3dac22d6f957a88 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=47c1b4c322464e15abc06ce0c802f44f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:05:14.975811 11271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88ce3a9f14a74ec7a3dac22d6f957a88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:14.976754 11345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88ce3a9f14a74ec7a3dac22d6f957a88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:14.978797 11344 tablet_service.cc:1511] Processing CreateTablet for tablet b4eb781f8ed04b4791f2d8ee53061a15 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=47c1b4c322464e15abc06ce0c802f44f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:05:14.980161 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4eb781f8ed04b4791f2d8ee53061a15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:14.995165 11395 tablet_bootstrap.cc:492] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 817b494b9b5b4ff0bbf68b9fd74963d4: Bootstrap starting.
I20260709 13:05:15.004781 11395 tablet_bootstrap.cc:654] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 817b494b9b5b4ff0bbf68b9fd74963d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.018934 11396 tablet_bootstrap.cc:492] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 42e9e3e7c02e4e6b92d7c6956c01a275: Bootstrap starting.
I20260709 13:05:15.021755 11395 tablet_bootstrap.cc:492] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 817b494b9b5b4ff0bbf68b9fd74963d4: No bootstrap required, opened a new log
I20260709 13:05:15.022440 11395 ts_tablet_manager.cc:1403] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 817b494b9b5b4ff0bbf68b9fd74963d4: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.014s
I20260709 13:05:15.025807 11395 raft_consensus.cc:359] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:15.026510 11398 tablet_bootstrap.cc:492] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 5d06cb5f8cff404097ba5f1d3afd3268: Bootstrap starting.
I20260709 13:05:15.026674 11395 raft_consensus.cc:385] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:15.027400 11395 raft_consensus.cc:740] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 817b494b9b5b4ff0bbf68b9fd74963d4, State: Initialized, Role: FOLLOWER
I20260709 13:05:15.028239 11395 consensus_queue.cc:260] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 817b494b9b5b4ff0bbf68b9fd74963d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:15.029249 11396 tablet_bootstrap.cc:654] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 42e9e3e7c02e4e6b92d7c6956c01a275: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.031020 11231 heartbeater.cc:499] Master 127.0.107.254:37799 was elected leader, sending a full tablet report...
I20260709 13:05:15.031538 11395 ts_tablet_manager.cc:1434] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 817b494b9b5b4ff0bbf68b9fd74963d4: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:05:15.032547 11395 tablet_bootstrap.cc:492] T b4eb781f8ed04b4791f2d8ee53061a15 P 817b494b9b5b4ff0bbf68b9fd74963d4: Bootstrap starting.
I20260709 13:05:15.037433 11398 tablet_bootstrap.cc:654] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 5d06cb5f8cff404097ba5f1d3afd3268: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.039299 11395 tablet_bootstrap.cc:654] T b4eb781f8ed04b4791f2d8ee53061a15 P 817b494b9b5b4ff0bbf68b9fd74963d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.052966 11395 tablet_bootstrap.cc:492] T b4eb781f8ed04b4791f2d8ee53061a15 P 817b494b9b5b4ff0bbf68b9fd74963d4: No bootstrap required, opened a new log
I20260709 13:05:15.053125 11398 tablet_bootstrap.cc:492] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 5d06cb5f8cff404097ba5f1d3afd3268: No bootstrap required, opened a new log
I20260709 13:05:15.053675 11395 ts_tablet_manager.cc:1403] T b4eb781f8ed04b4791f2d8ee53061a15 P 817b494b9b5b4ff0bbf68b9fd74963d4: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.007s
I20260709 13:05:15.053767 11398 ts_tablet_manager.cc:1403] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 5d06cb5f8cff404097ba5f1d3afd3268: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.010s
I20260709 13:05:15.053745 11396 tablet_bootstrap.cc:492] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 42e9e3e7c02e4e6b92d7c6956c01a275: No bootstrap required, opened a new log
I20260709 13:05:15.055843 11396 ts_tablet_manager.cc:1403] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 42e9e3e7c02e4e6b92d7c6956c01a275: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.023s
I20260709 13:05:15.057749 11395 raft_consensus.cc:359] T b4eb781f8ed04b4791f2d8ee53061a15 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:15.057945 11398 raft_consensus.cc:359] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 5d06cb5f8cff404097ba5f1d3afd3268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:15.058352 11396 raft_consensus.cc:359] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:15.058749 11395 raft_consensus.cc:385] T b4eb781f8ed04b4791f2d8ee53061a15 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:15.058790 11398 raft_consensus.cc:385] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 5d06cb5f8cff404097ba5f1d3afd3268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:15.059103 11396 raft_consensus.cc:385] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:15.059288 11395 raft_consensus.cc:740] T b4eb781f8ed04b4791f2d8ee53061a15 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 817b494b9b5b4ff0bbf68b9fd74963d4, State: Initialized, Role: FOLLOWER
I20260709 13:05:15.059619 11396 raft_consensus.cc:740] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42e9e3e7c02e4e6b92d7c6956c01a275, State: Initialized, Role: FOLLOWER
I20260709 13:05:15.059350 11398 raft_consensus.cc:740] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 5d06cb5f8cff404097ba5f1d3afd3268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d06cb5f8cff404097ba5f1d3afd3268, State: Initialized, Role: FOLLOWER
I20260709 13:05:15.060566 11395 consensus_queue.cc:260] T b4eb781f8ed04b4791f2d8ee53061a15 P 817b494b9b5b4ff0bbf68b9fd74963d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:15.060633 11398 consensus_queue.cc:260] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 5d06cb5f8cff404097ba5f1d3afd3268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:15.062682 11395 ts_tablet_manager.cc:1434] T b4eb781f8ed04b4791f2d8ee53061a15 P 817b494b9b5b4ff0bbf68b9fd74963d4: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:05:15.063306 11380 heartbeater.cc:499] Master 127.0.107.254:37799 was elected leader, sending a full tablet report...
I20260709 13:05:15.060770 11396 consensus_queue.cc:260] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 42e9e3e7c02e4e6b92d7c6956c01a275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:15.064136 11398 ts_tablet_manager.cc:1434] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 5d06cb5f8cff404097ba5f1d3afd3268: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:05:15.065495 11398 tablet_bootstrap.cc:492] T b4eb781f8ed04b4791f2d8ee53061a15 P 5d06cb5f8cff404097ba5f1d3afd3268: Bootstrap starting.
I20260709 13:05:15.077850 11398 tablet_bootstrap.cc:654] T b4eb781f8ed04b4791f2d8ee53061a15 P 5d06cb5f8cff404097ba5f1d3afd3268: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.080588 11306 heartbeater.cc:499] Master 127.0.107.254:37799 was elected leader, sending a full tablet report...
I20260709 13:05:15.081349 11396 ts_tablet_manager.cc:1434] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 42e9e3e7c02e4e6b92d7c6956c01a275: Time spent starting tablet: real 0.025s	user 0.013s	sys 0.009s
I20260709 13:05:15.082604 11396 tablet_bootstrap.cc:492] T b4eb781f8ed04b4791f2d8ee53061a15 P 42e9e3e7c02e4e6b92d7c6956c01a275: Bootstrap starting.
I20260709 13:05:15.084169 11398 tablet_bootstrap.cc:492] T b4eb781f8ed04b4791f2d8ee53061a15 P 5d06cb5f8cff404097ba5f1d3afd3268: No bootstrap required, opened a new log
I20260709 13:05:15.084682 11398 ts_tablet_manager.cc:1403] T b4eb781f8ed04b4791f2d8ee53061a15 P 5d06cb5f8cff404097ba5f1d3afd3268: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.003s
I20260709 13:05:15.087103 11398 raft_consensus.cc:359] T b4eb781f8ed04b4791f2d8ee53061a15 P 5d06cb5f8cff404097ba5f1d3afd3268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:15.087713 11398 raft_consensus.cc:385] T b4eb781f8ed04b4791f2d8ee53061a15 P 5d06cb5f8cff404097ba5f1d3afd3268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:15.087976 11398 raft_consensus.cc:740] T b4eb781f8ed04b4791f2d8ee53061a15 P 5d06cb5f8cff404097ba5f1d3afd3268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d06cb5f8cff404097ba5f1d3afd3268, State: Initialized, Role: FOLLOWER
I20260709 13:05:15.088791 11398 consensus_queue.cc:260] T b4eb781f8ed04b4791f2d8ee53061a15 P 5d06cb5f8cff404097ba5f1d3afd3268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:15.089644 11396 tablet_bootstrap.cc:654] T b4eb781f8ed04b4791f2d8ee53061a15 P 42e9e3e7c02e4e6b92d7c6956c01a275: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.090996 11398 ts_tablet_manager.cc:1434] T b4eb781f8ed04b4791f2d8ee53061a15 P 5d06cb5f8cff404097ba5f1d3afd3268: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:05:15.096719 11396 tablet_bootstrap.cc:492] T b4eb781f8ed04b4791f2d8ee53061a15 P 42e9e3e7c02e4e6b92d7c6956c01a275: No bootstrap required, opened a new log
I20260709 13:05:15.097587 11396 ts_tablet_manager.cc:1403] T b4eb781f8ed04b4791f2d8ee53061a15 P 42e9e3e7c02e4e6b92d7c6956c01a275: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:05:15.100642 11396 raft_consensus.cc:359] T b4eb781f8ed04b4791f2d8ee53061a15 P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:15.101468 11396 raft_consensus.cc:385] T b4eb781f8ed04b4791f2d8ee53061a15 P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:15.101823 11396 raft_consensus.cc:740] T b4eb781f8ed04b4791f2d8ee53061a15 P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42e9e3e7c02e4e6b92d7c6956c01a275, State: Initialized, Role: FOLLOWER
I20260709 13:05:15.102528 11396 consensus_queue.cc:260] T b4eb781f8ed04b4791f2d8ee53061a15 P 42e9e3e7c02e4e6b92d7c6956c01a275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:15.104423 11396 ts_tablet_manager.cc:1434] T b4eb781f8ed04b4791f2d8ee53061a15 P 42e9e3e7c02e4e6b92d7c6956c01a275: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:05:15.157459 11399 raft_consensus.cc:493] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.158238 11399 raft_consensus.cc:515] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:15.160199 11399 leader_election.cc:290] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 817b494b9b5b4ff0bbf68b9fd74963d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42e9e3e7c02e4e6b92d7c6956c01a275 (127.0.107.194:37547), 5d06cb5f8cff404097ba5f1d3afd3268 (127.0.107.195:44257)
I20260709 13:05:15.172698 11281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ce3a9f14a74ec7a3dac22d6f957a88" candidate_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" is_pre_election: true
I20260709 13:05:15.173516 11281 raft_consensus.cc:2468] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 817b494b9b5b4ff0bbf68b9fd74963d4 in term 0.
I20260709 13:05:15.174671 11171 leader_election.cc:304] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 817b494b9b5b4ff0bbf68b9fd74963d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42e9e3e7c02e4e6b92d7c6956c01a275, 817b494b9b5b4ff0bbf68b9fd74963d4; no voters: 
I20260709 13:05:15.174767 11355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ce3a9f14a74ec7a3dac22d6f957a88" candidate_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" is_pre_election: true
I20260709 13:05:15.175505 11399 raft_consensus.cc:2804] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:15.175523 11355 raft_consensus.cc:2468] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 5d06cb5f8cff404097ba5f1d3afd3268 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 817b494b9b5b4ff0bbf68b9fd74963d4 in term 0.
I20260709 13:05:15.176043 11399 raft_consensus.cc:493] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:15.176412 11399 raft_consensus.cc:3060] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.183329 11399 raft_consensus.cc:515] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:15.185022 11399 leader_election.cc:290] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 817b494b9b5b4ff0bbf68b9fd74963d4 [CANDIDATE]: Term 1 election: Requested vote from peers 42e9e3e7c02e4e6b92d7c6956c01a275 (127.0.107.194:37547), 5d06cb5f8cff404097ba5f1d3afd3268 (127.0.107.195:44257)
I20260709 13:05:15.186210 11281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ce3a9f14a74ec7a3dac22d6f957a88" candidate_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275"
I20260709 13:05:15.186878 11355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ce3a9f14a74ec7a3dac22d6f957a88" candidate_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d06cb5f8cff404097ba5f1d3afd3268"
I20260709 13:05:15.187000 11281 raft_consensus.cc:3060] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.187491 11355 raft_consensus.cc:3060] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 5d06cb5f8cff404097ba5f1d3afd3268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.195685 11355 raft_consensus.cc:2468] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 5d06cb5f8cff404097ba5f1d3afd3268 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 817b494b9b5b4ff0bbf68b9fd74963d4 in term 1.
I20260709 13:05:15.196254 11281 raft_consensus.cc:2468] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 817b494b9b5b4ff0bbf68b9fd74963d4 in term 1.
I20260709 13:05:15.197438 11171 leader_election.cc:304] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 817b494b9b5b4ff0bbf68b9fd74963d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d06cb5f8cff404097ba5f1d3afd3268, 817b494b9b5b4ff0bbf68b9fd74963d4; no voters: 
I20260709 13:05:15.198328 11399 raft_consensus.cc:2804] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:15.199362 11399 raft_consensus.cc:697] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 1 LEADER]: Becoming Leader. State: Replica: 817b494b9b5b4ff0bbf68b9fd74963d4, State: Running, Role: LEADER
I20260709 13:05:15.200237 11399 consensus_queue.cc:237] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 817b494b9b5b4ff0bbf68b9fd74963d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:15.209227 11102 catalog_manager.cc:5697] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 817b494b9b5b4ff0bbf68b9fd74963d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 817b494b9b5b4ff0bbf68b9fd74963d4 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:15.231460 11399 raft_consensus.cc:493] T b4eb781f8ed04b4791f2d8ee53061a15 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.232537 11399 raft_consensus.cc:515] T b4eb781f8ed04b4791f2d8ee53061a15 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:15.234766 11399 leader_election.cc:290] T b4eb781f8ed04b4791f2d8ee53061a15 P 817b494b9b5b4ff0bbf68b9fd74963d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42e9e3e7c02e4e6b92d7c6956c01a275 (127.0.107.194:37547), 5d06cb5f8cff404097ba5f1d3afd3268 (127.0.107.195:44257)
I20260709 13:05:15.236501 11281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4eb781f8ed04b4791f2d8ee53061a15" candidate_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" is_pre_election: true
I20260709 13:05:15.236914 11355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4eb781f8ed04b4791f2d8ee53061a15" candidate_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" is_pre_election: true
I20260709 13:05:15.237311 11281 raft_consensus.cc:2468] T b4eb781f8ed04b4791f2d8ee53061a15 P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 817b494b9b5b4ff0bbf68b9fd74963d4 in term 0.
I20260709 13:05:15.237627 11355 raft_consensus.cc:2468] T b4eb781f8ed04b4791f2d8ee53061a15 P 5d06cb5f8cff404097ba5f1d3afd3268 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 817b494b9b5b4ff0bbf68b9fd74963d4 in term 0.
I20260709 13:05:15.238770 11171 leader_election.cc:304] T b4eb781f8ed04b4791f2d8ee53061a15 P 817b494b9b5b4ff0bbf68b9fd74963d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42e9e3e7c02e4e6b92d7c6956c01a275, 817b494b9b5b4ff0bbf68b9fd74963d4; no voters: 
I20260709 13:05:15.239563 11399 raft_consensus.cc:2804] T b4eb781f8ed04b4791f2d8ee53061a15 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:15.239956 11399 raft_consensus.cc:493] T b4eb781f8ed04b4791f2d8ee53061a15 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:15.240288 11399 raft_consensus.cc:3060] T b4eb781f8ed04b4791f2d8ee53061a15 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.246497 11399 raft_consensus.cc:515] T b4eb781f8ed04b4791f2d8ee53061a15 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:15.248615 11399 leader_election.cc:290] T b4eb781f8ed04b4791f2d8ee53061a15 P 817b494b9b5b4ff0bbf68b9fd74963d4 [CANDIDATE]: Term 1 election: Requested vote from peers 42e9e3e7c02e4e6b92d7c6956c01a275 (127.0.107.194:37547), 5d06cb5f8cff404097ba5f1d3afd3268 (127.0.107.195:44257)
I20260709 13:05:15.249846 11281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4eb781f8ed04b4791f2d8ee53061a15" candidate_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275"
I20260709 13:05:15.250574 11281 raft_consensus.cc:3060] T b4eb781f8ed04b4791f2d8ee53061a15 P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.250509 11355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4eb781f8ed04b4791f2d8ee53061a15" candidate_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d06cb5f8cff404097ba5f1d3afd3268"
I20260709 13:05:15.251650 11355 raft_consensus.cc:3060] T b4eb781f8ed04b4791f2d8ee53061a15 P 5d06cb5f8cff404097ba5f1d3afd3268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.259943 11355 raft_consensus.cc:2468] T b4eb781f8ed04b4791f2d8ee53061a15 P 5d06cb5f8cff404097ba5f1d3afd3268 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 817b494b9b5b4ff0bbf68b9fd74963d4 in term 1.
I20260709 13:05:15.259943 11281 raft_consensus.cc:2468] T b4eb781f8ed04b4791f2d8ee53061a15 P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 817b494b9b5b4ff0bbf68b9fd74963d4 in term 1.
I20260709 13:05:15.261870 11171 leader_election.cc:304] T b4eb781f8ed04b4791f2d8ee53061a15 P 817b494b9b5b4ff0bbf68b9fd74963d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42e9e3e7c02e4e6b92d7c6956c01a275, 817b494b9b5b4ff0bbf68b9fd74963d4; no voters: 
I20260709 13:05:15.262578 11399 raft_consensus.cc:2804] T b4eb781f8ed04b4791f2d8ee53061a15 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:15.263121 11399 raft_consensus.cc:697] T b4eb781f8ed04b4791f2d8ee53061a15 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 1 LEADER]: Becoming Leader. State: Replica: 817b494b9b5b4ff0bbf68b9fd74963d4, State: Running, Role: LEADER
I20260709 13:05:15.263953 11399 consensus_queue.cc:237] T b4eb781f8ed04b4791f2d8ee53061a15 P 817b494b9b5b4ff0bbf68b9fd74963d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:15.272495 11102 catalog_manager.cc:5697] T b4eb781f8ed04b4791f2d8ee53061a15 P 817b494b9b5b4ff0bbf68b9fd74963d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 817b494b9b5b4ff0bbf68b9fd74963d4 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:15.332111 11102 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40112:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:15.334223 11102 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:15.360721 11196 tablet_service.cc:1511] Processing CreateTablet for tablet 4a43efc8ea4e4508ae8dee40a7e7fafa (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=aabd9cf31e8645b7b08386d34947d73c]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:05:15.362293 11196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a43efc8ea4e4508ae8dee40a7e7fafa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:15.362277 11271 tablet_service.cc:1511] Processing CreateTablet for tablet 4a43efc8ea4e4508ae8dee40a7e7fafa (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=aabd9cf31e8645b7b08386d34947d73c]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:05:15.364439 11271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a43efc8ea4e4508ae8dee40a7e7fafa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:15.366976 11195 tablet_service.cc:1511] Processing CreateTablet for tablet 7d53f56723e142cdb675579480449047 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=aabd9cf31e8645b7b08386d34947d73c]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:05:15.368748 11195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d53f56723e142cdb675579480449047. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:15.364429 11345 tablet_service.cc:1511] Processing CreateTablet for tablet 4a43efc8ea4e4508ae8dee40a7e7fafa (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=aabd9cf31e8645b7b08386d34947d73c]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:05:15.375469 11270 tablet_service.cc:1511] Processing CreateTablet for tablet 7d53f56723e142cdb675579480449047 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=aabd9cf31e8645b7b08386d34947d73c]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:05:15.376096 11345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a43efc8ea4e4508ae8dee40a7e7fafa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:15.376724 11270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d53f56723e142cdb675579480449047. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:15.378751 11152 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:15.381319 11344 tablet_service.cc:1511] Processing CreateTablet for tablet 7d53f56723e142cdb675579480449047 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=aabd9cf31e8645b7b08386d34947d73c]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:05:15.382762 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d53f56723e142cdb675579480449047. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:15.388993 11395 tablet_bootstrap.cc:492] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 817b494b9b5b4ff0bbf68b9fd74963d4: Bootstrap starting.
I20260709 13:05:15.389587 11396 tablet_bootstrap.cc:492] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 42e9e3e7c02e4e6b92d7c6956c01a275: Bootstrap starting.
I20260709 13:05:15.397521 11395 tablet_bootstrap.cc:654] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 817b494b9b5b4ff0bbf68b9fd74963d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.400444 11398 tablet_bootstrap.cc:492] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268: Bootstrap starting.
I20260709 13:05:15.400545 11396 tablet_bootstrap.cc:654] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 42e9e3e7c02e4e6b92d7c6956c01a275: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.407665 11398 tablet_bootstrap.cc:654] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.416124 11396 tablet_bootstrap.cc:492] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 42e9e3e7c02e4e6b92d7c6956c01a275: No bootstrap required, opened a new log
I20260709 13:05:15.416869 11396 ts_tablet_manager.cc:1403] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 42e9e3e7c02e4e6b92d7c6956c01a275: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.006s
I20260709 13:05:15.418133 11398 tablet_bootstrap.cc:492] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268: No bootstrap required, opened a new log
I20260709 13:05:15.423465 11398 ts_tablet_manager.cc:1403] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.009s
I20260709 13:05:15.420506 11396 raft_consensus.cc:359] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:15.424604 11396 raft_consensus.cc:385] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:15.425026 11396 raft_consensus.cc:740] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42e9e3e7c02e4e6b92d7c6956c01a275, State: Initialized, Role: FOLLOWER
I20260709 13:05:15.426033 11396 consensus_queue.cc:260] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 42e9e3e7c02e4e6b92d7c6956c01a275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:15.430148 11395 tablet_bootstrap.cc:492] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 817b494b9b5b4ff0bbf68b9fd74963d4: No bootstrap required, opened a new log
I20260709 13:05:15.431104 11396 ts_tablet_manager.cc:1434] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 42e9e3e7c02e4e6b92d7c6956c01a275: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:05:15.431509 11395 ts_tablet_manager.cc:1403] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 817b494b9b5b4ff0bbf68b9fd74963d4: Time spent bootstrapping tablet: real 0.043s	user 0.017s	sys 0.010s
I20260709 13:05:15.426687 11398 raft_consensus.cc:359] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:15.432268 11396 tablet_bootstrap.cc:492] T 7d53f56723e142cdb675579480449047 P 42e9e3e7c02e4e6b92d7c6956c01a275: Bootstrap starting.
I20260709 13:05:15.432535 11398 raft_consensus.cc:385] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:15.432922 11398 raft_consensus.cc:740] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d06cb5f8cff404097ba5f1d3afd3268, State: Initialized, Role: FOLLOWER
I20260709 13:05:15.433840 11398 consensus_queue.cc:260] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:15.434664 11395 raft_consensus.cc:359] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:15.435422 11395 raft_consensus.cc:385] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:15.435698 11395 raft_consensus.cc:740] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 817b494b9b5b4ff0bbf68b9fd74963d4, State: Initialized, Role: FOLLOWER
I20260709 13:05:15.436436 11398 ts_tablet_manager.cc:1434] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:05:15.436589 11395 consensus_queue.cc:260] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 817b494b9b5b4ff0bbf68b9fd74963d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:15.437613 11398 tablet_bootstrap.cc:492] T 7d53f56723e142cdb675579480449047 P 5d06cb5f8cff404097ba5f1d3afd3268: Bootstrap starting.
I20260709 13:05:15.438930 11395 ts_tablet_manager.cc:1434] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 817b494b9b5b4ff0bbf68b9fd74963d4: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:15.440038 11395 tablet_bootstrap.cc:492] T 7d53f56723e142cdb675579480449047 P 817b494b9b5b4ff0bbf68b9fd74963d4: Bootstrap starting.
I20260709 13:05:15.444273 11396 tablet_bootstrap.cc:654] T 7d53f56723e142cdb675579480449047 P 42e9e3e7c02e4e6b92d7c6956c01a275: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.449306 11398 tablet_bootstrap.cc:654] T 7d53f56723e142cdb675579480449047 P 5d06cb5f8cff404097ba5f1d3afd3268: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.451647 11395 tablet_bootstrap.cc:654] T 7d53f56723e142cdb675579480449047 P 817b494b9b5b4ff0bbf68b9fd74963d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.458403 11403 raft_consensus.cc:493] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.459386 11403 raft_consensus.cc:515] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:15.463491 11403 leader_election.cc:290] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 817b494b9b5b4ff0bbf68b9fd74963d4 (127.0.107.193:37689), 42e9e3e7c02e4e6b92d7c6956c01a275 (127.0.107.194:37547)
I20260709 13:05:15.464592 11395 tablet_bootstrap.cc:492] T 7d53f56723e142cdb675579480449047 P 817b494b9b5b4ff0bbf68b9fd74963d4: No bootstrap required, opened a new log
I20260709 13:05:15.465705 11395 ts_tablet_manager.cc:1403] T 7d53f56723e142cdb675579480449047 P 817b494b9b5b4ff0bbf68b9fd74963d4: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.013s
I20260709 13:05:15.467756 11398 tablet_bootstrap.cc:492] T 7d53f56723e142cdb675579480449047 P 5d06cb5f8cff404097ba5f1d3afd3268: No bootstrap required, opened a new log
I20260709 13:05:15.468613 11398 ts_tablet_manager.cc:1403] T 7d53f56723e142cdb675579480449047 P 5d06cb5f8cff404097ba5f1d3afd3268: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.008s
I20260709 13:05:15.470834 11395 raft_consensus.cc:359] T 7d53f56723e142cdb675579480449047 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:15.471918 11395 raft_consensus.cc:385] T 7d53f56723e142cdb675579480449047 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:15.472292 11395 raft_consensus.cc:740] T 7d53f56723e142cdb675579480449047 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 817b494b9b5b4ff0bbf68b9fd74963d4, State: Initialized, Role: FOLLOWER
I20260709 13:05:15.473486 11395 consensus_queue.cc:260] T 7d53f56723e142cdb675579480449047 P 817b494b9b5b4ff0bbf68b9fd74963d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:15.474166 11398 raft_consensus.cc:359] T 7d53f56723e142cdb675579480449047 P 5d06cb5f8cff404097ba5f1d3afd3268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:15.475021 11398 raft_consensus.cc:385] T 7d53f56723e142cdb675579480449047 P 5d06cb5f8cff404097ba5f1d3afd3268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:15.475353 11398 raft_consensus.cc:740] T 7d53f56723e142cdb675579480449047 P 5d06cb5f8cff404097ba5f1d3afd3268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d06cb5f8cff404097ba5f1d3afd3268, State: Initialized, Role: FOLLOWER
I20260709 13:05:15.476621 11398 consensus_queue.cc:260] T 7d53f56723e142cdb675579480449047 P 5d06cb5f8cff404097ba5f1d3afd3268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:15.477267 11395 ts_tablet_manager.cc:1434] T 7d53f56723e142cdb675579480449047 P 817b494b9b5b4ff0bbf68b9fd74963d4: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:05:15.479574 11398 ts_tablet_manager.cc:1434] T 7d53f56723e142cdb675579480449047 P 5d06cb5f8cff404097ba5f1d3afd3268: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 13:05:15.494253 11396 tablet_bootstrap.cc:492] T 7d53f56723e142cdb675579480449047 P 42e9e3e7c02e4e6b92d7c6956c01a275: No bootstrap required, opened a new log
I20260709 13:05:15.494956 11396 ts_tablet_manager.cc:1403] T 7d53f56723e142cdb675579480449047 P 42e9e3e7c02e4e6b92d7c6956c01a275: Time spent bootstrapping tablet: real 0.063s	user 0.025s	sys 0.015s
I20260709 13:05:15.498457 11396 raft_consensus.cc:359] T 7d53f56723e142cdb675579480449047 P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:15.499485 11396 raft_consensus.cc:385] T 7d53f56723e142cdb675579480449047 P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:15.499914 11396 raft_consensus.cc:740] T 7d53f56723e142cdb675579480449047 P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42e9e3e7c02e4e6b92d7c6956c01a275, State: Initialized, Role: FOLLOWER
I20260709 13:05:15.502342 11281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a43efc8ea4e4508ae8dee40a7e7fafa" candidate_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" is_pre_election: true
I20260709 13:05:15.503134 11281 raft_consensus.cc:2468] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d06cb5f8cff404097ba5f1d3afd3268 in term 0.
I20260709 13:05:15.501344 11396 consensus_queue.cc:260] T 7d53f56723e142cdb675579480449047 P 42e9e3e7c02e4e6b92d7c6956c01a275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:15.505017 11320 leader_election.cc:304] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42e9e3e7c02e4e6b92d7c6956c01a275, 5d06cb5f8cff404097ba5f1d3afd3268; no voters: 
I20260709 13:05:15.505722 11206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a43efc8ea4e4508ae8dee40a7e7fafa" candidate_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" is_pre_election: true
I20260709 13:05:15.506278 11403 raft_consensus.cc:2804] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:15.506497 11206 raft_consensus.cc:2468] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d06cb5f8cff404097ba5f1d3afd3268 in term 0.
I20260709 13:05:15.507026 11403 raft_consensus.cc:493] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:15.507507 11396 ts_tablet_manager.cc:1434] T 7d53f56723e142cdb675579480449047 P 42e9e3e7c02e4e6b92d7c6956c01a275: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 13:05:15.507468 11403 raft_consensus.cc:3060] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.520112 11403 raft_consensus.cc:515] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:15.522927 11403 leader_election.cc:290] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268 [CANDIDATE]: Term 1 election: Requested vote from peers 817b494b9b5b4ff0bbf68b9fd74963d4 (127.0.107.193:37689), 42e9e3e7c02e4e6b92d7c6956c01a275 (127.0.107.194:37547)
I20260709 13:05:15.524103 11206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a43efc8ea4e4508ae8dee40a7e7fafa" candidate_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4"
I20260709 13:05:15.524103 11281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a43efc8ea4e4508ae8dee40a7e7fafa" candidate_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275"
I20260709 13:05:15.525425 11281 raft_consensus.cc:3060] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.525435 11206 raft_consensus.cc:3060] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.535930 11281 raft_consensus.cc:2468] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d06cb5f8cff404097ba5f1d3afd3268 in term 1.
I20260709 13:05:15.536037 11206 raft_consensus.cc:2468] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d06cb5f8cff404097ba5f1d3afd3268 in term 1.
I20260709 13:05:15.537456 11320 leader_election.cc:304] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42e9e3e7c02e4e6b92d7c6956c01a275, 5d06cb5f8cff404097ba5f1d3afd3268; no voters: 
I20260709 13:05:15.538615 11403 raft_consensus.cc:2804] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:15.539636 11403 raft_consensus.cc:697] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268 [term 1 LEADER]: Becoming Leader. State: Replica: 5d06cb5f8cff404097ba5f1d3afd3268, State: Running, Role: LEADER
I20260709 13:05:15.541145 11403 consensus_queue.cc:237] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:15.551715 11102 catalog_manager.cc:5697] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d06cb5f8cff404097ba5f1d3afd3268 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:15.610852 11399 consensus_queue.cc:1048] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 817b494b9b5b4ff0bbf68b9fd74963d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:15.625582 11399 consensus_queue.cc:1048] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 817b494b9b5b4ff0bbf68b9fd74963d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:15.659951 11403 raft_consensus.cc:493] T 7d53f56723e142cdb675579480449047 P 5d06cb5f8cff404097ba5f1d3afd3268 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.660753 11403 raft_consensus.cc:515] T 7d53f56723e142cdb675579480449047 P 5d06cb5f8cff404097ba5f1d3afd3268 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:15.663074 11403 leader_election.cc:290] T 7d53f56723e142cdb675579480449047 P 5d06cb5f8cff404097ba5f1d3afd3268 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 817b494b9b5b4ff0bbf68b9fd74963d4 (127.0.107.193:37689), 42e9e3e7c02e4e6b92d7c6956c01a275 (127.0.107.194:37547)
I20260709 13:05:15.663795 11206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d53f56723e142cdb675579480449047" candidate_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" is_pre_election: true
I20260709 13:05:15.664136 11281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d53f56723e142cdb675579480449047" candidate_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" is_pre_election: true
I20260709 13:05:15.664700 11206 raft_consensus.cc:2468] T 7d53f56723e142cdb675579480449047 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d06cb5f8cff404097ba5f1d3afd3268 in term 0.
I20260709 13:05:15.664952 11281 raft_consensus.cc:2468] T 7d53f56723e142cdb675579480449047 P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d06cb5f8cff404097ba5f1d3afd3268 in term 0.
I20260709 13:05:15.666006 11320 leader_election.cc:304] T 7d53f56723e142cdb675579480449047 P 5d06cb5f8cff404097ba5f1d3afd3268 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d06cb5f8cff404097ba5f1d3afd3268, 817b494b9b5b4ff0bbf68b9fd74963d4; no voters: 
I20260709 13:05:15.666651 11403 raft_consensus.cc:2804] T 7d53f56723e142cdb675579480449047 P 5d06cb5f8cff404097ba5f1d3afd3268 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:15.666987 11403 raft_consensus.cc:493] T 7d53f56723e142cdb675579480449047 P 5d06cb5f8cff404097ba5f1d3afd3268 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:15.667259 11403 raft_consensus.cc:3060] T 7d53f56723e142cdb675579480449047 P 5d06cb5f8cff404097ba5f1d3afd3268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.673708 11403 raft_consensus.cc:515] T 7d53f56723e142cdb675579480449047 P 5d06cb5f8cff404097ba5f1d3afd3268 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:15.675570 11403 leader_election.cc:290] T 7d53f56723e142cdb675579480449047 P 5d06cb5f8cff404097ba5f1d3afd3268 [CANDIDATE]: Term 1 election: Requested vote from peers 817b494b9b5b4ff0bbf68b9fd74963d4 (127.0.107.193:37689), 42e9e3e7c02e4e6b92d7c6956c01a275 (127.0.107.194:37547)
I20260709 13:05:15.676420 11206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d53f56723e142cdb675579480449047" candidate_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4"
I20260709 13:05:15.676725 11281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d53f56723e142cdb675579480449047" candidate_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275"
I20260709 13:05:15.676983 11206 raft_consensus.cc:3060] T 7d53f56723e142cdb675579480449047 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.677399 11281 raft_consensus.cc:3060] T 7d53f56723e142cdb675579480449047 P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.683564 11281 raft_consensus.cc:2468] T 7d53f56723e142cdb675579480449047 P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d06cb5f8cff404097ba5f1d3afd3268 in term 1.
I20260709 13:05:15.684742 11320 leader_election.cc:304] T 7d53f56723e142cdb675579480449047 P 5d06cb5f8cff404097ba5f1d3afd3268 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42e9e3e7c02e4e6b92d7c6956c01a275, 5d06cb5f8cff404097ba5f1d3afd3268; no voters: 
I20260709 13:05:15.685197 11206 raft_consensus.cc:2468] T 7d53f56723e142cdb675579480449047 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d06cb5f8cff404097ba5f1d3afd3268 in term 1.
I20260709 13:05:15.685973 11403 raft_consensus.cc:2804] T 7d53f56723e142cdb675579480449047 P 5d06cb5f8cff404097ba5f1d3afd3268 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:15.686478 11403 raft_consensus.cc:697] T 7d53f56723e142cdb675579480449047 P 5d06cb5f8cff404097ba5f1d3afd3268 [term 1 LEADER]: Becoming Leader. State: Replica: 5d06cb5f8cff404097ba5f1d3afd3268, State: Running, Role: LEADER
I20260709 13:05:15.687575 11403 consensus_queue.cc:237] T 7d53f56723e142cdb675579480449047 P 5d06cb5f8cff404097ba5f1d3afd3268 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:15.696071 11102 catalog_manager.cc:5697] T 7d53f56723e142cdb675579480449047 P 5d06cb5f8cff404097ba5f1d3afd3268 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d06cb5f8cff404097ba5f1d3afd3268 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:15.743126 11206 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4eb781f8ed04b4791f2d8ee53061a15"
dest_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4"
mode: GRACEFUL
new_leader_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275"
 from {username='slave'} at 127.0.0.1:55348
I20260709 13:05:15.743729 11206 raft_consensus.cc:606] T b4eb781f8ed04b4791f2d8ee53061a15 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 1 LEADER]: Received request to transfer leadership to TS 42e9e3e7c02e4e6b92d7c6956c01a275
I20260709 13:05:15.746855 11430 consensus_queue.cc:1048] T b4eb781f8ed04b4791f2d8ee53061a15 P 817b494b9b5b4ff0bbf68b9fd74963d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:15.749719 11430 consensus_queue.cc:1048] T b4eb781f8ed04b4791f2d8ee53061a15 P 817b494b9b5b4ff0bbf68b9fd74963d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:15.762902 11430 raft_consensus.cc:993] T b4eb781f8ed04b4791f2d8ee53061a15 P 817b494b9b5b4ff0bbf68b9fd74963d4: : Instructing follower 42e9e3e7c02e4e6b92d7c6956c01a275 to start an election
I20260709 13:05:15.763640 11399 raft_consensus.cc:1081] T b4eb781f8ed04b4791f2d8ee53061a15 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 1 LEADER]: Signalling peer 42e9e3e7c02e4e6b92d7c6956c01a275 to start an election
I20260709 13:05:15.767691 11281 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4eb781f8ed04b4791f2d8ee53061a15"
dest_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275"
 from {username='slave'} at 127.0.0.1:57720
I20260709 13:05:15.768425 11281 raft_consensus.cc:493] T b4eb781f8ed04b4791f2d8ee53061a15 P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:15.768884 11281 raft_consensus.cc:3060] T b4eb781f8ed04b4791f2d8ee53061a15 P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:15.770886 11354 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a43efc8ea4e4508ae8dee40a7e7fafa"
dest_uuid: "5d06cb5f8cff404097ba5f1d3afd3268"
mode: GRACEFUL
new_leader_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4"
 from {username='slave'} at 127.0.0.1:55076
I20260709 13:05:15.771610 11354 raft_consensus.cc:606] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268 [term 1 LEADER]: Received request to transfer leadership to TS 817b494b9b5b4ff0bbf68b9fd74963d4
I20260709 13:05:15.781185 11354 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d53f56723e142cdb675579480449047"
dest_uuid: "5d06cb5f8cff404097ba5f1d3afd3268"
mode: GRACEFUL
new_leader_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4"
 from {username='slave'} at 127.0.0.1:55076
I20260709 13:05:15.781966 11354 raft_consensus.cc:606] T 7d53f56723e142cdb675579480449047 P 5d06cb5f8cff404097ba5f1d3afd3268 [term 1 LEADER]: Received request to transfer leadership to TS 817b494b9b5b4ff0bbf68b9fd74963d4
I20260709 13:05:15.782505 11281 raft_consensus.cc:515] T b4eb781f8ed04b4791f2d8ee53061a15 P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:15.786310 11281 leader_election.cc:290] T b4eb781f8ed04b4791f2d8ee53061a15 P 42e9e3e7c02e4e6b92d7c6956c01a275 [CANDIDATE]: Term 2 election: Requested vote from peers 817b494b9b5b4ff0bbf68b9fd74963d4 (127.0.107.193:37689), 5d06cb5f8cff404097ba5f1d3afd3268 (127.0.107.195:44257)
I20260709 13:05:15.806468 11206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4eb781f8ed04b4791f2d8ee53061a15" candidate_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4"
I20260709 13:05:15.807487 11206 raft_consensus.cc:3055] T b4eb781f8ed04b4791f2d8ee53061a15 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:15.808015 11206 raft_consensus.cc:740] T b4eb781f8ed04b4791f2d8ee53061a15 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 817b494b9b5b4ff0bbf68b9fd74963d4, State: Running, Role: LEADER
I20260709 13:05:15.809177 11206 consensus_queue.cc:260] T b4eb781f8ed04b4791f2d8ee53061a15 P 817b494b9b5b4ff0bbf68b9fd74963d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:15.810660 11206 raft_consensus.cc:3060] T b4eb781f8ed04b4791f2d8ee53061a15 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:15.810855 11354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4eb781f8ed04b4791f2d8ee53061a15" candidate_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d06cb5f8cff404097ba5f1d3afd3268"
I20260709 13:05:15.811641 11354 raft_consensus.cc:3060] T b4eb781f8ed04b4791f2d8ee53061a15 P 5d06cb5f8cff404097ba5f1d3afd3268 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:15.818866 11206 raft_consensus.cc:2468] T b4eb781f8ed04b4791f2d8ee53061a15 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42e9e3e7c02e4e6b92d7c6956c01a275 in term 2.
I20260709 13:05:15.820622 11354 raft_consensus.cc:2468] T b4eb781f8ed04b4791f2d8ee53061a15 P 5d06cb5f8cff404097ba5f1d3afd3268 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42e9e3e7c02e4e6b92d7c6956c01a275 in term 2.
I20260709 13:05:15.820910 11246 leader_election.cc:304] T b4eb781f8ed04b4791f2d8ee53061a15 P 42e9e3e7c02e4e6b92d7c6956c01a275 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42e9e3e7c02e4e6b92d7c6956c01a275, 817b494b9b5b4ff0bbf68b9fd74963d4; no voters: 
I20260709 13:05:15.822314 11404 raft_consensus.cc:2804] T b4eb781f8ed04b4791f2d8ee53061a15 P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:15.823503 11404 raft_consensus.cc:697] T b4eb781f8ed04b4791f2d8ee53061a15 P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 2 LEADER]: Becoming Leader. State: Replica: 42e9e3e7c02e4e6b92d7c6956c01a275, State: Running, Role: LEADER
I20260709 13:05:15.824345 11404 consensus_queue.cc:237] T b4eb781f8ed04b4791f2d8ee53061a15 P 42e9e3e7c02e4e6b92d7c6956c01a275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:15.833832 11104 catalog_manager.cc:5697] T b4eb781f8ed04b4791f2d8ee53061a15 P 42e9e3e7c02e4e6b92d7c6956c01a275 reported cstate change: term changed from 1 to 2, leader changed from 817b494b9b5b4ff0bbf68b9fd74963d4 (127.0.107.193) to 42e9e3e7c02e4e6b92d7c6956c01a275 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:16.012504 11403 consensus_queue.cc:1048] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:16.025897 11403 consensus_queue.cc:1048] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268 [LEADER]: Connected to new peer: Peer: permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:16.040803 11444 raft_consensus.cc:993] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268: : Instructing follower 817b494b9b5b4ff0bbf68b9fd74963d4 to start an election
I20260709 13:05:16.041407 11403 raft_consensus.cc:1081] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268 [term 1 LEADER]: Signalling peer 817b494b9b5b4ff0bbf68b9fd74963d4 to start an election
I20260709 13:05:16.043390 11206 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a43efc8ea4e4508ae8dee40a7e7fafa"
dest_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4"
 from {username='slave'} at 127.0.0.1:55344
I20260709 13:05:16.044314 11206 raft_consensus.cc:493] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:16.045058 11206 raft_consensus.cc:3060] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:16.055910 11206 raft_consensus.cc:515] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:16.057900 11206 leader_election.cc:290] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 817b494b9b5b4ff0bbf68b9fd74963d4 [CANDIDATE]: Term 2 election: Requested vote from peers 42e9e3e7c02e4e6b92d7c6956c01a275 (127.0.107.194:37547), 5d06cb5f8cff404097ba5f1d3afd3268 (127.0.107.195:44257)
I20260709 13:05:16.058858 11281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a43efc8ea4e4508ae8dee40a7e7fafa" candidate_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275"
I20260709 13:05:16.059453 11281 raft_consensus.cc:3060] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:16.059146 11354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a43efc8ea4e4508ae8dee40a7e7fafa" candidate_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d06cb5f8cff404097ba5f1d3afd3268"
I20260709 13:05:16.060684 11354 raft_consensus.cc:3055] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:16.061340 11354 raft_consensus.cc:740] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d06cb5f8cff404097ba5f1d3afd3268, State: Running, Role: LEADER
I20260709 13:05:16.062278 11354 consensus_queue.cc:260] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:16.063388 11354 raft_consensus.cc:3060] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:16.068431 11281 raft_consensus.cc:2468] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 817b494b9b5b4ff0bbf68b9fd74963d4 in term 2.
I20260709 13:05:16.070117 11171 leader_election.cc:304] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 817b494b9b5b4ff0bbf68b9fd74963d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42e9e3e7c02e4e6b92d7c6956c01a275, 817b494b9b5b4ff0bbf68b9fd74963d4; no voters: 
I20260709 13:05:16.070914 11399 raft_consensus.cc:2804] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:16.071405 11399 raft_consensus.cc:697] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 2 LEADER]: Becoming Leader. State: Replica: 817b494b9b5b4ff0bbf68b9fd74963d4, State: Running, Role: LEADER
I20260709 13:05:16.072072 11354 raft_consensus.cc:2468] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 817b494b9b5b4ff0bbf68b9fd74963d4 in term 2.
I20260709 13:05:16.072279 11399 consensus_queue.cc:237] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 817b494b9b5b4ff0bbf68b9fd74963d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:16.079363 11104 catalog_manager.cc:5697] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 817b494b9b5b4ff0bbf68b9fd74963d4 reported cstate change: term changed from 1 to 2, leader changed from 5d06cb5f8cff404097ba5f1d3afd3268 (127.0.107.195) to 817b494b9b5b4ff0bbf68b9fd74963d4 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:16.135215 11403 consensus_queue.cc:1048] T 7d53f56723e142cdb675579480449047 P 5d06cb5f8cff404097ba5f1d3afd3268 [LEADER]: Connected to new peer: Peer: permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:16.143797 11444 raft_consensus.cc:993] T 7d53f56723e142cdb675579480449047 P 5d06cb5f8cff404097ba5f1d3afd3268: : Instructing follower 817b494b9b5b4ff0bbf68b9fd74963d4 to start an election
I20260709 13:05:16.144285 11444 raft_consensus.cc:1081] T 7d53f56723e142cdb675579480449047 P 5d06cb5f8cff404097ba5f1d3afd3268 [term 1 LEADER]: Signalling peer 817b494b9b5b4ff0bbf68b9fd74963d4 to start an election
I20260709 13:05:16.146811 11205 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d53f56723e142cdb675579480449047"
dest_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4"
 from {username='slave'} at 127.0.0.1:55344
I20260709 13:05:16.147493 11205 raft_consensus.cc:493] T 7d53f56723e142cdb675579480449047 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:16.148227 11205 raft_consensus.cc:3060] T 7d53f56723e142cdb675579480449047 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:16.149664 11426 consensus_queue.cc:1048] T 7d53f56723e142cdb675579480449047 P 5d06cb5f8cff404097ba5f1d3afd3268 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:16.158926 11205 raft_consensus.cc:515] T 7d53f56723e142cdb675579480449047 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:16.160351 11206 raft_consensus.cc:1240] T 7d53f56723e142cdb675579480449047 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 2 FOLLOWER]: Rejecting Update request from peer 5d06cb5f8cff404097ba5f1d3afd3268 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:16.162865 11205 leader_election.cc:290] T 7d53f56723e142cdb675579480449047 P 817b494b9b5b4ff0bbf68b9fd74963d4 [CANDIDATE]: Term 2 election: Requested vote from peers 42e9e3e7c02e4e6b92d7c6956c01a275 (127.0.107.194:37547), 5d06cb5f8cff404097ba5f1d3afd3268 (127.0.107.195:44257)
I20260709 13:05:16.164009 11354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d53f56723e142cdb675579480449047" candidate_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d06cb5f8cff404097ba5f1d3afd3268"
I20260709 13:05:16.164714 11354 raft_consensus.cc:3055] T 7d53f56723e142cdb675579480449047 P 5d06cb5f8cff404097ba5f1d3afd3268 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:16.165052 11354 raft_consensus.cc:740] T 7d53f56723e142cdb675579480449047 P 5d06cb5f8cff404097ba5f1d3afd3268 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d06cb5f8cff404097ba5f1d3afd3268, State: Running, Role: LEADER
I20260709 13:05:16.165505 11280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d53f56723e142cdb675579480449047" candidate_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275"
I20260709 13:05:16.166340 11280 raft_consensus.cc:3060] T 7d53f56723e142cdb675579480449047 P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:16.166149 11354 consensus_queue.cc:260] T 7d53f56723e142cdb675579480449047 P 5d06cb5f8cff404097ba5f1d3afd3268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:16.167730 11354 raft_consensus.cc:3060] T 7d53f56723e142cdb675579480449047 P 5d06cb5f8cff404097ba5f1d3afd3268 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:16.173962 11280 raft_consensus.cc:2468] T 7d53f56723e142cdb675579480449047 P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 817b494b9b5b4ff0bbf68b9fd74963d4 in term 2.
I20260709 13:05:16.174700 11354 raft_consensus.cc:2468] T 7d53f56723e142cdb675579480449047 P 5d06cb5f8cff404097ba5f1d3afd3268 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 817b494b9b5b4ff0bbf68b9fd74963d4 in term 2.
I20260709 13:05:16.175464 11171 leader_election.cc:304] T 7d53f56723e142cdb675579480449047 P 817b494b9b5b4ff0bbf68b9fd74963d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42e9e3e7c02e4e6b92d7c6956c01a275, 817b494b9b5b4ff0bbf68b9fd74963d4; no voters: 
I20260709 13:05:16.176369 11399 raft_consensus.cc:2804] T 7d53f56723e142cdb675579480449047 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:16.176930 11399 raft_consensus.cc:697] T 7d53f56723e142cdb675579480449047 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 2 LEADER]: Becoming Leader. State: Replica: 817b494b9b5b4ff0bbf68b9fd74963d4, State: Running, Role: LEADER
I20260709 13:05:16.177839 11399 consensus_queue.cc:237] T 7d53f56723e142cdb675579480449047 P 817b494b9b5b4ff0bbf68b9fd74963d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:16.184713 11103 catalog_manager.cc:5697] T 7d53f56723e142cdb675579480449047 P 817b494b9b5b4ff0bbf68b9fd74963d4 reported cstate change: term changed from 1 to 2, leader changed from 5d06cb5f8cff404097ba5f1d3afd3268 (127.0.107.195) to 817b494b9b5b4ff0bbf68b9fd74963d4 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:16.267315 11206 raft_consensus.cc:1275] T b4eb781f8ed04b4791f2d8ee53061a15 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 2 FOLLOWER]: Refusing update from remote peer 42e9e3e7c02e4e6b92d7c6956c01a275: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:16.268697 11404 consensus_queue.cc:1048] T b4eb781f8ed04b4791f2d8ee53061a15 P 42e9e3e7c02e4e6b92d7c6956c01a275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:16.279646 11354 raft_consensus.cc:1275] T b4eb781f8ed04b4791f2d8ee53061a15 P 5d06cb5f8cff404097ba5f1d3afd3268 [term 2 FOLLOWER]: Refusing update from remote peer 42e9e3e7c02e4e6b92d7c6956c01a275: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:16.281193 11404 consensus_queue.cc:1048] T b4eb781f8ed04b4791f2d8ee53061a15 P 42e9e3e7c02e4e6b92d7c6956c01a275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:16.309299   431 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:05:16.311038   431 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:05:16.311501   431 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:05:16.324951 11206 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a43efc8ea4e4508ae8dee40a7e7fafa"
dest_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4"
mode: GRACEFUL
new_leader_uuid: "5d06cb5f8cff404097ba5f1d3afd3268"
 from {username='slave'} at 127.0.0.1:55366
I20260709 13:05:16.325698 11206 raft_consensus.cc:606] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 2 LEADER]: Received request to transfer leadership to TS 5d06cb5f8cff404097ba5f1d3afd3268
I20260709 13:05:16.326926   431 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:05:16.482128 11280 raft_consensus.cc:1275] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 2 FOLLOWER]: Refusing update from remote peer 817b494b9b5b4ff0bbf68b9fd74963d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:16.483633 11399 consensus_queue.cc:1048] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 817b494b9b5b4ff0bbf68b9fd74963d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:16.493649 11354 raft_consensus.cc:1275] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268 [term 2 FOLLOWER]: Refusing update from remote peer 817b494b9b5b4ff0bbf68b9fd74963d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:16.495303 11409 consensus_queue.cc:1048] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 817b494b9b5b4ff0bbf68b9fd74963d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:16.502848 11409 raft_consensus.cc:993] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 817b494b9b5b4ff0bbf68b9fd74963d4: : Instructing follower 5d06cb5f8cff404097ba5f1d3afd3268 to start an election
I20260709 13:05:16.503391 11399 raft_consensus.cc:1081] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 2 LEADER]: Signalling peer 5d06cb5f8cff404097ba5f1d3afd3268 to start an election
I20260709 13:05:16.505146 11354 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a43efc8ea4e4508ae8dee40a7e7fafa"
dest_uuid: "5d06cb5f8cff404097ba5f1d3afd3268"
 from {username='slave'} at 127.0.0.1:55064
I20260709 13:05:16.505788 11354 raft_consensus.cc:493] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:16.506253 11354 raft_consensus.cc:3060] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:16.512418 11354 raft_consensus.cc:515] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:16.514467 11354 leader_election.cc:290] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268 [CANDIDATE]: Term 3 election: Requested vote from peers 817b494b9b5b4ff0bbf68b9fd74963d4 (127.0.107.193:37689), 42e9e3e7c02e4e6b92d7c6956c01a275 (127.0.107.194:37547)
I20260709 13:05:16.515363 11206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a43efc8ea4e4508ae8dee40a7e7fafa" candidate_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4"
I20260709 13:05:16.515730 11280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a43efc8ea4e4508ae8dee40a7e7fafa" candidate_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275"
I20260709 13:05:16.516120 11206 raft_consensus.cc:3055] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:16.516448 11280 raft_consensus.cc:3060] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:16.516558 11206 raft_consensus.cc:740] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 817b494b9b5b4ff0bbf68b9fd74963d4, State: Running, Role: LEADER
I20260709 13:05:16.517620 11206 consensus_queue.cc:260] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 817b494b9b5b4ff0bbf68b9fd74963d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:16.518656 11206 raft_consensus.cc:3060] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:16.523157 11280 raft_consensus.cc:2468] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d06cb5f8cff404097ba5f1d3afd3268 in term 3.
I20260709 13:05:16.524313 11320 leader_election.cc:304] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42e9e3e7c02e4e6b92d7c6956c01a275, 5d06cb5f8cff404097ba5f1d3afd3268; no voters: 
I20260709 13:05:16.524659 11206 raft_consensus.cc:2468] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d06cb5f8cff404097ba5f1d3afd3268 in term 3.
I20260709 13:05:16.525131 11426 raft_consensus.cc:2804] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:16.525705 11426 raft_consensus.cc:697] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268 [term 3 LEADER]: Becoming Leader. State: Replica: 5d06cb5f8cff404097ba5f1d3afd3268, State: Running, Role: LEADER
I20260709 13:05:16.526705 11426 consensus_queue.cc:237] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } }
I20260709 13:05:16.533423 11103 catalog_manager.cc:5697] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268 reported cstate change: term changed from 2 to 3, leader changed from 817b494b9b5b4ff0bbf68b9fd74963d4 (127.0.107.193) to 5d06cb5f8cff404097ba5f1d3afd3268 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817b494b9b5b4ff0bbf68b9fd74963d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42e9e3e7c02e4e6b92d7c6956c01a275" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:16.551625   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:05:16.574895 11354 raft_consensus.cc:1275] T 7d53f56723e142cdb675579480449047 P 5d06cb5f8cff404097ba5f1d3afd3268 [term 2 FOLLOWER]: Refusing update from remote peer 817b494b9b5b4ff0bbf68b9fd74963d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:16.576824 11399 consensus_queue.cc:1048] T 7d53f56723e142cdb675579480449047 P 817b494b9b5b4ff0bbf68b9fd74963d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d06cb5f8cff404097ba5f1d3afd3268" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:16.577570   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:16.578487   431 tablet_replica.cc:333] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 817b494b9b5b4ff0bbf68b9fd74963d4: stopping tablet replica
I20260709 13:05:16.579119   431 raft_consensus.cc:2243] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:16.579592   431 raft_consensus.cc:2272] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:16.582643   431 tablet_replica.cc:333] T 7d53f56723e142cdb675579480449047 P 817b494b9b5b4ff0bbf68b9fd74963d4: stopping tablet replica
I20260709 13:05:16.583438   431 raft_consensus.cc:2243] T 7d53f56723e142cdb675579480449047 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:16.584465   431 pending_rounds.cc:70] T 7d53f56723e142cdb675579480449047 P 817b494b9b5b4ff0bbf68b9fd74963d4: Trying to abort 2 pending ops.
I20260709 13:05:16.584662   431 pending_rounds.cc:77] T 7d53f56723e142cdb675579480449047 P 817b494b9b5b4ff0bbf68b9fd74963d4: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305635087072587776 op_type: NO_OP noop_request { }
I20260709 13:05:16.585012   431 raft_consensus.cc:2889] T 7d53f56723e142cdb675579480449047 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:05:16.585316   431 pending_rounds.cc:77] T 7d53f56723e142cdb675579480449047 P 817b494b9b5b4ff0bbf68b9fd74963d4: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305635085064839168 op_type: NO_OP noop_request { }
I20260709 13:05:16.585582   431 raft_consensus.cc:2889] T 7d53f56723e142cdb675579480449047 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:05:16.585883   431 raft_consensus.cc:2272] T 7d53f56723e142cdb675579480449047 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:16.588619   431 tablet_replica.cc:333] T b4eb781f8ed04b4791f2d8ee53061a15 P 817b494b9b5b4ff0bbf68b9fd74963d4: stopping tablet replica
I20260709 13:05:16.589282   431 raft_consensus.cc:2243] T b4eb781f8ed04b4791f2d8ee53061a15 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:16.589776   431 raft_consensus.cc:2272] T b4eb781f8ed04b4791f2d8ee53061a15 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:16.592049   431 tablet_replica.cc:333] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 817b494b9b5b4ff0bbf68b9fd74963d4: stopping tablet replica
I20260709 13:05:16.592590   431 raft_consensus.cc:2243] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:16.593526   431 raft_consensus.cc:2272] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 817b494b9b5b4ff0bbf68b9fd74963d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:16.608914   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 13:05:16.623418   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:05:16.645347   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:16.646242   431 tablet_replica.cc:333] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 42e9e3e7c02e4e6b92d7c6956c01a275: stopping tablet replica
I20260709 13:05:16.647212   431 raft_consensus.cc:2243] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:16.647673   431 raft_consensus.cc:2272] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:16.651074   431 tablet_replica.cc:333] T 7d53f56723e142cdb675579480449047 P 42e9e3e7c02e4e6b92d7c6956c01a275: stopping tablet replica
I20260709 13:05:16.651625   431 raft_consensus.cc:2243] T 7d53f56723e142cdb675579480449047 P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:16.652030   431 raft_consensus.cc:2272] T 7d53f56723e142cdb675579480449047 P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:16.654518   431 tablet_replica.cc:333] T b4eb781f8ed04b4791f2d8ee53061a15 P 42e9e3e7c02e4e6b92d7c6956c01a275: stopping tablet replica
I20260709 13:05:16.655023   431 raft_consensus.cc:2243] T b4eb781f8ed04b4791f2d8ee53061a15 P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:16.656199   431 raft_consensus.cc:2272] T b4eb781f8ed04b4791f2d8ee53061a15 P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:16.659010   431 tablet_replica.cc:333] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 42e9e3e7c02e4e6b92d7c6956c01a275: stopping tablet replica
I20260709 13:05:16.659511   431 raft_consensus.cc:2243] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:16.659929   431 raft_consensus.cc:2272] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 42e9e3e7c02e4e6b92d7c6956c01a275 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:16.684355   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:05:16.698436   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:05:16.721503   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:16.722378   431 tablet_replica.cc:333] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268: stopping tablet replica
I20260709 13:05:16.723006   431 raft_consensus.cc:2243] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:16.723703   431 pending_rounds.cc:70] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268: Trying to abort 1 pending ops.
I20260709 13:05:16.723905   431 pending_rounds.cc:77] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305635088500944896 op_type: NO_OP noop_request { }
I20260709 13:05:16.724180   431 raft_consensus.cc:2889] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:05:16.724469   431 raft_consensus.cc:2272] T 4a43efc8ea4e4508ae8dee40a7e7fafa P 5d06cb5f8cff404097ba5f1d3afd3268 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:16.726787   431 tablet_replica.cc:333] T 7d53f56723e142cdb675579480449047 P 5d06cb5f8cff404097ba5f1d3afd3268: stopping tablet replica
I20260709 13:05:16.727352   431 raft_consensus.cc:2243] T 7d53f56723e142cdb675579480449047 P 5d06cb5f8cff404097ba5f1d3afd3268 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:16.727751   431 pending_rounds.cc:70] T 7d53f56723e142cdb675579480449047 P 5d06cb5f8cff404097ba5f1d3afd3268: Trying to abort 1 pending ops.
I20260709 13:05:16.727955   431 pending_rounds.cc:77] T 7d53f56723e142cdb675579480449047 P 5d06cb5f8cff404097ba5f1d3afd3268: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305635087072587776 op_type: NO_OP noop_request { }
I20260709 13:05:16.728219   431 raft_consensus.cc:2889] T 7d53f56723e142cdb675579480449047 P 5d06cb5f8cff404097ba5f1d3afd3268 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:05:16.728506   431 raft_consensus.cc:2272] T 7d53f56723e142cdb675579480449047 P 5d06cb5f8cff404097ba5f1d3afd3268 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:16.731029   431 tablet_replica.cc:333] T b4eb781f8ed04b4791f2d8ee53061a15 P 5d06cb5f8cff404097ba5f1d3afd3268: stopping tablet replica
I20260709 13:05:16.731576   431 raft_consensus.cc:2243] T b4eb781f8ed04b4791f2d8ee53061a15 P 5d06cb5f8cff404097ba5f1d3afd3268 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:16.732005   431 raft_consensus.cc:2272] T b4eb781f8ed04b4791f2d8ee53061a15 P 5d06cb5f8cff404097ba5f1d3afd3268 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:16.734862   431 tablet_replica.cc:333] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 5d06cb5f8cff404097ba5f1d3afd3268: stopping tablet replica
I20260709 13:05:16.735461   431 raft_consensus.cc:2243] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 5d06cb5f8cff404097ba5f1d3afd3268 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:16.735963   431 raft_consensus.cc:2272] T 88ce3a9f14a74ec7a3dac22d6f957a88 P 5d06cb5f8cff404097ba5f1d3afd3268 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:16.759684   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:05:16.775595   431 master.cc:562] Master@127.0.107.254:37799 shutting down...
I20260709 13:05:16.793614   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c38278446c2e49d3b017e9b8ff12e60a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:16.794267   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c38278446c2e49d3b017e9b8ff12e60a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:16.794616   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P c38278446c2e49d3b017e9b8ff12e60a: stopping tablet replica
I20260709 13:05:16.815348   431 master.cc:584] Master@127.0.107.254:37799 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2629 ms)
[----------] 6 tests from LeaderRebalancerTest (336824 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:05:16.847829   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:36585
I20260709 13:05:16.849349   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:16.855489 11451 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:16.856056 11452 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:16.857831 11454 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:16.859556   431 server_base.cc:1061] running on GCE node
I20260709 13:05:16.860595   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:16.860800   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:16.861047   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602316861028 us; error 0 us; skew 500 ppm
I20260709 13:05:16.861658   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:16.864188   431 webserver.cc:533] Webserver started at http://127.0.107.254:40703/ using document root <none> and password file <none>
I20260709 13:05:16.864650   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:16.864902   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:16.865461   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:16.866588   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601979855482-431-0/minicluster-data/master-0-root/instance:
uuid: "3f6084af20764c6eb4d8ab85b1c9eef3"
format_stamp: "Formatted at 2026-07-09 13:05:16 on dist-test-slave-g4pn"
I20260709 13:05:16.871660   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:05:16.876569 11459 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:16.877642   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 13:05:16.878068   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601979855482-431-0/minicluster-data/master-0-root
uuid: "3f6084af20764c6eb4d8ab85b1c9eef3"
format_stamp: "Formatted at 2026-07-09 13:05:16 on dist-test-slave-g4pn"
I20260709 13:05:16.878381   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601979855482-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601979855482-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601979855482-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:16.908571   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:16.910411   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:16.957434   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:36585
I20260709 13:05:16.957542 11510 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:36585 every 8 connection(s)
I20260709 13:05:16.961378 11511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.974572 11511 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f6084af20764c6eb4d8ab85b1c9eef3: Bootstrap starting.
I20260709 13:05:16.979640 11511 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3f6084af20764c6eb4d8ab85b1c9eef3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.984270 11511 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f6084af20764c6eb4d8ab85b1c9eef3: No bootstrap required, opened a new log
I20260709 13:05:16.986426 11511 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3f6084af20764c6eb4d8ab85b1c9eef3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f6084af20764c6eb4d8ab85b1c9eef3" member_type: VOTER }
I20260709 13:05:16.986830 11511 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3f6084af20764c6eb4d8ab85b1c9eef3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.987015 11511 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3f6084af20764c6eb4d8ab85b1c9eef3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f6084af20764c6eb4d8ab85b1c9eef3, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.987633 11511 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f6084af20764c6eb4d8ab85b1c9eef3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f6084af20764c6eb4d8ab85b1c9eef3" member_type: VOTER }
I20260709 13:05:16.988086 11511 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3f6084af20764c6eb4d8ab85b1c9eef3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:16.988281 11511 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3f6084af20764c6eb4d8ab85b1c9eef3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:16.988503 11511 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3f6084af20764c6eb4d8ab85b1c9eef3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.994264 11511 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3f6084af20764c6eb4d8ab85b1c9eef3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f6084af20764c6eb4d8ab85b1c9eef3" member_type: VOTER }
I20260709 13:05:16.994796 11511 leader_election.cc:304] T 00000000000000000000000000000000 P 3f6084af20764c6eb4d8ab85b1c9eef3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3f6084af20764c6eb4d8ab85b1c9eef3; no voters: 
I20260709 13:05:16.995954 11511 leader_election.cc:290] T 00000000000000000000000000000000 P 3f6084af20764c6eb4d8ab85b1c9eef3 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:16.996387 11514 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3f6084af20764c6eb4d8ab85b1c9eef3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:16.998019 11514 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3f6084af20764c6eb4d8ab85b1c9eef3 [term 1 LEADER]: Becoming Leader. State: Replica: 3f6084af20764c6eb4d8ab85b1c9eef3, State: Running, Role: LEADER
I20260709 13:05:16.998744 11514 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f6084af20764c6eb4d8ab85b1c9eef3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f6084af20764c6eb4d8ab85b1c9eef3" member_type: VOTER }
I20260709 13:05:16.998898 11511 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3f6084af20764c6eb4d8ab85b1c9eef3 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:17.002154 11516 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f6084af20764c6eb4d8ab85b1c9eef3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f6084af20764c6eb4d8ab85b1c9eef3. Latest consensus state: current_term: 1 leader_uuid: "3f6084af20764c6eb4d8ab85b1c9eef3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f6084af20764c6eb4d8ab85b1c9eef3" member_type: VOTER } }
I20260709 13:05:17.002830 11516 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f6084af20764c6eb4d8ab85b1c9eef3 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:17.002658 11515 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f6084af20764c6eb4d8ab85b1c9eef3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3f6084af20764c6eb4d8ab85b1c9eef3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f6084af20764c6eb4d8ab85b1c9eef3" member_type: VOTER } }
I20260709 13:05:17.005031 11515 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f6084af20764c6eb4d8ab85b1c9eef3 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:17.006356 11521 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:17.011363 11521 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:17.015581   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:17.022363 11521 catalog_manager.cc:1383] Generated new cluster ID: 1f20a84914834ae885353e13a729d43b
I20260709 13:05:17.022686 11521 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:17.048877 11521 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:17.050292 11521 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:17.068488 11521 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 3f6084af20764c6eb4d8ab85b1c9eef3: Generated new TSK 0
I20260709 13:05:17.069361 11521 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:17.083422   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:17.089874 11532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:17.091101 11533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:17.094440 11535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:17.094517   431 server_base.cc:1061] running on GCE node
I20260709 13:05:17.095891   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:17.096077   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:17.096289   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602317096268 us; error 0 us; skew 500 ppm
I20260709 13:05:17.096848   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:17.099735   431 webserver.cc:533] Webserver started at http://127.0.107.193:39623/ using document root <none> and password file <none>
I20260709 13:05:17.100328   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:17.100522   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:17.100832   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:17.102058   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601979855482-431-0/minicluster-data/ts-0-root/instance:
uuid: "645c185863fd448e91faa534d9676384"
format_stamp: "Formatted at 2026-07-09 13:05:17 on dist-test-slave-g4pn"
I20260709 13:05:17.107437   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.004s
I20260709 13:05:17.111941 11540 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:17.112944   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:05:17.113432   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601979855482-431-0/minicluster-data/ts-0-root
uuid: "645c185863fd448e91faa534d9676384"
format_stamp: "Formatted at 2026-07-09 13:05:17 on dist-test-slave-g4pn"
I20260709 13:05:17.113716   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601979855482-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601979855482-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601979855482-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:17.135469   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:17.136703   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:17.138351   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:17.140859   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:17.141054   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:17.141467   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:17.141634   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:17.187923   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:37707
I20260709 13:05:17.187990 11602 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:37707 every 8 connection(s)
I20260709 13:05:17.193267   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:17.200882 11607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:17.202522 11608 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:17.206991   431 server_base.cc:1061] running on GCE node
W20260709 13:05:17.207216 11610 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:17.208293 11603 heartbeater.cc:344] Connected to a master server at 127.0.107.254:36585
I20260709 13:05:17.208920 11603 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:17.209497   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:17.209910   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:17.210000 11603 heartbeater.cc:507] Master 127.0.107.254:36585 requested a full tablet report, sending...
I20260709 13:05:17.210175   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602317210153 us; error 0 us; skew 500 ppm
I20260709 13:05:17.211030   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:17.212648 11476 ts_manager.cc:194] Registered new tserver with Master: 645c185863fd448e91faa534d9676384 (127.0.107.193:37707)
I20260709 13:05:17.213801   431 webserver.cc:533] Webserver started at http://127.0.107.194:43011/ using document root <none> and password file <none>
I20260709 13:05:17.214357   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:17.214566   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:17.214643 11476 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41260
I20260709 13:05:17.214867   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:17.217048   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601979855482-431-0/minicluster-data/ts-1-root/instance:
uuid: "922904a85e7c45febb9f75ac6e08c44d"
format_stamp: "Formatted at 2026-07-09 13:05:17 on dist-test-slave-g4pn"
I20260709 13:05:17.221936   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:05:17.225713 11615 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:17.226559   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 13:05:17.226918   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601979855482-431-0/minicluster-data/ts-1-root
uuid: "922904a85e7c45febb9f75ac6e08c44d"
format_stamp: "Formatted at 2026-07-09 13:05:17 on dist-test-slave-g4pn"
I20260709 13:05:17.227275   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601979855482-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601979855482-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601979855482-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:17.257956   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:17.259116   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:17.260612   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:17.263092   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:17.263346   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:17.263582   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:17.263753   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:17.306978   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:45415
I20260709 13:05:17.307087 11677 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:45415 every 8 connection(s)
I20260709 13:05:17.312693   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:17.319554 11681 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:17.321650 11682 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:17.325258   431 server_base.cc:1061] running on GCE node
I20260709 13:05:17.325965 11678 heartbeater.cc:344] Connected to a master server at 127.0.107.254:36585
I20260709 13:05:17.326403 11678 heartbeater.cc:461] Registering TS with master...
W20260709 13:05:17.326588 11684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:17.327389 11678 heartbeater.cc:507] Master 127.0.107.254:36585 requested a full tablet report, sending...
I20260709 13:05:17.327821   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:17.328150   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:17.328358   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602317328339 us; error 0 us; skew 500 ppm
I20260709 13:05:17.329161   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:17.329979 11476 ts_manager.cc:194] Registered new tserver with Master: 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415)
I20260709 13:05:17.331741 11476 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41262
I20260709 13:05:17.332180   431 webserver.cc:533] Webserver started at http://127.0.107.195:42729/ using document root <none> and password file <none>
I20260709 13:05:17.332821   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:17.333120   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:17.333412   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:17.334517   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601979855482-431-0/minicluster-data/ts-2-root/instance:
uuid: "efc52ba30a214524ba9a3705d5b5909f"
format_stamp: "Formatted at 2026-07-09 13:05:17 on dist-test-slave-g4pn"
I20260709 13:05:17.339394   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:05:17.343204 11689 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:17.344288   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:05:17.344764   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601979855482-431-0/minicluster-data/ts-2-root
uuid: "efc52ba30a214524ba9a3705d5b5909f"
format_stamp: "Formatted at 2026-07-09 13:05:17 on dist-test-slave-g4pn"
I20260709 13:05:17.345176   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601979855482-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601979855482-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601979855482-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:17.367065   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:17.368479   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:17.370007   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:17.372416   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:17.372680   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:17.372924   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:17.373116   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:17.416630   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:37949
I20260709 13:05:17.416846 11751 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:37949 every 8 connection(s)
I20260709 13:05:17.431761 11752 heartbeater.cc:344] Connected to a master server at 127.0.107.254:36585
I20260709 13:05:17.432329 11752 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:17.433135 11752 heartbeater.cc:507] Master 127.0.107.254:36585 requested a full tablet report, sending...
I20260709 13:05:17.435240 11476 ts_manager.cc:194] Registered new tserver with Master: efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:17.435348   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01529883s
I20260709 13:05:17.436751 11476 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41272
I20260709 13:05:17.464598 11476 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41276:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:17.467456 11476 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:17.543292 11568 tablet_service.cc:1511] Processing CreateTablet for tablet 69acdb3a5cd54bc0b6921e6b343a20c2 (DEFAULT_TABLE table=test-workload [id=2ba14c1cf9dc49b69de8cdf1ea40ef0b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:17.544725 11568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69acdb3a5cd54bc0b6921e6b343a20c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.552603 11567 tablet_service.cc:1511] Processing CreateTablet for tablet b6555ed9a2e04888ac596b8dbe747265 (DEFAULT_TABLE table=test-workload [id=2ba14c1cf9dc49b69de8cdf1ea40ef0b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:17.554212 11567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6555ed9a2e04888ac596b8dbe747265. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.556367 11566 tablet_service.cc:1511] Processing CreateTablet for tablet a3f692f94196483a9148317c2c73adcd (DEFAULT_TABLE table=test-workload [id=2ba14c1cf9dc49b69de8cdf1ea40ef0b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:17.556965 11643 tablet_service.cc:1511] Processing CreateTablet for tablet 69acdb3a5cd54bc0b6921e6b343a20c2 (DEFAULT_TABLE table=test-workload [id=2ba14c1cf9dc49b69de8cdf1ea40ef0b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:17.557884 11566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3f692f94196483a9148317c2c73adcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.558491 11643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69acdb3a5cd54bc0b6921e6b343a20c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.560036 11638 tablet_service.cc:1511] Processing CreateTablet for tablet 0c7cb06551c649a4963138881a4aa55d (DEFAULT_TABLE table=test-workload [id=2ba14c1cf9dc49b69de8cdf1ea40ef0b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:17.561518 11638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c7cb06551c649a4963138881a4aa55d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.562408 11565 tablet_service.cc:1511] Processing CreateTablet for tablet 2253eb70f9fa4f77b87a1522e2a7a4f0 (DEFAULT_TABLE table=test-workload [id=2ba14c1cf9dc49b69de8cdf1ea40ef0b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:17.562518 11642 tablet_service.cc:1511] Processing CreateTablet for tablet b6555ed9a2e04888ac596b8dbe747265 (DEFAULT_TABLE table=test-workload [id=2ba14c1cf9dc49b69de8cdf1ea40ef0b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:17.563877 11565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2253eb70f9fa4f77b87a1522e2a7a4f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.563969 11642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6555ed9a2e04888ac596b8dbe747265. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.566190 11641 tablet_service.cc:1511] Processing CreateTablet for tablet a3f692f94196483a9148317c2c73adcd (DEFAULT_TABLE table=test-workload [id=2ba14c1cf9dc49b69de8cdf1ea40ef0b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:17.567850 11641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3f692f94196483a9148317c2c73adcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.568094 11563 tablet_service.cc:1511] Processing CreateTablet for tablet 0c7cb06551c649a4963138881a4aa55d (DEFAULT_TABLE table=test-workload [id=2ba14c1cf9dc49b69de8cdf1ea40ef0b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:17.569525 11563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c7cb06551c649a4963138881a4aa55d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.570247 11640 tablet_service.cc:1511] Processing CreateTablet for tablet 2253eb70f9fa4f77b87a1522e2a7a4f0 (DEFAULT_TABLE table=test-workload [id=2ba14c1cf9dc49b69de8cdf1ea40ef0b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:17.571887 11640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2253eb70f9fa4f77b87a1522e2a7a4f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.571605 11637 tablet_service.cc:1511] Processing CreateTablet for tablet dd80d122422e4086ba85914c7dfdbe0d (DEFAULT_TABLE table=test-workload [id=2ba14c1cf9dc49b69de8cdf1ea40ef0b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:17.573004 11637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd80d122422e4086ba85914c7dfdbe0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.573997 11639 tablet_service.cc:1511] Processing CreateTablet for tablet 6655f1f8c7674f98bd634a5f88ed3d55 (DEFAULT_TABLE table=test-workload [id=2ba14c1cf9dc49b69de8cdf1ea40ef0b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:17.574184 11562 tablet_service.cc:1511] Processing CreateTablet for tablet dd80d122422e4086ba85914c7dfdbe0d (DEFAULT_TABLE table=test-workload [id=2ba14c1cf9dc49b69de8cdf1ea40ef0b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:17.575428 11639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6655f1f8c7674f98bd634a5f88ed3d55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.575649 11562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd80d122422e4086ba85914c7dfdbe0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.566277 11564 tablet_service.cc:1511] Processing CreateTablet for tablet 6655f1f8c7674f98bd634a5f88ed3d55 (DEFAULT_TABLE table=test-workload [id=2ba14c1cf9dc49b69de8cdf1ea40ef0b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:17.578203 11564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6655f1f8c7674f98bd634a5f88ed3d55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.578621 11636 tablet_service.cc:1511] Processing CreateTablet for tablet 503bb0f5891b46de93cbac7e2a184b58 (DEFAULT_TABLE table=test-workload [id=2ba14c1cf9dc49b69de8cdf1ea40ef0b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:17.580945 11561 tablet_service.cc:1511] Processing CreateTablet for tablet 503bb0f5891b46de93cbac7e2a184b58 (DEFAULT_TABLE table=test-workload [id=2ba14c1cf9dc49b69de8cdf1ea40ef0b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:17.582350 11561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 503bb0f5891b46de93cbac7e2a184b58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.585605 11636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 503bb0f5891b46de93cbac7e2a184b58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.602317 11560 tablet_service.cc:1511] Processing CreateTablet for tablet d2603633a12047678d7b85f14c0c970e (DEFAULT_TABLE table=test-workload [id=2ba14c1cf9dc49b69de8cdf1ea40ef0b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:17.604142 11560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2603633a12047678d7b85f14c0c970e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.619274 11635 tablet_service.cc:1511] Processing CreateTablet for tablet d2603633a12047678d7b85f14c0c970e (DEFAULT_TABLE table=test-workload [id=2ba14c1cf9dc49b69de8cdf1ea40ef0b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:17.620720 11717 tablet_service.cc:1511] Processing CreateTablet for tablet 69acdb3a5cd54bc0b6921e6b343a20c2 (DEFAULT_TABLE table=test-workload [id=2ba14c1cf9dc49b69de8cdf1ea40ef0b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:17.621279 11635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2603633a12047678d7b85f14c0c970e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.622221 11717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69acdb3a5cd54bc0b6921e6b343a20c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.624713 11714 tablet_service.cc:1511] Processing CreateTablet for tablet 2253eb70f9fa4f77b87a1522e2a7a4f0 (DEFAULT_TABLE table=test-workload [id=2ba14c1cf9dc49b69de8cdf1ea40ef0b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:17.625823 11715 tablet_service.cc:1511] Processing CreateTablet for tablet a3f692f94196483a9148317c2c73adcd (DEFAULT_TABLE table=test-workload [id=2ba14c1cf9dc49b69de8cdf1ea40ef0b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:17.626268 11714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2253eb70f9fa4f77b87a1522e2a7a4f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.627195 11715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3f692f94196483a9148317c2c73adcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.624713 11716 tablet_service.cc:1511] Processing CreateTablet for tablet b6555ed9a2e04888ac596b8dbe747265 (DEFAULT_TABLE table=test-workload [id=2ba14c1cf9dc49b69de8cdf1ea40ef0b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:17.630039 11716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6555ed9a2e04888ac596b8dbe747265. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.635264 11713 tablet_service.cc:1511] Processing CreateTablet for tablet 6655f1f8c7674f98bd634a5f88ed3d55 (DEFAULT_TABLE table=test-workload [id=2ba14c1cf9dc49b69de8cdf1ea40ef0b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:17.635636 11712 tablet_service.cc:1511] Processing CreateTablet for tablet 0c7cb06551c649a4963138881a4aa55d (DEFAULT_TABLE table=test-workload [id=2ba14c1cf9dc49b69de8cdf1ea40ef0b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:17.637068 11713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6655f1f8c7674f98bd634a5f88ed3d55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.639103 11710 tablet_service.cc:1511] Processing CreateTablet for tablet 503bb0f5891b46de93cbac7e2a184b58 (DEFAULT_TABLE table=test-workload [id=2ba14c1cf9dc49b69de8cdf1ea40ef0b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:17.640520 11710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 503bb0f5891b46de93cbac7e2a184b58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.638345 11711 tablet_service.cc:1511] Processing CreateTablet for tablet dd80d122422e4086ba85914c7dfdbe0d (DEFAULT_TABLE table=test-workload [id=2ba14c1cf9dc49b69de8cdf1ea40ef0b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:17.641680 11711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd80d122422e4086ba85914c7dfdbe0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.646365 11712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c7cb06551c649a4963138881a4aa55d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.647321 11709 tablet_service.cc:1511] Processing CreateTablet for tablet d2603633a12047678d7b85f14c0c970e (DEFAULT_TABLE table=test-workload [id=2ba14c1cf9dc49b69de8cdf1ea40ef0b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:17.648762 11709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2603633a12047678d7b85f14c0c970e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.721206 11769 tablet_bootstrap.cc:492] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 645c185863fd448e91faa534d9676384: Bootstrap starting.
I20260709 13:05:17.744158 11767 tablet_bootstrap.cc:492] T 0c7cb06551c649a4963138881a4aa55d P 922904a85e7c45febb9f75ac6e08c44d: Bootstrap starting.
I20260709 13:05:17.746397 11768 tablet_bootstrap.cc:492] T 503bb0f5891b46de93cbac7e2a184b58 P efc52ba30a214524ba9a3705d5b5909f: Bootstrap starting.
I20260709 13:05:17.767230 11769 tablet_bootstrap.cc:654] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 645c185863fd448e91faa534d9676384: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.775456 11769 tablet_bootstrap.cc:492] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 645c185863fd448e91faa534d9676384: No bootstrap required, opened a new log
I20260709 13:05:17.776363 11769 ts_tablet_manager.cc:1403] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 645c185863fd448e91faa534d9676384: Time spent bootstrapping tablet: real 0.056s	user 0.008s	sys 0.004s
I20260709 13:05:17.779764 11769 raft_consensus.cc:359] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:17.780608 11769 raft_consensus.cc:385] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.780977 11769 raft_consensus.cc:740] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 645c185863fd448e91faa534d9676384, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.781831 11769 consensus_queue.cc:260] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 645c185863fd448e91faa534d9676384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:17.785252 11767 tablet_bootstrap.cc:654] T 0c7cb06551c649a4963138881a4aa55d P 922904a85e7c45febb9f75ac6e08c44d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.785252 11768 tablet_bootstrap.cc:654] T 503bb0f5891b46de93cbac7e2a184b58 P efc52ba30a214524ba9a3705d5b5909f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.787118 11603 heartbeater.cc:499] Master 127.0.107.254:36585 was elected leader, sending a full tablet report...
I20260709 13:05:17.790381 11769 ts_tablet_manager.cc:1434] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 645c185863fd448e91faa534d9676384: Time spent starting tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:05:17.791625 11769 tablet_bootstrap.cc:492] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 645c185863fd448e91faa534d9676384: Bootstrap starting.
I20260709 13:05:17.791931 11767 tablet_bootstrap.cc:492] T 0c7cb06551c649a4963138881a4aa55d P 922904a85e7c45febb9f75ac6e08c44d: No bootstrap required, opened a new log
I20260709 13:05:17.792486 11767 ts_tablet_manager.cc:1403] T 0c7cb06551c649a4963138881a4aa55d P 922904a85e7c45febb9f75ac6e08c44d: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.004s
I20260709 13:05:17.795554 11767 raft_consensus.cc:359] T 0c7cb06551c649a4963138881a4aa55d P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:17.796535 11767 raft_consensus.cc:385] T 0c7cb06551c649a4963138881a4aa55d P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.796924 11767 raft_consensus.cc:740] T 0c7cb06551c649a4963138881a4aa55d P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 922904a85e7c45febb9f75ac6e08c44d, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.798514 11769 tablet_bootstrap.cc:654] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 645c185863fd448e91faa534d9676384: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.797998 11767 consensus_queue.cc:260] T 0c7cb06551c649a4963138881a4aa55d P 922904a85e7c45febb9f75ac6e08c44d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:17.802484 11768 tablet_bootstrap.cc:492] T 503bb0f5891b46de93cbac7e2a184b58 P efc52ba30a214524ba9a3705d5b5909f: No bootstrap required, opened a new log
I20260709 13:05:17.803332 11768 ts_tablet_manager.cc:1403] T 503bb0f5891b46de93cbac7e2a184b58 P efc52ba30a214524ba9a3705d5b5909f: Time spent bootstrapping tablet: real 0.057s	user 0.019s	sys 0.004s
I20260709 13:05:17.808063 11768 raft_consensus.cc:359] T 503bb0f5891b46de93cbac7e2a184b58 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:17.809180 11768 raft_consensus.cc:385] T 503bb0f5891b46de93cbac7e2a184b58 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.809628 11768 raft_consensus.cc:740] T 503bb0f5891b46de93cbac7e2a184b58 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc52ba30a214524ba9a3705d5b5909f, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.810992 11768 consensus_queue.cc:260] T 503bb0f5891b46de93cbac7e2a184b58 P efc52ba30a214524ba9a3705d5b5909f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:17.813189 11678 heartbeater.cc:499] Master 127.0.107.254:36585 was elected leader, sending a full tablet report...
I20260709 13:05:17.816370 11769 tablet_bootstrap.cc:492] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 645c185863fd448e91faa534d9676384: No bootstrap required, opened a new log
I20260709 13:05:17.817019 11769 ts_tablet_manager.cc:1403] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 645c185863fd448e91faa534d9676384: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.008s
I20260709 13:05:17.813504 11767 ts_tablet_manager.cc:1434] T 0c7cb06551c649a4963138881a4aa55d P 922904a85e7c45febb9f75ac6e08c44d: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.011s
I20260709 13:05:17.821035 11767 tablet_bootstrap.cc:492] T dd80d122422e4086ba85914c7dfdbe0d P 922904a85e7c45febb9f75ac6e08c44d: Bootstrap starting.
I20260709 13:05:17.821218 11752 heartbeater.cc:499] Master 127.0.107.254:36585 was elected leader, sending a full tablet report...
I20260709 13:05:17.822196 11768 ts_tablet_manager.cc:1434] T 503bb0f5891b46de93cbac7e2a184b58 P efc52ba30a214524ba9a3705d5b5909f: Time spent starting tablet: real 0.018s	user 0.016s	sys 0.001s
I20260709 13:05:17.823460 11768 tablet_bootstrap.cc:492] T dd80d122422e4086ba85914c7dfdbe0d P efc52ba30a214524ba9a3705d5b5909f: Bootstrap starting.
I20260709 13:05:17.829190 11767 tablet_bootstrap.cc:654] T dd80d122422e4086ba85914c7dfdbe0d P 922904a85e7c45febb9f75ac6e08c44d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.830164 11768 tablet_bootstrap.cc:654] T dd80d122422e4086ba85914c7dfdbe0d P efc52ba30a214524ba9a3705d5b5909f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.829115 11769 raft_consensus.cc:359] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:17.832461 11769 raft_consensus.cc:385] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.832981 11769 raft_consensus.cc:740] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 645c185863fd448e91faa534d9676384, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.834143 11769 consensus_queue.cc:260] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 645c185863fd448e91faa534d9676384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:17.838388 11769 ts_tablet_manager.cc:1434] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 645c185863fd448e91faa534d9676384: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:05:17.839236 11767 tablet_bootstrap.cc:492] T dd80d122422e4086ba85914c7dfdbe0d P 922904a85e7c45febb9f75ac6e08c44d: No bootstrap required, opened a new log
I20260709 13:05:17.839489 11769 tablet_bootstrap.cc:492] T 503bb0f5891b46de93cbac7e2a184b58 P 645c185863fd448e91faa534d9676384: Bootstrap starting.
I20260709 13:05:17.839951 11767 ts_tablet_manager.cc:1403] T dd80d122422e4086ba85914c7dfdbe0d P 922904a85e7c45febb9f75ac6e08c44d: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.004s
I20260709 13:05:17.841861 11768 tablet_bootstrap.cc:492] T dd80d122422e4086ba85914c7dfdbe0d P efc52ba30a214524ba9a3705d5b5909f: No bootstrap required, opened a new log
I20260709 13:05:17.842612 11768 ts_tablet_manager.cc:1403] T dd80d122422e4086ba85914c7dfdbe0d P efc52ba30a214524ba9a3705d5b5909f: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.005s
I20260709 13:05:17.843495 11767 raft_consensus.cc:359] T dd80d122422e4086ba85914c7dfdbe0d P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:17.844560 11767 raft_consensus.cc:385] T dd80d122422e4086ba85914c7dfdbe0d P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.844985 11767 raft_consensus.cc:740] T dd80d122422e4086ba85914c7dfdbe0d P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 922904a85e7c45febb9f75ac6e08c44d, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.846029 11767 consensus_queue.cc:260] T dd80d122422e4086ba85914c7dfdbe0d P 922904a85e7c45febb9f75ac6e08c44d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:17.846372 11768 raft_consensus.cc:359] T dd80d122422e4086ba85914c7dfdbe0d P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:17.847319 11769 tablet_bootstrap.cc:654] T 503bb0f5891b46de93cbac7e2a184b58 P 645c185863fd448e91faa534d9676384: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.849212 11767 ts_tablet_manager.cc:1434] T dd80d122422e4086ba85914c7dfdbe0d P 922904a85e7c45febb9f75ac6e08c44d: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:05:17.850473 11767 tablet_bootstrap.cc:492] T d2603633a12047678d7b85f14c0c970e P 922904a85e7c45febb9f75ac6e08c44d: Bootstrap starting.
I20260709 13:05:17.847332 11768 raft_consensus.cc:385] T dd80d122422e4086ba85914c7dfdbe0d P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.856518 11768 raft_consensus.cc:740] T dd80d122422e4086ba85914c7dfdbe0d P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc52ba30a214524ba9a3705d5b5909f, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.858302 11768 consensus_queue.cc:260] T dd80d122422e4086ba85914c7dfdbe0d P efc52ba30a214524ba9a3705d5b5909f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:17.859757 11767 tablet_bootstrap.cc:654] T d2603633a12047678d7b85f14c0c970e P 922904a85e7c45febb9f75ac6e08c44d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.861450 11768 ts_tablet_manager.cc:1434] T dd80d122422e4086ba85914c7dfdbe0d P efc52ba30a214524ba9a3705d5b5909f: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.004s
I20260709 13:05:17.862742 11768 tablet_bootstrap.cc:492] T 0c7cb06551c649a4963138881a4aa55d P efc52ba30a214524ba9a3705d5b5909f: Bootstrap starting.
I20260709 13:05:17.864636 11769 tablet_bootstrap.cc:492] T 503bb0f5891b46de93cbac7e2a184b58 P 645c185863fd448e91faa534d9676384: No bootstrap required, opened a new log
I20260709 13:05:17.865595 11769 ts_tablet_manager.cc:1403] T 503bb0f5891b46de93cbac7e2a184b58 P 645c185863fd448e91faa534d9676384: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.011s
I20260709 13:05:17.869318 11768 tablet_bootstrap.cc:654] T 0c7cb06551c649a4963138881a4aa55d P efc52ba30a214524ba9a3705d5b5909f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.870530 11769 raft_consensus.cc:359] T 503bb0f5891b46de93cbac7e2a184b58 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:17.871794 11769 raft_consensus.cc:385] T 503bb0f5891b46de93cbac7e2a184b58 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.872465 11769 raft_consensus.cc:740] T 503bb0f5891b46de93cbac7e2a184b58 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 645c185863fd448e91faa534d9676384, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.873747 11769 consensus_queue.cc:260] T 503bb0f5891b46de93cbac7e2a184b58 P 645c185863fd448e91faa534d9676384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:17.877413 11769 ts_tablet_manager.cc:1434] T 503bb0f5891b46de93cbac7e2a184b58 P 645c185863fd448e91faa534d9676384: Time spent starting tablet: real 0.011s	user 0.011s	sys 0.000s
I20260709 13:05:17.879202 11769 tablet_bootstrap.cc:492] T a3f692f94196483a9148317c2c73adcd P 645c185863fd448e91faa534d9676384: Bootstrap starting.
I20260709 13:05:17.886422 11768 tablet_bootstrap.cc:492] T 0c7cb06551c649a4963138881a4aa55d P efc52ba30a214524ba9a3705d5b5909f: No bootstrap required, opened a new log
I20260709 13:05:17.887326 11768 ts_tablet_manager.cc:1403] T 0c7cb06551c649a4963138881a4aa55d P efc52ba30a214524ba9a3705d5b5909f: Time spent bootstrapping tablet: real 0.025s	user 0.006s	sys 0.012s
I20260709 13:05:17.890105 11769 tablet_bootstrap.cc:654] T a3f692f94196483a9148317c2c73adcd P 645c185863fd448e91faa534d9676384: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.890571 11768 raft_consensus.cc:359] T 0c7cb06551c649a4963138881a4aa55d P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:17.891430 11768 raft_consensus.cc:385] T 0c7cb06551c649a4963138881a4aa55d P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.891805 11768 raft_consensus.cc:740] T 0c7cb06551c649a4963138881a4aa55d P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc52ba30a214524ba9a3705d5b5909f, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.892735 11767 tablet_bootstrap.cc:492] T d2603633a12047678d7b85f14c0c970e P 922904a85e7c45febb9f75ac6e08c44d: No bootstrap required, opened a new log
I20260709 13:05:17.893419 11767 ts_tablet_manager.cc:1403] T d2603633a12047678d7b85f14c0c970e P 922904a85e7c45febb9f75ac6e08c44d: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.023s
I20260709 13:05:17.892820 11768 consensus_queue.cc:260] T 0c7cb06551c649a4963138881a4aa55d P efc52ba30a214524ba9a3705d5b5909f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:17.896278 11768 ts_tablet_manager.cc:1434] T 0c7cb06551c649a4963138881a4aa55d P efc52ba30a214524ba9a3705d5b5909f: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.005s
I20260709 13:05:17.896526 11767 raft_consensus.cc:359] T d2603633a12047678d7b85f14c0c970e P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:17.897835 11768 tablet_bootstrap.cc:492] T 69acdb3a5cd54bc0b6921e6b343a20c2 P efc52ba30a214524ba9a3705d5b5909f: Bootstrap starting.
I20260709 13:05:17.900745 11767 raft_consensus.cc:385] T d2603633a12047678d7b85f14c0c970e P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.901386 11767 raft_consensus.cc:740] T d2603633a12047678d7b85f14c0c970e P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 922904a85e7c45febb9f75ac6e08c44d, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.902753 11767 consensus_queue.cc:260] T d2603633a12047678d7b85f14c0c970e P 922904a85e7c45febb9f75ac6e08c44d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:17.903347 11769 tablet_bootstrap.cc:492] T a3f692f94196483a9148317c2c73adcd P 645c185863fd448e91faa534d9676384: No bootstrap required, opened a new log
I20260709 13:05:17.904147 11769 ts_tablet_manager.cc:1403] T a3f692f94196483a9148317c2c73adcd P 645c185863fd448e91faa534d9676384: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.005s
I20260709 13:05:17.905534 11767 ts_tablet_manager.cc:1434] T d2603633a12047678d7b85f14c0c970e P 922904a85e7c45febb9f75ac6e08c44d: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:05:17.906879 11767 tablet_bootstrap.cc:492] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 922904a85e7c45febb9f75ac6e08c44d: Bootstrap starting.
I20260709 13:05:17.909269 11768 tablet_bootstrap.cc:654] T 69acdb3a5cd54bc0b6921e6b343a20c2 P efc52ba30a214524ba9a3705d5b5909f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.914111 11767 tablet_bootstrap.cc:654] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 922904a85e7c45febb9f75ac6e08c44d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.914418 11769 raft_consensus.cc:359] T a3f692f94196483a9148317c2c73adcd P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:17.916344 11769 raft_consensus.cc:385] T a3f692f94196483a9148317c2c73adcd P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.916910 11769 raft_consensus.cc:740] T a3f692f94196483a9148317c2c73adcd P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 645c185863fd448e91faa534d9676384, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.918287 11769 consensus_queue.cc:260] T a3f692f94196483a9148317c2c73adcd P 645c185863fd448e91faa534d9676384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:17.919678 11771 raft_consensus.cc:493] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.920351 11771 raft_consensus.cc:515] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:17.923369 11768 tablet_bootstrap.cc:492] T 69acdb3a5cd54bc0b6921e6b343a20c2 P efc52ba30a214524ba9a3705d5b5909f: No bootstrap required, opened a new log
I20260709 13:05:17.924022 11768 ts_tablet_manager.cc:1403] T 69acdb3a5cd54bc0b6921e6b343a20c2 P efc52ba30a214524ba9a3705d5b5909f: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.001s
I20260709 13:05:17.924795 11769 ts_tablet_manager.cc:1434] T a3f692f94196483a9148317c2c73adcd P 645c185863fd448e91faa534d9676384: Time spent starting tablet: real 0.020s	user 0.011s	sys 0.000s
I20260709 13:05:17.926043 11769 tablet_bootstrap.cc:492] T 6655f1f8c7674f98bd634a5f88ed3d55 P 645c185863fd448e91faa534d9676384: Bootstrap starting.
I20260709 13:05:17.927021 11774 raft_consensus.cc:493] T d2603633a12047678d7b85f14c0c970e P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.927644 11774 raft_consensus.cc:515] T d2603633a12047678d7b85f14c0c970e P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:17.927722 11768 raft_consensus.cc:359] T 69acdb3a5cd54bc0b6921e6b343a20c2 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:17.928592 11768 raft_consensus.cc:385] T 69acdb3a5cd54bc0b6921e6b343a20c2 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.928953 11768 raft_consensus.cc:740] T 69acdb3a5cd54bc0b6921e6b343a20c2 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc52ba30a214524ba9a3705d5b5909f, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.935037 11768 consensus_queue.cc:260] T 69acdb3a5cd54bc0b6921e6b343a20c2 P efc52ba30a214524ba9a3705d5b5909f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:17.938762 11768 ts_tablet_manager.cc:1434] T 69acdb3a5cd54bc0b6921e6b343a20c2 P efc52ba30a214524ba9a3705d5b5909f: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.005s
I20260709 13:05:17.940397 11768 tablet_bootstrap.cc:492] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f: Bootstrap starting.
I20260709 13:05:17.945992 11774 leader_election.cc:290] T d2603633a12047678d7b85f14c0c970e P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:17.949208 11774 raft_consensus.cc:493] T dd80d122422e4086ba85914c7dfdbe0d P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.949914 11774 raft_consensus.cc:515] T dd80d122422e4086ba85914c7dfdbe0d P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:17.952740 11768 tablet_bootstrap.cc:654] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.954360 11774 leader_election.cc:290] T dd80d122422e4086ba85914c7dfdbe0d P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:17.956547 11771 leader_election.cc:290] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:17.968140 11768 tablet_bootstrap.cc:492] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f: No bootstrap required, opened a new log
I20260709 13:05:17.969630 11768 ts_tablet_manager.cc:1403] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f: Time spent bootstrapping tablet: real 0.030s	user 0.024s	sys 0.000s
I20260709 13:05:17.963958 11769 tablet_bootstrap.cc:654] T 6655f1f8c7674f98bd634a5f88ed3d55 P 645c185863fd448e91faa534d9676384: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.975522 11768 raft_consensus.cc:359] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:17.976862 11768 raft_consensus.cc:385] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.977404 11768 raft_consensus.cc:740] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc52ba30a214524ba9a3705d5b5909f, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.979138 11768 consensus_queue.cc:260] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:17.986538 11768 ts_tablet_manager.cc:1434] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f: Time spent starting tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 13:05:17.986452 11776 raft_consensus.cc:493] T 0c7cb06551c649a4963138881a4aa55d P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.987582 11776 raft_consensus.cc:515] T 0c7cb06551c649a4963138881a4aa55d P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:17.988839 11768 tablet_bootstrap.cc:492] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f: Bootstrap starting.
I20260709 13:05:17.994477 11774 raft_consensus.cc:493] T 0c7cb06551c649a4963138881a4aa55d P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.995244 11774 raft_consensus.cc:515] T 0c7cb06551c649a4963138881a4aa55d P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:17.998271 11776 leader_election.cc:290] T 0c7cb06551c649a4963138881a4aa55d P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415)
I20260709 13:05:18.000144 11768 tablet_bootstrap.cc:654] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.000062 11774 leader_election.cc:290] T 0c7cb06551c649a4963138881a4aa55d P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
W20260709 13:05:18.011329 11524 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:18.016772 11768 tablet_bootstrap.cc:492] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f: No bootstrap required, opened a new log
I20260709 13:05:18.017900 11768 ts_tablet_manager.cc:1403] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f: Time spent bootstrapping tablet: real 0.030s	user 0.021s	sys 0.006s
I20260709 13:05:18.022711 11768 raft_consensus.cc:359] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.024183 11768 raft_consensus.cc:385] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.024807 11768 raft_consensus.cc:740] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc52ba30a214524ba9a3705d5b5909f, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.026147 11768 consensus_queue.cc:260] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.030045 11768 ts_tablet_manager.cc:1434] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f: Time spent starting tablet: real 0.012s	user 0.011s	sys 0.000s
I20260709 13:05:18.031571 11768 tablet_bootstrap.cc:492] T a3f692f94196483a9148317c2c73adcd P efc52ba30a214524ba9a3705d5b5909f: Bootstrap starting.
I20260709 13:05:18.041261 11768 tablet_bootstrap.cc:654] T a3f692f94196483a9148317c2c73adcd P efc52ba30a214524ba9a3705d5b5909f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.045001 11767 tablet_bootstrap.cc:492] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 922904a85e7c45febb9f75ac6e08c44d: No bootstrap required, opened a new log
I20260709 13:05:18.046435 11776 raft_consensus.cc:493] T 69acdb3a5cd54bc0b6921e6b343a20c2 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.047449 11776 raft_consensus.cc:515] T 69acdb3a5cd54bc0b6921e6b343a20c2 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.050935 11776 leader_election.cc:290] T 69acdb3a5cd54bc0b6921e6b343a20c2 P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415)
I20260709 13:05:18.045836 11767 ts_tablet_manager.cc:1403] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 922904a85e7c45febb9f75ac6e08c44d: Time spent bootstrapping tablet: real 0.139s	user 0.050s	sys 0.074s
I20260709 13:05:18.056181 11767 raft_consensus.cc:359] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.057629 11767 raft_consensus.cc:385] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.058209 11767 raft_consensus.cc:740] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 922904a85e7c45febb9f75ac6e08c44d, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.059937 11767 consensus_queue.cc:260] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 922904a85e7c45febb9f75ac6e08c44d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.063200 11767 ts_tablet_manager.cc:1434] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 922904a85e7c45febb9f75ac6e08c44d: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:05:18.064543 11767 tablet_bootstrap.cc:492] T 6655f1f8c7674f98bd634a5f88ed3d55 P 922904a85e7c45febb9f75ac6e08c44d: Bootstrap starting.
I20260709 13:05:18.072515 11767 tablet_bootstrap.cc:654] T 6655f1f8c7674f98bd634a5f88ed3d55 P 922904a85e7c45febb9f75ac6e08c44d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.093587 11771 raft_consensus.cc:493] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.094451 11771 raft_consensus.cc:515] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.096473 11776 raft_consensus.cc:493] T 503bb0f5891b46de93cbac7e2a184b58 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.097039 11776 raft_consensus.cc:515] T 503bb0f5891b46de93cbac7e2a184b58 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.097638 11771 leader_election.cc:290] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:18.098639 11771 raft_consensus.cc:493] T a3f692f94196483a9148317c2c73adcd P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.099196 11771 raft_consensus.cc:515] T a3f692f94196483a9148317c2c73adcd P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.099929 11776 leader_election.cc:290] T 503bb0f5891b46de93cbac7e2a184b58 P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415)
I20260709 13:05:18.100486 11776 raft_consensus.cc:493] T dd80d122422e4086ba85914c7dfdbe0d P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.100925 11776 raft_consensus.cc:515] T dd80d122422e4086ba85914c7dfdbe0d P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.103384 11776 leader_election.cc:290] T dd80d122422e4086ba85914c7dfdbe0d P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415)
I20260709 13:05:18.101485 11771 leader_election.cc:290] T a3f692f94196483a9148317c2c73adcd P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:18.108101 11769 tablet_bootstrap.cc:492] T 6655f1f8c7674f98bd634a5f88ed3d55 P 645c185863fd448e91faa534d9676384: No bootstrap required, opened a new log
I20260709 13:05:18.115984 11769 ts_tablet_manager.cc:1403] T 6655f1f8c7674f98bd634a5f88ed3d55 P 645c185863fd448e91faa534d9676384: Time spent bootstrapping tablet: real 0.190s	user 0.034s	sys 0.055s
I20260709 13:05:18.118870 11776 raft_consensus.cc:493] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.119601 11776 raft_consensus.cc:515] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.122056 11776 leader_election.cc:290] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415)
I20260709 13:05:18.124156 11769 raft_consensus.cc:359] T 6655f1f8c7674f98bd634a5f88ed3d55 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.125590 11769 raft_consensus.cc:385] T 6655f1f8c7674f98bd634a5f88ed3d55 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.126092 11769 raft_consensus.cc:740] T 6655f1f8c7674f98bd634a5f88ed3d55 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 645c185863fd448e91faa534d9676384, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.129227 11769 consensus_queue.cc:260] T 6655f1f8c7674f98bd634a5f88ed3d55 P 645c185863fd448e91faa534d9676384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.140668 11769 ts_tablet_manager.cc:1434] T 6655f1f8c7674f98bd634a5f88ed3d55 P 645c185863fd448e91faa534d9676384: Time spent starting tablet: real 0.024s	user 0.011s	sys 0.000s
I20260709 13:05:18.142041 11769 tablet_bootstrap.cc:492] T d2603633a12047678d7b85f14c0c970e P 645c185863fd448e91faa534d9676384: Bootstrap starting.
I20260709 13:05:18.144989 11725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f692f94196483a9148317c2c73adcd" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc52ba30a214524ba9a3705d5b5909f" is_pre_election: true
I20260709 13:05:18.147029 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2253eb70f9fa4f77b87a1522e2a7a4f0" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc52ba30a214524ba9a3705d5b5909f" is_pre_election: true
I20260709 13:05:18.148986 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69acdb3a5cd54bc0b6921e6b343a20c2" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc52ba30a214524ba9a3705d5b5909f" is_pre_election: true
I20260709 13:05:18.149854 11769 tablet_bootstrap.cc:654] T d2603633a12047678d7b85f14c0c970e P 645c185863fd448e91faa534d9676384: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.150111 11726 raft_consensus.cc:2468] T 69acdb3a5cd54bc0b6921e6b343a20c2 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 645c185863fd448e91faa534d9676384 in term 0.
W20260709 13:05:18.151662 11541 leader_election.cc:343] T a3f692f94196483a9148317c2c73adcd P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:18.152660 11541 leader_election.cc:343] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.153620 11541 leader_election.cc:304] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645c185863fd448e91faa534d9676384, efc52ba30a214524ba9a3705d5b5909f; no voters: 
I20260709 13:05:18.153821 11725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7cb06551c649a4963138881a4aa55d" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc52ba30a214524ba9a3705d5b5909f" is_pre_election: true
I20260709 13:05:18.156145 11725 raft_consensus.cc:2468] T 0c7cb06551c649a4963138881a4aa55d P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 922904a85e7c45febb9f75ac6e08c44d in term 0.
I20260709 13:05:18.154630 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80d122422e4086ba85914c7dfdbe0d" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc52ba30a214524ba9a3705d5b5909f" is_pre_election: true
I20260709 13:05:18.158164 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2603633a12047678d7b85f14c0c970e" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc52ba30a214524ba9a3705d5b5909f" is_pre_election: true
I20260709 13:05:18.157305 11727 raft_consensus.cc:2468] T dd80d122422e4086ba85914c7dfdbe0d P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 922904a85e7c45febb9f75ac6e08c44d in term 0.
I20260709 13:05:18.161723 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2253eb70f9fa4f77b87a1522e2a7a4f0" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922904a85e7c45febb9f75ac6e08c44d" is_pre_election: true
I20260709 13:05:18.162693 11616 leader_election.cc:304] T 0c7cb06551c649a4963138881a4aa55d P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 922904a85e7c45febb9f75ac6e08c44d, efc52ba30a214524ba9a3705d5b5909f; no voters: 
I20260709 13:05:18.163437 11768 tablet_bootstrap.cc:492] T a3f692f94196483a9148317c2c73adcd P efc52ba30a214524ba9a3705d5b5909f: No bootstrap required, opened a new log
I20260709 13:05:18.163259 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69acdb3a5cd54bc0b6921e6b343a20c2" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922904a85e7c45febb9f75ac6e08c44d" is_pre_election: true
I20260709 13:05:18.163697 11774 raft_consensus.cc:2804] T 0c7cb06551c649a4963138881a4aa55d P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:18.164041 11652 raft_consensus.cc:2468] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 645c185863fd448e91faa534d9676384 in term 0.
I20260709 13:05:18.164116 11774 raft_consensus.cc:493] T 0c7cb06551c649a4963138881a4aa55d P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.164557 11769 tablet_bootstrap.cc:492] T d2603633a12047678d7b85f14c0c970e P 645c185863fd448e91faa534d9676384: No bootstrap required, opened a new log
I20260709 13:05:18.164692 11774 raft_consensus.cc:3060] T 0c7cb06551c649a4963138881a4aa55d P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.164017 11768 ts_tablet_manager.cc:1403] T a3f692f94196483a9148317c2c73adcd P efc52ba30a214524ba9a3705d5b5909f: Time spent bootstrapping tablet: real 0.133s	user 0.029s	sys 0.051s
I20260709 13:05:18.165174 11769 ts_tablet_manager.cc:1403] T d2603633a12047678d7b85f14c0c970e P 645c185863fd448e91faa534d9676384: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.003s
I20260709 13:05:18.166481 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f692f94196483a9148317c2c73adcd" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922904a85e7c45febb9f75ac6e08c44d" is_pre_election: true
W20260709 13:05:18.168408 11544 leader_election.cc:343] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.168896 11544 leader_election.cc:304] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 645c185863fd448e91faa534d9676384; no voters: 922904a85e7c45febb9f75ac6e08c44d, efc52ba30a214524ba9a3705d5b5909f
W20260709 13:05:18.170470 11616 leader_election.cc:343] T d2603633a12047678d7b85f14c0c970e P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.170660 11769 raft_consensus.cc:359] T d2603633a12047678d7b85f14c0c970e P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.171339 11771 raft_consensus.cc:2749] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:18.171608 11769 raft_consensus.cc:385] T d2603633a12047678d7b85f14c0c970e P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.171990 11769 raft_consensus.cc:740] T d2603633a12047678d7b85f14c0c970e P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 645c185863fd448e91faa534d9676384, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.172044 11616 leader_election.cc:304] T dd80d122422e4086ba85914c7dfdbe0d P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 922904a85e7c45febb9f75ac6e08c44d, efc52ba30a214524ba9a3705d5b5909f; no voters: 
I20260709 13:05:18.172833 11769 consensus_queue.cc:260] T d2603633a12047678d7b85f14c0c970e P 645c185863fd448e91faa534d9676384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.178506 11769 ts_tablet_manager.cc:1434] T d2603633a12047678d7b85f14c0c970e P 645c185863fd448e91faa534d9676384: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 13:05:18.168670 11768 raft_consensus.cc:359] T a3f692f94196483a9148317c2c73adcd P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.179957 11769 tablet_bootstrap.cc:492] T b6555ed9a2e04888ac596b8dbe747265 P 645c185863fd448e91faa534d9676384: Bootstrap starting.
I20260709 13:05:18.180357 11768 raft_consensus.cc:385] T a3f692f94196483a9148317c2c73adcd P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.181018 11771 raft_consensus.cc:2804] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:18.185016 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7cb06551c649a4963138881a4aa55d" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922904a85e7c45febb9f75ac6e08c44d" is_pre_election: true
I20260709 13:05:18.187310 11768 raft_consensus.cc:740] T a3f692f94196483a9148317c2c73adcd P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc52ba30a214524ba9a3705d5b5909f, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.188295 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69acdb3a5cd54bc0b6921e6b343a20c2" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922904a85e7c45febb9f75ac6e08c44d" is_pre_election: true
I20260709 13:05:18.186216 11802 raft_consensus.cc:2804] T dd80d122422e4086ba85914c7dfdbe0d P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:18.182458 11578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2603633a12047678d7b85f14c0c970e" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645c185863fd448e91faa534d9676384" is_pre_election: true
I20260709 13:05:18.189021 11802 raft_consensus.cc:493] T dd80d122422e4086ba85914c7dfdbe0d P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.183772 11576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7cb06551c649a4963138881a4aa55d" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645c185863fd448e91faa534d9676384" is_pre_election: true
I20260709 13:05:18.190151 11802 raft_consensus.cc:3060] T dd80d122422e4086ba85914c7dfdbe0d P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.183080 11577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80d122422e4086ba85914c7dfdbe0d" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645c185863fd448e91faa534d9676384" is_pre_election: true
I20260709 13:05:18.191269 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80d122422e4086ba85914c7dfdbe0d" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922904a85e7c45febb9f75ac6e08c44d" is_pre_election: true
I20260709 13:05:18.189013 11653 raft_consensus.cc:2468] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc52ba30a214524ba9a3705d5b5909f in term 0.
I20260709 13:05:18.192566 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503bb0f5891b46de93cbac7e2a184b58" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922904a85e7c45febb9f75ac6e08c44d" is_pre_election: true
I20260709 13:05:18.181715 11785 raft_consensus.cc:493] T d2603633a12047678d7b85f14c0c970e P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.194258 11575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503bb0f5891b46de93cbac7e2a184b58" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645c185863fd448e91faa534d9676384" is_pre_election: true
I20260709 13:05:18.194518 11774 raft_consensus.cc:515] T 0c7cb06551c649a4963138881a4aa55d P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.194867 11574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80d122422e4086ba85914c7dfdbe0d" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645c185863fd448e91faa534d9676384" is_pre_election: true
I20260709 13:05:18.195104 11575 raft_consensus.cc:2468] T 503bb0f5891b46de93cbac7e2a184b58 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc52ba30a214524ba9a3705d5b5909f in term 0.
I20260709 13:05:18.196172 11785 raft_consensus.cc:515] T d2603633a12047678d7b85f14c0c970e P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.196655 11573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6655f1f8c7674f98bd634a5f88ed3d55" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645c185863fd448e91faa534d9676384" is_pre_election: true
I20260709 13:05:18.197539 11573 raft_consensus.cc:2468] T 6655f1f8c7674f98bd634a5f88ed3d55 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc52ba30a214524ba9a3705d5b5909f in term 0.
I20260709 13:05:18.198824 11785 leader_election.cc:290] T d2603633a12047678d7b85f14c0c970e P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:18.198935 11576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69acdb3a5cd54bc0b6921e6b343a20c2" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645c185863fd448e91faa534d9676384" is_pre_election: true
I20260709 13:05:18.200062 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6655f1f8c7674f98bd634a5f88ed3d55" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922904a85e7c45febb9f75ac6e08c44d" is_pre_election: true
I20260709 13:05:18.200193 11578 raft_consensus.cc:2468] T d2603633a12047678d7b85f14c0c970e P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 922904a85e7c45febb9f75ac6e08c44d in term 0.
I20260709 13:05:18.200387 11577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7cb06551c649a4963138881a4aa55d" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645c185863fd448e91faa534d9676384" is_pre_election: true
I20260709 13:05:18.202198 11693 leader_election.cc:304] T 69acdb3a5cd54bc0b6921e6b343a20c2 P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 922904a85e7c45febb9f75ac6e08c44d, efc52ba30a214524ba9a3705d5b5909f; no voters: 
I20260709 13:05:18.203238 11776 raft_consensus.cc:2804] T 69acdb3a5cd54bc0b6921e6b343a20c2 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:05:18.184060 11544 leader_election.cc:343] T a3f692f94196483a9148317c2c73adcd P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.203720 11776 raft_consensus.cc:493] T 69acdb3a5cd54bc0b6921e6b343a20c2 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.204123 11776 raft_consensus.cc:3060] T 69acdb3a5cd54bc0b6921e6b343a20c2 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.186962 11771 raft_consensus.cc:493] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:18.204478 11619 leader_election.cc:343] T 0c7cb06551c649a4963138881a4aa55d P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 645c185863fd448e91faa534d9676384 (127.0.107.193:37707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.204689 11771 raft_consensus.cc:3060] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.205755 11769 tablet_bootstrap.cc:654] T b6555ed9a2e04888ac596b8dbe747265 P 645c185863fd448e91faa534d9676384: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:18.206081 11619 leader_election.cc:343] T dd80d122422e4086ba85914c7dfdbe0d P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 645c185863fd448e91faa534d9676384 (127.0.107.193:37707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.188486 11768 consensus_queue.cc:260] T a3f692f94196483a9148317c2c73adcd P efc52ba30a214524ba9a3705d5b5909f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.208567 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2603633a12047678d7b85f14c0c970e" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc52ba30a214524ba9a3705d5b5909f" is_pre_election: true
I20260709 13:05:18.209045 11652 raft_consensus.cc:2393] T 0c7cb06551c649a4963138881a4aa55d P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc52ba30a214524ba9a3705d5b5909f in current term 1: Already voted for candidate 922904a85e7c45febb9f75ac6e08c44d in this term.
I20260709 13:05:18.210719 11619 leader_election.cc:304] T d2603633a12047678d7b85f14c0c970e P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 645c185863fd448e91faa534d9676384, 922904a85e7c45febb9f75ac6e08c44d; no voters: efc52ba30a214524ba9a3705d5b5909f
I20260709 13:05:18.215128 11767 tablet_bootstrap.cc:492] T 6655f1f8c7674f98bd634a5f88ed3d55 P 922904a85e7c45febb9f75ac6e08c44d: No bootstrap required, opened a new log
I20260709 13:05:18.204041 11544 leader_election.cc:304] T a3f692f94196483a9148317c2c73adcd P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 645c185863fd448e91faa534d9676384; no voters: 922904a85e7c45febb9f75ac6e08c44d, efc52ba30a214524ba9a3705d5b5909f
I20260709 13:05:18.215651 11771 raft_consensus.cc:515] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.227533 11767 ts_tablet_manager.cc:1403] T 6655f1f8c7674f98bd634a5f88ed3d55 P 922904a85e7c45febb9f75ac6e08c44d: Time spent bootstrapping tablet: real 0.163s	user 0.023s	sys 0.050s
I20260709 13:05:18.228528 11785 raft_consensus.cc:2749] T a3f692f94196483a9148317c2c73adcd P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:18.221223 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7cb06551c649a4963138881a4aa55d" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc52ba30a214524ba9a3705d5b5909f"
W20260709 13:05:18.215837 11541 leader_election.cc:343] T d2603633a12047678d7b85f14c0c970e P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.224206 11774 leader_election.cc:290] T 0c7cb06551c649a4963138881a4aa55d P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 election: Requested vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:18.219383 11776 raft_consensus.cc:515] T 69acdb3a5cd54bc0b6921e6b343a20c2 P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.227035 11768 ts_tablet_manager.cc:1434] T a3f692f94196483a9148317c2c73adcd P efc52ba30a214524ba9a3705d5b5909f: Time spent starting tablet: real 0.062s	user 0.008s	sys 0.000s
W20260709 13:05:18.228706 11544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45415, user_credentials={real_user=slave}} blocked reactor thread for 44714.5us
I20260709 13:05:18.229557 11727 raft_consensus.cc:3060] T 0c7cb06551c649a4963138881a4aa55d P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.231547 11768 tablet_bootstrap.cc:492] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P efc52ba30a214524ba9a3705d5b5909f: Bootstrap starting.
I20260709 13:05:18.232074 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2603633a12047678d7b85f14c0c970e" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922904a85e7c45febb9f75ac6e08c44d" is_pre_election: true
I20260709 13:05:18.238034 11767 raft_consensus.cc:359] T 6655f1f8c7674f98bd634a5f88ed3d55 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.239231 11576 raft_consensus.cc:2393] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc52ba30a214524ba9a3705d5b5909f in current term 1: Already voted for candidate 645c185863fd448e91faa534d9676384 in this term.
I20260709 13:05:18.231448 11776 leader_election.cc:290] T 69acdb3a5cd54bc0b6921e6b343a20c2 P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 election: Requested vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415)
I20260709 13:05:18.230177 11774 raft_consensus.cc:2804] T d2603633a12047678d7b85f14c0c970e P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:18.241590 11774 raft_consensus.cc:493] T d2603633a12047678d7b85f14c0c970e P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.242233 11774 raft_consensus.cc:3060] T d2603633a12047678d7b85f14c0c970e P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.242333 11802 raft_consensus.cc:515] T dd80d122422e4086ba85914c7dfdbe0d P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.244112 11650 raft_consensus.cc:2393] T dd80d122422e4086ba85914c7dfdbe0d P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc52ba30a214524ba9a3705d5b5909f in current term 1: Already voted for candidate 922904a85e7c45febb9f75ac6e08c44d in this term.
I20260709 13:05:18.249536 11776 raft_consensus.cc:493] T a3f692f94196483a9148317c2c73adcd P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.250567 11776 raft_consensus.cc:515] T a3f692f94196483a9148317c2c73adcd P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
W20260709 13:05:18.217486 11693 leader_election.cc:343] T 503bb0f5891b46de93cbac7e2a184b58 P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:18.253873 11693 leader_election.cc:343] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.262581 11768 tablet_bootstrap.cc:654] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P efc52ba30a214524ba9a3705d5b5909f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.265982 11576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69acdb3a5cd54bc0b6921e6b343a20c2" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645c185863fd448e91faa534d9676384"
I20260709 13:05:18.266963 11576 raft_consensus.cc:2393] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate efc52ba30a214524ba9a3705d5b5909f in current term 1: Already voted for candidate 645c185863fd448e91faa534d9676384 in this term.
I20260709 13:05:18.267441 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69acdb3a5cd54bc0b6921e6b343a20c2" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc52ba30a214524ba9a3705d5b5909f"
I20260709 13:05:18.268267 11726 raft_consensus.cc:2393] T 69acdb3a5cd54bc0b6921e6b343a20c2 P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 645c185863fd448e91faa534d9676384 in current term 1: Already voted for candidate efc52ba30a214524ba9a3705d5b5909f in this term.
I20260709 13:05:18.269236 11776 leader_election.cc:290] T a3f692f94196483a9148317c2c73adcd P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415)
I20260709 13:05:18.270051 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69acdb3a5cd54bc0b6921e6b343a20c2" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922904a85e7c45febb9f75ac6e08c44d"
I20260709 13:05:18.270841 11651 raft_consensus.cc:3060] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.270426 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80d122422e4086ba85914c7dfdbe0d" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc52ba30a214524ba9a3705d5b5909f"
I20260709 13:05:18.271579 11726 raft_consensus.cc:3060] T dd80d122422e4086ba85914c7dfdbe0d P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.266160 11771 leader_election.cc:290] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 election: Requested vote from peers 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:18.239225 11767 raft_consensus.cc:385] T 6655f1f8c7674f98bd634a5f88ed3d55 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.273039 11802 leader_election.cc:290] T dd80d122422e4086ba85914c7dfdbe0d P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 election: Requested vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:18.273407 11767 raft_consensus.cc:740] T 6655f1f8c7674f98bd634a5f88ed3d55 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 922904a85e7c45febb9f75ac6e08c44d, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.274338 11767 consensus_queue.cc:260] T 6655f1f8c7674f98bd634a5f88ed3d55 P 922904a85e7c45febb9f75ac6e08c44d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.277248 11727 raft_consensus.cc:2468] T 0c7cb06551c649a4963138881a4aa55d P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 922904a85e7c45febb9f75ac6e08c44d in term 1.
I20260709 13:05:18.278956 11616 leader_election.cc:304] T 0c7cb06551c649a4963138881a4aa55d P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 922904a85e7c45febb9f75ac6e08c44d, efc52ba30a214524ba9a3705d5b5909f; no voters: 
I20260709 13:05:18.279569 11767 ts_tablet_manager.cc:1434] T 6655f1f8c7674f98bd634a5f88ed3d55 P 922904a85e7c45febb9f75ac6e08c44d: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 13:05:18.280062 11802 raft_consensus.cc:2804] T 0c7cb06551c649a4963138881a4aa55d P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:18.280613 11802 raft_consensus.cc:697] T 0c7cb06551c649a4963138881a4aa55d P 922904a85e7c45febb9f75ac6e08c44d [term 1 LEADER]: Becoming Leader. State: Replica: 922904a85e7c45febb9f75ac6e08c44d, State: Running, Role: LEADER
I20260709 13:05:18.281700 11802 consensus_queue.cc:237] T 0c7cb06551c649a4963138881a4aa55d P 922904a85e7c45febb9f75ac6e08c44d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.282680 11576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f692f94196483a9148317c2c73adcd" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645c185863fd448e91faa534d9676384" is_pre_election: true
I20260709 13:05:18.283504 11576 raft_consensus.cc:2468] T a3f692f94196483a9148317c2c73adcd P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc52ba30a214524ba9a3705d5b5909f in term 0.
I20260709 13:05:18.283713 11726 raft_consensus.cc:2468] T dd80d122422e4086ba85914c7dfdbe0d P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 922904a85e7c45febb9f75ac6e08c44d in term 1.
W20260709 13:05:18.284583 11619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37707, user_credentials={real_user=slave}} blocked reactor thread for 73959.3us
I20260709 13:05:18.287122 11769 tablet_bootstrap.cc:492] T b6555ed9a2e04888ac596b8dbe747265 P 645c185863fd448e91faa534d9676384: No bootstrap required, opened a new log
I20260709 13:05:18.287819 11769 ts_tablet_manager.cc:1403] T b6555ed9a2e04888ac596b8dbe747265 P 645c185863fd448e91faa534d9676384: Time spent bootstrapping tablet: real 0.108s	user 0.013s	sys 0.000s
I20260709 13:05:18.285279 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69acdb3a5cd54bc0b6921e6b343a20c2" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922904a85e7c45febb9f75ac6e08c44d"
I20260709 13:05:18.289505 11575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7cb06551c649a4963138881a4aa55d" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645c185863fd448e91faa534d9676384"
I20260709 13:05:18.289611 11573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80d122422e4086ba85914c7dfdbe0d" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645c185863fd448e91faa534d9676384"
I20260709 13:05:18.283751 11774 raft_consensus.cc:515] T d2603633a12047678d7b85f14c0c970e P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.292914 11616 leader_election.cc:304] T dd80d122422e4086ba85914c7dfdbe0d P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 922904a85e7c45febb9f75ac6e08c44d, efc52ba30a214524ba9a3705d5b5909f; no voters: 
W20260709 13:05:18.293042 11619 leader_election.cc:343] T 0c7cb06551c649a4963138881a4aa55d P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 645c185863fd448e91faa534d9676384 (127.0.107.193:37707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.294076 11652 raft_consensus.cc:2393] T d2603633a12047678d7b85f14c0c970e P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 645c185863fd448e91faa534d9676384 in current term 1: Already voted for candidate 922904a85e7c45febb9f75ac6e08c44d in this term.
W20260709 13:05:18.294400 11619 leader_election.cc:343] T dd80d122422e4086ba85914c7dfdbe0d P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 645c185863fd448e91faa534d9676384 (127.0.107.193:37707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.295938 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2603633a12047678d7b85f14c0c970e" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc52ba30a214524ba9a3705d5b5909f"
I20260709 13:05:18.296892 11803 raft_consensus.cc:2804] T dd80d122422e4086ba85914c7dfdbe0d P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:18.297204 11576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2603633a12047678d7b85f14c0c970e" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645c185863fd448e91faa534d9676384"
I20260709 13:05:18.294481 11774 leader_election.cc:290] T d2603633a12047678d7b85f14c0c970e P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 election: Requested vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:18.295074 11767 tablet_bootstrap.cc:492] T b6555ed9a2e04888ac596b8dbe747265 P 922904a85e7c45febb9f75ac6e08c44d: Bootstrap starting.
W20260709 13:05:18.298511 11616 leader_election.cc:343] T d2603633a12047678d7b85f14c0c970e P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.298183 11576 raft_consensus.cc:3060] T d2603633a12047678d7b85f14c0c970e P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.298672 11651 raft_consensus.cc:2468] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc52ba30a214524ba9a3705d5b5909f in term 1.
W20260709 13:05:18.298295 11693 leader_election.cc:343] T dd80d122422e4086ba85914c7dfdbe0d P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 645c185863fd448e91faa534d9676384 (127.0.107.193:37707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.303889 11769 raft_consensus.cc:359] T b6555ed9a2e04888ac596b8dbe747265 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.304935 11769 raft_consensus.cc:385] T b6555ed9a2e04888ac596b8dbe747265 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:05:18.305173 11693 leader_election.cc:343] T 0c7cb06551c649a4963138881a4aa55d P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 645c185863fd448e91faa534d9676384 (127.0.107.193:37707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.305401 11769 raft_consensus.cc:740] T b6555ed9a2e04888ac596b8dbe747265 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 645c185863fd448e91faa534d9676384, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.305709 11693 leader_election.cc:304] T 0c7cb06551c649a4963138881a4aa55d P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc52ba30a214524ba9a3705d5b5909f; no voters: 645c185863fd448e91faa534d9676384, 922904a85e7c45febb9f75ac6e08c44d
I20260709 13:05:18.306557 11776 raft_consensus.cc:2749] T 0c7cb06551c649a4963138881a4aa55d P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:18.306648 11769 consensus_queue.cc:260] T b6555ed9a2e04888ac596b8dbe747265 P 645c185863fd448e91faa534d9676384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.309324 11769 ts_tablet_manager.cc:1434] T b6555ed9a2e04888ac596b8dbe747265 P 645c185863fd448e91faa534d9676384: Time spent starting tablet: real 0.021s	user 0.010s	sys 0.001s
I20260709 13:05:18.309270 11693 leader_election.cc:304] T 503bb0f5891b46de93cbac7e2a184b58 P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 645c185863fd448e91faa534d9676384, efc52ba30a214524ba9a3705d5b5909f; no voters: 922904a85e7c45febb9f75ac6e08c44d
I20260709 13:05:18.311015 11776 raft_consensus.cc:2804] T 503bb0f5891b46de93cbac7e2a184b58 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:18.311947 11769 tablet_bootstrap.cc:492] T 0c7cb06551c649a4963138881a4aa55d P 645c185863fd448e91faa534d9676384: Bootstrap starting.
I20260709 13:05:18.311980 11776 raft_consensus.cc:493] T 503bb0f5891b46de93cbac7e2a184b58 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.316059 11776 raft_consensus.cc:3060] T 503bb0f5891b46de93cbac7e2a184b58 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.299727 11544 leader_election.cc:304] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 645c185863fd448e91faa534d9676384; no voters: 922904a85e7c45febb9f75ac6e08c44d, efc52ba30a214524ba9a3705d5b5909f
I20260709 13:05:18.315544 11693 leader_election.cc:304] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 645c185863fd448e91faa534d9676384, efc52ba30a214524ba9a3705d5b5909f; no voters: 922904a85e7c45febb9f75ac6e08c44d
I20260709 13:05:18.323222 11800 raft_consensus.cc:2804] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:18.323652 11800 raft_consensus.cc:493] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.323982 11800 raft_consensus.cc:3060] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.324617 11768 tablet_bootstrap.cc:492] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P efc52ba30a214524ba9a3705d5b5909f: No bootstrap required, opened a new log
I20260709 13:05:18.325184 11768 ts_tablet_manager.cc:1403] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P efc52ba30a214524ba9a3705d5b5909f: Time spent bootstrapping tablet: real 0.094s	user 0.014s	sys 0.003s
I20260709 13:05:18.327351 11544 leader_election.cc:304] T d2603633a12047678d7b85f14c0c970e P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 645c185863fd448e91faa534d9676384; no voters: 922904a85e7c45febb9f75ac6e08c44d, efc52ba30a214524ba9a3705d5b5909f
I20260709 13:05:18.328528 11785 raft_consensus.cc:2749] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:18.328213 11768 raft_consensus.cc:359] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.324972 11767 tablet_bootstrap.cc:654] T b6555ed9a2e04888ac596b8dbe747265 P 922904a85e7c45febb9f75ac6e08c44d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.331013 11768 raft_consensus.cc:385] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.331434 11768 raft_consensus.cc:740] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc52ba30a214524ba9a3705d5b5909f, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.332746 11769 tablet_bootstrap.cc:654] T 0c7cb06551c649a4963138881a4aa55d P 645c185863fd448e91faa534d9676384: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.332499 11768 consensus_queue.cc:260] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P efc52ba30a214524ba9a3705d5b5909f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.321976 11803 raft_consensus.cc:697] T dd80d122422e4086ba85914c7dfdbe0d P 922904a85e7c45febb9f75ac6e08c44d [term 1 LEADER]: Becoming Leader. State: Replica: 922904a85e7c45febb9f75ac6e08c44d, State: Running, Role: LEADER
I20260709 13:05:18.339566 11768 ts_tablet_manager.cc:1434] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P efc52ba30a214524ba9a3705d5b5909f: Time spent starting tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:05:18.340574 11768 tablet_bootstrap.cc:492] T d2603633a12047678d7b85f14c0c970e P efc52ba30a214524ba9a3705d5b5909f: Bootstrap starting.
I20260709 13:05:18.345292 11576 raft_consensus.cc:2468] T d2603633a12047678d7b85f14c0c970e P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 922904a85e7c45febb9f75ac6e08c44d in term 1.
I20260709 13:05:18.347565 11771 raft_consensus.cc:2749] T d2603633a12047678d7b85f14c0c970e P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:18.338608 11800 raft_consensus.cc:515] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.352155 11800 leader_election.cc:290] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 election: Requested vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415)
I20260709 13:05:18.352525 11619 leader_election.cc:304] T d2603633a12047678d7b85f14c0c970e P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 645c185863fd448e91faa534d9676384, 922904a85e7c45febb9f75ac6e08c44d; no voters: efc52ba30a214524ba9a3705d5b5909f
I20260709 13:05:18.353567 11776 raft_consensus.cc:515] T 503bb0f5891b46de93cbac7e2a184b58 P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.354156 11693 leader_election.cc:304] T a3f692f94196483a9148317c2c73adcd P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645c185863fd448e91faa534d9676384, efc52ba30a214524ba9a3705d5b5909f; no voters: 
I20260709 13:05:18.355921 11776 leader_election.cc:290] T 503bb0f5891b46de93cbac7e2a184b58 P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 election: Requested vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415)
I20260709 13:05:18.356551 11776 raft_consensus.cc:2804] T a3f692f94196483a9148317c2c73adcd P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:18.356374 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f692f94196483a9148317c2c73adcd" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922904a85e7c45febb9f75ac6e08c44d" is_pre_election: true
I20260709 13:05:18.357589 11807 raft_consensus.cc:2804] T d2603633a12047678d7b85f14c0c970e P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:18.358366 11807 raft_consensus.cc:697] T d2603633a12047678d7b85f14c0c970e P 922904a85e7c45febb9f75ac6e08c44d [term 1 LEADER]: Becoming Leader. State: Replica: 922904a85e7c45febb9f75ac6e08c44d, State: Running, Role: LEADER
I20260709 13:05:18.359283 11807 consensus_queue.cc:237] T d2603633a12047678d7b85f14c0c970e P 922904a85e7c45febb9f75ac6e08c44d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.360330 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6655f1f8c7674f98bd634a5f88ed3d55" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922904a85e7c45febb9f75ac6e08c44d"
I20260709 13:05:18.360769 11768 tablet_bootstrap.cc:654] T d2603633a12047678d7b85f14c0c970e P efc52ba30a214524ba9a3705d5b5909f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.360977 11651 raft_consensus.cc:3060] T 6655f1f8c7674f98bd634a5f88ed3d55 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.356941 11776 raft_consensus.cc:493] T a3f692f94196483a9148317c2c73adcd P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.363039 11776 raft_consensus.cc:3060] T a3f692f94196483a9148317c2c73adcd P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.373119 11576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6655f1f8c7674f98bd634a5f88ed3d55" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645c185863fd448e91faa534d9676384"
I20260709 13:05:18.373248 11803 consensus_queue.cc:237] T dd80d122422e4086ba85914c7dfdbe0d P 922904a85e7c45febb9f75ac6e08c44d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.375275 11767 tablet_bootstrap.cc:492] T b6555ed9a2e04888ac596b8dbe747265 P 922904a85e7c45febb9f75ac6e08c44d: No bootstrap required, opened a new log
I20260709 13:05:18.376004 11767 ts_tablet_manager.cc:1403] T b6555ed9a2e04888ac596b8dbe747265 P 922904a85e7c45febb9f75ac6e08c44d: Time spent bootstrapping tablet: real 0.081s	user 0.022s	sys 0.021s
I20260709 13:05:18.377665 11693 leader_election.cc:304] T dd80d122422e4086ba85914c7dfdbe0d P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc52ba30a214524ba9a3705d5b5909f; no voters: 645c185863fd448e91faa534d9676384, 922904a85e7c45febb9f75ac6e08c44d
I20260709 13:05:18.379145 11693 leader_election.cc:304] T 69acdb3a5cd54bc0b6921e6b343a20c2 P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 922904a85e7c45febb9f75ac6e08c44d, efc52ba30a214524ba9a3705d5b5909f; no voters: 645c185863fd448e91faa534d9676384
I20260709 13:05:18.375231 11576 raft_consensus.cc:3060] T 6655f1f8c7674f98bd634a5f88ed3d55 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.379556 11767 raft_consensus.cc:359] T b6555ed9a2e04888ac596b8dbe747265 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.383123 11767 raft_consensus.cc:385] T b6555ed9a2e04888ac596b8dbe747265 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:05:18.383548 11693 leader_election.cc:343] T a3f692f94196483a9148317c2c73adcd P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.383567 11767 raft_consensus.cc:740] T b6555ed9a2e04888ac596b8dbe747265 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 922904a85e7c45febb9f75ac6e08c44d, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.384357 11768 tablet_bootstrap.cc:492] T d2603633a12047678d7b85f14c0c970e P efc52ba30a214524ba9a3705d5b5909f: No bootstrap required, opened a new log
I20260709 13:05:18.385251 11769 tablet_bootstrap.cc:492] T 0c7cb06551c649a4963138881a4aa55d P 645c185863fd448e91faa534d9676384: No bootstrap required, opened a new log
I20260709 13:05:18.385475 11768 ts_tablet_manager.cc:1403] T d2603633a12047678d7b85f14c0c970e P efc52ba30a214524ba9a3705d5b5909f: Time spent bootstrapping tablet: real 0.045s	user 0.008s	sys 0.008s
I20260709 13:05:18.379633 11776 raft_consensus.cc:515] T a3f692f94196483a9148317c2c73adcd P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.385707 11769 ts_tablet_manager.cc:1403] T 0c7cb06551c649a4963138881a4aa55d P 645c185863fd448e91faa534d9676384: Time spent bootstrapping tablet: real 0.075s	user 0.018s	sys 0.003s
I20260709 13:05:18.386826 11767 consensus_queue.cc:260] T b6555ed9a2e04888ac596b8dbe747265 P 922904a85e7c45febb9f75ac6e08c44d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.385074 11800 raft_consensus.cc:2804] T 69acdb3a5cd54bc0b6921e6b343a20c2 P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:18.391713 11776 leader_election.cc:290] T a3f692f94196483a9148317c2c73adcd P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 election: Requested vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415)
I20260709 13:05:18.392522 11768 raft_consensus.cc:359] T d2603633a12047678d7b85f14c0c970e P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.393359 11768 raft_consensus.cc:385] T d2603633a12047678d7b85f14c0c970e P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.393664 11768 raft_consensus.cc:740] T d2603633a12047678d7b85f14c0c970e P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc52ba30a214524ba9a3705d5b5909f, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.397562 11768 consensus_queue.cc:260] T d2603633a12047678d7b85f14c0c970e P efc52ba30a214524ba9a3705d5b5909f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.393123 11573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503bb0f5891b46de93cbac7e2a184b58" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645c185863fd448e91faa534d9676384"
I20260709 13:05:18.398644 11573 raft_consensus.cc:3060] T 503bb0f5891b46de93cbac7e2a184b58 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.401324 11776 raft_consensus.cc:493] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.380681 11809 raft_consensus.cc:2749] T dd80d122422e4086ba85914c7dfdbe0d P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:18.398041 11769 raft_consensus.cc:359] T 0c7cb06551c649a4963138881a4aa55d P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.400053 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503bb0f5891b46de93cbac7e2a184b58" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922904a85e7c45febb9f75ac6e08c44d"
I20260709 13:05:18.406472 11769 raft_consensus.cc:385] T 0c7cb06551c649a4963138881a4aa55d P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.406869 11769 raft_consensus.cc:740] T 0c7cb06551c649a4963138881a4aa55d P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 645c185863fd448e91faa534d9676384, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.407835 11768 ts_tablet_manager.cc:1434] T d2603633a12047678d7b85f14c0c970e P efc52ba30a214524ba9a3705d5b5909f: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:05:18.409937 11575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f692f94196483a9148317c2c73adcd" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645c185863fd448e91faa534d9676384"
I20260709 13:05:18.405642 11776 raft_consensus.cc:515] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.410667 11575 raft_consensus.cc:3060] T a3f692f94196483a9148317c2c73adcd P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.412961 11776 leader_election.cc:290] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415)
I20260709 13:05:18.414217 11769 consensus_queue.cc:260] T 0c7cb06551c649a4963138881a4aa55d P 645c185863fd448e91faa534d9676384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.414907 11573 raft_consensus.cc:2468] T 503bb0f5891b46de93cbac7e2a184b58 P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc52ba30a214524ba9a3705d5b5909f in term 1.
I20260709 13:05:18.416887 11576 raft_consensus.cc:2468] T 6655f1f8c7674f98bd634a5f88ed3d55 P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc52ba30a214524ba9a3705d5b5909f in term 1.
I20260709 13:05:18.419010 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f692f94196483a9148317c2c73adcd" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922904a85e7c45febb9f75ac6e08c44d"
I20260709 13:05:18.422237 11573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6555ed9a2e04888ac596b8dbe747265" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645c185863fd448e91faa534d9676384" is_pre_election: true
I20260709 13:05:18.422389 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6555ed9a2e04888ac596b8dbe747265" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922904a85e7c45febb9f75ac6e08c44d" is_pre_election: true
I20260709 13:05:18.422956 11573 raft_consensus.cc:2468] T b6555ed9a2e04888ac596b8dbe747265 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc52ba30a214524ba9a3705d5b5909f in term 0.
I20260709 13:05:18.423146 11652 raft_consensus.cc:2468] T b6555ed9a2e04888ac596b8dbe747265 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc52ba30a214524ba9a3705d5b5909f in term 0.
I20260709 13:05:18.425928 11693 leader_election.cc:304] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645c185863fd448e91faa534d9676384, efc52ba30a214524ba9a3705d5b5909f; no voters: 
I20260709 13:05:18.427663 11693 leader_election.cc:304] T 503bb0f5891b46de93cbac7e2a184b58 P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645c185863fd448e91faa534d9676384, efc52ba30a214524ba9a3705d5b5909f; no voters: 
I20260709 13:05:18.431079 11769 ts_tablet_manager.cc:1434] T 0c7cb06551c649a4963138881a4aa55d P 645c185863fd448e91faa534d9676384: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.001s
I20260709 13:05:18.426779 11767 ts_tablet_manager.cc:1434] T b6555ed9a2e04888ac596b8dbe747265 P 922904a85e7c45febb9f75ac6e08c44d: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.000s
I20260709 13:05:18.431672 11693 leader_election.cc:304] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645c185863fd448e91faa534d9676384, efc52ba30a214524ba9a3705d5b5909f; no voters: 
W20260709 13:05:18.432606 11693 leader_election.cc:343] T 503bb0f5891b46de93cbac7e2a184b58 P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.408650 11651 raft_consensus.cc:2468] T 6655f1f8c7674f98bd634a5f88ed3d55 P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc52ba30a214524ba9a3705d5b5909f in term 1.
I20260709 13:05:18.434350 11575 raft_consensus.cc:2468] T a3f692f94196483a9148317c2c73adcd P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc52ba30a214524ba9a3705d5b5909f in term 1.
W20260709 13:05:18.438601 11693 leader_election.cc:343] T a3f692f94196483a9148317c2c73adcd P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.433235 11767 tablet_bootstrap.cc:492] T a3f692f94196483a9148317c2c73adcd P 922904a85e7c45febb9f75ac6e08c44d: Bootstrap starting.
I20260709 13:05:18.430374 11800 raft_consensus.cc:697] T 69acdb3a5cd54bc0b6921e6b343a20c2 P efc52ba30a214524ba9a3705d5b5909f [term 1 LEADER]: Becoming Leader. State: Replica: efc52ba30a214524ba9a3705d5b5909f, State: Running, Role: LEADER
I20260709 13:05:18.440654 11800 consensus_queue.cc:237] T 69acdb3a5cd54bc0b6921e6b343a20c2 P efc52ba30a214524ba9a3705d5b5909f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.443228 11693 leader_election.cc:304] T a3f692f94196483a9148317c2c73adcd P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 645c185863fd448e91faa534d9676384, efc52ba30a214524ba9a3705d5b5909f; no voters: 922904a85e7c45febb9f75ac6e08c44d
I20260709 13:05:18.445472 11771 raft_consensus.cc:493] T 0c7cb06551c649a4963138881a4aa55d P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.446314 11771 raft_consensus.cc:515] T 0c7cb06551c649a4963138881a4aa55d P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.447079 11767 tablet_bootstrap.cc:654] T a3f692f94196483a9148317c2c73adcd P 922904a85e7c45febb9f75ac6e08c44d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.451297 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7cb06551c649a4963138881a4aa55d" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922904a85e7c45febb9f75ac6e08c44d" is_pre_election: true
I20260709 13:05:18.453881 11771 leader_election.cc:290] T 0c7cb06551c649a4963138881a4aa55d P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:18.455127 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7cb06551c649a4963138881a4aa55d" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc52ba30a214524ba9a3705d5b5909f" is_pre_election: true
I20260709 13:05:18.456018 11726 raft_consensus.cc:2393] T 0c7cb06551c649a4963138881a4aa55d P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 645c185863fd448e91faa534d9676384 in current term 1: Already voted for candidate 922904a85e7c45febb9f75ac6e08c44d in this term.
I20260709 13:05:18.457504 11541 leader_election.cc:304] T 0c7cb06551c649a4963138881a4aa55d P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 645c185863fd448e91faa534d9676384; no voters: 922904a85e7c45febb9f75ac6e08c44d, efc52ba30a214524ba9a3705d5b5909f
I20260709 13:05:18.444916 11473 catalog_manager.cc:5697] T 0c7cb06551c649a4963138881a4aa55d P 922904a85e7c45febb9f75ac6e08c44d reported cstate change: term changed from 0 to 1, leader changed from <none> to 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "922904a85e7c45febb9f75ac6e08c44d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:18.460346 11771 raft_consensus.cc:3060] T 0c7cb06551c649a4963138881a4aa55d P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.460434 11473 catalog_manager.cc:5697] T dd80d122422e4086ba85914c7dfdbe0d P 922904a85e7c45febb9f75ac6e08c44d reported cstate change: term changed from 0 to 1, leader changed from <none> to 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "922904a85e7c45febb9f75ac6e08c44d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:18.434384 11809 raft_consensus.cc:2804] T 503bb0f5891b46de93cbac7e2a184b58 P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:18.435034 11776 raft_consensus.cc:2804] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:18.464664 11776 raft_consensus.cc:493] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.465150 11776 raft_consensus.cc:3060] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.435669 11769 tablet_bootstrap.cc:492] T dd80d122422e4086ba85914c7dfdbe0d P 645c185863fd448e91faa534d9676384: Bootstrap starting.
I20260709 13:05:18.431085 11813 raft_consensus.cc:2804] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:18.477769 11776 raft_consensus.cc:515] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.487249 11820 raft_consensus.cc:2804] T a3f692f94196483a9148317c2c73adcd P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:18.488237 11771 raft_consensus.cc:2749] T 0c7cb06551c649a4963138881a4aa55d P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:18.488602 11813 raft_consensus.cc:697] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f [term 1 LEADER]: Becoming Leader. State: Replica: efc52ba30a214524ba9a3705d5b5909f, State: Running, Role: LEADER
I20260709 13:05:18.489830 11813 consensus_queue.cc:237] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.491168 11776 leader_election.cc:290] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 election: Requested vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415)
I20260709 13:05:18.495728 11809 raft_consensus.cc:697] T 503bb0f5891b46de93cbac7e2a184b58 P efc52ba30a214524ba9a3705d5b5909f [term 1 LEADER]: Becoming Leader. State: Replica: efc52ba30a214524ba9a3705d5b5909f, State: Running, Role: LEADER
I20260709 13:05:18.497480 11809 consensus_queue.cc:237] T 503bb0f5891b46de93cbac7e2a184b58 P efc52ba30a214524ba9a3705d5b5909f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.499404 11767 tablet_bootstrap.cc:492] T a3f692f94196483a9148317c2c73adcd P 922904a85e7c45febb9f75ac6e08c44d: No bootstrap required, opened a new log
I20260709 13:05:18.500586 11767 ts_tablet_manager.cc:1403] T a3f692f94196483a9148317c2c73adcd P 922904a85e7c45febb9f75ac6e08c44d: Time spent bootstrapping tablet: real 0.068s	user 0.031s	sys 0.023s
I20260709 13:05:18.504756 11769 tablet_bootstrap.cc:654] T dd80d122422e4086ba85914c7dfdbe0d P 645c185863fd448e91faa534d9676384: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.506072 11767 raft_consensus.cc:359] T a3f692f94196483a9148317c2c73adcd P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.515815 11767 raft_consensus.cc:385] T a3f692f94196483a9148317c2c73adcd P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.516400 11767 raft_consensus.cc:740] T a3f692f94196483a9148317c2c73adcd P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 922904a85e7c45febb9f75ac6e08c44d, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.510149 11820 raft_consensus.cc:697] T a3f692f94196483a9148317c2c73adcd P efc52ba30a214524ba9a3705d5b5909f [term 1 LEADER]: Becoming Leader. State: Replica: efc52ba30a214524ba9a3705d5b5909f, State: Running, Role: LEADER
I20260709 13:05:18.518293 11767 consensus_queue.cc:260] T a3f692f94196483a9148317c2c73adcd P 922904a85e7c45febb9f75ac6e08c44d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.518582 11820 consensus_queue.cc:237] T a3f692f94196483a9148317c2c73adcd P efc52ba30a214524ba9a3705d5b5909f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
W20260709 13:05:18.523304 11693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37707, user_credentials={real_user=slave}} blocked reactor thread for 80169us
I20260709 13:05:18.529011 11767 ts_tablet_manager.cc:1434] T a3f692f94196483a9148317c2c73adcd P 922904a85e7c45febb9f75ac6e08c44d: Time spent starting tablet: real 0.027s	user 0.012s	sys 0.000s
I20260709 13:05:18.531081 11767 tablet_bootstrap.cc:492] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 922904a85e7c45febb9f75ac6e08c44d: Bootstrap starting.
I20260709 13:05:18.539702 11575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6555ed9a2e04888ac596b8dbe747265" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645c185863fd448e91faa534d9676384"
I20260709 13:05:18.540110 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6555ed9a2e04888ac596b8dbe747265" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922904a85e7c45febb9f75ac6e08c44d"
I20260709 13:05:18.540841 11651 raft_consensus.cc:3060] T b6555ed9a2e04888ac596b8dbe747265 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.540830 11575 raft_consensus.cc:3060] T b6555ed9a2e04888ac596b8dbe747265 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.545683 11767 tablet_bootstrap.cc:654] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 922904a85e7c45febb9f75ac6e08c44d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.553758 11575 raft_consensus.cc:2468] T b6555ed9a2e04888ac596b8dbe747265 P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc52ba30a214524ba9a3705d5b5909f in term 1.
I20260709 13:05:18.554531 11651 raft_consensus.cc:2468] T b6555ed9a2e04888ac596b8dbe747265 P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc52ba30a214524ba9a3705d5b5909f in term 1.
I20260709 13:05:18.556113 11693 leader_election.cc:304] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645c185863fd448e91faa534d9676384, efc52ba30a214524ba9a3705d5b5909f; no voters: 
I20260709 13:05:18.557282 11820 raft_consensus.cc:2804] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:18.557559 11769 tablet_bootstrap.cc:492] T dd80d122422e4086ba85914c7dfdbe0d P 645c185863fd448e91faa534d9676384: No bootstrap required, opened a new log
I20260709 13:05:18.558066 11769 ts_tablet_manager.cc:1403] T dd80d122422e4086ba85914c7dfdbe0d P 645c185863fd448e91faa534d9676384: Time spent bootstrapping tablet: real 0.123s	user 0.008s	sys 0.013s
I20260709 13:05:18.558423 11820 raft_consensus.cc:697] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f [term 1 LEADER]: Becoming Leader. State: Replica: efc52ba30a214524ba9a3705d5b5909f, State: Running, Role: LEADER
I20260709 13:05:18.559402 11820 consensus_queue.cc:237] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.561146 11769 raft_consensus.cc:359] T dd80d122422e4086ba85914c7dfdbe0d P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.569020 11767 tablet_bootstrap.cc:492] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 922904a85e7c45febb9f75ac6e08c44d: No bootstrap required, opened a new log
I20260709 13:05:18.570434 11767 ts_tablet_manager.cc:1403] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 922904a85e7c45febb9f75ac6e08c44d: Time spent bootstrapping tablet: real 0.040s	user 0.017s	sys 0.008s
I20260709 13:05:18.565127 11769 raft_consensus.cc:385] T dd80d122422e4086ba85914c7dfdbe0d P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.573379 11769 raft_consensus.cc:740] T dd80d122422e4086ba85914c7dfdbe0d P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 645c185863fd448e91faa534d9676384, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.573318 11767 raft_consensus.cc:359] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.574056 11767 raft_consensus.cc:385] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.574349 11767 raft_consensus.cc:740] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 922904a85e7c45febb9f75ac6e08c44d, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.574255 11769 consensus_queue.cc:260] T dd80d122422e4086ba85914c7dfdbe0d P 645c185863fd448e91faa534d9676384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.575081 11767 consensus_queue.cc:260] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 922904a85e7c45febb9f75ac6e08c44d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.576469 11769 ts_tablet_manager.cc:1434] T dd80d122422e4086ba85914c7dfdbe0d P 645c185863fd448e91faa534d9676384: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:05:18.577128 11767 ts_tablet_manager.cc:1434] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 922904a85e7c45febb9f75ac6e08c44d: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:05:18.578111 11767 tablet_bootstrap.cc:492] T 503bb0f5891b46de93cbac7e2a184b58 P 922904a85e7c45febb9f75ac6e08c44d: Bootstrap starting.
I20260709 13:05:18.577442 11473 catalog_manager.cc:5697] T d2603633a12047678d7b85f14c0c970e P 922904a85e7c45febb9f75ac6e08c44d reported cstate change: term changed from 0 to 1, leader changed from <none> to 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "922904a85e7c45febb9f75ac6e08c44d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:18.583914 11767 tablet_bootstrap.cc:654] T 503bb0f5891b46de93cbac7e2a184b58 P 922904a85e7c45febb9f75ac6e08c44d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.587446 11820 raft_consensus.cc:493] T d2603633a12047678d7b85f14c0c970e P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.588030 11820 raft_consensus.cc:515] T d2603633a12047678d7b85f14c0c970e P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.590121 11820 leader_election.cc:290] T d2603633a12047678d7b85f14c0c970e P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415)
I20260709 13:05:18.591415 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2603633a12047678d7b85f14c0c970e" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922904a85e7c45febb9f75ac6e08c44d" is_pre_election: true
I20260709 13:05:18.591796 11575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2603633a12047678d7b85f14c0c970e" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645c185863fd448e91faa534d9676384" is_pre_election: true
I20260709 13:05:18.592715 11575 raft_consensus.cc:2393] T d2603633a12047678d7b85f14c0c970e P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc52ba30a214524ba9a3705d5b5909f in current term 1: Already voted for candidate 922904a85e7c45febb9f75ac6e08c44d in this term.
I20260709 13:05:18.595000 11693 leader_election.cc:304] T d2603633a12047678d7b85f14c0c970e P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc52ba30a214524ba9a3705d5b5909f; no voters: 645c185863fd448e91faa534d9676384, 922904a85e7c45febb9f75ac6e08c44d
I20260709 13:05:18.594869 11475 catalog_manager.cc:5697] T a3f692f94196483a9148317c2c73adcd P efc52ba30a214524ba9a3705d5b5909f reported cstate change: term changed from 0 to 1, leader changed from <none> to efc52ba30a214524ba9a3705d5b5909f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "efc52ba30a214524ba9a3705d5b5909f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:18.597539 11820 raft_consensus.cc:3060] T d2603633a12047678d7b85f14c0c970e P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.598536 11475 catalog_manager.cc:5697] T 69acdb3a5cd54bc0b6921e6b343a20c2 P efc52ba30a214524ba9a3705d5b5909f reported cstate change: term changed from 0 to 1, leader changed from <none> to efc52ba30a214524ba9a3705d5b5909f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "efc52ba30a214524ba9a3705d5b5909f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:18.602602 11475 catalog_manager.cc:5697] T 503bb0f5891b46de93cbac7e2a184b58 P efc52ba30a214524ba9a3705d5b5909f reported cstate change: term changed from 0 to 1, leader changed from <none> to efc52ba30a214524ba9a3705d5b5909f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "efc52ba30a214524ba9a3705d5b5909f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:18.604694 11475 catalog_manager.cc:5697] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f reported cstate change: term changed from 0 to 1, leader changed from <none> to efc52ba30a214524ba9a3705d5b5909f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "efc52ba30a214524ba9a3705d5b5909f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:18.606683 11767 tablet_bootstrap.cc:492] T 503bb0f5891b46de93cbac7e2a184b58 P 922904a85e7c45febb9f75ac6e08c44d: No bootstrap required, opened a new log
I20260709 13:05:18.606475 11820 raft_consensus.cc:2749] T d2603633a12047678d7b85f14c0c970e P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:18.607267 11767 ts_tablet_manager.cc:1403] T 503bb0f5891b46de93cbac7e2a184b58 P 922904a85e7c45febb9f75ac6e08c44d: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.016s
I20260709 13:05:18.610163 11767 raft_consensus.cc:359] T 503bb0f5891b46de93cbac7e2a184b58 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.610917 11767 raft_consensus.cc:385] T 503bb0f5891b46de93cbac7e2a184b58 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.611183 11767 raft_consensus.cc:740] T 503bb0f5891b46de93cbac7e2a184b58 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 922904a85e7c45febb9f75ac6e08c44d, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.611955 11767 consensus_queue.cc:260] T 503bb0f5891b46de93cbac7e2a184b58 P 922904a85e7c45febb9f75ac6e08c44d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.613647 11767 ts_tablet_manager.cc:1434] T 503bb0f5891b46de93cbac7e2a184b58 P 922904a85e7c45febb9f75ac6e08c44d: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:05:18.624818 11473 catalog_manager.cc:5697] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f reported cstate change: term changed from 0 to 1, leader changed from <none> to efc52ba30a214524ba9a3705d5b5909f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "efc52ba30a214524ba9a3705d5b5909f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:18.654970 11771 raft_consensus.cc:493] T dd80d122422e4086ba85914c7dfdbe0d P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.655675 11771 raft_consensus.cc:515] T dd80d122422e4086ba85914c7dfdbe0d P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.657617 11771 leader_election.cc:290] T dd80d122422e4086ba85914c7dfdbe0d P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:18.658811 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80d122422e4086ba85914c7dfdbe0d" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922904a85e7c45febb9f75ac6e08c44d" is_pre_election: true
I20260709 13:05:18.658962 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80d122422e4086ba85914c7dfdbe0d" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc52ba30a214524ba9a3705d5b5909f" is_pre_election: true
I20260709 13:05:18.659929 11726 raft_consensus.cc:2393] T dd80d122422e4086ba85914c7dfdbe0d P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 645c185863fd448e91faa534d9676384 in current term 1: Already voted for candidate 922904a85e7c45febb9f75ac6e08c44d in this term.
I20260709 13:05:18.660969 11541 leader_election.cc:304] T dd80d122422e4086ba85914c7dfdbe0d P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 645c185863fd448e91faa534d9676384; no voters: 922904a85e7c45febb9f75ac6e08c44d, efc52ba30a214524ba9a3705d5b5909f
I20260709 13:05:18.662006 11771 raft_consensus.cc:3060] T dd80d122422e4086ba85914c7dfdbe0d P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.668836 11771 raft_consensus.cc:2749] T dd80d122422e4086ba85914c7dfdbe0d P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:18.716078 11803 raft_consensus.cc:493] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.716871 11803 raft_consensus.cc:515] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.718943 11803 leader_election.cc:290] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:18.719835 11575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2253eb70f9fa4f77b87a1522e2a7a4f0" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645c185863fd448e91faa534d9676384" is_pre_election: true
I20260709 13:05:18.719980 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2253eb70f9fa4f77b87a1522e2a7a4f0" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc52ba30a214524ba9a3705d5b5909f" is_pre_election: true
I20260709 13:05:18.720522 11575 raft_consensus.cc:2468] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 922904a85e7c45febb9f75ac6e08c44d in term 0.
I20260709 13:05:18.720635 11726 raft_consensus.cc:2468] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 922904a85e7c45febb9f75ac6e08c44d in term 0.
I20260709 13:05:18.721668 11619 leader_election.cc:304] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645c185863fd448e91faa534d9676384, 922904a85e7c45febb9f75ac6e08c44d; no voters: 
I20260709 13:05:18.722448 11803 raft_consensus.cc:2804] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:18.723078 11803 raft_consensus.cc:493] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.723546 11803 raft_consensus.cc:3060] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.729442 11803 raft_consensus.cc:515] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.731137 11803 leader_election.cc:290] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 election: Requested vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:18.732520 11575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2253eb70f9fa4f77b87a1522e2a7a4f0" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645c185863fd448e91faa534d9676384"
I20260709 13:05:18.732511 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2253eb70f9fa4f77b87a1522e2a7a4f0" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc52ba30a214524ba9a3705d5b5909f"
I20260709 13:05:18.733347 11575 raft_consensus.cc:3060] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.733425 11726 raft_consensus.cc:3060] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.735570 11803 consensus_queue.cc:1048] T 0c7cb06551c649a4963138881a4aa55d P 922904a85e7c45febb9f75ac6e08c44d [LEADER]: Connected to new peer: Peer: permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.740978 11726 raft_consensus.cc:2468] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 922904a85e7c45febb9f75ac6e08c44d in term 1.
I20260709 13:05:18.741534 11575 raft_consensus.cc:2468] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 922904a85e7c45febb9f75ac6e08c44d in term 1.
I20260709 13:05:18.742412 11616 leader_election.cc:304] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 922904a85e7c45febb9f75ac6e08c44d, efc52ba30a214524ba9a3705d5b5909f; no voters: 
I20260709 13:05:18.743316 11803 raft_consensus.cc:2804] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:18.744203 11803 raft_consensus.cc:697] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 922904a85e7c45febb9f75ac6e08c44d [term 1 LEADER]: Becoming Leader. State: Replica: 922904a85e7c45febb9f75ac6e08c44d, State: Running, Role: LEADER
I20260709 13:05:18.745432 11803 consensus_queue.cc:237] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 922904a85e7c45febb9f75ac6e08c44d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.746564 11802 raft_consensus.cc:493] T a3f692f94196483a9148317c2c73adcd P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.747165 11802 raft_consensus.cc:515] T a3f692f94196483a9148317c2c73adcd P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.750612 11802 leader_election.cc:290] T a3f692f94196483a9148317c2c73adcd P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:18.753255 11802 consensus_queue.cc:1048] T 0c7cb06551c649a4963138881a4aa55d P 922904a85e7c45febb9f75ac6e08c44d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.754142 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f692f94196483a9148317c2c73adcd" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc52ba30a214524ba9a3705d5b5909f" is_pre_election: true
I20260709 13:05:18.758065 11475 catalog_manager.cc:5697] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 922904a85e7c45febb9f75ac6e08c44d reported cstate change: term changed from 0 to 1, leader changed from <none> to 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "922904a85e7c45febb9f75ac6e08c44d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:18.766952 11575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f692f94196483a9148317c2c73adcd" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645c185863fd448e91faa534d9676384" is_pre_election: true
I20260709 13:05:18.769282 11575 raft_consensus.cc:2393] T a3f692f94196483a9148317c2c73adcd P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 922904a85e7c45febb9f75ac6e08c44d in current term 1: Already voted for candidate efc52ba30a214524ba9a3705d5b5909f in this term.
I20260709 13:05:18.769387 11803 consensus_queue.cc:1048] T d2603633a12047678d7b85f14c0c970e P 922904a85e7c45febb9f75ac6e08c44d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:18.770965 11619 leader_election.cc:304] T a3f692f94196483a9148317c2c73adcd P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 922904a85e7c45febb9f75ac6e08c44d; no voters: 645c185863fd448e91faa534d9676384, efc52ba30a214524ba9a3705d5b5909f
I20260709 13:05:18.772569 11802 raft_consensus.cc:3060] T a3f692f94196483a9148317c2c73adcd P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.796905 11802 raft_consensus.cc:2749] T a3f692f94196483a9148317c2c73adcd P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:18.805974 11803 consensus_queue.cc:1048] T d2603633a12047678d7b85f14c0c970e P 922904a85e7c45febb9f75ac6e08c44d [LEADER]: Connected to new peer: Peer: permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.819468 11802 raft_consensus.cc:493] T 503bb0f5891b46de93cbac7e2a184b58 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.820611 11802 raft_consensus.cc:515] T 503bb0f5891b46de93cbac7e2a184b58 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:18.823463 11573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503bb0f5891b46de93cbac7e2a184b58" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645c185863fd448e91faa534d9676384" is_pre_election: true
I20260709 13:05:18.824224 11802 leader_election.cc:290] T 503bb0f5891b46de93cbac7e2a184b58 P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:18.825387 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503bb0f5891b46de93cbac7e2a184b58" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc52ba30a214524ba9a3705d5b5909f" is_pre_election: true
I20260709 13:05:18.824397 11573 raft_consensus.cc:2393] T 503bb0f5891b46de93cbac7e2a184b58 P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 922904a85e7c45febb9f75ac6e08c44d in current term 1: Already voted for candidate efc52ba30a214524ba9a3705d5b5909f in this term.
I20260709 13:05:18.827407 11820 consensus_queue.cc:1048] T 69acdb3a5cd54bc0b6921e6b343a20c2 P efc52ba30a214524ba9a3705d5b5909f [LEADER]: Connected to new peer: Peer: permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.828347 11619 leader_election.cc:304] T 503bb0f5891b46de93cbac7e2a184b58 P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 922904a85e7c45febb9f75ac6e08c44d; no voters: 645c185863fd448e91faa534d9676384, efc52ba30a214524ba9a3705d5b5909f
I20260709 13:05:18.829232 11802 raft_consensus.cc:3060] T 503bb0f5891b46de93cbac7e2a184b58 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.838011 11802 raft_consensus.cc:2749] T 503bb0f5891b46de93cbac7e2a184b58 P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:18.842568 11800 consensus_queue.cc:1048] T 69acdb3a5cd54bc0b6921e6b343a20c2 P efc52ba30a214524ba9a3705d5b5909f [LEADER]: Connected to new peer: Peer: permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:18.894585 11800 consensus_queue.cc:1048] T 503bb0f5891b46de93cbac7e2a184b58 P efc52ba30a214524ba9a3705d5b5909f [LEADER]: Connected to new peer: Peer: permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:18.908061 11800 consensus_queue.cc:1048] T 503bb0f5891b46de93cbac7e2a184b58 P efc52ba30a214524ba9a3705d5b5909f [LEADER]: Connected to new peer: Peer: permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:18.937609 11802 consensus_queue.cc:1048] T dd80d122422e4086ba85914c7dfdbe0d P 922904a85e7c45febb9f75ac6e08c44d [LEADER]: Connected to new peer: Peer: permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.951170 11802 consensus_queue.cc:1048] T dd80d122422e4086ba85914c7dfdbe0d P 922904a85e7c45febb9f75ac6e08c44d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.987075 11800 consensus_queue.cc:1048] T a3f692f94196483a9148317c2c73adcd P efc52ba30a214524ba9a3705d5b5909f [LEADER]: Connected to new peer: Peer: permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:19.000072 11800 consensus_queue.cc:1048] T a3f692f94196483a9148317c2c73adcd P efc52ba30a214524ba9a3705d5b5909f [LEADER]: Connected to new peer: Peer: permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:19.058552 11726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69acdb3a5cd54bc0b6921e6b343a20c2"
dest_uuid: "efc52ba30a214524ba9a3705d5b5909f"
mode: GRACEFUL
new_leader_uuid: "645c185863fd448e91faa534d9676384"
 from {username='slave'} at 127.0.0.1:58540
I20260709 13:05:19.059068 11726 raft_consensus.cc:606] T 69acdb3a5cd54bc0b6921e6b343a20c2 P efc52ba30a214524ba9a3705d5b5909f [term 1 LEADER]: Received request to transfer leadership to TS 645c185863fd448e91faa534d9676384
I20260709 13:05:19.064981 11726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6555ed9a2e04888ac596b8dbe747265"
dest_uuid: "efc52ba30a214524ba9a3705d5b5909f"
mode: GRACEFUL
new_leader_uuid: "645c185863fd448e91faa534d9676384"
 from {username='slave'} at 127.0.0.1:58540
I20260709 13:05:19.065588 11726 raft_consensus.cc:606] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f [term 1 LEADER]: Received request to transfer leadership to TS 645c185863fd448e91faa534d9676384
I20260709 13:05:19.072134 11726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3f692f94196483a9148317c2c73adcd"
dest_uuid: "efc52ba30a214524ba9a3705d5b5909f"
mode: GRACEFUL
new_leader_uuid: "645c185863fd448e91faa534d9676384"
 from {username='slave'} at 127.0.0.1:58540
I20260709 13:05:19.072746 11726 raft_consensus.cc:606] T a3f692f94196483a9148317c2c73adcd P efc52ba30a214524ba9a3705d5b5909f [term 1 LEADER]: Received request to transfer leadership to TS 645c185863fd448e91faa534d9676384
I20260709 13:05:19.088924 11820 consensus_queue.cc:1048] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f [LEADER]: Connected to new peer: Peer: permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:19.092465 11651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2253eb70f9fa4f77b87a1522e2a7a4f0"
dest_uuid: "922904a85e7c45febb9f75ac6e08c44d"
mode: GRACEFUL
new_leader_uuid: "645c185863fd448e91faa534d9676384"
 from {username='slave'} at 127.0.0.1:38632
I20260709 13:05:19.094485 11651 raft_consensus.cc:606] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 922904a85e7c45febb9f75ac6e08c44d [term 1 LEADER]: Received request to transfer leadership to TS 645c185863fd448e91faa534d9676384
I20260709 13:05:19.102087 11726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6655f1f8c7674f98bd634a5f88ed3d55"
dest_uuid: "efc52ba30a214524ba9a3705d5b5909f"
mode: GRACEFUL
new_leader_uuid: "922904a85e7c45febb9f75ac6e08c44d"
 from {username='slave'} at 127.0.0.1:58540
I20260709 13:05:19.102715 11726 raft_consensus.cc:606] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f [term 1 LEADER]: Received request to transfer leadership to TS 922904a85e7c45febb9f75ac6e08c44d
I20260709 13:05:19.114405 11820 consensus_queue.cc:1048] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f [LEADER]: Connected to new peer: Peer: permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:19.117998 11819 consensus_queue.cc:1048] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f [LEADER]: Connected to new peer: Peer: permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:19.119745 11726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "503bb0f5891b46de93cbac7e2a184b58"
dest_uuid: "efc52ba30a214524ba9a3705d5b5909f"
mode: GRACEFUL
new_leader_uuid: "922904a85e7c45febb9f75ac6e08c44d"
 from {username='slave'} at 127.0.0.1:58540
I20260709 13:05:19.120549 11726 raft_consensus.cc:606] T 503bb0f5891b46de93cbac7e2a184b58 P efc52ba30a214524ba9a3705d5b5909f [term 1 LEADER]: Received request to transfer leadership to TS 922904a85e7c45febb9f75ac6e08c44d
I20260709 13:05:19.120868 11819 consensus_queue.cc:1048] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f [LEADER]: Connected to new peer: Peer: permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:19.132426 11651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2603633a12047678d7b85f14c0c970e"
dest_uuid: "922904a85e7c45febb9f75ac6e08c44d"
mode: GRACEFUL
new_leader_uuid: "efc52ba30a214524ba9a3705d5b5909f"
 from {username='slave'} at 127.0.0.1:38632
I20260709 13:05:19.133917 11651 raft_consensus.cc:606] T d2603633a12047678d7b85f14c0c970e P 922904a85e7c45febb9f75ac6e08c44d [term 1 LEADER]: Received request to transfer leadership to TS efc52ba30a214524ba9a3705d5b5909f
I20260709 13:05:19.147564 11802 consensus_queue.cc:1048] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 922904a85e7c45febb9f75ac6e08c44d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:19.148020 11809 raft_consensus.cc:993] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f: : Instructing follower 645c185863fd448e91faa534d9676384 to start an election
I20260709 13:05:19.148525 11809 raft_consensus.cc:1081] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f [term 1 LEADER]: Signalling peer 645c185863fd448e91faa534d9676384 to start an election
I20260709 13:05:19.151427 11800 raft_consensus.cc:993] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f: : Instructing follower 922904a85e7c45febb9f75ac6e08c44d to start an election
I20260709 13:05:19.152247 11820 raft_consensus.cc:1081] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f [term 1 LEADER]: Signalling peer 922904a85e7c45febb9f75ac6e08c44d to start an election
I20260709 13:05:19.156271 11573 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6555ed9a2e04888ac596b8dbe747265"
dest_uuid: "645c185863fd448e91faa534d9676384"
 from {username='slave'} at 127.0.0.1:45702
I20260709 13:05:19.157325 11573 raft_consensus.cc:493] T b6555ed9a2e04888ac596b8dbe747265 P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:19.157706 11573 raft_consensus.cc:3060] T b6555ed9a2e04888ac596b8dbe747265 P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.163597 11652 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6655f1f8c7674f98bd634a5f88ed3d55"
dest_uuid: "922904a85e7c45febb9f75ac6e08c44d"
 from {username='slave'} at 127.0.0.1:38618
I20260709 13:05:19.164320 11652 raft_consensus.cc:493] T 6655f1f8c7674f98bd634a5f88ed3d55 P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:19.164721 11652 raft_consensus.cc:3060] T 6655f1f8c7674f98bd634a5f88ed3d55 P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.163597 11802 consensus_queue.cc:1048] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 922904a85e7c45febb9f75ac6e08c44d [LEADER]: Connected to new peer: Peer: permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:19.170907 11573 raft_consensus.cc:515] T b6555ed9a2e04888ac596b8dbe747265 P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:19.174857 11573 leader_election.cc:290] T b6555ed9a2e04888ac596b8dbe747265 P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 2 election: Requested vote from peers 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:19.176589 11652 raft_consensus.cc:515] T 6655f1f8c7674f98bd634a5f88ed3d55 P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:19.178532 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6555ed9a2e04888ac596b8dbe747265" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efc52ba30a214524ba9a3705d5b5909f"
I20260709 13:05:19.179414 11726 raft_consensus.cc:3055] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:19.179778 11726 raft_consensus.cc:740] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: efc52ba30a214524ba9a3705d5b5909f, State: Running, Role: LEADER
I20260709 13:05:19.180868 11652 leader_election.cc:290] T 6655f1f8c7674f98bd634a5f88ed3d55 P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 2 election: Requested vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:19.180753 11726 consensus_queue.cc:260] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:19.181476 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6655f1f8c7674f98bd634a5f88ed3d55" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efc52ba30a214524ba9a3705d5b5909f"
I20260709 13:05:19.182065 11727 raft_consensus.cc:3055] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:19.182262 11727 raft_consensus.cc:740] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: efc52ba30a214524ba9a3705d5b5909f, State: Running, Role: LEADER
I20260709 13:05:19.182713 11726 raft_consensus.cc:3060] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.183007 11727 consensus_queue.cc:260] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:19.183912 11727 raft_consensus.cc:3060] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.180774 11573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6655f1f8c7674f98bd634a5f88ed3d55" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "645c185863fd448e91faa534d9676384"
I20260709 13:05:19.185633 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6555ed9a2e04888ac596b8dbe747265" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "922904a85e7c45febb9f75ac6e08c44d"
I20260709 13:05:19.185882 11573 raft_consensus.cc:3060] T 6655f1f8c7674f98bd634a5f88ed3d55 P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.190908 11726 raft_consensus.cc:2468] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 645c185863fd448e91faa534d9676384 in term 2.
I20260709 13:05:19.191972 11651 raft_consensus.cc:3060] T b6555ed9a2e04888ac596b8dbe747265 P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.192468 11541 leader_election.cc:304] T b6555ed9a2e04888ac596b8dbe747265 P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645c185863fd448e91faa534d9676384, efc52ba30a214524ba9a3705d5b5909f; no voters: 
I20260709 13:05:19.192945 11727 raft_consensus.cc:2468] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 922904a85e7c45febb9f75ac6e08c44d in term 2.
I20260709 13:05:19.193943 11771 raft_consensus.cc:2804] T b6555ed9a2e04888ac596b8dbe747265 P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:19.196286 11616 leader_election.cc:304] T 6655f1f8c7674f98bd634a5f88ed3d55 P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 922904a85e7c45febb9f75ac6e08c44d, efc52ba30a214524ba9a3705d5b5909f; no voters: 
I20260709 13:05:19.197381 11802 raft_consensus.cc:2804] T 6655f1f8c7674f98bd634a5f88ed3d55 P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:19.198019 11802 raft_consensus.cc:697] T 6655f1f8c7674f98bd634a5f88ed3d55 P 922904a85e7c45febb9f75ac6e08c44d [term 2 LEADER]: Becoming Leader. State: Replica: 922904a85e7c45febb9f75ac6e08c44d, State: Running, Role: LEADER
I20260709 13:05:19.198882 11802 consensus_queue.cc:237] T 6655f1f8c7674f98bd634a5f88ed3d55 P 922904a85e7c45febb9f75ac6e08c44d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:19.200405 11573 raft_consensus.cc:2468] T 6655f1f8c7674f98bd634a5f88ed3d55 P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 922904a85e7c45febb9f75ac6e08c44d in term 2.
I20260709 13:05:19.205459 11651 raft_consensus.cc:2468] T b6555ed9a2e04888ac596b8dbe747265 P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 645c185863fd448e91faa534d9676384 in term 2.
I20260709 13:05:19.207729 11771 raft_consensus.cc:697] T b6555ed9a2e04888ac596b8dbe747265 P 645c185863fd448e91faa534d9676384 [term 2 LEADER]: Becoming Leader. State: Replica: 645c185863fd448e91faa534d9676384, State: Running, Role: LEADER
I20260709 13:05:19.209328 11807 raft_consensus.cc:993] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 922904a85e7c45febb9f75ac6e08c44d: : Instructing follower 645c185863fd448e91faa534d9676384 to start an election
I20260709 13:05:19.209954 11807 raft_consensus.cc:1081] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 922904a85e7c45febb9f75ac6e08c44d [term 1 LEADER]: Signalling peer 645c185863fd448e91faa534d9676384 to start an election
I20260709 13:05:19.211980 11575 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2253eb70f9fa4f77b87a1522e2a7a4f0"
dest_uuid: "645c185863fd448e91faa534d9676384"
 from {username='slave'} at 127.0.0.1:45698
I20260709 13:05:19.211903 11771 consensus_queue.cc:237] T b6555ed9a2e04888ac596b8dbe747265 P 645c185863fd448e91faa534d9676384 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:19.212812 11575 raft_consensus.cc:493] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:19.213347 11575 raft_consensus.cc:3060] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.212993 11472 catalog_manager.cc:5697] T 6655f1f8c7674f98bd634a5f88ed3d55 P 922904a85e7c45febb9f75ac6e08c44d reported cstate change: term changed from 1 to 2, leader changed from efc52ba30a214524ba9a3705d5b5909f (127.0.107.195) to 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "922904a85e7c45febb9f75ac6e08c44d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:19.222049 11575 raft_consensus.cc:515] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:19.225152 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2253eb70f9fa4f77b87a1522e2a7a4f0" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "922904a85e7c45febb9f75ac6e08c44d"
I20260709 13:05:19.225853 11651 raft_consensus.cc:3055] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 922904a85e7c45febb9f75ac6e08c44d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:19.226394 11575 leader_election.cc:290] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 2 election: Requested vote from peers 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:19.226657 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2253eb70f9fa4f77b87a1522e2a7a4f0" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efc52ba30a214524ba9a3705d5b5909f"
I20260709 13:05:19.227933 11726 raft_consensus.cc:3060] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.226244 11651 raft_consensus.cc:740] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 922904a85e7c45febb9f75ac6e08c44d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 922904a85e7c45febb9f75ac6e08c44d, State: Running, Role: LEADER
I20260709 13:05:19.230052 11476 catalog_manager.cc:5697] T b6555ed9a2e04888ac596b8dbe747265 P 645c185863fd448e91faa534d9676384 reported cstate change: term changed from 1 to 2, leader changed from efc52ba30a214524ba9a3705d5b5909f (127.0.107.195) to 645c185863fd448e91faa534d9676384 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "645c185863fd448e91faa534d9676384" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:19.230397 11651 consensus_queue.cc:260] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 922904a85e7c45febb9f75ac6e08c44d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:19.232342 11651 raft_consensus.cc:3060] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.240372 11820 raft_consensus.cc:993] T 69acdb3a5cd54bc0b6921e6b343a20c2 P efc52ba30a214524ba9a3705d5b5909f: : Instructing follower 645c185863fd448e91faa534d9676384 to start an election
I20260709 13:05:19.241034 11820 raft_consensus.cc:1081] T 69acdb3a5cd54bc0b6921e6b343a20c2 P efc52ba30a214524ba9a3705d5b5909f [term 1 LEADER]: Signalling peer 645c185863fd448e91faa534d9676384 to start an election
I20260709 13:05:19.242411 11651 raft_consensus.cc:2468] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 645c185863fd448e91faa534d9676384 in term 2.
I20260709 13:05:19.242841 11575 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69acdb3a5cd54bc0b6921e6b343a20c2"
dest_uuid: "645c185863fd448e91faa534d9676384"
 from {username='slave'} at 127.0.0.1:45702
I20260709 13:05:19.243453 11726 raft_consensus.cc:2468] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 645c185863fd448e91faa534d9676384 in term 2.
I20260709 13:05:19.243541 11575 raft_consensus.cc:493] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:19.244096 11544 leader_election.cc:304] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645c185863fd448e91faa534d9676384, 922904a85e7c45febb9f75ac6e08c44d; no voters: 
I20260709 13:05:19.244154 11575 raft_consensus.cc:3060] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.245131 11771 raft_consensus.cc:2804] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:19.245651 11771 raft_consensus.cc:697] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 645c185863fd448e91faa534d9676384 [term 2 LEADER]: Becoming Leader. State: Replica: 645c185863fd448e91faa534d9676384, State: Running, Role: LEADER
I20260709 13:05:19.246497 11771 consensus_queue.cc:237] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 645c185863fd448e91faa534d9676384 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:19.252230 11575 raft_consensus.cc:515] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:19.254595 11575 leader_election.cc:290] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 2 election: Requested vote from peers 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:19.254931 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69acdb3a5cd54bc0b6921e6b343a20c2" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "922904a85e7c45febb9f75ac6e08c44d"
I20260709 13:05:19.255301 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69acdb3a5cd54bc0b6921e6b343a20c2" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efc52ba30a214524ba9a3705d5b5909f"
I20260709 13:05:19.255533 11651 raft_consensus.cc:3060] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.254732 11472 catalog_manager.cc:5697] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 645c185863fd448e91faa534d9676384 reported cstate change: term changed from 1 to 2, leader changed from 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194) to 645c185863fd448e91faa534d9676384 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "645c185863fd448e91faa534d9676384" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:19.256086 11726 raft_consensus.cc:3055] T 69acdb3a5cd54bc0b6921e6b343a20c2 P efc52ba30a214524ba9a3705d5b5909f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:19.256489 11726 raft_consensus.cc:740] T 69acdb3a5cd54bc0b6921e6b343a20c2 P efc52ba30a214524ba9a3705d5b5909f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: efc52ba30a214524ba9a3705d5b5909f, State: Running, Role: LEADER
I20260709 13:05:19.257228 11726 consensus_queue.cc:260] T 69acdb3a5cd54bc0b6921e6b343a20c2 P efc52ba30a214524ba9a3705d5b5909f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:19.258217 11726 raft_consensus.cc:3060] T 69acdb3a5cd54bc0b6921e6b343a20c2 P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.263242 11651 raft_consensus.cc:2468] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 645c185863fd448e91faa534d9676384 in term 2.
I20260709 13:05:19.264765 11544 leader_election.cc:304] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645c185863fd448e91faa534d9676384, 922904a85e7c45febb9f75ac6e08c44d; no voters: 
I20260709 13:05:19.265491 11726 raft_consensus.cc:2468] T 69acdb3a5cd54bc0b6921e6b343a20c2 P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 645c185863fd448e91faa534d9676384 in term 2.
I20260709 13:05:19.265767 11771 raft_consensus.cc:2804] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:19.266342 11771 raft_consensus.cc:697] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 645c185863fd448e91faa534d9676384 [term 2 LEADER]: Becoming Leader. State: Replica: 645c185863fd448e91faa534d9676384, State: Running, Role: LEADER
I20260709 13:05:19.267362 11771 consensus_queue.cc:237] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 645c185863fd448e91faa534d9676384 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:19.274264 11472 catalog_manager.cc:5697] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 645c185863fd448e91faa534d9676384 reported cstate change: term changed from 1 to 2, leader changed from efc52ba30a214524ba9a3705d5b5909f (127.0.107.195) to 645c185863fd448e91faa534d9676384 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "645c185863fd448e91faa534d9676384" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:19.412248 11833 raft_consensus.cc:993] T d2603633a12047678d7b85f14c0c970e P 922904a85e7c45febb9f75ac6e08c44d: : Instructing follower efc52ba30a214524ba9a3705d5b5909f to start an election
I20260709 13:05:19.412814 11802 raft_consensus.cc:1081] T d2603633a12047678d7b85f14c0c970e P 922904a85e7c45febb9f75ac6e08c44d [term 1 LEADER]: Signalling peer efc52ba30a214524ba9a3705d5b5909f to start an election
I20260709 13:05:19.414943 11726 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2603633a12047678d7b85f14c0c970e"
dest_uuid: "efc52ba30a214524ba9a3705d5b5909f"
 from {username='slave'} at 127.0.0.1:58528
I20260709 13:05:19.415655 11726 raft_consensus.cc:493] T d2603633a12047678d7b85f14c0c970e P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:19.416169 11726 raft_consensus.cc:3060] T d2603633a12047678d7b85f14c0c970e P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.419343 11819 raft_consensus.cc:993] T 503bb0f5891b46de93cbac7e2a184b58 P efc52ba30a214524ba9a3705d5b5909f: : Instructing follower 922904a85e7c45febb9f75ac6e08c44d to start an election
I20260709 13:05:19.420033 11820 raft_consensus.cc:1081] T 503bb0f5891b46de93cbac7e2a184b58 P efc52ba30a214524ba9a3705d5b5909f [term 1 LEADER]: Signalling peer 922904a85e7c45febb9f75ac6e08c44d to start an election
I20260709 13:05:19.422880 11651 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "503bb0f5891b46de93cbac7e2a184b58"
dest_uuid: "922904a85e7c45febb9f75ac6e08c44d"
 from {username='slave'} at 127.0.0.1:38618
I20260709 13:05:19.423513 11651 raft_consensus.cc:493] T 503bb0f5891b46de93cbac7e2a184b58 P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:19.423928 11651 raft_consensus.cc:3060] T 503bb0f5891b46de93cbac7e2a184b58 P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.428687 11726 raft_consensus.cc:515] T d2603633a12047678d7b85f14c0c970e P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:19.431469 11726 leader_election.cc:290] T d2603633a12047678d7b85f14c0c970e P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 2 election: Requested vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415)
I20260709 13:05:19.432302 11575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2603633a12047678d7b85f14c0c970e" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "645c185863fd448e91faa534d9676384"
I20260709 13:05:19.432999 11575 raft_consensus.cc:3060] T d2603633a12047678d7b85f14c0c970e P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.432720 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2603633a12047678d7b85f14c0c970e" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "922904a85e7c45febb9f75ac6e08c44d"
I20260709 13:05:19.432695 11651 raft_consensus.cc:515] T 503bb0f5891b46de93cbac7e2a184b58 P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:19.433789 11652 raft_consensus.cc:3055] T d2603633a12047678d7b85f14c0c970e P 922904a85e7c45febb9f75ac6e08c44d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:19.434231 11652 raft_consensus.cc:740] T d2603633a12047678d7b85f14c0c970e P 922904a85e7c45febb9f75ac6e08c44d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 922904a85e7c45febb9f75ac6e08c44d, State: Running, Role: LEADER
I20260709 13:05:19.435240 11652 consensus_queue.cc:260] T d2603633a12047678d7b85f14c0c970e P 922904a85e7c45febb9f75ac6e08c44d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:19.436576 11573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503bb0f5891b46de93cbac7e2a184b58" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "645c185863fd448e91faa534d9676384"
I20260709 13:05:19.437147 11652 raft_consensus.cc:3060] T d2603633a12047678d7b85f14c0c970e P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.437427 11573 raft_consensus.cc:3060] T 503bb0f5891b46de93cbac7e2a184b58 P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.437544 11651 leader_election.cc:290] T 503bb0f5891b46de93cbac7e2a184b58 P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 2 election: Requested vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:19.437441 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503bb0f5891b46de93cbac7e2a184b58" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efc52ba30a214524ba9a3705d5b5909f"
I20260709 13:05:19.440027 11726 raft_consensus.cc:3055] T 503bb0f5891b46de93cbac7e2a184b58 P efc52ba30a214524ba9a3705d5b5909f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:19.440400 11726 raft_consensus.cc:740] T 503bb0f5891b46de93cbac7e2a184b58 P efc52ba30a214524ba9a3705d5b5909f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: efc52ba30a214524ba9a3705d5b5909f, State: Running, Role: LEADER
I20260709 13:05:19.441926 11575 raft_consensus.cc:2468] T d2603633a12047678d7b85f14c0c970e P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc52ba30a214524ba9a3705d5b5909f in term 2.
I20260709 13:05:19.443354 11693 leader_election.cc:304] T d2603633a12047678d7b85f14c0c970e P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645c185863fd448e91faa534d9676384, efc52ba30a214524ba9a3705d5b5909f; no voters: 
I20260709 13:05:19.441483 11726 consensus_queue.cc:260] T 503bb0f5891b46de93cbac7e2a184b58 P efc52ba30a214524ba9a3705d5b5909f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:19.444355 11820 raft_consensus.cc:2804] T d2603633a12047678d7b85f14c0c970e P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:19.444777 11726 raft_consensus.cc:3060] T 503bb0f5891b46de93cbac7e2a184b58 P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.444871 11820 raft_consensus.cc:697] T d2603633a12047678d7b85f14c0c970e P efc52ba30a214524ba9a3705d5b5909f [term 2 LEADER]: Becoming Leader. State: Replica: efc52ba30a214524ba9a3705d5b5909f, State: Running, Role: LEADER
I20260709 13:05:19.445977 11820 consensus_queue.cc:237] T d2603633a12047678d7b85f14c0c970e P efc52ba30a214524ba9a3705d5b5909f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:19.450863 11652 raft_consensus.cc:2468] T d2603633a12047678d7b85f14c0c970e P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc52ba30a214524ba9a3705d5b5909f in term 2.
I20260709 13:05:19.453069 11573 raft_consensus.cc:2468] T 503bb0f5891b46de93cbac7e2a184b58 P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 922904a85e7c45febb9f75ac6e08c44d in term 2.
I20260709 13:05:19.453382 11726 raft_consensus.cc:2468] T 503bb0f5891b46de93cbac7e2a184b58 P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 922904a85e7c45febb9f75ac6e08c44d in term 2.
I20260709 13:05:19.454681 11619 leader_election.cc:304] T 503bb0f5891b46de93cbac7e2a184b58 P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645c185863fd448e91faa534d9676384, 922904a85e7c45febb9f75ac6e08c44d; no voters: 
I20260709 13:05:19.455766 11802 raft_consensus.cc:2804] T 503bb0f5891b46de93cbac7e2a184b58 P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:19.456439 11802 raft_consensus.cc:697] T 503bb0f5891b46de93cbac7e2a184b58 P 922904a85e7c45febb9f75ac6e08c44d [term 2 LEADER]: Becoming Leader. State: Replica: 922904a85e7c45febb9f75ac6e08c44d, State: Running, Role: LEADER
I20260709 13:05:19.457422 11802 consensus_queue.cc:237] T 503bb0f5891b46de93cbac7e2a184b58 P 922904a85e7c45febb9f75ac6e08c44d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:19.460016 11472 catalog_manager.cc:5697] T d2603633a12047678d7b85f14c0c970e P efc52ba30a214524ba9a3705d5b5909f reported cstate change: term changed from 1 to 2, leader changed from 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194) to efc52ba30a214524ba9a3705d5b5909f (127.0.107.195). New cstate: current_term: 2 leader_uuid: "efc52ba30a214524ba9a3705d5b5909f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:19.465229 11476 catalog_manager.cc:5697] T 503bb0f5891b46de93cbac7e2a184b58 P 922904a85e7c45febb9f75ac6e08c44d reported cstate change: term changed from 1 to 2, leader changed from efc52ba30a214524ba9a3705d5b5909f (127.0.107.195) to 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "922904a85e7c45febb9f75ac6e08c44d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:19.482247 11819 raft_consensus.cc:993] T a3f692f94196483a9148317c2c73adcd P efc52ba30a214524ba9a3705d5b5909f: : Instructing follower 645c185863fd448e91faa534d9676384 to start an election
I20260709 13:05:19.482775 11809 raft_consensus.cc:1081] T a3f692f94196483a9148317c2c73adcd P efc52ba30a214524ba9a3705d5b5909f [term 1 LEADER]: Signalling peer 645c185863fd448e91faa534d9676384 to start an election
I20260709 13:05:19.484876 11573 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a3f692f94196483a9148317c2c73adcd"
dest_uuid: "645c185863fd448e91faa534d9676384"
 from {username='slave'} at 127.0.0.1:45702
I20260709 13:05:19.485438 11573 raft_consensus.cc:493] T a3f692f94196483a9148317c2c73adcd P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:19.486227 11573 raft_consensus.cc:3060] T a3f692f94196483a9148317c2c73adcd P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.492157 11573 raft_consensus.cc:515] T a3f692f94196483a9148317c2c73adcd P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:19.494091 11573 leader_election.cc:290] T a3f692f94196483a9148317c2c73adcd P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 2 election: Requested vote from peers 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:19.495524 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f692f94196483a9148317c2c73adcd" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "922904a85e7c45febb9f75ac6e08c44d"
I20260709 13:05:19.496018 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f692f94196483a9148317c2c73adcd" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efc52ba30a214524ba9a3705d5b5909f"
I20260709 13:05:19.496413 11652 raft_consensus.cc:3060] T a3f692f94196483a9148317c2c73adcd P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.496968 11726 raft_consensus.cc:3055] T a3f692f94196483a9148317c2c73adcd P efc52ba30a214524ba9a3705d5b5909f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:19.497385 11726 raft_consensus.cc:740] T a3f692f94196483a9148317c2c73adcd P efc52ba30a214524ba9a3705d5b5909f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: efc52ba30a214524ba9a3705d5b5909f, State: Running, Role: LEADER
I20260709 13:05:19.498304 11726 consensus_queue.cc:260] T a3f692f94196483a9148317c2c73adcd P efc52ba30a214524ba9a3705d5b5909f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:19.499492 11726 raft_consensus.cc:3060] T a3f692f94196483a9148317c2c73adcd P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.505146 11726 raft_consensus.cc:2468] T a3f692f94196483a9148317c2c73adcd P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 645c185863fd448e91faa534d9676384 in term 2.
I20260709 13:05:19.507750 11541 leader_election.cc:304] T a3f692f94196483a9148317c2c73adcd P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645c185863fd448e91faa534d9676384, efc52ba30a214524ba9a3705d5b5909f; no voters: 
I20260709 13:05:19.509119 11771 raft_consensus.cc:2804] T a3f692f94196483a9148317c2c73adcd P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:19.509764 11771 raft_consensus.cc:697] T a3f692f94196483a9148317c2c73adcd P 645c185863fd448e91faa534d9676384 [term 2 LEADER]: Becoming Leader. State: Replica: 645c185863fd448e91faa534d9676384, State: Running, Role: LEADER
I20260709 13:05:19.509795 11652 raft_consensus.cc:2468] T a3f692f94196483a9148317c2c73adcd P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 645c185863fd448e91faa534d9676384 in term 2.
I20260709 13:05:19.511606 11771 consensus_queue.cc:237] T a3f692f94196483a9148317c2c73adcd P 645c185863fd448e91faa534d9676384 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:19.529282 11472 catalog_manager.cc:5697] T a3f692f94196483a9148317c2c73adcd P 645c185863fd448e91faa534d9676384 reported cstate change: term changed from 1 to 2, leader changed from efc52ba30a214524ba9a3705d5b5909f (127.0.107.195) to 645c185863fd448e91faa534d9676384 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "645c185863fd448e91faa534d9676384" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:19.659243 11652 raft_consensus.cc:1275] T b6555ed9a2e04888ac596b8dbe747265 P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Refusing update from remote peer 645c185863fd448e91faa534d9676384: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:19.663932 11771 consensus_queue.cc:1048] T b6555ed9a2e04888ac596b8dbe747265 P 645c185863fd448e91faa534d9676384 [LEADER]: Connected to new peer: Peer: permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:19.673898 11726 raft_consensus.cc:1275] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Refusing update from remote peer 645c185863fd448e91faa534d9676384: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:19.676102 11858 consensus_queue.cc:1048] T b6555ed9a2e04888ac596b8dbe747265 P 645c185863fd448e91faa534d9676384 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:19.722455 11652 raft_consensus.cc:1275] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Refusing update from remote peer 645c185863fd448e91faa534d9676384: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:19.724225 11858 consensus_queue.cc:1048] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 645c185863fd448e91faa534d9676384 [LEADER]: Connected to new peer: Peer: permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:19.735059 11726 raft_consensus.cc:1275] T 69acdb3a5cd54bc0b6921e6b343a20c2 P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Refusing update from remote peer 645c185863fd448e91faa534d9676384: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:19.737290 11771 consensus_queue.cc:1048] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 645c185863fd448e91faa534d9676384 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:19.756484 11573 raft_consensus.cc:1275] T 6655f1f8c7674f98bd634a5f88ed3d55 P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Refusing update from remote peer 922904a85e7c45febb9f75ac6e08c44d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:19.761888 11802 consensus_queue.cc:1048] T 6655f1f8c7674f98bd634a5f88ed3d55 P 922904a85e7c45febb9f75ac6e08c44d [LEADER]: Connected to new peer: Peer: permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:19.773746 11726 raft_consensus.cc:1275] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Refusing update from remote peer 922904a85e7c45febb9f75ac6e08c44d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:19.776284 11802 consensus_queue.cc:1048] T 6655f1f8c7674f98bd634a5f88ed3d55 P 922904a85e7c45febb9f75ac6e08c44d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:19.808876 11726 raft_consensus.cc:1275] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Refusing update from remote peer 645c185863fd448e91faa534d9676384: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:19.810562 11771 consensus_queue.cc:1048] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 645c185863fd448e91faa534d9676384 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:19.822659 11652 raft_consensus.cc:1275] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Refusing update from remote peer 645c185863fd448e91faa534d9676384: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:19.829334 11771 consensus_queue.cc:1048] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 645c185863fd448e91faa534d9676384 [LEADER]: Connected to new peer: Peer: permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:19.941324 11573 raft_consensus.cc:1275] T d2603633a12047678d7b85f14c0c970e P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Refusing update from remote peer efc52ba30a214524ba9a3705d5b5909f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:19.941778 11726 raft_consensus.cc:1275] T 503bb0f5891b46de93cbac7e2a184b58 P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Refusing update from remote peer 922904a85e7c45febb9f75ac6e08c44d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:19.944370 11809 consensus_queue.cc:1048] T d2603633a12047678d7b85f14c0c970e P efc52ba30a214524ba9a3705d5b5909f [LEADER]: Connected to new peer: Peer: permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:19.944816 11802 consensus_queue.cc:1048] T 503bb0f5891b46de93cbac7e2a184b58 P 922904a85e7c45febb9f75ac6e08c44d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:19.960809 11652 raft_consensus.cc:1275] T d2603633a12047678d7b85f14c0c970e P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Refusing update from remote peer efc52ba30a214524ba9a3705d5b5909f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:19.967630 11573 raft_consensus.cc:1275] T 503bb0f5891b46de93cbac7e2a184b58 P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Refusing update from remote peer 922904a85e7c45febb9f75ac6e08c44d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:19.970064 11807 consensus_queue.cc:1048] T 503bb0f5891b46de93cbac7e2a184b58 P 922904a85e7c45febb9f75ac6e08c44d [LEADER]: Connected to new peer: Peer: permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:19.970890 11819 consensus_queue.cc:1048] T d2603633a12047678d7b85f14c0c970e P efc52ba30a214524ba9a3705d5b5909f [LEADER]: Connected to new peer: Peer: permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:19.975648 11652 raft_consensus.cc:1275] T a3f692f94196483a9148317c2c73adcd P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Refusing update from remote peer 645c185863fd448e91faa534d9676384: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:19.978832 11858 consensus_queue.cc:1048] T a3f692f94196483a9148317c2c73adcd P 645c185863fd448e91faa534d9676384 [LEADER]: Connected to new peer: Peer: permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:20.000857 11727 raft_consensus.cc:1275] T a3f692f94196483a9148317c2c73adcd P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Refusing update from remote peer 645c185863fd448e91faa534d9676384: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:20.003656 11858 consensus_queue.cc:1048] T a3f692f94196483a9148317c2c73adcd P 645c185863fd448e91faa534d9676384 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:22.166724 11473 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39008:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:22.169431 11473 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:22.227370 11562 tablet_service.cc:1511] Processing CreateTablet for tablet 1ddad75b87454a569aca197513526ac0 (DEFAULT_TABLE table=soft_deleted_table [id=a3a3dff256ef4cbab875574c5f5044e4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:22.228291 11636 tablet_service.cc:1511] Processing CreateTablet for tablet 1ddad75b87454a569aca197513526ac0 (DEFAULT_TABLE table=soft_deleted_table [id=a3a3dff256ef4cbab875574c5f5044e4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:22.229242 11714 tablet_service.cc:1511] Processing CreateTablet for tablet 1ddad75b87454a569aca197513526ac0 (DEFAULT_TABLE table=soft_deleted_table [id=a3a3dff256ef4cbab875574c5f5044e4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:22.229755 11636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ddad75b87454a569aca197513526ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:22.230573 11714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ddad75b87454a569aca197513526ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:22.228675 11562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ddad75b87454a569aca197513526ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:22.232220 11640 tablet_service.cc:1511] Processing CreateTablet for tablet 697274863f944f0fbb85ceb095246a34 (DEFAULT_TABLE table=soft_deleted_table [id=a3a3dff256ef4cbab875574c5f5044e4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:22.233533 11640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 697274863f944f0fbb85ceb095246a34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:22.234752 11563 tablet_service.cc:1511] Processing CreateTablet for tablet 697274863f944f0fbb85ceb095246a34 (DEFAULT_TABLE table=soft_deleted_table [id=a3a3dff256ef4cbab875574c5f5044e4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:22.236194 11563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 697274863f944f0fbb85ceb095246a34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:22.246616 11641 tablet_service.cc:1511] Processing CreateTablet for tablet 92a1be5cd07e49e285721f1cfa7af29f (DEFAULT_TABLE table=soft_deleted_table [id=a3a3dff256ef4cbab875574c5f5044e4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:22.248087 11641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92a1be5cd07e49e285721f1cfa7af29f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:22.251933 11709 tablet_service.cc:1511] Processing CreateTablet for tablet 697274863f944f0fbb85ceb095246a34 (DEFAULT_TABLE table=soft_deleted_table [id=a3a3dff256ef4cbab875574c5f5044e4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:22.253599 11709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 697274863f944f0fbb85ceb095246a34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:22.253916 11561 tablet_service.cc:1511] Processing CreateTablet for tablet 92a1be5cd07e49e285721f1cfa7af29f (DEFAULT_TABLE table=soft_deleted_table [id=a3a3dff256ef4cbab875574c5f5044e4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:22.255167 11561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92a1be5cd07e49e285721f1cfa7af29f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:22.268775 11715 tablet_service.cc:1511] Processing CreateTablet for tablet 92a1be5cd07e49e285721f1cfa7af29f (DEFAULT_TABLE table=soft_deleted_table [id=a3a3dff256ef4cbab875574c5f5044e4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:22.270475 11715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92a1be5cd07e49e285721f1cfa7af29f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:22.278820 11877 tablet_bootstrap.cc:492] T 1ddad75b87454a569aca197513526ac0 P 645c185863fd448e91faa534d9676384: Bootstrap starting.
I20260709 13:05:22.283180 11567 tablet_service.cc:1511] Processing CreateTablet for tablet 9c039891b31042bf80ce793acc763f02 (DEFAULT_TABLE table=soft_deleted_table [id=a3a3dff256ef4cbab875574c5f5044e4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:22.284744 11567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c039891b31042bf80ce793acc763f02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:22.284948 11876 tablet_bootstrap.cc:492] T 1ddad75b87454a569aca197513526ac0 P 922904a85e7c45febb9f75ac6e08c44d: Bootstrap starting.
I20260709 13:05:22.287182 11877 tablet_bootstrap.cc:654] T 1ddad75b87454a569aca197513526ac0 P 645c185863fd448e91faa534d9676384: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.289733 11636 tablet_service.cc:1511] Processing CreateTablet for tablet 9c039891b31042bf80ce793acc763f02 (DEFAULT_TABLE table=soft_deleted_table [id=a3a3dff256ef4cbab875574c5f5044e4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:22.291186 11636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c039891b31042bf80ce793acc763f02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:22.291769 11713 tablet_service.cc:1511] Processing CreateTablet for tablet 9c039891b31042bf80ce793acc763f02 (DEFAULT_TABLE table=soft_deleted_table [id=a3a3dff256ef4cbab875574c5f5044e4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:22.293116 11713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c039891b31042bf80ce793acc763f02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:22.309278 11564 tablet_service.cc:1511] Processing CreateTablet for tablet 93f9b1bb3ecf400b862f2f4138e56c26 (DEFAULT_TABLE table=soft_deleted_table [id=a3a3dff256ef4cbab875574c5f5044e4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:22.310738 11564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93f9b1bb3ecf400b862f2f4138e56c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:22.320142 11876 tablet_bootstrap.cc:654] T 1ddad75b87454a569aca197513526ac0 P 922904a85e7c45febb9f75ac6e08c44d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.321509 11877 tablet_bootstrap.cc:492] T 1ddad75b87454a569aca197513526ac0 P 645c185863fd448e91faa534d9676384: No bootstrap required, opened a new log
I20260709 13:05:22.322104 11877 ts_tablet_manager.cc:1403] T 1ddad75b87454a569aca197513526ac0 P 645c185863fd448e91faa534d9676384: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.011s
I20260709 13:05:22.325469 11877 raft_consensus.cc:359] T 1ddad75b87454a569aca197513526ac0 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.326251 11877 raft_consensus.cc:385] T 1ddad75b87454a569aca197513526ac0 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.326551 11877 raft_consensus.cc:740] T 1ddad75b87454a569aca197513526ac0 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 645c185863fd448e91faa534d9676384, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.327361 11636 tablet_service.cc:1511] Processing CreateTablet for tablet 93f9b1bb3ecf400b862f2f4138e56c26 (DEFAULT_TABLE table=soft_deleted_table [id=a3a3dff256ef4cbab875574c5f5044e4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:22.327610 11877 consensus_queue.cc:260] T 1ddad75b87454a569aca197513526ac0 P 645c185863fd448e91faa534d9676384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.329447 11636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93f9b1bb3ecf400b862f2f4138e56c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:22.338377 11877 ts_tablet_manager.cc:1434] T 1ddad75b87454a569aca197513526ac0 P 645c185863fd448e91faa534d9676384: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 13:05:22.340389 11563 tablet_service.cc:1511] Processing CreateTablet for tablet 4e1812f5a3f645f7916cb5c302389554 (DEFAULT_TABLE table=soft_deleted_table [id=a3a3dff256ef4cbab875574c5f5044e4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:22.342111 11563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e1812f5a3f645f7916cb5c302389554. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:22.340555 11716 tablet_service.cc:1511] Processing CreateTablet for tablet 93f9b1bb3ecf400b862f2f4138e56c26 (DEFAULT_TABLE table=soft_deleted_table [id=a3a3dff256ef4cbab875574c5f5044e4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:22.347435 11716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93f9b1bb3ecf400b862f2f4138e56c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:22.349400 11876 tablet_bootstrap.cc:492] T 1ddad75b87454a569aca197513526ac0 P 922904a85e7c45febb9f75ac6e08c44d: No bootstrap required, opened a new log
I20260709 13:05:22.350016 11876 ts_tablet_manager.cc:1403] T 1ddad75b87454a569aca197513526ac0 P 922904a85e7c45febb9f75ac6e08c44d: Time spent bootstrapping tablet: real 0.065s	user 0.014s	sys 0.005s
I20260709 13:05:22.354142 11713 tablet_service.cc:1511] Processing CreateTablet for tablet 4e1812f5a3f645f7916cb5c302389554 (DEFAULT_TABLE table=soft_deleted_table [id=a3a3dff256ef4cbab875574c5f5044e4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:22.355541 11713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e1812f5a3f645f7916cb5c302389554. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:22.358554 11641 tablet_service.cc:1511] Processing CreateTablet for tablet 150e4155b8b44870a836beaa9aedb09f (DEFAULT_TABLE table=soft_deleted_table [id=a3a3dff256ef4cbab875574c5f5044e4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:22.358870 11561 tablet_service.cc:1511] Processing CreateTablet for tablet 150e4155b8b44870a836beaa9aedb09f (DEFAULT_TABLE table=soft_deleted_table [id=a3a3dff256ef4cbab875574c5f5044e4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:22.359973 11641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 150e4155b8b44870a836beaa9aedb09f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:22.360186 11561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 150e4155b8b44870a836beaa9aedb09f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:22.365010 11880 tablet_bootstrap.cc:492] T 9c039891b31042bf80ce793acc763f02 P efc52ba30a214524ba9a3705d5b5909f: Bootstrap starting.
I20260709 13:05:22.365556 11717 tablet_service.cc:1511] Processing CreateTablet for tablet 150e4155b8b44870a836beaa9aedb09f (DEFAULT_TABLE table=soft_deleted_table [id=a3a3dff256ef4cbab875574c5f5044e4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:22.367182 11717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 150e4155b8b44870a836beaa9aedb09f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:22.369320 11642 tablet_service.cc:1511] Processing CreateTablet for tablet 0e916728a67d4b0e8c29748c8af0b79a (DEFAULT_TABLE table=soft_deleted_table [id=a3a3dff256ef4cbab875574c5f5044e4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:22.370716 11642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e916728a67d4b0e8c29748c8af0b79a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:22.371724 11711 tablet_service.cc:1511] Processing CreateTablet for tablet 0e916728a67d4b0e8c29748c8af0b79a (DEFAULT_TABLE table=soft_deleted_table [id=a3a3dff256ef4cbab875574c5f5044e4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:22.373303 11711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e916728a67d4b0e8c29748c8af0b79a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:22.378149 11564 tablet_service.cc:1511] Processing CreateTablet for tablet 0e916728a67d4b0e8c29748c8af0b79a (DEFAULT_TABLE table=soft_deleted_table [id=a3a3dff256ef4cbab875574c5f5044e4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:22.379796 11564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e916728a67d4b0e8c29748c8af0b79a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:22.383145 11639 tablet_service.cc:1511] Processing CreateTablet for tablet fc065a29f3ec440f9181e37392205f3f (DEFAULT_TABLE table=soft_deleted_table [id=a3a3dff256ef4cbab875574c5f5044e4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:22.384483 11639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc065a29f3ec440f9181e37392205f3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:22.353252 11640 tablet_service.cc:1511] Processing CreateTablet for tablet 4e1812f5a3f645f7916cb5c302389554 (DEFAULT_TABLE table=soft_deleted_table [id=a3a3dff256ef4cbab875574c5f5044e4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:22.386102 11640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e1812f5a3f645f7916cb5c302389554. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:22.388933 11880 tablet_bootstrap.cc:654] T 9c039891b31042bf80ce793acc763f02 P efc52ba30a214524ba9a3705d5b5909f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.380165 11567 tablet_service.cc:1511] Processing CreateTablet for tablet fc065a29f3ec440f9181e37392205f3f (DEFAULT_TABLE table=soft_deleted_table [id=a3a3dff256ef4cbab875574c5f5044e4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:22.396574 11567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc065a29f3ec440f9181e37392205f3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:22.400771 11876 raft_consensus.cc:359] T 1ddad75b87454a569aca197513526ac0 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.401716 11876 raft_consensus.cc:385] T 1ddad75b87454a569aca197513526ac0 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.402038 11876 raft_consensus.cc:740] T 1ddad75b87454a569aca197513526ac0 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 922904a85e7c45febb9f75ac6e08c44d, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.402781 11876 consensus_queue.cc:260] T 1ddad75b87454a569aca197513526ac0 P 922904a85e7c45febb9f75ac6e08c44d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.401420 11877 tablet_bootstrap.cc:492] T 697274863f944f0fbb85ceb095246a34 P 645c185863fd448e91faa534d9676384: Bootstrap starting.
I20260709 13:05:22.407243 11714 tablet_service.cc:1511] Processing CreateTablet for tablet fc065a29f3ec440f9181e37392205f3f (DEFAULT_TABLE table=soft_deleted_table [id=a3a3dff256ef4cbab875574c5f5044e4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:22.414438 11714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc065a29f3ec440f9181e37392205f3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:22.451057 11877 tablet_bootstrap.cc:654] T 697274863f944f0fbb85ceb095246a34 P 645c185863fd448e91faa534d9676384: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.498384 11876 ts_tablet_manager.cc:1434] T 1ddad75b87454a569aca197513526ac0 P 922904a85e7c45febb9f75ac6e08c44d: Time spent starting tablet: real 0.148s	user 0.016s	sys 0.017s
I20260709 13:05:22.499904 11876 tablet_bootstrap.cc:492] T 697274863f944f0fbb85ceb095246a34 P 922904a85e7c45febb9f75ac6e08c44d: Bootstrap starting.
I20260709 13:05:22.504513 11880 tablet_bootstrap.cc:492] T 9c039891b31042bf80ce793acc763f02 P efc52ba30a214524ba9a3705d5b5909f: No bootstrap required, opened a new log
I20260709 13:05:22.505152 11880 ts_tablet_manager.cc:1403] T 9c039891b31042bf80ce793acc763f02 P efc52ba30a214524ba9a3705d5b5909f: Time spent bootstrapping tablet: real 0.140s	user 0.021s	sys 0.000s
I20260709 13:05:22.507345 11876 tablet_bootstrap.cc:654] T 697274863f944f0fbb85ceb095246a34 P 922904a85e7c45febb9f75ac6e08c44d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.509735 11877 tablet_bootstrap.cc:492] T 697274863f944f0fbb85ceb095246a34 P 645c185863fd448e91faa534d9676384: No bootstrap required, opened a new log
I20260709 13:05:22.510313 11877 ts_tablet_manager.cc:1403] T 697274863f944f0fbb85ceb095246a34 P 645c185863fd448e91faa534d9676384: Time spent bootstrapping tablet: real 0.109s	user 0.018s	sys 0.006s
I20260709 13:05:22.509966 11880 raft_consensus.cc:359] T 9c039891b31042bf80ce793acc763f02 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.511216 11880 raft_consensus.cc:385] T 9c039891b31042bf80ce793acc763f02 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.511715 11880 raft_consensus.cc:740] T 9c039891b31042bf80ce793acc763f02 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc52ba30a214524ba9a3705d5b5909f, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.512866 11880 consensus_queue.cc:260] T 9c039891b31042bf80ce793acc763f02 P efc52ba30a214524ba9a3705d5b5909f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.514539 11877 raft_consensus.cc:359] T 697274863f944f0fbb85ceb095246a34 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.515561 11877 raft_consensus.cc:385] T 697274863f944f0fbb85ceb095246a34 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.515944 11876 tablet_bootstrap.cc:492] T 697274863f944f0fbb85ceb095246a34 P 922904a85e7c45febb9f75ac6e08c44d: No bootstrap required, opened a new log
I20260709 13:05:22.515959 11877 raft_consensus.cc:740] T 697274863f944f0fbb85ceb095246a34 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 645c185863fd448e91faa534d9676384, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.516762 11876 ts_tablet_manager.cc:1403] T 697274863f944f0fbb85ceb095246a34 P 922904a85e7c45febb9f75ac6e08c44d: Time spent bootstrapping tablet: real 0.017s	user 0.003s	sys 0.012s
I20260709 13:05:22.573570 11884 raft_consensus.cc:493] T 1ddad75b87454a569aca197513526ac0 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.516146 11880 ts_tablet_manager.cc:1434] T 9c039891b31042bf80ce793acc763f02 P efc52ba30a214524ba9a3705d5b5909f: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:05:22.579146 11880 tablet_bootstrap.cc:492] T 1ddad75b87454a569aca197513526ac0 P efc52ba30a214524ba9a3705d5b5909f: Bootstrap starting.
I20260709 13:05:22.574880 11884 raft_consensus.cc:515] T 1ddad75b87454a569aca197513526ac0 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.574855 11877 consensus_queue.cc:260] T 697274863f944f0fbb85ceb095246a34 P 645c185863fd448e91faa534d9676384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.581177 11876 raft_consensus.cc:359] T 697274863f944f0fbb85ceb095246a34 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.582222 11877 ts_tablet_manager.cc:1434] T 697274863f944f0fbb85ceb095246a34 P 645c185863fd448e91faa534d9676384: Time spent starting tablet: real 0.072s	user 0.009s	sys 0.001s
I20260709 13:05:22.584069 11573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddad75b87454a569aca197513526ac0" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645c185863fd448e91faa534d9676384" is_pre_election: true
I20260709 13:05:22.585270 11573 raft_consensus.cc:2468] T 1ddad75b87454a569aca197513526ac0 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 922904a85e7c45febb9f75ac6e08c44d in term 0.
I20260709 13:05:22.586551 11877 tablet_bootstrap.cc:492] T 92a1be5cd07e49e285721f1cfa7af29f P 645c185863fd448e91faa534d9676384: Bootstrap starting.
I20260709 13:05:22.587426 11619 leader_election.cc:304] T 1ddad75b87454a569aca197513526ac0 P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645c185863fd448e91faa534d9676384, 922904a85e7c45febb9f75ac6e08c44d; no voters: 
I20260709 13:05:22.588883 11881 raft_consensus.cc:2804] T 1ddad75b87454a569aca197513526ac0 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:22.589381 11881 raft_consensus.cc:493] T 1ddad75b87454a569aca197513526ac0 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:22.589735 11881 raft_consensus.cc:3060] T 1ddad75b87454a569aca197513526ac0 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.600912 11884 leader_election.cc:290] T 1ddad75b87454a569aca197513526ac0 P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:22.582444 11876 raft_consensus.cc:385] T 697274863f944f0fbb85ceb095246a34 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.603782 11876 raft_consensus.cc:740] T 697274863f944f0fbb85ceb095246a34 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 922904a85e7c45febb9f75ac6e08c44d, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.603084 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddad75b87454a569aca197513526ac0" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc52ba30a214524ba9a3705d5b5909f" is_pre_election: true
I20260709 13:05:22.605998 11876 consensus_queue.cc:260] T 697274863f944f0fbb85ceb095246a34 P 922904a85e7c45febb9f75ac6e08c44d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
W20260709 13:05:22.607532 11616 leader_election.cc:343] T 1ddad75b87454a569aca197513526ac0 P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:22.611718 11876 ts_tablet_manager.cc:1434] T 697274863f944f0fbb85ceb095246a34 P 922904a85e7c45febb9f75ac6e08c44d: Time spent starting tablet: real 0.038s	user 0.012s	sys 0.001s
I20260709 13:05:22.612655 11877 tablet_bootstrap.cc:654] T 92a1be5cd07e49e285721f1cfa7af29f P 645c185863fd448e91faa534d9676384: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.616736 11881 raft_consensus.cc:515] T 1ddad75b87454a569aca197513526ac0 P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.622223 11876 tablet_bootstrap.cc:492] T 9c039891b31042bf80ce793acc763f02 P 922904a85e7c45febb9f75ac6e08c44d: Bootstrap starting.
I20260709 13:05:22.623337 11877 tablet_bootstrap.cc:492] T 92a1be5cd07e49e285721f1cfa7af29f P 645c185863fd448e91faa534d9676384: No bootstrap required, opened a new log
I20260709 13:05:22.623987 11877 ts_tablet_manager.cc:1403] T 92a1be5cd07e49e285721f1cfa7af29f P 645c185863fd448e91faa534d9676384: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.004s
I20260709 13:05:22.624719 11573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddad75b87454a569aca197513526ac0" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645c185863fd448e91faa534d9676384"
I20260709 13:05:22.625569 11573 raft_consensus.cc:3060] T 1ddad75b87454a569aca197513526ac0 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.628062 11877 raft_consensus.cc:359] T 92a1be5cd07e49e285721f1cfa7af29f P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.628989 11877 raft_consensus.cc:385] T 92a1be5cd07e49e285721f1cfa7af29f P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.629331 11877 raft_consensus.cc:740] T 92a1be5cd07e49e285721f1cfa7af29f P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 645c185863fd448e91faa534d9676384, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.629954 11880 tablet_bootstrap.cc:654] T 1ddad75b87454a569aca197513526ac0 P efc52ba30a214524ba9a3705d5b5909f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.630420 11877 consensus_queue.cc:260] T 92a1be5cd07e49e285721f1cfa7af29f P 645c185863fd448e91faa534d9676384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.631831 11876 tablet_bootstrap.cc:654] T 9c039891b31042bf80ce793acc763f02 P 922904a85e7c45febb9f75ac6e08c44d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.633498 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddad75b87454a569aca197513526ac0" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc52ba30a214524ba9a3705d5b5909f"
W20260709 13:05:22.635388 11616 leader_election.cc:343] T 1ddad75b87454a569aca197513526ac0 P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:22.636078 11881 leader_election.cc:290] T 1ddad75b87454a569aca197513526ac0 P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 election: Requested vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:22.637005 11877 ts_tablet_manager.cc:1434] T 92a1be5cd07e49e285721f1cfa7af29f P 645c185863fd448e91faa534d9676384: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.005s
I20260709 13:05:22.641626 11876 tablet_bootstrap.cc:492] T 9c039891b31042bf80ce793acc763f02 P 922904a85e7c45febb9f75ac6e08c44d: No bootstrap required, opened a new log
I20260709 13:05:22.642334 11876 ts_tablet_manager.cc:1403] T 9c039891b31042bf80ce793acc763f02 P 922904a85e7c45febb9f75ac6e08c44d: Time spent bootstrapping tablet: real 0.021s	user 0.002s	sys 0.016s
I20260709 13:05:22.643023 11877 tablet_bootstrap.cc:492] T 9c039891b31042bf80ce793acc763f02 P 645c185863fd448e91faa534d9676384: Bootstrap starting.
I20260709 13:05:22.643929 11573 raft_consensus.cc:2468] T 1ddad75b87454a569aca197513526ac0 P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 922904a85e7c45febb9f75ac6e08c44d in term 1.
I20260709 13:05:22.645773 11619 leader_election.cc:304] T 1ddad75b87454a569aca197513526ac0 P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 645c185863fd448e91faa534d9676384, 922904a85e7c45febb9f75ac6e08c44d; no voters: efc52ba30a214524ba9a3705d5b5909f
I20260709 13:05:22.646368 11876 raft_consensus.cc:359] T 9c039891b31042bf80ce793acc763f02 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.647207 11876 raft_consensus.cc:385] T 9c039891b31042bf80ce793acc763f02 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.641383 11880 tablet_bootstrap.cc:492] T 1ddad75b87454a569aca197513526ac0 P efc52ba30a214524ba9a3705d5b5909f: No bootstrap required, opened a new log
I20260709 13:05:22.647441 11881 raft_consensus.cc:2804] T 1ddad75b87454a569aca197513526ac0 P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:22.647892 11880 ts_tablet_manager.cc:1403] T 1ddad75b87454a569aca197513526ac0 P efc52ba30a214524ba9a3705d5b5909f: Time spent bootstrapping tablet: real 0.070s	user 0.008s	sys 0.011s
I20260709 13:05:22.648305 11881 raft_consensus.cc:697] T 1ddad75b87454a569aca197513526ac0 P 922904a85e7c45febb9f75ac6e08c44d [term 1 LEADER]: Becoming Leader. State: Replica: 922904a85e7c45febb9f75ac6e08c44d, State: Running, Role: LEADER
I20260709 13:05:22.649960 11881 consensus_queue.cc:237] T 1ddad75b87454a569aca197513526ac0 P 922904a85e7c45febb9f75ac6e08c44d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.647518 11876 raft_consensus.cc:740] T 9c039891b31042bf80ce793acc763f02 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 922904a85e7c45febb9f75ac6e08c44d, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.653100 11877 tablet_bootstrap.cc:654] T 9c039891b31042bf80ce793acc763f02 P 645c185863fd448e91faa534d9676384: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.652696 11876 consensus_queue.cc:260] T 9c039891b31042bf80ce793acc763f02 P 922904a85e7c45febb9f75ac6e08c44d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.655117 11876 ts_tablet_manager.cc:1434] T 9c039891b31042bf80ce793acc763f02 P 922904a85e7c45febb9f75ac6e08c44d: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:05:22.657176 11876 tablet_bootstrap.cc:492] T 92a1be5cd07e49e285721f1cfa7af29f P 922904a85e7c45febb9f75ac6e08c44d: Bootstrap starting.
I20260709 13:05:22.661022 11881 raft_consensus.cc:493] T 9c039891b31042bf80ce793acc763f02 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.661909 11881 raft_consensus.cc:515] T 9c039891b31042bf80ce793acc763f02 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.663235 11880 raft_consensus.cc:359] T 1ddad75b87454a569aca197513526ac0 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.664085 11880 raft_consensus.cc:385] T 1ddad75b87454a569aca197513526ac0 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.664425 11877 tablet_bootstrap.cc:492] T 9c039891b31042bf80ce793acc763f02 P 645c185863fd448e91faa534d9676384: No bootstrap required, opened a new log
I20260709 13:05:22.667644 11573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c039891b31042bf80ce793acc763f02" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645c185863fd448e91faa534d9676384" is_pre_election: true
I20260709 13:05:22.668324 11877 ts_tablet_manager.cc:1403] T 9c039891b31042bf80ce793acc763f02 P 645c185863fd448e91faa534d9676384: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.008s
W20260709 13:05:22.670725 11619 leader_election.cc:343] T 9c039891b31042bf80ce793acc763f02 P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 645c185863fd448e91faa534d9676384 (127.0.107.193:37707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:22.671100 11881 leader_election.cc:290] T 9c039891b31042bf80ce793acc763f02 P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:22.665192 11880 raft_consensus.cc:740] T 1ddad75b87454a569aca197513526ac0 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc52ba30a214524ba9a3705d5b5909f, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.672264 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c039891b31042bf80ce793acc763f02" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc52ba30a214524ba9a3705d5b5909f" is_pre_election: true
I20260709 13:05:22.673171 11726 raft_consensus.cc:2468] T 9c039891b31042bf80ce793acc763f02 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 922904a85e7c45febb9f75ac6e08c44d in term 0.
I20260709 13:05:22.672700 11880 consensus_queue.cc:260] T 1ddad75b87454a569aca197513526ac0 P efc52ba30a214524ba9a3705d5b5909f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.672799 11473 catalog_manager.cc:5697] T 1ddad75b87454a569aca197513526ac0 P 922904a85e7c45febb9f75ac6e08c44d reported cstate change: term changed from 0 to 1, leader changed from <none> to 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "922904a85e7c45febb9f75ac6e08c44d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:22.675190 11616 leader_election.cc:304] T 9c039891b31042bf80ce793acc763f02 P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 922904a85e7c45febb9f75ac6e08c44d, efc52ba30a214524ba9a3705d5b5909f; no voters: 645c185863fd448e91faa534d9676384
I20260709 13:05:22.676743 11881 raft_consensus.cc:2804] T 9c039891b31042bf80ce793acc763f02 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:22.677448 11881 raft_consensus.cc:493] T 9c039891b31042bf80ce793acc763f02 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:22.677848 11880 ts_tablet_manager.cc:1434] T 1ddad75b87454a569aca197513526ac0 P efc52ba30a214524ba9a3705d5b5909f: Time spent starting tablet: real 0.021s	user 0.001s	sys 0.011s
I20260709 13:05:22.677886 11881 raft_consensus.cc:3060] T 9c039891b31042bf80ce793acc763f02 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.679641 11880 tablet_bootstrap.cc:492] T 92a1be5cd07e49e285721f1cfa7af29f P efc52ba30a214524ba9a3705d5b5909f: Bootstrap starting.
I20260709 13:05:22.673645 11877 raft_consensus.cc:359] T 9c039891b31042bf80ce793acc763f02 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.680954 11877 raft_consensus.cc:385] T 9c039891b31042bf80ce793acc763f02 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.681439 11877 raft_consensus.cc:740] T 9c039891b31042bf80ce793acc763f02 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 645c185863fd448e91faa534d9676384, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.682698 11877 consensus_queue.cc:260] T 9c039891b31042bf80ce793acc763f02 P 645c185863fd448e91faa534d9676384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.688894 11881 raft_consensus.cc:515] T 9c039891b31042bf80ce793acc763f02 P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.689342 11880 tablet_bootstrap.cc:654] T 92a1be5cd07e49e285721f1cfa7af29f P efc52ba30a214524ba9a3705d5b5909f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.693765 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c039891b31042bf80ce793acc763f02" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc52ba30a214524ba9a3705d5b5909f"
I20260709 13:05:22.694306 11877 ts_tablet_manager.cc:1434] T 9c039891b31042bf80ce793acc763f02 P 645c185863fd448e91faa534d9676384: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.002s
I20260709 13:05:22.694864 11726 raft_consensus.cc:3060] T 9c039891b31042bf80ce793acc763f02 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.692646 11573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c039891b31042bf80ce793acc763f02" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645c185863fd448e91faa534d9676384"
I20260709 13:05:22.695909 11573 raft_consensus.cc:3060] T 9c039891b31042bf80ce793acc763f02 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.696559 11877 tablet_bootstrap.cc:492] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384: Bootstrap starting.
I20260709 13:05:22.704659 11881 leader_election.cc:290] T 9c039891b31042bf80ce793acc763f02 P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 election: Requested vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:22.723651 11877 tablet_bootstrap.cc:654] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.723742 11726 raft_consensus.cc:2468] T 9c039891b31042bf80ce793acc763f02 P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 922904a85e7c45febb9f75ac6e08c44d in term 1.
I20260709 13:05:22.728217 11573 raft_consensus.cc:2468] T 9c039891b31042bf80ce793acc763f02 P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 922904a85e7c45febb9f75ac6e08c44d in term 1.
I20260709 13:05:22.729051 11616 leader_election.cc:304] T 9c039891b31042bf80ce793acc763f02 P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 922904a85e7c45febb9f75ac6e08c44d, efc52ba30a214524ba9a3705d5b5909f; no voters: 
I20260709 13:05:22.730057 11881 raft_consensus.cc:2804] T 9c039891b31042bf80ce793acc763f02 P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:22.730921 11881 raft_consensus.cc:697] T 9c039891b31042bf80ce793acc763f02 P 922904a85e7c45febb9f75ac6e08c44d [term 1 LEADER]: Becoming Leader. State: Replica: 922904a85e7c45febb9f75ac6e08c44d, State: Running, Role: LEADER
I20260709 13:05:22.731890 11881 consensus_queue.cc:237] T 9c039891b31042bf80ce793acc763f02 P 922904a85e7c45febb9f75ac6e08c44d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.724762 11876 tablet_bootstrap.cc:654] T 92a1be5cd07e49e285721f1cfa7af29f P 922904a85e7c45febb9f75ac6e08c44d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.751783 11472 catalog_manager.cc:5697] T 9c039891b31042bf80ce793acc763f02 P 922904a85e7c45febb9f75ac6e08c44d reported cstate change: term changed from 0 to 1, leader changed from <none> to 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "922904a85e7c45febb9f75ac6e08c44d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:22.756165 11880 tablet_bootstrap.cc:492] T 92a1be5cd07e49e285721f1cfa7af29f P efc52ba30a214524ba9a3705d5b5909f: No bootstrap required, opened a new log
I20260709 13:05:22.756960 11880 ts_tablet_manager.cc:1403] T 92a1be5cd07e49e285721f1cfa7af29f P efc52ba30a214524ba9a3705d5b5909f: Time spent bootstrapping tablet: real 0.078s	user 0.012s	sys 0.027s
I20260709 13:05:22.764293 11876 tablet_bootstrap.cc:492] T 92a1be5cd07e49e285721f1cfa7af29f P 922904a85e7c45febb9f75ac6e08c44d: No bootstrap required, opened a new log
I20260709 13:05:22.765236 11876 ts_tablet_manager.cc:1403] T 92a1be5cd07e49e285721f1cfa7af29f P 922904a85e7c45febb9f75ac6e08c44d: Time spent bootstrapping tablet: real 0.109s	user 0.027s	sys 0.023s
I20260709 13:05:22.766685 11880 raft_consensus.cc:359] T 92a1be5cd07e49e285721f1cfa7af29f P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.767478 11880 raft_consensus.cc:385] T 92a1be5cd07e49e285721f1cfa7af29f P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.767762 11880 raft_consensus.cc:740] T 92a1be5cd07e49e285721f1cfa7af29f P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc52ba30a214524ba9a3705d5b5909f, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.768558 11880 consensus_queue.cc:260] T 92a1be5cd07e49e285721f1cfa7af29f P efc52ba30a214524ba9a3705d5b5909f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.768982 11876 raft_consensus.cc:359] T 92a1be5cd07e49e285721f1cfa7af29f P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.769984 11876 raft_consensus.cc:385] T 92a1be5cd07e49e285721f1cfa7af29f P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.770491 11876 raft_consensus.cc:740] T 92a1be5cd07e49e285721f1cfa7af29f P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 922904a85e7c45febb9f75ac6e08c44d, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.771593 11880 ts_tablet_manager.cc:1434] T 92a1be5cd07e49e285721f1cfa7af29f P efc52ba30a214524ba9a3705d5b5909f: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:05:22.771340 11876 consensus_queue.cc:260] T 92a1be5cd07e49e285721f1cfa7af29f P 922904a85e7c45febb9f75ac6e08c44d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.773387 11880 tablet_bootstrap.cc:492] T 697274863f944f0fbb85ceb095246a34 P efc52ba30a214524ba9a3705d5b5909f: Bootstrap starting.
I20260709 13:05:22.774111 11876 ts_tablet_manager.cc:1434] T 92a1be5cd07e49e285721f1cfa7af29f P 922904a85e7c45febb9f75ac6e08c44d: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:05:22.775420 11876 tablet_bootstrap.cc:492] T 93f9b1bb3ecf400b862f2f4138e56c26 P 922904a85e7c45febb9f75ac6e08c44d: Bootstrap starting.
I20260709 13:05:22.783512 11877 tablet_bootstrap.cc:492] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384: No bootstrap required, opened a new log
I20260709 13:05:22.784127 11877 ts_tablet_manager.cc:1403] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384: Time spent bootstrapping tablet: real 0.088s	user 0.007s	sys 0.011s
I20260709 13:05:22.785413 11876 tablet_bootstrap.cc:654] T 93f9b1bb3ecf400b862f2f4138e56c26 P 922904a85e7c45febb9f75ac6e08c44d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.781721 11880 tablet_bootstrap.cc:654] T 697274863f944f0fbb85ceb095246a34 P efc52ba30a214524ba9a3705d5b5909f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.795569 11877 raft_consensus.cc:359] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.796700 11877 raft_consensus.cc:385] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.797032 11877 raft_consensus.cc:740] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 645c185863fd448e91faa534d9676384, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.798112 11876 tablet_bootstrap.cc:492] T 93f9b1bb3ecf400b862f2f4138e56c26 P 922904a85e7c45febb9f75ac6e08c44d: No bootstrap required, opened a new log
I20260709 13:05:22.798250 11880 tablet_bootstrap.cc:492] T 697274863f944f0fbb85ceb095246a34 P efc52ba30a214524ba9a3705d5b5909f: No bootstrap required, opened a new log
I20260709 13:05:22.798036 11877 consensus_queue.cc:260] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.798801 11876 ts_tablet_manager.cc:1403] T 93f9b1bb3ecf400b862f2f4138e56c26 P 922904a85e7c45febb9f75ac6e08c44d: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.007s
I20260709 13:05:22.799201 11880 ts_tablet_manager.cc:1403] T 697274863f944f0fbb85ceb095246a34 P efc52ba30a214524ba9a3705d5b5909f: Time spent bootstrapping tablet: real 0.026s	user 0.005s	sys 0.015s
I20260709 13:05:22.802276 11876 raft_consensus.cc:359] T 93f9b1bb3ecf400b862f2f4138e56c26 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.802489 11880 raft_consensus.cc:359] T 697274863f944f0fbb85ceb095246a34 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.803066 11876 raft_consensus.cc:385] T 93f9b1bb3ecf400b862f2f4138e56c26 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.803335 11880 raft_consensus.cc:385] T 697274863f944f0fbb85ceb095246a34 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.803439 11876 raft_consensus.cc:740] T 93f9b1bb3ecf400b862f2f4138e56c26 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 922904a85e7c45febb9f75ac6e08c44d, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.803828 11880 raft_consensus.cc:740] T 697274863f944f0fbb85ceb095246a34 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc52ba30a214524ba9a3705d5b5909f, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.804375 11876 consensus_queue.cc:260] T 93f9b1bb3ecf400b862f2f4138e56c26 P 922904a85e7c45febb9f75ac6e08c44d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.804853 11880 consensus_queue.cc:260] T 697274863f944f0fbb85ceb095246a34 P efc52ba30a214524ba9a3705d5b5909f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.807322 11876 ts_tablet_manager.cc:1434] T 93f9b1bb3ecf400b862f2f4138e56c26 P 922904a85e7c45febb9f75ac6e08c44d: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:05:22.807528 11880 ts_tablet_manager.cc:1434] T 697274863f944f0fbb85ceb095246a34 P efc52ba30a214524ba9a3705d5b5909f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:05:22.808990 11876 tablet_bootstrap.cc:492] T 0e916728a67d4b0e8c29748c8af0b79a P 922904a85e7c45febb9f75ac6e08c44d: Bootstrap starting.
I20260709 13:05:22.812041 11877 ts_tablet_manager.cc:1434] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384: Time spent starting tablet: real 0.028s	user 0.010s	sys 0.001s
I20260709 13:05:22.817891 11880 tablet_bootstrap.cc:492] T 0e916728a67d4b0e8c29748c8af0b79a P efc52ba30a214524ba9a3705d5b5909f: Bootstrap starting.
I20260709 13:05:22.819072 11876 tablet_bootstrap.cc:654] T 0e916728a67d4b0e8c29748c8af0b79a P 922904a85e7c45febb9f75ac6e08c44d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.825579 11880 tablet_bootstrap.cc:654] T 0e916728a67d4b0e8c29748c8af0b79a P efc52ba30a214524ba9a3705d5b5909f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.826978 11877 tablet_bootstrap.cc:492] T fc065a29f3ec440f9181e37392205f3f P 645c185863fd448e91faa534d9676384: Bootstrap starting.
I20260709 13:05:22.830912 11819 raft_consensus.cc:493] T 697274863f944f0fbb85ceb095246a34 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.831794 11819 raft_consensus.cc:515] T 697274863f944f0fbb85ceb095246a34 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.835847 11573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "697274863f944f0fbb85ceb095246a34" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645c185863fd448e91faa534d9676384" is_pre_election: true
I20260709 13:05:22.836578 11573 raft_consensus.cc:2468] T 697274863f944f0fbb85ceb095246a34 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc52ba30a214524ba9a3705d5b5909f in term 0.
I20260709 13:05:22.838228 11693 leader_election.cc:304] T 697274863f944f0fbb85ceb095246a34 P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645c185863fd448e91faa534d9676384, efc52ba30a214524ba9a3705d5b5909f; no voters: 
I20260709 13:05:22.838840 11880 tablet_bootstrap.cc:492] T 0e916728a67d4b0e8c29748c8af0b79a P efc52ba30a214524ba9a3705d5b5909f: No bootstrap required, opened a new log
I20260709 13:05:22.839483 11880 ts_tablet_manager.cc:1403] T 0e916728a67d4b0e8c29748c8af0b79a P efc52ba30a214524ba9a3705d5b5909f: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.004s
I20260709 13:05:22.839764 11819 leader_election.cc:290] T 697274863f944f0fbb85ceb095246a34 P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415)
I20260709 13:05:22.840359 11819 raft_consensus.cc:2804] T 697274863f944f0fbb85ceb095246a34 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:22.840715 11819 raft_consensus.cc:493] T 697274863f944f0fbb85ceb095246a34 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:22.841126 11819 raft_consensus.cc:3060] T 697274863f944f0fbb85ceb095246a34 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.842779 11880 raft_consensus.cc:359] T 0e916728a67d4b0e8c29748c8af0b79a P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.843425 11880 raft_consensus.cc:385] T 0e916728a67d4b0e8c29748c8af0b79a P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.843688 11880 raft_consensus.cc:740] T 0e916728a67d4b0e8c29748c8af0b79a P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc52ba30a214524ba9a3705d5b5909f, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.844431 11880 consensus_queue.cc:260] T 0e916728a67d4b0e8c29748c8af0b79a P efc52ba30a214524ba9a3705d5b5909f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.846338 11880 ts_tablet_manager.cc:1434] T 0e916728a67d4b0e8c29748c8af0b79a P efc52ba30a214524ba9a3705d5b5909f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:22.847566 11880 tablet_bootstrap.cc:492] T 4e1812f5a3f645f7916cb5c302389554 P efc52ba30a214524ba9a3705d5b5909f: Bootstrap starting.
I20260709 13:05:22.854355 11880 tablet_bootstrap.cc:654] T 4e1812f5a3f645f7916cb5c302389554 P efc52ba30a214524ba9a3705d5b5909f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.859750 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "697274863f944f0fbb85ceb095246a34" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922904a85e7c45febb9f75ac6e08c44d" is_pre_election: true
I20260709 13:05:22.860865 11651 raft_consensus.cc:2468] T 697274863f944f0fbb85ceb095246a34 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc52ba30a214524ba9a3705d5b5909f in term 0.
I20260709 13:05:22.863826 11857 raft_consensus.cc:493] T 92a1be5cd07e49e285721f1cfa7af29f P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.864439 11857 raft_consensus.cc:515] T 92a1be5cd07e49e285721f1cfa7af29f P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.866093 11819 raft_consensus.cc:515] T 697274863f944f0fbb85ceb095246a34 P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.868904 11876 tablet_bootstrap.cc:492] T 0e916728a67d4b0e8c29748c8af0b79a P 922904a85e7c45febb9f75ac6e08c44d: No bootstrap required, opened a new log
I20260709 13:05:22.868764 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a1be5cd07e49e285721f1cfa7af29f" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc52ba30a214524ba9a3705d5b5909f" is_pre_election: true
I20260709 13:05:22.869014 11819 leader_election.cc:290] T 697274863f944f0fbb85ceb095246a34 P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 election: Requested vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415)
I20260709 13:05:22.869582 11876 ts_tablet_manager.cc:1403] T 0e916728a67d4b0e8c29748c8af0b79a P 922904a85e7c45febb9f75ac6e08c44d: Time spent bootstrapping tablet: real 0.061s	user 0.027s	sys 0.017s
I20260709 13:05:22.870669 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a1be5cd07e49e285721f1cfa7af29f" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922904a85e7c45febb9f75ac6e08c44d" is_pre_election: true
I20260709 13:05:22.871400 11651 raft_consensus.cc:2468] T 92a1be5cd07e49e285721f1cfa7af29f P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 645c185863fd448e91faa534d9676384 in term 0.
I20260709 13:05:22.872877 11857 leader_election.cc:290] T 92a1be5cd07e49e285721f1cfa7af29f P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:22.873036 11544 leader_election.cc:304] T 92a1be5cd07e49e285721f1cfa7af29f P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645c185863fd448e91faa534d9676384, 922904a85e7c45febb9f75ac6e08c44d; no voters: 
I20260709 13:05:22.873325 11876 raft_consensus.cc:359] T 0e916728a67d4b0e8c29748c8af0b79a P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.874128 11876 raft_consensus.cc:385] T 0e916728a67d4b0e8c29748c8af0b79a P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.874517 11876 raft_consensus.cc:740] T 0e916728a67d4b0e8c29748c8af0b79a P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 922904a85e7c45febb9f75ac6e08c44d, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.875423 11876 consensus_queue.cc:260] T 0e916728a67d4b0e8c29748c8af0b79a P 922904a85e7c45febb9f75ac6e08c44d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.876974 11573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "697274863f944f0fbb85ceb095246a34" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645c185863fd448e91faa534d9676384"
I20260709 13:05:22.877774 11573 raft_consensus.cc:3060] T 697274863f944f0fbb85ceb095246a34 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.883461 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "697274863f944f0fbb85ceb095246a34" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922904a85e7c45febb9f75ac6e08c44d"
I20260709 13:05:22.869580 11726 raft_consensus.cc:2468] T 92a1be5cd07e49e285721f1cfa7af29f P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 645c185863fd448e91faa534d9676384 in term 0.
I20260709 13:05:22.889639 11877 tablet_bootstrap.cc:654] T fc065a29f3ec440f9181e37392205f3f P 645c185863fd448e91faa534d9676384: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.891338 11651 raft_consensus.cc:3060] T 697274863f944f0fbb85ceb095246a34 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.894224 11880 tablet_bootstrap.cc:492] T 4e1812f5a3f645f7916cb5c302389554 P efc52ba30a214524ba9a3705d5b5909f: No bootstrap required, opened a new log
I20260709 13:05:22.884565 11857 raft_consensus.cc:2804] T 92a1be5cd07e49e285721f1cfa7af29f P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:22.886651 11876 ts_tablet_manager.cc:1434] T 0e916728a67d4b0e8c29748c8af0b79a P 922904a85e7c45febb9f75ac6e08c44d: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:05:22.889536 11573 raft_consensus.cc:2468] T 697274863f944f0fbb85ceb095246a34 P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc52ba30a214524ba9a3705d5b5909f in term 1.
I20260709 13:05:22.894819 11857 raft_consensus.cc:493] T 92a1be5cd07e49e285721f1cfa7af29f P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:22.897730 11857 raft_consensus.cc:3060] T 92a1be5cd07e49e285721f1cfa7af29f P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.897862 11693 leader_election.cc:304] T 697274863f944f0fbb85ceb095246a34 P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645c185863fd448e91faa534d9676384, efc52ba30a214524ba9a3705d5b5909f; no voters: 
I20260709 13:05:22.898594 11819 raft_consensus.cc:493] T 1ddad75b87454a569aca197513526ac0 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.899010 11901 raft_consensus.cc:2804] T 697274863f944f0fbb85ceb095246a34 P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:22.899096 11819 raft_consensus.cc:515] T 1ddad75b87454a569aca197513526ac0 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.901809 11819 leader_election.cc:290] T 1ddad75b87454a569aca197513526ac0 P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415)
I20260709 13:05:22.895955 11876 tablet_bootstrap.cc:492] T 150e4155b8b44870a836beaa9aedb09f P 922904a85e7c45febb9f75ac6e08c44d: Bootstrap starting.
I20260709 13:05:22.903777 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddad75b87454a569aca197513526ac0" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922904a85e7c45febb9f75ac6e08c44d" is_pre_election: true
I20260709 13:05:22.903944 11573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddad75b87454a569aca197513526ac0" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645c185863fd448e91faa534d9676384" is_pre_election: true
I20260709 13:05:22.906492 11573 raft_consensus.cc:2393] T 1ddad75b87454a569aca197513526ac0 P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc52ba30a214524ba9a3705d5b5909f in current term 1: Already voted for candidate 922904a85e7c45febb9f75ac6e08c44d in this term.
I20260709 13:05:22.906142 11901 raft_consensus.cc:697] T 697274863f944f0fbb85ceb095246a34 P efc52ba30a214524ba9a3705d5b5909f [term 1 LEADER]: Becoming Leader. State: Replica: efc52ba30a214524ba9a3705d5b5909f, State: Running, Role: LEADER
I20260709 13:05:22.908448 11901 consensus_queue.cc:237] T 697274863f944f0fbb85ceb095246a34 P efc52ba30a214524ba9a3705d5b5909f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.911299 11651 raft_consensus.cc:2468] T 697274863f944f0fbb85ceb095246a34 P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc52ba30a214524ba9a3705d5b5909f in term 1.
I20260709 13:05:22.913353 11876 tablet_bootstrap.cc:654] T 150e4155b8b44870a836beaa9aedb09f P 922904a85e7c45febb9f75ac6e08c44d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.913610 11693 leader_election.cc:304] T 1ddad75b87454a569aca197513526ac0 P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc52ba30a214524ba9a3705d5b5909f; no voters: 645c185863fd448e91faa534d9676384, 922904a85e7c45febb9f75ac6e08c44d
I20260709 13:05:22.914575 11819 raft_consensus.cc:3060] T 1ddad75b87454a569aca197513526ac0 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.913646 11877 tablet_bootstrap.cc:492] T fc065a29f3ec440f9181e37392205f3f P 645c185863fd448e91faa534d9676384: No bootstrap required, opened a new log
I20260709 13:05:22.894862 11880 ts_tablet_manager.cc:1403] T 4e1812f5a3f645f7916cb5c302389554 P efc52ba30a214524ba9a3705d5b5909f: Time spent bootstrapping tablet: real 0.048s	user 0.016s	sys 0.028s
I20260709 13:05:22.916579 11877 ts_tablet_manager.cc:1403] T fc065a29f3ec440f9181e37392205f3f P 645c185863fd448e91faa534d9676384: Time spent bootstrapping tablet: real 0.090s	user 0.018s	sys 0.000s
I20260709 13:05:22.920701 11880 raft_consensus.cc:359] T 4e1812f5a3f645f7916cb5c302389554 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.921769 11880 raft_consensus.cc:385] T 4e1812f5a3f645f7916cb5c302389554 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.922122 11880 raft_consensus.cc:740] T 4e1812f5a3f645f7916cb5c302389554 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc52ba30a214524ba9a3705d5b5909f, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.922955 11880 consensus_queue.cc:260] T 4e1812f5a3f645f7916cb5c302389554 P efc52ba30a214524ba9a3705d5b5909f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.932464 11877 raft_consensus.cc:359] T fc065a29f3ec440f9181e37392205f3f P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.933689 11877 raft_consensus.cc:385] T fc065a29f3ec440f9181e37392205f3f P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.934070 11877 raft_consensus.cc:740] T fc065a29f3ec440f9181e37392205f3f P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 645c185863fd448e91faa534d9676384, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.935822 11857 raft_consensus.cc:515] T 92a1be5cd07e49e285721f1cfa7af29f P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.938773 11857 leader_election.cc:290] T 92a1be5cd07e49e285721f1cfa7af29f P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 election: Requested vote from peers 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:22.940547 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a1be5cd07e49e285721f1cfa7af29f" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc52ba30a214524ba9a3705d5b5909f"
I20260709 13:05:22.941433 11726 raft_consensus.cc:3060] T 92a1be5cd07e49e285721f1cfa7af29f P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.935534 11877 consensus_queue.cc:260] T fc065a29f3ec440f9181e37392205f3f P 645c185863fd448e91faa534d9676384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.943630 11472 catalog_manager.cc:5697] T 697274863f944f0fbb85ceb095246a34 P efc52ba30a214524ba9a3705d5b5909f reported cstate change: term changed from 0 to 1, leader changed from <none> to efc52ba30a214524ba9a3705d5b5909f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "efc52ba30a214524ba9a3705d5b5909f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:22.945348 11876 tablet_bootstrap.cc:492] T 150e4155b8b44870a836beaa9aedb09f P 922904a85e7c45febb9f75ac6e08c44d: No bootstrap required, opened a new log
I20260709 13:05:22.945586 11877 ts_tablet_manager.cc:1434] T fc065a29f3ec440f9181e37392205f3f P 645c185863fd448e91faa534d9676384: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.000s
I20260709 13:05:22.945940 11876 ts_tablet_manager.cc:1403] T 150e4155b8b44870a836beaa9aedb09f P 922904a85e7c45febb9f75ac6e08c44d: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.005s
I20260709 13:05:22.946882 11877 tablet_bootstrap.cc:492] T 4e1812f5a3f645f7916cb5c302389554 P 645c185863fd448e91faa534d9676384: Bootstrap starting.
I20260709 13:05:22.951367 11726 raft_consensus.cc:2468] T 92a1be5cd07e49e285721f1cfa7af29f P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 645c185863fd448e91faa534d9676384 in term 1.
I20260709 13:05:22.953377 11541 leader_election.cc:304] T 92a1be5cd07e49e285721f1cfa7af29f P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645c185863fd448e91faa534d9676384, efc52ba30a214524ba9a3705d5b5909f; no voters: 
I20260709 13:05:22.953877 11880 ts_tablet_manager.cc:1434] T 4e1812f5a3f645f7916cb5c302389554 P efc52ba30a214524ba9a3705d5b5909f: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.004s
I20260709 13:05:22.955509 11880 tablet_bootstrap.cc:492] T 93f9b1bb3ecf400b862f2f4138e56c26 P efc52ba30a214524ba9a3705d5b5909f: Bootstrap starting.
I20260709 13:05:22.958580 11819 raft_consensus.cc:2749] T 1ddad75b87454a569aca197513526ac0 P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:22.958743 11907 raft_consensus.cc:2804] T 92a1be5cd07e49e285721f1cfa7af29f P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:22.959642 11907 raft_consensus.cc:697] T 92a1be5cd07e49e285721f1cfa7af29f P 645c185863fd448e91faa534d9676384 [term 1 LEADER]: Becoming Leader. State: Replica: 645c185863fd448e91faa534d9676384, State: Running, Role: LEADER
I20260709 13:05:22.960969 11877 tablet_bootstrap.cc:654] T 4e1812f5a3f645f7916cb5c302389554 P 645c185863fd448e91faa534d9676384: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.960695 11907 consensus_queue.cc:237] T 92a1be5cd07e49e285721f1cfa7af29f P 645c185863fd448e91faa534d9676384 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.964870 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a1be5cd07e49e285721f1cfa7af29f" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922904a85e7c45febb9f75ac6e08c44d"
I20260709 13:05:22.965229 11880 tablet_bootstrap.cc:654] T 93f9b1bb3ecf400b862f2f4138e56c26 P efc52ba30a214524ba9a3705d5b5909f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.965726 11651 raft_consensus.cc:3060] T 92a1be5cd07e49e285721f1cfa7af29f P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.967666 11876 raft_consensus.cc:359] T 150e4155b8b44870a836beaa9aedb09f P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.969422 11876 raft_consensus.cc:385] T 150e4155b8b44870a836beaa9aedb09f P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.969732 11876 raft_consensus.cc:740] T 150e4155b8b44870a836beaa9aedb09f P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 922904a85e7c45febb9f75ac6e08c44d, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.970584 11876 consensus_queue.cc:260] T 150e4155b8b44870a836beaa9aedb09f P 922904a85e7c45febb9f75ac6e08c44d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:22.973815 11876 ts_tablet_manager.cc:1434] T 150e4155b8b44870a836beaa9aedb09f P 922904a85e7c45febb9f75ac6e08c44d: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 13:05:22.982892 11876 tablet_bootstrap.cc:492] T fc065a29f3ec440f9181e37392205f3f P 922904a85e7c45febb9f75ac6e08c44d: Bootstrap starting.
I20260709 13:05:23.006434 11819 raft_consensus.cc:493] T 4e1812f5a3f645f7916cb5c302389554 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.007407 11877 tablet_bootstrap.cc:492] T 4e1812f5a3f645f7916cb5c302389554 P 645c185863fd448e91faa534d9676384: No bootstrap required, opened a new log
I20260709 13:05:23.007341 11819 raft_consensus.cc:515] T 4e1812f5a3f645f7916cb5c302389554 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:23.008282 11877 ts_tablet_manager.cc:1403] T 4e1812f5a3f645f7916cb5c302389554 P 645c185863fd448e91faa534d9676384: Time spent bootstrapping tablet: real 0.062s	user 0.022s	sys 0.021s
I20260709 13:05:23.020241 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1812f5a3f645f7916cb5c302389554" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922904a85e7c45febb9f75ac6e08c44d" is_pre_election: true
I20260709 13:05:23.022343 11575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1812f5a3f645f7916cb5c302389554" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645c185863fd448e91faa534d9676384" is_pre_election: true
W20260709 13:05:23.023288 11693 leader_election.cc:343] T 4e1812f5a3f645f7916cb5c302389554 P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.025920 11819 leader_election.cc:290] T 4e1812f5a3f645f7916cb5c302389554 P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415)
I20260709 13:05:23.028337 11876 tablet_bootstrap.cc:654] T fc065a29f3ec440f9181e37392205f3f P 922904a85e7c45febb9f75ac6e08c44d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.028224 11651 raft_consensus.cc:2468] T 92a1be5cd07e49e285721f1cfa7af29f P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 645c185863fd448e91faa534d9676384 in term 1.
I20260709 13:05:23.034442 11833 raft_consensus.cc:493] T 0e916728a67d4b0e8c29748c8af0b79a P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.035123 11833 raft_consensus.cc:515] T 0e916728a67d4b0e8c29748c8af0b79a P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:23.036988 11877 raft_consensus.cc:359] T 4e1812f5a3f645f7916cb5c302389554 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
W20260709 13:05:23.037524 11693 leader_election.cc:343] T 4e1812f5a3f645f7916cb5c302389554 P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 645c185863fd448e91faa534d9676384 (127.0.107.193:37707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.037900 11877 raft_consensus.cc:385] T 4e1812f5a3f645f7916cb5c302389554 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.038199 11693 leader_election.cc:304] T 4e1812f5a3f645f7916cb5c302389554 P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc52ba30a214524ba9a3705d5b5909f; no voters: 645c185863fd448e91faa534d9676384, 922904a85e7c45febb9f75ac6e08c44d
I20260709 13:05:23.038264 11877 raft_consensus.cc:740] T 4e1812f5a3f645f7916cb5c302389554 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 645c185863fd448e91faa534d9676384, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.039280 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e916728a67d4b0e8c29748c8af0b79a" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc52ba30a214524ba9a3705d5b5909f" is_pre_election: true
I20260709 13:05:23.039939 11726 raft_consensus.cc:2468] T 0e916728a67d4b0e8c29748c8af0b79a P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 922904a85e7c45febb9f75ac6e08c44d in term 0.
I20260709 13:05:23.039889 11877 consensus_queue.cc:260] T 4e1812f5a3f645f7916cb5c302389554 P 645c185863fd448e91faa534d9676384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:23.039912 11819 raft_consensus.cc:2749] T 4e1812f5a3f645f7916cb5c302389554 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:23.042318 11575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e916728a67d4b0e8c29748c8af0b79a" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645c185863fd448e91faa534d9676384" is_pre_election: true
I20260709 13:05:23.042507 11616 leader_election.cc:304] T 0e916728a67d4b0e8c29748c8af0b79a P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 922904a85e7c45febb9f75ac6e08c44d, efc52ba30a214524ba9a3705d5b5909f; no voters: 
I20260709 13:05:23.043421 11881 raft_consensus.cc:2804] T 0e916728a67d4b0e8c29748c8af0b79a P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:23.043813 11881 raft_consensus.cc:493] T 0e916728a67d4b0e8c29748c8af0b79a P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:23.044202 11881 raft_consensus.cc:3060] T 0e916728a67d4b0e8c29748c8af0b79a P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.044297 11877 ts_tablet_manager.cc:1434] T 4e1812f5a3f645f7916cb5c302389554 P 645c185863fd448e91faa534d9676384: Time spent starting tablet: real 0.036s	user 0.002s	sys 0.009s
I20260709 13:05:23.046590 11880 tablet_bootstrap.cc:492] T 93f9b1bb3ecf400b862f2f4138e56c26 P efc52ba30a214524ba9a3705d5b5909f: No bootstrap required, opened a new log
I20260709 13:05:23.046518 11877 tablet_bootstrap.cc:492] T 150e4155b8b44870a836beaa9aedb09f P 645c185863fd448e91faa534d9676384: Bootstrap starting.
I20260709 13:05:23.047402 11880 ts_tablet_manager.cc:1403] T 93f9b1bb3ecf400b862f2f4138e56c26 P efc52ba30a214524ba9a3705d5b5909f: Time spent bootstrapping tablet: real 0.092s	user 0.031s	sys 0.044s
I20260709 13:05:23.048323 11857 raft_consensus.cc:493] T fc065a29f3ec440f9181e37392205f3f P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:23.049023 11619 leader_election.cc:343] T 0e916728a67d4b0e8c29748c8af0b79a P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 645c185863fd448e91faa534d9676384 (127.0.107.193:37707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.048890 11857 raft_consensus.cc:515] T fc065a29f3ec440f9181e37392205f3f P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:23.050917 11880 raft_consensus.cc:359] T 93f9b1bb3ecf400b862f2f4138e56c26 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:23.051782 11880 raft_consensus.cc:385] T 93f9b1bb3ecf400b862f2f4138e56c26 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.052253 11880 raft_consensus.cc:740] T 93f9b1bb3ecf400b862f2f4138e56c26 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc52ba30a214524ba9a3705d5b5909f, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.052649 11857 leader_election.cc:290] T fc065a29f3ec440f9181e37392205f3f P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:23.053369 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc065a29f3ec440f9181e37392205f3f" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922904a85e7c45febb9f75ac6e08c44d" is_pre_election: true
W20260709 13:05:23.055646 11544 leader_election.cc:343] T fc065a29f3ec440f9181e37392205f3f P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.053194 11880 consensus_queue.cc:260] T 93f9b1bb3ecf400b862f2f4138e56c26 P efc52ba30a214524ba9a3705d5b5909f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:23.060415 11877 tablet_bootstrap.cc:654] T 150e4155b8b44870a836beaa9aedb09f P 645c185863fd448e91faa534d9676384: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.060068 11887 consensus_queue.cc:1048] T 1ddad75b87454a569aca197513526ac0 P 922904a85e7c45febb9f75ac6e08c44d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:23.061033 11880 ts_tablet_manager.cc:1434] T 93f9b1bb3ecf400b862f2f4138e56c26 P efc52ba30a214524ba9a3705d5b5909f: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:05:23.061175 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc065a29f3ec440f9181e37392205f3f" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc52ba30a214524ba9a3705d5b5909f" is_pre_election: true
I20260709 13:05:23.059325 11472 catalog_manager.cc:5697] T 92a1be5cd07e49e285721f1cfa7af29f P 645c185863fd448e91faa534d9676384 reported cstate change: term changed from 0 to 1, leader changed from <none> to 645c185863fd448e91faa534d9676384 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "645c185863fd448e91faa534d9676384" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:23.062816 11541 leader_election.cc:343] T fc065a29f3ec440f9181e37392205f3f P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.063355 11541 leader_election.cc:304] T fc065a29f3ec440f9181e37392205f3f P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 645c185863fd448e91faa534d9676384; no voters: 922904a85e7c45febb9f75ac6e08c44d, efc52ba30a214524ba9a3705d5b5909f
I20260709 13:05:23.064391 11880 tablet_bootstrap.cc:492] T 150e4155b8b44870a836beaa9aedb09f P efc52ba30a214524ba9a3705d5b5909f: Bootstrap starting.
W20260709 13:05:23.074100 11524 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:23.080596 11857 raft_consensus.cc:2749] T fc065a29f3ec440f9181e37392205f3f P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:23.081472 11880 tablet_bootstrap.cc:654] T 150e4155b8b44870a836beaa9aedb09f P efc52ba30a214524ba9a3705d5b5909f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.094214 11833 leader_election.cc:290] T 0e916728a67d4b0e8c29748c8af0b79a P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:23.113999 11880 tablet_bootstrap.cc:492] T 150e4155b8b44870a836beaa9aedb09f P efc52ba30a214524ba9a3705d5b5909f: No bootstrap required, opened a new log
I20260709 13:05:23.114795 11880 ts_tablet_manager.cc:1403] T 150e4155b8b44870a836beaa9aedb09f P efc52ba30a214524ba9a3705d5b5909f: Time spent bootstrapping tablet: real 0.051s	user 0.008s	sys 0.016s
I20260709 13:05:23.119056 11880 raft_consensus.cc:359] T 150e4155b8b44870a836beaa9aedb09f P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:23.120455 11880 raft_consensus.cc:385] T 150e4155b8b44870a836beaa9aedb09f P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.120836 11880 raft_consensus.cc:740] T 150e4155b8b44870a836beaa9aedb09f P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc52ba30a214524ba9a3705d5b5909f, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.122359 11880 consensus_queue.cc:260] T 150e4155b8b44870a836beaa9aedb09f P efc52ba30a214524ba9a3705d5b5909f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:23.125695 11880 ts_tablet_manager.cc:1434] T 150e4155b8b44870a836beaa9aedb09f P efc52ba30a214524ba9a3705d5b5909f: Time spent starting tablet: real 0.011s	user 0.011s	sys 0.000s
I20260709 13:05:23.127985 11880 tablet_bootstrap.cc:492] T fc065a29f3ec440f9181e37392205f3f P efc52ba30a214524ba9a3705d5b5909f: Bootstrap starting.
I20260709 13:05:23.137171 11880 tablet_bootstrap.cc:654] T fc065a29f3ec440f9181e37392205f3f P efc52ba30a214524ba9a3705d5b5909f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.108553 11881 raft_consensus.cc:515] T 0e916728a67d4b0e8c29748c8af0b79a P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:23.152572 11880 tablet_bootstrap.cc:492] T fc065a29f3ec440f9181e37392205f3f P efc52ba30a214524ba9a3705d5b5909f: No bootstrap required, opened a new log
I20260709 13:05:23.153302 11880 ts_tablet_manager.cc:1403] T fc065a29f3ec440f9181e37392205f3f P efc52ba30a214524ba9a3705d5b5909f: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.004s
I20260709 13:05:23.153683 11575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e916728a67d4b0e8c29748c8af0b79a" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645c185863fd448e91faa534d9676384"
I20260709 13:05:23.156311 11876 tablet_bootstrap.cc:492] T fc065a29f3ec440f9181e37392205f3f P 922904a85e7c45febb9f75ac6e08c44d: No bootstrap required, opened a new log
I20260709 13:05:23.161427 11876 ts_tablet_manager.cc:1403] T fc065a29f3ec440f9181e37392205f3f P 922904a85e7c45febb9f75ac6e08c44d: Time spent bootstrapping tablet: real 0.179s	user 0.031s	sys 0.057s
W20260709 13:05:23.156699 11619 leader_election.cc:343] T 0e916728a67d4b0e8c29748c8af0b79a P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 645c185863fd448e91faa534d9676384 (127.0.107.193:37707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.164660 11876 raft_consensus.cc:359] T fc065a29f3ec440f9181e37392205f3f P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:23.165414 11876 raft_consensus.cc:385] T fc065a29f3ec440f9181e37392205f3f P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.165680 11876 raft_consensus.cc:740] T fc065a29f3ec440f9181e37392205f3f P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 922904a85e7c45febb9f75ac6e08c44d, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.166409 11876 consensus_queue.cc:260] T fc065a29f3ec440f9181e37392205f3f P 922904a85e7c45febb9f75ac6e08c44d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:23.158453 11880 raft_consensus.cc:359] T fc065a29f3ec440f9181e37392205f3f P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:23.167272 11880 raft_consensus.cc:385] T fc065a29f3ec440f9181e37392205f3f P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.167608 11880 raft_consensus.cc:740] T fc065a29f3ec440f9181e37392205f3f P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc52ba30a214524ba9a3705d5b5909f, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.168620 11876 ts_tablet_manager.cc:1434] T fc065a29f3ec440f9181e37392205f3f P 922904a85e7c45febb9f75ac6e08c44d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:23.168569 11880 consensus_queue.cc:260] T fc065a29f3ec440f9181e37392205f3f P efc52ba30a214524ba9a3705d5b5909f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:23.169394 11920 consensus_queue.cc:1048] T 1ddad75b87454a569aca197513526ac0 P 922904a85e7c45febb9f75ac6e08c44d [LEADER]: Connected to new peer: Peer: permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:23.169523 11881 leader_election.cc:290] T 0e916728a67d4b0e8c29748c8af0b79a P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 election: Requested vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:23.171185 11880 ts_tablet_manager.cc:1434] T fc065a29f3ec440f9181e37392205f3f P efc52ba30a214524ba9a3705d5b5909f: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:05:23.169878 11876 tablet_bootstrap.cc:492] T 4e1812f5a3f645f7916cb5c302389554 P 922904a85e7c45febb9f75ac6e08c44d: Bootstrap starting.
I20260709 13:05:23.173369 11877 tablet_bootstrap.cc:492] T 150e4155b8b44870a836beaa9aedb09f P 645c185863fd448e91faa534d9676384: No bootstrap required, opened a new log
I20260709 13:05:23.174088 11877 ts_tablet_manager.cc:1403] T 150e4155b8b44870a836beaa9aedb09f P 645c185863fd448e91faa534d9676384: Time spent bootstrapping tablet: real 0.128s	user 0.035s	sys 0.022s
I20260709 13:05:23.177485 11877 raft_consensus.cc:359] T 150e4155b8b44870a836beaa9aedb09f P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:23.178695 11877 raft_consensus.cc:385] T 150e4155b8b44870a836beaa9aedb09f P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.179034 11877 raft_consensus.cc:740] T 150e4155b8b44870a836beaa9aedb09f P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 645c185863fd448e91faa534d9676384, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.169417 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e916728a67d4b0e8c29748c8af0b79a" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc52ba30a214524ba9a3705d5b5909f"
I20260709 13:05:23.179821 11877 consensus_queue.cc:260] T 150e4155b8b44870a836beaa9aedb09f P 645c185863fd448e91faa534d9676384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:23.180593 11726 raft_consensus.cc:3060] T 0e916728a67d4b0e8c29748c8af0b79a P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.181975 11876 tablet_bootstrap.cc:654] T 4e1812f5a3f645f7916cb5c302389554 P 922904a85e7c45febb9f75ac6e08c44d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.182518 11877 ts_tablet_manager.cc:1434] T 150e4155b8b44870a836beaa9aedb09f P 645c185863fd448e91faa534d9676384: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:05:23.183758 11877 tablet_bootstrap.cc:492] T 0e916728a67d4b0e8c29748c8af0b79a P 645c185863fd448e91faa534d9676384: Bootstrap starting.
I20260709 13:05:23.193112 11877 tablet_bootstrap.cc:654] T 0e916728a67d4b0e8c29748c8af0b79a P 645c185863fd448e91faa534d9676384: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.197394 11876 tablet_bootstrap.cc:492] T 4e1812f5a3f645f7916cb5c302389554 P 922904a85e7c45febb9f75ac6e08c44d: No bootstrap required, opened a new log
I20260709 13:05:23.198022 11876 ts_tablet_manager.cc:1403] T 4e1812f5a3f645f7916cb5c302389554 P 922904a85e7c45febb9f75ac6e08c44d: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.007s
I20260709 13:05:23.201006 11876 raft_consensus.cc:359] T 4e1812f5a3f645f7916cb5c302389554 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:23.202620 11876 raft_consensus.cc:385] T 4e1812f5a3f645f7916cb5c302389554 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.202922 11726 raft_consensus.cc:2468] T 0e916728a67d4b0e8c29748c8af0b79a P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 922904a85e7c45febb9f75ac6e08c44d in term 1.
I20260709 13:05:23.203020 11876 raft_consensus.cc:740] T 4e1812f5a3f645f7916cb5c302389554 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 922904a85e7c45febb9f75ac6e08c44d, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.204355 11616 leader_election.cc:304] T 0e916728a67d4b0e8c29748c8af0b79a P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 922904a85e7c45febb9f75ac6e08c44d, efc52ba30a214524ba9a3705d5b5909f; no voters: 645c185863fd448e91faa534d9676384
I20260709 13:05:23.204325 11876 consensus_queue.cc:260] T 4e1812f5a3f645f7916cb5c302389554 P 922904a85e7c45febb9f75ac6e08c44d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:23.205858 11920 raft_consensus.cc:2804] T 0e916728a67d4b0e8c29748c8af0b79a P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:23.206501 11920 raft_consensus.cc:697] T 0e916728a67d4b0e8c29748c8af0b79a P 922904a85e7c45febb9f75ac6e08c44d [term 1 LEADER]: Becoming Leader. State: Replica: 922904a85e7c45febb9f75ac6e08c44d, State: Running, Role: LEADER
I20260709 13:05:23.207423 11920 consensus_queue.cc:237] T 0e916728a67d4b0e8c29748c8af0b79a P 922904a85e7c45febb9f75ac6e08c44d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:23.209326 11876 ts_tablet_manager.cc:1434] T 4e1812f5a3f645f7916cb5c302389554 P 922904a85e7c45febb9f75ac6e08c44d: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:05:23.210119 11908 raft_consensus.cc:493] T 150e4155b8b44870a836beaa9aedb09f P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.210691 11908 raft_consensus.cc:515] T 150e4155b8b44870a836beaa9aedb09f P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:23.213032 11908 leader_election.cc:290] T 150e4155b8b44870a836beaa9aedb09f P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:23.215214 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "150e4155b8b44870a836beaa9aedb09f" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc52ba30a214524ba9a3705d5b5909f" is_pre_election: true
I20260709 13:05:23.215977 11727 raft_consensus.cc:2468] T 150e4155b8b44870a836beaa9aedb09f P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 645c185863fd448e91faa534d9676384 in term 0.
I20260709 13:05:23.217571 11541 leader_election.cc:304] T 150e4155b8b44870a836beaa9aedb09f P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645c185863fd448e91faa534d9676384, efc52ba30a214524ba9a3705d5b5909f; no voters: 
I20260709 13:05:23.218618 11908 raft_consensus.cc:2804] T 150e4155b8b44870a836beaa9aedb09f P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:23.219053 11908 raft_consensus.cc:493] T 150e4155b8b44870a836beaa9aedb09f P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:23.217111 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "150e4155b8b44870a836beaa9aedb09f" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922904a85e7c45febb9f75ac6e08c44d" is_pre_election: true
I20260709 13:05:23.219590 11908 raft_consensus.cc:3060] T 150e4155b8b44870a836beaa9aedb09f P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.220443 11651 raft_consensus.cc:2468] T 150e4155b8b44870a836beaa9aedb09f P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 645c185863fd448e91faa534d9676384 in term 0.
I20260709 13:05:23.231640 11908 raft_consensus.cc:515] T 150e4155b8b44870a836beaa9aedb09f P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:23.235049 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "150e4155b8b44870a836beaa9aedb09f" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922904a85e7c45febb9f75ac6e08c44d"
I20260709 13:05:23.235430 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "150e4155b8b44870a836beaa9aedb09f" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc52ba30a214524ba9a3705d5b5909f"
I20260709 13:05:23.235702 11651 raft_consensus.cc:3060] T 150e4155b8b44870a836beaa9aedb09f P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.236306 11726 raft_consensus.cc:3060] T 150e4155b8b44870a836beaa9aedb09f P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.240952 11472 catalog_manager.cc:5697] T 0e916728a67d4b0e8c29748c8af0b79a P 922904a85e7c45febb9f75ac6e08c44d reported cstate change: term changed from 0 to 1, leader changed from <none> to 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "922904a85e7c45febb9f75ac6e08c44d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:23.242767 11877 tablet_bootstrap.cc:492] T 0e916728a67d4b0e8c29748c8af0b79a P 645c185863fd448e91faa534d9676384: No bootstrap required, opened a new log
I20260709 13:05:23.243338 11877 ts_tablet_manager.cc:1403] T 0e916728a67d4b0e8c29748c8af0b79a P 645c185863fd448e91faa534d9676384: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.008s
I20260709 13:05:23.244843 11651 raft_consensus.cc:2468] T 150e4155b8b44870a836beaa9aedb09f P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 645c185863fd448e91faa534d9676384 in term 1.
I20260709 13:05:23.244843 11726 raft_consensus.cc:2468] T 150e4155b8b44870a836beaa9aedb09f P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 645c185863fd448e91faa534d9676384 in term 1.
I20260709 13:05:23.246172 11544 leader_election.cc:304] T 150e4155b8b44870a836beaa9aedb09f P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645c185863fd448e91faa534d9676384, 922904a85e7c45febb9f75ac6e08c44d; no voters: 
I20260709 13:05:23.235265 11908 leader_election.cc:290] T 150e4155b8b44870a836beaa9aedb09f P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 election: Requested vote from peers 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:23.246400 11877 raft_consensus.cc:359] T 0e916728a67d4b0e8c29748c8af0b79a P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:23.247339 11877 raft_consensus.cc:385] T 0e916728a67d4b0e8c29748c8af0b79a P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.247589 11908 raft_consensus.cc:2804] T 150e4155b8b44870a836beaa9aedb09f P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:23.247663 11877 raft_consensus.cc:740] T 0e916728a67d4b0e8c29748c8af0b79a P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 645c185863fd448e91faa534d9676384, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.248238 11908 raft_consensus.cc:697] T 150e4155b8b44870a836beaa9aedb09f P 645c185863fd448e91faa534d9676384 [term 1 LEADER]: Becoming Leader. State: Replica: 645c185863fd448e91faa534d9676384, State: Running, Role: LEADER
I20260709 13:05:23.248771 11877 consensus_queue.cc:260] T 0e916728a67d4b0e8c29748c8af0b79a P 645c185863fd448e91faa534d9676384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:23.249281 11908 consensus_queue.cc:237] T 150e4155b8b44870a836beaa9aedb09f P 645c185863fd448e91faa534d9676384 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:23.251641 11877 ts_tablet_manager.cc:1434] T 0e916728a67d4b0e8c29748c8af0b79a P 645c185863fd448e91faa534d9676384: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:23.260154 11472 catalog_manager.cc:5697] T 150e4155b8b44870a836beaa9aedb09f P 645c185863fd448e91faa534d9676384 reported cstate change: term changed from 0 to 1, leader changed from <none> to 645c185863fd448e91faa534d9676384 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "645c185863fd448e91faa534d9676384" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:23.275269 11920 consensus_queue.cc:1048] T 9c039891b31042bf80ce793acc763f02 P 922904a85e7c45febb9f75ac6e08c44d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:23.288329 11920 consensus_queue.cc:1048] T 9c039891b31042bf80ce793acc763f02 P 922904a85e7c45febb9f75ac6e08c44d [LEADER]: Connected to new peer: Peer: permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:23.288797 11908 raft_consensus.cc:493] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.289443 11908 raft_consensus.cc:515] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:23.289924 11907 raft_consensus.cc:493] T 4e1812f5a3f645f7916cb5c302389554 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.290495 11907 raft_consensus.cc:515] T 4e1812f5a3f645f7916cb5c302389554 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:23.292006 11908 leader_election.cc:290] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:23.292651 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f9b1bb3ecf400b862f2f4138e56c26" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922904a85e7c45febb9f75ac6e08c44d" is_pre_election: true
I20260709 13:05:23.293499 11651 raft_consensus.cc:2468] T 93f9b1bb3ecf400b862f2f4138e56c26 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 645c185863fd448e91faa534d9676384 in term 0.
I20260709 13:05:23.294528 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f9b1bb3ecf400b862f2f4138e56c26" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc52ba30a214524ba9a3705d5b5909f" is_pre_election: true
I20260709 13:05:23.295171 11726 raft_consensus.cc:2468] T 93f9b1bb3ecf400b862f2f4138e56c26 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 645c185863fd448e91faa534d9676384 in term 0.
I20260709 13:05:23.295318 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1812f5a3f645f7916cb5c302389554" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922904a85e7c45febb9f75ac6e08c44d" is_pre_election: true
I20260709 13:05:23.296965 11651 raft_consensus.cc:2468] T 4e1812f5a3f645f7916cb5c302389554 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 645c185863fd448e91faa534d9676384 in term 0.
I20260709 13:05:23.297470 11544 leader_election.cc:304] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645c185863fd448e91faa534d9676384, 922904a85e7c45febb9f75ac6e08c44d; no voters: 
I20260709 13:05:23.298589 11857 raft_consensus.cc:2804] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:23.299010 11857 raft_consensus.cc:493] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:23.299376 11857 raft_consensus.cc:3060] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.292994 11907 leader_election.cc:290] T 4e1812f5a3f645f7916cb5c302389554 P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:23.301167 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1812f5a3f645f7916cb5c302389554" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc52ba30a214524ba9a3705d5b5909f" is_pre_election: true
I20260709 13:05:23.302047 11726 raft_consensus.cc:2468] T 4e1812f5a3f645f7916cb5c302389554 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 645c185863fd448e91faa534d9676384 in term 0.
I20260709 13:05:23.303571 11541 leader_election.cc:304] T 4e1812f5a3f645f7916cb5c302389554 P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645c185863fd448e91faa534d9676384, efc52ba30a214524ba9a3705d5b5909f; no voters: 
I20260709 13:05:23.304535 11907 raft_consensus.cc:2804] T 4e1812f5a3f645f7916cb5c302389554 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:23.304927 11907 raft_consensus.cc:493] T 4e1812f5a3f645f7916cb5c302389554 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:23.305284 11907 raft_consensus.cc:3060] T 4e1812f5a3f645f7916cb5c302389554 P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.307960 11819 consensus_queue.cc:1048] T 697274863f944f0fbb85ceb095246a34 P efc52ba30a214524ba9a3705d5b5909f [LEADER]: Connected to new peer: Peer: permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:23.312573 11857 raft_consensus.cc:515] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:23.314177 11907 raft_consensus.cc:515] T 4e1812f5a3f645f7916cb5c302389554 P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:23.315150 11857 leader_election.cc:290] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 election: Requested vote from peers 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:23.316071 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f9b1bb3ecf400b862f2f4138e56c26" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922904a85e7c45febb9f75ac6e08c44d"
I20260709 13:05:23.316660 11651 raft_consensus.cc:3060] T 93f9b1bb3ecf400b862f2f4138e56c26 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.317330 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1812f5a3f645f7916cb5c302389554" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922904a85e7c45febb9f75ac6e08c44d"
I20260709 13:05:23.317950 11652 raft_consensus.cc:3060] T 4e1812f5a3f645f7916cb5c302389554 P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.318338 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f9b1bb3ecf400b862f2f4138e56c26" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc52ba30a214524ba9a3705d5b5909f"
I20260709 13:05:23.318964 11727 raft_consensus.cc:3060] T 93f9b1bb3ecf400b862f2f4138e56c26 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.321643 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1812f5a3f645f7916cb5c302389554" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc52ba30a214524ba9a3705d5b5909f"
I20260709 13:05:23.322382 11726 raft_consensus.cc:3060] T 4e1812f5a3f645f7916cb5c302389554 P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.329222 11907 leader_election.cc:290] T 4e1812f5a3f645f7916cb5c302389554 P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 election: Requested vote from peers 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:23.330868 11652 raft_consensus.cc:2468] T 4e1812f5a3f645f7916cb5c302389554 P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 645c185863fd448e91faa534d9676384 in term 1.
I20260709 13:05:23.331208 11726 raft_consensus.cc:2468] T 4e1812f5a3f645f7916cb5c302389554 P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 645c185863fd448e91faa534d9676384 in term 1.
I20260709 13:05:23.330956 11651 raft_consensus.cc:2468] T 93f9b1bb3ecf400b862f2f4138e56c26 P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 645c185863fd448e91faa534d9676384 in term 1.
I20260709 13:05:23.328924 11727 raft_consensus.cc:2468] T 93f9b1bb3ecf400b862f2f4138e56c26 P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 645c185863fd448e91faa534d9676384 in term 1.
I20260709 13:05:23.332537 11541 leader_election.cc:304] T 4e1812f5a3f645f7916cb5c302389554 P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645c185863fd448e91faa534d9676384, efc52ba30a214524ba9a3705d5b5909f; no voters: 
I20260709 13:05:23.332741 11920 raft_consensus.cc:493] T fc065a29f3ec440f9181e37392205f3f P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.333457 11920 raft_consensus.cc:515] T fc065a29f3ec440f9181e37392205f3f P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:23.333783 11544 leader_election.cc:304] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645c185863fd448e91faa534d9676384, 922904a85e7c45febb9f75ac6e08c44d; no voters: 
I20260709 13:05:23.334255 11907 raft_consensus.cc:2804] T 4e1812f5a3f645f7916cb5c302389554 P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:23.335387 11907 raft_consensus.cc:697] T 4e1812f5a3f645f7916cb5c302389554 P 645c185863fd448e91faa534d9676384 [term 1 LEADER]: Becoming Leader. State: Replica: 645c185863fd448e91faa534d9676384, State: Running, Role: LEADER
I20260709 13:05:23.335927 11920 leader_election.cc:290] T fc065a29f3ec440f9181e37392205f3f P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:23.336303 11907 consensus_queue.cc:237] T 4e1812f5a3f645f7916cb5c302389554 P 645c185863fd448e91faa534d9676384 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:23.334878 11857 raft_consensus.cc:2804] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:23.337411 11575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc065a29f3ec440f9181e37392205f3f" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645c185863fd448e91faa534d9676384" is_pre_election: true
I20260709 13:05:23.338019 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc065a29f3ec440f9181e37392205f3f" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc52ba30a214524ba9a3705d5b5909f" is_pre_election: true
I20260709 13:05:23.338135 11575 raft_consensus.cc:2468] T fc065a29f3ec440f9181e37392205f3f P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 922904a85e7c45febb9f75ac6e08c44d in term 0.
I20260709 13:05:23.338660 11726 raft_consensus.cc:2468] T fc065a29f3ec440f9181e37392205f3f P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 922904a85e7c45febb9f75ac6e08c44d in term 0.
I20260709 13:05:23.337527 11857 raft_consensus.cc:697] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384 [term 1 LEADER]: Becoming Leader. State: Replica: 645c185863fd448e91faa534d9676384, State: Running, Role: LEADER
I20260709 13:05:23.339911 11619 leader_election.cc:304] T fc065a29f3ec440f9181e37392205f3f P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645c185863fd448e91faa534d9676384, 922904a85e7c45febb9f75ac6e08c44d; no voters: 
I20260709 13:05:23.340828 11920 raft_consensus.cc:2804] T fc065a29f3ec440f9181e37392205f3f P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:23.340728 11857 consensus_queue.cc:237] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:23.344295 11920 raft_consensus.cc:493] T fc065a29f3ec440f9181e37392205f3f P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:23.344816 11920 raft_consensus.cc:3060] T fc065a29f3ec440f9181e37392205f3f P 922904a85e7c45febb9f75ac6e08c44d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.349891 11904 consensus_queue.cc:1048] T 697274863f944f0fbb85ceb095246a34 P efc52ba30a214524ba9a3705d5b5909f [LEADER]: Connected to new peer: Peer: permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:23.363245 11908 consensus_queue.cc:1048] T 92a1be5cd07e49e285721f1cfa7af29f P 645c185863fd448e91faa534d9676384 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:23.374934 11475 catalog_manager.cc:5697] T 4e1812f5a3f645f7916cb5c302389554 P 645c185863fd448e91faa534d9676384 reported cstate change: term changed from 0 to 1, leader changed from <none> to 645c185863fd448e91faa534d9676384 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "645c185863fd448e91faa534d9676384" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:23.377679 11920 raft_consensus.cc:515] T fc065a29f3ec440f9181e37392205f3f P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:23.382261 11920 leader_election.cc:290] T fc065a29f3ec440f9181e37392205f3f P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 election: Requested vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:23.382316 11575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc065a29f3ec440f9181e37392205f3f" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645c185863fd448e91faa534d9676384"
I20260709 13:05:23.383261 11575 raft_consensus.cc:3060] T fc065a29f3ec440f9181e37392205f3f P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.383697 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc065a29f3ec440f9181e37392205f3f" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc52ba30a214524ba9a3705d5b5909f"
I20260709 13:05:23.384722 11727 raft_consensus.cc:3060] T fc065a29f3ec440f9181e37392205f3f P efc52ba30a214524ba9a3705d5b5909f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.395798 11575 raft_consensus.cc:2468] T fc065a29f3ec440f9181e37392205f3f P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 922904a85e7c45febb9f75ac6e08c44d in term 1.
I20260709 13:05:23.397416 11619 leader_election.cc:304] T fc065a29f3ec440f9181e37392205f3f P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645c185863fd448e91faa534d9676384, 922904a85e7c45febb9f75ac6e08c44d; no voters: 
I20260709 13:05:23.397497 11727 raft_consensus.cc:2468] T fc065a29f3ec440f9181e37392205f3f P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 922904a85e7c45febb9f75ac6e08c44d in term 1.
I20260709 13:05:23.397070 11475 catalog_manager.cc:5697] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384 reported cstate change: term changed from 0 to 1, leader changed from <none> to 645c185863fd448e91faa534d9676384 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "645c185863fd448e91faa534d9676384" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:23.398671 11920 raft_consensus.cc:2804] T fc065a29f3ec440f9181e37392205f3f P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:23.401311 11920 raft_consensus.cc:697] T fc065a29f3ec440f9181e37392205f3f P 922904a85e7c45febb9f75ac6e08c44d [term 1 LEADER]: Becoming Leader. State: Replica: 922904a85e7c45febb9f75ac6e08c44d, State: Running, Role: LEADER
I20260709 13:05:23.402218 11920 consensus_queue.cc:237] T fc065a29f3ec440f9181e37392205f3f P 922904a85e7c45febb9f75ac6e08c44d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:23.411319 11908 consensus_queue.cc:1048] T 92a1be5cd07e49e285721f1cfa7af29f P 645c185863fd448e91faa534d9676384 [LEADER]: Connected to new peer: Peer: permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:23.429497 11472 catalog_manager.cc:5697] T fc065a29f3ec440f9181e37392205f3f P 922904a85e7c45febb9f75ac6e08c44d reported cstate change: term changed from 0 to 1, leader changed from <none> to 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "922904a85e7c45febb9f75ac6e08c44d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:23.486105 11908 raft_consensus.cc:493] T 0e916728a67d4b0e8c29748c8af0b79a P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.486645 11908 raft_consensus.cc:515] T 0e916728a67d4b0e8c29748c8af0b79a P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:23.488543 11908 leader_election.cc:290] T 0e916728a67d4b0e8c29748c8af0b79a P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:23.489526 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e916728a67d4b0e8c29748c8af0b79a" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922904a85e7c45febb9f75ac6e08c44d" is_pre_election: true
I20260709 13:05:23.489612 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e916728a67d4b0e8c29748c8af0b79a" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc52ba30a214524ba9a3705d5b5909f" is_pre_election: true
I20260709 13:05:23.490388 11726 raft_consensus.cc:2393] T 0e916728a67d4b0e8c29748c8af0b79a P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 645c185863fd448e91faa534d9676384 in current term 1: Already voted for candidate 922904a85e7c45febb9f75ac6e08c44d in this term.
I20260709 13:05:23.491340 11541 leader_election.cc:304] T 0e916728a67d4b0e8c29748c8af0b79a P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 645c185863fd448e91faa534d9676384; no voters: 922904a85e7c45febb9f75ac6e08c44d, efc52ba30a214524ba9a3705d5b5909f
I20260709 13:05:23.492070 11908 raft_consensus.cc:3060] T 0e916728a67d4b0e8c29748c8af0b79a P 645c185863fd448e91faa534d9676384 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.500553 11908 raft_consensus.cc:2749] T 0e916728a67d4b0e8c29748c8af0b79a P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:23.620141 11887 consensus_queue.cc:1048] T 0e916728a67d4b0e8c29748c8af0b79a P 922904a85e7c45febb9f75ac6e08c44d [LEADER]: Connected to new peer: Peer: permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:23.633291 11920 consensus_queue.cc:1048] T 0e916728a67d4b0e8c29748c8af0b79a P 922904a85e7c45febb9f75ac6e08c44d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:23.637135 11908 consensus_queue.cc:1048] T 150e4155b8b44870a836beaa9aedb09f P 645c185863fd448e91faa534d9676384 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:23.650198 11857 consensus_queue.cc:1048] T 150e4155b8b44870a836beaa9aedb09f P 645c185863fd448e91faa534d9676384 [LEADER]: Connected to new peer: Peer: permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:23.707762 11652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ddad75b87454a569aca197513526ac0"
dest_uuid: "922904a85e7c45febb9f75ac6e08c44d"
mode: GRACEFUL
new_leader_uuid: "645c185863fd448e91faa534d9676384"
 from {username='slave'} at 127.0.0.1:38632
I20260709 13:05:23.708405 11652 raft_consensus.cc:606] T 1ddad75b87454a569aca197513526ac0 P 922904a85e7c45febb9f75ac6e08c44d [term 1 LEADER]: Received request to transfer leadership to TS 645c185863fd448e91faa534d9676384
I20260709 13:05:23.716522 11727 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "697274863f944f0fbb85ceb095246a34"
dest_uuid: "efc52ba30a214524ba9a3705d5b5909f"
mode: GRACEFUL
new_leader_uuid: "645c185863fd448e91faa534d9676384"
 from {username='slave'} at 127.0.0.1:58540
I20260709 13:05:23.717212 11727 raft_consensus.cc:606] T 697274863f944f0fbb85ceb095246a34 P efc52ba30a214524ba9a3705d5b5909f [term 1 LEADER]: Received request to transfer leadership to TS 645c185863fd448e91faa534d9676384
I20260709 13:05:23.727638 11652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c039891b31042bf80ce793acc763f02"
dest_uuid: "922904a85e7c45febb9f75ac6e08c44d"
mode: GRACEFUL
new_leader_uuid: "645c185863fd448e91faa534d9676384"
 from {username='slave'} at 127.0.0.1:38632
I20260709 13:05:23.728322 11652 raft_consensus.cc:606] T 9c039891b31042bf80ce793acc763f02 P 922904a85e7c45febb9f75ac6e08c44d [term 1 LEADER]: Received request to transfer leadership to TS 645c185863fd448e91faa534d9676384
I20260709 13:05:23.751649 11575 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93f9b1bb3ecf400b862f2f4138e56c26"
dest_uuid: "645c185863fd448e91faa534d9676384"
mode: GRACEFUL
new_leader_uuid: "922904a85e7c45febb9f75ac6e08c44d"
 from {username='slave'} at 127.0.0.1:39378
I20260709 13:05:23.752388 11575 raft_consensus.cc:606] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384 [term 1 LEADER]: Received request to transfer leadership to TS 922904a85e7c45febb9f75ac6e08c44d
I20260709 13:05:23.761431 11932 consensus_queue.cc:1048] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:23.761915 11575 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e1812f5a3f645f7916cb5c302389554"
dest_uuid: "645c185863fd448e91faa534d9676384"
mode: GRACEFUL
new_leader_uuid: "922904a85e7c45febb9f75ac6e08c44d"
 from {username='slave'} at 127.0.0.1:39378
I20260709 13:05:23.762598 11575 raft_consensus.cc:606] T 4e1812f5a3f645f7916cb5c302389554 P 645c185863fd448e91faa534d9676384 [term 1 LEADER]: Received request to transfer leadership to TS 922904a85e7c45febb9f75ac6e08c44d
I20260709 13:05:23.776999 11575 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "150e4155b8b44870a836beaa9aedb09f"
dest_uuid: "645c185863fd448e91faa534d9676384"
mode: GRACEFUL
new_leader_uuid: "922904a85e7c45febb9f75ac6e08c44d"
 from {username='slave'} at 127.0.0.1:39378
I20260709 13:05:23.778394 11575 raft_consensus.cc:606] T 150e4155b8b44870a836beaa9aedb09f P 645c185863fd448e91faa534d9676384 [term 1 LEADER]: Received request to transfer leadership to TS 922904a85e7c45febb9f75ac6e08c44d
I20260709 13:05:23.785952 11887 raft_consensus.cc:993] T 1ddad75b87454a569aca197513526ac0 P 922904a85e7c45febb9f75ac6e08c44d: : Instructing follower 645c185863fd448e91faa534d9676384 to start an election
I20260709 13:05:23.786870 11887 raft_consensus.cc:1081] T 1ddad75b87454a569aca197513526ac0 P 922904a85e7c45febb9f75ac6e08c44d [term 1 LEADER]: Signalling peer 645c185863fd448e91faa534d9676384 to start an election
I20260709 13:05:23.787539 11907 consensus_queue.cc:1048] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384 [LEADER]: Connected to new peer: Peer: permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:23.800009 11575 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ddad75b87454a569aca197513526ac0"
dest_uuid: "645c185863fd448e91faa534d9676384"
 from {username='slave'} at 127.0.0.1:45698
I20260709 13:05:23.800969 11575 raft_consensus.cc:493] T 1ddad75b87454a569aca197513526ac0 P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:23.801621 11575 raft_consensus.cc:3060] T 1ddad75b87454a569aca197513526ac0 P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:23.822045 11575 raft_consensus.cc:515] T 1ddad75b87454a569aca197513526ac0 P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:23.825747 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddad75b87454a569aca197513526ac0" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "922904a85e7c45febb9f75ac6e08c44d"
I20260709 13:05:23.826148 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddad75b87454a569aca197513526ac0" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efc52ba30a214524ba9a3705d5b5909f"
I20260709 13:05:23.826421 11651 raft_consensus.cc:3055] T 1ddad75b87454a569aca197513526ac0 P 922904a85e7c45febb9f75ac6e08c44d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:23.826771 11651 raft_consensus.cc:740] T 1ddad75b87454a569aca197513526ac0 P 922904a85e7c45febb9f75ac6e08c44d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 922904a85e7c45febb9f75ac6e08c44d, State: Running, Role: LEADER
I20260709 13:05:23.826818 11727 raft_consensus.cc:3060] T 1ddad75b87454a569aca197513526ac0 P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:23.829493 11651 consensus_queue.cc:260] T 1ddad75b87454a569aca197513526ac0 P 922904a85e7c45febb9f75ac6e08c44d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:23.841341 11651 raft_consensus.cc:3060] T 1ddad75b87454a569aca197513526ac0 P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:24.018538 11651 raft_consensus.cc:2468] T 1ddad75b87454a569aca197513526ac0 P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 645c185863fd448e91faa534d9676384 in term 2.
I20260709 13:05:23.825794 11575 leader_election.cc:290] T 1ddad75b87454a569aca197513526ac0 P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 2 election: Requested vote from peers 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:24.080546 11948 consensus_queue.cc:1048] T 4e1812f5a3f645f7916cb5c302389554 P 645c185863fd448e91faa534d9676384 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:24.085429 11950 consensus_queue.cc:1048] T fc065a29f3ec440f9181e37392205f3f P 922904a85e7c45febb9f75ac6e08c44d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:24.123862 11950 consensus_queue.cc:1048] T fc065a29f3ec440f9181e37392205f3f P 922904a85e7c45febb9f75ac6e08c44d [LEADER]: Connected to new peer: Peer: permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:24.143393 11727 raft_consensus.cc:2468] T 1ddad75b87454a569aca197513526ac0 P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 645c185863fd448e91faa534d9676384 in term 2.
I20260709 13:05:24.145057 11541 leader_election.cc:304] T 1ddad75b87454a569aca197513526ac0 P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645c185863fd448e91faa534d9676384, efc52ba30a214524ba9a3705d5b5909f; no voters: 
I20260709 13:05:24.146039 11908 raft_consensus.cc:2804] T 1ddad75b87454a569aca197513526ac0 P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:24.146556 11908 raft_consensus.cc:697] T 1ddad75b87454a569aca197513526ac0 P 645c185863fd448e91faa534d9676384 [term 2 LEADER]: Becoming Leader. State: Replica: 645c185863fd448e91faa534d9676384, State: Running, Role: LEADER
I20260709 13:05:24.148161 11908 consensus_queue.cc:237] T 1ddad75b87454a569aca197513526ac0 P 645c185863fd448e91faa534d9676384 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:24.158948 11947 raft_consensus.cc:993] T 697274863f944f0fbb85ceb095246a34 P efc52ba30a214524ba9a3705d5b5909f: : Instructing follower 645c185863fd448e91faa534d9676384 to start an election
I20260709 13:05:24.159574 11946 raft_consensus.cc:1081] T 697274863f944f0fbb85ceb095246a34 P efc52ba30a214524ba9a3705d5b5909f [term 1 LEADER]: Signalling peer 645c185863fd448e91faa534d9676384 to start an election
I20260709 13:05:24.161563 11575 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "697274863f944f0fbb85ceb095246a34"
dest_uuid: "645c185863fd448e91faa534d9676384"
 from {username='slave'} at 127.0.0.1:45702
I20260709 13:05:24.162204 11575 raft_consensus.cc:493] T 697274863f944f0fbb85ceb095246a34 P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:24.162878 11575 raft_consensus.cc:3060] T 697274863f944f0fbb85ceb095246a34 P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:24.178562 11575 raft_consensus.cc:515] T 697274863f944f0fbb85ceb095246a34 P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:24.181110 11575 leader_election.cc:290] T 697274863f944f0fbb85ceb095246a34 P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 2 election: Requested vote from peers 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:24.184134 11907 raft_consensus.cc:993] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384: : Instructing follower 922904a85e7c45febb9f75ac6e08c44d to start an election
I20260709 13:05:24.184731 11907 raft_consensus.cc:1081] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384 [term 1 LEADER]: Signalling peer 922904a85e7c45febb9f75ac6e08c44d to start an election
I20260709 13:05:24.189863 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "697274863f944f0fbb85ceb095246a34" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "922904a85e7c45febb9f75ac6e08c44d"
I20260709 13:05:24.190626 11653 raft_consensus.cc:3060] T 697274863f944f0fbb85ceb095246a34 P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:24.192359 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "697274863f944f0fbb85ceb095246a34" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efc52ba30a214524ba9a3705d5b5909f"
I20260709 13:05:24.193399 11727 raft_consensus.cc:3055] T 697274863f944f0fbb85ceb095246a34 P efc52ba30a214524ba9a3705d5b5909f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:24.193748 11727 raft_consensus.cc:740] T 697274863f944f0fbb85ceb095246a34 P efc52ba30a214524ba9a3705d5b5909f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: efc52ba30a214524ba9a3705d5b5909f, State: Running, Role: LEADER
I20260709 13:05:24.195372 11727 consensus_queue.cc:260] T 697274863f944f0fbb85ceb095246a34 P efc52ba30a214524ba9a3705d5b5909f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:24.196292 11650 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93f9b1bb3ecf400b862f2f4138e56c26"
dest_uuid: "922904a85e7c45febb9f75ac6e08c44d"
 from {username='slave'} at 127.0.0.1:38616
I20260709 13:05:24.197175 11650 raft_consensus.cc:493] T 93f9b1bb3ecf400b862f2f4138e56c26 P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:24.197630 11650 raft_consensus.cc:3060] T 93f9b1bb3ecf400b862f2f4138e56c26 P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:24.196691 11727 raft_consensus.cc:3060] T 697274863f944f0fbb85ceb095246a34 P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:24.206625 11907 consensus_queue.cc:1048] T 4e1812f5a3f645f7916cb5c302389554 P 645c185863fd448e91faa534d9676384 [LEADER]: Connected to new peer: Peer: permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:24.209542 11948 raft_consensus.cc:993] T 150e4155b8b44870a836beaa9aedb09f P 645c185863fd448e91faa534d9676384: : Instructing follower 922904a85e7c45febb9f75ac6e08c44d to start an election
I20260709 13:05:24.210472 11948 raft_consensus.cc:1081] T 150e4155b8b44870a836beaa9aedb09f P 645c185863fd448e91faa534d9676384 [term 1 LEADER]: Signalling peer 922904a85e7c45febb9f75ac6e08c44d to start an election
I20260709 13:05:24.212482 11652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc065a29f3ec440f9181e37392205f3f"
dest_uuid: "922904a85e7c45febb9f75ac6e08c44d"
mode: GRACEFUL
new_leader_uuid: "efc52ba30a214524ba9a3705d5b5909f"
 from {username='slave'} at 127.0.0.1:38632
I20260709 13:05:24.213306 11652 raft_consensus.cc:606] T fc065a29f3ec440f9181e37392205f3f P 922904a85e7c45febb9f75ac6e08c44d [term 1 LEADER]: Received request to transfer leadership to TS efc52ba30a214524ba9a3705d5b5909f
I20260709 13:05:24.218819 11653 raft_consensus.cc:2468] T 697274863f944f0fbb85ceb095246a34 P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 645c185863fd448e91faa534d9676384 in term 2.
I20260709 13:05:24.219635 11651 raft_consensus.cc:1240] T 697274863f944f0fbb85ceb095246a34 P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Rejecting Update request from peer efc52ba30a214524ba9a3705d5b5909f for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:24.225009 11727 raft_consensus.cc:2468] T 697274863f944f0fbb85ceb095246a34 P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 645c185863fd448e91faa534d9676384 in term 2.
I20260709 13:05:24.225804 11473 catalog_manager.cc:5697] T 1ddad75b87454a569aca197513526ac0 P 645c185863fd448e91faa534d9676384 reported cstate change: term changed from 1 to 2, leader changed from 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194) to 645c185863fd448e91faa534d9676384 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "645c185863fd448e91faa534d9676384" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:24.226850 11541 leader_election.cc:304] T 697274863f944f0fbb85ceb095246a34 P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645c185863fd448e91faa534d9676384, efc52ba30a214524ba9a3705d5b5909f; no voters: 
I20260709 13:05:24.227727 11907 raft_consensus.cc:2804] T 697274863f944f0fbb85ceb095246a34 P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:24.228312 11907 raft_consensus.cc:697] T 697274863f944f0fbb85ceb095246a34 P 645c185863fd448e91faa534d9676384 [term 2 LEADER]: Becoming Leader. State: Replica: 645c185863fd448e91faa534d9676384, State: Running, Role: LEADER
I20260709 13:05:24.228828 11650 raft_consensus.cc:515] T 93f9b1bb3ecf400b862f2f4138e56c26 P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:24.229255 11907 consensus_queue.cc:237] T 697274863f944f0fbb85ceb095246a34 P 645c185863fd448e91faa534d9676384 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:24.232813 11575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f9b1bb3ecf400b862f2f4138e56c26" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "645c185863fd448e91faa534d9676384"
I20260709 13:05:24.233438 11575 raft_consensus.cc:3055] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:24.233726 11575 raft_consensus.cc:740] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 645c185863fd448e91faa534d9676384, State: Running, Role: LEADER
I20260709 13:05:24.239387 11652 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "150e4155b8b44870a836beaa9aedb09f"
dest_uuid: "922904a85e7c45febb9f75ac6e08c44d"
 from {username='slave'} at 127.0.0.1:38616
I20260709 13:05:24.240175 11652 raft_consensus.cc:493] T 150e4155b8b44870a836beaa9aedb09f P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:24.240550 11652 raft_consensus.cc:3060] T 150e4155b8b44870a836beaa9aedb09f P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:24.242565 11575 consensus_queue.cc:260] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:24.243876 11575 raft_consensus.cc:3060] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:24.244190 11907 raft_consensus.cc:993] T 4e1812f5a3f645f7916cb5c302389554 P 645c185863fd448e91faa534d9676384: : Instructing follower 922904a85e7c45febb9f75ac6e08c44d to start an election
I20260709 13:05:24.245596 11907 raft_consensus.cc:1081] T 4e1812f5a3f645f7916cb5c302389554 P 645c185863fd448e91faa534d9676384 [term 1 LEADER]: Signalling peer 922904a85e7c45febb9f75ac6e08c44d to start an election
I20260709 13:05:24.245991 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f9b1bb3ecf400b862f2f4138e56c26" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efc52ba30a214524ba9a3705d5b5909f"
I20260709 13:05:24.244827 11650 leader_election.cc:290] T 93f9b1bb3ecf400b862f2f4138e56c26 P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 2 election: Requested vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:24.246627 11727 raft_consensus.cc:3060] T 93f9b1bb3ecf400b862f2f4138e56c26 P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:24.249359 11652 raft_consensus.cc:515] T 150e4155b8b44870a836beaa9aedb09f P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:24.253854 11575 raft_consensus.cc:2468] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 922904a85e7c45febb9f75ac6e08c44d in term 2.
I20260709 13:05:24.251032 11650 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e1812f5a3f645f7916cb5c302389554"
dest_uuid: "922904a85e7c45febb9f75ac6e08c44d"
 from {username='slave'} at 127.0.0.1:38616
I20260709 13:05:24.257882 11650 raft_consensus.cc:493] T 4e1812f5a3f645f7916cb5c302389554 P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:24.258368 11650 raft_consensus.cc:3060] T 4e1812f5a3f645f7916cb5c302389554 P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:24.258195 11619 leader_election.cc:304] T 93f9b1bb3ecf400b862f2f4138e56c26 P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645c185863fd448e91faa534d9676384, 922904a85e7c45febb9f75ac6e08c44d; no voters: 
I20260709 13:05:24.259588 11949 raft_consensus.cc:2804] T 93f9b1bb3ecf400b862f2f4138e56c26 P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:24.260051 11949 raft_consensus.cc:697] T 93f9b1bb3ecf400b862f2f4138e56c26 P 922904a85e7c45febb9f75ac6e08c44d [term 2 LEADER]: Becoming Leader. State: Replica: 922904a85e7c45febb9f75ac6e08c44d, State: Running, Role: LEADER
I20260709 13:05:24.260918 11949 consensus_queue.cc:237] T 93f9b1bb3ecf400b862f2f4138e56c26 P 922904a85e7c45febb9f75ac6e08c44d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:24.269549 11727 raft_consensus.cc:2468] T 93f9b1bb3ecf400b862f2f4138e56c26 P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 922904a85e7c45febb9f75ac6e08c44d in term 2.
I20260709 13:05:24.272456 11575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "150e4155b8b44870a836beaa9aedb09f" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "645c185863fd448e91faa534d9676384"
I20260709 13:05:24.273111 11575 raft_consensus.cc:3055] T 150e4155b8b44870a836beaa9aedb09f P 645c185863fd448e91faa534d9676384 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:24.273483 11575 raft_consensus.cc:740] T 150e4155b8b44870a836beaa9aedb09f P 645c185863fd448e91faa534d9676384 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 645c185863fd448e91faa534d9676384, State: Running, Role: LEADER
I20260709 13:05:24.273190 11650 raft_consensus.cc:515] T 4e1812f5a3f645f7916cb5c302389554 P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:24.274447 11652 leader_election.cc:290] T 150e4155b8b44870a836beaa9aedb09f P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 2 election: Requested vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:24.273916 11476 catalog_manager.cc:5697] T 697274863f944f0fbb85ceb095246a34 P 645c185863fd448e91faa534d9676384 reported cstate change: term changed from 1 to 2, leader changed from efc52ba30a214524ba9a3705d5b5909f (127.0.107.195) to 645c185863fd448e91faa534d9676384 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "645c185863fd448e91faa534d9676384" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:24.275576 11575 consensus_queue.cc:260] T 150e4155b8b44870a836beaa9aedb09f P 645c185863fd448e91faa534d9676384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:24.279109 11575 raft_consensus.cc:3060] T 150e4155b8b44870a836beaa9aedb09f P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:24.279402 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "150e4155b8b44870a836beaa9aedb09f" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efc52ba30a214524ba9a3705d5b5909f"
I20260709 13:05:24.280014 11727 raft_consensus.cc:3060] T 150e4155b8b44870a836beaa9aedb09f P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:24.287549 11727 raft_consensus.cc:2468] T 150e4155b8b44870a836beaa9aedb09f P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 922904a85e7c45febb9f75ac6e08c44d in term 2.
I20260709 13:05:24.287743 11575 raft_consensus.cc:2468] T 150e4155b8b44870a836beaa9aedb09f P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 922904a85e7c45febb9f75ac6e08c44d in term 2.
I20260709 13:05:24.288916 11616 leader_election.cc:304] T 150e4155b8b44870a836beaa9aedb09f P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 922904a85e7c45febb9f75ac6e08c44d, efc52ba30a214524ba9a3705d5b5909f; no voters: 
I20260709 13:05:24.288653 11472 catalog_manager.cc:5697] T 93f9b1bb3ecf400b862f2f4138e56c26 P 922904a85e7c45febb9f75ac6e08c44d reported cstate change: term changed from 1 to 2, leader changed from 645c185863fd448e91faa534d9676384 (127.0.107.193) to 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "922904a85e7c45febb9f75ac6e08c44d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:24.290210 11950 raft_consensus.cc:2804] T 150e4155b8b44870a836beaa9aedb09f P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:24.290570 11887 raft_consensus.cc:993] T 9c039891b31042bf80ce793acc763f02 P 922904a85e7c45febb9f75ac6e08c44d: : Instructing follower 645c185863fd448e91faa534d9676384 to start an election
I20260709 13:05:24.290712 11950 raft_consensus.cc:697] T 150e4155b8b44870a836beaa9aedb09f P 922904a85e7c45febb9f75ac6e08c44d [term 2 LEADER]: Becoming Leader. State: Replica: 922904a85e7c45febb9f75ac6e08c44d, State: Running, Role: LEADER
I20260709 13:05:24.291309 11887 raft_consensus.cc:1081] T 9c039891b31042bf80ce793acc763f02 P 922904a85e7c45febb9f75ac6e08c44d [term 1 LEADER]: Signalling peer 645c185863fd448e91faa534d9676384 to start an election
I20260709 13:05:24.293591 11650 leader_election.cc:290] T 4e1812f5a3f645f7916cb5c302389554 P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 2 election: Requested vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:24.294809 11575 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c039891b31042bf80ce793acc763f02"
dest_uuid: "645c185863fd448e91faa534d9676384"
 from {username='slave'} at 127.0.0.1:45698
I20260709 13:05:24.295372 11575 raft_consensus.cc:493] T 9c039891b31042bf80ce793acc763f02 P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:24.292842 11950 consensus_queue.cc:237] T 150e4155b8b44870a836beaa9aedb09f P 922904a85e7c45febb9f75ac6e08c44d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:24.295680 11573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1812f5a3f645f7916cb5c302389554" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "645c185863fd448e91faa534d9676384"
I20260709 13:05:24.296342 11573 raft_consensus.cc:3055] T 4e1812f5a3f645f7916cb5c302389554 P 645c185863fd448e91faa534d9676384 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:24.296609 11573 raft_consensus.cc:740] T 4e1812f5a3f645f7916cb5c302389554 P 645c185863fd448e91faa534d9676384 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 645c185863fd448e91faa534d9676384, State: Running, Role: LEADER
I20260709 13:05:24.297667 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1812f5a3f645f7916cb5c302389554" candidate_uuid: "922904a85e7c45febb9f75ac6e08c44d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efc52ba30a214524ba9a3705d5b5909f"
I20260709 13:05:24.297655 11573 consensus_queue.cc:260] T 4e1812f5a3f645f7916cb5c302389554 P 645c185863fd448e91faa534d9676384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:24.298512 11727 raft_consensus.cc:3060] T 4e1812f5a3f645f7916cb5c302389554 P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:24.299005 11573 raft_consensus.cc:3060] T 4e1812f5a3f645f7916cb5c302389554 P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:24.295677 11575 raft_consensus.cc:3060] T 9c039891b31042bf80ce793acc763f02 P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:24.306797 11573 raft_consensus.cc:2468] T 4e1812f5a3f645f7916cb5c302389554 P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 922904a85e7c45febb9f75ac6e08c44d in term 2.
I20260709 13:05:24.307399 11727 raft_consensus.cc:2468] T 4e1812f5a3f645f7916cb5c302389554 P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 922904a85e7c45febb9f75ac6e08c44d in term 2.
I20260709 13:05:24.308607 11616 leader_election.cc:304] T 4e1812f5a3f645f7916cb5c302389554 P 922904a85e7c45febb9f75ac6e08c44d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 922904a85e7c45febb9f75ac6e08c44d, efc52ba30a214524ba9a3705d5b5909f; no voters: 
I20260709 13:05:24.309614 11949 raft_consensus.cc:2804] T 4e1812f5a3f645f7916cb5c302389554 P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:24.310148 11949 raft_consensus.cc:697] T 4e1812f5a3f645f7916cb5c302389554 P 922904a85e7c45febb9f75ac6e08c44d [term 2 LEADER]: Becoming Leader. State: Replica: 922904a85e7c45febb9f75ac6e08c44d, State: Running, Role: LEADER
I20260709 13:05:24.310897 11949 consensus_queue.cc:237] T 4e1812f5a3f645f7916cb5c302389554 P 922904a85e7c45febb9f75ac6e08c44d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:24.310521 11472 catalog_manager.cc:5697] T 150e4155b8b44870a836beaa9aedb09f P 922904a85e7c45febb9f75ac6e08c44d reported cstate change: term changed from 1 to 2, leader changed from 645c185863fd448e91faa534d9676384 (127.0.107.193) to 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "922904a85e7c45febb9f75ac6e08c44d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:24.313652 11575 raft_consensus.cc:515] T 9c039891b31042bf80ce793acc763f02 P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:24.315776 11575 leader_election.cc:290] T 9c039891b31042bf80ce793acc763f02 P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 2 election: Requested vote from peers 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415), efc52ba30a214524ba9a3705d5b5909f (127.0.107.195:37949)
I20260709 13:05:24.317006 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c039891b31042bf80ce793acc763f02" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efc52ba30a214524ba9a3705d5b5909f"
I20260709 13:05:24.317677 11727 raft_consensus.cc:3060] T 9c039891b31042bf80ce793acc763f02 P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:24.317893 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c039891b31042bf80ce793acc763f02" candidate_uuid: "645c185863fd448e91faa534d9676384" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "922904a85e7c45febb9f75ac6e08c44d"
I20260709 13:05:24.318481 11650 raft_consensus.cc:3055] T 9c039891b31042bf80ce793acc763f02 P 922904a85e7c45febb9f75ac6e08c44d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:24.318769 11650 raft_consensus.cc:740] T 9c039891b31042bf80ce793acc763f02 P 922904a85e7c45febb9f75ac6e08c44d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 922904a85e7c45febb9f75ac6e08c44d, State: Running, Role: LEADER
I20260709 13:05:24.319837 11650 consensus_queue.cc:260] T 9c039891b31042bf80ce793acc763f02 P 922904a85e7c45febb9f75ac6e08c44d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:24.321213 11650 raft_consensus.cc:3060] T 9c039891b31042bf80ce793acc763f02 P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:24.325531 11472 catalog_manager.cc:5697] T 4e1812f5a3f645f7916cb5c302389554 P 922904a85e7c45febb9f75ac6e08c44d reported cstate change: term changed from 1 to 2, leader changed from 645c185863fd448e91faa534d9676384 (127.0.107.193) to 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "922904a85e7c45febb9f75ac6e08c44d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:24.326934 11727 raft_consensus.cc:2468] T 9c039891b31042bf80ce793acc763f02 P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 645c185863fd448e91faa534d9676384 in term 2.
I20260709 13:05:24.328284 11541 leader_election.cc:304] T 9c039891b31042bf80ce793acc763f02 P 645c185863fd448e91faa534d9676384 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645c185863fd448e91faa534d9676384, efc52ba30a214524ba9a3705d5b5909f; no voters: 
I20260709 13:05:24.329905 11955 raft_consensus.cc:2804] T 9c039891b31042bf80ce793acc763f02 P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:24.330411 11955 raft_consensus.cc:697] T 9c039891b31042bf80ce793acc763f02 P 645c185863fd448e91faa534d9676384 [term 2 LEADER]: Becoming Leader. State: Replica: 645c185863fd448e91faa534d9676384, State: Running, Role: LEADER
I20260709 13:05:24.330920 11650 raft_consensus.cc:2468] T 9c039891b31042bf80ce793acc763f02 P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 645c185863fd448e91faa534d9676384 in term 2.
I20260709 13:05:24.331247 11955 consensus_queue.cc:237] T 9c039891b31042bf80ce793acc763f02 P 645c185863fd448e91faa534d9676384 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:24.341172 11472 catalog_manager.cc:5697] T 9c039891b31042bf80ce793acc763f02 P 645c185863fd448e91faa534d9676384 reported cstate change: term changed from 1 to 2, leader changed from 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194) to 645c185863fd448e91faa534d9676384 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "645c185863fd448e91faa534d9676384" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:24.518767 11950 raft_consensus.cc:993] T fc065a29f3ec440f9181e37392205f3f P 922904a85e7c45febb9f75ac6e08c44d: : Instructing follower efc52ba30a214524ba9a3705d5b5909f to start an election
I20260709 13:05:24.519258 11949 raft_consensus.cc:1081] T fc065a29f3ec440f9181e37392205f3f P 922904a85e7c45febb9f75ac6e08c44d [term 1 LEADER]: Signalling peer efc52ba30a214524ba9a3705d5b5909f to start an election
I20260709 13:05:24.520753 11727 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc065a29f3ec440f9181e37392205f3f"
dest_uuid: "efc52ba30a214524ba9a3705d5b5909f"
 from {username='slave'} at 127.0.0.1:58528
I20260709 13:05:24.521410 11727 raft_consensus.cc:493] T fc065a29f3ec440f9181e37392205f3f P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:24.521726 11727 raft_consensus.cc:3060] T fc065a29f3ec440f9181e37392205f3f P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:24.526856 11727 raft_consensus.cc:515] T fc065a29f3ec440f9181e37392205f3f P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:24.529834 11575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc065a29f3ec440f9181e37392205f3f" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "645c185863fd448e91faa534d9676384"
I20260709 13:05:24.530157 11727 leader_election.cc:290] T fc065a29f3ec440f9181e37392205f3f P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 2 election: Requested vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415)
I20260709 13:05:24.530604 11575 raft_consensus.cc:3060] T fc065a29f3ec440f9181e37392205f3f P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:24.532121 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc065a29f3ec440f9181e37392205f3f" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "922904a85e7c45febb9f75ac6e08c44d"
I20260709 13:05:24.532770 11650 raft_consensus.cc:3055] T fc065a29f3ec440f9181e37392205f3f P 922904a85e7c45febb9f75ac6e08c44d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:24.533121 11650 raft_consensus.cc:740] T fc065a29f3ec440f9181e37392205f3f P 922904a85e7c45febb9f75ac6e08c44d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 922904a85e7c45febb9f75ac6e08c44d, State: Running, Role: LEADER
I20260709 13:05:24.534098 11650 consensus_queue.cc:260] T fc065a29f3ec440f9181e37392205f3f P 922904a85e7c45febb9f75ac6e08c44d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:24.535391 11650 raft_consensus.cc:3060] T fc065a29f3ec440f9181e37392205f3f P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:24.538904 11575 raft_consensus.cc:2468] T fc065a29f3ec440f9181e37392205f3f P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc52ba30a214524ba9a3705d5b5909f in term 2.
I20260709 13:05:24.540302 11693 leader_election.cc:304] T fc065a29f3ec440f9181e37392205f3f P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645c185863fd448e91faa534d9676384, efc52ba30a214524ba9a3705d5b5909f; no voters: 
I20260709 13:05:24.541172 11946 raft_consensus.cc:2804] T fc065a29f3ec440f9181e37392205f3f P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:24.541653 11946 raft_consensus.cc:697] T fc065a29f3ec440f9181e37392205f3f P efc52ba30a214524ba9a3705d5b5909f [term 2 LEADER]: Becoming Leader. State: Replica: efc52ba30a214524ba9a3705d5b5909f, State: Running, Role: LEADER
I20260709 13:05:24.542666 11650 raft_consensus.cc:2468] T fc065a29f3ec440f9181e37392205f3f P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc52ba30a214524ba9a3705d5b5909f in term 2.
I20260709 13:05:24.542474 11946 consensus_queue.cc:237] T fc065a29f3ec440f9181e37392205f3f P efc52ba30a214524ba9a3705d5b5909f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:24.550583 11472 catalog_manager.cc:5697] T fc065a29f3ec440f9181e37392205f3f P efc52ba30a214524ba9a3705d5b5909f reported cstate change: term changed from 1 to 2, leader changed from 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194) to efc52ba30a214524ba9a3705d5b5909f (127.0.107.195). New cstate: current_term: 2 leader_uuid: "efc52ba30a214524ba9a3705d5b5909f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:24.649041 11650 raft_consensus.cc:1275] T 1ddad75b87454a569aca197513526ac0 P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Refusing update from remote peer 645c185863fd448e91faa534d9676384: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:24.650456 11955 consensus_queue.cc:1048] T 1ddad75b87454a569aca197513526ac0 P 645c185863fd448e91faa534d9676384 [LEADER]: Connected to new peer: Peer: permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:24.664824 11727 raft_consensus.cc:1275] T 1ddad75b87454a569aca197513526ac0 P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Refusing update from remote peer 645c185863fd448e91faa534d9676384: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:24.668812 11575 raft_consensus.cc:1275] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Refusing update from remote peer 922904a85e7c45febb9f75ac6e08c44d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:24.668746 11907 consensus_queue.cc:1048] T 1ddad75b87454a569aca197513526ac0 P 645c185863fd448e91faa534d9676384 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:24.670794 11950 consensus_queue.cc:1048] T 93f9b1bb3ecf400b862f2f4138e56c26 P 922904a85e7c45febb9f75ac6e08c44d [LEADER]: Connected to new peer: Peer: permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:24.678927 11726 raft_consensus.cc:1275] T 93f9b1bb3ecf400b862f2f4138e56c26 P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Refusing update from remote peer 922904a85e7c45febb9f75ac6e08c44d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:24.680496 11920 consensus_queue.cc:1048] T 93f9b1bb3ecf400b862f2f4138e56c26 P 922904a85e7c45febb9f75ac6e08c44d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:24.697460 11727 raft_consensus.cc:1275] T 4e1812f5a3f645f7916cb5c302389554 P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Refusing update from remote peer 922904a85e7c45febb9f75ac6e08c44d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:24.699043 11950 consensus_queue.cc:1048] T 4e1812f5a3f645f7916cb5c302389554 P 922904a85e7c45febb9f75ac6e08c44d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:24.710000 11575 raft_consensus.cc:1275] T 4e1812f5a3f645f7916cb5c302389554 P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Refusing update from remote peer 922904a85e7c45febb9f75ac6e08c44d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:24.711216 11950 consensus_queue.cc:1048] T 4e1812f5a3f645f7916cb5c302389554 P 922904a85e7c45febb9f75ac6e08c44d [LEADER]: Connected to new peer: Peer: permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:24.760370 11727 raft_consensus.cc:1275] T 697274863f944f0fbb85ceb095246a34 P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Refusing update from remote peer 645c185863fd448e91faa534d9676384: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:24.761821 11907 consensus_queue.cc:1048] T 697274863f944f0fbb85ceb095246a34 P 645c185863fd448e91faa534d9676384 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:24.771291 11650 raft_consensus.cc:1275] T 697274863f944f0fbb85ceb095246a34 P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Refusing update from remote peer 645c185863fd448e91faa534d9676384: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:24.773408 11907 consensus_queue.cc:1048] T 697274863f944f0fbb85ceb095246a34 P 645c185863fd448e91faa534d9676384 [LEADER]: Connected to new peer: Peer: permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:24.781998 11650 raft_consensus.cc:1275] T 9c039891b31042bf80ce793acc763f02 P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Refusing update from remote peer 645c185863fd448e91faa534d9676384: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:24.783309 11907 consensus_queue.cc:1048] T 9c039891b31042bf80ce793acc763f02 P 645c185863fd448e91faa534d9676384 [LEADER]: Connected to new peer: Peer: permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:24.793579 11726 raft_consensus.cc:1275] T 9c039891b31042bf80ce793acc763f02 P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Refusing update from remote peer 645c185863fd448e91faa534d9676384: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:24.795257 11857 consensus_queue.cc:1048] T 9c039891b31042bf80ce793acc763f02 P 645c185863fd448e91faa534d9676384 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:24.866094 11726 raft_consensus.cc:1275] T 150e4155b8b44870a836beaa9aedb09f P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Refusing update from remote peer 922904a85e7c45febb9f75ac6e08c44d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:24.867712 11950 consensus_queue.cc:1048] T 150e4155b8b44870a836beaa9aedb09f P 922904a85e7c45febb9f75ac6e08c44d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:24.878536 11575 raft_consensus.cc:1275] T 150e4155b8b44870a836beaa9aedb09f P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Refusing update from remote peer 922904a85e7c45febb9f75ac6e08c44d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:24.879971 11970 consensus_queue.cc:1048] T 150e4155b8b44870a836beaa9aedb09f P 922904a85e7c45febb9f75ac6e08c44d [LEADER]: Connected to new peer: Peer: permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:24.935186 11575 raft_consensus.cc:1275] T fc065a29f3ec440f9181e37392205f3f P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Refusing update from remote peer efc52ba30a214524ba9a3705d5b5909f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:24.936373 11946 consensus_queue.cc:1048] T fc065a29f3ec440f9181e37392205f3f P efc52ba30a214524ba9a3705d5b5909f [LEADER]: Connected to new peer: Peer: permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:24.944782 11650 raft_consensus.cc:1275] T fc065a29f3ec440f9181e37392205f3f P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Refusing update from remote peer efc52ba30a214524ba9a3705d5b5909f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:24.946535 11947 consensus_queue.cc:1048] T fc065a29f3ec440f9181e37392205f3f P efc52ba30a214524ba9a3705d5b5909f [LEADER]: Connected to new peer: Peer: permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:25.022534 11748 debug-util.cc:398] Leaking SignalData structure 0x7b0800295d80 after lost signal to thread 434
W20260709 13:05:25.024029 11748 debug-util.cc:398] Leaking SignalData structure 0x7b080005d5e0 after lost signal to thread 11510
W20260709 13:05:25.025247 11748 debug-util.cc:398] Leaking SignalData structure 0x7b0800099540 after lost signal to thread 11602
W20260709 13:05:25.026260 11748 debug-util.cc:398] Leaking SignalData structure 0x7b08003627e0 after lost signal to thread 11677
W20260709 13:05:25.027259 11748 debug-util.cc:398] Leaking SignalData structure 0x7b080018f680 after lost signal to thread 11751
I20260709 13:05:27.226497 11472 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39008:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:05:27.259445 11472 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39008:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:05:27.422634   431 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:05:27.549916 12014 tablet.cc:1724] T 1ddad75b87454a569aca197513526ac0 P 645c185863fd448e91faa534d9676384: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:05:27.604092 11619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37707, user_credentials={real_user=slave}} blocked reactor thread for 61559.4us
W20260709 13:05:27.606755 11997 log.cc:927] Time spent T 9c039891b31042bf80ce793acc763f02 P 645c185863fd448e91faa534d9676384: Append to log took a long time: real 0.187s	user 0.000s	sys 0.002s
I20260709 13:05:27.564066 12015 tablet.cc:1724] T 1ddad75b87454a569aca197513526ac0 P efc52ba30a214524ba9a3705d5b5909f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:05:27.664019 12004 log.cc:927] Time spent T 150e4155b8b44870a836beaa9aedb09f P 922904a85e7c45febb9f75ac6e08c44d: Append to log took a long time: real 0.181s	user 0.003s	sys 0.003s
I20260709 13:05:27.724071 12035 tablet.cc:1724] T 1ddad75b87454a569aca197513526ac0 P 922904a85e7c45febb9f75ac6e08c44d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:27.724282 12040 tablet.cc:1724] T 93f9b1bb3ecf400b862f2f4138e56c26 P efc52ba30a214524ba9a3705d5b5909f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:27.773102 12043 tablet.cc:1724] T 92a1be5cd07e49e285721f1cfa7af29f P 922904a85e7c45febb9f75ac6e08c44d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:27.761042 12046 tablet.cc:1724] T 93f9b1bb3ecf400b862f2f4138e56c26 P 922904a85e7c45febb9f75ac6e08c44d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:27.789405 11472 catalog_manager.cc:5789] TS 645c185863fd448e91faa534d9676384 (127.0.107.193:37707) does not have the latest schema for tablet 9c039891b31042bf80ce793acc763f02 (table soft_deleted_table [id=a3a3dff256ef4cbab875574c5f5044e4]). Expected version 1 got 0
I20260709 13:05:27.790345 11472 catalog_manager.cc:5789] TS 645c185863fd448e91faa534d9676384 (127.0.107.193:37707) does not have the latest schema for tablet 92a1be5cd07e49e285721f1cfa7af29f (table soft_deleted_table [id=a3a3dff256ef4cbab875574c5f5044e4]). Expected version 1 got 0
I20260709 13:05:27.791963 11472 catalog_manager.cc:5789] TS 645c185863fd448e91faa534d9676384 (127.0.107.193:37707) does not have the latest schema for tablet 697274863f944f0fbb85ceb095246a34 (table soft_deleted_table [id=a3a3dff256ef4cbab875574c5f5044e4]). Expected version 1 got 0
I20260709 13:05:27.722862 12039 tablet.cc:1724] T 697274863f944f0fbb85ceb095246a34 P efc52ba30a214524ba9a3705d5b5909f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:27.764592 12047 tablet.cc:1724] T 4e1812f5a3f645f7916cb5c302389554 P 922904a85e7c45febb9f75ac6e08c44d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:27.790304 12049 tablet.cc:1724] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:05:27.803529 12034 log.cc:927] Time spent T 0e916728a67d4b0e8c29748c8af0b79a P 645c185863fd448e91faa534d9676384: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:05:27.721124 12038 tablet.cc:1724] T 697274863f944f0fbb85ceb095246a34 P 645c185863fd448e91faa534d9676384: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:05:27.814036 12032 log.cc:927] Time spent T 9c039891b31042bf80ce793acc763f02 P 922904a85e7c45febb9f75ac6e08c44d: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:05:27.815938 12014 tablet.cc:1724] T 92a1be5cd07e49e285721f1cfa7af29f P 645c185863fd448e91faa534d9676384: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:27.816450 12049 tablet.cc:1724] T fc065a29f3ec440f9181e37392205f3f P 645c185863fd448e91faa534d9676384: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:27.772991 12042 tablet.cc:1724] T fc065a29f3ec440f9181e37392205f3f P efc52ba30a214524ba9a3705d5b5909f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:05:27.820971 12028 log.cc:927] Time spent T 150e4155b8b44870a836beaa9aedb09f P 645c185863fd448e91faa534d9676384: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:05:27.831050 12049 tablet.cc:1724] T 4e1812f5a3f645f7916cb5c302389554 P 645c185863fd448e91faa534d9676384: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:27.845299 12015 tablet.cc:1724] T 4e1812f5a3f645f7916cb5c302389554 P efc52ba30a214524ba9a3705d5b5909f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:27.851130 12040 tablet.cc:1724] T 0e916728a67d4b0e8c29748c8af0b79a P efc52ba30a214524ba9a3705d5b5909f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:27.868918 11578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92a1be5cd07e49e285721f1cfa7af29f"
dest_uuid: "645c185863fd448e91faa534d9676384"
mode: GRACEFUL
new_leader_uuid: "efc52ba30a214524ba9a3705d5b5909f"
 from {username='slave'} at 127.0.0.1:39380
I20260709 13:05:27.869645 11578 raft_consensus.cc:606] T 92a1be5cd07e49e285721f1cfa7af29f P 645c185863fd448e91faa534d9676384 [term 1 LEADER]: Received request to transfer leadership to TS efc52ba30a214524ba9a3705d5b5909f
I20260709 13:05:27.870033 12049 tablet.cc:1724] T 9c039891b31042bf80ce793acc763f02 P 645c185863fd448e91faa534d9676384: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:27.878620 11977 raft_consensus.cc:993] T 92a1be5cd07e49e285721f1cfa7af29f P 645c185863fd448e91faa534d9676384: : Instructing follower efc52ba30a214524ba9a3705d5b5909f to start an election
I20260709 13:05:27.879227 11977 raft_consensus.cc:1081] T 92a1be5cd07e49e285721f1cfa7af29f P 645c185863fd448e91faa534d9676384 [term 1 LEADER]: Signalling peer efc52ba30a214524ba9a3705d5b5909f to start an election
I20260709 13:05:27.884145 11723 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92a1be5cd07e49e285721f1cfa7af29f"
dest_uuid: "efc52ba30a214524ba9a3705d5b5909f"
 from {username='slave'} at 127.0.0.1:58518
I20260709 13:05:27.884816 11723 raft_consensus.cc:493] T 92a1be5cd07e49e285721f1cfa7af29f P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:27.885226 11723 raft_consensus.cc:3060] T 92a1be5cd07e49e285721f1cfa7af29f P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:27.885637 12015 tablet.cc:1724] T 92a1be5cd07e49e285721f1cfa7af29f P efc52ba30a214524ba9a3705d5b5909f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:27.885761 12035 tablet.cc:1724] T 697274863f944f0fbb85ceb095246a34 P 922904a85e7c45febb9f75ac6e08c44d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:27.913231 12046 tablet.cc:1724] T 0e916728a67d4b0e8c29748c8af0b79a P 922904a85e7c45febb9f75ac6e08c44d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:27.914799 12015 tablet.cc:1724] T 150e4155b8b44870a836beaa9aedb09f P efc52ba30a214524ba9a3705d5b5909f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:27.943997 12046 tablet.cc:1724] T fc065a29f3ec440f9181e37392205f3f P 922904a85e7c45febb9f75ac6e08c44d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:27.947969 12043 tablet.cc:1724] T 150e4155b8b44870a836beaa9aedb09f P 922904a85e7c45febb9f75ac6e08c44d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:27.950527 11476 catalog_manager.cc:5789] TS 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415) does not have the latest schema for tablet 150e4155b8b44870a836beaa9aedb09f (table soft_deleted_table [id=a3a3dff256ef4cbab875574c5f5044e4]). Expected version 1 got 0
I20260709 13:05:27.950996 12042 tablet.cc:1724] T 9c039891b31042bf80ce793acc763f02 P efc52ba30a214524ba9a3705d5b5909f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:27.902667 12041 tablet.cc:1724] T 150e4155b8b44870a836beaa9aedb09f P 645c185863fd448e91faa534d9676384: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:27.965600 11476 catalog_manager.cc:5789] TS 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415) does not have the latest schema for tablet 0e916728a67d4b0e8c29748c8af0b79a (table soft_deleted_table [id=a3a3dff256ef4cbab875574c5f5044e4]). Expected version 1 got 0
I20260709 13:05:27.962536 12014 tablet.cc:1724] T 0e916728a67d4b0e8c29748c8af0b79a P 645c185863fd448e91faa534d9676384: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:27.957247 12047 tablet.cc:1724] T 9c039891b31042bf80ce793acc763f02 P 922904a85e7c45febb9f75ac6e08c44d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:27.964214 11723 raft_consensus.cc:515] T 92a1be5cd07e49e285721f1cfa7af29f P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:27.980768 11723 leader_election.cc:290] T 92a1be5cd07e49e285721f1cfa7af29f P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 2 election: Requested vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415)
I20260709 13:05:27.981913 11578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a1be5cd07e49e285721f1cfa7af29f" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "645c185863fd448e91faa534d9676384"
I20260709 13:05:27.991598 11578 raft_consensus.cc:3055] T 92a1be5cd07e49e285721f1cfa7af29f P 645c185863fd448e91faa534d9676384 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:27.991988 11578 raft_consensus.cc:740] T 92a1be5cd07e49e285721f1cfa7af29f P 645c185863fd448e91faa534d9676384 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 645c185863fd448e91faa534d9676384, State: Running, Role: LEADER
I20260709 13:05:27.992941 11578 consensus_queue.cc:260] T 92a1be5cd07e49e285721f1cfa7af29f P 645c185863fd448e91faa534d9676384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:27.994766 11578 raft_consensus.cc:3060] T 92a1be5cd07e49e285721f1cfa7af29f P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:27.986354 11651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93f9b1bb3ecf400b862f2f4138e56c26"
dest_uuid: "922904a85e7c45febb9f75ac6e08c44d"
mode: GRACEFUL
new_leader_uuid: "efc52ba30a214524ba9a3705d5b5909f"
 from {username='slave'} at 127.0.0.1:46396
I20260709 13:05:27.996582 11651 raft_consensus.cc:606] T 93f9b1bb3ecf400b862f2f4138e56c26 P 922904a85e7c45febb9f75ac6e08c44d [term 2 LEADER]: Received request to transfer leadership to TS efc52ba30a214524ba9a3705d5b5909f
I20260709 13:05:27.986268 11649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a1be5cd07e49e285721f1cfa7af29f" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "922904a85e7c45febb9f75ac6e08c44d"
I20260709 13:05:27.998167 11649 raft_consensus.cc:3060] T 92a1be5cd07e49e285721f1cfa7af29f P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:28.007587 11649 raft_consensus.cc:2468] T 92a1be5cd07e49e285721f1cfa7af29f P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc52ba30a214524ba9a3705d5b5909f in term 2.
I20260709 13:05:28.008947   431 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:05:28.009776   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:28.013743 11578 raft_consensus.cc:2468] T 92a1be5cd07e49e285721f1cfa7af29f P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc52ba30a214524ba9a3705d5b5909f in term 2.
I20260709 13:05:28.015774 11693 leader_election.cc:304] T 92a1be5cd07e49e285721f1cfa7af29f P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645c185863fd448e91faa534d9676384, efc52ba30a214524ba9a3705d5b5909f; no voters: 
I20260709 13:05:28.016714 12016 raft_consensus.cc:2804] T 92a1be5cd07e49e285721f1cfa7af29f P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:28.017496 12016 raft_consensus.cc:697] T 92a1be5cd07e49e285721f1cfa7af29f P efc52ba30a214524ba9a3705d5b5909f [term 2 LEADER]: Becoming Leader. State: Replica: efc52ba30a214524ba9a3705d5b5909f, State: Running, Role: LEADER
I20260709 13:05:28.018339 12016 consensus_queue.cc:237] T 92a1be5cd07e49e285721f1cfa7af29f P efc52ba30a214524ba9a3705d5b5909f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:28.020460 11651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6655f1f8c7674f98bd634a5f88ed3d55"
dest_uuid: "922904a85e7c45febb9f75ac6e08c44d"
mode: GRACEFUL
new_leader_uuid: "efc52ba30a214524ba9a3705d5b5909f"
 from {username='slave'} at 127.0.0.1:46396
I20260709 13:05:28.021164 11651 raft_consensus.cc:606] T 6655f1f8c7674f98bd634a5f88ed3d55 P 922904a85e7c45febb9f75ac6e08c44d [term 2 LEADER]: Received request to transfer leadership to TS efc52ba30a214524ba9a3705d5b5909f
I20260709 13:05:28.026787 11578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6555ed9a2e04888ac596b8dbe747265"
dest_uuid: "645c185863fd448e91faa534d9676384"
mode: GRACEFUL
new_leader_uuid: "efc52ba30a214524ba9a3705d5b5909f"
 from {username='slave'} at 127.0.0.1:39380
I20260709 13:05:28.028131 11578 raft_consensus.cc:606] T b6555ed9a2e04888ac596b8dbe747265 P 645c185863fd448e91faa534d9676384 [term 2 LEADER]: Received request to transfer leadership to TS efc52ba30a214524ba9a3705d5b5909f
I20260709 13:05:28.039376   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:28.040069   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:28.060015 11472 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 3f6084af20764c6eb4d8ab85b1c9eef3: soft_deleted_table [id=a3a3dff256ef4cbab875574c5f5044e4] alter complete (version 1)
I20260709 13:05:28.071023 11473 catalog_manager.cc:5697] T 92a1be5cd07e49e285721f1cfa7af29f P efc52ba30a214524ba9a3705d5b5909f reported cstate change: term changed from 1 to 2, leader changed from 645c185863fd448e91faa534d9676384 (127.0.107.193) to efc52ba30a214524ba9a3705d5b5909f (127.0.107.195). New cstate: current_term: 2 leader_uuid: "efc52ba30a214524ba9a3705d5b5909f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:28.149477 12013 raft_consensus.cc:993] T 93f9b1bb3ecf400b862f2f4138e56c26 P 922904a85e7c45febb9f75ac6e08c44d: : Instructing follower efc52ba30a214524ba9a3705d5b5909f to start an election
I20260709 13:05:28.150111 12018 raft_consensus.cc:1081] T 93f9b1bb3ecf400b862f2f4138e56c26 P 922904a85e7c45febb9f75ac6e08c44d [term 2 LEADER]: Signalling peer efc52ba30a214524ba9a3705d5b5909f to start an election
I20260709 13:05:28.152429 11723 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93f9b1bb3ecf400b862f2f4138e56c26"
dest_uuid: "efc52ba30a214524ba9a3705d5b5909f"
 from {username='slave'} at 127.0.0.1:58528
I20260709 13:05:28.154114 11723 raft_consensus.cc:493] T 93f9b1bb3ecf400b862f2f4138e56c26 P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:28.155246 11723 raft_consensus.cc:3060] T 93f9b1bb3ecf400b862f2f4138e56c26 P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:28.166100 11723 raft_consensus.cc:515] T 93f9b1bb3ecf400b862f2f4138e56c26 P efc52ba30a214524ba9a3705d5b5909f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:28.169741 11723 leader_election.cc:290] T 93f9b1bb3ecf400b862f2f4138e56c26 P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 3 election: Requested vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415)
I20260709 13:05:28.170658 11578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f9b1bb3ecf400b862f2f4138e56c26" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "645c185863fd448e91faa534d9676384"
I20260709 13:05:28.171522 11578 raft_consensus.cc:3060] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:28.172910 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f9b1bb3ecf400b862f2f4138e56c26" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "922904a85e7c45febb9f75ac6e08c44d"
I20260709 13:05:28.173923 11651 raft_consensus.cc:3055] T 93f9b1bb3ecf400b862f2f4138e56c26 P 922904a85e7c45febb9f75ac6e08c44d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:28.174448 11651 raft_consensus.cc:740] T 93f9b1bb3ecf400b862f2f4138e56c26 P 922904a85e7c45febb9f75ac6e08c44d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 922904a85e7c45febb9f75ac6e08c44d, State: Running, Role: LEADER
I20260709 13:05:28.175273 11651 consensus_queue.cc:260] T 93f9b1bb3ecf400b862f2f4138e56c26 P 922904a85e7c45febb9f75ac6e08c44d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:28.185778 11651 raft_consensus.cc:3060] T 93f9b1bb3ecf400b862f2f4138e56c26 P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:28.188421 11578 raft_consensus.cc:2468] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc52ba30a214524ba9a3705d5b5909f in term 3.
I20260709 13:05:28.190172 11693 leader_election.cc:304] T 93f9b1bb3ecf400b862f2f4138e56c26 P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645c185863fd448e91faa534d9676384, efc52ba30a214524ba9a3705d5b5909f; no voters: 
I20260709 13:05:28.191131 12016 raft_consensus.cc:2804] T 93f9b1bb3ecf400b862f2f4138e56c26 P efc52ba30a214524ba9a3705d5b5909f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:28.191615 12016 raft_consensus.cc:697] T 93f9b1bb3ecf400b862f2f4138e56c26 P efc52ba30a214524ba9a3705d5b5909f [term 3 LEADER]: Becoming Leader. State: Replica: efc52ba30a214524ba9a3705d5b5909f, State: Running, Role: LEADER
I20260709 13:05:28.192521 11651 raft_consensus.cc:2468] T 93f9b1bb3ecf400b862f2f4138e56c26 P 922904a85e7c45febb9f75ac6e08c44d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc52ba30a214524ba9a3705d5b5909f in term 3.
I20260709 13:05:28.192615 12016 consensus_queue.cc:237] T 93f9b1bb3ecf400b862f2f4138e56c26 P efc52ba30a214524ba9a3705d5b5909f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:28.206503 11473 catalog_manager.cc:5697] T 93f9b1bb3ecf400b862f2f4138e56c26 P efc52ba30a214524ba9a3705d5b5909f reported cstate change: term changed from 2 to 3, leader changed from 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194) to efc52ba30a214524ba9a3705d5b5909f (127.0.107.195). New cstate: current_term: 3 leader_uuid: "efc52ba30a214524ba9a3705d5b5909f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:28.242339 12018 raft_consensus.cc:993] T 6655f1f8c7674f98bd634a5f88ed3d55 P 922904a85e7c45febb9f75ac6e08c44d: : Instructing follower efc52ba30a214524ba9a3705d5b5909f to start an election
I20260709 13:05:28.242967 12013 raft_consensus.cc:1081] T 6655f1f8c7674f98bd634a5f88ed3d55 P 922904a85e7c45febb9f75ac6e08c44d [term 2 LEADER]: Signalling peer efc52ba30a214524ba9a3705d5b5909f to start an election
I20260709 13:05:28.245028 11724 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6655f1f8c7674f98bd634a5f88ed3d55"
dest_uuid: "efc52ba30a214524ba9a3705d5b5909f"
 from {username='slave'} at 127.0.0.1:58528
I20260709 13:05:28.245725 11724 raft_consensus.cc:493] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:28.246167 11724 raft_consensus.cc:3060] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:28.256088 11724 raft_consensus.cc:515] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:28.259629 11577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6655f1f8c7674f98bd634a5f88ed3d55" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "645c185863fd448e91faa534d9676384"
I20260709 13:05:28.260035 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6655f1f8c7674f98bd634a5f88ed3d55" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "922904a85e7c45febb9f75ac6e08c44d"
I20260709 13:05:28.260319 11577 raft_consensus.cc:3060] T 6655f1f8c7674f98bd634a5f88ed3d55 P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:28.260716 11651 raft_consensus.cc:3055] T 6655f1f8c7674f98bd634a5f88ed3d55 P 922904a85e7c45febb9f75ac6e08c44d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:28.261053 11651 raft_consensus.cc:740] T 6655f1f8c7674f98bd634a5f88ed3d55 P 922904a85e7c45febb9f75ac6e08c44d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 922904a85e7c45febb9f75ac6e08c44d, State: Running, Role: LEADER
I20260709 13:05:28.261912 11724 leader_election.cc:290] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 3 election: Requested vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415)
I20260709 13:05:28.261950 11651 consensus_queue.cc:260] T 6655f1f8c7674f98bd634a5f88ed3d55 P 922904a85e7c45febb9f75ac6e08c44d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:28.263367 11651 raft_consensus.cc:3060] T 6655f1f8c7674f98bd634a5f88ed3d55 P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:28.268035 11577 raft_consensus.cc:2468] T 6655f1f8c7674f98bd634a5f88ed3d55 P 645c185863fd448e91faa534d9676384 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc52ba30a214524ba9a3705d5b5909f in term 3.
I20260709 13:05:28.269469 11693 leader_election.cc:304] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645c185863fd448e91faa534d9676384, efc52ba30a214524ba9a3705d5b5909f; no voters: 
I20260709 13:05:28.270579 12016 raft_consensus.cc:2804] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:28.271344 12016 raft_consensus.cc:697] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f [term 3 LEADER]: Becoming Leader. State: Replica: efc52ba30a214524ba9a3705d5b5909f, State: Running, Role: LEADER
I20260709 13:05:28.272257 11651 raft_consensus.cc:2468] T 6655f1f8c7674f98bd634a5f88ed3d55 P 922904a85e7c45febb9f75ac6e08c44d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc52ba30a214524ba9a3705d5b5909f in term 3.
I20260709 13:05:28.272583 12016 consensus_queue.cc:237] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:28.282744 11473 catalog_manager.cc:5697] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f reported cstate change: term changed from 2 to 3, leader changed from 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194) to efc52ba30a214524ba9a3705d5b5909f (127.0.107.195). New cstate: current_term: 3 leader_uuid: "efc52ba30a214524ba9a3705d5b5909f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:28.387303 11976 raft_consensus.cc:993] T b6555ed9a2e04888ac596b8dbe747265 P 645c185863fd448e91faa534d9676384: : Instructing follower efc52ba30a214524ba9a3705d5b5909f to start an election
I20260709 13:05:28.388068 12007 raft_consensus.cc:1081] T b6555ed9a2e04888ac596b8dbe747265 P 645c185863fd448e91faa534d9676384 [term 2 LEADER]: Signalling peer efc52ba30a214524ba9a3705d5b5909f to start an election
I20260709 13:05:28.390115 11724 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6555ed9a2e04888ac596b8dbe747265"
dest_uuid: "efc52ba30a214524ba9a3705d5b5909f"
 from {username='slave'} at 127.0.0.1:58518
I20260709 13:05:28.390792 11724 raft_consensus.cc:493] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:28.391213 11724 raft_consensus.cc:3060] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:28.401131 11724 raft_consensus.cc:515] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:28.404449 11724 leader_election.cc:290] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 3 election: Requested vote from peers 645c185863fd448e91faa534d9676384 (127.0.107.193:37707), 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415)
I20260709 13:05:28.404822 11577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6555ed9a2e04888ac596b8dbe747265" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "645c185863fd448e91faa534d9676384"
I20260709 13:05:28.404995 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6555ed9a2e04888ac596b8dbe747265" candidate_uuid: "efc52ba30a214524ba9a3705d5b5909f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "922904a85e7c45febb9f75ac6e08c44d"
I20260709 13:05:28.405640 11577 raft_consensus.cc:3055] T b6555ed9a2e04888ac596b8dbe747265 P 645c185863fd448e91faa534d9676384 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:28.405702 11651 raft_consensus.cc:3060] T b6555ed9a2e04888ac596b8dbe747265 P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:28.406121 11577 raft_consensus.cc:740] T b6555ed9a2e04888ac596b8dbe747265 P 645c185863fd448e91faa534d9676384 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 645c185863fd448e91faa534d9676384, State: Running, Role: LEADER
I20260709 13:05:28.407485 11577 consensus_queue.cc:260] T b6555ed9a2e04888ac596b8dbe747265 P 645c185863fd448e91faa534d9676384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:28.409191 11577 raft_consensus.cc:3060] T b6555ed9a2e04888ac596b8dbe747265 P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:28.415035 11651 raft_consensus.cc:2468] T b6555ed9a2e04888ac596b8dbe747265 P 922904a85e7c45febb9f75ac6e08c44d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc52ba30a214524ba9a3705d5b5909f in term 3.
I20260709 13:05:28.416893 11693 leader_election.cc:304] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 922904a85e7c45febb9f75ac6e08c44d, efc52ba30a214524ba9a3705d5b5909f; no voters: 
I20260709 13:05:28.417963 12016 raft_consensus.cc:2804] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:28.418370 11577 raft_consensus.cc:2468] T b6555ed9a2e04888ac596b8dbe747265 P 645c185863fd448e91faa534d9676384 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc52ba30a214524ba9a3705d5b5909f in term 3.
I20260709 13:05:28.418493 12016 raft_consensus.cc:697] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f [term 3 LEADER]: Becoming Leader. State: Replica: efc52ba30a214524ba9a3705d5b5909f, State: Running, Role: LEADER
I20260709 13:05:28.419703 12016 consensus_queue.cc:237] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } }
I20260709 13:05:28.429940 11473 catalog_manager.cc:5697] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f reported cstate change: term changed from 2 to 3, leader changed from 645c185863fd448e91faa534d9676384 (127.0.107.193) to efc52ba30a214524ba9a3705d5b5909f (127.0.107.195). New cstate: current_term: 3 leader_uuid: "efc52ba30a214524ba9a3705d5b5909f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc52ba30a214524ba9a3705d5b5909f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37949 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:28.536175 11651 raft_consensus.cc:1275] T 92a1be5cd07e49e285721f1cfa7af29f P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Refusing update from remote peer efc52ba30a214524ba9a3705d5b5909f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:05:28.537807 12016 consensus_queue.cc:1048] T 92a1be5cd07e49e285721f1cfa7af29f P efc52ba30a214524ba9a3705d5b5909f [LEADER]: Connected to new peer: Peer: permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:28.563777 11577 raft_consensus.cc:1275] T 92a1be5cd07e49e285721f1cfa7af29f P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Refusing update from remote peer efc52ba30a214524ba9a3705d5b5909f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:05:28.566480 12016 consensus_queue.cc:1048] T 92a1be5cd07e49e285721f1cfa7af29f P efc52ba30a214524ba9a3705d5b5909f [LEADER]: Connected to new peer: Peer: permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:28.651651 11577 raft_consensus.cc:1275] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384 [term 3 FOLLOWER]: Refusing update from remote peer efc52ba30a214524ba9a3705d5b5909f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:05:28.653250 12016 consensus_queue.cc:1048] T 93f9b1bb3ecf400b862f2f4138e56c26 P efc52ba30a214524ba9a3705d5b5909f [LEADER]: Connected to new peer: Peer: permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:28.665964 11651 raft_consensus.cc:1275] T 93f9b1bb3ecf400b862f2f4138e56c26 P 922904a85e7c45febb9f75ac6e08c44d [term 3 FOLLOWER]: Refusing update from remote peer efc52ba30a214524ba9a3705d5b5909f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:05:28.669782 12059 consensus_queue.cc:1048] T 93f9b1bb3ecf400b862f2f4138e56c26 P efc52ba30a214524ba9a3705d5b5909f [LEADER]: Connected to new peer: Peer: permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:28.830510 11577 raft_consensus.cc:1275] T 6655f1f8c7674f98bd634a5f88ed3d55 P 645c185863fd448e91faa534d9676384 [term 3 FOLLOWER]: Refusing update from remote peer efc52ba30a214524ba9a3705d5b5909f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:28.832460 12059 consensus_queue.cc:1048] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f [LEADER]: Connected to new peer: Peer: permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:28.848336 11649 raft_consensus.cc:1275] T 6655f1f8c7674f98bd634a5f88ed3d55 P 922904a85e7c45febb9f75ac6e08c44d [term 3 FOLLOWER]: Refusing update from remote peer efc52ba30a214524ba9a3705d5b5909f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:28.855970 11975 consensus_queue.cc:1048] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f [LEADER]: Connected to new peer: Peer: permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:29.009991 11649 raft_consensus.cc:1275] T b6555ed9a2e04888ac596b8dbe747265 P 922904a85e7c45febb9f75ac6e08c44d [term 3 FOLLOWER]: Refusing update from remote peer efc52ba30a214524ba9a3705d5b5909f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:29.011809 11975 consensus_queue.cc:1048] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f [LEADER]: Connected to new peer: Peer: permanent_uuid: "922904a85e7c45febb9f75ac6e08c44d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:29.029318 11577 raft_consensus.cc:1275] T b6555ed9a2e04888ac596b8dbe747265 P 645c185863fd448e91faa534d9676384 [term 3 FOLLOWER]: Refusing update from remote peer efc52ba30a214524ba9a3705d5b5909f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:29.032251 12064 consensus_queue.cc:1048] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f [LEADER]: Connected to new peer: Peer: permanent_uuid: "645c185863fd448e91faa534d9676384" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:29.143754   431 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:05:29.155567   431 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:05:29.156103   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:29.165002   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:05:29.165578   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:30.215551   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:05:30.299333   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:30.300869   431 tablet_replica.cc:333] T 150e4155b8b44870a836beaa9aedb09f P 645c185863fd448e91faa534d9676384: stopping tablet replica
I20260709 13:05:30.301687   431 raft_consensus.cc:2243] T 150e4155b8b44870a836beaa9aedb09f P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.302307   431 raft_consensus.cc:2272] T 150e4155b8b44870a836beaa9aedb09f P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.308120   431 tablet_replica.cc:333] T 4e1812f5a3f645f7916cb5c302389554 P 645c185863fd448e91faa534d9676384: stopping tablet replica
I20260709 13:05:30.309221   431 raft_consensus.cc:2243] T 4e1812f5a3f645f7916cb5c302389554 P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.309821   431 raft_consensus.cc:2272] T 4e1812f5a3f645f7916cb5c302389554 P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.312500   431 tablet_replica.cc:333] T fc065a29f3ec440f9181e37392205f3f P 645c185863fd448e91faa534d9676384: stopping tablet replica
I20260709 13:05:30.313256   431 raft_consensus.cc:2243] T fc065a29f3ec440f9181e37392205f3f P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.313740   431 raft_consensus.cc:2272] T fc065a29f3ec440f9181e37392205f3f P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.316680   431 tablet_replica.cc:333] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384: stopping tablet replica
I20260709 13:05:30.317417   431 raft_consensus.cc:2243] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.318120   431 raft_consensus.cc:2272] T 93f9b1bb3ecf400b862f2f4138e56c26 P 645c185863fd448e91faa534d9676384 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.322503   431 tablet_replica.cc:333] T 9c039891b31042bf80ce793acc763f02 P 645c185863fd448e91faa534d9676384: stopping tablet replica
I20260709 13:05:30.325572   431 raft_consensus.cc:2243] T 9c039891b31042bf80ce793acc763f02 P 645c185863fd448e91faa534d9676384 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:30.327373   431 raft_consensus.cc:2272] T 9c039891b31042bf80ce793acc763f02 P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:30.327267 11693 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 9 similar messages]
I20260709 13:05:30.332057   431 tablet_replica.cc:333] T 0e916728a67d4b0e8c29748c8af0b79a P 645c185863fd448e91faa534d9676384: stopping tablet replica
I20260709 13:05:30.333498   431 raft_consensus.cc:2243] T 0e916728a67d4b0e8c29748c8af0b79a P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.334445   431 raft_consensus.cc:2272] T 0e916728a67d4b0e8c29748c8af0b79a P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.339223   431 tablet_replica.cc:333] T 92a1be5cd07e49e285721f1cfa7af29f P 645c185863fd448e91faa534d9676384: stopping tablet replica
W20260709 13:05:30.348011 11619 consensus_peers.cc:597] T dd80d122422e4086ba85914c7dfdbe0d P 922904a85e7c45febb9f75ac6e08c44d -> Peer 645c185863fd448e91faa534d9676384 (127.0.107.193:37707): Couldn't send request to peer 645c185863fd448e91faa534d9676384. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:30.350660 11693 consensus_peers.cc:597] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f -> Peer 645c185863fd448e91faa534d9676384 (127.0.107.193:37707): Couldn't send request to peer 645c185863fd448e91faa534d9676384. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:30.351572   431 raft_consensus.cc:2243] T 92a1be5cd07e49e285721f1cfa7af29f P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.352891   431 raft_consensus.cc:2272] T 92a1be5cd07e49e285721f1cfa7af29f P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.355250   431 tablet_replica.cc:333] T dd80d122422e4086ba85914c7dfdbe0d P 645c185863fd448e91faa534d9676384: stopping tablet replica
I20260709 13:05:30.356348   431 raft_consensus.cc:2243] T dd80d122422e4086ba85914c7dfdbe0d P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.357123   431 raft_consensus.cc:2272] T dd80d122422e4086ba85914c7dfdbe0d P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.361214   431 tablet_replica.cc:333] T 0c7cb06551c649a4963138881a4aa55d P 645c185863fd448e91faa534d9676384: stopping tablet replica
W20260709 13:05:30.360998 11693 consensus_peers.cc:597] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f -> Peer 645c185863fd448e91faa534d9676384 (127.0.107.193:37707): Couldn't send request to peer 645c185863fd448e91faa534d9676384. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:30.362468   431 raft_consensus.cc:2243] T 0c7cb06551c649a4963138881a4aa55d P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.363802   431 raft_consensus.cc:2272] T 0c7cb06551c649a4963138881a4aa55d P 645c185863fd448e91faa534d9676384 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.368986   431 tablet_replica.cc:333] T b6555ed9a2e04888ac596b8dbe747265 P 645c185863fd448e91faa534d9676384: stopping tablet replica
I20260709 13:05:30.369846   431 raft_consensus.cc:2243] T b6555ed9a2e04888ac596b8dbe747265 P 645c185863fd448e91faa534d9676384 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.370424   431 raft_consensus.cc:2272] T b6555ed9a2e04888ac596b8dbe747265 P 645c185863fd448e91faa534d9676384 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.373972   431 tablet_replica.cc:333] T d2603633a12047678d7b85f14c0c970e P 645c185863fd448e91faa534d9676384: stopping tablet replica
I20260709 13:05:30.374863   431 raft_consensus.cc:2243] T d2603633a12047678d7b85f14c0c970e P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:05:30.375151 11619 consensus_peers.cc:597] T 4e1812f5a3f645f7916cb5c302389554 P 922904a85e7c45febb9f75ac6e08c44d -> Peer 645c185863fd448e91faa534d9676384 (127.0.107.193:37707): Couldn't send request to peer 645c185863fd448e91faa534d9676384. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:30.375468   431 raft_consensus.cc:2272] T d2603633a12047678d7b85f14c0c970e P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.379689   431 tablet_replica.cc:333] T a3f692f94196483a9148317c2c73adcd P 645c185863fd448e91faa534d9676384: stopping tablet replica
I20260709 13:05:30.380836   431 raft_consensus.cc:2243] T a3f692f94196483a9148317c2c73adcd P 645c185863fd448e91faa534d9676384 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:30.381907   431 raft_consensus.cc:2272] T a3f692f94196483a9148317c2c73adcd P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:30.382330 11619 consensus_peers.cc:597] T 503bb0f5891b46de93cbac7e2a184b58 P 922904a85e7c45febb9f75ac6e08c44d -> Peer 645c185863fd448e91faa534d9676384 (127.0.107.193:37707): Couldn't send request to peer 645c185863fd448e91faa534d9676384. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:30.385857   431 tablet_replica.cc:333] T 503bb0f5891b46de93cbac7e2a184b58 P 645c185863fd448e91faa534d9676384: stopping tablet replica
I20260709 13:05:30.386641   431 raft_consensus.cc:2243] T 503bb0f5891b46de93cbac7e2a184b58 P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.387625   431 raft_consensus.cc:2272] T 503bb0f5891b46de93cbac7e2a184b58 P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.391269   431 tablet_replica.cc:333] T 697274863f944f0fbb85ceb095246a34 P 645c185863fd448e91faa534d9676384: stopping tablet replica
I20260709 13:05:30.391963   431 raft_consensus.cc:2243] T 697274863f944f0fbb85ceb095246a34 P 645c185863fd448e91faa534d9676384 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:30.392827   431 raft_consensus.cc:2272] T 697274863f944f0fbb85ceb095246a34 P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.395641   431 tablet_replica.cc:333] T 6655f1f8c7674f98bd634a5f88ed3d55 P 645c185863fd448e91faa534d9676384: stopping tablet replica
I20260709 13:05:30.396272   431 raft_consensus.cc:2243] T 6655f1f8c7674f98bd634a5f88ed3d55 P 645c185863fd448e91faa534d9676384 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.396791   431 raft_consensus.cc:2272] T 6655f1f8c7674f98bd634a5f88ed3d55 P 645c185863fd448e91faa534d9676384 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.402058   431 tablet_replica.cc:333] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 645c185863fd448e91faa534d9676384: stopping tablet replica
I20260709 13:05:30.402956   431 raft_consensus.cc:2243] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 645c185863fd448e91faa534d9676384 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:30.404372   431 raft_consensus.cc:2272] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.408538   431 tablet_replica.cc:333] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 645c185863fd448e91faa534d9676384: stopping tablet replica
I20260709 13:05:30.409411   431 raft_consensus.cc:2243] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 645c185863fd448e91faa534d9676384 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:30.410619   431 raft_consensus.cc:2272] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.414299   431 tablet_replica.cc:333] T 1ddad75b87454a569aca197513526ac0 P 645c185863fd448e91faa534d9676384: stopping tablet replica
I20260709 13:05:30.415102   431 raft_consensus.cc:2243] T 1ddad75b87454a569aca197513526ac0 P 645c185863fd448e91faa534d9676384 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:05:30.415863 11619 consensus_peers.cc:597] T 0e916728a67d4b0e8c29748c8af0b79a P 922904a85e7c45febb9f75ac6e08c44d -> Peer 645c185863fd448e91faa534d9676384 (127.0.107.193:37707): Couldn't send request to peer 645c185863fd448e91faa534d9676384. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:30.416255   431 raft_consensus.cc:2272] T 1ddad75b87454a569aca197513526ac0 P 645c185863fd448e91faa534d9676384 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.484149   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:05:30.525604 11693 consensus_peers.cc:597] T d2603633a12047678d7b85f14c0c970e P efc52ba30a214524ba9a3705d5b5909f -> Peer 645c185863fd448e91faa534d9676384 (127.0.107.193:37707): Couldn't send request to peer 645c185863fd448e91faa534d9676384. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:30.550374   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:05:30.562428 11693 consensus_peers.cc:597] T d2603633a12047678d7b85f14c0c970e P efc52ba30a214524ba9a3705d5b5909f -> Peer 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415): Couldn't send request to peer 922904a85e7c45febb9f75ac6e08c44d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:30.568495 11693 consensus_peers.cc:597] T fc065a29f3ec440f9181e37392205f3f P efc52ba30a214524ba9a3705d5b5909f -> Peer 645c185863fd448e91faa534d9676384 (127.0.107.193:37707): Couldn't send request to peer 645c185863fd448e91faa534d9676384. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:30.605818 11619 consensus_peers.cc:597] T 150e4155b8b44870a836beaa9aedb09f P 922904a85e7c45febb9f75ac6e08c44d -> Peer 645c185863fd448e91faa534d9676384 (127.0.107.193:37707): Couldn't send request to peer 645c185863fd448e91faa534d9676384. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:30.623322 11693 consensus_peers.cc:597] T 92a1be5cd07e49e285721f1cfa7af29f P efc52ba30a214524ba9a3705d5b5909f -> Peer 645c185863fd448e91faa534d9676384 (127.0.107.193:37707): Couldn't send request to peer 645c185863fd448e91faa534d9676384. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:30.630431 11619 consensus_peers.cc:597] T 0c7cb06551c649a4963138881a4aa55d P 922904a85e7c45febb9f75ac6e08c44d -> Peer 645c185863fd448e91faa534d9676384 (127.0.107.193:37707): Couldn't send request to peer 645c185863fd448e91faa534d9676384. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:30.631281 11693 consensus_peers.cc:597] T 93f9b1bb3ecf400b862f2f4138e56c26 P efc52ba30a214524ba9a3705d5b5909f -> Peer 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415): Couldn't send request to peer 922904a85e7c45febb9f75ac6e08c44d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:30.632886   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:30.634115   431 tablet_replica.cc:333] T fc065a29f3ec440f9181e37392205f3f P 922904a85e7c45febb9f75ac6e08c44d: stopping tablet replica
I20260709 13:05:30.635582   431 raft_consensus.cc:2243] T fc065a29f3ec440f9181e37392205f3f P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.636366   431 raft_consensus.cc:2272] T fc065a29f3ec440f9181e37392205f3f P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.638675   431 tablet_replica.cc:333] T 4e1812f5a3f645f7916cb5c302389554 P 922904a85e7c45febb9f75ac6e08c44d: stopping tablet replica
I20260709 13:05:30.639334   431 raft_consensus.cc:2243] T 4e1812f5a3f645f7916cb5c302389554 P 922904a85e7c45febb9f75ac6e08c44d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:30.640460   431 raft_consensus.cc:2272] T 4e1812f5a3f645f7916cb5c302389554 P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.643826   431 tablet_replica.cc:333] T 150e4155b8b44870a836beaa9aedb09f P 922904a85e7c45febb9f75ac6e08c44d: stopping tablet replica
I20260709 13:05:30.645040   431 raft_consensus.cc:2243] T 150e4155b8b44870a836beaa9aedb09f P 922904a85e7c45febb9f75ac6e08c44d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:30.646766   431 raft_consensus.cc:2272] T 150e4155b8b44870a836beaa9aedb09f P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.648967   431 tablet_replica.cc:333] T 93f9b1bb3ecf400b862f2f4138e56c26 P 922904a85e7c45febb9f75ac6e08c44d: stopping tablet replica
I20260709 13:05:30.649670   431 raft_consensus.cc:2243] T 93f9b1bb3ecf400b862f2f4138e56c26 P 922904a85e7c45febb9f75ac6e08c44d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.650241   431 raft_consensus.cc:2272] T 93f9b1bb3ecf400b862f2f4138e56c26 P 922904a85e7c45febb9f75ac6e08c44d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.652330   431 tablet_replica.cc:333] T 0e916728a67d4b0e8c29748c8af0b79a P 922904a85e7c45febb9f75ac6e08c44d: stopping tablet replica
I20260709 13:05:30.652974   431 raft_consensus.cc:2243] T 0e916728a67d4b0e8c29748c8af0b79a P 922904a85e7c45febb9f75ac6e08c44d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:30.653896   431 raft_consensus.cc:2272] T 0e916728a67d4b0e8c29748c8af0b79a P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.655941   431 tablet_replica.cc:333] T 92a1be5cd07e49e285721f1cfa7af29f P 922904a85e7c45febb9f75ac6e08c44d: stopping tablet replica
I20260709 13:05:30.656597   431 raft_consensus.cc:2243] T 92a1be5cd07e49e285721f1cfa7af29f P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.657153   431 raft_consensus.cc:2272] T 92a1be5cd07e49e285721f1cfa7af29f P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.660360   431 tablet_replica.cc:333] T 9c039891b31042bf80ce793acc763f02 P 922904a85e7c45febb9f75ac6e08c44d: stopping tablet replica
I20260709 13:05:30.661746   431 raft_consensus.cc:2243] T 9c039891b31042bf80ce793acc763f02 P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.662681   431 raft_consensus.cc:2272] T 9c039891b31042bf80ce793acc763f02 P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.666448   431 tablet_replica.cc:333] T 503bb0f5891b46de93cbac7e2a184b58 P 922904a85e7c45febb9f75ac6e08c44d: stopping tablet replica
I20260709 13:05:30.668044   431 raft_consensus.cc:2243] T 503bb0f5891b46de93cbac7e2a184b58 P 922904a85e7c45febb9f75ac6e08c44d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:30.669271   431 raft_consensus.cc:2272] T 503bb0f5891b46de93cbac7e2a184b58 P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:30.670467 11693 consensus_peers.cc:597] T 93f9b1bb3ecf400b862f2f4138e56c26 P efc52ba30a214524ba9a3705d5b5909f -> Peer 645c185863fd448e91faa534d9676384 (127.0.107.193:37707): Couldn't send request to peer 645c185863fd448e91faa534d9676384. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:30.672417   431 tablet_replica.cc:333] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 922904a85e7c45febb9f75ac6e08c44d: stopping tablet replica
I20260709 13:05:30.673413   431 raft_consensus.cc:2243] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.673987   431 raft_consensus.cc:2272] T 69acdb3a5cd54bc0b6921e6b343a20c2 P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.677150   431 tablet_replica.cc:333] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 922904a85e7c45febb9f75ac6e08c44d: stopping tablet replica
I20260709 13:05:30.677865   431 raft_consensus.cc:2243] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.678625   431 raft_consensus.cc:2272] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.681488   431 tablet_replica.cc:333] T a3f692f94196483a9148317c2c73adcd P 922904a85e7c45febb9f75ac6e08c44d: stopping tablet replica
I20260709 13:05:30.682148   431 raft_consensus.cc:2243] T a3f692f94196483a9148317c2c73adcd P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.683003   431 raft_consensus.cc:2272] T a3f692f94196483a9148317c2c73adcd P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.687175   431 tablet_replica.cc:333] T b6555ed9a2e04888ac596b8dbe747265 P 922904a85e7c45febb9f75ac6e08c44d: stopping tablet replica
I20260709 13:05:30.687944   431 raft_consensus.cc:2243] T b6555ed9a2e04888ac596b8dbe747265 P 922904a85e7c45febb9f75ac6e08c44d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.688573   431 raft_consensus.cc:2272] T b6555ed9a2e04888ac596b8dbe747265 P 922904a85e7c45febb9f75ac6e08c44d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.691191   431 tablet_replica.cc:333] T 697274863f944f0fbb85ceb095246a34 P 922904a85e7c45febb9f75ac6e08c44d: stopping tablet replica
I20260709 13:05:30.691848   431 raft_consensus.cc:2243] T 697274863f944f0fbb85ceb095246a34 P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.692342   431 raft_consensus.cc:2272] T 697274863f944f0fbb85ceb095246a34 P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.694868   431 tablet_replica.cc:333] T 6655f1f8c7674f98bd634a5f88ed3d55 P 922904a85e7c45febb9f75ac6e08c44d: stopping tablet replica
I20260709 13:05:30.695489   431 raft_consensus.cc:2243] T 6655f1f8c7674f98bd634a5f88ed3d55 P 922904a85e7c45febb9f75ac6e08c44d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.695955   431 raft_consensus.cc:2272] T 6655f1f8c7674f98bd634a5f88ed3d55 P 922904a85e7c45febb9f75ac6e08c44d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.699097   431 tablet_replica.cc:333] T dd80d122422e4086ba85914c7dfdbe0d P 922904a85e7c45febb9f75ac6e08c44d: stopping tablet replica
I20260709 13:05:30.699874   431 raft_consensus.cc:2243] T dd80d122422e4086ba85914c7dfdbe0d P 922904a85e7c45febb9f75ac6e08c44d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:30.701114   431 raft_consensus.cc:2272] T dd80d122422e4086ba85914c7dfdbe0d P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.704455   431 tablet_replica.cc:333] T 1ddad75b87454a569aca197513526ac0 P 922904a85e7c45febb9f75ac6e08c44d: stopping tablet replica
I20260709 13:05:30.705124   431 raft_consensus.cc:2243] T 1ddad75b87454a569aca197513526ac0 P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.705663   431 raft_consensus.cc:2272] T 1ddad75b87454a569aca197513526ac0 P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.707934   431 tablet_replica.cc:333] T d2603633a12047678d7b85f14c0c970e P 922904a85e7c45febb9f75ac6e08c44d: stopping tablet replica
I20260709 13:05:30.708617   431 raft_consensus.cc:2243] T d2603633a12047678d7b85f14c0c970e P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.709218   431 raft_consensus.cc:2272] T d2603633a12047678d7b85f14c0c970e P 922904a85e7c45febb9f75ac6e08c44d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.712713   431 tablet_replica.cc:333] T 0c7cb06551c649a4963138881a4aa55d P 922904a85e7c45febb9f75ac6e08c44d: stopping tablet replica
I20260709 13:05:30.713382   431 raft_consensus.cc:2243] T 0c7cb06551c649a4963138881a4aa55d P 922904a85e7c45febb9f75ac6e08c44d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:30.714573   431 raft_consensus.cc:2272] T 0c7cb06551c649a4963138881a4aa55d P 922904a85e7c45febb9f75ac6e08c44d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:30.759634 11693 consensus_peers.cc:597] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f -> Peer 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415): Couldn't send request to peer 922904a85e7c45febb9f75ac6e08c44d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45415: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:30.772418   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:05:30.839097   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:05:30.840905 11693 consensus_peers.cc:597] T 92a1be5cd07e49e285721f1cfa7af29f P efc52ba30a214524ba9a3705d5b5909f -> Peer 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415): Couldn't send request to peer 922904a85e7c45febb9f75ac6e08c44d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45415: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:30.876742 11693 consensus_peers.cc:597] T fc065a29f3ec440f9181e37392205f3f P efc52ba30a214524ba9a3705d5b5909f -> Peer 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415): Couldn't send request to peer 922904a85e7c45febb9f75ac6e08c44d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45415: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:30.886929 11693 consensus_peers.cc:597] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f -> Peer 922904a85e7c45febb9f75ac6e08c44d (127.0.107.194:45415): Couldn't send request to peer 922904a85e7c45febb9f75ac6e08c44d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45415: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:30.902776   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:30.904042   431 tablet_replica.cc:333] T fc065a29f3ec440f9181e37392205f3f P efc52ba30a214524ba9a3705d5b5909f: stopping tablet replica
I20260709 13:05:30.905059   431 raft_consensus.cc:2243] T fc065a29f3ec440f9181e37392205f3f P efc52ba30a214524ba9a3705d5b5909f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:30.906442   431 raft_consensus.cc:2272] T fc065a29f3ec440f9181e37392205f3f P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.911010   431 tablet_replica.cc:333] T 93f9b1bb3ecf400b862f2f4138e56c26 P efc52ba30a214524ba9a3705d5b5909f: stopping tablet replica
I20260709 13:05:30.912125   431 raft_consensus.cc:2243] T 93f9b1bb3ecf400b862f2f4138e56c26 P efc52ba30a214524ba9a3705d5b5909f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:30.913659   431 raft_consensus.cc:2272] T 93f9b1bb3ecf400b862f2f4138e56c26 P efc52ba30a214524ba9a3705d5b5909f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.916687   431 tablet_replica.cc:333] T 150e4155b8b44870a836beaa9aedb09f P efc52ba30a214524ba9a3705d5b5909f: stopping tablet replica
I20260709 13:05:30.917930   431 raft_consensus.cc:2243] T 150e4155b8b44870a836beaa9aedb09f P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.918742   431 raft_consensus.cc:2272] T 150e4155b8b44870a836beaa9aedb09f P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.921984   431 tablet_replica.cc:333] T 4e1812f5a3f645f7916cb5c302389554 P efc52ba30a214524ba9a3705d5b5909f: stopping tablet replica
I20260709 13:05:30.922910   431 raft_consensus.cc:2243] T 4e1812f5a3f645f7916cb5c302389554 P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.923560   431 raft_consensus.cc:2272] T 4e1812f5a3f645f7916cb5c302389554 P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.926402   431 tablet_replica.cc:333] T 697274863f944f0fbb85ceb095246a34 P efc52ba30a214524ba9a3705d5b5909f: stopping tablet replica
I20260709 13:05:30.927315   431 raft_consensus.cc:2243] T 697274863f944f0fbb85ceb095246a34 P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.927966   431 raft_consensus.cc:2272] T 697274863f944f0fbb85ceb095246a34 P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.932185   431 tablet_replica.cc:333] T 0e916728a67d4b0e8c29748c8af0b79a P efc52ba30a214524ba9a3705d5b5909f: stopping tablet replica
I20260709 13:05:30.933522   431 raft_consensus.cc:2243] T 0e916728a67d4b0e8c29748c8af0b79a P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.934360   431 raft_consensus.cc:2272] T 0e916728a67d4b0e8c29748c8af0b79a P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.937743   431 tablet_replica.cc:333] T 92a1be5cd07e49e285721f1cfa7af29f P efc52ba30a214524ba9a3705d5b5909f: stopping tablet replica
I20260709 13:05:30.938898   431 raft_consensus.cc:2243] T 92a1be5cd07e49e285721f1cfa7af29f P efc52ba30a214524ba9a3705d5b5909f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:30.940294   431 raft_consensus.cc:2272] T 92a1be5cd07e49e285721f1cfa7af29f P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.943444   431 tablet_replica.cc:333] T d2603633a12047678d7b85f14c0c970e P efc52ba30a214524ba9a3705d5b5909f: stopping tablet replica
I20260709 13:05:30.944455   431 raft_consensus.cc:2243] T d2603633a12047678d7b85f14c0c970e P efc52ba30a214524ba9a3705d5b5909f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:30.945830   431 raft_consensus.cc:2272] T d2603633a12047678d7b85f14c0c970e P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.949350   431 tablet_replica.cc:333] T 69acdb3a5cd54bc0b6921e6b343a20c2 P efc52ba30a214524ba9a3705d5b5909f: stopping tablet replica
I20260709 13:05:30.950325   431 raft_consensus.cc:2243] T 69acdb3a5cd54bc0b6921e6b343a20c2 P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.951041   431 raft_consensus.cc:2272] T 69acdb3a5cd54bc0b6921e6b343a20c2 P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.954679   431 tablet_replica.cc:333] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P efc52ba30a214524ba9a3705d5b5909f: stopping tablet replica
I20260709 13:05:30.955928   431 raft_consensus.cc:2243] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.957003   431 raft_consensus.cc:2272] T 2253eb70f9fa4f77b87a1522e2a7a4f0 P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.960448   431 tablet_replica.cc:333] T a3f692f94196483a9148317c2c73adcd P efc52ba30a214524ba9a3705d5b5909f: stopping tablet replica
I20260709 13:05:30.961493   431 raft_consensus.cc:2243] T a3f692f94196483a9148317c2c73adcd P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.962249   431 raft_consensus.cc:2272] T a3f692f94196483a9148317c2c73adcd P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.965674   431 tablet_replica.cc:333] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f: stopping tablet replica
I20260709 13:05:30.966885   431 raft_consensus.cc:2243] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:30.968143   431 raft_consensus.cc:2272] T b6555ed9a2e04888ac596b8dbe747265 P efc52ba30a214524ba9a3705d5b5909f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.972105   431 tablet_replica.cc:333] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f: stopping tablet replica
I20260709 13:05:30.973832   431 raft_consensus.cc:2243] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:30.975208   431 raft_consensus.cc:2272] T 6655f1f8c7674f98bd634a5f88ed3d55 P efc52ba30a214524ba9a3705d5b5909f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.980278   431 tablet_replica.cc:333] T 1ddad75b87454a569aca197513526ac0 P efc52ba30a214524ba9a3705d5b5909f: stopping tablet replica
I20260709 13:05:30.981213   431 raft_consensus.cc:2243] T 1ddad75b87454a569aca197513526ac0 P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.981997   431 raft_consensus.cc:2272] T 1ddad75b87454a569aca197513526ac0 P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.984836   431 tablet_replica.cc:333] T 9c039891b31042bf80ce793acc763f02 P efc52ba30a214524ba9a3705d5b5909f: stopping tablet replica
I20260709 13:05:30.985709   431 raft_consensus.cc:2243] T 9c039891b31042bf80ce793acc763f02 P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.986371   431 raft_consensus.cc:2272] T 9c039891b31042bf80ce793acc763f02 P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.991333   431 tablet_replica.cc:333] T 0c7cb06551c649a4963138881a4aa55d P efc52ba30a214524ba9a3705d5b5909f: stopping tablet replica
I20260709 13:05:30.992596   431 raft_consensus.cc:2243] T 0c7cb06551c649a4963138881a4aa55d P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.993630   431 raft_consensus.cc:2272] T 0c7cb06551c649a4963138881a4aa55d P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.997243   431 tablet_replica.cc:333] T dd80d122422e4086ba85914c7dfdbe0d P efc52ba30a214524ba9a3705d5b5909f: stopping tablet replica
I20260709 13:05:30.998096   431 raft_consensus.cc:2243] T dd80d122422e4086ba85914c7dfdbe0d P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.999001   431 raft_consensus.cc:2272] T dd80d122422e4086ba85914c7dfdbe0d P efc52ba30a214524ba9a3705d5b5909f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:31.002807   431 tablet_replica.cc:333] T 503bb0f5891b46de93cbac7e2a184b58 P efc52ba30a214524ba9a3705d5b5909f: stopping tablet replica
I20260709 13:05:31.003378   431 raft_consensus.cc:2243] T 503bb0f5891b46de93cbac7e2a184b58 P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:31.004137   431 raft_consensus.cc:2272] T 503bb0f5891b46de93cbac7e2a184b58 P efc52ba30a214524ba9a3705d5b5909f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:31.326824   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:05:31.368432   431 master.cc:562] Master@127.0.107.254:36585 shutting down...
I20260709 13:05:31.401736   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3f6084af20764c6eb4d8ab85b1c9eef3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:31.402467   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3f6084af20764c6eb4d8ab85b1c9eef3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:31.402812   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3f6084af20764c6eb4d8ab85b1c9eef3: stopping tablet replica
I20260709 13:05:31.428181   431 master.cc:584] Master@127.0.107.254:36585 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (14663 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:05:31.515157   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:37307
I20260709 13:05:31.517305   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:31.526113 12076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:31.526197 12075 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:31.528810   431 server_base.cc:1061] running on GCE node
W20260709 13:05:31.528266 12078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:31.530539   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:31.530757   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:31.530877   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602331530866 us; error 0 us; skew 500 ppm
I20260709 13:05:31.531329   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:31.535260   431 webserver.cc:533] Webserver started at http://127.0.107.254:44581/ using document root <none> and password file <none>
I20260709 13:05:31.535925   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:31.536405   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:31.536952   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:31.538244   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601979855482-431-0/minicluster-data/master-0-root/instance:
uuid: "3d16d2bb6db54c5e9b922e7bed56092a"
format_stamp: "Formatted at 2026-07-09 13:05:31 on dist-test-slave-g4pn"
I20260709 13:05:31.543701   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:05:31.547729 12083 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:31.548816   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:05:31.549135   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601979855482-431-0/minicluster-data/master-0-root
uuid: "3d16d2bb6db54c5e9b922e7bed56092a"
format_stamp: "Formatted at 2026-07-09 13:05:31 on dist-test-slave-g4pn"
I20260709 13:05:31.549419   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601979855482-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601979855482-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601979855482-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:31.560892   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:31.562254   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:31.613569   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:37307
I20260709 13:05:31.613940 12134 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:37307 every 8 connection(s)
I20260709 13:05:31.619235 12135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:31.637135 12135 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d16d2bb6db54c5e9b922e7bed56092a: Bootstrap starting.
I20260709 13:05:31.643095 12135 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3d16d2bb6db54c5e9b922e7bed56092a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:31.647852 12135 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d16d2bb6db54c5e9b922e7bed56092a: No bootstrap required, opened a new log
I20260709 13:05:31.650887 12135 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3d16d2bb6db54c5e9b922e7bed56092a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d16d2bb6db54c5e9b922e7bed56092a" member_type: VOTER }
I20260709 13:05:31.651306 12135 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3d16d2bb6db54c5e9b922e7bed56092a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:31.651588 12135 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3d16d2bb6db54c5e9b922e7bed56092a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d16d2bb6db54c5e9b922e7bed56092a, State: Initialized, Role: FOLLOWER
I20260709 13:05:31.652344 12135 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d16d2bb6db54c5e9b922e7bed56092a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d16d2bb6db54c5e9b922e7bed56092a" member_type: VOTER }
I20260709 13:05:31.652885 12135 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3d16d2bb6db54c5e9b922e7bed56092a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:31.653144 12135 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3d16d2bb6db54c5e9b922e7bed56092a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:31.654173 12135 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3d16d2bb6db54c5e9b922e7bed56092a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:31.660851 12135 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3d16d2bb6db54c5e9b922e7bed56092a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d16d2bb6db54c5e9b922e7bed56092a" member_type: VOTER }
I20260709 13:05:31.661573 12135 leader_election.cc:304] T 00000000000000000000000000000000 P 3d16d2bb6db54c5e9b922e7bed56092a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3d16d2bb6db54c5e9b922e7bed56092a; no voters: 
I20260709 13:05:31.662846 12135 leader_election.cc:290] T 00000000000000000000000000000000 P 3d16d2bb6db54c5e9b922e7bed56092a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:31.663254 12138 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3d16d2bb6db54c5e9b922e7bed56092a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:31.664768 12138 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3d16d2bb6db54c5e9b922e7bed56092a [term 1 LEADER]: Becoming Leader. State: Replica: 3d16d2bb6db54c5e9b922e7bed56092a, State: Running, Role: LEADER
I20260709 13:05:31.665535 12138 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3d16d2bb6db54c5e9b922e7bed56092a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d16d2bb6db54c5e9b922e7bed56092a" member_type: VOTER }
I20260709 13:05:31.666116 12135 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3d16d2bb6db54c5e9b922e7bed56092a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:31.670234 12140 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d16d2bb6db54c5e9b922e7bed56092a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d16d2bb6db54c5e9b922e7bed56092a. Latest consensus state: current_term: 1 leader_uuid: "3d16d2bb6db54c5e9b922e7bed56092a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d16d2bb6db54c5e9b922e7bed56092a" member_type: VOTER } }
I20260709 13:05:31.671368 12140 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d16d2bb6db54c5e9b922e7bed56092a [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:31.670212 12139 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d16d2bb6db54c5e9b922e7bed56092a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3d16d2bb6db54c5e9b922e7bed56092a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d16d2bb6db54c5e9b922e7bed56092a" member_type: VOTER } }
I20260709 13:05:31.672640 12139 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d16d2bb6db54c5e9b922e7bed56092a [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:31.675220 12145 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:31.682081 12145 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:31.692162   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:31.695767 12145 catalog_manager.cc:1383] Generated new cluster ID: b259494e98e44907ae8a2e65f2ed7c2c
I20260709 13:05:31.696341 12145 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:31.734879 12145 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:31.738668 12145 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:31.758419 12145 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 3d16d2bb6db54c5e9b922e7bed56092a: Generated new TSK 0
I20260709 13:05:31.759337 12145 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:31.765547   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:31.778106 12156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:31.780180 12157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:31.781733 12159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:31.781811   431 server_base.cc:1061] running on GCE node
I20260709 13:05:31.783198   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:31.783912   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:31.784102   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602331784077 us; error 0 us; skew 500 ppm
I20260709 13:05:31.784683   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:31.789618   431 webserver.cc:533] Webserver started at http://127.0.107.193:36159/ using document root <none> and password file <none>
I20260709 13:05:31.790462   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:31.790882   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:31.791213   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:31.792659   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601979855482-431-0/minicluster-data/ts-0-root/instance:
uuid: "8094d462961742bdbb1b497a71355a24"
format_stamp: "Formatted at 2026-07-09 13:05:31 on dist-test-slave-g4pn"
I20260709 13:05:31.799252   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:05:31.804724 12164 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:31.806140   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
I20260709 13:05:31.806530   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601979855482-431-0/minicluster-data/ts-0-root
uuid: "8094d462961742bdbb1b497a71355a24"
format_stamp: "Formatted at 2026-07-09 13:05:31 on dist-test-slave-g4pn"
I20260709 13:05:31.806860   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601979855482-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601979855482-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601979855482-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:31.822744   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:31.824033   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:31.825947   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:31.828739   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:31.829172   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:05:31.829592   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:31.830080   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.001s	user 0.000s	sys 0.000s
I20260709 13:05:31.905901   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:37607
I20260709 13:05:31.906023 12226 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:37607 every 8 connection(s)
I20260709 13:05:31.911939   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:31.921195 12231 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:31.922225 12232 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:31.929864 12227 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37307
I20260709 13:05:31.930104   431 server_base.cc:1061] running on GCE node
W20260709 13:05:31.929998 12234 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:31.930636 12227 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:31.932435   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:05:31.932592 12227 heartbeater.cc:507] Master 127.0.107.254:37307 requested a full tablet report, sending...
W20260709 13:05:31.932662   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:31.933415   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602331933393 us; error 0 us; skew 500 ppm
I20260709 13:05:31.934247   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:31.937270 12100 ts_manager.cc:194] Registered new tserver with Master: 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607)
I20260709 13:05:31.938362   431 webserver.cc:533] Webserver started at http://127.0.107.194:45905/ using document root <none> and password file <none>
I20260709 13:05:31.939226   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:31.939502   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:31.939815   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:31.940248 12100 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47098
I20260709 13:05:31.941489   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601979855482-431-0/minicluster-data/ts-1-root/instance:
uuid: "c00025c0f6594942bd14688ade17cb0e"
format_stamp: "Formatted at 2026-07-09 13:05:31 on dist-test-slave-g4pn"
I20260709 13:05:31.947834   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:05:31.952740 12239 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:31.954213   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.001s
I20260709 13:05:31.954864   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601979855482-431-0/minicluster-data/ts-1-root
uuid: "c00025c0f6594942bd14688ade17cb0e"
format_stamp: "Formatted at 2026-07-09 13:05:31 on dist-test-slave-g4pn"
I20260709 13:05:31.955452   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601979855482-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601979855482-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601979855482-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:31.990417   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:31.991717   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:31.993569   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:31.996624   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:31.996912   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:31.997512   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:31.997709   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:32.064865   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:37905
I20260709 13:05:32.065368 12301 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:37905 every 8 connection(s)
I20260709 13:05:32.072763   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:32.084061 12305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:32.085500 12306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:32.086632 12302 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37307
I20260709 13:05:32.087544 12302 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:32.089623 12302 heartbeater.cc:507] Master 127.0.107.254:37307 requested a full tablet report, sending...
W20260709 13:05:32.089775 12308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:32.092350   431 server_base.cc:1061] running on GCE node
I20260709 13:05:32.093819   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:05:32.093735 12100 ts_manager.cc:194] Registered new tserver with Master: c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
W20260709 13:05:32.094319   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:32.094563   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602332094542 us; error 0 us; skew 500 ppm
I20260709 13:05:32.095440   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:32.095976 12100 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47100
I20260709 13:05:32.099586   431 webserver.cc:533] Webserver started at http://127.0.107.195:37567/ using document root <none> and password file <none>
I20260709 13:05:32.100152   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:32.100315   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:32.100535   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:32.101761   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601979855482-431-0/minicluster-data/ts-2-root/instance:
uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
format_stamp: "Formatted at 2026-07-09 13:05:32 on dist-test-slave-g4pn"
I20260709 13:05:32.107921   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:05:32.114929 12313 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:32.116065   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 13:05:32.116437   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601979855482-431-0/minicluster-data/ts-2-root
uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
format_stamp: "Formatted at 2026-07-09 13:05:32 on dist-test-slave-g4pn"
I20260709 13:05:32.116712   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601979855482-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601979855482-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskpZK0mr/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601979855482-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:32.139885   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:32.141294   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:32.142935   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:32.145473   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:32.145668   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:32.145943   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:32.146085   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:32.209250 12375 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:34793 every 8 connection(s)
I20260709 13:05:32.208976   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:34793
I20260709 13:05:32.230638 12376 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37307
I20260709 13:05:32.231389 12376 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:32.232766 12376 heartbeater.cc:507] Master 127.0.107.254:37307 requested a full tablet report, sending...
I20260709 13:05:32.236536 12100 ts_manager.cc:194] Registered new tserver with Master: f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:32.237478   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.022441622s
I20260709 13:05:32.238876 12100 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47110
I20260709 13:05:32.270488 12100 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47112:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:32.274158 12100 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:32.364336 12192 tablet_service.cc:1511] Processing CreateTablet for tablet 03a56ae904c84229be46c9d8773eb639 (DEFAULT_TABLE table=test-workload [id=47a1521931ee4b868a5234e9406e0635]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:32.365954 12192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03a56ae904c84229be46c9d8773eb639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.366605 12267 tablet_service.cc:1511] Processing CreateTablet for tablet 03a56ae904c84229be46c9d8773eb639 (DEFAULT_TABLE table=test-workload [id=47a1521931ee4b868a5234e9406e0635]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:32.367874 12191 tablet_service.cc:1511] Processing CreateTablet for tablet 6cb3962ca7144e23a7f8e13cb66c5691 (DEFAULT_TABLE table=test-workload [id=47a1521931ee4b868a5234e9406e0635]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:32.368453 12267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03a56ae904c84229be46c9d8773eb639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.369575 12191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cb3962ca7144e23a7f8e13cb66c5691. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.370033 12190 tablet_service.cc:1511] Processing CreateTablet for tablet 4c030549c2814e2b949de006d26f5514 (DEFAULT_TABLE table=test-workload [id=47a1521931ee4b868a5234e9406e0635]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:32.371927 12190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c030549c2814e2b949de006d26f5514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.376662 12266 tablet_service.cc:1511] Processing CreateTablet for tablet 6cb3962ca7144e23a7f8e13cb66c5691 (DEFAULT_TABLE table=test-workload [id=47a1521931ee4b868a5234e9406e0635]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:32.379117 12266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cb3962ca7144e23a7f8e13cb66c5691. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.381960 12265 tablet_service.cc:1511] Processing CreateTablet for tablet 4c030549c2814e2b949de006d26f5514 (DEFAULT_TABLE table=test-workload [id=47a1521931ee4b868a5234e9406e0635]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:32.389513 12265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c030549c2814e2b949de006d26f5514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.400933 12340 tablet_service.cc:1511] Processing CreateTablet for tablet 6cb3962ca7144e23a7f8e13cb66c5691 (DEFAULT_TABLE table=test-workload [id=47a1521931ee4b868a5234e9406e0635]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:32.405463 12340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cb3962ca7144e23a7f8e13cb66c5691. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.400964 12341 tablet_service.cc:1511] Processing CreateTablet for tablet 03a56ae904c84229be46c9d8773eb639 (DEFAULT_TABLE table=test-workload [id=47a1521931ee4b868a5234e9406e0635]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:32.406867 12341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03a56ae904c84229be46c9d8773eb639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.404873 12189 tablet_service.cc:1511] Processing CreateTablet for tablet 33f0e3ad1e4344cf8177322fec690c78 (DEFAULT_TABLE table=test-workload [id=47a1521931ee4b868a5234e9406e0635]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:32.412536 12189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33f0e3ad1e4344cf8177322fec690c78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.415132 12264 tablet_service.cc:1511] Processing CreateTablet for tablet 33f0e3ad1e4344cf8177322fec690c78 (DEFAULT_TABLE table=test-workload [id=47a1521931ee4b868a5234e9406e0635]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:32.410867 12339 tablet_service.cc:1511] Processing CreateTablet for tablet 4c030549c2814e2b949de006d26f5514 (DEFAULT_TABLE table=test-workload [id=47a1521931ee4b868a5234e9406e0635]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:32.416857 12264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33f0e3ad1e4344cf8177322fec690c78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.418329 12339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c030549c2814e2b949de006d26f5514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.427413 12394 tablet_bootstrap.cc:492] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24: Bootstrap starting.
I20260709 13:05:32.435235 12338 tablet_service.cc:1511] Processing CreateTablet for tablet 33f0e3ad1e4344cf8177322fec690c78 (DEFAULT_TABLE table=test-workload [id=47a1521931ee4b868a5234e9406e0635]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:32.437356 12338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33f0e3ad1e4344cf8177322fec690c78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.441147 12394 tablet_bootstrap.cc:654] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.458009 12191 tablet_service.cc:1511] Processing CreateTablet for tablet c53cb67f3c6240549cb8672a5d254db7 (DEFAULT_TABLE table=test-workload [id=47a1521931ee4b868a5234e9406e0635]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:32.459848 12191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c53cb67f3c6240549cb8672a5d254db7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.463786 12263 tablet_service.cc:1511] Processing CreateTablet for tablet c53cb67f3c6240549cb8672a5d254db7 (DEFAULT_TABLE table=test-workload [id=47a1521931ee4b868a5234e9406e0635]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:32.466979 12263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c53cb67f3c6240549cb8672a5d254db7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.491621 12396 tablet_bootstrap.cc:492] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e: Bootstrap starting.
I20260709 13:05:32.500337 12394 tablet_bootstrap.cc:492] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24: No bootstrap required, opened a new log
I20260709 13:05:32.504115 12337 tablet_service.cc:1511] Processing CreateTablet for tablet c53cb67f3c6240549cb8672a5d254db7 (DEFAULT_TABLE table=test-workload [id=47a1521931ee4b868a5234e9406e0635]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:32.505752 12337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c53cb67f3c6240549cb8672a5d254db7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.505676 12190 tablet_service.cc:1511] Processing CreateTablet for tablet aea38e5274ba452894df20a69755dbda (DEFAULT_TABLE table=test-workload [id=47a1521931ee4b868a5234e9406e0635]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:32.507834 12190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aea38e5274ba452894df20a69755dbda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.507206 12266 tablet_service.cc:1511] Processing CreateTablet for tablet aea38e5274ba452894df20a69755dbda (DEFAULT_TABLE table=test-workload [id=47a1521931ee4b868a5234e9406e0635]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:32.509451 12394 ts_tablet_manager.cc:1403] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24: Time spent bootstrapping tablet: real 0.074s	user 0.016s	sys 0.010s
I20260709 13:05:32.509676 12266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aea38e5274ba452894df20a69755dbda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.513895 12336 tablet_service.cc:1511] Processing CreateTablet for tablet aea38e5274ba452894df20a69755dbda (DEFAULT_TABLE table=test-workload [id=47a1521931ee4b868a5234e9406e0635]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:32.515522 12336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aea38e5274ba452894df20a69755dbda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.534242 12189 tablet_service.cc:1511] Processing CreateTablet for tablet 0051bc6e9d314fcca7be8439e6fa998f (DEFAULT_TABLE table=test-workload [id=47a1521931ee4b868a5234e9406e0635]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:32.536495 12189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0051bc6e9d314fcca7be8439e6fa998f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.548521 12394 raft_consensus.cc:359] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:32.549723 12394 raft_consensus.cc:385] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.550384 12397 tablet_bootstrap.cc:492] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Bootstrap starting.
I20260709 13:05:32.554795 12394 raft_consensus.cc:740] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.556731 12394 consensus_queue.cc:260] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:32.553905 12396 tablet_bootstrap.cc:654] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.559633 12266 tablet_service.cc:1511] Processing CreateTablet for tablet 0051bc6e9d314fcca7be8439e6fa998f (DEFAULT_TABLE table=test-workload [id=47a1521931ee4b868a5234e9406e0635]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:32.563373 12397 tablet_bootstrap.cc:654] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.566419 12266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0051bc6e9d314fcca7be8439e6fa998f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.567876 12339 tablet_service.cc:1511] Processing CreateTablet for tablet 0051bc6e9d314fcca7be8439e6fa998f (DEFAULT_TABLE table=test-workload [id=47a1521931ee4b868a5234e9406e0635]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:32.569933 12339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0051bc6e9d314fcca7be8439e6fa998f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.582106 12189 tablet_service.cc:1511] Processing CreateTablet for tablet f3beb77c94044e94a8cf4318a473a13b (DEFAULT_TABLE table=test-workload [id=47a1521931ee4b868a5234e9406e0635]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:32.586094 12264 tablet_service.cc:1511] Processing CreateTablet for tablet f3beb77c94044e94a8cf4318a473a13b (DEFAULT_TABLE table=test-workload [id=47a1521931ee4b868a5234e9406e0635]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:32.598351 12189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3beb77c94044e94a8cf4318a473a13b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.599846 12264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3beb77c94044e94a8cf4318a473a13b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.607374 12397 tablet_bootstrap.cc:492] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: No bootstrap required, opened a new log
I20260709 13:05:32.610097 12397 ts_tablet_manager.cc:1403] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Time spent bootstrapping tablet: real 0.060s	user 0.019s	sys 0.015s
I20260709 13:05:32.610292 12227 heartbeater.cc:499] Master 127.0.107.254:37307 was elected leader, sending a full tablet report...
I20260709 13:05:32.611173 12396 tablet_bootstrap.cc:492] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e: No bootstrap required, opened a new log
I20260709 13:05:32.612779 12396 ts_tablet_manager.cc:1403] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e: Time spent bootstrapping tablet: real 0.122s	user 0.024s	sys 0.020s
I20260709 13:05:32.610304 12394 ts_tablet_manager.cc:1434] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24: Time spent starting tablet: real 0.100s	user 0.013s	sys 0.007s
I20260709 13:05:32.616741 12397 raft_consensus.cc:359] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:32.618772 12397 raft_consensus.cc:385] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.619246 12397 raft_consensus.cc:740] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.619616 12394 tablet_bootstrap.cc:492] T 03a56ae904c84229be46c9d8773eb639 P 8094d462961742bdbb1b497a71355a24: Bootstrap starting.
I20260709 13:05:32.620537 12396 raft_consensus.cc:359] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:32.622156 12396 raft_consensus.cc:385] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.622702 12396 raft_consensus.cc:740] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.620213 12397 consensus_queue.cc:260] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:32.697964 12396 consensus_queue.cc:260] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
W20260709 13:05:32.667943 12228 tablet.cc:2406] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:05:32.682559 12191 tablet_service.cc:1511] Processing CreateTablet for tablet 20eda87dc6e642ad8791304d782e09a1 (DEFAULT_TABLE table=test-workload [id=47a1521931ee4b868a5234e9406e0635]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
W20260709 13:05:32.683542 12148 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:32.683140 12263 tablet_service.cc:1511] Processing CreateTablet for tablet 20eda87dc6e642ad8791304d782e09a1 (DEFAULT_TABLE table=test-workload [id=47a1521931ee4b868a5234e9406e0635]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:32.709606 12263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20eda87dc6e642ad8791304d782e09a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.706249 12191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20eda87dc6e642ad8791304d782e09a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.706400 12338 tablet_service.cc:1511] Processing CreateTablet for tablet 20eda87dc6e642ad8791304d782e09a1 (DEFAULT_TABLE table=test-workload [id=47a1521931ee4b868a5234e9406e0635]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:32.716563 12338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20eda87dc6e642ad8791304d782e09a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.703936 12336 tablet_service.cc:1511] Processing CreateTablet for tablet f3beb77c94044e94a8cf4318a473a13b (DEFAULT_TABLE table=test-workload [id=47a1521931ee4b868a5234e9406e0635]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:32.721124 12336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3beb77c94044e94a8cf4318a473a13b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.732576 12399 raft_consensus.cc:493] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.735126 12399 raft_consensus.cc:515] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:32.741344 12376 heartbeater.cc:499] Master 127.0.107.254:37307 was elected leader, sending a full tablet report...
I20260709 13:05:32.741459 12394 tablet_bootstrap.cc:654] T 03a56ae904c84229be46c9d8773eb639 P 8094d462961742bdbb1b497a71355a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.748816 12403 raft_consensus.cc:493] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.755990 12399 leader_election.cc:290] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:32.758957 12403 raft_consensus.cc:515] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:32.791363 12396 ts_tablet_manager.cc:1434] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e: Time spent starting tablet: real 0.178s	user 0.030s	sys 0.012s
I20260709 13:05:32.793915 12302 heartbeater.cc:499] Master 127.0.107.254:37307 was elected leader, sending a full tablet report...
I20260709 13:05:32.798740 12403 leader_election.cc:290] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:32.799782 12397 ts_tablet_manager.cc:1434] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Time spent starting tablet: real 0.189s	user 0.013s	sys 0.021s
I20260709 13:05:32.797701 12396 tablet_bootstrap.cc:492] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e: Bootstrap starting.
I20260709 13:05:32.817844 12394 tablet_bootstrap.cc:492] T 03a56ae904c84229be46c9d8773eb639 P 8094d462961742bdbb1b497a71355a24: No bootstrap required, opened a new log
I20260709 13:05:32.819336 12394 ts_tablet_manager.cc:1403] T 03a56ae904c84229be46c9d8773eb639 P 8094d462961742bdbb1b497a71355a24: Time spent bootstrapping tablet: real 0.200s	user 0.023s	sys 0.006s
I20260709 13:05:32.823215 12397 tablet_bootstrap.cc:492] T 03a56ae904c84229be46c9d8773eb639 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Bootstrap starting.
I20260709 13:05:32.843642 12402 raft_consensus.cc:493] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.858335 12397 tablet_bootstrap.cc:654] T 03a56ae904c84229be46c9d8773eb639 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.857690 12402 raft_consensus.cc:515] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:32.896484 12394 raft_consensus.cc:359] T 03a56ae904c84229be46c9d8773eb639 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:32.897776 12394 raft_consensus.cc:385] T 03a56ae904c84229be46c9d8773eb639 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.898345 12394 raft_consensus.cc:740] T 03a56ae904c84229be46c9d8773eb639 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.935000 12402 leader_election.cc:290] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:32.957293 12396 tablet_bootstrap.cc:654] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.957384 12277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f0e3ad1e4344cf8177322fec690c78" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
W20260709 13:05:32.964650 12314 leader_election.cc:343] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:32.942591 12394 consensus_queue.cc:260] T 03a56ae904c84229be46c9d8773eb639 P 8094d462961742bdbb1b497a71355a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:32.977906 12277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb3962ca7144e23a7f8e13cb66c5691" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:32.982978 12202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f0e3ad1e4344cf8177322fec690c78" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
W20260709 13:05:32.985414 12165 leader_election.cc:343] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:32.987170 12317 leader_election.cc:343] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:32.987758 12317 leader_election.cc:304] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:32.989760 12403 raft_consensus.cc:2749] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:32.990293 12351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb3962ca7144e23a7f8e13cb66c5691" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:32.990777 12394 ts_tablet_manager.cc:1434] T 03a56ae904c84229be46c9d8773eb639 P 8094d462961742bdbb1b497a71355a24: Time spent starting tablet: real 0.171s	user 0.011s	sys 0.001s
W20260709 13:05:32.992075 12165 leader_election.cc:343] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:32.992607 12394 tablet_bootstrap.cc:492] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24: Bootstrap starting.
I20260709 13:05:32.992584 12165 leader_election.cc:304] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8094d462961742bdbb1b497a71355a24; no voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:32.997030 12399 raft_consensus.cc:2749] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:32.998775 12396 tablet_bootstrap.cc:492] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e: No bootstrap required, opened a new log
I20260709 13:05:32.999428 12396 ts_tablet_manager.cc:1403] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e: Time spent bootstrapping tablet: real 0.202s	user 0.018s	sys 0.004s
I20260709 13:05:33.003837 12397 tablet_bootstrap.cc:492] T 03a56ae904c84229be46c9d8773eb639 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: No bootstrap required, opened a new log
I20260709 13:05:33.004567 12397 ts_tablet_manager.cc:1403] T 03a56ae904c84229be46c9d8773eb639 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Time spent bootstrapping tablet: real 0.182s	user 0.014s	sys 0.010s
I20260709 13:05:33.009846 12397 raft_consensus.cc:359] T 03a56ae904c84229be46c9d8773eb639 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.010830 12397 raft_consensus.cc:385] T 03a56ae904c84229be46c9d8773eb639 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.011216 12397 raft_consensus.cc:740] T 03a56ae904c84229be46c9d8773eb639 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.012367 12397 consensus_queue.cc:260] T 03a56ae904c84229be46c9d8773eb639 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.011343 12394 tablet_bootstrap.cc:654] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:33.015105 12397 ts_tablet_manager.cc:1434] T 03a56ae904c84229be46c9d8773eb639 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:05:33.019215 12202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a56ae904c84229be46c9d8773eb639" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:33.019315 12351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a56ae904c84229be46c9d8773eb639" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:33.012974 12396 raft_consensus.cc:359] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.020639 12396 raft_consensus.cc:385] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.020347 12351 raft_consensus.cc:2468] T 03a56ae904c84229be46c9d8773eb639 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 0.
I20260709 13:05:33.021016 12396 raft_consensus.cc:740] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.020349 12202 raft_consensus.cc:2468] T 03a56ae904c84229be46c9d8773eb639 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 0.
I20260709 13:05:33.022657 12240 leader_election.cc:304] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 
I20260709 13:05:33.022996 12397 tablet_bootstrap.cc:492] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Bootstrap starting.
I20260709 13:05:33.024252 12402 raft_consensus.cc:2804] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:33.024652 12402 raft_consensus.cc:493] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.025274 12402 raft_consensus.cc:3060] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.025617 12396 consensus_queue.cc:260] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.033418 12397 tablet_bootstrap.cc:654] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:33.036583 12402 raft_consensus.cc:515] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.038300 12394 tablet_bootstrap.cc:492] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24: No bootstrap required, opened a new log
I20260709 13:05:33.039247 12396 ts_tablet_manager.cc:1434] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.008s
I20260709 13:05:33.040517 12202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a56ae904c84229be46c9d8773eb639" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24"
I20260709 13:05:33.041240 12202 raft_consensus.cc:3060] T 03a56ae904c84229be46c9d8773eb639 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.041577 12402 leader_election.cc:290] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 election: Requested vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:33.039480 12394 ts_tablet_manager.cc:1403] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.009s
I20260709 13:05:33.042644 12351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a56ae904c84229be46c9d8773eb639" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
I20260709 13:05:33.043326 12351 raft_consensus.cc:3060] T 03a56ae904c84229be46c9d8773eb639 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.045665 12394 raft_consensus.cc:359] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.046546 12394 raft_consensus.cc:385] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.053013 12396 tablet_bootstrap.cc:492] T 4c030549c2814e2b949de006d26f5514 P c00025c0f6594942bd14688ade17cb0e: Bootstrap starting.
I20260709 13:05:33.055655 12202 raft_consensus.cc:2468] T 03a56ae904c84229be46c9d8773eb639 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 1.
I20260709 13:05:33.057982 12351 raft_consensus.cc:2468] T 03a56ae904c84229be46c9d8773eb639 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 1.
I20260709 13:05:33.046864 12394 raft_consensus.cc:740] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.058585 12397 tablet_bootstrap.cc:492] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: No bootstrap required, opened a new log
I20260709 13:05:33.058516 12243 leader_election.cc:304] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e; no voters: 
I20260709 13:05:33.059376 12397 ts_tablet_manager.cc:1403] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Time spent bootstrapping tablet: real 0.037s	user 0.022s	sys 0.003s
I20260709 13:05:33.059731 12402 raft_consensus.cc:2804] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:33.059612 12394 consensus_queue.cc:260] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.060319 12402 raft_consensus.cc:697] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e [term 1 LEADER]: Becoming Leader. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Running, Role: LEADER
I20260709 13:05:33.061339 12402 consensus_queue.cc:237] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.063045 12394 ts_tablet_manager.cc:1434] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 13:05:33.063787 12397 raft_consensus.cc:359] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.064462 12394 tablet_bootstrap.cc:492] T 4c030549c2814e2b949de006d26f5514 P 8094d462961742bdbb1b497a71355a24: Bootstrap starting.
I20260709 13:05:33.064795 12397 raft_consensus.cc:385] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.065233 12397 raft_consensus.cc:740] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.066313 12397 consensus_queue.cc:260] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.071213 12397 ts_tablet_manager.cc:1434] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:05:33.073311 12397 tablet_bootstrap.cc:492] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Bootstrap starting.
I20260709 13:05:33.073459 12396 tablet_bootstrap.cc:654] T 4c030549c2814e2b949de006d26f5514 P c00025c0f6594942bd14688ade17cb0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:33.082180 12394 tablet_bootstrap.cc:654] T 4c030549c2814e2b949de006d26f5514 P 8094d462961742bdbb1b497a71355a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:33.082998 12397 tablet_bootstrap.cc:654] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:33.091689 12402 raft_consensus.cc:493] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.092689 12402 raft_consensus.cc:515] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.096738 12402 leader_election.cc:290] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:33.098213 12202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb3962ca7144e23a7f8e13cb66c5691" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:33.098824 12351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb3962ca7144e23a7f8e13cb66c5691" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:33.099225 12202 raft_consensus.cc:2468] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 0.
I20260709 13:05:33.099980 12351 raft_consensus.cc:2468] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 0.
I20260709 13:05:33.102133 12240 leader_election.cc:304] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 
I20260709 13:05:33.101270 12098 catalog_manager.cc:5697] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e reported cstate change: term changed from 0 to 1, leader changed from <none> to c00025c0f6594942bd14688ade17cb0e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c00025c0f6594942bd14688ade17cb0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:33.103679 12402 raft_consensus.cc:2804] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:33.104318 12402 raft_consensus.cc:493] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.104835 12402 raft_consensus.cc:3060] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.117571 12397 tablet_bootstrap.cc:492] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: No bootstrap required, opened a new log
I20260709 13:05:33.122089 12397 ts_tablet_manager.cc:1403] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.005s
I20260709 13:05:33.125855 12396 tablet_bootstrap.cc:492] T 4c030549c2814e2b949de006d26f5514 P c00025c0f6594942bd14688ade17cb0e: No bootstrap required, opened a new log
I20260709 13:05:33.127287 12397 raft_consensus.cc:359] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.128445 12396 ts_tablet_manager.cc:1403] T 4c030549c2814e2b949de006d26f5514 P c00025c0f6594942bd14688ade17cb0e: Time spent bootstrapping tablet: real 0.076s	user 0.016s	sys 0.012s
I20260709 13:05:33.128470 12397 raft_consensus.cc:385] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.131099 12397 raft_consensus.cc:740] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.131250 12402 raft_consensus.cc:515] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.132472 12397 consensus_queue.cc:260] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.134159 12396 raft_consensus.cc:359] T 4c030549c2814e2b949de006d26f5514 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.135396 12396 raft_consensus.cc:385] T 4c030549c2814e2b949de006d26f5514 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.136675 12351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb3962ca7144e23a7f8e13cb66c5691" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
I20260709 13:05:33.135782 12397 ts_tablet_manager.cc:1434] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.004s
I20260709 13:05:33.137595 12351 raft_consensus.cc:3060] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.139112 12397 tablet_bootstrap.cc:492] T 4c030549c2814e2b949de006d26f5514 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Bootstrap starting.
I20260709 13:05:33.140435 12394 tablet_bootstrap.cc:492] T 4c030549c2814e2b949de006d26f5514 P 8094d462961742bdbb1b497a71355a24: No bootstrap required, opened a new log
I20260709 13:05:33.141433 12402 leader_election.cc:290] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 election: Requested vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:33.141510 12202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb3962ca7144e23a7f8e13cb66c5691" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24"
I20260709 13:05:33.141155 12394 ts_tablet_manager.cc:1403] T 4c030549c2814e2b949de006d26f5514 P 8094d462961742bdbb1b497a71355a24: Time spent bootstrapping tablet: real 0.077s	user 0.024s	sys 0.023s
I20260709 13:05:33.142262 12202 raft_consensus.cc:3060] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.145443 12394 raft_consensus.cc:359] T 4c030549c2814e2b949de006d26f5514 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.146366 12394 raft_consensus.cc:385] T 4c030549c2814e2b949de006d26f5514 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.146687 12394 raft_consensus.cc:740] T 4c030549c2814e2b949de006d26f5514 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.147224 12351 raft_consensus.cc:2468] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 1.
I20260709 13:05:33.147673 12397 tablet_bootstrap.cc:654] T 4c030549c2814e2b949de006d26f5514 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:33.147588 12394 consensus_queue.cc:260] T 4c030549c2814e2b949de006d26f5514 P 8094d462961742bdbb1b497a71355a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.135787 12396 raft_consensus.cc:740] T 4c030549c2814e2b949de006d26f5514 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.149370 12240 leader_election.cc:304] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 
I20260709 13:05:33.149586 12396 consensus_queue.cc:260] T 4c030549c2814e2b949de006d26f5514 P c00025c0f6594942bd14688ade17cb0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.151278 12417 raft_consensus.cc:2804] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:33.151727 12394 ts_tablet_manager.cc:1434] T 4c030549c2814e2b949de006d26f5514 P 8094d462961742bdbb1b497a71355a24: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:05:33.153421 12394 tablet_bootstrap.cc:492] T aea38e5274ba452894df20a69755dbda P 8094d462961742bdbb1b497a71355a24: Bootstrap starting.
I20260709 13:05:33.168820 12394 tablet_bootstrap.cc:654] T aea38e5274ba452894df20a69755dbda P 8094d462961742bdbb1b497a71355a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:33.171663 12202 raft_consensus.cc:2468] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 1.
I20260709 13:05:33.176728 12396 ts_tablet_manager.cc:1434] T 4c030549c2814e2b949de006d26f5514 P c00025c0f6594942bd14688ade17cb0e: Time spent starting tablet: real 0.047s	user 0.010s	sys 0.000s
I20260709 13:05:33.178539 12396 tablet_bootstrap.cc:492] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e: Bootstrap starting.
I20260709 13:05:33.179529 12394 tablet_bootstrap.cc:492] T aea38e5274ba452894df20a69755dbda P 8094d462961742bdbb1b497a71355a24: No bootstrap required, opened a new log
I20260709 13:05:33.180212 12394 ts_tablet_manager.cc:1403] T aea38e5274ba452894df20a69755dbda P 8094d462961742bdbb1b497a71355a24: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.000s
I20260709 13:05:33.488644 12397 tablet_bootstrap.cc:492] T 4c030549c2814e2b949de006d26f5514 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: No bootstrap required, opened a new log
I20260709 13:05:33.490347 12397 ts_tablet_manager.cc:1403] T 4c030549c2814e2b949de006d26f5514 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Time spent bootstrapping tablet: real 0.352s	user 0.020s	sys 0.020s
I20260709 13:05:33.496088 12397 raft_consensus.cc:359] T 4c030549c2814e2b949de006d26f5514 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.497409 12397 raft_consensus.cc:385] T 4c030549c2814e2b949de006d26f5514 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.497758 12397 raft_consensus.cc:740] T 4c030549c2814e2b949de006d26f5514 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.498586 12417 raft_consensus.cc:697] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [term 1 LEADER]: Becoming Leader. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Running, Role: LEADER
I20260709 13:05:33.499792 12417 consensus_queue.cc:237] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.499228 12397 consensus_queue.cc:260] T 4c030549c2814e2b949de006d26f5514 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.506299 12397 ts_tablet_manager.cc:1434] T 4c030549c2814e2b949de006d26f5514 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:05:33.508028 12397 tablet_bootstrap.cc:492] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Bootstrap starting.
I20260709 13:05:33.521008 12397 tablet_bootstrap.cc:654] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:33.524961 12394 raft_consensus.cc:359] T aea38e5274ba452894df20a69755dbda P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.526423 12394 raft_consensus.cc:385] T aea38e5274ba452894df20a69755dbda P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.526779 12394 raft_consensus.cc:740] T aea38e5274ba452894df20a69755dbda P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.527647 12394 consensus_queue.cc:260] T aea38e5274ba452894df20a69755dbda P 8094d462961742bdbb1b497a71355a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.531490 12394 ts_tablet_manager.cc:1434] T aea38e5274ba452894df20a69755dbda P 8094d462961742bdbb1b497a71355a24: Time spent starting tablet: real 0.351s	user 0.027s	sys 0.010s
I20260709 13:05:33.536799 12394 tablet_bootstrap.cc:492] T c53cb67f3c6240549cb8672a5d254db7 P 8094d462961742bdbb1b497a71355a24: Bootstrap starting.
I20260709 13:05:33.539673 12397 tablet_bootstrap.cc:492] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4: No bootstrap required, opened a new log
I20260709 13:05:33.540350 12397 ts_tablet_manager.cc:1403] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.005s
I20260709 13:05:33.544538 12397 raft_consensus.cc:359] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.545387 12397 raft_consensus.cc:385] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.545691 12397 raft_consensus.cc:740] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.546061 12394 tablet_bootstrap.cc:654] T c53cb67f3c6240549cb8672a5d254db7 P 8094d462961742bdbb1b497a71355a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:33.546502 12399 raft_consensus.cc:493] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.546463 12397 consensus_queue.cc:260] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.547283 12399 raft_consensus.cc:515] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.550031 12397 ts_tablet_manager.cc:1434] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:05:33.552649 12399 leader_election.cc:290] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:33.554271 12397 tablet_bootstrap.cc:492] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Bootstrap starting.
I20260709 13:05:33.560397 12277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f0e3ad1e4344cf8177322fec690c78" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:33.560779 12394 tablet_bootstrap.cc:492] T c53cb67f3c6240549cb8672a5d254db7 P 8094d462961742bdbb1b497a71355a24: No bootstrap required, opened a new log
I20260709 13:05:33.561578 12394 ts_tablet_manager.cc:1403] T c53cb67f3c6240549cb8672a5d254db7 P 8094d462961742bdbb1b497a71355a24: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.003s
I20260709 13:05:33.563359 12397 tablet_bootstrap.cc:654] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:33.565304 12394 raft_consensus.cc:359] T c53cb67f3c6240549cb8672a5d254db7 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.566318 12394 raft_consensus.cc:385] T c53cb67f3c6240549cb8672a5d254db7 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:05:33.566360 12165 leader_election.cc:343] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:33.566892 12394 raft_consensus.cc:740] T c53cb67f3c6240549cb8672a5d254db7 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.567991 12394 consensus_queue.cc:260] T c53cb67f3c6240549cb8672a5d254db7 P 8094d462961742bdbb1b497a71355a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.574728 12394 ts_tablet_manager.cc:1434] T c53cb67f3c6240549cb8672a5d254db7 P 8094d462961742bdbb1b497a71355a24: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.004s
I20260709 13:05:33.576356 12394 tablet_bootstrap.cc:492] T 0051bc6e9d314fcca7be8439e6fa998f P 8094d462961742bdbb1b497a71355a24: Bootstrap starting.
I20260709 13:05:33.578359 12397 tablet_bootstrap.cc:492] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4: No bootstrap required, opened a new log
I20260709 13:05:33.579067 12397 ts_tablet_manager.cc:1403] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Time spent bootstrapping tablet: real 0.027s	user 0.021s	sys 0.003s
I20260709 13:05:33.582924 12397 raft_consensus.cc:359] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.583912 12397 raft_consensus.cc:385] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.584308 12397 raft_consensus.cc:740] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.585573 12394 tablet_bootstrap.cc:654] T 0051bc6e9d314fcca7be8439e6fa998f P 8094d462961742bdbb1b497a71355a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:33.585183 12397 consensus_queue.cc:260] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.587908 12397 ts_tablet_manager.cc:1434] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:33.589560 12397 tablet_bootstrap.cc:492] T 20eda87dc6e642ad8791304d782e09a1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Bootstrap starting.
I20260709 13:05:33.596068 12399 raft_consensus.cc:493] T 4c030549c2814e2b949de006d26f5514 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.597117 12399 raft_consensus.cc:515] T 4c030549c2814e2b949de006d26f5514 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.598608 12394 tablet_bootstrap.cc:492] T 0051bc6e9d314fcca7be8439e6fa998f P 8094d462961742bdbb1b497a71355a24: No bootstrap required, opened a new log
I20260709 13:05:33.599226 12397 tablet_bootstrap.cc:654] T 20eda87dc6e642ad8791304d782e09a1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:33.599999 12394 ts_tablet_manager.cc:1403] T 0051bc6e9d314fcca7be8439e6fa998f P 8094d462961742bdbb1b497a71355a24: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.009s
I20260709 13:05:33.600270 12399 leader_election.cc:290] T 4c030549c2814e2b949de006d26f5514 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:33.602072 12277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c030549c2814e2b949de006d26f5514" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:33.602970 12277 raft_consensus.cc:2468] T 4c030549c2814e2b949de006d26f5514 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 0.
I20260709 13:05:33.603919 12394 raft_consensus.cc:359] T 0051bc6e9d314fcca7be8439e6fa998f P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.605206 12394 raft_consensus.cc:385] T 0051bc6e9d314fcca7be8439e6fa998f P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.605252 12165 leader_election.cc:304] T 4c030549c2814e2b949de006d26f5514 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e; no voters: 
I20260709 13:05:33.605901 12394 raft_consensus.cc:740] T 0051bc6e9d314fcca7be8439e6fa998f P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.607054 12394 consensus_queue.cc:260] T 0051bc6e9d314fcca7be8439e6fa998f P 8094d462961742bdbb1b497a71355a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.610304 12399 raft_consensus.cc:2804] T 4c030549c2814e2b949de006d26f5514 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:33.610751 12399 raft_consensus.cc:493] T 4c030549c2814e2b949de006d26f5514 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.611092 12399 raft_consensus.cc:3060] T 4c030549c2814e2b949de006d26f5514 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.616637 12403 raft_consensus.cc:493] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.618325 12351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f0e3ad1e4344cf8177322fec690c78" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:33.619403 12351 raft_consensus.cc:2468] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 0.
I20260709 13:05:33.620234 12403 raft_consensus.cc:515] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.625761 12350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c030549c2814e2b949de006d26f5514" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:33.633303 12396 tablet_bootstrap.cc:654] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:33.632953 12350 raft_consensus.cc:2468] T 4c030549c2814e2b949de006d26f5514 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 0.
I20260709 13:05:33.637522 12397 tablet_bootstrap.cc:492] T 20eda87dc6e642ad8791304d782e09a1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: No bootstrap required, opened a new log
I20260709 13:05:33.637781 12165 leader_election.cc:304] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:33.638391 12397 ts_tablet_manager.cc:1403] T 20eda87dc6e642ad8791304d782e09a1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Time spent bootstrapping tablet: real 0.049s	user 0.020s	sys 0.013s
I20260709 13:05:33.641685 12202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53cb67f3c6240549cb8672a5d254db7" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:33.642261 12394 ts_tablet_manager.cc:1434] T 0051bc6e9d314fcca7be8439e6fa998f P 8094d462961742bdbb1b497a71355a24: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.012s
I20260709 13:05:33.642787 12397 raft_consensus.cc:359] T 20eda87dc6e642ad8791304d782e09a1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.643661 12397 raft_consensus.cc:385] T 20eda87dc6e642ad8791304d782e09a1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.643951 12397 raft_consensus.cc:740] T 20eda87dc6e642ad8791304d782e09a1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.642470 12202 raft_consensus.cc:2468] T c53cb67f3c6240549cb8672a5d254db7 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in term 0.
I20260709 13:05:33.645357 12394 tablet_bootstrap.cc:492] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24: Bootstrap starting.
I20260709 13:05:33.645174 12397 consensus_queue.cc:260] T 20eda87dc6e642ad8791304d782e09a1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.652103 12317 leader_election.cc:304] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 
I20260709 13:05:33.652822 12435 raft_consensus.cc:2804] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:33.653522 12435 raft_consensus.cc:493] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.654049 12435 raft_consensus.cc:3060] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.658630 12394 tablet_bootstrap.cc:654] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:33.675176 12417 consensus_queue.cc:1048] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:33.680048 12396 tablet_bootstrap.cc:492] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e: No bootstrap required, opened a new log
I20260709 13:05:33.680927 12396 ts_tablet_manager.cc:1403] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e: Time spent bootstrapping tablet: real 0.503s	user 0.013s	sys 0.007s
I20260709 13:05:33.647660 12399 raft_consensus.cc:515] T 4c030549c2814e2b949de006d26f5514 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.684978 12277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c030549c2814e2b949de006d26f5514" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
I20260709 13:05:33.685897 12277 raft_consensus.cc:3060] T 4c030549c2814e2b949de006d26f5514 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.688419 12396 raft_consensus.cc:359] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.689800 12396 raft_consensus.cc:385] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.690358 12396 raft_consensus.cc:740] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.696007 12439 raft_consensus.cc:2804] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:33.696566 12439 raft_consensus.cc:493] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.697554 12439 raft_consensus.cc:3060] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.697763 12100 catalog_manager.cc:5697] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e reported cstate change: term changed from 0 to 1, leader changed from <none> to c00025c0f6594942bd14688ade17cb0e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c00025c0f6594942bd14688ade17cb0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:33.699066 12399 leader_election.cc:290] T 4c030549c2814e2b949de006d26f5514 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 election: Requested vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:33.701787 12403 leader_election.cc:290] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:33.703116 12403 raft_consensus.cc:493] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.703699 12276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53cb67f3c6240549cb8672a5d254db7" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:33.703896 12403 raft_consensus.cc:515] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
W20260709 13:05:33.710216 12148 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:33.713594 12439 raft_consensus.cc:515] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.718722 12424 consensus_queue.cc:1048] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:33.720319 12394 tablet_bootstrap.cc:492] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24: No bootstrap required, opened a new log
I20260709 13:05:33.722725 12275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53cb67f3c6240549cb8672a5d254db7" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
I20260709 13:05:33.723212 12277 raft_consensus.cc:2468] T 4c030549c2814e2b949de006d26f5514 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 1.
I20260709 13:05:33.724092 12397 ts_tablet_manager.cc:1434] T 20eda87dc6e642ad8791304d782e09a1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Time spent starting tablet: real 0.085s	user 0.025s	sys 0.041s
I20260709 13:05:33.725494 12165 leader_election.cc:304] T 4c030549c2814e2b949de006d26f5514 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e; no voters: 
I20260709 13:05:33.725670 12397 tablet_bootstrap.cc:492] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Bootstrap starting.
I20260709 13:05:33.726634 12403 leader_election.cc:290] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:33.721107 12394 ts_tablet_manager.cc:1403] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24: Time spent bootstrapping tablet: real 0.076s	user 0.016s	sys 0.005s
I20260709 13:05:33.727416 12396 consensus_queue.cc:260] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.732375 12394 raft_consensus.cc:359] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.732781 12276 raft_consensus.cc:2468] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in term 0.
I20260709 13:05:33.733177 12394 raft_consensus.cc:385] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.733518 12394 raft_consensus.cc:740] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.734426 12394 consensus_queue.cc:260] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.734866 12397 tablet_bootstrap.cc:654] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:33.736690 12394 ts_tablet_manager.cc:1434] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:05:33.737963 12417 raft_consensus.cc:493] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.738474 12439 leader_election.cc:290] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 election: Requested vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:33.738807 12417 raft_consensus.cc:515] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.739982 12277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea38e5274ba452894df20a69755dbda" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
W20260709 13:05:33.741649 12314 leader_election.cc:343] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:33.743572 12399 raft_consensus.cc:2804] T 4c030549c2814e2b949de006d26f5514 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:33.738131 12394 tablet_bootstrap.cc:492] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24: Bootstrap starting.
I20260709 13:05:33.751150 12399 raft_consensus.cc:697] T 4c030549c2814e2b949de006d26f5514 P 8094d462961742bdbb1b497a71355a24 [term 1 LEADER]: Becoming Leader. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Running, Role: LEADER
I20260709 13:05:33.761590 12200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53cb67f3c6240549cb8672a5d254db7" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:33.756778 12417 leader_election.cc:290] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:33.762701 12200 raft_consensus.cc:2468] T c53cb67f3c6240549cb8672a5d254db7 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 0.
I20260709 13:05:33.731747 12435 raft_consensus.cc:515] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
W20260709 13:05:33.731143 12317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37607, user_credentials={real_user=slave}} blocked reactor thread for 79152.3us
I20260709 13:05:33.769301 12394 tablet_bootstrap.cc:654] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:33.775540 12199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea38e5274ba452894df20a69755dbda" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:33.777560 12350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53cb67f3c6240549cb8672a5d254db7" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:33.778038 12202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53cb67f3c6240549cb8672a5d254db7" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24"
I20260709 13:05:33.779009 12350 raft_consensus.cc:2393] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c00025c0f6594942bd14688ade17cb0e in current term 1: Already voted for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in this term.
I20260709 13:05:33.779066 12202 raft_consensus.cc:3060] T c53cb67f3c6240549cb8672a5d254db7 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.776674 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c030549c2814e2b949de006d26f5514" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
I20260709 13:05:33.785996 12349 raft_consensus.cc:3060] T 4c030549c2814e2b949de006d26f5514 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.787501 12441 raft_consensus.cc:493] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.788406 12350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f0e3ad1e4344cf8177322fec690c78" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
I20260709 13:05:33.789546 12350 raft_consensus.cc:3060] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.788120 12441 raft_consensus.cc:515] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.785036 12276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f0e3ad1e4344cf8177322fec690c78" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
I20260709 13:05:33.792006 12441 leader_election.cc:290] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:33.791982 12438 raft_consensus.cc:493] T 20eda87dc6e642ad8791304d782e09a1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.792876 12438 raft_consensus.cc:515] T 20eda87dc6e642ad8791304d782e09a1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
W20260709 13:05:33.793553 12165 leader_election.cc:343] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:33.795071 12276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20eda87dc6e642ad8791304d782e09a1" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:33.797135 12276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20eda87dc6e642ad8791304d782e09a1" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:33.798086 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20eda87dc6e642ad8791304d782e09a1" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
W20260709 13:05:33.798689 12314 leader_election.cc:343] T 20eda87dc6e642ad8791304d782e09a1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:33.798923 12348 raft_consensus.cc:2468] T 20eda87dc6e642ad8791304d782e09a1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 0.
I20260709 13:05:33.776685 12199 raft_consensus.cc:2468] T aea38e5274ba452894df20a69755dbda P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in term 0.
I20260709 13:05:33.801260 12243 leader_election.cc:304] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e; no voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:33.802141 12165 leader_election.cc:304] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 
I20260709 13:05:33.799626 12438 leader_election.cc:290] T 20eda87dc6e642ad8791304d782e09a1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:33.802975 12417 raft_consensus.cc:2804] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:33.805934 12417 raft_consensus.cc:493] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.806447 12417 raft_consensus.cc:3060] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.807999 12199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20eda87dc6e642ad8791304d782e09a1" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:33.810482 12317 leader_election.cc:304] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:33.811831 12438 raft_consensus.cc:493] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.812153 12439 raft_consensus.cc:2804] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:33.762604 12399 consensus_queue.cc:237] T 4c030549c2814e2b949de006d26f5514 P 8094d462961742bdbb1b497a71355a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.813352 12439 raft_consensus.cc:493] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.813122 12438 raft_consensus.cc:515] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.813958 12439 raft_consensus.cc:3060] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.805373 12441 raft_consensus.cc:2804] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:33.803849 12435 leader_election.cc:290] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 election: Requested vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:33.829516 12200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0051bc6e9d314fcca7be8439e6fa998f" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:33.830933 12200 raft_consensus.cc:2468] T 0051bc6e9d314fcca7be8439e6fa998f P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in term 0.
I20260709 13:05:33.821945 12441 raft_consensus.cc:493] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.832979 12441 raft_consensus.cc:3060] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.833134 12317 leader_election.cc:304] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 
I20260709 13:05:33.834623 12403 raft_consensus.cc:2804] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:33.835024 12403 raft_consensus.cc:493] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.835372 12403 raft_consensus.cc:3060] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.848557 12438 leader_election.cc:290] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:33.849409 12276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0051bc6e9d314fcca7be8439e6fa998f" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
W20260709 13:05:33.851652 12314 leader_election.cc:343] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:33.865309 12349 raft_consensus.cc:2468] T 4c030549c2814e2b949de006d26f5514 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 1.
I20260709 13:05:33.858575 12396 ts_tablet_manager.cc:1434] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e: Time spent starting tablet: real 0.177s	user 0.013s	sys 0.001s
I20260709 13:05:33.868558 12439 raft_consensus.cc:515] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.868253 12441 raft_consensus.cc:515] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.870298 12396 tablet_bootstrap.cc:492] T 33f0e3ad1e4344cf8177322fec690c78 P c00025c0f6594942bd14688ade17cb0e: Bootstrap starting.
I20260709 13:05:33.872116 12199 raft_consensus.cc:2393] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in current term 1: Already voted for candidate 8094d462961742bdbb1b497a71355a24 in this term.
W20260709 13:05:33.873154 12165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34793, user_credentials={real_user=slave}} blocked reactor thread for 71157.6us
W20260709 13:05:33.876890 12165 leader_election.cc:343] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:33.878973 12317 leader_election.cc:304] T 20eda87dc6e642ad8791304d782e09a1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:33.884575 12397 tablet_bootstrap.cc:492] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4: No bootstrap required, opened a new log
I20260709 13:05:33.884260 12202 raft_consensus.cc:2468] T c53cb67f3c6240549cb8672a5d254db7 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in term 1.
I20260709 13:05:33.885672 12397 ts_tablet_manager.cc:1403] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Time spent bootstrapping tablet: real 0.160s	user 0.031s	sys 0.020s
I20260709 13:05:33.887064 12438 raft_consensus.cc:3060] T 20eda87dc6e642ad8791304d782e09a1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.889029 12397 raft_consensus.cc:359] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.890312 12350 raft_consensus.cc:2468] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 1.
I20260709 13:05:33.890504 12397 raft_consensus.cc:385] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.891000 12397 raft_consensus.cc:740] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.892115 12397 consensus_queue.cc:260] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.892971 12441 leader_election.cc:290] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 election: Requested vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:33.864763 12403 raft_consensus.cc:515] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.893550 12317 leader_election.cc:304] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:33.903469 12436 raft_consensus.cc:2804] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:33.906561 12276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20eda87dc6e642ad8791304d782e09a1" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
I20260709 13:05:33.906841 12202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea38e5274ba452894df20a69755dbda" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24"
W20260709 13:05:33.908329 12165 leader_election.cc:343] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:33.907670 12202 raft_consensus.cc:3060] T aea38e5274ba452894df20a69755dbda P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.908790 12350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20eda87dc6e642ad8791304d782e09a1" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
I20260709 13:05:33.910147 12439 leader_election.cc:290] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 election: Requested vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:33.911264 12276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea38e5274ba452894df20a69755dbda" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
I20260709 13:05:33.912335 12277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0051bc6e9d314fcca7be8439e6fa998f" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
I20260709 13:05:33.912737 12199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0051bc6e9d314fcca7be8439e6fa998f" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24"
I20260709 13:05:33.913578 12199 raft_consensus.cc:3060] T 0051bc6e9d314fcca7be8439e6fa998f P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.913703 12403 leader_election.cc:290] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 election: Requested vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:33.917550 12438 raft_consensus.cc:2749] T 20eda87dc6e642ad8791304d782e09a1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:33.918879 12314 leader_election.cc:343] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:33.919714 12314 leader_election.cc:343] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:33.921005 12394 tablet_bootstrap.cc:492] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24: No bootstrap required, opened a new log
I20260709 13:05:33.922041 12397 ts_tablet_manager.cc:1434] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.002s
I20260709 13:05:33.922559 12099 catalog_manager.cc:5697] T 4c030549c2814e2b949de006d26f5514 P 8094d462961742bdbb1b497a71355a24 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8094d462961742bdbb1b497a71355a24 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "8094d462961742bdbb1b497a71355a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:33.924162 12394 ts_tablet_manager.cc:1403] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24: Time spent bootstrapping tablet: real 0.186s	user 0.020s	sys 0.017s
I20260709 13:05:33.927932 12350 raft_consensus.cc:2468] T 20eda87dc6e642ad8791304d782e09a1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 1.
I20260709 13:05:33.930966 12396 tablet_bootstrap.cc:654] T 33f0e3ad1e4344cf8177322fec690c78 P c00025c0f6594942bd14688ade17cb0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:33.909332 12165 leader_election.cc:304] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:33.933928 12441 raft_consensus.cc:2804] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:33.934444 12441 raft_consensus.cc:697] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [term 1 LEADER]: Becoming Leader. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Running, Role: LEADER
I20260709 13:05:33.934589 12165 leader_election.cc:304] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:33.936851 12399 raft_consensus.cc:2804] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:33.936738 12441 consensus_queue.cc:237] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.934649 12394 raft_consensus.cc:359] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.940124 12394 raft_consensus.cc:385] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.940454 12394 raft_consensus.cc:740] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.938357 12399 raft_consensus.cc:697] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24 [term 1 LEADER]: Becoming Leader. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Running, Role: LEADER
I20260709 13:05:33.944973 12436 raft_consensus.cc:697] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 LEADER]: Becoming Leader. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Running, Role: LEADER
I20260709 13:05:33.946487 12436 consensus_queue.cc:237] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.947077 12399 consensus_queue.cc:237] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.950065 12394 consensus_queue.cc:260] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.936769 12417 raft_consensus.cc:515] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.943368 12199 raft_consensus.cc:2468] T 0051bc6e9d314fcca7be8439e6fa998f P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in term 1.
I20260709 13:05:33.960044 12394 ts_tablet_manager.cc:1434] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.002s
I20260709 13:05:33.959693 12317 leader_election.cc:304] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:33.964046 12202 raft_consensus.cc:2468] T aea38e5274ba452894df20a69755dbda P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in term 1.
I20260709 13:05:33.964674 12438 raft_consensus.cc:2804] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:33.970050 12438 raft_consensus.cc:697] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 LEADER]: Becoming Leader. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Running, Role: LEADER
I20260709 13:05:33.974215 12438 consensus_queue.cc:237] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.979614 12199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53cb67f3c6240549cb8672a5d254db7" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24"
I20260709 13:05:33.980634 12350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53cb67f3c6240549cb8672a5d254db7" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
I20260709 13:05:33.980688 12199 raft_consensus.cc:2393] T c53cb67f3c6240549cb8672a5d254db7 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c00025c0f6594942bd14688ade17cb0e in current term 1: Already voted for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in this term.
I20260709 13:05:33.984140 12417 leader_election.cc:290] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 election: Requested vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:33.984561 12317 leader_election.cc:304] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:33.985159 12243 leader_election.cc:304] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e; no voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:33.986222 12417 raft_consensus.cc:2749] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:33.986671 12403 raft_consensus.cc:2804] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:33.987340 12403 raft_consensus.cc:697] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 LEADER]: Becoming Leader. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Running, Role: LEADER
I20260709 13:05:33.992524 12403 consensus_queue.cc:237] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:33.999440 12098 catalog_manager.cc:5697] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8094d462961742bdbb1b497a71355a24 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "8094d462961742bdbb1b497a71355a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:34.003183 12098 catalog_manager.cc:5697] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8094d462961742bdbb1b497a71355a24 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "8094d462961742bdbb1b497a71355a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:34.023345 12100 catalog_manager.cc:5697] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:34.024210 12396 tablet_bootstrap.cc:492] T 33f0e3ad1e4344cf8177322fec690c78 P c00025c0f6594942bd14688ade17cb0e: No bootstrap required, opened a new log
I20260709 13:05:34.024849 12396 ts_tablet_manager.cc:1403] T 33f0e3ad1e4344cf8177322fec690c78 P c00025c0f6594942bd14688ade17cb0e: Time spent bootstrapping tablet: real 0.155s	user 0.012s	sys 0.020s
I20260709 13:05:34.028554 12396 raft_consensus.cc:359] T 33f0e3ad1e4344cf8177322fec690c78 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:34.030241 12396 raft_consensus.cc:385] T 33f0e3ad1e4344cf8177322fec690c78 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.030460 12396 raft_consensus.cc:740] T 33f0e3ad1e4344cf8177322fec690c78 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.032999 12396 consensus_queue.cc:260] T 33f0e3ad1e4344cf8177322fec690c78 P c00025c0f6594942bd14688ade17cb0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:34.036299 12396 ts_tablet_manager.cc:1434] T 33f0e3ad1e4344cf8177322fec690c78 P c00025c0f6594942bd14688ade17cb0e: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:05:34.037842 12396 tablet_bootstrap.cc:492] T aea38e5274ba452894df20a69755dbda P c00025c0f6594942bd14688ade17cb0e: Bootstrap starting.
I20260709 13:05:34.044853 12396 tablet_bootstrap.cc:654] T aea38e5274ba452894df20a69755dbda P c00025c0f6594942bd14688ade17cb0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.049942 12098 catalog_manager.cc:5697] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:34.051815 12396 tablet_bootstrap.cc:492] T aea38e5274ba452894df20a69755dbda P c00025c0f6594942bd14688ade17cb0e: No bootstrap required, opened a new log
I20260709 13:05:34.052466 12396 ts_tablet_manager.cc:1403] T aea38e5274ba452894df20a69755dbda P c00025c0f6594942bd14688ade17cb0e: Time spent bootstrapping tablet: real 0.015s	user 0.004s	sys 0.008s
I20260709 13:05:34.052059 12098 catalog_manager.cc:5697] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:34.056756 12396 raft_consensus.cc:359] T aea38e5274ba452894df20a69755dbda P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:34.058190 12396 raft_consensus.cc:385] T aea38e5274ba452894df20a69755dbda P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.058697 12396 raft_consensus.cc:740] T aea38e5274ba452894df20a69755dbda P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.059533 12396 consensus_queue.cc:260] T aea38e5274ba452894df20a69755dbda P c00025c0f6594942bd14688ade17cb0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:34.062052 12396 ts_tablet_manager.cc:1434] T aea38e5274ba452894df20a69755dbda P c00025c0f6594942bd14688ade17cb0e: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.000s
I20260709 13:05:34.063225 12396 tablet_bootstrap.cc:492] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e: Bootstrap starting.
I20260709 13:05:34.070508 12396 tablet_bootstrap.cc:654] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.079109 12396 tablet_bootstrap.cc:492] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e: No bootstrap required, opened a new log
I20260709 13:05:34.079026 12417 consensus_queue.cc:1048] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:34.079766 12396 ts_tablet_manager.cc:1403] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 13:05:34.083051 12396 raft_consensus.cc:359] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:34.083698 12396 raft_consensus.cc:385] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.084038 12396 raft_consensus.cc:740] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.084509 12417 raft_consensus.cc:493] T 33f0e3ad1e4344cf8177322fec690c78 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.085481 12417 raft_consensus.cc:515] T 33f0e3ad1e4344cf8177322fec690c78 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:34.085011 12396 consensus_queue.cc:260] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:34.089643 12417 leader_election.cc:290] T 33f0e3ad1e4344cf8177322fec690c78 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:34.089854 12351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f0e3ad1e4344cf8177322fec690c78" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:34.090891 12351 raft_consensus.cc:2393] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c00025c0f6594942bd14688ade17cb0e in current term 1: Already voted for candidate 8094d462961742bdbb1b497a71355a24 in this term.
I20260709 13:05:34.092723 12396 ts_tablet_manager.cc:1434] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 13:05:34.094271 12396 tablet_bootstrap.cc:492] T f3beb77c94044e94a8cf4318a473a13b P c00025c0f6594942bd14688ade17cb0e: Bootstrap starting.
I20260709 13:05:34.094357 12199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f0e3ad1e4344cf8177322fec690c78" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:34.096494 12446 consensus_queue.cc:1048] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:34.096540 12243 leader_election.cc:304] T 33f0e3ad1e4344cf8177322fec690c78 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e; no voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:34.098465 12446 raft_consensus.cc:3060] T 33f0e3ad1e4344cf8177322fec690c78 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.104095 12396 tablet_bootstrap.cc:654] T f3beb77c94044e94a8cf4318a473a13b P c00025c0f6594942bd14688ade17cb0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.109448 12446 raft_consensus.cc:2749] T 33f0e3ad1e4344cf8177322fec690c78 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:34.114737 12396 tablet_bootstrap.cc:492] T f3beb77c94044e94a8cf4318a473a13b P c00025c0f6594942bd14688ade17cb0e: No bootstrap required, opened a new log
I20260709 13:05:34.114821 12399 raft_consensus.cc:493] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.115640 12396 ts_tablet_manager.cc:1403] T f3beb77c94044e94a8cf4318a473a13b P c00025c0f6594942bd14688ade17cb0e: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.001s
I20260709 13:05:34.115667 12399 raft_consensus.cc:515] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:34.119481 12396 raft_consensus.cc:359] T f3beb77c94044e94a8cf4318a473a13b P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:34.119637 12277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3beb77c94044e94a8cf4318a473a13b" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:34.120198 12396 raft_consensus.cc:385] T f3beb77c94044e94a8cf4318a473a13b P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.120541 12396 raft_consensus.cc:740] T f3beb77c94044e94a8cf4318a473a13b P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.121371 12399 leader_election.cc:290] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:34.121320 12396 consensus_queue.cc:260] T f3beb77c94044e94a8cf4318a473a13b P c00025c0f6594942bd14688ade17cb0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:34.122570 12277 raft_consensus.cc:2468] T f3beb77c94044e94a8cf4318a473a13b P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 0.
I20260709 13:05:34.123749 12396 ts_tablet_manager.cc:1434] T f3beb77c94044e94a8cf4318a473a13b P c00025c0f6594942bd14688ade17cb0e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:05:34.123682 12351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3beb77c94044e94a8cf4318a473a13b" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:34.125054 12351 raft_consensus.cc:2468] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 0.
I20260709 13:05:34.125435 12396 tablet_bootstrap.cc:492] T 20eda87dc6e642ad8791304d782e09a1 P c00025c0f6594942bd14688ade17cb0e: Bootstrap starting.
I20260709 13:05:34.127236 12165 leader_election.cc:304] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 
I20260709 13:05:34.130090 12399 raft_consensus.cc:2804] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:34.130951 12399 raft_consensus.cc:493] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:34.131428 12399 raft_consensus.cc:3060] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.136147 12396 tablet_bootstrap.cc:654] T 20eda87dc6e642ad8791304d782e09a1 P c00025c0f6594942bd14688ade17cb0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.144954 12399 raft_consensus.cc:515] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:34.147460 12399 leader_election.cc:290] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 election: Requested vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:34.147785 12396 tablet_bootstrap.cc:492] T 20eda87dc6e642ad8791304d782e09a1 P c00025c0f6594942bd14688ade17cb0e: No bootstrap required, opened a new log
I20260709 13:05:34.148438 12396 ts_tablet_manager.cc:1403] T 20eda87dc6e642ad8791304d782e09a1 P c00025c0f6594942bd14688ade17cb0e: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.004s
I20260709 13:05:34.148612 12277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3beb77c94044e94a8cf4318a473a13b" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
I20260709 13:05:34.148923 12351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3beb77c94044e94a8cf4318a473a13b" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
I20260709 13:05:34.149434 12277 raft_consensus.cc:3060] T f3beb77c94044e94a8cf4318a473a13b P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.149817 12351 raft_consensus.cc:3060] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.152361 12396 raft_consensus.cc:359] T 20eda87dc6e642ad8791304d782e09a1 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:34.153189 12396 raft_consensus.cc:385] T 20eda87dc6e642ad8791304d782e09a1 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.153633 12396 raft_consensus.cc:740] T 20eda87dc6e642ad8791304d782e09a1 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.154488 12396 consensus_queue.cc:260] T 20eda87dc6e642ad8791304d782e09a1 P c00025c0f6594942bd14688ade17cb0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:34.157208 12396 ts_tablet_manager.cc:1434] T 20eda87dc6e642ad8791304d782e09a1 P c00025c0f6594942bd14688ade17cb0e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:05:34.159727 12277 raft_consensus.cc:2468] T f3beb77c94044e94a8cf4318a473a13b P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 1.
I20260709 13:05:34.160018 12351 raft_consensus.cc:2468] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 1.
I20260709 13:05:34.160970 12165 leader_election.cc:304] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e; no voters: 
I20260709 13:05:34.162480 12399 raft_consensus.cc:2804] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:34.162987 12399 raft_consensus.cc:697] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [term 1 LEADER]: Becoming Leader. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Running, Role: LEADER
I20260709 13:05:34.163745 12399 consensus_queue.cc:237] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:34.173861 12099 catalog_manager.cc:5697] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8094d462961742bdbb1b497a71355a24 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "8094d462961742bdbb1b497a71355a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:34.177323 12446 raft_consensus.cc:493] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.177898 12446 raft_consensus.cc:515] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:34.180783 12446 leader_election.cc:290] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:34.181169 12199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0051bc6e9d314fcca7be8439e6fa998f" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:34.181447 12351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0051bc6e9d314fcca7be8439e6fa998f" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:34.182099 12199 raft_consensus.cc:2393] T 0051bc6e9d314fcca7be8439e6fa998f P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c00025c0f6594942bd14688ade17cb0e in current term 1: Already voted for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in this term.
I20260709 13:05:34.183168 12243 leader_election.cc:304] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e; no voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:34.184115 12446 raft_consensus.cc:3060] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.190246 12446 raft_consensus.cc:2749] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:34.216675 12131 debug-util.cc:398] Leaking SignalData structure 0x7b08003209c0 after lost signal to thread 434
W20260709 13:05:34.218679 12131 debug-util.cc:398] Leaking SignalData structure 0x7b08000099a0 after lost signal to thread 12134
W20260709 13:05:34.220538 12131 debug-util.cc:398] Leaking SignalData structure 0x7b08002ac780 after lost signal to thread 12226
W20260709 13:05:34.221793 12131 debug-util.cc:398] Leaking SignalData structure 0x7b08000ecb00 after lost signal to thread 12301
W20260709 13:05:34.222935 12131 debug-util.cc:398] Leaking SignalData structure 0x7b0800266520 after lost signal to thread 12375
I20260709 13:05:34.285797 12277 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03a56ae904c84229be46c9d8773eb639"
dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
mode: GRACEFUL
new_leader_uuid: "8094d462961742bdbb1b497a71355a24"
 from {username='slave'} at 127.0.0.1:53256
I20260709 13:05:34.286586 12277 raft_consensus.cc:606] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e [term 1 LEADER]: Received request to transfer leadership to TS 8094d462961742bdbb1b497a71355a24
I20260709 13:05:34.293738 12277 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6cb3962ca7144e23a7f8e13cb66c5691"
dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
mode: GRACEFUL
new_leader_uuid: "8094d462961742bdbb1b497a71355a24"
 from {username='slave'} at 127.0.0.1:53256
I20260709 13:05:34.294344 12277 raft_consensus.cc:606] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [term 1 LEADER]: Received request to transfer leadership to TS 8094d462961742bdbb1b497a71355a24
I20260709 13:05:34.322090 12351 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c53cb67f3c6240549cb8672a5d254db7"
dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
mode: GRACEFUL
new_leader_uuid: "c00025c0f6594942bd14688ade17cb0e"
 from {username='slave'} at 127.0.0.1:34220
I20260709 13:05:34.323042 12351 raft_consensus.cc:606] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 LEADER]: Received request to transfer leadership to TS c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:34.330672 12351 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aea38e5274ba452894df20a69755dbda"
dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
mode: GRACEFUL
new_leader_uuid: "c00025c0f6594942bd14688ade17cb0e"
 from {username='slave'} at 127.0.0.1:34220
I20260709 13:05:34.331821 12351 raft_consensus.cc:606] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 LEADER]: Received request to transfer leadership to TS c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:34.339496 12351 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0051bc6e9d314fcca7be8439e6fa998f"
dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
mode: GRACEFUL
new_leader_uuid: "c00025c0f6594942bd14688ade17cb0e"
 from {username='slave'} at 127.0.0.1:34220
I20260709 13:05:34.340301 12351 raft_consensus.cc:606] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 LEADER]: Received request to transfer leadership to TS c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:34.359676 12199 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3beb77c94044e94a8cf4318a473a13b"
dest_uuid: "8094d462961742bdbb1b497a71355a24"
mode: GRACEFUL
new_leader_uuid: "c00025c0f6594942bd14688ade17cb0e"
 from {username='slave'} at 127.0.0.1:33012
I20260709 13:05:34.360271 12199 raft_consensus.cc:606] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [term 1 LEADER]: Received request to transfer leadership to TS c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:34.366289 12199 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20eda87dc6e642ad8791304d782e09a1"
dest_uuid: "8094d462961742bdbb1b497a71355a24"
mode: GRACEFUL
new_leader_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
 from {username='slave'} at 127.0.0.1:33012
I20260709 13:05:34.366858 12199 raft_consensus.cc:606] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24 [term 1 LEADER]: Received request to transfer leadership to TS f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:34.382859 12399 consensus_queue.cc:1048] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:34.383388 12403 consensus_queue.cc:1048] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:34.385656 12399 consensus_queue.cc:1048] T 4c030549c2814e2b949de006d26f5514 P 8094d462961742bdbb1b497a71355a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:34.410585 12403 raft_consensus.cc:993] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: : Instructing follower c00025c0f6594942bd14688ade17cb0e to start an election
I20260709 13:05:34.411127 12403 raft_consensus.cc:1081] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 LEADER]: Signalling peer c00025c0f6594942bd14688ade17cb0e to start an election
I20260709 13:05:34.417797 12435 consensus_queue.cc:1048] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:34.419732 12277 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c53cb67f3c6240549cb8672a5d254db7"
dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
 from {username='slave'} at 127.0.0.1:53242
I20260709 13:05:34.420704 12277 raft_consensus.cc:493] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:34.421137 12277 raft_consensus.cc:3060] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:34.427443 12439 consensus_queue.cc:1048] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:34.445892 12449 consensus_queue.cc:1048] T 4c030549c2814e2b949de006d26f5514 P 8094d462961742bdbb1b497a71355a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:34.446142 12277 raft_consensus.cc:515] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:34.454238 12276 raft_consensus.cc:1240] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Rejecting Update request from peer f706a4ebbb9e4c9f9d0a9259f1ac73e4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:34.462698 12439 consensus_queue.cc:1059] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:34.463830 12439 raft_consensus.cc:3055] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:34.464226 12439 raft_consensus.cc:740] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Running, Role: LEADER
I20260709 13:05:34.465620 12277 leader_election.cc:290] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 2 election: Requested vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:34.466023 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53cb67f3c6240549cb8672a5d254db7" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
I20260709 13:05:34.466425 12199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53cb67f3c6240549cb8672a5d254db7" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8094d462961742bdbb1b497a71355a24"
I20260709 13:05:34.467041 12199 raft_consensus.cc:3060] T c53cb67f3c6240549cb8672a5d254db7 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:34.467586 12417 raft_consensus.cc:493] T aea38e5274ba452894df20a69755dbda P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.468155 12417 raft_consensus.cc:515] T aea38e5274ba452894df20a69755dbda P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:34.467177 12439 consensus_queue.cc:260] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:34.470939 12439 raft_consensus.cc:3060] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:34.472389 12417 leader_election.cc:290] T aea38e5274ba452894df20a69755dbda P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:34.472561 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea38e5274ba452894df20a69755dbda" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:34.475505 12202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea38e5274ba452894df20a69755dbda" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:34.476851 12202 raft_consensus.cc:2393] T aea38e5274ba452894df20a69755dbda P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c00025c0f6594942bd14688ade17cb0e in current term 1: Already voted for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in this term.
I20260709 13:05:34.478403 12243 leader_election.cc:304] T aea38e5274ba452894df20a69755dbda P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e; no voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:34.480181 12435 consensus_queue.cc:1048] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:34.481387 12417 raft_consensus.cc:3060] T aea38e5274ba452894df20a69755dbda P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.499976 12452 raft_consensus.cc:993] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e: : Instructing follower 8094d462961742bdbb1b497a71355a24 to start an election
I20260709 13:05:34.500566 12452 raft_consensus.cc:1081] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [term 1 LEADER]: Signalling peer 8094d462961742bdbb1b497a71355a24 to start an election
I20260709 13:05:34.503957 12202 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6cb3962ca7144e23a7f8e13cb66c5691"
dest_uuid: "8094d462961742bdbb1b497a71355a24"
 from {username='slave'} at 127.0.0.1:33000
I20260709 13:05:34.504731 12202 raft_consensus.cc:493] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:34.505263 12202 raft_consensus.cc:3060] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:34.506212 12349 raft_consensus.cc:2468] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 2.
I20260709 13:05:34.510785 12240 leader_election.cc:304] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 
I20260709 13:05:34.512466 12446 raft_consensus.cc:2804] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:34.514173 12446 raft_consensus.cc:697] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [term 2 LEADER]: Becoming Leader. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Running, Role: LEADER
I20260709 13:05:34.515319 12446 consensus_queue.cc:237] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:34.490166 12199 raft_consensus.cc:2468] T c53cb67f3c6240549cb8672a5d254db7 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 2.
I20260709 13:05:34.521831 12277 raft_consensus.cc:3060] T 20eda87dc6e642ad8791304d782e09a1 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.522836 12202 raft_consensus.cc:515] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:34.524704 12202 leader_election.cc:290] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 2 election: Requested vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:34.528052 12275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb3962ca7144e23a7f8e13cb66c5691" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
I20260709 13:05:34.528419 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb3962ca7144e23a7f8e13cb66c5691" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
I20260709 13:05:34.529488 12349 raft_consensus.cc:3060] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:34.528939 12275 raft_consensus.cc:3055] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:34.530534 12275 raft_consensus.cc:740] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Running, Role: LEADER
I20260709 13:05:34.532081 12275 consensus_queue.cc:260] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:34.534418 12275 raft_consensus.cc:3060] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:34.535696 12099 catalog_manager.cc:5697] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e reported cstate change: term changed from 1 to 2, leader changed from f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195) to c00025c0f6594942bd14688ade17cb0e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "c00025c0f6594942bd14688ade17cb0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:34.560583 12435 raft_consensus.cc:993] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24: : Instructing follower f706a4ebbb9e4c9f9d0a9259f1ac73e4 to start an election
I20260709 13:05:34.561223 12449 raft_consensus.cc:1081] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24 [term 1 LEADER]: Signalling peer f706a4ebbb9e4c9f9d0a9259f1ac73e4 to start an election
I20260709 13:05:34.564469 12349 raft_consensus.cc:2468] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 2.
I20260709 13:05:34.564586 12439 consensus_queue.cc:1048] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:34.570456 12348 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20eda87dc6e642ad8791304d782e09a1"
dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
 from {username='slave'} at 127.0.0.1:34204
I20260709 13:05:34.571318 12348 raft_consensus.cc:493] T 20eda87dc6e642ad8791304d782e09a1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:34.572229 12348 raft_consensus.cc:3060] T 20eda87dc6e642ad8791304d782e09a1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:34.581465 12399 consensus_queue.cc:1048] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:34.583734 12439 consensus_queue.cc:1048] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:34.577783 12417 raft_consensus.cc:2749] T aea38e5274ba452894df20a69755dbda P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:34.589435 12165 leader_election.cc:304] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 
I20260709 13:05:34.590242 12446 raft_consensus.cc:493] T 20eda87dc6e642ad8791304d782e09a1 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.590920 12446 raft_consensus.cc:515] T 20eda87dc6e642ad8791304d782e09a1 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:34.593878 12399 raft_consensus.cc:2804] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:34.594885 12399 raft_consensus.cc:697] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24 [term 2 LEADER]: Becoming Leader. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Running, Role: LEADER
I20260709 13:05:34.595466 12446 leader_election.cc:290] T 20eda87dc6e642ad8791304d782e09a1 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:34.596253 12399 consensus_queue.cc:237] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:34.599272 12202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20eda87dc6e642ad8791304d782e09a1" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:34.602180 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20eda87dc6e642ad8791304d782e09a1" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:34.605006 12240 leader_election.cc:304] T 20eda87dc6e642ad8791304d782e09a1 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e; no voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:34.601008 12275 raft_consensus.cc:2468] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 2.
I20260709 13:05:34.607120 12417 raft_consensus.cc:2749] T 20eda87dc6e642ad8791304d782e09a1 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:34.607108 12435 consensus_queue.cc:1048] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:05:34.618947 12439 consensus_queue.cc:1048] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:34.626884 12439 consensus_queue.cc:1048] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:34.635063 12441 consensus_queue.cc:1048] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:34.658680 12348 raft_consensus.cc:515] T 20eda87dc6e642ad8791304d782e09a1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:34.664376 12273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20eda87dc6e642ad8791304d782e09a1" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
I20260709 13:05:34.667377 12348 leader_election.cc:290] T 20eda87dc6e642ad8791304d782e09a1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 2 election: Requested vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:34.677493 12098 catalog_manager.cc:5697] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24 reported cstate change: term changed from 1 to 2, leader changed from c00025c0f6594942bd14688ade17cb0e (127.0.107.194) to 8094d462961742bdbb1b497a71355a24 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "8094d462961742bdbb1b497a71355a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:34.689759 12435 raft_consensus.cc:993] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24: : Instructing follower c00025c0f6594942bd14688ade17cb0e to start an election
I20260709 13:05:34.690680 12435 raft_consensus.cc:1081] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [term 1 LEADER]: Signalling peer c00025c0f6594942bd14688ade17cb0e to start an election
I20260709 13:05:34.694470 12439 raft_consensus.cc:993] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4: : Instructing follower c00025c0f6594942bd14688ade17cb0e to start an election
I20260709 13:05:34.698273 12403 raft_consensus.cc:1081] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 LEADER]: Signalling peer c00025c0f6594942bd14688ade17cb0e to start an election
I20260709 13:05:34.702054 12274 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aea38e5274ba452894df20a69755dbda"
dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
 from {username='slave'} at 127.0.0.1:53242
I20260709 13:05:34.702723 12274 raft_consensus.cc:493] T aea38e5274ba452894df20a69755dbda P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:34.703105 12274 raft_consensus.cc:3060] T aea38e5274ba452894df20a69755dbda P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:34.706455 12277 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3beb77c94044e94a8cf4318a473a13b"
dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
 from {username='slave'} at 127.0.0.1:53226
I20260709 13:05:34.710721 12436 raft_consensus.cc:993] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4: : Instructing follower c00025c0f6594942bd14688ade17cb0e to start an election
I20260709 13:05:34.712050 12436 raft_consensus.cc:1081] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 LEADER]: Signalling peer c00025c0f6594942bd14688ade17cb0e to start an election
I20260709 13:05:34.714870 12276 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0051bc6e9d314fcca7be8439e6fa998f"
dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
 from {username='slave'} at 127.0.0.1:53242
I20260709 13:05:34.715564 12276 raft_consensus.cc:493] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:34.721779 12276 raft_consensus.cc:3060] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:34.725260 12277 raft_consensus.cc:493] T f3beb77c94044e94a8cf4318a473a13b P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:34.725832 12277 raft_consensus.cc:3060] T f3beb77c94044e94a8cf4318a473a13b P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:34.715255 12199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20eda87dc6e642ad8791304d782e09a1" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8094d462961742bdbb1b497a71355a24"
I20260709 13:05:34.738868 12199 raft_consensus.cc:3055] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:34.739255 12199 raft_consensus.cc:740] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Running, Role: LEADER
I20260709 13:05:34.741914 12417 raft_consensus.cc:993] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e: : Instructing follower 8094d462961742bdbb1b497a71355a24 to start an election
I20260709 13:05:34.742506 12424 raft_consensus.cc:1081] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e [term 1 LEADER]: Signalling peer 8094d462961742bdbb1b497a71355a24 to start an election
I20260709 13:05:34.744681 12201 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03a56ae904c84229be46c9d8773eb639"
dest_uuid: "8094d462961742bdbb1b497a71355a24"
 from {username='slave'} at 127.0.0.1:33000
I20260709 13:05:34.745384 12201 raft_consensus.cc:493] T 03a56ae904c84229be46c9d8773eb639 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:34.745767 12201 raft_consensus.cc:3060] T 03a56ae904c84229be46c9d8773eb639 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:34.748037 12199 consensus_queue.cc:260] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:34.756670 12277 raft_consensus.cc:515] T f3beb77c94044e94a8cf4318a473a13b P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:34.752472 12276 raft_consensus.cc:515] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:34.758752 12201 raft_consensus.cc:515] T 03a56ae904c84229be46c9d8773eb639 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:34.761175 12275 raft_consensus.cc:1240] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Rejecting Update request from peer f706a4ebbb9e4c9f9d0a9259f1ac73e4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:34.763775 12439 consensus_queue.cc:1059] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:34.763973 12275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a56ae904c84229be46c9d8773eb639" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
I20260709 13:05:34.764679 12275 raft_consensus.cc:3055] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:34.764761 12439 raft_consensus.cc:3055] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:34.766744 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0051bc6e9d314fcca7be8439e6fa998f" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
I20260709 13:05:34.767025 12439 raft_consensus.cc:740] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Running, Role: LEADER
I20260709 13:05:34.768875 12202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0051bc6e9d314fcca7be8439e6fa998f" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8094d462961742bdbb1b497a71355a24"
I20260709 13:05:34.768090 12439 consensus_queue.cc:260] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:34.769812 12202 raft_consensus.cc:3060] T 0051bc6e9d314fcca7be8439e6fa998f P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:34.765046 12275 raft_consensus.cc:740] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Running, Role: LEADER
I20260709 13:05:34.770924 12439 raft_consensus.cc:3060] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:34.771754 12275 consensus_queue.cc:260] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:34.758976 12199 raft_consensus.cc:3060] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:34.760035 12274 raft_consensus.cc:515] T aea38e5274ba452894df20a69755dbda P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:34.781051 12200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea38e5274ba452894df20a69755dbda" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8094d462961742bdbb1b497a71355a24"
I20260709 13:05:34.774525 12275 raft_consensus.cc:3060] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:34.765528 12276 leader_election.cc:290] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 2 election: Requested vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:34.781723 12200 raft_consensus.cc:3060] T aea38e5274ba452894df20a69755dbda P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:34.786110 12277 leader_election.cc:290] T f3beb77c94044e94a8cf4318a473a13b P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 2 election: Requested vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:34.788576 12350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea38e5274ba452894df20a69755dbda" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
I20260709 13:05:34.790354 12350 raft_consensus.cc:3055] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:34.791070 12350 raft_consensus.cc:740] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Running, Role: LEADER
I20260709 13:05:34.790165 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3beb77c94044e94a8cf4318a473a13b" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
I20260709 13:05:34.792994 12349 raft_consensus.cc:3060] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:34.793313 12274 leader_election.cc:290] T aea38e5274ba452894df20a69755dbda P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 2 election: Requested vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:34.807747 12350 consensus_queue.cc:260] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:34.809724 12350 raft_consensus.cc:3060] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:34.811399 12351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a56ae904c84229be46c9d8773eb639" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
I20260709 13:05:34.812165 12351 raft_consensus.cc:3060] T 03a56ae904c84229be46c9d8773eb639 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:34.812530 12201 leader_election.cc:290] T 03a56ae904c84229be46c9d8773eb639 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 2 election: Requested vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:34.818147 12198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3beb77c94044e94a8cf4318a473a13b" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8094d462961742bdbb1b497a71355a24"
I20260709 13:05:34.826622 12198 raft_consensus.cc:3055] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:34.827076 12198 raft_consensus.cc:740] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Running, Role: LEADER
I20260709 13:05:34.828115 12198 consensus_queue.cc:260] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:34.829576 12198 raft_consensus.cc:3060] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:34.832661 12275 raft_consensus.cc:2468] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 2.
I20260709 13:05:34.835528 12348 raft_consensus.cc:2468] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 2.
I20260709 13:05:34.835943 12165 leader_election.cc:304] T 03a56ae904c84229be46c9d8773eb639 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e; no voters: 
I20260709 13:05:34.836992 12399 raft_consensus.cc:2804] T 03a56ae904c84229be46c9d8773eb639 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:34.834353 12199 raft_consensus.cc:2468] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in term 2.
I20260709 13:05:34.837532 12399 raft_consensus.cc:697] T 03a56ae904c84229be46c9d8773eb639 P 8094d462961742bdbb1b497a71355a24 [term 2 LEADER]: Becoming Leader. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Running, Role: LEADER
I20260709 13:05:34.838888 12399 consensus_queue.cc:237] T 03a56ae904c84229be46c9d8773eb639 P 8094d462961742bdbb1b497a71355a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:34.837491 12350 raft_consensus.cc:2468] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 2.
I20260709 13:05:34.834183 12349 raft_consensus.cc:2468] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 2.
I20260709 13:05:34.846565 12240 leader_election.cc:304] T aea38e5274ba452894df20a69755dbda P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 
I20260709 13:05:34.847649 12424 raft_consensus.cc:2804] T aea38e5274ba452894df20a69755dbda P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:34.848058 12351 raft_consensus.cc:2468] T 03a56ae904c84229be46c9d8773eb639 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 2.
I20260709 13:05:34.848733 12424 raft_consensus.cc:697] T aea38e5274ba452894df20a69755dbda P c00025c0f6594942bd14688ade17cb0e [term 2 LEADER]: Becoming Leader. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Running, Role: LEADER
I20260709 13:05:34.852331 12317 leader_election.cc:304] T 20eda87dc6e642ad8791304d782e09a1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:34.850942 12424 consensus_queue.cc:237] T aea38e5274ba452894df20a69755dbda P c00025c0f6594942bd14688ade17cb0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:34.853366 12202 raft_consensus.cc:2468] T 0051bc6e9d314fcca7be8439e6fa998f P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 2.
I20260709 13:05:34.858333 12439 raft_consensus.cc:2804] T 20eda87dc6e642ad8791304d782e09a1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:34.859483 12240 leader_election.cc:304] T f3beb77c94044e94a8cf4318a473a13b P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 
I20260709 13:05:34.865765 12439 raft_consensus.cc:697] T 20eda87dc6e642ad8791304d782e09a1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 LEADER]: Becoming Leader. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Running, Role: LEADER
I20260709 13:05:34.866948 12424 raft_consensus.cc:2804] T f3beb77c94044e94a8cf4318a473a13b P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:34.866758 12439 consensus_queue.cc:237] T 20eda87dc6e642ad8791304d782e09a1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:34.867630 12424 raft_consensus.cc:697] T f3beb77c94044e94a8cf4318a473a13b P c00025c0f6594942bd14688ade17cb0e [term 2 LEADER]: Becoming Leader. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Running, Role: LEADER
I20260709 13:05:34.856196 12200 raft_consensus.cc:2468] T aea38e5274ba452894df20a69755dbda P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 2.
I20260709 13:05:34.870602 12424 consensus_queue.cc:237] T f3beb77c94044e94a8cf4318a473a13b P c00025c0f6594942bd14688ade17cb0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:34.863462 12243 leader_election.cc:304] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e; no voters: 
I20260709 13:05:34.871922 12097 catalog_manager.cc:5697] T aea38e5274ba452894df20a69755dbda P c00025c0f6594942bd14688ade17cb0e reported cstate change: term changed from 1 to 2, leader changed from f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195) to c00025c0f6594942bd14688ade17cb0e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "c00025c0f6594942bd14688ade17cb0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:34.875016 12446 raft_consensus.cc:2804] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:34.875705 12446 raft_consensus.cc:697] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [term 2 LEADER]: Becoming Leader. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Running, Role: LEADER
I20260709 13:05:34.861229 12198 raft_consensus.cc:2468] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 2.
I20260709 13:05:34.876677 12446 consensus_queue.cc:237] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:34.882258 12098 catalog_manager.cc:5697] T 20eda87dc6e642ad8791304d782e09a1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 reported cstate change: term changed from 1 to 2, leader changed from 8094d462961742bdbb1b497a71355a24 (127.0.107.193) to f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:34.893800 12100 catalog_manager.cc:5697] T 03a56ae904c84229be46c9d8773eb639 P 8094d462961742bdbb1b497a71355a24 reported cstate change: term changed from 1 to 2, leader changed from c00025c0f6594942bd14688ade17cb0e (127.0.107.194) to 8094d462961742bdbb1b497a71355a24 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "8094d462961742bdbb1b497a71355a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:34.910166 12100 catalog_manager.cc:5697] T f3beb77c94044e94a8cf4318a473a13b P c00025c0f6594942bd14688ade17cb0e reported cstate change: term changed from 1 to 2, leader changed from 8094d462961742bdbb1b497a71355a24 (127.0.107.193) to c00025c0f6594942bd14688ade17cb0e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "c00025c0f6594942bd14688ade17cb0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:34.912218 12100 catalog_manager.cc:5697] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e reported cstate change: term changed from 1 to 2, leader changed from f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195) to c00025c0f6594942bd14688ade17cb0e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "c00025c0f6594942bd14688ade17cb0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:34.944483 12348 raft_consensus.cc:1275] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Refusing update from remote peer c00025c0f6594942bd14688ade17cb0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:34.946256 12446 consensus_queue.cc:1048] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:34.959643 12198 raft_consensus.cc:1275] T c53cb67f3c6240549cb8672a5d254db7 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Refusing update from remote peer c00025c0f6594942bd14688ade17cb0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:34.962074 12446 consensus_queue.cc:1048] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:34.985869 12274 raft_consensus.cc:1275] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Refusing update from remote peer 8094d462961742bdbb1b497a71355a24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:34.987491 12441 consensus_queue.cc:1048] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:35.004885 12351 raft_consensus.cc:1275] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Refusing update from remote peer 8094d462961742bdbb1b497a71355a24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:35.010200 12435 consensus_queue.cc:1048] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:35.263804 12274 raft_consensus.cc:3060] T 20eda87dc6e642ad8791304d782e09a1 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:35.270954 12274 raft_consensus.cc:1275] T 20eda87dc6e642ad8791304d782e09a1 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Refusing update from remote peer f706a4ebbb9e4c9f9d0a9259f1ac73e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:35.272639 12439 consensus_queue.cc:1048] T 20eda87dc6e642ad8791304d782e09a1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:35.285605 12198 raft_consensus.cc:1275] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Refusing update from remote peer f706a4ebbb9e4c9f9d0a9259f1ac73e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:35.287922 12436 consensus_queue.cc:1048] T 20eda87dc6e642ad8791304d782e09a1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:35.304878 12351 raft_consensus.cc:1275] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Refusing update from remote peer c00025c0f6594942bd14688ade17cb0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:35.306651 12446 consensus_queue.cc:1048] T aea38e5274ba452894df20a69755dbda P c00025c0f6594942bd14688ade17cb0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:35.319502 12198 raft_consensus.cc:1275] T aea38e5274ba452894df20a69755dbda P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Refusing update from remote peer c00025c0f6594942bd14688ade17cb0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:35.321066 12446 consensus_queue.cc:1048] T aea38e5274ba452894df20a69755dbda P c00025c0f6594942bd14688ade17cb0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:35.325666 12351 raft_consensus.cc:1275] T 03a56ae904c84229be46c9d8773eb639 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Refusing update from remote peer 8094d462961742bdbb1b497a71355a24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:35.327374 12435 consensus_queue.cc:1048] T 03a56ae904c84229be46c9d8773eb639 P 8094d462961742bdbb1b497a71355a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:35.351920 12274 raft_consensus.cc:1275] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Refusing update from remote peer 8094d462961742bdbb1b497a71355a24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:35.355517 12399 consensus_queue.cc:1048] T 03a56ae904c84229be46c9d8773eb639 P 8094d462961742bdbb1b497a71355a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:35.363693 12348 raft_consensus.cc:1275] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Refusing update from remote peer c00025c0f6594942bd14688ade17cb0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:35.365926 12446 consensus_queue.cc:1048] T f3beb77c94044e94a8cf4318a473a13b P c00025c0f6594942bd14688ade17cb0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:35.380336 12198 raft_consensus.cc:1275] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Refusing update from remote peer c00025c0f6594942bd14688ade17cb0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:35.382406 12417 consensus_queue.cc:1048] T f3beb77c94044e94a8cf4318a473a13b P c00025c0f6594942bd14688ade17cb0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:35.424487 12198 raft_consensus.cc:1275] T 0051bc6e9d314fcca7be8439e6fa998f P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Refusing update from remote peer c00025c0f6594942bd14688ade17cb0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:35.426741 12446 consensus_queue.cc:1048] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:35.436795 12348 raft_consensus.cc:1275] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Refusing update from remote peer c00025c0f6594942bd14688ade17cb0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:35.438753 12424 consensus_queue.cc:1048] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:37.411825 12098 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47126:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:37.415330 12098 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:37.492082 12189 tablet_service.cc:1511] Processing CreateTablet for tablet 1ef162d93c6a4ad2bba817bce6bbad60 (DEFAULT_TABLE table=soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:37.493867 12189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ef162d93c6a4ad2bba817bce6bbad60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:37.493472 12263 tablet_service.cc:1511] Processing CreateTablet for tablet 1ef162d93c6a4ad2bba817bce6bbad60 (DEFAULT_TABLE table=soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:37.495865 12263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ef162d93c6a4ad2bba817bce6bbad60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:37.497721 12191 tablet_service.cc:1511] Processing CreateTablet for tablet 6b9f87e57a6d4cb99b1fcd62ea87691b (DEFAULT_TABLE table=soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:37.500000 12264 tablet_service.cc:1511] Processing CreateTablet for tablet 6b9f87e57a6d4cb99b1fcd62ea87691b (DEFAULT_TABLE table=soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:37.504099 12266 tablet_service.cc:1511] Processing CreateTablet for tablet 1e107fbfc8174ff58fb3bdbb9077606a (DEFAULT_TABLE table=soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:37.507903 12267 tablet_service.cc:1511] Processing CreateTablet for tablet a3d34a9b02754ff5ba682f7b6f960ab1 (DEFAULT_TABLE table=soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:37.511895 12192 tablet_service.cc:1511] Processing CreateTablet for tablet a3d34a9b02754ff5ba682f7b6f960ab1 (DEFAULT_TABLE table=soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:37.512135 12190 tablet_service.cc:1511] Processing CreateTablet for tablet 1e107fbfc8174ff58fb3bdbb9077606a (DEFAULT_TABLE table=soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:37.512207 12188 tablet_service.cc:1511] Processing CreateTablet for tablet 6d42d833844a46f48d7b08d9129648b8 (DEFAULT_TABLE table=soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:37.519033 12187 tablet_service.cc:1511] Processing CreateTablet for tablet 0f5ae9bf6da2464a80a3a9c8cf2c54dd (DEFAULT_TABLE table=soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:37.529127 12186 tablet_service.cc:1511] Processing CreateTablet for tablet bcd0d96ef5ec4e6782b4e4a056db2b4f (DEFAULT_TABLE table=soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:37.529577 12265 tablet_service.cc:1511] Processing CreateTablet for tablet 6d42d833844a46f48d7b08d9129648b8 (DEFAULT_TABLE table=soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:37.500744 12191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b9f87e57a6d4cb99b1fcd62ea87691b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:37.531152 12186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcd0d96ef5ec4e6782b4e4a056db2b4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:37.531224 12262 tablet_service.cc:1511] Processing CreateTablet for tablet 0f5ae9bf6da2464a80a3a9c8cf2c54dd (DEFAULT_TABLE table=soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:37.533650 12188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d42d833844a46f48d7b08d9129648b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:37.534721 12187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f5ae9bf6da2464a80a3a9c8cf2c54dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:37.535537 12190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e107fbfc8174ff58fb3bdbb9077606a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:37.538411 12192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3d34a9b02754ff5ba682f7b6f960ab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:37.539999 12262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f5ae9bf6da2464a80a3a9c8cf2c54dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:37.542892 12265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d42d833844a46f48d7b08d9129648b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:37.544023 12336 tablet_service.cc:1511] Processing CreateTablet for tablet 1ef162d93c6a4ad2bba817bce6bbad60 (DEFAULT_TABLE table=soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:37.545540 12267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3d34a9b02754ff5ba682f7b6f960ab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:37.547498 12266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e107fbfc8174ff58fb3bdbb9077606a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:37.549516 12261 tablet_service.cc:1511] Processing CreateTablet for tablet bcd0d96ef5ec4e6782b4e4a056db2b4f (DEFAULT_TABLE table=soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:37.550714 12185 tablet_service.cc:1511] Processing CreateTablet for tablet 49c766b4b3c24f7db3ed4de1e794a0d3 (DEFAULT_TABLE table=soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:37.551039 12261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcd0d96ef5ec4e6782b4e4a056db2b4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:37.552465 12185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49c766b4b3c24f7db3ed4de1e794a0d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:37.554319 12184 tablet_service.cc:1511] Processing CreateTablet for tablet 9036b076f3c64c818c3c9f94f6c4acf9 (DEFAULT_TABLE table=soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:37.553993 12338 tablet_service.cc:1511] Processing CreateTablet for tablet 6b9f87e57a6d4cb99b1fcd62ea87691b (DEFAULT_TABLE table=soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:37.553025 12260 tablet_service.cc:1511] Processing CreateTablet for tablet 49c766b4b3c24f7db3ed4de1e794a0d3 (DEFAULT_TABLE table=soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:37.565476 12264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b9f87e57a6d4cb99b1fcd62ea87691b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:37.555560 12259 tablet_service.cc:1511] Processing CreateTablet for tablet 9036b076f3c64c818c3c9f94f6c4acf9 (DEFAULT_TABLE table=soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:37.555802 12337 tablet_service.cc:1511] Processing CreateTablet for tablet a3d34a9b02754ff5ba682f7b6f960ab1 (DEFAULT_TABLE table=soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:37.558120 12340 tablet_service.cc:1511] Processing CreateTablet for tablet 0f5ae9bf6da2464a80a3a9c8cf2c54dd (DEFAULT_TABLE table=soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:37.559105 12341 tablet_service.cc:1511] Processing CreateTablet for tablet 6d42d833844a46f48d7b08d9129648b8 (DEFAULT_TABLE table=soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:37.569558 12259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9036b076f3c64c818c3c9f94f6c4acf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:37.558145 12339 tablet_service.cc:1511] Processing CreateTablet for tablet 1e107fbfc8174ff58fb3bdbb9077606a (DEFAULT_TABLE table=soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:37.571296 12260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49c766b4b3c24f7db3ed4de1e794a0d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:37.567159 12184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9036b076f3c64c818c3c9f94f6c4acf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:37.552819 12336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ef162d93c6a4ad2bba817bce6bbad60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:37.577875 12337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3d34a9b02754ff5ba682f7b6f960ab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:37.584177 12340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f5ae9bf6da2464a80a3a9c8cf2c54dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:37.585685 12341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d42d833844a46f48d7b08d9129648b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:37.590953 12339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e107fbfc8174ff58fb3bdbb9077606a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:37.597756 12338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b9f87e57a6d4cb99b1fcd62ea87691b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:37.609210 12502 tablet_bootstrap.cc:492] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24: Bootstrap starting.
I20260709 13:05:37.635978 12335 tablet_service.cc:1511] Processing CreateTablet for tablet bcd0d96ef5ec4e6782b4e4a056db2b4f (DEFAULT_TABLE table=soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:37.651583 12335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcd0d96ef5ec4e6782b4e4a056db2b4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:37.678153 12333 tablet_service.cc:1511] Processing CreateTablet for tablet 9036b076f3c64c818c3c9f94f6c4acf9 (DEFAULT_TABLE table=soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:37.678583 12334 tablet_service.cc:1511] Processing CreateTablet for tablet 49c766b4b3c24f7db3ed4de1e794a0d3 (DEFAULT_TABLE table=soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:37.680519 12333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9036b076f3c64c818c3c9f94f6c4acf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:37.689733 12334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49c766b4b3c24f7db3ed4de1e794a0d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:37.716528 12502 tablet_bootstrap.cc:654] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:37.786769 12148 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:05:37.852346 12165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34793, user_credentials={real_user=slave}} blocked reactor thread for 96251.7us
I20260709 13:05:37.860692 12504 tablet_bootstrap.cc:492] T bcd0d96ef5ec4e6782b4e4a056db2b4f P c00025c0f6594942bd14688ade17cb0e: Bootstrap starting.
I20260709 13:05:37.866851 12502 tablet_bootstrap.cc:492] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24: No bootstrap required, opened a new log
I20260709 13:05:37.867751 12502 ts_tablet_manager.cc:1403] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24: Time spent bootstrapping tablet: real 0.259s	user 0.017s	sys 0.027s
I20260709 13:05:37.882874 12502 raft_consensus.cc:359] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:37.883664 12502 raft_consensus.cc:385] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:37.883961 12502 raft_consensus.cc:740] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Initialized, Role: FOLLOWER
I20260709 13:05:37.884752 12502 consensus_queue.cc:260] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:37.887436 12502 ts_tablet_manager.cc:1434] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.002s
I20260709 13:05:37.889001 12502 tablet_bootstrap.cc:492] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24: Bootstrap starting.
I20260709 13:05:37.892007 12504 tablet_bootstrap.cc:654] T bcd0d96ef5ec4e6782b4e4a056db2b4f P c00025c0f6594942bd14688ade17cb0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:37.893708 12506 tablet_bootstrap.cc:492] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Bootstrap starting.
I20260709 13:05:37.903683 12502 tablet_bootstrap.cc:654] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:37.909258 12502 tablet_bootstrap.cc:492] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24: No bootstrap required, opened a new log
I20260709 13:05:37.909746 12502 ts_tablet_manager.cc:1403] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.000s
I20260709 13:05:37.913192 12502 raft_consensus.cc:359] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:37.913981 12502 raft_consensus.cc:385] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:37.914330 12502 raft_consensus.cc:740] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Initialized, Role: FOLLOWER
I20260709 13:05:37.915729 12506 tablet_bootstrap.cc:654] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:37.915405 12502 consensus_queue.cc:260] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:37.918560 12502 ts_tablet_manager.cc:1434] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:05:37.948877 12502 tablet_bootstrap.cc:492] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P 8094d462961742bdbb1b497a71355a24: Bootstrap starting.
I20260709 13:05:37.968117 12504 tablet_bootstrap.cc:492] T bcd0d96ef5ec4e6782b4e4a056db2b4f P c00025c0f6594942bd14688ade17cb0e: No bootstrap required, opened a new log
I20260709 13:05:37.969249 12502 tablet_bootstrap.cc:654] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P 8094d462961742bdbb1b497a71355a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:37.969367 12504 ts_tablet_manager.cc:1403] T bcd0d96ef5ec4e6782b4e4a056db2b4f P c00025c0f6594942bd14688ade17cb0e: Time spent bootstrapping tablet: real 0.109s	user 0.028s	sys 0.009s
I20260709 13:05:37.973356 12504 raft_consensus.cc:359] T bcd0d96ef5ec4e6782b4e4a056db2b4f P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:37.974133 12504 raft_consensus.cc:385] T bcd0d96ef5ec4e6782b4e4a056db2b4f P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:37.974431 12504 raft_consensus.cc:740] T bcd0d96ef5ec4e6782b4e4a056db2b4f P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Initialized, Role: FOLLOWER
I20260709 13:05:37.975317 12504 consensus_queue.cc:260] T bcd0d96ef5ec4e6782b4e4a056db2b4f P c00025c0f6594942bd14688ade17cb0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:37.981164 12506 tablet_bootstrap.cc:492] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: No bootstrap required, opened a new log
I20260709 13:05:37.981875 12506 ts_tablet_manager.cc:1403] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Time spent bootstrapping tablet: real 0.089s	user 0.033s	sys 0.029s
I20260709 13:05:37.983662 12502 tablet_bootstrap.cc:492] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P 8094d462961742bdbb1b497a71355a24: No bootstrap required, opened a new log
I20260709 13:05:37.984543 12502 ts_tablet_manager.cc:1403] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P 8094d462961742bdbb1b497a71355a24: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.007s
I20260709 13:05:37.985262 12504 ts_tablet_manager.cc:1434] T bcd0d96ef5ec4e6782b4e4a056db2b4f P c00025c0f6594942bd14688ade17cb0e: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.003s
I20260709 13:05:37.986804 12504 tablet_bootstrap.cc:492] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e: Bootstrap starting.
I20260709 13:05:37.986804 12506 raft_consensus.cc:359] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:37.987871 12506 raft_consensus.cc:385] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:37.988517 12506 raft_consensus.cc:740] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Initialized, Role: FOLLOWER
I20260709 13:05:37.989732 12506 consensus_queue.cc:260] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:37.993976 12502 raft_consensus.cc:359] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:37.999439 12504 tablet_bootstrap.cc:654] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:37.999919 12502 raft_consensus.cc:385] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:38.000325 12502 raft_consensus.cc:740] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Initialized, Role: FOLLOWER
I20260709 13:05:38.001444 12502 consensus_queue.cc:260] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P 8094d462961742bdbb1b497a71355a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.004935 12502 ts_tablet_manager.cc:1434] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P 8094d462961742bdbb1b497a71355a24: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.004s
I20260709 13:05:38.005339 12506 ts_tablet_manager.cc:1434] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Time spent starting tablet: real 0.023s	user 0.011s	sys 0.000s
I20260709 13:05:38.006778 12502 tablet_bootstrap.cc:492] T 6d42d833844a46f48d7b08d9129648b8 P 8094d462961742bdbb1b497a71355a24: Bootstrap starting.
I20260709 13:05:38.023488 12506 tablet_bootstrap.cc:492] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Bootstrap starting.
I20260709 13:05:38.034116 12502 tablet_bootstrap.cc:654] T 6d42d833844a46f48d7b08d9129648b8 P 8094d462961742bdbb1b497a71355a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:38.037268 12504 tablet_bootstrap.cc:492] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e: No bootstrap required, opened a new log
I20260709 13:05:38.037670 12506 tablet_bootstrap.cc:654] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:38.038353 12504 ts_tablet_manager.cc:1403] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e: Time spent bootstrapping tablet: real 0.052s	user 0.024s	sys 0.021s
I20260709 13:05:38.042578 12504 raft_consensus.cc:359] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.043525 12504 raft_consensus.cc:385] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:38.043856 12504 raft_consensus.cc:740] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Initialized, Role: FOLLOWER
I20260709 13:05:38.044759 12504 consensus_queue.cc:260] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.047654 12504 ts_tablet_manager.cc:1434] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:05:38.050248 12504 tablet_bootstrap.cc:492] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P c00025c0f6594942bd14688ade17cb0e: Bootstrap starting.
I20260709 13:05:38.060820 12504 tablet_bootstrap.cc:654] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P c00025c0f6594942bd14688ade17cb0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:38.073192 12502 tablet_bootstrap.cc:492] T 6d42d833844a46f48d7b08d9129648b8 P 8094d462961742bdbb1b497a71355a24: No bootstrap required, opened a new log
I20260709 13:05:38.073194 12506 tablet_bootstrap.cc:492] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: No bootstrap required, opened a new log
I20260709 13:05:38.074103 12502 ts_tablet_manager.cc:1403] T 6d42d833844a46f48d7b08d9129648b8 P 8094d462961742bdbb1b497a71355a24: Time spent bootstrapping tablet: real 0.068s	user 0.016s	sys 0.013s
I20260709 13:05:38.074103 12506 ts_tablet_manager.cc:1403] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Time spent bootstrapping tablet: real 0.056s	user 0.036s	sys 0.011s
I20260709 13:05:38.077787 12506 raft_consensus.cc:359] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.079049 12506 raft_consensus.cc:385] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:38.079669 12506 raft_consensus.cc:740] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Initialized, Role: FOLLOWER
I20260709 13:05:38.080464 12506 consensus_queue.cc:260] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.078090 12502 raft_consensus.cc:359] T 6d42d833844a46f48d7b08d9129648b8 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.081851 12502 raft_consensus.cc:385] T 6d42d833844a46f48d7b08d9129648b8 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:38.082243 12502 raft_consensus.cc:740] T 6d42d833844a46f48d7b08d9129648b8 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Initialized, Role: FOLLOWER
I20260709 13:05:38.083096 12506 ts_tablet_manager.cc:1434] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:05:38.083112 12502 consensus_queue.cc:260] T 6d42d833844a46f48d7b08d9129648b8 P 8094d462961742bdbb1b497a71355a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.084451 12506 tablet_bootstrap.cc:492] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Bootstrap starting.
I20260709 13:05:38.086181 12502 ts_tablet_manager.cc:1434] T 6d42d833844a46f48d7b08d9129648b8 P 8094d462961742bdbb1b497a71355a24: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:05:38.087764 12502 tablet_bootstrap.cc:492] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24: Bootstrap starting.
I20260709 13:05:38.092512 12506 tablet_bootstrap.cc:654] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:38.095989 12502 tablet_bootstrap.cc:654] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:38.105823 12506 tablet_bootstrap.cc:492] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4: No bootstrap required, opened a new log
I20260709 13:05:38.106405 12506 ts_tablet_manager.cc:1403] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Time spent bootstrapping tablet: real 0.022s	user 0.019s	sys 0.000s
I20260709 13:05:38.110985 12506 raft_consensus.cc:359] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.120621 12506 raft_consensus.cc:385] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:38.120997 12506 raft_consensus.cc:740] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Initialized, Role: FOLLOWER
I20260709 13:05:38.122068 12504 tablet_bootstrap.cc:492] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P c00025c0f6594942bd14688ade17cb0e: No bootstrap required, opened a new log
I20260709 13:05:38.122359 12502 tablet_bootstrap.cc:492] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24: No bootstrap required, opened a new log
I20260709 13:05:38.124689 12504 ts_tablet_manager.cc:1403] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P c00025c0f6594942bd14688ade17cb0e: Time spent bootstrapping tablet: real 0.075s	user 0.019s	sys 0.007s
I20260709 13:05:38.126065 12502 ts_tablet_manager.cc:1403] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.011s
I20260709 13:05:38.122637 12506 consensus_queue.cc:260] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.129688 12502 raft_consensus.cc:359] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.129745 12504 raft_consensus.cc:359] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.130863 12502 raft_consensus.cc:385] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:38.130883 12504 raft_consensus.cc:385] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:38.131434 12502 raft_consensus.cc:740] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Initialized, Role: FOLLOWER
I20260709 13:05:38.131461 12504 raft_consensus.cc:740] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Initialized, Role: FOLLOWER
I20260709 13:05:38.133111 12502 consensus_queue.cc:260] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.136217 12506 ts_tablet_manager.cc:1434] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Time spent starting tablet: real 0.029s	user 0.011s	sys 0.000s
I20260709 13:05:38.137189 12502 ts_tablet_manager.cc:1434] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:05:38.137902 12506 tablet_bootstrap.cc:492] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Bootstrap starting.
I20260709 13:05:38.133107 12504 consensus_queue.cc:260] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P c00025c0f6594942bd14688ade17cb0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.148260 12506 tablet_bootstrap.cc:654] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:38.149402 12504 ts_tablet_manager.cc:1434] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P c00025c0f6594942bd14688ade17cb0e: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.000s
I20260709 13:05:38.150713 12504 tablet_bootstrap.cc:492] T a3d34a9b02754ff5ba682f7b6f960ab1 P c00025c0f6594942bd14688ade17cb0e: Bootstrap starting.
I20260709 13:05:38.151751 12502 tablet_bootstrap.cc:492] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24: Bootstrap starting.
I20260709 13:05:38.160633 12502 tablet_bootstrap.cc:654] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:38.162259 12504 tablet_bootstrap.cc:654] T a3d34a9b02754ff5ba682f7b6f960ab1 P c00025c0f6594942bd14688ade17cb0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:38.179077 12502 tablet_bootstrap.cc:492] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24: No bootstrap required, opened a new log
I20260709 13:05:38.179746 12502 ts_tablet_manager.cc:1403] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.014s
I20260709 13:05:38.179900 12504 tablet_bootstrap.cc:492] T a3d34a9b02754ff5ba682f7b6f960ab1 P c00025c0f6594942bd14688ade17cb0e: No bootstrap required, opened a new log
I20260709 13:05:38.180611 12504 ts_tablet_manager.cc:1403] T a3d34a9b02754ff5ba682f7b6f960ab1 P c00025c0f6594942bd14688ade17cb0e: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.003s
I20260709 13:05:38.183782 12502 raft_consensus.cc:359] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.183962 12504 raft_consensus.cc:359] T a3d34a9b02754ff5ba682f7b6f960ab1 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.184610 12506 tablet_bootstrap.cc:492] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: No bootstrap required, opened a new log
I20260709 13:05:38.184921 12504 raft_consensus.cc:385] T a3d34a9b02754ff5ba682f7b6f960ab1 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:38.184866 12502 raft_consensus.cc:385] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:38.185643 12502 raft_consensus.cc:740] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Initialized, Role: FOLLOWER
I20260709 13:05:38.185540 12504 raft_consensus.cc:740] T a3d34a9b02754ff5ba682f7b6f960ab1 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Initialized, Role: FOLLOWER
I20260709 13:05:38.186654 12504 consensus_queue.cc:260] T a3d34a9b02754ff5ba682f7b6f960ab1 P c00025c0f6594942bd14688ade17cb0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.186687 12502 consensus_queue.cc:260] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.190354 12504 ts_tablet_manager.cc:1434] T a3d34a9b02754ff5ba682f7b6f960ab1 P c00025c0f6594942bd14688ade17cb0e: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:05:38.194036 12502 ts_tablet_manager.cc:1434] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:05:38.195356 12502 tablet_bootstrap.cc:492] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24: Bootstrap starting.
I20260709 13:05:38.190714 12517 raft_consensus.cc:493] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.196597 12517 raft_consensus.cc:515] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.201051 12198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d42d833844a46f48d7b08d9129648b8" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:38.201937 12198 raft_consensus.cc:2468] T 6d42d833844a46f48d7b08d9129648b8 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in term 0.
I20260709 13:05:38.203212 12502 tablet_bootstrap.cc:654] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:38.204101 12399 raft_consensus.cc:493] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.204468 12317 leader_election.cc:304] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 
I20260709 13:05:38.205147 12399 raft_consensus.cc:515] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.205886 12436 raft_consensus.cc:2804] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:38.206336 12436 raft_consensus.cc:493] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:38.206693 12436 raft_consensus.cc:3060] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:38.208879 12274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcd0d96ef5ec4e6782b4e4a056db2b4f" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:38.209633 12274 raft_consensus.cc:2468] T bcd0d96ef5ec4e6782b4e4a056db2b4f P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 0.
I20260709 13:05:38.212337 12165 leader_election.cc:304] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e; no voters: 
I20260709 13:05:38.213376 12503 raft_consensus.cc:2804] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:38.213774 12503 raft_consensus.cc:493] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:38.207707 12399 leader_election.cc:290] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:38.214067 12351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcd0d96ef5ec4e6782b4e4a056db2b4f" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:38.192763 12504 tablet_bootstrap.cc:492] T 6d42d833844a46f48d7b08d9129648b8 P c00025c0f6594942bd14688ade17cb0e: Bootstrap starting.
I20260709 13:05:38.214112 12503 raft_consensus.cc:3060] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:38.221948 12165 leader_election.cc:343] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:38.222445 12517 leader_election.cc:290] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:38.223297 12504 tablet_bootstrap.cc:654] T 6d42d833844a46f48d7b08d9129648b8 P c00025c0f6594942bd14688ade17cb0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:38.225637 12506 ts_tablet_manager.cc:1403] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Time spent bootstrapping tablet: real 0.088s	user 0.029s	sys 0.015s
I20260709 13:05:38.232774 12274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d42d833844a46f48d7b08d9129648b8" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
W20260709 13:05:38.235210 12314 leader_election.cc:343] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:38.239077 12436 raft_consensus.cc:515] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.243341 12198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d42d833844a46f48d7b08d9129648b8" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24"
I20260709 13:05:38.244117 12198 raft_consensus.cc:3060] T 6d42d833844a46f48d7b08d9129648b8 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:38.246258 12503 raft_consensus.cc:515] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.235329 12506 raft_consensus.cc:359] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.254861 12274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcd0d96ef5ec4e6782b4e4a056db2b4f" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
I20260709 13:05:38.261034 12274 raft_consensus.cc:3060] T bcd0d96ef5ec4e6782b4e4a056db2b4f P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:38.262406 12275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d42d833844a46f48d7b08d9129648b8" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
W20260709 13:05:38.264307 12314 leader_election.cc:343] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:38.265172 12436 leader_election.cc:290] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 election: Requested vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:38.259334 12198 raft_consensus.cc:2468] T 6d42d833844a46f48d7b08d9129648b8 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in term 1.
I20260709 13:05:38.259989 12506 raft_consensus.cc:385] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:38.270072 12506 raft_consensus.cc:740] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Initialized, Role: FOLLOWER
I20260709 13:05:38.271199 12506 consensus_queue.cc:260] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.274705 12506 ts_tablet_manager.cc:1434] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Time spent starting tablet: real 0.044s	user 0.009s	sys 0.001s
I20260709 13:05:38.279402 12506 tablet_bootstrap.cc:492] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Bootstrap starting.
I20260709 13:05:38.280864 12317 leader_election.cc:304] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:38.282233 12503 leader_election.cc:290] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 election: Requested vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:38.290410 12351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcd0d96ef5ec4e6782b4e4a056db2b4f" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
I20260709 13:05:38.293159 12502 tablet_bootstrap.cc:492] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24: No bootstrap required, opened a new log
I20260709 13:05:38.293591 12504 tablet_bootstrap.cc:492] T 6d42d833844a46f48d7b08d9129648b8 P c00025c0f6594942bd14688ade17cb0e: No bootstrap required, opened a new log
I20260709 13:05:38.294175 12502 ts_tablet_manager.cc:1403] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24: Time spent bootstrapping tablet: real 0.099s	user 0.016s	sys 0.005s
I20260709 13:05:38.294340 12504 ts_tablet_manager.cc:1403] T 6d42d833844a46f48d7b08d9129648b8 P c00025c0f6594942bd14688ade17cb0e: Time spent bootstrapping tablet: real 0.102s	user 0.027s	sys 0.037s
I20260709 13:05:38.297724 12446 raft_consensus.cc:493] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.298288 12446 raft_consensus.cc:515] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.300798 12446 leader_election.cc:290] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:38.301844 12198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9036b076f3c64c818c3c9f94f6c4acf9" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:38.302773 12351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9036b076f3c64c818c3c9f94f6c4acf9" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:38.304216 12351 raft_consensus.cc:2468] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 0.
W20260709 13:05:38.301120 12165 leader_election.cc:343] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:38.304721 12502 raft_consensus.cc:359] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
W20260709 13:05:38.305292 12243 leader_election.cc:343] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:38.305598 12502 raft_consensus.cc:385] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:38.305963 12502 raft_consensus.cc:740] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Initialized, Role: FOLLOWER
I20260709 13:05:38.306367 12240 leader_election.cc:304] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24
I20260709 13:05:38.306813 12502 consensus_queue.cc:260] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.307750 12446 raft_consensus.cc:2804] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:38.308151 12446 raft_consensus.cc:493] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:38.308501 12446 raft_consensus.cc:3060] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:38.311393 12502 ts_tablet_manager.cc:1434] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:05:38.302419 12436 raft_consensus.cc:2804] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:38.312963 12502 tablet_bootstrap.cc:492] T 49c766b4b3c24f7db3ed4de1e794a0d3 P 8094d462961742bdbb1b497a71355a24: Bootstrap starting.
I20260709 13:05:38.313323 12436 raft_consensus.cc:697] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 LEADER]: Becoming Leader. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Running, Role: LEADER
I20260709 13:05:38.314621 12503 raft_consensus.cc:493] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.314378 12436 consensus_queue.cc:237] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.315210 12503 raft_consensus.cc:515] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.317447 12504 raft_consensus.cc:359] T 6d42d833844a46f48d7b08d9129648b8 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.318295 12504 raft_consensus.cc:385] T 6d42d833844a46f48d7b08d9129648b8 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:38.318647 12504 raft_consensus.cc:740] T 6d42d833844a46f48d7b08d9129648b8 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Initialized, Role: FOLLOWER
I20260709 13:05:38.319507 12503 leader_election.cc:290] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:38.319834 12275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9f87e57a6d4cb99b1fcd62ea87691b" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:38.319684 12504 consensus_queue.cc:260] T 6d42d833844a46f48d7b08d9129648b8 P c00025c0f6594942bd14688ade17cb0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
W20260709 13:05:38.322335 12165 leader_election.cc:343] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:38.324275 12351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9f87e57a6d4cb99b1fcd62ea87691b" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
W20260709 13:05:38.326102 12165 leader_election.cc:343] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:38.326625 12165 leader_election.cc:304] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8094d462961742bdbb1b497a71355a24; no voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:38.326964 12504 ts_tablet_manager.cc:1434] T 6d42d833844a46f48d7b08d9129648b8 P c00025c0f6594942bd14688ade17cb0e: Time spent starting tablet: real 0.032s	user 0.011s	sys 0.002s
I20260709 13:05:38.327941 12503 raft_consensus.cc:2749] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:38.329360 12274 raft_consensus.cc:2468] T bcd0d96ef5ec4e6782b4e4a056db2b4f P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 1.
I20260709 13:05:38.331195 12165 leader_election.cc:304] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e; no voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:38.332953 12502 tablet_bootstrap.cc:654] T 49c766b4b3c24f7db3ed4de1e794a0d3 P 8094d462961742bdbb1b497a71355a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:38.332901 12503 raft_consensus.cc:2804] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:38.335414 12503 raft_consensus.cc:697] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [term 1 LEADER]: Becoming Leader. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Running, Role: LEADER
I20260709 13:05:38.336745 12503 consensus_queue.cc:237] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.342167 12506 tablet_bootstrap.cc:654] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:38.342825 12504 tablet_bootstrap.cc:492] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e: Bootstrap starting.
I20260709 13:05:38.347720 12523 raft_consensus.cc:493] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.348390 12523 raft_consensus.cc:515] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.358208 12523 leader_election.cc:290] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:38.367548 12198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f5ae9bf6da2464a80a3a9c8cf2c54dd" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:38.369021 12198 raft_consensus.cc:2468] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 0.
I20260709 13:05:38.371944 12243 leader_election.cc:304] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e; no voters: 
I20260709 13:05:38.373440 12351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f5ae9bf6da2464a80a3a9c8cf2c54dd" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
W20260709 13:05:38.376104 12240 leader_election.cc:343] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:38.379683 12524 raft_consensus.cc:2804] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:38.380725 12524 raft_consensus.cc:493] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:38.381469 12524 raft_consensus.cc:3060] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:38.380262 12504 tablet_bootstrap.cc:654] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:38.397028 12502 tablet_bootstrap.cc:492] T 49c766b4b3c24f7db3ed4de1e794a0d3 P 8094d462961742bdbb1b497a71355a24: No bootstrap required, opened a new log
I20260709 13:05:38.398553 12502 ts_tablet_manager.cc:1403] T 49c766b4b3c24f7db3ed4de1e794a0d3 P 8094d462961742bdbb1b497a71355a24: Time spent bootstrapping tablet: real 0.086s	user 0.008s	sys 0.011s
I20260709 13:05:38.399425 12506 tablet_bootstrap.cc:492] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4: No bootstrap required, opened a new log
I20260709 13:05:38.400847 12506 ts_tablet_manager.cc:1403] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Time spent bootstrapping tablet: real 0.122s	user 0.018s	sys 0.003s
I20260709 13:05:38.411595 12446 raft_consensus.cc:515] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.416237 12100 catalog_manager.cc:5697] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8094d462961742bdbb1b497a71355a24 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "8094d462961742bdbb1b497a71355a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:38.418355 12502 raft_consensus.cc:359] T 49c766b4b3c24f7db3ed4de1e794a0d3 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.419538 12502 raft_consensus.cc:385] T 49c766b4b3c24f7db3ed4de1e794a0d3 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:38.419862 12502 raft_consensus.cc:740] T 49c766b4b3c24f7db3ed4de1e794a0d3 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Initialized, Role: FOLLOWER
I20260709 13:05:38.420938 12198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9036b076f3c64c818c3c9f94f6c4acf9" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24"
I20260709 13:05:38.421151 12098 catalog_manager.cc:5697] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:38.422560 12243 leader_election.cc:343] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:38.431527 12506 raft_consensus.cc:359] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.433281 12506 raft_consensus.cc:385] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:38.433391 12351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9036b076f3c64c818c3c9f94f6c4acf9" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
I20260709 13:05:38.437654 12506 raft_consensus.cc:740] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Initialized, Role: FOLLOWER
I20260709 13:05:38.437862 12351 raft_consensus.cc:3060] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:38.439370 12506 consensus_queue.cc:260] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.452358 12446 leader_election.cc:290] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 election: Requested vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:38.456984 12351 raft_consensus.cc:2468] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 1.
I20260709 13:05:38.457443 12502 consensus_queue.cc:260] T 49c766b4b3c24f7db3ed4de1e794a0d3 P 8094d462961742bdbb1b497a71355a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.460240 12240 leader_election.cc:304] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24
I20260709 13:05:38.461427 12502 ts_tablet_manager.cc:1434] T 49c766b4b3c24f7db3ed4de1e794a0d3 P 8094d462961742bdbb1b497a71355a24: Time spent starting tablet: real 0.062s	user 0.010s	sys 0.002s
I20260709 13:05:38.462589 12502 tablet_bootstrap.cc:492] T 9036b076f3c64c818c3c9f94f6c4acf9 P 8094d462961742bdbb1b497a71355a24: Bootstrap starting.
I20260709 13:05:38.463462 12446 raft_consensus.cc:2804] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:38.464236 12446 raft_consensus.cc:697] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [term 1 LEADER]: Becoming Leader. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Running, Role: LEADER
I20260709 13:05:38.465183 12446 consensus_queue.cc:237] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.472107 12502 tablet_bootstrap.cc:654] T 9036b076f3c64c818c3c9f94f6c4acf9 P 8094d462961742bdbb1b497a71355a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:38.441589 12524 raft_consensus.cc:515] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.490679 12198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f5ae9bf6da2464a80a3a9c8cf2c54dd" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24"
I20260709 13:05:38.497723 12198 raft_consensus.cc:3060] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:38.501797 12097 catalog_manager.cc:5697] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e reported cstate change: term changed from 0 to 1, leader changed from <none> to c00025c0f6594942bd14688ade17cb0e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c00025c0f6594942bd14688ade17cb0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:38.503300 12504 tablet_bootstrap.cc:492] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e: No bootstrap required, opened a new log
I20260709 13:05:38.504172 12504 ts_tablet_manager.cc:1403] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e: Time spent bootstrapping tablet: real 0.162s	user 0.024s	sys 0.018s
I20260709 13:05:38.508822 12399 raft_consensus.cc:493] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.509490 12399 raft_consensus.cc:515] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.511519 12524 leader_election.cc:290] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 election: Requested vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:38.490154 12506 ts_tablet_manager.cc:1434] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Time spent starting tablet: real 0.084s	user 0.011s	sys 0.002s
I20260709 13:05:38.512861 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f5ae9bf6da2464a80a3a9c8cf2c54dd" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
I20260709 13:05:38.514955 12351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ef162d93c6a4ad2bba817bce6bbad60" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:38.523113 12198 raft_consensus.cc:2468] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 1.
I20260709 13:05:38.515899 12504 raft_consensus.cc:359] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.516358 12274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ef162d93c6a4ad2bba817bce6bbad60" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:38.524155 12504 raft_consensus.cc:385] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:38.524531 12504 raft_consensus.cc:740] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Initialized, Role: FOLLOWER
I20260709 13:05:38.512599 12399 leader_election.cc:290] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:38.519111 12502 tablet_bootstrap.cc:492] T 9036b076f3c64c818c3c9f94f6c4acf9 P 8094d462961742bdbb1b497a71355a24: No bootstrap required, opened a new log
I20260709 13:05:38.524902 12243 leader_election.cc:304] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e; no voters: 
I20260709 13:05:38.525578 12502 ts_tablet_manager.cc:1403] T 9036b076f3c64c818c3c9f94f6c4acf9 P 8094d462961742bdbb1b497a71355a24: Time spent bootstrapping tablet: real 0.063s	user 0.015s	sys 0.007s
W20260709 13:05:38.525483 12165 leader_election.cc:343] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:38.526273 12523 raft_consensus.cc:2804] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:05:38.526880 12165 leader_election.cc:343] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:38.527498 12165 leader_election.cc:304] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8094d462961742bdbb1b497a71355a24; no voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:38.528369 12399 raft_consensus.cc:2749] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:38.529798 12502 raft_consensus.cc:359] T 9036b076f3c64c818c3c9f94f6c4acf9 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.531091 12502 raft_consensus.cc:385] T 9036b076f3c64c818c3c9f94f6c4acf9 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:38.531514 12502 raft_consensus.cc:740] T 9036b076f3c64c818c3c9f94f6c4acf9 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Initialized, Role: FOLLOWER
W20260709 13:05:38.531327 12240 leader_election.cc:343] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:38.533483 12502 consensus_queue.cc:260] T 9036b076f3c64c818c3c9f94f6c4acf9 P 8094d462961742bdbb1b497a71355a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.533496 12504 consensus_queue.cc:260] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.540594 12502 ts_tablet_manager.cc:1434] T 9036b076f3c64c818c3c9f94f6c4acf9 P 8094d462961742bdbb1b497a71355a24: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.001s
I20260709 13:05:38.544938 12523 raft_consensus.cc:697] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P c00025c0f6594942bd14688ade17cb0e [term 1 LEADER]: Becoming Leader. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Running, Role: LEADER
I20260709 13:05:38.546301 12523 consensus_queue.cc:237] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P c00025c0f6594942bd14688ade17cb0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.549772 12506 tablet_bootstrap.cc:492] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Bootstrap starting.
I20260709 13:05:38.551364 12399 raft_consensus.cc:493] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.552004 12399 raft_consensus.cc:515] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.554644 12399 leader_election.cc:290] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:38.555840 12436 raft_consensus.cc:493] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.556465 12436 raft_consensus.cc:515] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.559126 12504 ts_tablet_manager.cc:1434] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e: Time spent starting tablet: real 0.055s	user 0.009s	sys 0.003s
I20260709 13:05:38.559266 12517 raft_consensus.cc:493] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.574534 12504 tablet_bootstrap.cc:492] T 1e107fbfc8174ff58fb3bdbb9077606a P c00025c0f6594942bd14688ade17cb0e: Bootstrap starting.
I20260709 13:05:38.574318 12517 raft_consensus.cc:515] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.560906 12274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d34a9b02754ff5ba682f7b6f960ab1" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:38.566666 12446 raft_consensus.cc:493] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.578361 12274 raft_consensus.cc:2468] T a3d34a9b02754ff5ba682f7b6f960ab1 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 0.
I20260709 13:05:38.578379 12446 raft_consensus.cc:515] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.579335 12506 tablet_bootstrap.cc:654] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:38.580981 12274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e107fbfc8174ff58fb3bdbb9077606a" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:38.581284 12165 leader_election.cc:304] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e; no voters: 
I20260709 13:05:38.583062 12351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9f87e57a6d4cb99b1fcd62ea87691b" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:38.583607 12517 leader_election.cc:290] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
W20260709 13:05:38.584393 12314 leader_election.cc:343] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:38.584501 12200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9f87e57a6d4cb99b1fcd62ea87691b" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:38.585282 12200 raft_consensus.cc:2468] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 0.
W20260709 13:05:38.587114 12240 leader_election.cc:343] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:38.570164 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d34a9b02754ff5ba682f7b6f960ab1" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:38.587914 12348 raft_consensus.cc:2468] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 0.
I20260709 13:05:38.589042 12243 leader_election.cc:304] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e; no voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:38.590103 12523 raft_consensus.cc:2804] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:38.590471 12523 raft_consensus.cc:493] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:38.590808 12523 raft_consensus.cc:3060] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:38.581128 12446 leader_election.cc:290] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:38.597855 12097 catalog_manager.cc:5697] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P c00025c0f6594942bd14688ade17cb0e reported cstate change: term changed from 0 to 1, leader changed from <none> to c00025c0f6594942bd14688ade17cb0e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c00025c0f6594942bd14688ade17cb0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:38.599670 12503 raft_consensus.cc:2804] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:38.600179 12503 raft_consensus.cc:493] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:38.600535 12503 raft_consensus.cc:3060] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:38.608320 12436 leader_election.cc:290] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:38.609594 12503 raft_consensus.cc:515] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.611408 12200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d34a9b02754ff5ba682f7b6f960ab1" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:38.613991 12274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d34a9b02754ff5ba682f7b6f960ab1" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
I20260709 13:05:38.618620 12274 raft_consensus.cc:3060] T a3d34a9b02754ff5ba682f7b6f960ab1 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:38.614207 12275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d34a9b02754ff5ba682f7b6f960ab1" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:38.617506 12399 raft_consensus.cc:493] T 49c766b4b3c24f7db3ed4de1e794a0d3 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.625059 12399 raft_consensus.cc:515] T 49c766b4b3c24f7db3ed4de1e794a0d3 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.629204 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c766b4b3c24f7db3ed4de1e794a0d3" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:38.629854 12275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c766b4b3c24f7db3ed4de1e794a0d3" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
W20260709 13:05:38.631870 12165 leader_election.cc:343] T 49c766b4b3c24f7db3ed4de1e794a0d3 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:38.633634 12539 raft_consensus.cc:493] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:38.634377 12165 leader_election.cc:343] T 49c766b4b3c24f7db3ed4de1e794a0d3 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:38.634991 12165 leader_election.cc:304] T 49c766b4b3c24f7db3ed4de1e794a0d3 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8094d462961742bdbb1b497a71355a24; no voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:38.635744 12198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e107fbfc8174ff58fb3bdbb9077606a" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:38.637948 12399 leader_election.cc:290] T 49c766b4b3c24f7db3ed4de1e794a0d3 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:38.638530 12399 raft_consensus.cc:2749] T 49c766b4b3c24f7db3ed4de1e794a0d3 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:38.617465 12523 raft_consensus.cc:515] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.640654 12539 raft_consensus.cc:515] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.643733 12202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9f87e57a6d4cb99b1fcd62ea87691b" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24"
I20260709 13:05:38.613049 12200 raft_consensus.cc:2393] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in current term 1: Already voted for candidate 8094d462961742bdbb1b497a71355a24 in this term.
I20260709 13:05:38.644660 12202 raft_consensus.cc:3060] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:38.647236 12523 leader_election.cc:290] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 election: Requested vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:38.647439 12274 raft_consensus.cc:2468] T a3d34a9b02754ff5ba682f7b6f960ab1 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 1.
I20260709 13:05:38.643733 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9f87e57a6d4cb99b1fcd62ea87691b" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
I20260709 13:05:38.646456 12503 leader_election.cc:290] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 election: Requested vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
W20260709 13:05:38.651865 12240 leader_election.cc:343] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:38.645864 12317 leader_election.cc:304] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:38.652529 12274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e107fbfc8174ff58fb3bdbb9077606a" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:38.653021 12436 raft_consensus.cc:3060] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:38.654676 12165 leader_election.cc:304] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e; no voters: 
W20260709 13:05:38.655797 12165 leader_election.cc:343] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:38.656638 12503 raft_consensus.cc:2804] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:38.657215 12503 raft_consensus.cc:697] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [term 1 LEADER]: Becoming Leader. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Running, Role: LEADER
I20260709 13:05:38.658078 12503 consensus_queue.cc:237] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.658898 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e107fbfc8174ff58fb3bdbb9077606a" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:38.659893 12348 raft_consensus.cc:2468] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 0.
I20260709 13:05:38.646027 12198 raft_consensus.cc:2468] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in term 0.
I20260709 13:05:38.661408 12523 raft_consensus.cc:493] T 6d42d833844a46f48d7b08d9129648b8 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.649260 12504 tablet_bootstrap.cc:654] T 1e107fbfc8174ff58fb3bdbb9077606a P c00025c0f6594942bd14688ade17cb0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:38.665671 12165 leader_election.cc:304] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:38.665939 12523 raft_consensus.cc:515] T 6d42d833844a46f48d7b08d9129648b8 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.665112 12436 raft_consensus.cc:2749] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:38.664492 12351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d34a9b02754ff5ba682f7b6f960ab1" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
I20260709 13:05:38.667189 12540 raft_consensus.cc:2804] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:38.671281 12540 raft_consensus.cc:493] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:38.672600 12202 raft_consensus.cc:2468] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 1.
I20260709 13:05:38.674862 12198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d42d833844a46f48d7b08d9129648b8" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:38.673774 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d42d833844a46f48d7b08d9129648b8" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:38.644260 12539 leader_election.cc:290] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:38.675709 12243 leader_election.cc:304] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e; no voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:38.677048 12198 raft_consensus.cc:2393] T 6d42d833844a46f48d7b08d9129648b8 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c00025c0f6594942bd14688ade17cb0e in current term 1: Already voted for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in this term.
I20260709 13:05:38.679438 12534 raft_consensus.cc:2804] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:38.680075 12506 tablet_bootstrap.cc:492] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P f706a4ebbb9e4c9f9d0a9259f1ac73e4: No bootstrap required, opened a new log
I20260709 13:05:38.667205 12317 leader_election.cc:304] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:38.680084 12534 raft_consensus.cc:697] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e [term 1 LEADER]: Becoming Leader. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Running, Role: LEADER
I20260709 13:05:38.681422 12243 leader_election.cc:304] T 6d42d833844a46f48d7b08d9129648b8 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e; no voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:38.682147 12534 consensus_queue.cc:237] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.683525 12446 raft_consensus.cc:3060] T 6d42d833844a46f48d7b08d9129648b8 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:38.685474 12540 raft_consensus.cc:3060] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:38.687508 12517 raft_consensus.cc:2804] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:38.688294 12517 raft_consensus.cc:493] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:38.688660 12517 raft_consensus.cc:3060] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:38.689271 12351 raft_consensus.cc:2468] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 1.
I20260709 13:05:38.697548 12540 raft_consensus.cc:515] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.698961 12504 tablet_bootstrap.cc:492] T 1e107fbfc8174ff58fb3bdbb9077606a P c00025c0f6594942bd14688ade17cb0e: No bootstrap required, opened a new log
I20260709 13:05:38.699846 12504 ts_tablet_manager.cc:1403] T 1e107fbfc8174ff58fb3bdbb9077606a P c00025c0f6594942bd14688ade17cb0e: Time spent bootstrapping tablet: real 0.126s	user 0.015s	sys 0.006s
I20260709 13:05:38.701650 12274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e107fbfc8174ff58fb3bdbb9077606a" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
W20260709 13:05:38.703393 12165 leader_election.cc:343] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:38.700834 12097 catalog_manager.cc:5697] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8094d462961742bdbb1b497a71355a24 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "8094d462961742bdbb1b497a71355a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:38.703835 12504 raft_consensus.cc:359] T 1e107fbfc8174ff58fb3bdbb9077606a P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.704840 12504 raft_consensus.cc:385] T 1e107fbfc8174ff58fb3bdbb9077606a P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:38.705211 12504 raft_consensus.cc:740] T 1e107fbfc8174ff58fb3bdbb9077606a P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Initialized, Role: FOLLOWER
I20260709 13:05:38.706125 12504 consensus_queue.cc:260] T 1e107fbfc8174ff58fb3bdbb9077606a P c00025c0f6594942bd14688ade17cb0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.708078 12351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e107fbfc8174ff58fb3bdbb9077606a" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
I20260709 13:05:38.708928 12540 leader_election.cc:290] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 election: Requested vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:38.681154 12506 ts_tablet_manager.cc:1403] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Time spent bootstrapping tablet: real 0.132s	user 0.031s	sys 0.014s
I20260709 13:05:38.716709 12504 ts_tablet_manager.cc:1434] T 1e107fbfc8174ff58fb3bdbb9077606a P c00025c0f6594942bd14688ade17cb0e: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.004s
I20260709 13:05:38.718111 12504 tablet_bootstrap.cc:492] T 49c766b4b3c24f7db3ed4de1e794a0d3 P c00025c0f6594942bd14688ade17cb0e: Bootstrap starting.
I20260709 13:05:38.675637 12523 leader_election.cc:290] T 6d42d833844a46f48d7b08d9129648b8 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:38.720985 12506 raft_consensus.cc:359] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.721902 12506 raft_consensus.cc:385] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:38.722245 12506 raft_consensus.cc:740] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Initialized, Role: FOLLOWER
I20260709 13:05:38.726778 12504 tablet_bootstrap.cc:654] T 49c766b4b3c24f7db3ed4de1e794a0d3 P c00025c0f6594942bd14688ade17cb0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:38.723265 12506 consensus_queue.cc:260] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.732847 12446 raft_consensus.cc:2749] T 6d42d833844a46f48d7b08d9129648b8 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:38.738914 12517 raft_consensus.cc:515] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.740746 12506 ts_tablet_manager.cc:1434] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.001s
I20260709 13:05:38.741492 12351 raft_consensus.cc:2393] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8094d462961742bdbb1b497a71355a24 in current term 1: Already voted for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in this term.
I20260709 13:05:38.756489 12098 catalog_manager.cc:5697] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e reported cstate change: term changed from 0 to 1, leader changed from <none> to c00025c0f6594942bd14688ade17cb0e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c00025c0f6594942bd14688ade17cb0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:38.790635 12540 consensus_queue.cc:1048] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:05:38.791039 12148 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:38.828027 12506 tablet_bootstrap.cc:492] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Bootstrap starting.
I20260709 13:05:38.841006 12534 raft_consensus.cc:493] T 1e107fbfc8174ff58fb3bdbb9077606a P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.828588 12274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e107fbfc8174ff58fb3bdbb9077606a" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
I20260709 13:05:38.842718 12534 raft_consensus.cc:515] T 1e107fbfc8174ff58fb3bdbb9077606a P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.844506 12274 raft_consensus.cc:3060] T 1e107fbfc8174ff58fb3bdbb9077606a P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:38.847865 12534 leader_election.cc:290] T 1e107fbfc8174ff58fb3bdbb9077606a P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:38.848066 12202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e107fbfc8174ff58fb3bdbb9077606a" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:38.828416 12517 leader_election.cc:290] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 election: Requested vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:38.849649 12202 raft_consensus.cc:2393] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c00025c0f6594942bd14688ade17cb0e in current term 1: Already voted for candidate 8094d462961742bdbb1b497a71355a24 in this term.
I20260709 13:05:38.841684 12198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e107fbfc8174ff58fb3bdbb9077606a" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24"
I20260709 13:05:38.853017 12351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e107fbfc8174ff58fb3bdbb9077606a" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:38.855422 12351 raft_consensus.cc:2393] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c00025c0f6594942bd14688ade17cb0e in current term 1: Already voted for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in this term.
I20260709 13:05:38.856220 12504 tablet_bootstrap.cc:492] T 49c766b4b3c24f7db3ed4de1e794a0d3 P c00025c0f6594942bd14688ade17cb0e: No bootstrap required, opened a new log
I20260709 13:05:38.857161 12504 ts_tablet_manager.cc:1403] T 49c766b4b3c24f7db3ed4de1e794a0d3 P c00025c0f6594942bd14688ade17cb0e: Time spent bootstrapping tablet: real 0.139s	user 0.016s	sys 0.009s
I20260709 13:05:38.853986 12198 raft_consensus.cc:2393] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in current term 1: Already voted for candidate 8094d462961742bdbb1b497a71355a24 in this term.
I20260709 13:05:38.859822 12504 raft_consensus.cc:359] T 49c766b4b3c24f7db3ed4de1e794a0d3 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.860348 12504 raft_consensus.cc:385] T 49c766b4b3c24f7db3ed4de1e794a0d3 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:38.860507 12504 raft_consensus.cc:740] T 49c766b4b3c24f7db3ed4de1e794a0d3 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Initialized, Role: FOLLOWER
I20260709 13:05:38.861243 12504 consensus_queue.cc:260] T 49c766b4b3c24f7db3ed4de1e794a0d3 P c00025c0f6594942bd14688ade17cb0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.863296 12240 leader_election.cc:304] T 1e107fbfc8174ff58fb3bdbb9077606a P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e; no voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:38.863381 12504 ts_tablet_manager.cc:1434] T 49c766b4b3c24f7db3ed4de1e794a0d3 P c00025c0f6594942bd14688ade17cb0e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:05:38.865285 12504 tablet_bootstrap.cc:492] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e: Bootstrap starting.
I20260709 13:05:38.874123 12351 raft_consensus.cc:3060] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:38.880009 12506 tablet_bootstrap.cc:654] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:38.889678 12517 raft_consensus.cc:493] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.890455 12517 raft_consensus.cc:515] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.892341 12504 tablet_bootstrap.cc:654] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:38.905237 12517 leader_election.cc:290] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:38.903030 12276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcd0d96ef5ec4e6782b4e4a056db2b4f" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:38.911379 12198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcd0d96ef5ec4e6782b4e4a056db2b4f" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:38.962209 12506 tablet_bootstrap.cc:492] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4: No bootstrap required, opened a new log
I20260709 13:05:38.962821 12274 raft_consensus.cc:2468] T 1e107fbfc8174ff58fb3bdbb9077606a P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in term 1.
I20260709 13:05:38.966677 12534 raft_consensus.cc:2749] T 1e107fbfc8174ff58fb3bdbb9077606a P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:38.902729 12545 consensus_queue.cc:1048] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:05:38.968461 12165 leader_election.cc:304] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8094d462961742bdbb1b497a71355a24; no voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:38.969244 12506 ts_tablet_manager.cc:1403] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Time spent bootstrapping tablet: real 0.142s	user 0.034s	sys 0.045s
I20260709 13:05:38.971038 12317 leader_election.cc:304] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:38.974457 12540 raft_consensus.cc:2749] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:38.975342 12503 consensus_queue.cc:1048] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:38.976796 12534 raft_consensus.cc:493] T 49c766b4b3c24f7db3ed4de1e794a0d3 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.977502 12534 raft_consensus.cc:515] T 49c766b4b3c24f7db3ed4de1e794a0d3 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.978765 12503 raft_consensus.cc:493] T 9036b076f3c64c818c3c9f94f6c4acf9 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.980616 12504 tablet_bootstrap.cc:492] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e: No bootstrap required, opened a new log
I20260709 13:05:38.980006 12503 raft_consensus.cc:515] T 9036b076f3c64c818c3c9f94f6c4acf9 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:39.006102 12504 ts_tablet_manager.cc:1403] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e: Time spent bootstrapping tablet: real 0.141s	user 0.014s	sys 0.015s
I20260709 13:05:38.985644 12198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c766b4b3c24f7db3ed4de1e794a0d3" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:39.006524 12202 raft_consensus.cc:3060] T 9036b076f3c64c818c3c9f94f6c4acf9 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.007121 12198 raft_consensus.cc:2468] T 49c766b4b3c24f7db3ed4de1e794a0d3 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 0.
I20260709 13:05:38.979992 12534 leader_election.cc:290] T 49c766b4b3c24f7db3ed4de1e794a0d3 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:39.009166 12243 leader_election.cc:304] T 49c766b4b3c24f7db3ed4de1e794a0d3 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e; no voters: 
I20260709 13:05:39.010053 12534 raft_consensus.cc:2804] T 49c766b4b3c24f7db3ed4de1e794a0d3 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:38.981602 12314 leader_election.cc:304] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24
I20260709 13:05:39.010753 12534 raft_consensus.cc:493] T 49c766b4b3c24f7db3ed4de1e794a0d3 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.011264 12545 raft_consensus.cc:2804] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:39.011605 12544 raft_consensus.cc:2749] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:39.011890 12545 raft_consensus.cc:697] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 LEADER]: Becoming Leader. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Running, Role: LEADER
I20260709 13:05:39.012838 12545 consensus_queue.cc:237] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:38.983003 12351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c766b4b3c24f7db3ed4de1e794a0d3" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:38.981390 12517 raft_consensus.cc:493] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.016698 12517 raft_consensus.cc:515] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:39.011238 12534 raft_consensus.cc:3060] T 49c766b4b3c24f7db3ed4de1e794a0d3 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:39.017450 12240 leader_election.cc:343] T 49c766b4b3c24f7db3ed4de1e794a0d3 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:39.017710 12348 raft_consensus.cc:3060] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.018338 12436 consensus_queue.cc:1048] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:38.995986 12523 consensus_queue.cc:1048] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
W20260709 13:05:39.025045 12314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37905, user_credentials={real_user=slave}} blocked reactor thread for 43546.8us
I20260709 13:05:39.027370 12503 leader_election.cc:290] T 9036b076f3c64c818c3c9f94f6c4acf9 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:39.027556 12517 leader_election.cc:290] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:39.028498 12200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f5ae9bf6da2464a80a3a9c8cf2c54dd" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:39.029578 12200 raft_consensus.cc:2393] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in current term 1: Already voted for candidate c00025c0f6594942bd14688ade17cb0e in this term.
I20260709 13:05:39.037516 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9036b076f3c64c818c3c9f94f6c4acf9" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:39.033460 12504 raft_consensus.cc:359] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:39.042011 12276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9036b076f3c64c818c3c9f94f6c4acf9" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:39.042176 12504 raft_consensus.cc:385] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.046406 12504 raft_consensus.cc:740] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.047362 12504 consensus_queue.cc:260] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:39.056787 12165 leader_election.cc:304] T 9036b076f3c64c818c3c9f94f6c4acf9 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8094d462961742bdbb1b497a71355a24; no voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:39.058598 12547 raft_consensus.cc:2749] T 9036b076f3c64c818c3c9f94f6c4acf9 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:39.062436 12276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f5ae9bf6da2464a80a3a9c8cf2c54dd" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:39.066087 12523 consensus_queue.cc:1048] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:39.062932 12099 catalog_manager.cc:5697] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:39.073762 12504 ts_tablet_manager.cc:1434] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.005s
I20260709 13:05:39.078531 12446 consensus_queue.cc:1048] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P c00025c0f6594942bd14688ade17cb0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:05:39.060381 12534 raft_consensus.cc:515] T 49c766b4b3c24f7db3ed4de1e794a0d3 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:39.100540 12534 leader_election.cc:290] T 49c766b4b3c24f7db3ed4de1e794a0d3 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 election: Requested vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:39.103602 12351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c766b4b3c24f7db3ed4de1e794a0d3" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
W20260709 13:05:39.106935 12240 leader_election.cc:343] T 49c766b4b3c24f7db3ed4de1e794a0d3 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:39.107843 12200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c766b4b3c24f7db3ed4de1e794a0d3" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24"
I20260709 13:05:39.108534 12200 raft_consensus.cc:3060] T 49c766b4b3c24f7db3ed4de1e794a0d3 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.089779 12506 raft_consensus.cc:359] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:39.119395 12506 raft_consensus.cc:385] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.119721 12506 raft_consensus.cc:740] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.120721 12506 consensus_queue.cc:260] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:39.075245 12314 leader_election.cc:304] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:39.095337 12503 consensus_queue.cc:1048] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
W20260709 13:05:39.130577 12314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37905, user_credentials={real_user=slave}} blocked reactor thread for 55433us
I20260709 13:05:39.134271 12506 ts_tablet_manager.cc:1434] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Time spent starting tablet: real 0.165s	user 0.009s	sys 0.000s
I20260709 13:05:39.136534 12506 tablet_bootstrap.cc:492] T 49c766b4b3c24f7db3ed4de1e794a0d3 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Bootstrap starting.
I20260709 13:05:39.143250 12200 raft_consensus.cc:2468] T 49c766b4b3c24f7db3ed4de1e794a0d3 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 1.
I20260709 13:05:39.149396 12545 raft_consensus.cc:2749] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:39.158524 12506 tablet_bootstrap.cc:654] T 49c766b4b3c24f7db3ed4de1e794a0d3 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.161329 12547 consensus_queue.cc:1048] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:39.161952 12562 consensus_queue.cc:1048] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P c00025c0f6594942bd14688ade17cb0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:39.163924 12243 leader_election.cc:304] T 49c766b4b3c24f7db3ed4de1e794a0d3 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e; no voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:39.175057 12562 raft_consensus.cc:2804] T 49c766b4b3c24f7db3ed4de1e794a0d3 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:39.176563 12562 raft_consensus.cc:697] T 49c766b4b3c24f7db3ed4de1e794a0d3 P c00025c0f6594942bd14688ade17cb0e [term 1 LEADER]: Becoming Leader. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Running, Role: LEADER
I20260709 13:05:39.179867 12562 consensus_queue.cc:237] T 49c766b4b3c24f7db3ed4de1e794a0d3 P c00025c0f6594942bd14688ade17cb0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:39.248556 12506 tablet_bootstrap.cc:492] T 49c766b4b3c24f7db3ed4de1e794a0d3 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: No bootstrap required, opened a new log
I20260709 13:05:39.248385 12098 catalog_manager.cc:5697] T 49c766b4b3c24f7db3ed4de1e794a0d3 P c00025c0f6594942bd14688ade17cb0e reported cstate change: term changed from 0 to 1, leader changed from <none> to c00025c0f6594942bd14688ade17cb0e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c00025c0f6594942bd14688ade17cb0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:39.250089 12506 ts_tablet_manager.cc:1403] T 49c766b4b3c24f7db3ed4de1e794a0d3 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Time spent bootstrapping tablet: real 0.114s	user 0.055s	sys 0.036s
I20260709 13:05:39.254122 12506 raft_consensus.cc:359] T 49c766b4b3c24f7db3ed4de1e794a0d3 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:39.254878 12506 raft_consensus.cc:385] T 49c766b4b3c24f7db3ed4de1e794a0d3 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.255158 12506 raft_consensus.cc:740] T 49c766b4b3c24f7db3ed4de1e794a0d3 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.255962 12562 consensus_queue.cc:1048] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:39.256137 12506 consensus_queue.cc:260] T 49c766b4b3c24f7db3ed4de1e794a0d3 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:39.258517 12506 ts_tablet_manager.cc:1434] T 49c766b4b3c24f7db3ed4de1e794a0d3 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:05:39.262061 12506 tablet_bootstrap.cc:492] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Bootstrap starting.
I20260709 13:05:39.269631 12506 tablet_bootstrap.cc:654] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.298602 12506 tablet_bootstrap.cc:492] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: No bootstrap required, opened a new log
I20260709 13:05:39.298897 12348 raft_consensus.cc:3060] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.299280 12506 ts_tablet_manager.cc:1403] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.020s
I20260709 13:05:39.302999 12506 raft_consensus.cc:359] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:39.304003 12506 raft_consensus.cc:385] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.304361 12506 raft_consensus.cc:740] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.305285 12506 consensus_queue.cc:260] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:39.308147 12506 ts_tablet_manager.cc:1434] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:39.321401 12524 consensus_queue.cc:1048] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:39.390547 12545 raft_consensus.cc:493] T 49c766b4b3c24f7db3ed4de1e794a0d3 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.391150 12545 raft_consensus.cc:515] T 49c766b4b3c24f7db3ed4de1e794a0d3 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:39.393883 12545 leader_election.cc:290] T 49c766b4b3c24f7db3ed4de1e794a0d3 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:39.395323 12200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c766b4b3c24f7db3ed4de1e794a0d3" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:39.396090 12276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c766b4b3c24f7db3ed4de1e794a0d3" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:39.396916 12200 raft_consensus.cc:2393] T 49c766b4b3c24f7db3ed4de1e794a0d3 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in current term 1: Already voted for candidate c00025c0f6594942bd14688ade17cb0e in this term.
I20260709 13:05:39.398867 12314 leader_election.cc:304] T 49c766b4b3c24f7db3ed4de1e794a0d3 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:39.400036 12545 raft_consensus.cc:3060] T 49c766b4b3c24f7db3ed4de1e794a0d3 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.408862 12545 raft_consensus.cc:2749] T 49c766b4b3c24f7db3ed4de1e794a0d3 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:39.458410 12517 consensus_queue.cc:1048] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:39.462678 12517 consensus_queue.cc:1048] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:39.490401 12524 raft_consensus.cc:493] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.491032 12524 raft_consensus.cc:515] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:39.496654 12524 leader_election.cc:290] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:39.497655 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ef162d93c6a4ad2bba817bce6bbad60" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:39.578213 12544 raft_consensus.cc:493] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.592880 12544 raft_consensus.cc:515] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:39.663496 12559 consensus_queue.cc:1048] T 49c766b4b3c24f7db3ed4de1e794a0d3 P c00025c0f6594942bd14688ade17cb0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:39.668285 12348 raft_consensus.cc:2468] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 0.
I20260709 13:05:39.852710 12544 leader_election.cc:290] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:40.438673 12200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ef162d93c6a4ad2bba817bce6bbad60" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:40.440764 12200 raft_consensus.cc:2468] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in term 0.
I20260709 13:05:40.445504 12200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ef162d93c6a4ad2bba817bce6bbad60" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:40.446494 12200 raft_consensus.cc:2468] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 0.
I20260709 13:05:40.461784 12317 leader_election.cc:304] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 
I20260709 13:05:40.463223 12243 leader_election.cc:304] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e; no voters: 
I20260709 13:05:40.464318 12544 raft_consensus.cc:2804] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.464478 12524 raft_consensus.cc:2804] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.464833 12544 raft_consensus.cc:493] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.464879 12524 raft_consensus.cc:493] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.465308 12544 raft_consensus.cc:3060] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.465369 12524 raft_consensus.cc:3060] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.472759 12534 consensus_queue.cc:1048] T 49c766b4b3c24f7db3ed4de1e794a0d3 P c00025c0f6594942bd14688ade17cb0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:40.479930 12544 raft_consensus.cc:515] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:40.577859 12578 raft_consensus.cc:493] T 6d42d833844a46f48d7b08d9129648b8 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f706a4ebbb9e4c9f9d0a9259f1ac73e4)
I20260709 13:05:40.578967 12578 raft_consensus.cc:515] T 6d42d833844a46f48d7b08d9129648b8 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:40.583202 12578 leader_election.cc:290] T 6d42d833844a46f48d7b08d9129648b8 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:40.583331 12274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d42d833844a46f48d7b08d9129648b8" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:40.612993 12544 leader_election.cc:290] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 election: Requested vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:40.703037 12524 raft_consensus.cc:515] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
W20260709 13:05:40.715341 12240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34793, user_credentials={real_user=slave}} blocked reactor thread for 63730.1us
I20260709 13:05:40.750144 12585 raft_consensus.cc:493] T a3d34a9b02754ff5ba682f7b6f960ab1 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8094d462961742bdbb1b497a71355a24)
I20260709 13:05:40.751008 12585 raft_consensus.cc:515] T a3d34a9b02754ff5ba682f7b6f960ab1 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:40.862509 12098 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47098 (request call id 68) took 1393 ms. Trace:
I20260709 13:05:40.863387 12098 rpcz_store.cc:276] 0709 13:05:39.467892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.476484 (+  8592us) service_pool.cc:224] Handling call
0709 13:05:40.861634 (+1385150us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 13:05:40.899228 12097 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47110 (request call id 57) took 1413 ms. Trace:
I20260709 13:05:40.899672 12097 rpcz_store.cc:276] 0709 13:05:39.485892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.486480 (+   588us) service_pool.cc:224] Handling call
0709 13:05:40.899153 (+1412673us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":216405,"reported_tablets":1}
W20260709 13:05:40.902699 12148 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:40.911041 12199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d34a9b02754ff5ba682f7b6f960ab1" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:40.916044 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d34a9b02754ff5ba682f7b6f960ab1" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:40.918668 12240 leader_election.cc:304] T a3d34a9b02754ff5ba682f7b6f960ab1 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e; no voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:40.920367 12589 raft_consensus.cc:2749] T a3d34a9b02754ff5ba682f7b6f960ab1 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:40.929275 12276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ef162d93c6a4ad2bba817bce6bbad60" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:40.930297 12276 raft_consensus.cc:2393] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in current term 1: Already voted for candidate c00025c0f6594942bd14688ade17cb0e in this term.
I20260709 13:05:40.931630 12585 leader_election.cc:290] T a3d34a9b02754ff5ba682f7b6f960ab1 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:40.947013 12274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ef162d93c6a4ad2bba817bce6bbad60" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
I20260709 13:05:40.948215 12274 raft_consensus.cc:2393] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in current term 1: Already voted for candidate c00025c0f6594942bd14688ade17cb0e in this term.
W20260709 13:05:40.963418 12317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37607, user_credentials={real_user=slave}} blocked reactor thread for 499667us
I20260709 13:05:40.966437 12199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ef162d93c6a4ad2bba817bce6bbad60" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24"
I20260709 13:05:40.967274 12199 raft_consensus.cc:3060] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.993877 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d42d833844a46f48d7b08d9129648b8" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:41.011904 12165 leader_election.cc:304] T 6d42d833844a46f48d7b08d9129648b8 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8094d462961742bdbb1b497a71355a24; no voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:41.013255 12579 raft_consensus.cc:2749] T 6d42d833844a46f48d7b08d9129648b8 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:40.735904 12534 raft_consensus.cc:493] T 20eda87dc6e642ad8791304d782e09a1 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f706a4ebbb9e4c9f9d0a9259f1ac73e4)
I20260709 13:05:41.026748 12534 raft_consensus.cc:515] T 20eda87dc6e642ad8791304d782e09a1 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:41.035748 12351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20eda87dc6e642ad8791304d782e09a1" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:41.046155 12534 leader_election.cc:290] T 20eda87dc6e642ad8791304d782e09a1 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:41.051671 12351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ef162d93c6a4ad2bba817bce6bbad60" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
I20260709 13:05:41.049142 12524 leader_election.cc:290] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 election: Requested vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:41.053220 12351 raft_consensus.cc:2393] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c00025c0f6594942bd14688ade17cb0e in current term 1: Already voted for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in this term.
I20260709 13:05:41.092341 12202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20eda87dc6e642ad8791304d782e09a1" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:41.094049 12200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ef162d93c6a4ad2bba817bce6bbad60" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24"
I20260709 13:05:41.096597 12243 leader_election.cc:304] T 20eda87dc6e642ad8791304d782e09a1 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e; no voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:41.098904 12559 raft_consensus.cc:2749] T 20eda87dc6e642ad8791304d782e09a1 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:41.101226 12243 leader_election.cc:304] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e; no voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:41.102862 12559 raft_consensus.cc:2749] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:41.110507 12199 raft_consensus.cc:2468] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in term 1.
I20260709 13:05:41.113210 12317 leader_election.cc:304] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:41.114938 12591 raft_consensus.cc:2804] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:41.115824 12591 raft_consensus.cc:697] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 LEADER]: Becoming Leader. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Running, Role: LEADER
I20260709 13:05:41.117978 12591 consensus_queue.cc:237] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:41.150832 12097 catalog_manager.cc:5697] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:41.506839 12347 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ef162d93c6a4ad2bba817bce6bbad60"
dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
mode: GRACEFUL
new_leader_uuid: "8094d462961742bdbb1b497a71355a24"
 from {username='slave'} at 127.0.0.1:34220
I20260709 13:05:41.507417 12347 raft_consensus.cc:606] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 LEADER]: Received request to transfer leadership to TS 8094d462961742bdbb1b497a71355a24
I20260709 13:05:41.516057 12276 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b9f87e57a6d4cb99b1fcd62ea87691b"
dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
mode: GRACEFUL
new_leader_uuid: "8094d462961742bdbb1b497a71355a24"
 from {username='slave'} at 127.0.0.1:53256
I20260709 13:05:41.516969 12276 raft_consensus.cc:606] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e [term 1 LEADER]: Received request to transfer leadership to TS 8094d462961742bdbb1b497a71355a24
I20260709 13:05:41.524721 12347 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e107fbfc8174ff58fb3bdbb9077606a"
dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
mode: GRACEFUL
new_leader_uuid: "8094d462961742bdbb1b497a71355a24"
 from {username='slave'} at 127.0.0.1:34220
I20260709 13:05:41.525434 12347 raft_consensus.cc:606] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 LEADER]: Received request to transfer leadership to TS 8094d462961742bdbb1b497a71355a24
I20260709 13:05:41.537357 12347 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d42d833844a46f48d7b08d9129648b8"
dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
mode: GRACEFUL
new_leader_uuid: "c00025c0f6594942bd14688ade17cb0e"
 from {username='slave'} at 127.0.0.1:34220
I20260709 13:05:41.538126 12347 raft_consensus.cc:606] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 LEADER]: Received request to transfer leadership to TS c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:41.549376 12200 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bcd0d96ef5ec4e6782b4e4a056db2b4f"
dest_uuid: "8094d462961742bdbb1b497a71355a24"
mode: GRACEFUL
new_leader_uuid: "c00025c0f6594942bd14688ade17cb0e"
 from {username='slave'} at 127.0.0.1:33012
I20260709 13:05:41.550017 12200 raft_consensus.cc:606] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [term 1 LEADER]: Received request to transfer leadership to TS c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:41.563946 12276 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9036b076f3c64c818c3c9f94f6c4acf9"
dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
mode: GRACEFUL
new_leader_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
 from {username='slave'} at 127.0.0.1:53256
I20260709 13:05:41.564726 12276 raft_consensus.cc:606] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [term 1 LEADER]: Received request to transfer leadership to TS f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:41.615888 12586 raft_consensus.cc:993] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e: : Instructing follower 8094d462961742bdbb1b497a71355a24 to start an election
I20260709 13:05:41.616438 12559 raft_consensus.cc:1081] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e [term 1 LEADER]: Signalling peer 8094d462961742bdbb1b497a71355a24 to start an election
I20260709 13:05:41.619400 12200 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b9f87e57a6d4cb99b1fcd62ea87691b"
dest_uuid: "8094d462961742bdbb1b497a71355a24"
 from {username='slave'} at 127.0.0.1:33000
I20260709 13:05:41.620430 12200 raft_consensus.cc:493] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:41.620889 12200 raft_consensus.cc:3060] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.631507 12200 raft_consensus.cc:515] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:41.633968 12591 consensus_queue.cc:1048] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:41.636021 12276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9f87e57a6d4cb99b1fcd62ea87691b" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
I20260709 13:05:41.636924 12276 raft_consensus.cc:3055] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:41.637326 12276 raft_consensus.cc:740] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Running, Role: LEADER
I20260709 13:05:41.640475 12200 leader_election.cc:290] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 2 election: Requested vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:41.638437 12276 consensus_queue.cc:260] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:41.639669 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9f87e57a6d4cb99b1fcd62ea87691b" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
I20260709 13:05:41.641992 12276 raft_consensus.cc:3060] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.642004 12347 raft_consensus.cc:3060] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.660458 12276 raft_consensus.cc:2468] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 2.
I20260709 13:05:41.663385 12165 leader_election.cc:304] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e; no voters: 
I20260709 13:05:41.664809 12577 raft_consensus.cc:2804] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:41.665385 12577 raft_consensus.cc:697] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [term 2 LEADER]: Becoming Leader. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Running, Role: LEADER
I20260709 13:05:41.666293 12577 consensus_queue.cc:237] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:41.674610 12347 raft_consensus.cc:2468] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 2.
I20260709 13:05:41.691022 12097 catalog_manager.cc:5697] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 reported cstate change: term changed from 1 to 2, leader changed from c00025c0f6594942bd14688ade17cb0e (127.0.107.194) to 8094d462961742bdbb1b497a71355a24 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "8094d462961742bdbb1b497a71355a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.704946 12591 consensus_queue.cc:1048] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:41.720369 12591 raft_consensus.cc:993] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: : Instructing follower 8094d462961742bdbb1b497a71355a24 to start an election
I20260709 13:05:41.720836 12591 raft_consensus.cc:1081] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 LEADER]: Signalling peer 8094d462961742bdbb1b497a71355a24 to start an election
I20260709 13:05:41.722887 12199 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ef162d93c6a4ad2bba817bce6bbad60"
dest_uuid: "8094d462961742bdbb1b497a71355a24"
 from {username='slave'} at 127.0.0.1:32992
I20260709 13:05:41.723513 12199 raft_consensus.cc:493] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:41.723893 12199 raft_consensus.cc:3060] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.731630 12199 raft_consensus.cc:515] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:41.734072 12199 leader_election.cc:290] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 2 election: Requested vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:41.735544 12351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ef162d93c6a4ad2bba817bce6bbad60" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
I20260709 13:05:41.735592 12274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ef162d93c6a4ad2bba817bce6bbad60" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
I20260709 13:05:41.736439 12351 raft_consensus.cc:3055] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:41.736961 12274 raft_consensus.cc:3060] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.737562 12351 raft_consensus.cc:740] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Running, Role: LEADER
I20260709 13:05:41.738565 12351 consensus_queue.cc:260] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:41.739964 12351 raft_consensus.cc:3060] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:41.746285 12298 debug-util.cc:398] Leaking SignalData structure 0x7b08000e8f40 after lost signal to thread 434
I20260709 13:05:41.746172 12274 raft_consensus.cc:2468] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 2.
W20260709 13:05:41.747805 12298 debug-util.cc:398] Leaking SignalData structure 0x7b080010c880 after lost signal to thread 12134
I20260709 13:05:41.748209 12351 raft_consensus.cc:2468] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 2.
I20260709 13:05:41.748065 12165 leader_election.cc:304] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e; no voters: 
I20260709 13:05:41.749398 12599 raft_consensus.cc:2804] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:41.749914 12599 raft_consensus.cc:697] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [term 2 LEADER]: Becoming Leader. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Running, Role: LEADER
I20260709 13:05:41.750859 12599 consensus_queue.cc:237] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
W20260709 13:05:41.751056 12298 debug-util.cc:398] Leaking SignalData structure 0x7b08000ba7e0 after lost signal to thread 12226
W20260709 13:05:41.757439 12298 debug-util.cc:398] Leaking SignalData structure 0x7b08002f7ae0 after lost signal to thread 12301
W20260709 13:05:41.759670 12298 debug-util.cc:398] Leaking SignalData structure 0x7b0800155c00 after lost signal to thread 12375
I20260709 13:05:41.763311 12586 raft_consensus.cc:993] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e: : Instructing follower f706a4ebbb9e4c9f9d0a9259f1ac73e4 to start an election
I20260709 13:05:41.764037 12586 raft_consensus.cc:1081] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [term 1 LEADER]: Signalling peer f706a4ebbb9e4c9f9d0a9259f1ac73e4 to start an election
I20260709 13:05:41.766134 12347 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9036b076f3c64c818c3c9f94f6c4acf9"
dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
 from {username='slave'} at 127.0.0.1:34214
I20260709 13:05:41.766865 12347 raft_consensus.cc:493] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:41.767267 12347 raft_consensus.cc:3060] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.765925 12097 catalog_manager.cc:5697] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 reported cstate change: term changed from 1 to 2, leader changed from f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195) to 8094d462961742bdbb1b497a71355a24 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "8094d462961742bdbb1b497a71355a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.780483 12347 raft_consensus.cc:515] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:41.785044 12199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9036b076f3c64c818c3c9f94f6c4acf9" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8094d462961742bdbb1b497a71355a24"
I20260709 13:05:41.785785 12199 raft_consensus.cc:3060] T 9036b076f3c64c818c3c9f94f6c4acf9 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.787952 12274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9036b076f3c64c818c3c9f94f6c4acf9" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
I20260709 13:05:41.789121 12274 raft_consensus.cc:3055] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:41.789491 12274 raft_consensus.cc:740] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Running, Role: LEADER
I20260709 13:05:41.790606 12274 consensus_queue.cc:260] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:41.792105 12274 raft_consensus.cc:3060] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.796850 12199 raft_consensus.cc:2468] T 9036b076f3c64c818c3c9f94f6c4acf9 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in term 2.
I20260709 13:05:41.798434 12317 leader_election.cc:304] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 
I20260709 13:05:41.800961 12598 raft_consensus.cc:2804] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:41.801539 12598 raft_consensus.cc:697] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 LEADER]: Becoming Leader. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Running, Role: LEADER
I20260709 13:05:41.802500 12598 consensus_queue.cc:237] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:41.805409 12347 leader_election.cc:290] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 2 election: Requested vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:41.808584 12274 raft_consensus.cc:2468] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in term 2.
I20260709 13:05:41.820537 12097 catalog_manager.cc:5697] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 reported cstate change: term changed from 1 to 2, leader changed from c00025c0f6594942bd14688ade17cb0e (127.0.107.194) to f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:41.870827 12601 raft_consensus.cc:993] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24: : Instructing follower c00025c0f6594942bd14688ade17cb0e to start an election
I20260709 13:05:41.871946 12599 raft_consensus.cc:1081] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [term 1 LEADER]: Signalling peer c00025c0f6594942bd14688ade17cb0e to start an election
I20260709 13:05:41.874286 12274 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bcd0d96ef5ec4e6782b4e4a056db2b4f"
dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
 from {username='slave'} at 127.0.0.1:53226
I20260709 13:05:41.875162 12274 raft_consensus.cc:493] T bcd0d96ef5ec4e6782b4e4a056db2b4f P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:41.875988 12274 raft_consensus.cc:3060] T bcd0d96ef5ec4e6782b4e4a056db2b4f P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.899950 12274 raft_consensus.cc:515] T bcd0d96ef5ec4e6782b4e4a056db2b4f P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:41.902921 12598 raft_consensus.cc:993] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: : Instructing follower c00025c0f6594942bd14688ade17cb0e to start an election
I20260709 13:05:41.903690 12598 raft_consensus.cc:1081] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 LEADER]: Signalling peer c00025c0f6594942bd14688ade17cb0e to start an election
I20260709 13:05:41.906039 12275 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d42d833844a46f48d7b08d9129648b8"
dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
 from {username='slave'} at 127.0.0.1:53242
I20260709 13:05:41.906715 12275 raft_consensus.cc:493] T 6d42d833844a46f48d7b08d9129648b8 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:41.907109 12275 raft_consensus.cc:3060] T 6d42d833844a46f48d7b08d9129648b8 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.908103 12199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcd0d96ef5ec4e6782b4e4a056db2b4f" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8094d462961742bdbb1b497a71355a24"
I20260709 13:05:41.909611 12199 raft_consensus.cc:3055] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:41.910041 12199 raft_consensus.cc:740] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Running, Role: LEADER
I20260709 13:05:41.910193 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcd0d96ef5ec4e6782b4e4a056db2b4f" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
I20260709 13:05:41.911018 12347 raft_consensus.cc:3060] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.911877 12199 consensus_queue.cc:260] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:41.913517 12199 raft_consensus.cc:3060] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.920313 12274 leader_election.cc:290] T bcd0d96ef5ec4e6782b4e4a056db2b4f P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 2 election: Requested vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:41.923022 12347 raft_consensus.cc:2468] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 2.
I20260709 13:05:41.924692 12240 leader_election.cc:304] T bcd0d96ef5ec4e6782b4e4a056db2b4f P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 
I20260709 13:05:41.925828 12586 raft_consensus.cc:2804] T bcd0d96ef5ec4e6782b4e4a056db2b4f P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:41.926385 12586 raft_consensus.cc:697] T bcd0d96ef5ec4e6782b4e4a056db2b4f P c00025c0f6594942bd14688ade17cb0e [term 2 LEADER]: Becoming Leader. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Running, Role: LEADER
I20260709 13:05:41.926397 12275 raft_consensus.cc:515] T 6d42d833844a46f48d7b08d9129648b8 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:41.927407 12586 consensus_queue.cc:237] T bcd0d96ef5ec4e6782b4e4a056db2b4f P c00025c0f6594942bd14688ade17cb0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:41.930274 12275 leader_election.cc:290] T 6d42d833844a46f48d7b08d9129648b8 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 2 election: Requested vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:41.933210 12200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d42d833844a46f48d7b08d9129648b8" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8094d462961742bdbb1b497a71355a24"
I20260709 13:05:41.933987 12200 raft_consensus.cc:3060] T 6d42d833844a46f48d7b08d9129648b8 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.935083 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d42d833844a46f48d7b08d9129648b8" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
I20260709 13:05:41.935802 12349 raft_consensus.cc:3055] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:41.936137 12349 raft_consensus.cc:740] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Running, Role: LEADER
I20260709 13:05:41.937368 12349 consensus_queue.cc:260] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:41.938982 12349 raft_consensus.cc:3060] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.946424 12200 raft_consensus.cc:2468] T 6d42d833844a46f48d7b08d9129648b8 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 2.
I20260709 13:05:41.949915 12199 raft_consensus.cc:2468] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 2.
I20260709 13:05:41.959220 12349 raft_consensus.cc:2468] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 2.
I20260709 13:05:41.959649 12243 leader_election.cc:304] T 6d42d833844a46f48d7b08d9129648b8 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e; no voters: 
I20260709 13:05:41.961434 12586 raft_consensus.cc:2804] T 6d42d833844a46f48d7b08d9129648b8 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:41.962430 12586 raft_consensus.cc:697] T 6d42d833844a46f48d7b08d9129648b8 P c00025c0f6594942bd14688ade17cb0e [term 2 LEADER]: Becoming Leader. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Running, Role: LEADER
I20260709 13:05:41.963442 12586 consensus_queue.cc:237] T 6d42d833844a46f48d7b08d9129648b8 P c00025c0f6594942bd14688ade17cb0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:41.964895 12097 catalog_manager.cc:5697] T bcd0d96ef5ec4e6782b4e4a056db2b4f P c00025c0f6594942bd14688ade17cb0e reported cstate change: term changed from 1 to 2, leader changed from 8094d462961742bdbb1b497a71355a24 (127.0.107.193) to c00025c0f6594942bd14688ade17cb0e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "c00025c0f6594942bd14688ade17cb0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.997247 12097 catalog_manager.cc:5697] T 6d42d833844a46f48d7b08d9129648b8 P c00025c0f6594942bd14688ade17cb0e reported cstate change: term changed from 1 to 2, leader changed from f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195) to c00025c0f6594942bd14688ade17cb0e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "c00025c0f6594942bd14688ade17cb0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:42.080282 12275 raft_consensus.cc:1275] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Refusing update from remote peer 8094d462961742bdbb1b497a71355a24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.082231 12601 consensus_queue.cc:1048] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.102689 12349 raft_consensus.cc:1275] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Refusing update from remote peer 8094d462961742bdbb1b497a71355a24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.105544 12577 consensus_queue.cc:1048] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.137167 12591 raft_consensus.cc:993] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4: : Instructing follower 8094d462961742bdbb1b497a71355a24 to start an election
I20260709 13:05:42.137707 12591 raft_consensus.cc:1081] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 LEADER]: Signalling peer 8094d462961742bdbb1b497a71355a24 to start an election
I20260709 13:05:42.140254 12200 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e107fbfc8174ff58fb3bdbb9077606a"
dest_uuid: "8094d462961742bdbb1b497a71355a24"
 from {username='slave'} at 127.0.0.1:32992
I20260709 13:05:42.140966 12200 raft_consensus.cc:493] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:42.141501 12200 raft_consensus.cc:3060] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:42.157930 12200 raft_consensus.cc:515] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:42.161255 12275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e107fbfc8174ff58fb3bdbb9077606a" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
I20260709 13:05:42.161971 12275 raft_consensus.cc:3060] T 1e107fbfc8174ff58fb3bdbb9077606a P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:42.167517 12200 leader_election.cc:290] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 2 election: Requested vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:42.169324 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e107fbfc8174ff58fb3bdbb9077606a" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
I20260709 13:05:42.170181 12349 raft_consensus.cc:3055] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:42.170599 12349 raft_consensus.cc:740] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Running, Role: LEADER
I20260709 13:05:42.174417 12349 consensus_queue.cc:260] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:42.179777 12275 raft_consensus.cc:2468] T 1e107fbfc8174ff58fb3bdbb9077606a P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 2.
I20260709 13:05:42.176192 12349 raft_consensus.cc:3060] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:42.182960 12165 leader_election.cc:304] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e; no voters: 
I20260709 13:05:42.184520 12577 raft_consensus.cc:2804] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:42.185051 12577 raft_consensus.cc:697] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 [term 2 LEADER]: Becoming Leader. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Running, Role: LEADER
I20260709 13:05:42.186023 12577 consensus_queue.cc:237] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:42.190924 12200 raft_consensus.cc:1275] T 9036b076f3c64c818c3c9f94f6c4acf9 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Refusing update from remote peer f706a4ebbb9e4c9f9d0a9259f1ac73e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.193269 12611 consensus_queue.cc:1048] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.200659 12347 raft_consensus.cc:1275] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Refusing update from remote peer 8094d462961742bdbb1b497a71355a24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.203087 12599 consensus_queue.cc:1048] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:42.205042 12349 raft_consensus.cc:2468] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 2.
I20260709 13:05:42.219673 12275 raft_consensus.cc:1275] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Refusing update from remote peer 8094d462961742bdbb1b497a71355a24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.221712 12577 consensus_queue.cc:1048] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.213716 12097 catalog_manager.cc:5697] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 reported cstate change: term changed from 1 to 2, leader changed from f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195) to 8094d462961742bdbb1b497a71355a24 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "8094d462961742bdbb1b497a71355a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:42.243156 12275 raft_consensus.cc:1275] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Refusing update from remote peer f706a4ebbb9e4c9f9d0a9259f1ac73e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.244869 12611 consensus_queue.cc:1048] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.312918 12199 raft_consensus.cc:1275] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Refusing update from remote peer c00025c0f6594942bd14688ade17cb0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.314670 12609 consensus_queue.cc:1048] T bcd0d96ef5ec4e6782b4e4a056db2b4f P c00025c0f6594942bd14688ade17cb0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.332155 12349 raft_consensus.cc:1275] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Refusing update from remote peer c00025c0f6594942bd14688ade17cb0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.334236 12586 consensus_queue.cc:1048] T bcd0d96ef5ec4e6782b4e4a056db2b4f P c00025c0f6594942bd14688ade17cb0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:42.450718 12349 raft_consensus.cc:1275] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Refusing update from remote peer c00025c0f6594942bd14688ade17cb0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.452445 12586 consensus_queue.cc:1048] T 6d42d833844a46f48d7b08d9129648b8 P c00025c0f6594942bd14688ade17cb0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.470948 12199 raft_consensus.cc:1275] T 6d42d833844a46f48d7b08d9129648b8 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Refusing update from remote peer c00025c0f6594942bd14688ade17cb0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.473445 12586 consensus_queue.cc:1048] T 6d42d833844a46f48d7b08d9129648b8 P c00025c0f6594942bd14688ade17cb0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:42.622968 12349 raft_consensus.cc:1275] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Refusing update from remote peer 8094d462961742bdbb1b497a71355a24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.624692 12577 consensus_queue.cc:1048] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.647156 12274 raft_consensus.cc:1275] T 1e107fbfc8174ff58fb3bdbb9077606a P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Refusing update from remote peer 8094d462961742bdbb1b497a71355a24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.652331 12599 consensus_queue.cc:1048] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:05:43.951977 12131 debug-util.cc:398] Leaking SignalData structure 0x7b08000fc9c0 after lost signal to thread 434
I20260709 13:05:44.671167 12627 raft_consensus.cc:493] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c00025c0f6594942bd14688ade17cb0e)
I20260709 13:05:44.673327 12627 raft_consensus.cc:515] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:44.678725 12627 leader_election.cc:290] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:44.681883 12628 raft_consensus.cc:493] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c00025c0f6594942bd14688ade17cb0e)
I20260709 13:05:44.683027 12628 raft_consensus.cc:515] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:44.686240 12628 leader_election.cc:290] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:44.692886 12627 raft_consensus.cc:493] T 6d42d833844a46f48d7b08d9129648b8 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c00025c0f6594942bd14688ade17cb0e)
I20260709 13:05:44.693199 12629 raft_consensus.cc:493] T c53cb67f3c6240549cb8672a5d254db7 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c00025c0f6594942bd14688ade17cb0e)
I20260709 13:05:44.693935 12628 raft_consensus.cc:493] T aea38e5274ba452894df20a69755dbda P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c00025c0f6594942bd14688ade17cb0e)
I20260709 13:05:44.694450 12629 raft_consensus.cc:515] T c53cb67f3c6240549cb8672a5d254db7 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:44.695938 12628 raft_consensus.cc:515] T aea38e5274ba452894df20a69755dbda P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:44.697400 12629 leader_election.cc:290] T c53cb67f3c6240549cb8672a5d254db7 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:44.699705 12628 leader_election.cc:290] T aea38e5274ba452894df20a69755dbda P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:44.694294 12627 raft_consensus.cc:515] T 6d42d833844a46f48d7b08d9129648b8 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:44.702420 12627 leader_election.cc:290] T 6d42d833844a46f48d7b08d9129648b8 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:44.736903 12633 raft_consensus.cc:493] T 4c030549c2814e2b949de006d26f5514 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8094d462961742bdbb1b497a71355a24)
I20260709 13:05:44.739022 12628 raft_consensus.cc:493] T 9036b076f3c64c818c3c9f94f6c4acf9 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f706a4ebbb9e4c9f9d0a9259f1ac73e4)
I20260709 13:05:44.738749 12601 raft_consensus.cc:493] T 0051bc6e9d314fcca7be8439e6fa998f P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c00025c0f6594942bd14688ade17cb0e)
I20260709 13:05:44.741003 12601 raft_consensus.cc:515] T 0051bc6e9d314fcca7be8439e6fa998f P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:44.742794 12629 raft_consensus.cc:493] T 49c766b4b3c24f7db3ed4de1e794a0d3 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c00025c0f6594942bd14688ade17cb0e)
I20260709 13:05:44.743957 12629 raft_consensus.cc:515] T 49c766b4b3c24f7db3ed4de1e794a0d3 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:44.744850 12627 raft_consensus.cc:493] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c00025c0f6594942bd14688ade17cb0e)
I20260709 13:05:44.745893 12627 raft_consensus.cc:515] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:44.746703 12598 raft_consensus.cc:493] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c00025c0f6594942bd14688ade17cb0e)
I20260709 13:05:44.747171 12629 leader_election.cc:290] T 49c766b4b3c24f7db3ed4de1e794a0d3 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:44.747743 12598 raft_consensus.cc:515] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:44.748047 12629 raft_consensus.cc:493] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f706a4ebbb9e4c9f9d0a9259f1ac73e4)
I20260709 13:05:44.748661 12627 leader_election.cc:290] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:44.751784 12629 raft_consensus.cc:515] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:44.740381 12628 raft_consensus.cc:515] T 9036b076f3c64c818c3c9f94f6c4acf9 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:44.763698 12628 leader_election.cc:290] T 9036b076f3c64c818c3c9f94f6c4acf9 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:44.768692 12632 raft_consensus.cc:493] T 1e107fbfc8174ff58fb3bdbb9077606a P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8094d462961742bdbb1b497a71355a24)
I20260709 13:05:44.770582 12632 raft_consensus.cc:515] T 1e107fbfc8174ff58fb3bdbb9077606a P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:44.771443 12631 raft_consensus.cc:493] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8094d462961742bdbb1b497a71355a24)
I20260709 13:05:44.774494 12559 raft_consensus.cc:493] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f706a4ebbb9e4c9f9d0a9259f1ac73e4)
I20260709 13:05:44.775777 12559 raft_consensus.cc:515] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:44.773698 12631 raft_consensus.cc:515] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:44.777607 12629 leader_election.cc:290] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
W20260709 13:05:44.778640 12131 debug-util.cc:398] Leaking SignalData structure 0x7b0800136b00 after lost signal to thread 12134
I20260709 13:05:44.779011 12559 leader_election.cc:290] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:44.775740 12632 leader_election.cc:290] T 1e107fbfc8174ff58fb3bdbb9077606a P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:44.780229 12631 leader_election.cc:290] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:44.738739 12633 raft_consensus.cc:515] T 4c030549c2814e2b949de006d26f5514 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:44.755930 12598 leader_election.cc:290] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:44.733847 12611 raft_consensus.cc:493] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8094d462961742bdbb1b497a71355a24)
I20260709 13:05:44.799292 12611 raft_consensus.cc:515] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:44.800128 12631 raft_consensus.cc:493] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8094d462961742bdbb1b497a71355a24)
I20260709 13:05:44.800205 12559 raft_consensus.cc:493] T a3d34a9b02754ff5ba682f7b6f960ab1 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8094d462961742bdbb1b497a71355a24)
I20260709 13:05:44.805663 12631 raft_consensus.cc:515] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:44.806484 12559 raft_consensus.cc:515] T a3d34a9b02754ff5ba682f7b6f960ab1 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:44.808735 12631 leader_election.cc:290] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:44.810531 12559 leader_election.cc:290] T a3d34a9b02754ff5ba682f7b6f960ab1 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:44.792486 12601 leader_election.cc:290] T 0051bc6e9d314fcca7be8439e6fa998f P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:44.808677 12633 leader_election.cc:290] T 4c030549c2814e2b949de006d26f5514 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:44.812428 12611 leader_election.cc:290] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:44.829475 12099 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47110 (request call id 72) took 2160 ms. Trace:
I20260709 13:05:44.826196 12591 raft_consensus.cc:493] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8094d462961742bdbb1b497a71355a24)
I20260709 13:05:44.843708 12591 raft_consensus.cc:515] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:44.845413 12611 raft_consensus.cc:493] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c00025c0f6594942bd14688ade17cb0e)
I20260709 13:05:44.845813 12198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e107fbfc8174ff58fb3bdbb9077606a" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:44.847400 12591 leader_election.cc:290] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:44.843140 12099 rpcz_store.cc:276] 0709 13:05:42.668352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.668512 (+   160us) service_pool.cc:224] Handling call
0709 13:05:44.828495 (+2159983us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b2400230798. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b7dd2adb1 00007f1b7de6ab71 00007f1b7de6aa22 00007f1b86d83c09 00007f1b7e03a970 00007f1b7e047a8f 00007f1b86e4ce14 00007f1b8530d2a4 00007f1b8530d232 00007f1b8530d161 00007f1b8530d0dc
0709 13:05:44.829021 (+   526us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9,"reported_tablets":1,"spinlock_wait_cycles":310240640}
I20260709 13:05:44.828331 12598 raft_consensus.cc:493] T 4c030549c2814e2b949de006d26f5514 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8094d462961742bdbb1b497a71355a24)
I20260709 13:05:44.862668 12098 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47100 (request call id 84) took 2132 ms. Trace:
I20260709 13:05:44.863242 12098 rpcz_store.cc:276] 0709 13:05:42.729647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.815009 (+ 85362us) service_pool.cc:224] Handling call
0709 13:05:44.862419 (+2047410us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 13:05:44.868489 12100 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47098 (request call id 85) took 2139 ms. Trace:
I20260709 13:05:44.859551 12598 raft_consensus.cc:515] T 4c030549c2814e2b949de006d26f5514 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:44.872579 12100 rpcz_store.cc:276] 0709 13:05:42.729363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.605144 (+1875781us) service_pool.cc:224] Handling call
0709 13:05:44.868276 (+263132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47256,"reported_tablets":1}
I20260709 13:05:44.882863 12634 raft_consensus.cc:493] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c00025c0f6594942bd14688ade17cb0e)
I20260709 13:05:44.884045 12634 raft_consensus.cc:515] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:44.884630 12274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0051bc6e9d314fcca7be8439e6fa998f" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:44.887020 12202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c030549c2814e2b949de006d26f5514" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:44.888677 12197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb3962ca7144e23a7f8e13cb66c5691" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:44.890869 12196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d34a9b02754ff5ba682f7b6f960ab1" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:44.833822 12559 raft_consensus.cc:493] T 20eda87dc6e642ad8791304d782e09a1 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f706a4ebbb9e4c9f9d0a9259f1ac73e4)
I20260709 13:05:44.892657 12634 leader_election.cc:290] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:44.893456 12559 raft_consensus.cc:515] T 20eda87dc6e642ad8791304d782e09a1 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:44.894438 12098 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47126:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
W20260709 13:05:44.896402 12131 debug-util.cc:398] Leaking SignalData structure 0x7b08001ab020 after lost signal to thread 12226
I20260709 13:05:44.899509 12200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9f87e57a6d4cb99b1fcd62ea87691b" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:44.929064 12640 raft_consensus.cc:493] T 49c766b4b3c24f7db3ed4de1e794a0d3 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c00025c0f6594942bd14688ade17cb0e)
I20260709 13:05:44.831633 12201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9036b076f3c64c818c3c9f94f6c4acf9" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:44.930442 12640 raft_consensus.cc:515] T 49c766b4b3c24f7db3ed4de1e794a0d3 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:44.930874 12201 raft_consensus.cc:2468] T 9036b076f3c64c818c3c9f94f6c4acf9 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 2.
I20260709 13:05:44.832556 12633 raft_consensus.cc:493] T 33f0e3ad1e4344cf8177322fec690c78 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8094d462961742bdbb1b497a71355a24)
I20260709 13:05:44.933174 12611 raft_consensus.cc:515] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:44.934120 12633 raft_consensus.cc:515] T 33f0e3ad1e4344cf8177322fec690c78 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:44.936405 12243 leader_election.cc:304] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e; no voters: 
I20260709 13:05:44.903709 12591 raft_consensus.cc:493] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8094d462961742bdbb1b497a71355a24)
I20260709 13:05:44.938503 12275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9f87e57a6d4cb99b1fcd62ea87691b" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:44.939615 12275 raft_consensus.cc:2468] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in term 2.
I20260709 13:05:44.940511 12632 raft_consensus.cc:493] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8094d462961742bdbb1b497a71355a24)
I20260709 13:05:44.941366 12632 raft_consensus.cc:515] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:44.943957 12638 raft_consensus.cc:493] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8094d462961742bdbb1b497a71355a24)
I20260709 13:05:44.938278 12591 raft_consensus.cc:515] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:44.944955 12638 raft_consensus.cc:515] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:44.956943 12640 leader_election.cc:290] T 49c766b4b3c24f7db3ed4de1e794a0d3 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:44.957324 12633 leader_election.cc:290] T 33f0e3ad1e4344cf8177322fec690c78 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:44.960152 12276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d34a9b02754ff5ba682f7b6f960ab1" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:44.964370 12276 raft_consensus.cc:2468] T a3d34a9b02754ff5ba682f7b6f960ab1 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in term 1.
I20260709 13:05:44.961966 12277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3beb77c94044e94a8cf4318a473a13b" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:44.965972 12314 leader_election.cc:304] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 
I20260709 13:05:44.962239 12273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c766b4b3c24f7db3ed4de1e794a0d3" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:44.963343 12591 leader_election.cc:290] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:44.968520 12591 raft_consensus.cc:2804] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:44.969201 12591 raft_consensus.cc:493] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8094d462961742bdbb1b497a71355a24)
I20260709 13:05:44.959475 12639 raft_consensus.cc:2804] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:44.970075 12632 leader_election.cc:290] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:44.958187 12598 leader_election.cc:290] T 4c030549c2814e2b949de006d26f5514 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:44.971108 12639 raft_consensus.cc:493] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Starting leader election (detected failure of leader f706a4ebbb9e4c9f9d0a9259f1ac73e4)
I20260709 13:05:44.970080 12611 leader_election.cc:290] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:44.971681 12639 raft_consensus.cc:3060] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.959264 12559 leader_election.cc:290] T 20eda87dc6e642ad8791304d782e09a1 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:44.974262 12638 leader_election.cc:290] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
W20260709 13:05:44.974520 12131 debug-util.cc:398] Leaking SignalData structure 0x7b08001e4c60 after lost signal to thread 12301
W20260709 13:05:44.975123 12131 debug-util.cc:398] Leaking SignalData structure 0x7b080027e4c0 after lost signal to thread 12302
I20260709 13:05:44.976766 12611 raft_consensus.cc:493] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8094d462961742bdbb1b497a71355a24)
W20260709 13:05:44.977034 12131 debug-util.cc:398] Leaking SignalData structure 0x7b08002bc560 after lost signal to thread 12375
I20260709 13:05:44.978629 12598 raft_consensus.cc:493] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c00025c0f6594942bd14688ade17cb0e)
I20260709 13:05:44.979787 12598 raft_consensus.cc:515] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:44.926721 12634 raft_consensus.cc:493] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8094d462961742bdbb1b497a71355a24)
I20260709 13:05:44.978235 12611 raft_consensus.cc:515] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:44.990278 12611 leader_election.cc:290] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:44.989176 12637 raft_consensus.cc:493] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c00025c0f6594942bd14688ade17cb0e)
I20260709 13:05:44.997539 12611 raft_consensus.cc:493] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8094d462961742bdbb1b497a71355a24)
I20260709 13:05:44.997843 12637 raft_consensus.cc:515] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:44.998359 12611 raft_consensus.cc:515] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:45.000640 12637 leader_election.cc:290] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:44.989900 12598 leader_election.cc:290] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:44.993876 12591 raft_consensus.cc:3060] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.984154 12201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f0e3ad1e4344cf8177322fec690c78" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:45.003312 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e107fbfc8174ff58fb3bdbb9077606a" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:45.003728 12598 raft_consensus.cc:493] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c00025c0f6594942bd14688ade17cb0e)
I20260709 13:05:44.984663 12634 raft_consensus.cc:515] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:45.004707 12598 raft_consensus.cc:515] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:45.005263 12611 leader_election.cc:290] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:45.008180 12611 raft_consensus.cc:493] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c00025c0f6594942bd14688ade17cb0e)
I20260709 13:05:45.010138 12199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d34a9b02754ff5ba682f7b6f960ab1" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:45.010443 12611 raft_consensus.cc:515] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:45.012189 12196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9f87e57a6d4cb99b1fcd62ea87691b" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:45.013748 12194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3beb77c94044e94a8cf4318a473a13b" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:45.005762 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9036b076f3c64c818c3c9f94f6c4acf9" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:45.006501 12349 raft_consensus.cc:2468] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 2.
I20260709 13:05:45.006870 12634 leader_election.cc:290] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:45.016110 12197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c030549c2814e2b949de006d26f5514" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:45.018846 12611 leader_election.cc:290] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:44.957903 12640 raft_consensus.cc:493] T 03a56ae904c84229be46c9d8773eb639 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8094d462961742bdbb1b497a71355a24)
I20260709 13:05:45.025027 12196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb3962ca7144e23a7f8e13cb66c5691" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:45.025693 12198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f5ae9bf6da2464a80a3a9c8cf2c54dd" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:45.027110 12202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcd0d96ef5ec4e6782b4e4a056db2b4f" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:45.031526 12197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c766b4b3c24f7db3ed4de1e794a0d3" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:45.027637 12194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d42d833844a46f48d7b08d9129648b8" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:45.026692 12199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f0e3ad1e4344cf8177322fec690c78" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:45.033473 12200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0051bc6e9d314fcca7be8439e6fa998f" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:45.026698 12640 raft_consensus.cc:515] T 03a56ae904c84229be46c9d8773eb639 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:45.036928 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3beb77c94044e94a8cf4318a473a13b" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:45.006888 12598 leader_election.cc:290] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:45.037600 12347 raft_consensus.cc:2468] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 2.
I20260709 13:05:45.039582 12195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ef162d93c6a4ad2bba817bce6bbad60" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:45.041272 12640 leader_election.cc:290] T 03a56ae904c84229be46c9d8773eb639 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607)
I20260709 13:05:45.043448 12274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3beb77c94044e94a8cf4318a473a13b" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:45.043994 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9f87e57a6d4cb99b1fcd62ea87691b" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:45.045215 12351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcd0d96ef5ec4e6782b4e4a056db2b4f" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:45.045926 12351 raft_consensus.cc:2468] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 2.
I20260709 13:05:45.046030 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c030549c2814e2b949de006d26f5514" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:45.047652 12201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e107fbfc8174ff58fb3bdbb9077606a" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:45.047987 12195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53cb67f3c6240549cb8672a5d254db7" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:45.052886 12351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb3962ca7144e23a7f8e13cb66c5691" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:45.053646 12351 raft_consensus.cc:2468] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 2.
I20260709 13:05:45.055693 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea38e5274ba452894df20a69755dbda" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:45.055130 12351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53cb67f3c6240549cb8672a5d254db7" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:45.057457 12351 raft_consensus.cc:2468] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 2.
I20260709 13:05:45.058147 12273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcd0d96ef5ec4e6782b4e4a056db2b4f" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:45.058597 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d34a9b02754ff5ba682f7b6f960ab1" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:45.059371 12347 raft_consensus.cc:2468] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 1.
I20260709 13:05:45.062129 12639 raft_consensus.cc:515] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
W20260709 13:05:45.038667 12243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:37607, user_credentials={real_user=slave}} blocked reactor thread for 75332.9us
I20260709 13:05:45.063755 12275 raft_consensus.cc:1240] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Rejecting Update request from peer f706a4ebbb9e4c9f9d0a9259f1ac73e4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:45.064517 12314 leader_election.cc:304] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 
I20260709 13:05:45.065945 12350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d42d833844a46f48d7b08d9129648b8" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:45.066963 12351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f0e3ad1e4344cf8177322fec690c78" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:45.067458 12273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53cb67f3c6240549cb8672a5d254db7" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:45.070307 12351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20eda87dc6e642ad8791304d782e09a1" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:45.072042 12591 raft_consensus.cc:515] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:45.072271 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a56ae904c84229be46c9d8773eb639" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:45.072278 12275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea38e5274ba452894df20a69755dbda" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:45.072492 12640 raft_consensus.cc:2804] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:45.074048 12640 raft_consensus.cc:493] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8094d462961742bdbb1b497a71355a24)
I20260709 13:05:45.073933 12350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c766b4b3c24f7db3ed4de1e794a0d3" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:45.073995 12274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d42d833844a46f48d7b08d9129648b8" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:45.074117 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ef162d93c6a4ad2bba817bce6bbad60" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:45.075706 12277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c030549c2814e2b949de006d26f5514" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:45.076103 12348 raft_consensus.cc:2468] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 2.
I20260709 13:05:45.077131 12276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d42d833844a46f48d7b08d9129648b8" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:45.077396 12272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f5ae9bf6da2464a80a3a9c8cf2c54dd" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:45.078715 12351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20eda87dc6e642ad8791304d782e09a1" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:45.078871 12271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f0e3ad1e4344cf8177322fec690c78" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:45.079121 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0051bc6e9d314fcca7be8439e6fa998f" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:45.079564 12271 raft_consensus.cc:2468] T 33f0e3ad1e4344cf8177322fec690c78 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in term 1.
I20260709 13:05:45.079797 12639 leader_election.cc:290] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 3 election: Requested vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:45.080693 12277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcd0d96ef5ec4e6782b4e4a056db2b4f" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:45.081144 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9036b076f3c64c818c3c9f94f6c4acf9" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:45.074693 12640 raft_consensus.cc:3060] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.083521 12165 leader_election.cc:304] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 
I20260709 13:05:45.076050 12350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f5ae9bf6da2464a80a3a9c8cf2c54dd" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:45.084903 12195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20eda87dc6e642ad8791304d782e09a1" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:45.085768 12630 raft_consensus.cc:2804] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:45.086045 12165 leader_election.cc:304] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 
I20260709 13:05:45.086179 12630 raft_consensus.cc:493] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c00025c0f6594942bd14688ade17cb0e)
I20260709 13:05:45.086756 12630 raft_consensus.cc:3060] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.087093 12273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0051bc6e9d314fcca7be8439e6fa998f" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:45.089602 12349 raft_consensus.cc:2393] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c00025c0f6594942bd14688ade17cb0e in current term 3: Already voted for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in this term.
I20260709 13:05:45.092686 12591 leader_election.cc:290] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 election: Requested vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:45.088521 12599 raft_consensus.cc:2804] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:45.093690 12599 raft_consensus.cc:493] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c00025c0f6594942bd14688ade17cb0e)
I20260709 13:05:45.094071 12599 raft_consensus.cc:3060] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.094692 12199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ef162d93c6a4ad2bba817bce6bbad60" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:45.094951 12275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f5ae9bf6da2464a80a3a9c8cf2c54dd" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:45.097183 12275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9036b076f3c64c818c3c9f94f6c4acf9" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:45.097477 12200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a56ae904c84229be46c9d8773eb639" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:45.098081 12275 raft_consensus.cc:2393] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8094d462961742bdbb1b497a71355a24 in current term 3: Already voted for candidate c00025c0f6594942bd14688ade17cb0e in this term.
I20260709 13:05:45.099890 12275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20eda87dc6e642ad8791304d782e09a1" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:45.102003 12270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ef162d93c6a4ad2bba817bce6bbad60" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:45.097013 12317 leader_election.cc:304] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:45.091126 12273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c766b4b3c24f7db3ed4de1e794a0d3" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:45.092113 12195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea38e5274ba452894df20a69755dbda" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:45.090581 12165 leader_election.cc:304] T c53cb67f3c6240549cb8672a5d254db7 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 
I20260709 13:05:45.104590 12636 raft_consensus.cc:2804] T c53cb67f3c6240549cb8672a5d254db7 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:45.105034 12636 raft_consensus.cc:493] T c53cb67f3c6240549cb8672a5d254db7 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c00025c0f6594942bd14688ade17cb0e)
I20260709 13:05:45.105424 12636 raft_consensus.cc:3060] T c53cb67f3c6240549cb8672a5d254db7 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.105876 12591 raft_consensus.cc:2749] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:45.106518 12640 raft_consensus.cc:515] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:45.110267 12351 raft_consensus.cc:1240] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Rejecting Update request from peer 8094d462961742bdbb1b497a71355a24 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:45.111239 12273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e107fbfc8174ff58fb3bdbb9077606a" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:45.108626 12317 leader_election.cc:304] T 49c766b4b3c24f7db3ed4de1e794a0d3 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:45.112391 12591 raft_consensus.cc:2749] T 49c766b4b3c24f7db3ed4de1e794a0d3 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:45.113160 12273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53cb67f3c6240549cb8672a5d254db7" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:45.114070 12317 leader_election.cc:304] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:45.114969 12273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea38e5274ba452894df20a69755dbda" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:45.116640 12591 raft_consensus.cc:2749] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:45.102769 12201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a56ae904c84229be46c9d8773eb639" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:45.117904 12277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9f87e57a6d4cb99b1fcd62ea87691b" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
I20260709 13:05:45.118181 12345 raft_consensus.cc:1240] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Rejecting Update request from peer 8094d462961742bdbb1b497a71355a24 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:45.117038 12273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a56ae904c84229be46c9d8773eb639" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:45.124716 12270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d34a9b02754ff5ba682f7b6f960ab1" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
I20260709 13:05:45.125497 12274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb3962ca7144e23a7f8e13cb66c5691" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:45.108976 12640 leader_election.cc:290] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 2 election: Requested vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:45.128576 12591 consensus_queue.cc:1059] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:05:45.130115 12195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d34a9b02754ff5ba682f7b6f960ab1" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24"
I20260709 13:05:45.130579 12314 leader_election.cc:304] T 4c030549c2814e2b949de006d26f5514 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:45.130240 12200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9036b076f3c64c818c3c9f94f6c4acf9" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24"
I20260709 13:05:45.131230 12640 raft_consensus.cc:3055] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:45.132480 12640 raft_consensus.cc:740] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Running, Role: LEADER
I20260709 13:05:45.129878 12201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9f87e57a6d4cb99b1fcd62ea87691b" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24"
I20260709 13:05:45.133267 12314 leader_election.cc:304] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:45.134248 12598 raft_consensus.cc:2749] T 4c030549c2814e2b949de006d26f5514 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:45.133821 12640 consensus_queue.cc:260] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:45.134795 12314 leader_election.cc:304] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:45.135147 12598 raft_consensus.cc:2749] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:45.135646 12634 raft_consensus.cc:2749] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:45.136169 12314 leader_election.cc:304] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24
I20260709 13:05:45.136482 12640 raft_consensus.cc:3060] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.137192 12634 raft_consensus.cc:2804] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:45.137552 12634 raft_consensus.cc:493] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8094d462961742bdbb1b497a71355a24)
I20260709 13:05:45.137955 12634 raft_consensus.cc:3060] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.137737 12314 leader_election.cc:304] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:45.139233 12314 leader_election.cc:304] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:45.140522 12314 leader_election.cc:304] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:45.141273 12591 raft_consensus.cc:2749] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:45.142189 12591 raft_consensus.cc:2749] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:45.143890 12636 raft_consensus.cc:515] T c53cb67f3c6240549cb8672a5d254db7 P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:45.149502 12165 leader_election.cc:304] T aea38e5274ba452894df20a69755dbda P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8094d462961742bdbb1b497a71355a24; no voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:45.150777 12314 leader_election.cc:304] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:45.151284 12598 raft_consensus.cc:2749] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:45.151718 12591 raft_consensus.cc:2749] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:45.152546 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9036b076f3c64c818c3c9f94f6c4acf9" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
I20260709 13:05:45.153285 12314 leader_election.cc:304] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:45.154256 12591 raft_consensus.cc:2749] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:45.155148 12240 leader_election.cc:304] T 1e107fbfc8174ff58fb3bdbb9077606a P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24
I20260709 13:05:45.156008 12314 leader_election.cc:304] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:45.156217 12632 raft_consensus.cc:2804] T 1e107fbfc8174ff58fb3bdbb9077606a P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:45.156344 12599 raft_consensus.cc:515] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:45.156775 12632 raft_consensus.cc:493] T 1e107fbfc8174ff58fb3bdbb9077606a P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8094d462961742bdbb1b497a71355a24)
I20260709 13:05:45.157193 12632 raft_consensus.cc:3060] T 1e107fbfc8174ff58fb3bdbb9077606a P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.157301 12240 leader_election.cc:304] T 4c030549c2814e2b949de006d26f5514 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e; no voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:45.157419 12635 raft_consensus.cc:2749] T aea38e5274ba452894df20a69755dbda P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:45.157830 12591 raft_consensus.cc:2749] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:45.158643 12639 raft_consensus.cc:2749] T 4c030549c2814e2b949de006d26f5514 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:45.159089 12165 leader_election.cc:304] T 6d42d833844a46f48d7b08d9129648b8 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8094d462961742bdbb1b497a71355a24; no voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:45.159917 12635 raft_consensus.cc:2749] T 6d42d833844a46f48d7b08d9129648b8 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:45.160233 12314 leader_election.cc:304] T 03a56ae904c84229be46c9d8773eb639 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:45.161207 12591 raft_consensus.cc:2749] T 03a56ae904c84229be46c9d8773eb639 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:45.162341 12165 leader_election.cc:304] T 0051bc6e9d314fcca7be8439e6fa998f P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8094d462961742bdbb1b497a71355a24; no voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:45.162621 12314 leader_election.cc:304] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:45.153188 12630 raft_consensus.cc:515] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:45.163682 12591 raft_consensus.cc:2749] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:45.155830 12634 raft_consensus.cc:515] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:45.165834 12635 raft_consensus.cc:2749] T 0051bc6e9d314fcca7be8439e6fa998f P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:45.167841 12165 leader_election.cc:304] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8094d462961742bdbb1b497a71355a24; no voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:45.168773 12201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f0e3ad1e4344cf8177322fec690c78" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24"
I20260709 13:05:45.170704 12599 leader_election.cc:290] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 3 election: Requested vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:45.172402 12636 leader_election.cc:290] T c53cb67f3c6240549cb8672a5d254db7 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 3 election: Requested vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:45.165213 12630 leader_election.cc:290] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 3 election: Requested vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:45.173146 12240 leader_election.cc:304] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24
I20260709 13:05:45.174039 12639 raft_consensus.cc:2804] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:45.174440 12639 raft_consensus.cc:493] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8094d462961742bdbb1b497a71355a24)
I20260709 13:05:45.174757 12240 leader_election.cc:304] T a3d34a9b02754ff5ba682f7b6f960ab1 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24
I20260709 13:05:45.174798 12639 raft_consensus.cc:3060] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.165036 12314 leader_election.cc:304] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:45.177379 12635 raft_consensus.cc:2749] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:45.178500 12642 raft_consensus.cc:2804] T a3d34a9b02754ff5ba682f7b6f960ab1 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:45.178983 12642 raft_consensus.cc:493] T a3d34a9b02754ff5ba682f7b6f960ab1 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8094d462961742bdbb1b497a71355a24)
I20260709 13:05:45.179386 12642 raft_consensus.cc:3060] T a3d34a9b02754ff5ba682f7b6f960ab1 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.179886 12165 leader_election.cc:304] T 49c766b4b3c24f7db3ed4de1e794a0d3 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8094d462961742bdbb1b497a71355a24; no voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:45.181039 12635 raft_consensus.cc:2749] T 49c766b4b3c24f7db3ed4de1e794a0d3 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:45.180542 12640 raft_consensus.cc:2749] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:45.184208 12632 raft_consensus.cc:515] T 1e107fbfc8174ff58fb3bdbb9077606a P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:45.191622 12273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcd0d96ef5ec4e6782b4e4a056db2b4f" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
I20260709 13:05:45.186297 12634 leader_election.cc:290] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 2 election: Requested vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:45.187510 12274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f0e3ad1e4344cf8177322fec690c78" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
I20260709 13:05:45.190153 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcd0d96ef5ec4e6782b4e4a056db2b4f" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
I20260709 13:05:45.190428 12351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53cb67f3c6240549cb8672a5d254db7" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
I20260709 13:05:45.193156 12277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53cb67f3c6240549cb8672a5d254db7" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
I20260709 13:05:45.190783 12270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3beb77c94044e94a8cf4318a473a13b" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
I20260709 13:05:45.184203 12347 raft_consensus.cc:2468] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 3.
I20260709 13:05:45.194582 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3beb77c94044e94a8cf4318a473a13b" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
I20260709 13:05:45.191210 12350 raft_consensus.cc:1240] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Rejecting Update request from peer 8094d462961742bdbb1b497a71355a24 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:45.196851 12240 leader_election.cc:304] T 33f0e3ad1e4344cf8177322fec690c78 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e; no voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:45.198027 12643 raft_consensus.cc:2749] T 33f0e3ad1e4344cf8177322fec690c78 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:45.189579 12165 leader_election.cc:304] T 9036b076f3c64c818c3c9f94f6c4acf9 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8094d462961742bdbb1b497a71355a24; no voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:45.197274 12632 leader_election.cc:290] T 1e107fbfc8174ff58fb3bdbb9077606a P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 3 election: Requested vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:45.201995 12314 leader_election.cc:304] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:45.200450 12630 raft_consensus.cc:3060] T 9036b076f3c64c818c3c9f94f6c4acf9 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.198518 12240 leader_election.cc:304] T 20eda87dc6e642ad8791304d782e09a1 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e; no voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:45.207191 12643 raft_consensus.cc:2749] T 20eda87dc6e642ad8791304d782e09a1 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:45.207332 12240 leader_election.cc:304] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e; no voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:45.201562 12201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e107fbfc8174ff58fb3bdbb9077606a" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24"
I20260709 13:05:45.206959 12642 raft_consensus.cc:515] T a3d34a9b02754ff5ba682f7b6f960ab1 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:45.200213 12165 leader_election.cc:304] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8094d462961742bdbb1b497a71355a24; no voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:45.210978 12634 raft_consensus.cc:2749] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:45.210444 12240 leader_election.cc:304] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24
I20260709 13:05:45.211970 12643 raft_consensus.cc:2804] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:45.212323 12643 raft_consensus.cc:493] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8094d462961742bdbb1b497a71355a24)
I20260709 13:05:45.212405 12201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d34a9b02754ff5ba682f7b6f960ab1" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24"
I20260709 13:05:45.211267 12635 raft_consensus.cc:2749] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:45.212736 12643 raft_consensus.cc:3060] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.213632 12240 leader_election.cc:304] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e; no voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:45.215214 12240 leader_election.cc:304] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24
I20260709 13:05:45.210520 12632 raft_consensus.cc:2749] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:45.214303 12635 consensus_queue.cc:1059] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:05:45.217372 12631 raft_consensus.cc:3060] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.217406 12633 raft_consensus.cc:2804] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:45.218356 12635 raft_consensus.cc:3055] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:45.218899 12633 raft_consensus.cc:697] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [term 3 LEADER]: Becoming Leader. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Running, Role: LEADER
I20260709 13:05:45.219242 12635 raft_consensus.cc:740] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Running, Role: LEADER
I20260709 13:05:45.220484 12633 consensus_queue.cc:237] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:45.221899 12636 consensus_queue.cc:1059] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:45.223172 12599 raft_consensus.cc:3055] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:45.220505 12635 consensus_queue.cc:260] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:45.223553 12599 raft_consensus.cc:740] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Running, Role: LEADER
I20260709 13:05:45.224352 12635 raft_consensus.cc:3060] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.224570 12599 consensus_queue.cc:260] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:45.230417 12350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e107fbfc8174ff58fb3bdbb9077606a" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
I20260709 13:05:45.231328 12642 leader_election.cc:290] T a3d34a9b02754ff5ba682f7b6f960ab1 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 2 election: Requested vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:45.231787 12599 raft_consensus.cc:3060] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.225998 12639 raft_consensus.cc:515] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:45.238346 12201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb3962ca7144e23a7f8e13cb66c5691" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24"
I20260709 13:05:45.239848 12350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d34a9b02754ff5ba682f7b6f960ab1" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
I20260709 13:05:45.240806 12350 raft_consensus.cc:2393] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c00025c0f6594942bd14688ade17cb0e in current term 2: Already voted for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in this term.
I20260709 13:05:45.243431 12639 leader_election.cc:290] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 3 election: Requested vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:45.246462 12599 consensus_queue.cc:1059] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:45.247870 12599 raft_consensus.cc:3055] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:45.248317 12599 raft_consensus.cc:740] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Running, Role: LEADER
I20260709 13:05:45.249433 12599 consensus_queue.cc:260] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:45.251093 12599 raft_consensus.cc:3060] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.254019 12630 raft_consensus.cc:2749] T 9036b076f3c64c818c3c9f94f6c4acf9 P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:45.254335 12631 raft_consensus.cc:2749] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:45.232692 12240 leader_election.cc:304] T 1e107fbfc8174ff58fb3bdbb9077606a P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e; no voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:45.256214 12643 raft_consensus.cc:515] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:45.257252 12350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb3962ca7144e23a7f8e13cb66c5691" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
I20260709 13:05:45.259398 12639 raft_consensus.cc:2749] T 1e107fbfc8174ff58fb3bdbb9077606a P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:45.259948 12240 leader_election.cc:304] T a3d34a9b02754ff5ba682f7b6f960ab1 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e; no voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:45.261649 12632 raft_consensus.cc:2749] T a3d34a9b02754ff5ba682f7b6f960ab1 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:45.261684 12270 raft_consensus.cc:1240] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Rejecting Update request from peer 8094d462961742bdbb1b497a71355a24 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:45.262646 12201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ef162d93c6a4ad2bba817bce6bbad60" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24"
I20260709 13:05:45.265794 12240 leader_election.cc:304] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e; no voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:45.272199 12639 raft_consensus.cc:2749] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:45.267503 12165 leader_election.cc:304] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8094d462961742bdbb1b497a71355a24; no voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:45.274358 12201 raft_consensus.cc:1240] T c53cb67f3c6240549cb8672a5d254db7 P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Rejecting Update request from peer c00025c0f6594942bd14688ade17cb0e for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:45.276073 12636 raft_consensus.cc:2749] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:45.276631 12165 leader_election.cc:304] T c53cb67f3c6240549cb8672a5d254db7 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8094d462961742bdbb1b497a71355a24; no voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:45.277796 12636 raft_consensus.cc:2749] T c53cb67f3c6240549cb8672a5d254db7 P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:45.278268 12270 raft_consensus.cc:1240] T a3d34a9b02754ff5ba682f7b6f960ab1 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Rejecting Update request from peer 8094d462961742bdbb1b497a71355a24 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:45.278467 12639 consensus_queue.cc:1059] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:45.279856 12639 raft_consensus.cc:3055] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:45.280220 12639 raft_consensus.cc:740] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Running, Role: LEADER
I20260709 13:05:45.284125 12165 leader_election.cc:304] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8094d462961742bdbb1b497a71355a24; no voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:45.285637 12635 raft_consensus.cc:2749] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:45.286296 12639 consensus_queue.cc:260] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:45.288656 12639 raft_consensus.cc:3060] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.291963 12098 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47126:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:05:45.300922 12635 consensus_queue.cc:1059] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:45.302445 12635 raft_consensus.cc:3055] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:45.302929 12635 raft_consensus.cc:740] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Running, Role: LEADER
I20260709 13:05:45.304167 12635 consensus_queue.cc:260] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:45.305953 12635 raft_consensus.cc:3060] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.306336 12270 raft_consensus.cc:1240] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Rejecting Update request from peer 8094d462961742bdbb1b497a71355a24 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:45.316723 12630 consensus_queue.cc:1059] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:45.318747 12599 raft_consensus.cc:3055] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:45.319202 12599 raft_consensus.cc:740] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Running, Role: LEADER
I20260709 13:05:45.320039 12643 leader_election.cc:290] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 3 election: Requested vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:45.320660 12270 raft_consensus.cc:1240] T 1e107fbfc8174ff58fb3bdbb9077606a P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Rejecting Update request from peer 8094d462961742bdbb1b497a71355a24 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:45.320319 12599 consensus_queue.cc:260] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:45.322228 12599 raft_consensus.cc:3060] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.326340 12630 consensus_queue.cc:1059] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:45.326333 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ef162d93c6a4ad2bba817bce6bbad60" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
I20260709 13:05:45.340376 12636 raft_consensus.cc:3055] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:45.340955 12636 raft_consensus.cc:740] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Running, Role: LEADER
I20260709 13:05:45.342034 12636 consensus_queue.cc:260] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:45.343743 12636 raft_consensus.cc:3060] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.355250 12240 leader_election.cc:304] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e; no voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:45.356442 12639 raft_consensus.cc:2749] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:05:45.356746 12184 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:32988: Illegal state: replica 8094d462961742bdbb1b497a71355a24 is not leader of this config: current role FOLLOWER
W20260709 13:05:45.360144 12087 catalog_manager.cc:5107] TS 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607): alter failed for tablet 1ef162d93c6a4ad2bba817bce6bbad60 (table soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]): Illegal state: replica 8094d462961742bdbb1b497a71355a24 is not leader of this config: current role FOLLOWER
W20260709 13:05:45.363220 12184 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:32988: Illegal state: replica 8094d462961742bdbb1b497a71355a24 is not leader of this config: current role FOLLOWER
W20260709 13:05:45.363471 12185 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:32988: Illegal state: replica 8094d462961742bdbb1b497a71355a24 is not leader of this config: current role FOLLOWER
W20260709 13:05:45.364053 12190 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:32988: Illegal state: replica 8094d462961742bdbb1b497a71355a24 is not leader of this config: current role FOLLOWER
I20260709 13:05:45.365932 12097 catalog_manager.cc:5697] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e reported cstate change: term changed from 2 to 3, leader changed from f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195) to c00025c0f6594942bd14688ade17cb0e (127.0.107.194). New cstate: current_term: 3 leader_uuid: "c00025c0f6594942bd14688ade17cb0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:45.367745 12097 catalog_manager.cc:5789] TS c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905) does not have the latest schema for tablet 9036b076f3c64c818c3c9f94f6c4acf9 (table soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]). Expected version 1 got 0
W20260709 13:05:45.383087 12184 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:32988: Illegal state: replica 8094d462961742bdbb1b497a71355a24 is not leader of this config: current role FOLLOWER
I20260709 13:05:45.391215   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:05:45.392753 12334 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34202: Illegal state: replica f706a4ebbb9e4c9f9d0a9259f1ac73e4 is not leader of this config: current role FOLLOWER
I20260709 13:05:45.447032 12195 raft_consensus.cc:1240] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Rejecting Update request from peer c00025c0f6594942bd14688ade17cb0e for earlier term 2. Current term is 3. Ops: []
W20260709 13:05:45.453859 12184 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:32988: Illegal state: replica 8094d462961742bdbb1b497a71355a24 is not leader of this config: current role FOLLOWER
I20260709 13:05:45.451154 12633 consensus_queue.cc:1059] T f3beb77c94044e94a8cf4318a473a13b P c00025c0f6594942bd14688ade17cb0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:05:45.457043 12633 raft_consensus.cc:3055] T f3beb77c94044e94a8cf4318a473a13b P c00025c0f6594942bd14688ade17cb0e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:45.457149 12347 raft_consensus.cc:1275] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Refusing update from remote peer c00025c0f6594942bd14688ade17cb0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:05:45.457480 12633 raft_consensus.cc:740] T f3beb77c94044e94a8cf4318a473a13b P c00025c0f6594942bd14688ade17cb0e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Running, Role: LEADER
I20260709 13:05:45.458527 12633 consensus_queue.cc:260] T f3beb77c94044e94a8cf4318a473a13b P c00025c0f6594942bd14688ade17cb0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:45.461134 12195 raft_consensus.cc:1275] T 9036b076f3c64c818c3c9f94f6c4acf9 P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Refusing update from remote peer c00025c0f6594942bd14688ade17cb0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:05:45.461038 12642 consensus_queue.cc:1048] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:45.461840 12633 raft_consensus.cc:3060] T f3beb77c94044e94a8cf4318a473a13b P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:45.463303 12190 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:32988: Illegal state: replica 8094d462961742bdbb1b497a71355a24 is not leader of this config: current role FOLLOWER
W20260709 13:05:45.464721 12184 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:32988: Illegal state: replica 8094d462961742bdbb1b497a71355a24 is not leader of this config: current role FOLLOWER
W20260709 13:05:45.466444 12190 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:32988: Illegal state: replica 8094d462961742bdbb1b497a71355a24 is not leader of this config: current role FOLLOWER
I20260709 13:05:45.466616 12639 consensus_queue.cc:1048] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:45.510893 12199 raft_consensus.cc:1240] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Rejecting Update request from peer c00025c0f6594942bd14688ade17cb0e for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20260709 13:05:45.516862 12639 consensus_queue.cc:1059] T bcd0d96ef5ec4e6782b4e4a056db2b4f P c00025c0f6594942bd14688ade17cb0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:05:45.533974 12559 raft_consensus.cc:3055] T bcd0d96ef5ec4e6782b4e4a056db2b4f P c00025c0f6594942bd14688ade17cb0e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:45.534457 12559 raft_consensus.cc:740] T bcd0d96ef5ec4e6782b4e4a056db2b4f P c00025c0f6594942bd14688ade17cb0e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Running, Role: LEADER
W20260709 13:05:45.535238 12190 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:32988: Illegal state: replica 8094d462961742bdbb1b497a71355a24 is not leader of this config: current role FOLLOWER
I20260709 13:05:45.535296 12559 consensus_queue.cc:260] T bcd0d96ef5ec4e6782b4e4a056db2b4f P c00025c0f6594942bd14688ade17cb0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:45.538949 12097 catalog_manager.cc:5789] TS f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793) does not have the latest schema for tablet 9036b076f3c64c818c3c9f94f6c4acf9 (table soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]). Expected version 1 got 0
I20260709 13:05:45.552775 12668 tablet.cc:1724] T 49c766b4b3c24f7db3ed4de1e794a0d3 P c00025c0f6594942bd14688ade17cb0e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:45.511076 12665 tablet.cc:1724] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P c00025c0f6594942bd14688ade17cb0e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:45.596789 12559 raft_consensus.cc:3060] T bcd0d96ef5ec4e6782b4e4a056db2b4f P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:45.603405 12184 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:32988: Illegal state: replica 8094d462961742bdbb1b497a71355a24 is not leader of this config: current role FOLLOWER
W20260709 13:05:45.604939 12190 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:32988: Illegal state: replica 8094d462961742bdbb1b497a71355a24 is not leader of this config: current role FOLLOWER
I20260709 13:05:45.607046 12649 mvcc.cc:204] Tried to move back new op lower bound from 7305635206952390656 to 7305635206045528064. Current Snapshot: MvccSnapshot[applied={T|T < 7305635206952390656}]
I20260709 13:05:45.608987 12097 catalog_manager.cc:5789] TS 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607) does not have the latest schema for tablet 9036b076f3c64c818c3c9f94f6c4acf9 (table soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]). Expected version 1 got 0
I20260709 13:05:45.616596 12098 catalog_manager.cc:5789] TS f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793) does not have the latest schema for tablet 9036b076f3c64c818c3c9f94f6c4acf9 (table soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]). Expected version 1 got 0
W20260709 13:05:45.608978 12190 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:32988: Illegal state: replica 8094d462961742bdbb1b497a71355a24 is not leader of this config: current role FOLLOWER
I20260709 13:05:45.617733 12672 tablet.cc:1724] T 49c766b4b3c24f7db3ed4de1e794a0d3 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:45.618733 12099 catalog_manager.cc:5789] TS c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905) does not have the latest schema for tablet 9036b076f3c64c818c3c9f94f6c4acf9 (table soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]). Expected version 1 got 0
W20260709 13:05:45.621726 12651 log.cc:927] Time spent T 6d42d833844a46f48d7b08d9129648b8 P c00025c0f6594942bd14688ade17cb0e: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:05:45.625530 12665 tablet.cc:1724] T 6d42d833844a46f48d7b08d9129648b8 P c00025c0f6594942bd14688ade17cb0e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:05:45.650104 12190 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:32988: Illegal state: replica 8094d462961742bdbb1b497a71355a24 is not leader of this config: current role FOLLOWER
I20260709 13:05:45.655651 12678 tablet.cc:1724] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:45.571162 12669 tablet.cc:1724] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P 8094d462961742bdbb1b497a71355a24: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:45.670318 12681 tablet.cc:1724] T 9036b076f3c64c818c3c9f94f6c4acf9 P 8094d462961742bdbb1b497a71355a24: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:45.680606 12195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c030549c2814e2b949de006d26f5514"
dest_uuid: "8094d462961742bdbb1b497a71355a24"
mode: GRACEFUL
new_leader_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
 from {username='slave'} at 127.0.0.1:47398
I20260709 13:05:45.658727 12671 tablet.cc:1724] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:45.685256 12677 tablet.cc:1724] T 49c766b4b3c24f7db3ed4de1e794a0d3 P 8094d462961742bdbb1b497a71355a24: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:45.685359 12099 catalog_manager.cc:5789] TS 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607) does not have the latest schema for tablet 9036b076f3c64c818c3c9f94f6c4acf9 (table soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]). Expected version 1 got 0
I20260709 13:05:45.687652 12672 tablet.cc:1724] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:45.695370 12676 tablet.cc:1724] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:45.699332 12682 tablet.cc:1724] T 6d42d833844a46f48d7b08d9129648b8 P 8094d462961742bdbb1b497a71355a24: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:45.701921 12098 catalog_manager.cc:5789] TS c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905) does not have the latest schema for tablet 9036b076f3c64c818c3c9f94f6c4acf9 (table soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]). Expected version 1 got 0
W20260709 13:05:45.706132 12190 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:32988: Illegal state: replica 8094d462961742bdbb1b497a71355a24 is not leader of this config: current role FOLLOWER
I20260709 13:05:45.722343 12195 raft_consensus.cc:606] T 4c030549c2814e2b949de006d26f5514 P 8094d462961742bdbb1b497a71355a24 [term 1 LEADER]: Received request to transfer leadership to TS f706a4ebbb9e4c9f9d0a9259f1ac73e4
W20260709 13:05:45.737718 12190 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:32988: Illegal state: replica 8094d462961742bdbb1b497a71355a24 is not leader of this config: current role FOLLOWER
I20260709 13:05:45.769006 12270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3beb77c94044e94a8cf4318a473a13b"
dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
mode: GRACEFUL
new_leader_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
 from {username='slave'} at 127.0.0.1:46092
I20260709 13:05:45.769703 12270 raft_consensus.cc:606] T f3beb77c94044e94a8cf4318a473a13b P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Received request to transfer leadership to TS f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:45.770028 12270 raft_consensus.cc:614] T f3beb77c94044e94a8cf4318a473a13b P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:45.771358   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:45.771946   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:05:45.779810 12190 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:32988: Illegal state: replica 8094d462961742bdbb1b497a71355a24 is not leader of this config: current role FOLLOWER
W20260709 13:05:45.814962 12190 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:32988: Illegal state: replica 8094d462961742bdbb1b497a71355a24 is not leader of this config: current role FOLLOWER
I20260709 13:05:45.878309 12684 raft_consensus.cc:993] T 4c030549c2814e2b949de006d26f5514 P 8094d462961742bdbb1b497a71355a24: : Instructing follower f706a4ebbb9e4c9f9d0a9259f1ac73e4 to start an election
I20260709 13:05:45.878831 12636 raft_consensus.cc:1081] T 4c030549c2814e2b949de006d26f5514 P 8094d462961742bdbb1b497a71355a24 [term 1 LEADER]: Signalling peer f706a4ebbb9e4c9f9d0a9259f1ac73e4 to start an election
I20260709 13:05:45.880432 12345 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c030549c2814e2b949de006d26f5514"
dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
 from {username='slave'} at 127.0.0.1:34204
I20260709 13:05:45.880999 12345 raft_consensus.cc:493] T 4c030549c2814e2b949de006d26f5514 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:45.881386 12345 raft_consensus.cc:3060] T 4c030549c2814e2b949de006d26f5514 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:45.893688 12190 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:32988: Illegal state: replica 8094d462961742bdbb1b497a71355a24 is not leader of this config: current role FOLLOWER
W20260709 13:05:45.895221 12184 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:32988: Illegal state: replica 8094d462961742bdbb1b497a71355a24 is not leader of this config: current role FOLLOWER
I20260709 13:05:45.904196 12345 raft_consensus.cc:515] T 4c030549c2814e2b949de006d26f5514 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:45.907016 12345 leader_election.cc:290] T 4c030549c2814e2b949de006d26f5514 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 2 election: Requested vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:45.908130 12195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c030549c2814e2b949de006d26f5514" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8094d462961742bdbb1b497a71355a24"
I20260709 13:05:45.908849 12195 raft_consensus.cc:3055] T 4c030549c2814e2b949de006d26f5514 P 8094d462961742bdbb1b497a71355a24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:45.909204 12195 raft_consensus.cc:740] T 4c030549c2814e2b949de006d26f5514 P 8094d462961742bdbb1b497a71355a24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Running, Role: LEADER
I20260709 13:05:45.909446 12270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c030549c2814e2b949de006d26f5514" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
I20260709 13:05:45.910051 12270 raft_consensus.cc:3060] T 4c030549c2814e2b949de006d26f5514 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.910097 12195 consensus_queue.cc:260] T 4c030549c2814e2b949de006d26f5514 P 8094d462961742bdbb1b497a71355a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:45.912215 12195 raft_consensus.cc:3060] T 4c030549c2814e2b949de006d26f5514 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.921389 12270 raft_consensus.cc:2468] T 4c030549c2814e2b949de006d26f5514 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in term 2.
I20260709 13:05:45.922475 12195 raft_consensus.cc:2468] T 4c030549c2814e2b949de006d26f5514 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in term 2.
I20260709 13:05:45.923080 12314 leader_election.cc:304] T 4c030549c2814e2b949de006d26f5514 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 
I20260709 13:05:45.924139 12634 raft_consensus.cc:2804] T 4c030549c2814e2b949de006d26f5514 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:45.928119 12634 raft_consensus.cc:697] T 4c030549c2814e2b949de006d26f5514 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 LEADER]: Becoming Leader. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Running, Role: LEADER
I20260709 13:05:45.929574 12634 consensus_queue.cc:237] T 4c030549c2814e2b949de006d26f5514 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:45.942356 12097 catalog_manager.cc:5697] T 4c030549c2814e2b949de006d26f5514 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 reported cstate change: term changed from 1 to 2, leader changed from 8094d462961742bdbb1b497a71355a24 (127.0.107.193) to f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:46.053578 12184 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:32988: Illegal state: replica 8094d462961742bdbb1b497a71355a24 is not leader of this config: current role FOLLOWER
W20260709 13:05:46.126065 12184 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:32988: Illegal state: replica 8094d462961742bdbb1b497a71355a24 is not leader of this config: current role FOLLOWER
W20260709 13:05:46.165596 12184 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:32988: Illegal state: replica 8094d462961742bdbb1b497a71355a24 is not leader of this config: current role FOLLOWER
W20260709 13:05:46.193348 12184 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:32988: Illegal state: replica 8094d462961742bdbb1b497a71355a24 is not leader of this config: current role FOLLOWER
I20260709 13:05:46.372287 12636 raft_consensus.cc:493] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.373045 12636 raft_consensus.cc:515] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:46.376330 12636 leader_election.cc:290] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:46.376703 12270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9f87e57a6d4cb99b1fcd62ea87691b" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:46.378499 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9f87e57a6d4cb99b1fcd62ea87691b" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:46.380048 12349 raft_consensus.cc:2468] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 3.
I20260709 13:05:46.381436 12165 leader_election.cc:304] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:46.382308 12636 raft_consensus.cc:2804] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:46.382745 12636 raft_consensus.cc:493] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:46.383211 12636 raft_consensus.cc:3060] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:46.386147 12270 raft_consensus.cc:1275] T 4c030549c2814e2b949de006d26f5514 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Refusing update from remote peer f706a4ebbb9e4c9f9d0a9259f1ac73e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:46.388274 12634 consensus_queue.cc:1048] T 4c030549c2814e2b949de006d26f5514 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:46.394198 12636 raft_consensus.cc:515] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:46.396726 12636 leader_election.cc:290] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 4 election: Requested vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:46.397760 12277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9f87e57a6d4cb99b1fcd62ea87691b" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
I20260709 13:05:46.401255 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9f87e57a6d4cb99b1fcd62ea87691b" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
I20260709 13:05:46.402210 12349 raft_consensus.cc:3060] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:46.431583 12636 raft_consensus.cc:493] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.432682 12636 raft_consensus.cc:515] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:46.434849 12195 raft_consensus.cc:1275] T 4c030549c2814e2b949de006d26f5514 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Refusing update from remote peer f706a4ebbb9e4c9f9d0a9259f1ac73e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:46.440493 12634 consensus_queue.cc:1048] T 4c030549c2814e2b949de006d26f5514 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:46.435971 12636 leader_election.cc:290] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:46.436583 12277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d34a9b02754ff5ba682f7b6f960ab1" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:46.438254 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d34a9b02754ff5ba682f7b6f960ab1" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:46.443812 12345 raft_consensus.cc:2468] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 2.
I20260709 13:05:46.450629 12165 leader_election.cc:304] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 
I20260709 13:05:46.453356 12636 raft_consensus.cc:2804] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:46.454066 12636 raft_consensus.cc:493] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:46.454783 12636 raft_consensus.cc:3060] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:46.463603 12349 raft_consensus.cc:2468] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 4.
I20260709 13:05:46.465322 12165 leader_election.cc:304] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:46.475239 12694 raft_consensus.cc:2804] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:46.475915 12694 raft_consensus.cc:697] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [term 4 LEADER]: Becoming Leader. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Running, Role: LEADER
I20260709 13:05:46.477129 12694 consensus_queue.cc:237] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:46.491847 12636 raft_consensus.cc:515] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:46.495386 12636 leader_election.cc:290] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 3 election: Requested vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:46.496214 12636 raft_consensus.cc:493] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.496796 12636 raft_consensus.cc:515] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:46.499433 12270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d34a9b02754ff5ba682f7b6f960ab1" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
I20260709 13:05:46.499490 12636 leader_election.cc:290] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:46.501056 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d34a9b02754ff5ba682f7b6f960ab1" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
I20260709 13:05:46.501802 12349 raft_consensus.cc:3060] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:46.510210 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb3962ca7144e23a7f8e13cb66c5691" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:46.512743 12270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb3962ca7144e23a7f8e13cb66c5691" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:46.515139 12165 leader_election.cc:304] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8094d462961742bdbb1b497a71355a24; no voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:46.516810 12693 raft_consensus.cc:2749] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:46.521409 12097 catalog_manager.cc:5697] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8094d462961742bdbb1b497a71355a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:46.522927 12097 catalog_manager.cc:5789] TS 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607) does not have the latest schema for tablet 6b9f87e57a6d4cb99b1fcd62ea87691b (table soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]). Expected version 1 got 0
I20260709 13:05:46.528309 12349 raft_consensus.cc:2468] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 3.
I20260709 13:05:46.532645 12165 leader_election.cc:304] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:46.534044 12693 raft_consensus.cc:2804] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:46.534571 12693 raft_consensus.cc:697] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [term 3 LEADER]: Becoming Leader. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Running, Role: LEADER
I20260709 13:05:46.535493 12693 consensus_queue.cc:237] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:46.575696 12097 catalog_manager.cc:5697] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "8094d462961742bdbb1b497a71355a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:46.577064 12097 catalog_manager.cc:5789] TS 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607) does not have the latest schema for tablet a3d34a9b02754ff5ba682f7b6f960ab1 (table soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]). Expected version 1 got 0
W20260709 13:05:46.591107 12184 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:32988: Illegal state: replica 8094d462961742bdbb1b497a71355a24 is not leader of this config: current role FOLLOWER
W20260709 13:05:46.592639 12087 catalog_manager.cc:5107] TS 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607): alter failed for tablet 1ef162d93c6a4ad2bba817bce6bbad60 (table soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]): Illegal state: replica 8094d462961742bdbb1b497a71355a24 is not leader of this config: current role FOLLOWER
I20260709 13:05:46.664084 12349 raft_consensus.cc:1275] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 4 FOLLOWER]: Refusing update from remote peer 8094d462961742bdbb1b497a71355a24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:46.664985 12270 raft_consensus.cc:3060] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:46.665966 12693 consensus_queue.cc:1048] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:46.676330 12270 raft_consensus.cc:1275] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e [term 4 FOLLOWER]: Refusing update from remote peer 8094d462961742bdbb1b497a71355a24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:46.688992 12693 consensus_queue.cc:1048] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:46.697474 12097 catalog_manager.cc:5789] TS f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793) does not have the latest schema for tablet 6b9f87e57a6d4cb99b1fcd62ea87691b (table soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]). Expected version 1 got 0
I20260709 13:05:46.707788 12705 tablet.cc:1724] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:46.715317 12097 catalog_manager.cc:5789] TS 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607) does not have the latest schema for tablet 6b9f87e57a6d4cb99b1fcd62ea87691b (table soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]). Expected version 1 got 0
I20260709 13:05:46.718626 12706 tablet.cc:1724] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:46.719882 12693 raft_consensus.cc:493] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.720520 12693 raft_consensus.cc:515] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:46.722806 12693 leader_election.cc:290] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:46.726058 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f0e3ad1e4344cf8177322fec690c78" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:46.726881 12345 raft_consensus.cc:2468] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 2.
I20260709 13:05:46.727815 12347 raft_consensus.cc:1275] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Refusing update from remote peer 8094d462961742bdbb1b497a71355a24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:46.728060 12270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f0e3ad1e4344cf8177322fec690c78" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:46.730391 12165 leader_election.cc:304] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: c00025c0f6594942bd14688ade17cb0e
W20260709 13:05:46.731666 12184 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:32988: Illegal state: replica 8094d462961742bdbb1b497a71355a24 is not leader of this config: current role FOLLOWER
I20260709 13:05:46.732215 12696 raft_consensus.cc:2804] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:46.732798 12696 raft_consensus.cc:493] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:46.733366 12696 raft_consensus.cc:3060] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:46.736716 12693 consensus_queue.cc:1048] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:05:46.745404 12097 catalog_manager.cc:5789] TS c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905) does not have the latest schema for tablet 6b9f87e57a6d4cb99b1fcd62ea87691b (table soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]). Expected version 1 got 0
I20260709 13:05:46.745728 12270 raft_consensus.cc:3060] T a3d34a9b02754ff5ba682f7b6f960ab1 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:46.748589 12633 raft_consensus.cc:493] T 33f0e3ad1e4344cf8177322fec690c78 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8094d462961742bdbb1b497a71355a24)
I20260709 13:05:46.749455 12099 catalog_manager.cc:5789] TS f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793) does not have the latest schema for tablet 6b9f87e57a6d4cb99b1fcd62ea87691b (table soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]). Expected version 1 got 0
I20260709 13:05:46.749270 12633 raft_consensus.cc:515] T 33f0e3ad1e4344cf8177322fec690c78 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:46.754177 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f0e3ad1e4344cf8177322fec690c78" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:46.755052 12347 raft_consensus.cc:2393] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c00025c0f6594942bd14688ade17cb0e in current term 2: Already voted for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in this term.
I20260709 13:05:46.754966 12200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f0e3ad1e4344cf8177322fec690c78" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:46.757829 12696 raft_consensus.cc:515] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:46.759124 12200 raft_consensus.cc:2368] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c00025c0f6594942bd14688ade17cb0e for earlier term 2. Current term is 3.
I20260709 13:05:46.759599 12633 leader_election.cc:290] T 33f0e3ad1e4344cf8177322fec690c78 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:46.762557 12243 leader_election.cc:400] T 33f0e3ad1e4344cf8177322fec690c78 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 2 pre-election: Vote denied by peer 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607) with higher term. Message: Invalid argument: T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c00025c0f6594942bd14688ade17cb0e for earlier term 2. Current term is 3.
I20260709 13:05:46.764117 12243 leader_election.cc:403] T 33f0e3ad1e4344cf8177322fec690c78 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:46.765605 12707 raft_consensus.cc:3060] T 33f0e3ad1e4344cf8177322fec690c78 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:05:46.765673 12274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f0e3ad1e4344cf8177322fec690c78" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
I20260709 13:05:46.767700 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f0e3ad1e4344cf8177322fec690c78" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
I20260709 13:05:46.768424 12347 raft_consensus.cc:3060] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:46.771140 12270 raft_consensus.cc:1275] T a3d34a9b02754ff5ba682f7b6f960ab1 P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Refusing update from remote peer 8094d462961742bdbb1b497a71355a24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:46.778173 12636 consensus_queue.cc:1048] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:46.787850 12707 raft_consensus.cc:2749] T 33f0e3ad1e4344cf8177322fec690c78 P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607) with higher term. Message: Invalid argument: T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c00025c0f6594942bd14688ade17cb0e for earlier term 2. Current term is 3.
I20260709 13:05:46.807200 12710 tablet.cc:1724] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:05:46.811884 12243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37607, user_credentials={real_user=slave}} blocked reactor thread for 49452.1us
I20260709 13:05:46.817380 12274 raft_consensus.cc:2468] T 33f0e3ad1e4344cf8177322fec690c78 P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 3.
I20260709 13:05:46.824245 12165 leader_election.cc:304] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e; no voters: 
I20260709 13:05:46.825022 12636 raft_consensus.cc:2804] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:46.825827 12685 raft_consensus.cc:493] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8094d462961742bdbb1b497a71355a24)
I20260709 13:05:46.825865 12636 raft_consensus.cc:697] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [term 3 LEADER]: Becoming Leader. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Running, Role: LEADER
I20260709 13:05:46.826701 12685 raft_consensus.cc:515] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:46.829598 12634 raft_consensus.cc:493] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c00025c0f6594942bd14688ade17cb0e)
I20260709 13:05:46.830097 12636 consensus_queue.cc:237] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:46.830389 12634 raft_consensus.cc:515] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:46.831357 12685 leader_election.cc:290] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:46.814715 12696 leader_election.cc:290] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 3 election: Requested vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:46.832654 12634 leader_election.cc:290] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:46.836717 12195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3beb77c94044e94a8cf4318a473a13b" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:46.838013 12195 raft_consensus.cc:2393] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in current term 3: Already voted for candidate 8094d462961742bdbb1b497a71355a24 in this term.
I20260709 13:05:46.845229 12200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e107fbfc8174ff58fb3bdbb9077606a" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:46.845603 12277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3beb77c94044e94a8cf4318a473a13b" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:46.846194 12200 raft_consensus.cc:2468] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in term 3.
I20260709 13:05:46.846364 12277 raft_consensus.cc:2468] T f3beb77c94044e94a8cf4318a473a13b P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in term 3.
I20260709 13:05:46.845674 12705 tablet.cc:1724] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:46.845898 12706 tablet.cc:1724] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:46.847723 12314 leader_election.cc:304] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24
I20260709 13:05:46.848387 12317 leader_election.cc:304] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 
I20260709 13:05:46.849421 12685 raft_consensus.cc:2804] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:46.850235 12685 raft_consensus.cc:493] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c00025c0f6594942bd14688ade17cb0e)
I20260709 13:05:46.850658 12685 raft_consensus.cc:3060] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:46.849510 12634 raft_consensus.cc:2804] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:46.850742 12274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e107fbfc8174ff58fb3bdbb9077606a" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:46.851238 12634 raft_consensus.cc:493] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8094d462961742bdbb1b497a71355a24)
I20260709 13:05:46.851687 12634 raft_consensus.cc:3060] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:46.852140 12274 raft_consensus.cc:2393] T 1e107fbfc8174ff58fb3bdbb9077606a P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in current term 3: Already voted for candidate c00025c0f6594942bd14688ade17cb0e in this term.
I20260709 13:05:46.858690 12100 catalog_manager.cc:5789] TS c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905) does not have the latest schema for tablet 6b9f87e57a6d4cb99b1fcd62ea87691b (table soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]). Expected version 1 got 0
I20260709 13:05:46.861457 12098 catalog_manager.cc:5789] TS f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793) does not have the latest schema for tablet a3d34a9b02754ff5ba682f7b6f960ab1 (table soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]). Expected version 1 got 0
I20260709 13:05:46.861836 12347 raft_consensus.cc:2468] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 3.
I20260709 13:05:46.898625 12634 raft_consensus.cc:515] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:46.902043 12100 catalog_manager.cc:5697] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "8094d462961742bdbb1b497a71355a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:46.910909 12200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e107fbfc8174ff58fb3bdbb9077606a" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24"
I20260709 13:05:46.893501 12685 raft_consensus.cc:515] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:46.917596 12195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3beb77c94044e94a8cf4318a473a13b" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24"
I20260709 13:05:46.918205 12274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3beb77c94044e94a8cf4318a473a13b" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
I20260709 13:05:46.918562 12195 raft_consensus.cc:2393] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in current term 3: Already voted for candidate 8094d462961742bdbb1b497a71355a24 in this term.
I20260709 13:05:46.921797   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:46.922055 12200 raft_consensus.cc:2468] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in term 3.
I20260709 13:05:46.923609 12317 leader_election.cc:304] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 
I20260709 13:05:46.929116 12685 leader_election.cc:290] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 election: Requested vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:46.930048 12274 raft_consensus.cc:2468] T f3beb77c94044e94a8cf4318a473a13b P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in term 3.
I20260709 13:05:46.932338 12314 leader_election.cc:304] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24
I20260709 13:05:46.930120 12685 raft_consensus.cc:2804] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:46.938869 12634 leader_election.cc:290] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 election: Requested vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:46.940626 12274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e107fbfc8174ff58fb3bdbb9077606a" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
I20260709 13:05:46.941700 12274 raft_consensus.cc:2393] T 1e107fbfc8174ff58fb3bdbb9077606a P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in current term 3: Already voted for candidate c00025c0f6594942bd14688ade17cb0e in this term.
I20260709 13:05:46.938462 12716 raft_consensus.cc:2804] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:46.943809 12716 raft_consensus.cc:697] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 LEADER]: Becoming Leader. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Running, Role: LEADER
I20260709 13:05:46.952503 12693 raft_consensus.cc:493] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.953471 12693 raft_consensus.cc:515] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:46.956465 12693 leader_election.cc:290] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:46.958233 12274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ef162d93c6a4ad2bba817bce6bbad60" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:46.958400 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ef162d93c6a4ad2bba817bce6bbad60" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:46.959324 12274 raft_consensus.cc:2468] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 3.
I20260709 13:05:46.959239 12349 raft_consensus.cc:2468] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 2.
I20260709 13:05:46.960630 12165 leader_election.cc:304] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e; no voters: 
I20260709 13:05:46.946326 12685 raft_consensus.cc:697] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 LEADER]: Becoming Leader. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Running, Role: LEADER
I20260709 13:05:46.962983 12685 consensus_queue.cc:237] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:46.973546 12099 catalog_manager.cc:5789] TS c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905) does not have the latest schema for tablet a3d34a9b02754ff5ba682f7b6f960ab1 (table soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]). Expected version 1 got 0
I20260709 13:05:46.975708 12713 raft_consensus.cc:2804] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:46.976246 12713 raft_consensus.cc:493] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:46.976585 12713 raft_consensus.cc:3060] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:46.945161 12716 consensus_queue.cc:237] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:46.982775 12270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0051bc6e9d314fcca7be8439e6fa998f"
dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
mode: GRACEFUL
new_leader_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
 from {username='slave'} at 127.0.0.1:46092
I20260709 13:05:46.983526 12270 raft_consensus.cc:606] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [term 2 LEADER]: Received request to transfer leadership to TS f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:46.985457   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:05:46.986390   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:46.992074 12713 raft_consensus.cc:515] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:46.994887 12713 leader_election.cc:290] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 4 election: Requested vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:46.996220 12274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ef162d93c6a4ad2bba817bce6bbad60" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
I20260709 13:05:46.997591 12274 raft_consensus.cc:3060] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:46.998106 12710 tablet.cc:1724] T a3d34a9b02754ff5ba682f7b6f960ab1 P c00025c0f6594942bd14688ade17cb0e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:46.996230 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ef162d93c6a4ad2bba817bce6bbad60" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
I20260709 13:05:47.005982 12712 raft_consensus.cc:493] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.006845 12712 raft_consensus.cc:515] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:47.006148 12349 raft_consensus.cc:3060] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:05:47.011016 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53cb67f3c6240549cb8672a5d254db7" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:47.011744 12345 raft_consensus.cc:2468] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 2.
I20260709 13:05:47.012452 12200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53cb67f3c6240549cb8672a5d254db7" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:47.014972 12693 raft_consensus.cc:493] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.015271 12099 catalog_manager.cc:5789] TS c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905) does not have the latest schema for tablet a3d34a9b02754ff5ba682f7b6f960ab1 (table soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]). Expected version 1 got 0
I20260709 13:05:47.015575 12693 raft_consensus.cc:515] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:47.016408 12712 leader_election.cc:290] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:47.013758 12200 raft_consensus.cc:2468] T c53cb67f3c6240549cb8672a5d254db7 P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 3.
I20260709 13:05:47.018440 12693 leader_election.cc:290] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:47.019810 12240 leader_election.cc:304] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 
I20260709 13:05:47.021613 12712 raft_consensus.cc:2804] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:47.022076 12712 raft_consensus.cc:493] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:47.022460 12712 raft_consensus.cc:3060] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:47.023254 12277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcd0d96ef5ec4e6782b4e4a056db2b4f" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:47.024282 12277 raft_consensus.cc:2410] T bcd0d96ef5ec4e6782b4e4a056db2b4f P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8094d462961742bdbb1b497a71355a24 for term 4 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:05:47.025338 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcd0d96ef5ec4e6782b4e4a056db2b4f" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:47.027820 12165 leader_election.cc:304] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8094d462961742bdbb1b497a71355a24; no voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:47.029119 12693 raft_consensus.cc:2749] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:47.031373 12693 raft_consensus.cc:493] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.032032 12712 raft_consensus.cc:515] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:47.032032 12693 raft_consensus.cc:515] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:47.035219 12349 raft_consensus.cc:2468] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 4.
I20260709 13:05:47.036747 12277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3beb77c94044e94a8cf4318a473a13b" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:47.037493 12165 leader_election.cc:304] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 
I20260709 13:05:47.037796 12277 raft_consensus.cc:2468] T f3beb77c94044e94a8cf4318a473a13b P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 3.
I20260709 13:05:47.038381 12713 raft_consensus.cc:2804] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:47.039553 12713 raft_consensus.cc:697] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [term 4 LEADER]: Becoming Leader. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Running, Role: LEADER
I20260709 13:05:47.039898 12693 leader_election.cc:290] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:47.032678 12099 catalog_manager.cc:5697] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 reported cstate change: term changed from 2 to 3, leader changed from 8094d462961742bdbb1b497a71355a24 (127.0.107.193) to f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:47.042729 12099 catalog_manager.cc:5789] TS f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793) does not have the latest schema for tablet 1e107fbfc8174ff58fb3bdbb9077606a (table soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]). Expected version 1 got 0
I20260709 13:05:47.043793 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3beb77c94044e94a8cf4318a473a13b" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:47.044543 12274 raft_consensus.cc:2468] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 4.
I20260709 13:05:47.044613 12200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53cb67f3c6240549cb8672a5d254db7" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24"
I20260709 13:05:47.040853 12713 consensus_queue.cc:237] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:47.045400 12200 raft_consensus.cc:3060] T c53cb67f3c6240549cb8672a5d254db7 P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:47.049052 12165 leader_election.cc:304] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e; no voters: 
I20260709 13:05:47.040105 12685 raft_consensus.cc:493] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c00025c0f6594942bd14688ade17cb0e)
I20260709 13:05:47.052944 12685 raft_consensus.cc:515] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:47.053836 12693 raft_consensus.cc:2804] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:47.056648 12693 raft_consensus.cc:493] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:47.057045 12195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcd0d96ef5ec4e6782b4e4a056db2b4f" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:47.058411 12685 leader_election.cc:290] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:47.058938 12195 raft_consensus.cc:2393] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in current term 3: Already voted for candidate 8094d462961742bdbb1b497a71355a24 in this term.
I20260709 13:05:47.057132 12693 raft_consensus.cc:3060] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:47.062448 12274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcd0d96ef5ec4e6782b4e4a056db2b4f" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:47.063174 12274 raft_consensus.cc:2468] T bcd0d96ef5ec4e6782b4e4a056db2b4f P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in term 3.
I20260709 13:05:47.064208 12314 leader_election.cc:304] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24
I20260709 13:05:47.070070 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53cb67f3c6240549cb8672a5d254db7" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
I20260709 13:05:47.071130 12349 raft_consensus.cc:3060] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:05:47.073468 12685 raft_consensus.cc:2804] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:47.074492 12685 raft_consensus.cc:493] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c00025c0f6594942bd14688ade17cb0e)
I20260709 13:05:47.077316 12685 raft_consensus.cc:3060] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:47.067111 12712 leader_election.cc:290] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 4 election: Requested vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:47.080850 12100 catalog_manager.cc:5697] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 reported cstate change: term changed from 2 to 3, leader changed from c00025c0f6594942bd14688ade17cb0e (127.0.107.194) to f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:47.085503 12693 raft_consensus.cc:515] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:47.087387 12200 raft_consensus.cc:2468] T c53cb67f3c6240549cb8672a5d254db7 P 8094d462961742bdbb1b497a71355a24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 4.
I20260709 13:05:47.089498 12243 leader_election.cc:304] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e; no voters: 
I20260709 13:05:47.090760 12274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3beb77c94044e94a8cf4318a473a13b" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
I20260709 13:05:47.091279 12712 raft_consensus.cc:2804] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:47.091508 12274 raft_consensus.cc:3060] T f3beb77c94044e94a8cf4318a473a13b P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:47.091908 12712 raft_consensus.cc:697] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [term 4 LEADER]: Becoming Leader. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Running, Role: LEADER
I20260709 13:05:47.092928 12712 consensus_queue.cc:237] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:47.102310 12274 raft_consensus.cc:2468] T f3beb77c94044e94a8cf4318a473a13b P c00025c0f6594942bd14688ade17cb0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8094d462961742bdbb1b497a71355a24 in term 4.
I20260709 13:05:47.103817 12349 raft_consensus.cc:2468] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 4.
I20260709 13:05:47.104255 12165 leader_election.cc:304] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e; no voters: 
I20260709 13:05:47.105182 12694 raft_consensus.cc:2804] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:47.105737 12694 raft_consensus.cc:697] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [term 4 LEADER]: Becoming Leader. State: Replica: 8094d462961742bdbb1b497a71355a24, State: Running, Role: LEADER
I20260709 13:05:47.105675 12685 raft_consensus.cc:515] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:47.107052 12694 consensus_queue.cc:237] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:47.110369 12277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcd0d96ef5ec4e6782b4e4a056db2b4f" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
I20260709 13:05:47.108168 12685 leader_election.cc:290] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 election: Requested vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:47.109223 12200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcd0d96ef5ec4e6782b4e4a056db2b4f" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24"
I20260709 13:05:47.113945 12200 raft_consensus.cc:2393] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in current term 3: Already voted for candidate 8094d462961742bdbb1b497a71355a24 in this term.
I20260709 13:05:47.123564 12693 leader_election.cc:290] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [CANDIDATE]: Term 4 election: Requested vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:47.123744 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3beb77c94044e94a8cf4318a473a13b" candidate_uuid: "8094d462961742bdbb1b497a71355a24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
I20260709 13:05:47.125909 12100 catalog_manager.cc:5697] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8094d462961742bdbb1b497a71355a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:47.128021 12100 catalog_manager.cc:5789] TS 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607) does not have the latest schema for tablet 1ef162d93c6a4ad2bba817bce6bbad60 (table soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]). Expected version 1 got 0
I20260709 13:05:47.131067 12277 raft_consensus.cc:2468] T bcd0d96ef5ec4e6782b4e4a056db2b4f P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in term 3.
I20260709 13:05:47.137125 12314 leader_election.cc:304] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24
I20260709 13:05:47.139609 12099 catalog_manager.cc:5697] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c00025c0f6594942bd14688ade17cb0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:47.141328 12685 raft_consensus.cc:2804] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:47.141963 12685 raft_consensus.cc:697] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 LEADER]: Becoming Leader. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Running, Role: LEADER
I20260709 13:05:47.142935 12685 consensus_queue.cc:237] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:47.160310 12100 catalog_manager.cc:5697] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 reported cstate change: term changed from 3 to 4, leader changed from f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195) to 8094d462961742bdbb1b497a71355a24 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "8094d462961742bdbb1b497a71355a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:47.165699 12097 catalog_manager.cc:5697] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 reported cstate change: term changed from 2 to 3, leader changed from c00025c0f6594942bd14688ade17cb0e (127.0.107.194) to f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:47.168253 12097 catalog_manager.cc:5789] TS f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793) does not have the latest schema for tablet bcd0d96ef5ec4e6782b4e4a056db2b4f (table soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]). Expected version 1 got 0
I20260709 13:05:47.341899 12712 raft_consensus.cc:993] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e: : Instructing follower f706a4ebbb9e4c9f9d0a9259f1ac73e4 to start an election
I20260709 13:05:47.342446 12633 raft_consensus.cc:1081] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [term 2 LEADER]: Signalling peer f706a4ebbb9e4c9f9d0a9259f1ac73e4 to start an election
I20260709 13:05:47.344372 12349 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0051bc6e9d314fcca7be8439e6fa998f"
dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
 from {username='slave'} at 127.0.0.1:34214
I20260709 13:05:47.344978 12349 raft_consensus.cc:493] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:47.345438 12349 raft_consensus.cc:3060] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:47.351019 12277 raft_consensus.cc:1275] T 33f0e3ad1e4344cf8177322fec690c78 P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Refusing update from remote peer 8094d462961742bdbb1b497a71355a24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:47.352716 12694 consensus_queue.cc:1048] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:47.354205 12349 raft_consensus.cc:515] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:47.356655 12349 leader_election.cc:290] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 election: Requested vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:47.357255 12200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0051bc6e9d314fcca7be8439e6fa998f" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8094d462961742bdbb1b497a71355a24"
I20260709 13:05:47.357959 12200 raft_consensus.cc:3060] T 0051bc6e9d314fcca7be8439e6fa998f P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:47.366199 12274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0051bc6e9d314fcca7be8439e6fa998f" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
I20260709 13:05:47.367017 12274 raft_consensus.cc:3055] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:47.367352 12274 raft_consensus.cc:740] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Running, Role: LEADER
I20260709 13:05:47.368232 12274 consensus_queue.cc:260] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:47.369997 12274 raft_consensus.cc:3060] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:47.378756 12274 raft_consensus.cc:2468] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in term 3.
I20260709 13:05:47.380764 12314 leader_election.cc:304] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 
I20260709 13:05:47.381580 12200 raft_consensus.cc:2468] T 0051bc6e9d314fcca7be8439e6fa998f P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in term 3.
I20260709 13:05:47.382540 12685 raft_consensus.cc:2804] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:47.383081 12685 raft_consensus.cc:697] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 LEADER]: Becoming Leader. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Running, Role: LEADER
I20260709 13:05:47.384145 12685 consensus_queue.cc:237] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:47.388229 12349 raft_consensus.cc:1275] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Refusing update from remote peer 8094d462961742bdbb1b497a71355a24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:47.390551 12693 consensus_queue.cc:1048] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:47.398985 12195 raft_consensus.cc:1275] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Refusing update from remote peer f706a4ebbb9e4c9f9d0a9259f1ac73e4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:47.401713 12716 consensus_queue.cc:1048] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:47.406538 12100 catalog_manager.cc:5697] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 reported cstate change: term changed from 2 to 3, leader changed from c00025c0f6594942bd14688ade17cb0e (127.0.107.194) to f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:47.411150 12685 raft_consensus.cc:493] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8094d462961742bdbb1b497a71355a24)
I20260709 13:05:47.411886 12685 raft_consensus.cc:515] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:47.416008 12201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb3962ca7144e23a7f8e13cb66c5691" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:47.416939 12201 raft_consensus.cc:2468] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in term 3.
I20260709 13:05:47.419416 12317 leader_election.cc:304] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 
I20260709 13:05:47.420768 12716 raft_consensus.cc:2804] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:47.421247 12716 raft_consensus.cc:493] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8094d462961742bdbb1b497a71355a24)
I20260709 13:05:47.421679 12716 raft_consensus.cc:3060] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:47.431653 12716 raft_consensus.cc:515] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:47.434069 12097 catalog_manager.cc:5789] TS 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607) does not have the latest schema for tablet 1e107fbfc8174ff58fb3bdbb9077606a (table soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]). Expected version 1 got 0
I20260709 13:05:47.435544 12274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb3962ca7144e23a7f8e13cb66c5691" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e" is_pre_election: true
I20260709 13:05:47.436484 12274 raft_consensus.cc:2393] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in current term 3: Already voted for candidate c00025c0f6594942bd14688ade17cb0e in this term.
I20260709 13:05:47.448969 12274 raft_consensus.cc:1275] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e [term 4 FOLLOWER]: Refusing update from remote peer 8094d462961742bdbb1b497a71355a24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:47.450937 12693 consensus_queue.cc:1048] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:47.455044 12277 raft_consensus.cc:1275] T 1e107fbfc8174ff58fb3bdbb9077606a P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Refusing update from remote peer f706a4ebbb9e4c9f9d0a9259f1ac73e4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:47.459481 12685 leader_election.cc:290] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:47.466105 12200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb3962ca7144e23a7f8e13cb66c5691" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24"
I20260709 13:05:47.469064 12100 catalog_manager.cc:5789] TS 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607) does not have the latest schema for tablet 1e107fbfc8174ff58fb3bdbb9077606a (table soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]). Expected version 1 got 0
I20260709 13:05:47.472234 12634 consensus_queue.cc:1048] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:47.475265 12195 raft_consensus.cc:1240] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [term 4 LEADER]: Rejecting Update request from peer f706a4ebbb9e4c9f9d0a9259f1ac73e4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:47.480772 12345 raft_consensus.cc:1275] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 4 FOLLOWER]: Refusing update from remote peer c00025c0f6594942bd14688ade17cb0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:47.483944 12712 consensus_queue.cc:1048] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:47.492774 12716 leader_election.cc:290] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 election: Requested vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:47.493716 12716 consensus_queue.cc:1059] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:47.495102 12277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb3962ca7144e23a7f8e13cb66c5691" candidate_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
I20260709 13:05:47.500509 12345 raft_consensus.cc:1275] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 4 FOLLOWER]: Refusing update from remote peer 8094d462961742bdbb1b497a71355a24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:47.503103 12693 consensus_queue.cc:1048] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:47.505564 12273 raft_consensus.cc:1240] T f3beb77c94044e94a8cf4318a473a13b P c00025c0f6594942bd14688ade17cb0e [term 4 FOLLOWER]: Rejecting Update request from peer f706a4ebbb9e4c9f9d0a9259f1ac73e4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:47.497046 12277 raft_consensus.cc:2393] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in current term 3: Already voted for candidate c00025c0f6594942bd14688ade17cb0e in this term.
I20260709 13:05:47.495106 12716 consensus_queue.cc:1243] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Peer 8094d462961742bdbb1b497a71355a24 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:05:47.516961 12685 raft_consensus.cc:3055] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:47.518226 12712 raft_consensus.cc:493] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.519033 12712 raft_consensus.cc:515] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:47.520709 12634 consensus_queue.cc:1059] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:47.517545 12685 raft_consensus.cc:740] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Running, Role: LEADER
I20260709 13:05:47.523108 12685 consensus_queue.cc:260] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:47.525964 12195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb3962ca7144e23a7f8e13cb66c5691" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8094d462961742bdbb1b497a71355a24" is_pre_election: true
I20260709 13:05:47.526892 12200 raft_consensus.cc:2468] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f706a4ebbb9e4c9f9d0a9259f1ac73e4 in term 3.
I20260709 13:05:47.532323 12317 leader_election.cc:304] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:47.535308 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb3962ca7144e23a7f8e13cb66c5691" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" is_pre_election: true
I20260709 13:05:47.536128 12734 raft_consensus.cc:2804] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:47.536268 12712 leader_election.cc:290] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:47.539418 12685 raft_consensus.cc:3060] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:47.543282 12200 raft_consensus.cc:1275] T c53cb67f3c6240549cb8672a5d254db7 P 8094d462961742bdbb1b497a71355a24 [term 4 FOLLOWER]: Refusing update from remote peer c00025c0f6594942bd14688ade17cb0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:47.541510 12734 raft_consensus.cc:697] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 LEADER]: Becoming Leader. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Running, Role: LEADER
I20260709 13:05:47.545567 12633 consensus_queue.cc:1048] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:47.548930 12734 consensus_queue.cc:237] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:47.558259 12100 catalog_manager.cc:5789] TS f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793) does not have the latest schema for tablet 1ef162d93c6a4ad2bba817bce6bbad60 (table soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]). Expected version 1 got 0
I20260709 13:05:47.573830 12240 leader_election.cc:304] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c00025c0f6594942bd14688ade17cb0e; no voters: 8094d462961742bdbb1b497a71355a24, f706a4ebbb9e4c9f9d0a9259f1ac73e4
I20260709 13:05:47.574322 12097 catalog_manager.cc:5789] TS c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905) does not have the latest schema for tablet 1ef162d93c6a4ad2bba817bce6bbad60 (table soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]). Expected version 1 got 0
I20260709 13:05:47.581413 12633 raft_consensus.cc:2749] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:47.593380 12099 catalog_manager.cc:5789] TS c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905) does not have the latest schema for tablet 1e107fbfc8174ff58fb3bdbb9077606a (table soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]). Expected version 1 got 0
I20260709 13:05:47.610951 12097 catalog_manager.cc:5789] TS f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793) does not have the latest schema for tablet 1e107fbfc8174ff58fb3bdbb9077606a (table soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]). Expected version 1 got 0
I20260709 13:05:47.611824 12097 catalog_manager.cc:5789] TS f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793) does not have the latest schema for tablet 1ef162d93c6a4ad2bba817bce6bbad60 (table soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]). Expected version 1 got 0
I20260709 13:05:47.612628 12097 catalog_manager.cc:5697] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 reported cstate change: term changed from 2 to 3, leader changed from 8094d462961742bdbb1b497a71355a24 (127.0.107.193) to f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:47.633590 12100 catalog_manager.cc:5789] TS c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905) does not have the latest schema for tablet 1ef162d93c6a4ad2bba817bce6bbad60 (table soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]). Expected version 1 got 0
I20260709 13:05:47.645040 12349 raft_consensus.cc:1275] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 4 FOLLOWER]: Refusing update from remote peer 8094d462961742bdbb1b497a71355a24: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:05:47.645489 12349 pending_rounds.cc:85] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Aborting all ops after (but not including) 2
I20260709 13:05:47.645740 12349 pending_rounds.cc:107] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:05:47.646036 12349 raft_consensus.cc:2889] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:47.651036 12636 consensus_queue.cc:1048] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:47.657724 12098 catalog_manager.cc:5789] TS 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607) does not have the latest schema for tablet 1ef162d93c6a4ad2bba817bce6bbad60 (table soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]). Expected version 1 got 0
I20260709 13:05:47.678694 12274 raft_consensus.cc:1275] T bcd0d96ef5ec4e6782b4e4a056db2b4f P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Refusing update from remote peer f706a4ebbb9e4c9f9d0a9259f1ac73e4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:05:47.681434 12685 consensus_queue.cc:1048] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:47.682272 12274 raft_consensus.cc:1275] T f3beb77c94044e94a8cf4318a473a13b P c00025c0f6594942bd14688ade17cb0e [term 4 FOLLOWER]: Refusing update from remote peer 8094d462961742bdbb1b497a71355a24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:47.689621 12693 consensus_queue.cc:1048] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:47.702695 12743 tablet.cc:1724] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:47.730464 12747 tablet.cc:1724] T bcd0d96ef5ec4e6782b4e4a056db2b4f P c00025c0f6594942bd14688ade17cb0e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:47.742837 12741 tablet.cc:1724] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:47.751370 12100 catalog_manager.cc:5789] TS c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905) does not have the latest schema for tablet bcd0d96ef5ec4e6782b4e4a056db2b4f (table soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]). Expected version 1 got 0
I20260709 13:05:47.745003 12742 tablet.cc:1724] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:47.770218 12200 raft_consensus.cc:1275] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Refusing update from remote peer f706a4ebbb9e4c9f9d0a9259f1ac73e4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:05:47.772315 12733 consensus_queue.cc:1048] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:47.766475 12746 tablet.cc:1724] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:47.805380 12741 tablet.cc:1724] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:47.813939 12747 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:53214 (request call id 20) took 2438 ms. Trace:
I20260709 13:05:47.814710 12747 rpcz_store.cc:276] 0709 13:05:45.375348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.375515 (+   167us) service_pool.cc:224] Handling call
0709 13:05:47.813683 (+2438168us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:45.396262 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0709 13:05:45.396923 (+   661us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0709 13:05:45.396953 (+    30us) alter_schema_op.cc:66] Acquired schema lock
0709 13:05:45.396999 (+    46us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0709 13:05:45.397129 (+   130us) alter_schema_op.cc:128] START. Timestamp: 1783602345397044
0709 13:05:45.397158 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:05:45.397851 (+   693us) log.cc:844] Serialized 204 byte log entry
0709 13:05:45.591467 (+193616us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b180031e700. stack: 00007f1b7de70343 00007f1b7de70240 00007f1b7d7ff1d4 00007f1b8753d304 00007f1b8753d299 00007f1b86d6ade1 00007f1b86d775b1 00007f1b7dea2522 00007f1b7dea47c1 00007f1b7dea4779 00007f1b7dea4709 00007f1b7dea46d1 00007f1b7dea39cd 000000000038f354 000000000038f199 00007f1b7de8583a
0709 13:05:47.719980 (+2128513us) op_driver.cc:464] REPLICATION: finished
0709 13:05:47.730096 (+ 10116us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0709 13:05:47.748852 (+ 18756us) log.cc:844] Serialized 5 byte log entry
0709 13:05:47.789643 (+ 40791us) tablet_metadata.cc:665] Metadata flushed
0709 13:05:47.813369 (+ 23726us) log.cc:844] Serialized 14 byte log entry
0709 13:05:47.813496 (+   127us) alter_schema_op.cc:73] Released schema lock
0709 13:05:47.813533 (+    37us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":9561,"mutex_wait_us":1890,"prepare.queue_time_us":18875,"prepare.run_cpu_time_us":22961,"prepare.run_wall_time_us":169847,"raft.queue_time_us":7341,"raft.run_cpu_time_us":1708,"raft.run_wall_time_us":43863,"replication_time_us":2322622,"spinlock_wait_cycles":6387072,"thread_start_us":234018,"threads_started":4,"wal-append.queue_time_us":117746,"wal-append.run_cpu_time_us":2638,"wal-append.run_wall_time_us":1067172}]]}
I20260709 13:05:47.841796 12098 catalog_manager.cc:5789] TS f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793) does not have the latest schema for tablet 1e107fbfc8174ff58fb3bdbb9077606a (table soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]). Expected version 1 got 0
I20260709 13:05:47.846871 12100 catalog_manager.cc:5789] TS 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607) does not have the latest schema for tablet bcd0d96ef5ec4e6782b4e4a056db2b4f (table soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff]). Expected version 1 got 0
I20260709 13:05:47.842113 12746 tablet.cc:1724] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:47.851598 12747 tablet.cc:1724] T 1e107fbfc8174ff58fb3bdbb9077606a P c00025c0f6594942bd14688ade17cb0e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:47.860085 12749 tablet.cc:1724] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:47.888238 12200 raft_consensus.cc:1275] T 0051bc6e9d314fcca7be8439e6fa998f P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Refusing update from remote peer f706a4ebbb9e4c9f9d0a9259f1ac73e4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:47.890697 12717 consensus_queue.cc:1048] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:47.913542 12100 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 3d16d2bb6db54c5e9b922e7bed56092a: soft_deleted_table [id=9bdbde58f1fd4b1aa3285ff5e00fd7ff] alter complete (version 1)
I20260709 13:05:47.923866 12277 raft_consensus.cc:1275] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Refusing update from remote peer f706a4ebbb9e4c9f9d0a9259f1ac73e4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:47.927029 12716 consensus_queue.cc:1048] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:47.957501 12200 raft_consensus.cc:1275] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Refusing update from remote peer f706a4ebbb9e4c9f9d0a9259f1ac73e4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:47.959029 12716 consensus_queue.cc:1048] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:47.972047 12277 raft_consensus.cc:1275] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Refusing update from remote peer f706a4ebbb9e4c9f9d0a9259f1ac73e4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:47.974045 12716 consensus_queue.cc:1048] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:48.048250   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:48.089458 12345 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0051bc6e9d314fcca7be8439e6fa998f"
dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
mode: GRACEFUL
new_leader_uuid: "c00025c0f6594942bd14688ade17cb0e"
 from {username='slave'} at 127.0.0.1:35982
I20260709 13:05:48.090457 12345 raft_consensus.cc:606] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 LEADER]: Received request to transfer leadership to TS c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:48.092473   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:05:48.093139   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:48.417665 12685 raft_consensus.cc:993] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4: : Instructing follower c00025c0f6594942bd14688ade17cb0e to start an election
I20260709 13:05:48.418155 12734 raft_consensus.cc:1081] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 LEADER]: Signalling peer c00025c0f6594942bd14688ade17cb0e to start an election
I20260709 13:05:48.420239 12277 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0051bc6e9d314fcca7be8439e6fa998f"
dest_uuid: "c00025c0f6594942bd14688ade17cb0e"
 from {username='slave'} at 127.0.0.1:53242
I20260709 13:05:48.420902 12277 raft_consensus.cc:493] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:48.421299 12277 raft_consensus.cc:3060] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:48.428613 12277 raft_consensus.cc:515] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:48.431092 12277 leader_election.cc:290] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 4 election: Requested vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195:34793)
I20260709 13:05:48.432327 12200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0051bc6e9d314fcca7be8439e6fa998f" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8094d462961742bdbb1b497a71355a24"
I20260709 13:05:48.432962 12200 raft_consensus.cc:3060] T 0051bc6e9d314fcca7be8439e6fa998f P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:48.433349 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0051bc6e9d314fcca7be8439e6fa998f" candidate_uuid: "c00025c0f6594942bd14688ade17cb0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4"
I20260709 13:05:48.434262 12345 raft_consensus.cc:3055] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:48.435214 12345 raft_consensus.cc:740] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f706a4ebbb9e4c9f9d0a9259f1ac73e4, State: Running, Role: LEADER
I20260709 13:05:48.436295 12345 consensus_queue.cc:260] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:48.437896 12345 raft_consensus.cc:3060] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:48.439543 12200 raft_consensus.cc:2468] T 0051bc6e9d314fcca7be8439e6fa998f P 8094d462961742bdbb1b497a71355a24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 4.
I20260709 13:05:48.440778 12243 leader_election.cc:304] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e; no voters: 
I20260709 13:05:48.441545 12712 raft_consensus.cc:2804] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:48.448199 12345 raft_consensus.cc:2468] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c00025c0f6594942bd14688ade17cb0e in term 4.
I20260709 13:05:48.455129 12712 raft_consensus.cc:697] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [term 4 LEADER]: Becoming Leader. State: Replica: c00025c0f6594942bd14688ade17cb0e, State: Running, Role: LEADER
I20260709 13:05:48.457345 12712 consensus_queue.cc:237] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:48.469707 12100 catalog_manager.cc:5697] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e reported cstate change: term changed from 3 to 4, leader changed from f706a4ebbb9e4c9f9d0a9259f1ac73e4 (127.0.107.195) to c00025c0f6594942bd14688ade17cb0e (127.0.107.194). New cstate: current_term: 4 leader_uuid: "c00025c0f6594942bd14688ade17cb0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:48.845055 12200 raft_consensus.cc:1275] T 0051bc6e9d314fcca7be8439e6fa998f P 8094d462961742bdbb1b497a71355a24 [term 4 FOLLOWER]: Refusing update from remote peer c00025c0f6594942bd14688ade17cb0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:48.847553 12712 consensus_queue.cc:1048] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:48.876011 12345 raft_consensus.cc:1275] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 4 FOLLOWER]: Refusing update from remote peer c00025c0f6594942bd14688ade17cb0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:48.882506 12757 consensus_queue.cc:1048] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:49.186008   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:05:49.239948   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:49.240962   431 tablet_replica.cc:333] T 49c766b4b3c24f7db3ed4de1e794a0d3 P 8094d462961742bdbb1b497a71355a24: stopping tablet replica
I20260709 13:05:49.242344   431 raft_consensus.cc:2243] T 49c766b4b3c24f7db3ed4de1e794a0d3 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.243098   431 raft_consensus.cc:2272] T 49c766b4b3c24f7db3ed4de1e794a0d3 P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.245873   431 tablet_replica.cc:333] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24: stopping tablet replica
I20260709 13:05:49.246662   431 raft_consensus.cc:2243] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.247164   431 raft_consensus.cc:2272] T 1e107fbfc8174ff58fb3bdbb9077606a P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.249586   431 tablet_replica.cc:333] T 9036b076f3c64c818c3c9f94f6c4acf9 P 8094d462961742bdbb1b497a71355a24: stopping tablet replica
I20260709 13:05:49.250880   431 raft_consensus.cc:2243] T 9036b076f3c64c818c3c9f94f6c4acf9 P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.251713   431 raft_consensus.cc:2272] T 9036b076f3c64c818c3c9f94f6c4acf9 P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.255085   431 tablet_replica.cc:333] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24: stopping tablet replica
I20260709 13:05:49.255861   431 raft_consensus.cc:2243] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.256772   431 raft_consensus.cc:2272] T a3d34a9b02754ff5ba682f7b6f960ab1 P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.259910   431 tablet_replica.cc:333] T 6d42d833844a46f48d7b08d9129648b8 P 8094d462961742bdbb1b497a71355a24: stopping tablet replica
I20260709 13:05:49.260587   431 raft_consensus.cc:2243] T 6d42d833844a46f48d7b08d9129648b8 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.261251   431 raft_consensus.cc:2272] T 6d42d833844a46f48d7b08d9129648b8 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.263681   431 tablet_replica.cc:333] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P 8094d462961742bdbb1b497a71355a24: stopping tablet replica
I20260709 13:05:49.264317   431 raft_consensus.cc:2243] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.264878   431 raft_consensus.cc:2272] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P 8094d462961742bdbb1b497a71355a24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.267458   431 tablet_replica.cc:333] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24: stopping tablet replica
I20260709 13:05:49.268179   431 raft_consensus.cc:2243] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.269054   431 raft_consensus.cc:2272] T 6b9f87e57a6d4cb99b1fcd62ea87691b P 8094d462961742bdbb1b497a71355a24 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.271831   431 tablet_replica.cc:333] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24: stopping tablet replica
I20260709 13:05:49.272657   431 raft_consensus.cc:2243] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.273540   431 raft_consensus.cc:2272] T bcd0d96ef5ec4e6782b4e4a056db2b4f P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.277180   431 tablet_replica.cc:333] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24: stopping tablet replica
I20260709 13:05:49.278594   431 raft_consensus.cc:2243] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.280167   431 raft_consensus.cc:2272] T 1ef162d93c6a4ad2bba817bce6bbad60 P 8094d462961742bdbb1b497a71355a24 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.284253   431 tablet_replica.cc:333] T 0051bc6e9d314fcca7be8439e6fa998f P 8094d462961742bdbb1b497a71355a24: stopping tablet replica
I20260709 13:05:49.285370   431 raft_consensus.cc:2243] T 0051bc6e9d314fcca7be8439e6fa998f P 8094d462961742bdbb1b497a71355a24 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.285905   431 raft_consensus.cc:2272] T 0051bc6e9d314fcca7be8439e6fa998f P 8094d462961742bdbb1b497a71355a24 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.289172   431 tablet_replica.cc:333] T c53cb67f3c6240549cb8672a5d254db7 P 8094d462961742bdbb1b497a71355a24: stopping tablet replica
I20260709 13:05:49.290145   431 raft_consensus.cc:2243] T c53cb67f3c6240549cb8672a5d254db7 P 8094d462961742bdbb1b497a71355a24 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.290742   431 raft_consensus.cc:2272] T c53cb67f3c6240549cb8672a5d254db7 P 8094d462961742bdbb1b497a71355a24 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.293816   431 tablet_replica.cc:333] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24: stopping tablet replica
I20260709 13:05:49.294543   431 raft_consensus.cc:2243] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.295836   431 raft_consensus.cc:2272] T 33f0e3ad1e4344cf8177322fec690c78 P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.298784   431 tablet_replica.cc:333] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24: stopping tablet replica
I20260709 13:05:49.299816   431 raft_consensus.cc:2243] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.300473   431 raft_consensus.cc:2272] T 6cb3962ca7144e23a7f8e13cb66c5691 P 8094d462961742bdbb1b497a71355a24 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.302990   431 tablet_replica.cc:333] T 03a56ae904c84229be46c9d8773eb639 P 8094d462961742bdbb1b497a71355a24: stopping tablet replica
I20260709 13:05:49.303572   431 raft_consensus.cc:2243] T 03a56ae904c84229be46c9d8773eb639 P 8094d462961742bdbb1b497a71355a24 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.304591   431 raft_consensus.cc:2272] T 03a56ae904c84229be46c9d8773eb639 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.307089   431 tablet_replica.cc:333] T aea38e5274ba452894df20a69755dbda P 8094d462961742bdbb1b497a71355a24: stopping tablet replica
I20260709 13:05:49.307705   431 raft_consensus.cc:2243] T aea38e5274ba452894df20a69755dbda P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.308223   431 raft_consensus.cc:2272] T aea38e5274ba452894df20a69755dbda P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.311125   431 tablet_replica.cc:333] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24: stopping tablet replica
I20260709 13:05:49.312007   431 raft_consensus.cc:2243] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.313482   431 raft_consensus.cc:2272] T f3beb77c94044e94a8cf4318a473a13b P 8094d462961742bdbb1b497a71355a24 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.316040   431 tablet_replica.cc:333] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24: stopping tablet replica
I20260709 13:05:49.316707   431 raft_consensus.cc:2243] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.317340   431 raft_consensus.cc:2272] T 20eda87dc6e642ad8791304d782e09a1 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.320096   431 tablet_replica.cc:333] T 4c030549c2814e2b949de006d26f5514 P 8094d462961742bdbb1b497a71355a24: stopping tablet replica
I20260709 13:05:49.320698   431 raft_consensus.cc:2243] T 4c030549c2814e2b949de006d26f5514 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.321249   431 raft_consensus.cc:2272] T 4c030549c2814e2b949de006d26f5514 P 8094d462961742bdbb1b497a71355a24 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:49.335005 12243 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 19 similar messages]
W20260709 13:05:49.340624 12243 consensus_peers.cc:597] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e -> Peer 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607): Couldn't send request to peer 8094d462961742bdbb1b497a71355a24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:49.346395 12243 consensus_peers.cc:597] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e -> Peer 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607): Couldn't send request to peer 8094d462961742bdbb1b497a71355a24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:49.364316 12243 consensus_peers.cc:597] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e -> Peer 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607): Couldn't send request to peer 8094d462961742bdbb1b497a71355a24. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:49.383646   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:05:49.392935 12317 consensus_peers.cc:597] T 20eda87dc6e642ad8791304d782e09a1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 -> Peer 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607): Couldn't send request to peer 8094d462961742bdbb1b497a71355a24. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:49.430878 12317 consensus_peers.cc:597] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 -> Peer 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607): Couldn't send request to peer 8094d462961742bdbb1b497a71355a24. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:49.443403   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:05:49.480561 12314 consensus_peers.cc:597] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 -> Peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Couldn't send request to peer c00025c0f6594942bd14688ade17cb0e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:49.500242 12317 consensus_peers.cc:597] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 -> Peer 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607): Couldn't send request to peer 8094d462961742bdbb1b497a71355a24. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:49.504127 12314 consensus_peers.cc:597] T 4c030549c2814e2b949de006d26f5514 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 -> Peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Couldn't send request to peer c00025c0f6594942bd14688ade17cb0e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:49.515967   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:49.517648   431 tablet_replica.cc:333] T 49c766b4b3c24f7db3ed4de1e794a0d3 P c00025c0f6594942bd14688ade17cb0e: stopping tablet replica
I20260709 13:05:49.519752   431 raft_consensus.cc:2243] T 49c766b4b3c24f7db3ed4de1e794a0d3 P c00025c0f6594942bd14688ade17cb0e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.521188   431 raft_consensus.cc:2272] T 49c766b4b3c24f7db3ed4de1e794a0d3 P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.524387   431 tablet_replica.cc:333] T 1e107fbfc8174ff58fb3bdbb9077606a P c00025c0f6594942bd14688ade17cb0e: stopping tablet replica
W20260709 13:05:49.524402 12243 consensus_peers.cc:597] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P c00025c0f6594942bd14688ade17cb0e -> Peer 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607): Couldn't send request to peer 8094d462961742bdbb1b497a71355a24. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:49.526448   431 raft_consensus.cc:2243] T 1e107fbfc8174ff58fb3bdbb9077606a P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.528306   431 raft_consensus.cc:2272] T 1e107fbfc8174ff58fb3bdbb9077606a P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:49.528306 12243 consensus_peers.cc:597] T aea38e5274ba452894df20a69755dbda P c00025c0f6594942bd14688ade17cb0e -> Peer 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607): Couldn't send request to peer 8094d462961742bdbb1b497a71355a24. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:49.534067   431 tablet_replica.cc:333] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e: stopping tablet replica
I20260709 13:05:49.534883   431 raft_consensus.cc:2243] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.535480   431 raft_consensus.cc:2272] T 6b9f87e57a6d4cb99b1fcd62ea87691b P c00025c0f6594942bd14688ade17cb0e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.538450   431 tablet_replica.cc:333] T 6d42d833844a46f48d7b08d9129648b8 P c00025c0f6594942bd14688ade17cb0e: stopping tablet replica
I20260709 13:05:49.539714   431 raft_consensus.cc:2243] T 6d42d833844a46f48d7b08d9129648b8 P c00025c0f6594942bd14688ade17cb0e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.541404   431 raft_consensus.cc:2272] T 6d42d833844a46f48d7b08d9129648b8 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.545946   431 tablet_replica.cc:333] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P c00025c0f6594942bd14688ade17cb0e: stopping tablet replica
I20260709 13:05:49.546766   431 raft_consensus.cc:2243] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P c00025c0f6594942bd14688ade17cb0e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.548460   431 raft_consensus.cc:2272] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P c00025c0f6594942bd14688ade17cb0e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.552871   431 tablet_replica.cc:333] T bcd0d96ef5ec4e6782b4e4a056db2b4f P c00025c0f6594942bd14688ade17cb0e: stopping tablet replica
I20260709 13:05:49.553627   431 raft_consensus.cc:2243] T bcd0d96ef5ec4e6782b4e4a056db2b4f P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.554173   431 raft_consensus.cc:2272] T bcd0d96ef5ec4e6782b4e4a056db2b4f P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.556941   431 tablet_replica.cc:333] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e: stopping tablet replica
I20260709 13:05:49.557976   431 raft_consensus.cc:2243] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.558681   431 raft_consensus.cc:2272] T 1ef162d93c6a4ad2bba817bce6bbad60 P c00025c0f6594942bd14688ade17cb0e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.561669   431 tablet_replica.cc:333] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e: stopping tablet replica
I20260709 13:05:49.562383   431 raft_consensus.cc:2243] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.563277   431 raft_consensus.cc:2272] T 0051bc6e9d314fcca7be8439e6fa998f P c00025c0f6594942bd14688ade17cb0e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.566646   431 tablet_replica.cc:333] T aea38e5274ba452894df20a69755dbda P c00025c0f6594942bd14688ade17cb0e: stopping tablet replica
I20260709 13:05:49.567361   431 raft_consensus.cc:2243] T aea38e5274ba452894df20a69755dbda P c00025c0f6594942bd14688ade17cb0e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.568356   431 raft_consensus.cc:2272] T aea38e5274ba452894df20a69755dbda P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.571780   431 tablet_replica.cc:333] T 33f0e3ad1e4344cf8177322fec690c78 P c00025c0f6594942bd14688ade17cb0e: stopping tablet replica
I20260709 13:05:49.572750   431 raft_consensus.cc:2243] T 33f0e3ad1e4344cf8177322fec690c78 P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.573453   431 raft_consensus.cc:2272] T 33f0e3ad1e4344cf8177322fec690c78 P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.577286   431 tablet_replica.cc:333] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e: stopping tablet replica
I20260709 13:05:49.580103   431 raft_consensus.cc:2243] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.583415   431 raft_consensus.cc:2272] T c53cb67f3c6240549cb8672a5d254db7 P c00025c0f6594942bd14688ade17cb0e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.586344   431 tablet_replica.cc:333] T 20eda87dc6e642ad8791304d782e09a1 P c00025c0f6594942bd14688ade17cb0e: stopping tablet replica
I20260709 13:05:49.587011   431 raft_consensus.cc:2243] T 20eda87dc6e642ad8791304d782e09a1 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.587535   431 raft_consensus.cc:2272] T 20eda87dc6e642ad8791304d782e09a1 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.591830   431 tablet_replica.cc:333] T f3beb77c94044e94a8cf4318a473a13b P c00025c0f6594942bd14688ade17cb0e: stopping tablet replica
I20260709 13:05:49.593341   431 raft_consensus.cc:2243] T f3beb77c94044e94a8cf4318a473a13b P c00025c0f6594942bd14688ade17cb0e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.594296   431 raft_consensus.cc:2272] T f3beb77c94044e94a8cf4318a473a13b P c00025c0f6594942bd14688ade17cb0e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.598312   431 tablet_replica.cc:333] T 4c030549c2814e2b949de006d26f5514 P c00025c0f6594942bd14688ade17cb0e: stopping tablet replica
W20260709 13:05:49.599136 12317 consensus_peers.cc:597] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 -> Peer 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607): Couldn't send request to peer 8094d462961742bdbb1b497a71355a24. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:49.599797   431 raft_consensus.cc:2243] T 4c030549c2814e2b949de006d26f5514 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.600437   431 raft_consensus.cc:2272] T 4c030549c2814e2b949de006d26f5514 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.602876   431 tablet_replica.cc:333] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e: stopping tablet replica
I20260709 13:05:49.603785   431 raft_consensus.cc:2243] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.604403   431 raft_consensus.cc:2272] T 03a56ae904c84229be46c9d8773eb639 P c00025c0f6594942bd14688ade17cb0e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.611407   431 tablet_replica.cc:333] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e: stopping tablet replica
W20260709 13:05:49.614490 12317 consensus_peers.cc:597] T 4c030549c2814e2b949de006d26f5514 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 -> Peer 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607): Couldn't send request to peer 8094d462961742bdbb1b497a71355a24. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:49.614686   431 raft_consensus.cc:2243] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.615996   431 raft_consensus.cc:2272] T 6cb3962ca7144e23a7f8e13cb66c5691 P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.626986   431 tablet_replica.cc:333] T a3d34a9b02754ff5ba682f7b6f960ab1 P c00025c0f6594942bd14688ade17cb0e: stopping tablet replica
I20260709 13:05:49.628350   431 raft_consensus.cc:2243] T a3d34a9b02754ff5ba682f7b6f960ab1 P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.629356   431 raft_consensus.cc:2272] T a3d34a9b02754ff5ba682f7b6f960ab1 P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.635092   431 tablet_replica.cc:333] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e: stopping tablet replica
I20260709 13:05:49.636111   431 raft_consensus.cc:2243] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.637496   431 raft_consensus.cc:2272] T 9036b076f3c64c818c3c9f94f6c4acf9 P c00025c0f6594942bd14688ade17cb0e [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:49.660077 12314 consensus_peers.cc:597] T 20eda87dc6e642ad8791304d782e09a1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 -> Peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Couldn't send request to peer c00025c0f6594942bd14688ade17cb0e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:49.844452 12314 consensus_peers.cc:597] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 -> Peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Couldn't send request to peer c00025c0f6594942bd14688ade17cb0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:37905: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:49.863529 12314 consensus_peers.cc:597] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 -> Peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Couldn't send request to peer c00025c0f6594942bd14688ade17cb0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:37905: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:50.467377 12770 raft_consensus.cc:493] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8094d462961742bdbb1b497a71355a24)
I20260709 13:05:50.468628 12770 raft_consensus.cc:515] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:50.471172 12770 leader_election.cc:290] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
W20260709 13:05:50.478662 12317 leader_election.cc:336] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37607: connect: Connection refused (error 111)
W20260709 13:05:50.482635 12314 leader_election.cc:336] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37905: connect: Connection refused (error 111)
I20260709 13:05:50.489719 12314 leader_election.cc:304] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:50.490679 12770 raft_consensus.cc:2749] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:50.547619 12770 raft_consensus.cc:493] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8094d462961742bdbb1b497a71355a24)
I20260709 13:05:50.548302 12770 raft_consensus.cc:515] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:50.550864 12770 leader_election.cc:290] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
W20260709 13:05:50.555739 12317 leader_election.cc:336] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37607: connect: Connection refused (error 111)
W20260709 13:05:50.557508 12314 leader_election.cc:336] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37905: connect: Connection refused (error 111)
I20260709 13:05:50.557906 12314 leader_election.cc:304] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:50.558815 12770 raft_consensus.cc:2749] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:50.581924 12770 raft_consensus.cc:493] T 49c766b4b3c24f7db3ed4de1e794a0d3 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c00025c0f6594942bd14688ade17cb0e)
I20260709 13:05:50.582315 12771 raft_consensus.cc:493] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8094d462961742bdbb1b497a71355a24)
I20260709 13:05:50.583062 12771 raft_consensus.cc:515] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:50.582593 12770 raft_consensus.cc:515] T 49c766b4b3c24f7db3ed4de1e794a0d3 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:50.586061 12771 leader_election.cc:290] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:50.589257 12770 leader_election.cc:290] T 49c766b4b3c24f7db3ed4de1e794a0d3 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
W20260709 13:05:50.592808 12314 leader_election.cc:336] T 49c766b4b3c24f7db3ed4de1e794a0d3 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37905: connect: Connection refused (error 111)
W20260709 13:05:50.593647 12314 leader_election.cc:336] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37905: connect: Connection refused (error 111)
W20260709 13:05:50.594724 12317 leader_election.cc:336] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37607: connect: Connection refused (error 111)
I20260709 13:05:50.595240 12317 leader_election.cc:304] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:50.595981 12770 raft_consensus.cc:2749] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:05:50.596225 12317 leader_election.cc:336] T 49c766b4b3c24f7db3ed4de1e794a0d3 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37607: connect: Connection refused (error 111)
I20260709 13:05:50.596740 12317 leader_election.cc:304] T 49c766b4b3c24f7db3ed4de1e794a0d3 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:50.597401 12770 raft_consensus.cc:2749] T 49c766b4b3c24f7db3ed4de1e794a0d3 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:50.612920 12770 raft_consensus.cc:493] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8094d462961742bdbb1b497a71355a24)
I20260709 13:05:50.614003 12770 raft_consensus.cc:515] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:50.616426 12770 leader_election.cc:290] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
W20260709 13:05:50.621210 12317 leader_election.cc:336] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37607: connect: Connection refused (error 111)
W20260709 13:05:50.622148 12314 leader_election.cc:336] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37905: connect: Connection refused (error 111)
I20260709 13:05:50.622783 12314 leader_election.cc:304] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:50.623767 12770 raft_consensus.cc:2749] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:50.655553 12770 raft_consensus.cc:493] T 03a56ae904c84229be46c9d8773eb639 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8094d462961742bdbb1b497a71355a24)
I20260709 13:05:50.656462 12770 raft_consensus.cc:515] T 03a56ae904c84229be46c9d8773eb639 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:50.659610 12770 leader_election.cc:290] T 03a56ae904c84229be46c9d8773eb639 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607)
W20260709 13:05:50.664439 12314 leader_election.cc:336] T 03a56ae904c84229be46c9d8773eb639 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37905: connect: Connection refused (error 111)
W20260709 13:05:50.665824 12317 leader_election.cc:336] T 03a56ae904c84229be46c9d8773eb639 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37607: connect: Connection refused (error 111)
I20260709 13:05:50.666339 12317 leader_election.cc:304] T 03a56ae904c84229be46c9d8773eb639 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:50.667197 12770 raft_consensus.cc:2749] T 03a56ae904c84229be46c9d8773eb639 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:50.687803 12770 raft_consensus.cc:493] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8094d462961742bdbb1b497a71355a24)
I20260709 13:05:50.688560 12770 raft_consensus.cc:515] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:50.691177 12770 leader_election.cc:290] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
W20260709 13:05:50.697152 12317 leader_election.cc:336] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37607: connect: Connection refused (error 111)
W20260709 13:05:50.698169 12314 leader_election.cc:336] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37905: connect: Connection refused (error 111)
I20260709 13:05:50.698552 12314 leader_election.cc:304] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:50.699199 12770 raft_consensus.cc:2749] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:05:50.719574   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 12298)
I20260709 13:05:50.826759 12770 raft_consensus.cc:493] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c00025c0f6594942bd14688ade17cb0e)
I20260709 13:05:50.828538 12770 raft_consensus.cc:515] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:50.831169 12770 leader_election.cc:290] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
W20260709 13:05:50.836233 12314 leader_election.cc:336] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37905: connect: Connection refused (error 111)
W20260709 13:05:50.837527 12317 leader_election.cc:336] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37607: connect: Connection refused (error 111)
I20260709 13:05:50.837944 12317 leader_election.cc:304] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:50.838958 12770 raft_consensus.cc:2749] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:50.850303 12770 raft_consensus.cc:493] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c00025c0f6594942bd14688ade17cb0e)
I20260709 13:05:50.850899 12770 raft_consensus.cc:515] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:50.852888 12770 leader_election.cc:290] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
W20260709 13:05:50.857136 12317 leader_election.cc:336] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37607: connect: Connection refused (error 111)
W20260709 13:05:50.857717 12314 leader_election.cc:336] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37905: connect: Connection refused (error 111)
I20260709 13:05:50.858084 12314 leader_election.cc:304] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:50.858724 12770 raft_consensus.cc:2749] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:50.859503 12771 raft_consensus.cc:493] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c00025c0f6594942bd14688ade17cb0e)
I20260709 13:05:50.860078 12771 raft_consensus.cc:515] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:50.862789 12771 leader_election.cc:290] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
W20260709 13:05:50.867998 12317 leader_election.cc:336] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37607: connect: Connection refused (error 111)
W20260709 13:05:50.870695 12314 leader_election.cc:336] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37905: connect: Connection refused (error 111)
I20260709 13:05:50.871057 12314 leader_election.cc:304] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:50.871848 12771 raft_consensus.cc:2749] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:50.900589 12770 raft_consensus.cc:493] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c00025c0f6594942bd14688ade17cb0e)
I20260709 13:05:50.901515 12770 raft_consensus.cc:515] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:50.904481 12770 leader_election.cc:290] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
W20260709 13:05:50.918542 12317 leader_election.cc:336] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37607: connect: Connection refused (error 111)
W20260709 13:05:50.921265 12314 leader_election.cc:336] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37905: connect: Connection refused (error 111)
I20260709 13:05:50.921711 12314 leader_election.cc:304] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:50.922420 12770 raft_consensus.cc:2749] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:50.994532 12770 raft_consensus.cc:493] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c00025c0f6594942bd14688ade17cb0e)
I20260709 13:05:50.995278 12770 raft_consensus.cc:515] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:50.997889 12770 leader_election.cc:290] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
W20260709 13:05:51.002235 12317 leader_election.cc:336] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37607: connect: Connection refused (error 111)
W20260709 13:05:51.003342 12314 leader_election.cc:336] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37905: connect: Connection refused (error 111)
I20260709 13:05:51.003911 12314 leader_election.cc:304] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:51.005004 12770 raft_consensus.cc:2749] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:51.085949 12770 raft_consensus.cc:493] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c00025c0f6594942bd14688ade17cb0e)
I20260709 13:05:51.086550 12770 raft_consensus.cc:515] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:51.090147 12770 leader_election.cc:290] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
W20260709 13:05:51.094712 12314 leader_election.cc:336] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37905: connect: Connection refused (error 111)
W20260709 13:05:51.095595 12317 leader_election.cc:336] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37607: connect: Connection refused (error 111)
I20260709 13:05:51.096004 12317 leader_election.cc:304] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:51.097393 12770 raft_consensus.cc:2749] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:05:51.720415   431 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 12298)
W20260709 13:05:51.831911 12317 consensus_peers.cc:597] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 -> Peer 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607): Couldn't send request to peer 8094d462961742bdbb1b497a71355a24. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:51.899169 12317 consensus_peers.cc:597] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 -> Peer 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607): Couldn't send request to peer 8094d462961742bdbb1b497a71355a24. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:51.909791 12317 consensus_peers.cc:597] T 20eda87dc6e642ad8791304d782e09a1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 -> Peer 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607): Couldn't send request to peer 8094d462961742bdbb1b497a71355a24. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:52.015420 12317 consensus_peers.cc:597] T 4c030549c2814e2b949de006d26f5514 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 -> Peer 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607): Couldn't send request to peer 8094d462961742bdbb1b497a71355a24. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:52.034430 12314 consensus_peers.cc:597] T 4c030549c2814e2b949de006d26f5514 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 -> Peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Couldn't send request to peer c00025c0f6594942bd14688ade17cb0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:37905: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:52.069285 12314 consensus_peers.cc:597] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 -> Peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Couldn't send request to peer c00025c0f6594942bd14688ade17cb0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:37905: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:52.078727 12317 consensus_peers.cc:597] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 -> Peer 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607): Couldn't send request to peer 8094d462961742bdbb1b497a71355a24. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:52.188839 12770 raft_consensus.cc:493] T 03a56ae904c84229be46c9d8773eb639 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8094d462961742bdbb1b497a71355a24)
I20260709 13:05:52.190246 12770 raft_consensus.cc:515] T 03a56ae904c84229be46c9d8773eb639 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:52.192217 12770 leader_election.cc:290] T 03a56ae904c84229be46c9d8773eb639 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905), 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607)
W20260709 13:05:52.197844 12314 leader_election.cc:336] T 03a56ae904c84229be46c9d8773eb639 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37905: connect: Connection refused (error 111)
W20260709 13:05:52.198869 12317 leader_election.cc:336] T 03a56ae904c84229be46c9d8773eb639 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37607: connect: Connection refused (error 111)
I20260709 13:05:52.199249 12317 leader_election.cc:304] T 03a56ae904c84229be46c9d8773eb639 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:52.200188 12770 raft_consensus.cc:2749] T 03a56ae904c84229be46c9d8773eb639 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:52.252791   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:05:52.274405 12314 consensus_peers.cc:597] T 20eda87dc6e642ad8791304d782e09a1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 -> Peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Couldn't send request to peer c00025c0f6594942bd14688ade17cb0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:37905: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:52.276146 12770 raft_consensus.cc:493] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8094d462961742bdbb1b497a71355a24)
I20260709 13:05:52.276988 12770 raft_consensus.cc:515] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:52.281543 12770 leader_election.cc:290] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
W20260709 13:05:52.293555 12317 leader_election.cc:336] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37607: connect: Connection refused (error 111)
W20260709 13:05:52.294467 12314 leader_election.cc:336] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37905: connect: Connection refused (error 111)
I20260709 13:05:52.294971 12314 leader_election.cc:304] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:52.295753 12770 raft_consensus.cc:2749] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:05:52.296026 12314 consensus_peers.cc:597] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 -> Peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Couldn't send request to peer c00025c0f6594942bd14688ade17cb0e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:37905: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:52.323581   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:05:52.378547   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:52.379396   431 tablet_replica.cc:333] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4: stopping tablet replica
I20260709 13:05:52.380752   431 raft_consensus.cc:2243] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:52.381680   431 raft_consensus.cc:2272] T 6b9f87e57a6d4cb99b1fcd62ea87691b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:52.384418   431 tablet_replica.cc:333] T 49c766b4b3c24f7db3ed4de1e794a0d3 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: stopping tablet replica
I20260709 13:05:52.385358   431 raft_consensus.cc:2243] T 49c766b4b3c24f7db3ed4de1e794a0d3 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:52.386022   431 raft_consensus.cc:2272] T 49c766b4b3c24f7db3ed4de1e794a0d3 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:52.388705   431 tablet_replica.cc:333] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P f706a4ebbb9e4c9f9d0a9259f1ac73e4: stopping tablet replica
I20260709 13:05:52.389864   431 raft_consensus.cc:2243] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:52.390704   431 raft_consensus.cc:2272] T 0f5ae9bf6da2464a80a3a9c8cf2c54dd P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:52.393190   431 tablet_replica.cc:333] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4: stopping tablet replica
I20260709 13:05:52.393858   431 raft_consensus.cc:2243] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:52.394706   431 raft_consensus.cc:2272] T bcd0d96ef5ec4e6782b4e4a056db2b4f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:52.396844   431 tablet_replica.cc:333] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4: stopping tablet replica
I20260709 13:05:52.397512   431 raft_consensus.cc:2243] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:52.398360   431 raft_consensus.cc:2272] T 1e107fbfc8174ff58fb3bdbb9077606a P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:52.400589   431 tablet_replica.cc:333] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: stopping tablet replica
I20260709 13:05:52.401234   431 raft_consensus.cc:2243] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:52.401811   431 raft_consensus.cc:2272] T 1ef162d93c6a4ad2bba817bce6bbad60 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:52.404660   431 tablet_replica.cc:333] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4: stopping tablet replica
I20260709 13:05:52.405364   431 raft_consensus.cc:2243] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:52.405829   431 raft_consensus.cc:2272] T 0051bc6e9d314fcca7be8439e6fa998f P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:52.408656   431 tablet_replica.cc:333] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: stopping tablet replica
I20260709 13:05:52.409581   431 raft_consensus.cc:2243] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:52.410373   431 raft_consensus.cc:2272] T 6d42d833844a46f48d7b08d9129648b8 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:52.412655   431 tablet_replica.cc:333] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4: stopping tablet replica
I20260709 13:05:52.413275   431 raft_consensus.cc:2243] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:52.413727   431 raft_consensus.cc:2272] T aea38e5274ba452894df20a69755dbda P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:52.417013   431 tablet_replica.cc:333] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4: stopping tablet replica
I20260709 13:05:52.417973   431 raft_consensus.cc:2243] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:52.418506   431 raft_consensus.cc:2272] T f3beb77c94044e94a8cf4318a473a13b P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:52.420723 12770 raft_consensus.cc:493] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8094d462961742bdbb1b497a71355a24)
I20260709 13:05:52.421237 12770 raft_consensus.cc:515] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8094d462961742bdbb1b497a71355a24" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37607 } } peers { permanent_uuid: "c00025c0f6594942bd14688ade17cb0e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37905 } } peers { permanent_uuid: "f706a4ebbb9e4c9f9d0a9259f1ac73e4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34793 } }
I20260709 13:05:52.421756   431 tablet_replica.cc:333] T 20eda87dc6e642ad8791304d782e09a1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: stopping tablet replica
I20260709 13:05:52.422981   431 raft_consensus.cc:2243] T 20eda87dc6e642ad8791304d782e09a1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:52.424319   431 raft_consensus.cc:2272] T 20eda87dc6e642ad8791304d782e09a1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:52.424636 12770 leader_election.cc:290] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607), c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905)
I20260709 13:05:52.429399   431 tablet_replica.cc:333] T 4c030549c2814e2b949de006d26f5514 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: stopping tablet replica
W20260709 13:05:52.430011 12314 leader_election.cc:336] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c00025c0f6594942bd14688ade17cb0e (127.0.107.194:37905): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37905: connect: Connection refused (error 111)
I20260709 13:05:52.430537   431 raft_consensus.cc:2243] T 4c030549c2814e2b949de006d26f5514 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:05:52.430740 12317 leader_election.cc:336] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8094d462961742bdbb1b497a71355a24 (127.0.107.193:37607): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37607: connect: Connection refused (error 111)
I20260709 13:05:52.431244 12317 leader_election.cc:304] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f706a4ebbb9e4c9f9d0a9259f1ac73e4; no voters: 8094d462961742bdbb1b497a71355a24, c00025c0f6594942bd14688ade17cb0e
I20260709 13:05:52.431646   431 raft_consensus.cc:2272] T 4c030549c2814e2b949de006d26f5514 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:52.432247 12770 raft_consensus.cc:2749] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:52.434167   431 tablet_replica.cc:333] T 03a56ae904c84229be46c9d8773eb639 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: stopping tablet replica
I20260709 13:05:52.435039   431 raft_consensus.cc:2243] T 03a56ae904c84229be46c9d8773eb639 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:52.435570   431 raft_consensus.cc:2272] T 03a56ae904c84229be46c9d8773eb639 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:52.437760   431 tablet_replica.cc:333] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: stopping tablet replica
I20260709 13:05:52.438318   431 raft_consensus.cc:2243] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:52.439194   431 raft_consensus.cc:2272] T 6cb3962ca7144e23a7f8e13cb66c5691 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:52.442026   431 tablet_replica.cc:333] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: stopping tablet replica
I20260709 13:05:52.442894   431 raft_consensus.cc:2243] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:52.443655   431 raft_consensus.cc:2272] T 9036b076f3c64c818c3c9f94f6c4acf9 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:52.450693   431 tablet_replica.cc:333] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: stopping tablet replica
I20260709 13:05:52.451294   431 raft_consensus.cc:2243] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:52.451833   431 raft_consensus.cc:2272] T a3d34a9b02754ff5ba682f7b6f960ab1 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:52.453874   431 tablet_replica.cc:333] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: stopping tablet replica
I20260709 13:05:52.454442   431 raft_consensus.cc:2243] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:52.455258   431 raft_consensus.cc:2272] T c53cb67f3c6240549cb8672a5d254db7 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:52.457374   431 tablet_replica.cc:333] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4: stopping tablet replica
I20260709 13:05:52.457878   431 raft_consensus.cc:2243] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:52.458314   431 raft_consensus.cc:2272] T 33f0e3ad1e4344cf8177322fec690c78 P f706a4ebbb9e4c9f9d0a9259f1ac73e4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:52.514277   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:05:52.570447   431 master.cc:562] Master@127.0.107.254:37307 shutting down...
I20260709 13:05:52.612635   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3d16d2bb6db54c5e9b922e7bed56092a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:52.613340   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3d16d2bb6db54c5e9b922e7bed56092a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:52.613705   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3d16d2bb6db54c5e9b922e7bed56092a: stopping tablet replica
I20260709 13:05:52.680719   431 master.cc:584] Master@127.0.107.254:37307 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (21264 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (35928 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (372753 ms total)
[  PASSED  ] 8 tests.
I20260709 13:05:52.778775   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:5107: suppressed but not reported on 1 messages since previous log ~6 seconds ago
I20260709 13:05:52.779027   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 685 messages since previous log ~573 seconds ago
I20260709 13:05:52.779168   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 685 messages since previous log ~573 seconds ago
I20260709 13:05:52.779309   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 685 messages since previous log ~573 seconds ago
I20260709 13:05:52.779454   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~44 seconds ago
I20260709 13:05:52.779599   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~44 seconds ago
I20260709 13:05:52.780315   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 4 messages since previous log ~149 seconds ago
I20260709 13:05:52.780717   431 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 3 messages since previous log ~216 seconds ago
I20260709 13:05:52.790035   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 3 messages since previous log ~216 seconds ago
I20260709 13:05:52.790364   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 98 messages since previous log ~3 seconds ago
I20260709 13:05:52.790524   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 52 messages since previous log ~20 seconds ago
